2023-10-06T02:09:39.019 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T02:09:39.019 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} --name yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412141 --owner scheduled_yuriw@teuthology --verbose -- /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412141/orig.config.yaml 2023-10-06T02:09:39.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T02:09:39.146 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412141 branch: wip-yuri-testing-2023-10-05-0730-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} email: yweinste@redhat.com first_in_suite: false job_id: '7412141' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-05-0730-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-05-0730-quincy sha1: f1e315a9732d36c05ec316678e2397dc58561c7f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7519 sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-05-0730-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f1e315a9732d36c05ec316678e2397dc58561c7f targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJKZlYzKIoGjt9JFShyDF3oIYG1ZkOSvbkkzfJQ7aXa7ji9xesq8T8H2iwcL2Cnnfcmkm3GdqofyWGlMdZ1KwSk= smithi191.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI+eWs6loppbmZWAWipjk8z8S8JkotjVclCjsg9hRbEYaaxuuKNuoqQ/fC4yOBXcb5I4YN2Ki9rolXWP+DPBhSI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:52:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T02:09:39.147 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa; will attempt to use it 2023-10-06T02:09:39.147 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa/tasks 2023-10-06T02:09:39.147 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T02:09:39.149 INFO:teuthology.task.internal:Checking packages... 2023-10-06T02:09:39.171 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2' 2023-10-06T02:09:39.171 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T02:09:39.171 INFO:teuthology.packaging:ref: None 2023-10-06T02:09:39.172 INFO:teuthology.packaging:tag: None 2023-10-06T02:09:39.172 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T02:09:39.172 INFO:teuthology.packaging:sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:09:39.172 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T02:09:39.312 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1296.gf1e315a9 2023-10-06T02:09:39.312 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T02:09:39.320 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T02:09:39.320 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T02:09:39.328 INFO:teuthology.task.internal:Saving configuration 2023-10-06T02:09:39.344 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T02:09:39.352 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T02:09:39.379 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412141', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:04:47.736116', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJKZlYzKIoGjt9JFShyDF3oIYG1ZkOSvbkkzfJQ7aXa7ji9xesq8T8H2iwcL2Cnnfcmkm3GdqofyWGlMdZ1KwSk='} 2023-10-06T02:09:39.402 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412141', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:04:47.737577', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI+eWs6loppbmZWAWipjk8z8S8JkotjVclCjsg9hRbEYaaxuuKNuoqQ/fC4yOBXcb5I4YN2Ki9rolXWP+DPBhSI='} 2023-10-06T02:09:39.402 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T02:09:39.409 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T02:09:39.410 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T02:09:39.410 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T02:09:39.483 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f99d76cdb80>, signals=[15]) 2023-10-06T02:09:39.483 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T02:09:39.491 INFO:teuthology.task.internal:Opening connections... 2023-10-06T02:09:39.491 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:09:39.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:09:39.562 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:09:39.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:09:39.634 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T02:09:39.643 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2023-10-06T02:09:39.661 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-10-06T02:09:39.661 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-10-06T02:09:39.717 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T02:09:39.718 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T02:09:39.718 INFO:teuthology.orchestra.run.smithi037.stdout:ID="rhel" 2023-10-06T02:09:39.718 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="fedora" 2023-10-06T02:09:39.718 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8.4" 2023-10-06T02:09:39.718 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8" 2023-10-06T02:09:39.718 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T02:09:39.718 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-10-06T02:09:39.718 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T02:09:39.718 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T02:09:39.719 INFO:teuthology.orchestra.run.smithi037.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T02:09:39.719 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T02:09:39.719 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:09:39.719 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T02:09:39.719 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T02:09:39.719 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T02:09:39.719 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T02:09:39.720 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-10-06T02:09:39.746 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2023-10-06T02:09:39.760 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2023-10-06T02:09:39.760 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-10-06T02:09:39.817 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T02:09:39.817 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T02:09:39.817 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel" 2023-10-06T02:09:39.817 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora" 2023-10-06T02:09:39.817 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.4" 2023-10-06T02:09:39.817 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-10-06T02:09:39.818 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T02:09:39.818 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-10-06T02:09:39.818 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T02:09:39.818 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T02:09:39.818 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T02:09:39.818 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T02:09:39.818 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:09:39.818 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T02:09:39.818 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T02:09:39.818 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T02:09:39.818 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T02:09:39.819 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-10-06T02:09:39.837 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T02:09:39.847 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T02:09:39.856 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T02:09:39.857 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2023-10-06T02:09:39.859 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2023-10-06T02:09:39.874 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T02:09:39.882 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T02:09:39.882 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2023-10-06T02:09:39.916 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2023-10-06T02:09:39.930 INFO:teuthology.orchestra.run.smithi191.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T02:09:39.931 INFO:teuthology.orchestra.run.smithi037.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T02:09:39.932 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T02:09:39.989 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T02:09:40.004 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-06T02:09:40.005 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-06T02:09:40.005 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T02:09:40.005 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T02:09:40.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:09:40.018 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2023-10-06T02:09:40.021 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:09:40.022 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2023-10-06T02:09:40.075 INFO:teuthology.orchestra.run.smithi191.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T02:09:40.075 INFO:teuthology.task.kernel:Running kernel on smithi191: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T02:09:40.075 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum install -y kernel 2023-10-06T02:09:40.079 INFO:teuthology.orchestra.run.smithi037.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T02:09:40.079 INFO:teuthology.task.kernel:Running kernel on smithi037: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T02:09:40.079 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y kernel 2023-10-06T02:09:41.512 INFO:teuthology.orchestra.run.smithi191.stdout:Updating Subscription Management repositories. 2023-10-06T02:09:41.512 INFO:teuthology.orchestra.run.smithi191.stdout:Unable to read consumer identity 2023-10-06T02:09:41.638 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-10-06T02:09:41.639 INFO:teuthology.orchestra.run.smithi037.stdout:Unable to read consumer identity 2023-10-06T02:09:43.053 INFO:teuthology.orchestra.run.smithi037.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-10-06T02:09:43.091 INFO:teuthology.orchestra.run.smithi191.stdout:Copr repo for python3-asyncssh owned by ceph 31 kB/s | 3.5 kB 00:00 2023-10-06T02:09:43.824 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2023-10-06T02:09:43.837 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 21 MB/s | 16 MB 00:00 2023-10-06T02:09:47.151 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2023-10-06T02:09:47.341 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 4.7 MB/s | 24 kB 00:00 2023-10-06T02:09:47.907 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T02:09:47.908 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T02:09:47.908 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T02:09:48.062 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2023-10-06T02:09:48.063 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2023-10-06T02:09:48.063 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2023-10-06T02:09:48.134 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T02:09:48.134 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T02:09:48.134 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T02:09:48.180 DEBUG:teuthology.orchestra.run.smithi191:> echo no | sudo yum reinstall kernel || true 2023-10-06T02:09:48.297 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-10-06T02:09:48.298 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2023-10-06T02:09:48.298 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-10-06T02:09:48.434 DEBUG:teuthology.orchestra.run.smithi037:> echo no | sudo yum reinstall kernel || true 2023-10-06T02:09:48.526 INFO:teuthology.orchestra.run.smithi191.stdout:Updating Subscription Management repositories. 2023-10-06T02:09:48.526 INFO:teuthology.orchestra.run.smithi191.stdout:Unable to read consumer identity 2023-10-06T02:09:48.814 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:01 ago on Fri 06 Oct 2023 02:09:47 AM UTC. 2023-10-06T02:09:48.840 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-10-06T02:09:48.841 INFO:teuthology.orchestra.run.smithi037.stdout:Unable to read consumer identity 2023-10-06T02:09:48.950 INFO:teuthology.orchestra.run.smithi191.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T02:09:48.950 INFO:teuthology.orchestra.run.smithi191.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:09:48.950 INFO:teuthology.orchestra.run.smithi191.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:09:48.973 INFO:teuthology.orchestra.run.smithi191.stderr:Error: No packages marked for reinstall. 2023-10-06T02:09:49.023 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum reinstall -y kernel || true 2023-10-06T02:09:49.153 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 02:09:47 AM UTC. 2023-10-06T02:09:49.289 INFO:teuthology.orchestra.run.smithi037.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T02:09:49.289 INFO:teuthology.orchestra.run.smithi037.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:09:49.289 INFO:teuthology.orchestra.run.smithi037.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:09:49.320 INFO:teuthology.orchestra.run.smithi037.stderr:Error: No packages marked for reinstall. 2023-10-06T02:09:49.364 INFO:teuthology.orchestra.run.smithi191.stdout:Updating Subscription Management repositories. 2023-10-06T02:09:49.365 INFO:teuthology.orchestra.run.smithi191.stdout:Unable to read consumer identity 2023-10-06T02:09:49.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum reinstall -y kernel || true 2023-10-06T02:09:49.656 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 02:09:47 AM UTC. 2023-10-06T02:09:49.736 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-10-06T02:09:49.737 INFO:teuthology.orchestra.run.smithi037.stdout:Unable to read consumer identity 2023-10-06T02:09:49.791 INFO:teuthology.orchestra.run.smithi191.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T02:09:49.791 INFO:teuthology.orchestra.run.smithi191.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:09:49.791 INFO:teuthology.orchestra.run.smithi191.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:09:49.804 INFO:teuthology.orchestra.run.smithi191.stderr:Error: No packages marked for reinstall. 2023-10-06T02:09:49.855 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T02:09:49.979 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:09:49.979 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:09:49.979 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:09:49.979 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T02:09:49.979 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T02:09:49.979 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-10-06T02:09:49.980 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi191.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T02:09:49.980 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T02:09:50.031 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:03 ago on Fri 06 Oct 2023 02:09:47 AM UTC. 2023-10-06T02:09:50.104 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:09:50.105 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:09:50.105 DEBUG:teuthology.orchestra.run.smithi191:> sudo rpm -qi grub2-tools 2023-10-06T02:09:50.132 INFO:teuthology.orchestra.run.smithi191.stdout:Name : grub2-tools 2023-10-06T02:09:50.132 INFO:teuthology.orchestra.run.smithi191.stdout:Epoch : 1 2023-10-06T02:09:50.132 INFO:teuthology.orchestra.run.smithi191.stdout:Version : 2.02 2023-10-06T02:09:50.132 INFO:teuthology.orchestra.run.smithi191.stdout:Release : 99.el8_4.1 2023-10-06T02:09:50.132 INFO:teuthology.orchestra.run.smithi191.stdout:Architecture: x86_64 2023-10-06T02:09:50.132 INFO:teuthology.orchestra.run.smithi191.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T02:09:50.132 INFO:teuthology.orchestra.run.smithi191.stdout:Group : System Environment/Base 2023-10-06T02:09:50.132 INFO:teuthology.orchestra.run.smithi191.stdout:Size : 9264631 2023-10-06T02:09:50.132 INFO:teuthology.orchestra.run.smithi191.stdout:License : GPLv3+ 2023-10-06T02:09:50.132 INFO:teuthology.orchestra.run.smithi191.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T02:09:50.133 INFO:teuthology.orchestra.run.smithi191.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T02:09:50.133 INFO:teuthology.orchestra.run.smithi191.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T02:09:50.133 INFO:teuthology.orchestra.run.smithi191.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T02:09:50.133 INFO:teuthology.orchestra.run.smithi191.stdout:Relocations : (not relocatable) 2023-10-06T02:09:50.133 INFO:teuthology.orchestra.run.smithi191.stdout:Packager : Red Hat, Inc. 2023-10-06T02:09:50.133 INFO:teuthology.orchestra.run.smithi191.stdout:Vendor : Red Hat, Inc. 2023-10-06T02:09:50.133 INFO:teuthology.orchestra.run.smithi191.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T02:09:50.133 INFO:teuthology.orchestra.run.smithi191.stdout:Summary : Support tools for GRUB. 2023-10-06T02:09:50.133 INFO:teuthology.orchestra.run.smithi191.stdout:Description : 2023-10-06T02:09:50.133 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:09:50.133 INFO:teuthology.orchestra.run.smithi191.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T02:09:50.133 INFO:teuthology.orchestra.run.smithi191.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T02:09:50.133 INFO:teuthology.orchestra.run.smithi191.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T02:09:50.134 INFO:teuthology.orchestra.run.smithi191.stdout:hardware devices. 2023-10-06T02:09:50.134 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:09:50.134 INFO:teuthology.orchestra.run.smithi191.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T02:09:50.135 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T02:09:50.135 INFO:teuthology.task.kernel:Updating grub on smithi191 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:09:50.135 DEBUG:teuthology.orchestra.run.smithi191:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T02:09:50.180 INFO:teuthology.orchestra.run.smithi037.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T02:09:50.180 INFO:teuthology.orchestra.run.smithi037.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:09:50.180 INFO:teuthology.orchestra.run.smithi037.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:09:50.192 INFO:teuthology.orchestra.run.smithi037.stderr:Error: No packages marked for reinstall. 2023-10-06T02:09:50.250 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T02:09:50.380 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:09:50.380 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:09:50.380 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:09:50.380 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T02:09:50.381 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T02:09:50.381 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-06T02:09:50.381 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T02:09:50.381 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T02:09:50.511 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:09:50.512 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:09:50.512 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -qi grub2-tools 2023-10-06T02:09:50.540 INFO:teuthology.orchestra.run.smithi037.stdout:Name : grub2-tools 2023-10-06T02:09:50.540 INFO:teuthology.orchestra.run.smithi037.stdout:Epoch : 1 2023-10-06T02:09:50.540 INFO:teuthology.orchestra.run.smithi037.stdout:Version : 2.02 2023-10-06T02:09:50.540 INFO:teuthology.orchestra.run.smithi037.stdout:Release : 99.el8_4.1 2023-10-06T02:09:50.540 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: x86_64 2023-10-06T02:09:50.540 INFO:teuthology.orchestra.run.smithi037.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T02:09:50.540 INFO:teuthology.orchestra.run.smithi037.stdout:Group : System Environment/Base 2023-10-06T02:09:50.540 INFO:teuthology.orchestra.run.smithi037.stdout:Size : 9264631 2023-10-06T02:09:50.540 INFO:teuthology.orchestra.run.smithi037.stdout:License : GPLv3+ 2023-10-06T02:09:50.540 INFO:teuthology.orchestra.run.smithi037.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T02:09:50.541 INFO:teuthology.orchestra.run.smithi037.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T02:09:50.541 INFO:teuthology.orchestra.run.smithi037.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T02:09:50.541 INFO:teuthology.orchestra.run.smithi037.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T02:09:50.541 INFO:teuthology.orchestra.run.smithi037.stdout:Relocations : (not relocatable) 2023-10-06T02:09:50.541 INFO:teuthology.orchestra.run.smithi037.stdout:Packager : Red Hat, Inc. 2023-10-06T02:09:50.541 INFO:teuthology.orchestra.run.smithi037.stdout:Vendor : Red Hat, Inc. 2023-10-06T02:09:50.541 INFO:teuthology.orchestra.run.smithi037.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T02:09:50.541 INFO:teuthology.orchestra.run.smithi037.stdout:Summary : Support tools for GRUB. 2023-10-06T02:09:50.541 INFO:teuthology.orchestra.run.smithi037.stdout:Description : 2023-10-06T02:09:50.541 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:09:50.541 INFO:teuthology.orchestra.run.smithi037.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T02:09:50.542 INFO:teuthology.orchestra.run.smithi037.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T02:09:50.542 INFO:teuthology.orchestra.run.smithi037.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T02:09:50.542 INFO:teuthology.orchestra.run.smithi037.stdout:hardware devices. 2023-10-06T02:09:50.542 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:09:50.542 INFO:teuthology.orchestra.run.smithi037.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T02:09:50.543 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T02:09:50.544 INFO:teuthology.task.kernel:Updating grub on smithi037 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:09:50.544 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T02:09:51.564 INFO:teuthology.orchestra.run.smithi191.stderr:Generating grub configuration file ... 2023-10-06T02:09:51.761 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2023-10-06T02:09:54.205 INFO:teuthology.orchestra.run.smithi191.stderr:done 2023-10-06T02:09:54.207 DEBUG:teuthology.orchestra.run.smithi191:> mktemp 2023-10-06T02:09:54.231 INFO:teuthology.orchestra.run.smithi191.stdout:/tmp/tmp.2PLS298pwq 2023-10-06T02:09:54.231 DEBUG:teuthology.orchestra.run.smithi191:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.2PLS298pwq 2023-10-06T02:09:54.249 INFO:teuthology.orchestra.run.smithi037.stderr:done 2023-10-06T02:09:54.251 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2023-10-06T02:09:54.275 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.wjTKsYFioS 2023-10-06T02:09:54.275 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.wjTKsYFioS 2023-10-06T02:09:54.300 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0666 /tmp/tmp.2PLS298pwq 2023-10-06T02:09:54.344 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.wjTKsYFioS 2023-10-06T02:09:54.461 DEBUG:teuthology.orchestra.remote:smithi191:/tmp/tmp.2PLS298pwq is 6KB 2023-10-06T02:09:54.509 DEBUG:teuthology.orchestra.run.smithi191:> rm -fr /tmp/tmp.2PLS298pwq 2023-10-06T02:09:54.517 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.wjTKsYFioS is 6KB 2023-10-06T02:09:54.524 DEBUG:teuthology.orchestra.run.smithi191:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T02:09:54.567 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.wjTKsYFioS 2023-10-06T02:09:54.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T02:09:54.602 INFO:teuthology.orchestra.run.smithi191.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T02:09:54.602 INFO:teuthology.orchestra.run.smithi191.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T02:09:54.602 INFO:teuthology.orchestra.run.smithi191.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T02:09:54.602 INFO:teuthology.orchestra.run.smithi191.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T02:09:54.603 DEBUG:teuthology.orchestra.run.smithi191:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:09:54.649 INFO:teuthology.orchestra.run.smithi037.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T02:09:54.650 INFO:teuthology.orchestra.run.smithi037.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T02:09:54.650 INFO:teuthology.orchestra.run.smithi037.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T02:09:54.650 INFO:teuthology.orchestra.run.smithi037.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T02:09:54.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:09:54.778 DEBUG:teuthology.orchestra.run.smithi191:> sudo shutdown -r now 2023-10-06T02:09:54.830 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2023-10-06T02:10:24.810 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-06T02:10:24.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-06T02:10:24.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:10:24.832 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-06T02:10:24.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-06T02:10:24.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:10:43.194 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-10-06T02:10:43.195 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-10-06T02:10:52.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-06T02:10:52.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:10:52.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-06T02:10:52.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:10:55.258 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-10-06T02:11:07.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-06T02:11:07.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:11:10.586 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-10-06T02:11:22.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-06T02:11:22.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:11:23.173 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-10-06T02:11:23.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-06T02:11:23.418 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T02:11:23.418 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2023-10-06T02:11:23.473 INFO:teuthology.orchestra.run.smithi037.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T02:11:23.473 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:11:23.473 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T02:11:23.474 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T02:11:24.474 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-06T02:11:24.475 DEBUG:teuthology.orchestra.run.smithi037:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T02:11:24.655 INFO:teuthology.orchestra.run.smithi037.stdout:ttyS1 2023-10-06T02:11:24.673 DEBUG:teuthology.parallel:result is None 2023-10-06T02:11:39.126 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-10-06T02:11:39.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-06T02:11:39.489 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T02:11:39.490 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2023-10-06T02:11:39.505 INFO:teuthology.orchestra.run.smithi191.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T02:11:39.505 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:11:39.505 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T02:11:39.505 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T02:11:40.506 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-06T02:11:40.506 DEBUG:teuthology.orchestra.run.smithi191:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T02:11:41.192 INFO:teuthology.orchestra.run.smithi191.stdout:ttyS1 2023-10-06T02:11:41.237 DEBUG:teuthology.parallel:result is None 2023-10-06T02:11:41.237 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T02:11:41.244 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T02:11:41.245 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T02:11:41.249 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T02:11:41.578 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T02:11:41.585 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T02:11:41.591 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T02:11:41.591 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T02:11:41.593 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T02:11:41.888 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T02:11:41.895 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T02:11:41.895 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T02:11:41.898 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T02:11:41.944 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:11:41.957 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:11:42.217 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:11:42.238 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:11:42.240 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T02:11:42.247 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T02:11:42.247 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T02:11:42.249 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T02:11:42.705 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T02:11:42.714 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T02:11:42.714 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T02:11:42.717 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T02:11:42.765 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:11:42.817 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:11:42.864 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:11:42.949 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:11:42.993 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:11:42.993 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T02:11:43.061 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:11:43.101 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:11:43.147 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:11:43.228 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:11:43.269 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:11:43.269 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T02:11:43.334 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2023-10-06T02:11:43.336 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2023-10-06T02:11:43.403 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T02:11:43.618 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T02:11:43.855 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T02:11:43.866 INFO:teuthology.task.internal:Starting timer... 2023-10-06T02:11:43.866 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T02:11:43.881 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T02:11:43.890 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T02:11:43.891 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2023-10-06T02:11:43.946 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: [ OK ] 2023-10-06T02:11:43.948 DEBUG:teuthology.orchestra.run.smithi191:> sudo service auditd rotate 2023-10-06T02:11:44.056 INFO:teuthology.orchestra.run.smithi191.stdout:Rotating logs: [ OK ] 2023-10-06T02:11:44.057 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T02:11:44.058 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2023-10-06T02:11:44.077 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2023-10-06T02:11:44.078 DEBUG:teuthology.orchestra.run.smithi191:> /usr/sbin/getenforce 2023-10-06T02:11:44.093 INFO:teuthology.orchestra.run.smithi191.stdout:Permissive 2023-10-06T02:11:44.093 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi191.front.sepia.ceph.com': 'permissive'} 2023-10-06T02:11:44.093 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T02:11:44.147 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:11:44.148 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T02:11:44.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:11:44.172 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T02:11:44.173 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2023-10-06T02:11:44.213 DEBUG:teuthology.orchestra.run.smithi191:> sudo /usr/sbin/setenforce permissive 2023-10-06T02:11:44.238 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T02:11:44.249 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-06T02:11:44.249 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T02:11:44.266 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T02:11:44.267 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T02:20:15.822 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2023-10-06T02:20:15.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-06T02:20:15.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:20:15.893 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-10-06T02:20:15.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-06T02:20:15.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-06T02:20:15.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:20:16.031 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-10-06T02:20:16.096 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-06T02:20:16.096 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T02:20:16.108 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T02:20:16.108 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T02:20:16.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:20:16.111 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T02:20:16.111 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:20:16.139 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T02:20:16.154 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T02:20:16.164 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T02:20:16.178 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T02:20:16.203 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2023-10-06T02:20:16.213 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2023-10-06T02:20:16.219 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: ntpd: command not found 2023-10-06T02:20:16.228 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T02:20:16.230 INFO:teuthology.orchestra.run.smithi191.stdout:506 Cannot talk to daemon 2023-10-06T02:20:16.242 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T02:20:16.244 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T02:20:16.257 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T02:20:16.310 INFO:teuthology.orchestra.run.smithi037.stderr:bash: ntpq: command not found 2023-10-06T02:20:16.313 INFO:teuthology.orchestra.run.smithi037.stdout:210 Number of sources = 4 2023-10-06T02:20:16.313 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T02:20:16.313 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2023-10-06T02:20:16.313 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:20:16.313 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:20:16.313 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:20:16.313 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:20:16.321 INFO:teuthology.orchestra.run.smithi191.stderr:bash: ntpq: command not found 2023-10-06T02:20:16.323 INFO:teuthology.orchestra.run.smithi191.stdout:210 Number of sources = 4 2023-10-06T02:20:16.323 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T02:20:16.323 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2023-10-06T02:20:16.323 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:20:16.324 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:20:16.324 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:20:16.324 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:20:16.325 INFO:teuthology.run_tasks:Running task install... 2023-10-06T02:20:16.334 DEBUG:teuthology.task.install:project ceph 2023-10-06T02:20:16.334 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}} 2023-10-06T02:20:16.334 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'} 2023-10-06T02:20:16.334 INFO:teuthology.task.install:Using flavor: default 2023-10-06T02:20:16.340 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T02:20:16.340 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T02:20:16.340 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T02:20:16.340 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:20:16.342 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T02:20:16.342 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:20:16.485 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T02:20:16.485 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T02:20:16.490 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T02:20:16.490 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T02:20:16.660 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T02:20:16.660 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:20:16.660 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T02:20:16.662 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T02:20:16.662 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:20:16.662 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T02:20:16.687 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T02:20:16.687 DEBUG:teuthology.orchestra.run.smithi191:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T02:20:16.689 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T02:20:16.689 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T02:20:16.752 DEBUG:teuthology.orchestra.run.smithi191:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T02:20:16.756 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T02:20:16.826 DEBUG:teuthology.orchestra.run.smithi191:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T02:20:16.831 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T02:20:16.889 INFO:teuthology.orchestra.run.smithi191.stdout:check_obsoletes = 1 2023-10-06T02:20:16.890 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum clean all 2023-10-06T02:20:16.896 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2023-10-06T02:20:16.897 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2023-10-06T02:20:17.281 INFO:teuthology.orchestra.run.smithi191.stdout:Updating Subscription Management repositories. 2023-10-06T02:20:17.306 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-10-06T02:20:17.692 INFO:teuthology.orchestra.run.smithi191.stdout:44 files removed 2023-10-06T02:20:17.720 INFO:teuthology.orchestra.run.smithi037.stdout:44 files removed 2023-10-06T02:20:17.742 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T02:20:17.776 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T02:20:18.092 INFO:teuthology.orchestra.run.smithi191.stdout:Updating Subscription Management repositories. 2023-10-06T02:20:18.145 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-10-06T02:20:19.001 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 350 kB/s | 78 kB 00:00 2023-10-06T02:20:19.122 INFO:teuthology.orchestra.run.smithi191.stdout:ceph packages for x86_64 208 kB/s | 78 kB 00:00 2023-10-06T02:20:19.349 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 30 kB/s | 9.2 kB 00:00 2023-10-06T02:20:19.468 INFO:teuthology.orchestra.run.smithi191.stdout:ceph noarch packages 30 kB/s | 9.2 kB 00:00 2023-10-06T02:20:19.686 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 4.8 kB/s | 1.4 kB 00:00 2023-10-06T02:20:19.686 INFO:teuthology.orchestra.run.smithi191.stdout:ceph source packages 7.7 kB/s | 1.4 kB 00:00 2023-10-06T02:20:19.820 INFO:teuthology.orchestra.run.smithi191.stdout:Copr repo for python3-asyncssh owned by ceph 33 kB/s | 3.5 kB 00:00 2023-10-06T02:20:19.825 INFO:teuthology.orchestra.run.smithi037.stdout:Copr repo for python3-asyncssh owned by ceph 32 kB/s | 3.5 kB 00:00 2023-10-06T02:20:20.833 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2023-10-06T02:20:21.466 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 16 MB 00:01 2023-10-06T02:20:24.321 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2023-10-06T02:20:24.737 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 5.0 MB/s | 24 kB 00:00 2023-10-06T02:20:24.775 INFO:teuthology.orchestra.run.smithi037.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 104 MB/s | 38 MB 00:00 2023-10-06T02:20:25.144 INFO:teuthology.orchestra.run.smithi191.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 118 MB/s | 38 MB 00:00 2023-10-06T02:20:30.857 INFO:teuthology.orchestra.run.smithi037.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 64 MB/s | 33 MB 00:00 2023-10-06T02:20:30.982 INFO:teuthology.orchestra.run.smithi191.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 54 MB/s | 33 MB 00:00 2023-10-06T02:20:39.058 INFO:teuthology.orchestra.run.smithi191.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T02:20:39.058 INFO:teuthology.orchestra.run.smithi191.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T02:20:39.069 INFO:teuthology.orchestra.run.smithi191.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T02:20:39.070 INFO:teuthology.orchestra.run.smithi191.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T02:20:39.070 INFO:teuthology.orchestra.run.smithi191.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T02:20:39.071 INFO:teuthology.orchestra.run.smithi191.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T02:20:39.073 INFO:teuthology.orchestra.run.smithi191.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T02:20:39.075 INFO:teuthology.orchestra.run.smithi191.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T02:20:39.076 INFO:teuthology.orchestra.run.smithi191.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T02:20:39.210 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T02:20:39.211 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T02:20:39.222 INFO:teuthology.orchestra.run.smithi037.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T02:20:39.223 INFO:teuthology.orchestra.run.smithi037.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T02:20:39.224 INFO:teuthology.orchestra.run.smithi037.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T02:20:39.225 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T02:20:39.227 INFO:teuthology.orchestra.run.smithi037.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T02:20:39.229 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T02:20:39.230 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T02:20:39.562 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2023-10-06T02:20:39.573 INFO:teuthology.orchestra.run.smithi191.stdout:====================================================================================================================== 2023-10-06T02:20:39.574 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2023-10-06T02:20:39.574 INFO:teuthology.orchestra.run.smithi191.stdout:====================================================================================================================== 2023-10-06T02:20:39.574 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2023-10-06T02:20:39.574 INFO:teuthology.orchestra.run.smithi191.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T02:20:39.574 INFO:teuthology.orchestra.run.smithi191.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T02:20:39.574 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T02:20:39.574 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T02:20:39.574 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T02:20:39.574 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T02:20:39.575 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T02:20:39.575 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T02:20:39.575 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T02:20:39.575 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T02:20:39.575 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T02:20:39.575 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T02:20:39.575 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T02:20:39.575 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T02:20:39.575 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T02:20:39.576 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T02:20:39.576 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T02:20:39.576 INFO:teuthology.orchestra.run.smithi191.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T02:20:39.576 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T02:20:39.576 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T02:20:39.576 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T02:20:39.576 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T02:20:39.577 INFO:teuthology.orchestra.run.smithi191.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T02:20:39.577 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T02:20:39.577 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T02:20:39.577 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T02:20:39.577 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T02:20:39.577 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T02:20:39.577 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T02:20:39.577 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T02:20:39.577 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T02:20:39.577 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T02:20:39.577 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T02:20:39.578 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrading: 2023-10-06T02:20:39.578 INFO:teuthology.orchestra.run.smithi191.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T02:20:39.578 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T02:20:39.578 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2023-10-06T02:20:39.578 INFO:teuthology.orchestra.run.smithi191.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T02:20:39.578 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T02:20:39.578 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T02:20:39.578 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T02:20:39.578 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T02:20:39.578 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T02:20:39.578 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T02:20:39.579 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T02:20:39.579 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T02:20:39.579 INFO:teuthology.orchestra.run.smithi191.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T02:20:39.579 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T02:20:39.579 INFO:teuthology.orchestra.run.smithi191.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T02:20:39.579 INFO:teuthology.orchestra.run.smithi191.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T02:20:39.579 INFO:teuthology.orchestra.run.smithi191.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T02:20:39.579 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T02:20:39.579 INFO:teuthology.orchestra.run.smithi191.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T02:20:39.579 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T02:20:39.579 INFO:teuthology.orchestra.run.smithi191.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T02:20:39.579 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T02:20:39.580 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T02:20:39.580 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T02:20:39.580 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T02:20:39.580 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T02:20:39.580 INFO:teuthology.orchestra.run.smithi191.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T02:20:39.580 INFO:teuthology.orchestra.run.smithi191.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T02:20:39.580 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T02:20:39.580 INFO:teuthology.orchestra.run.smithi191.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T02:20:39.580 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T02:20:39.580 INFO:teuthology.orchestra.run.smithi191.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T02:20:39.580 INFO:teuthology.orchestra.run.smithi191.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T02:20:39.581 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T02:20:39.581 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T02:20:39.581 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T02:20:39.581 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T02:20:39.581 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T02:20:39.581 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T02:20:39.581 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T02:20:39.581 INFO:teuthology.orchestra.run.smithi191.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T02:20:39.581 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T02:20:39.581 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T02:20:39.581 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T02:20:39.581 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T02:20:39.582 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T02:20:39.582 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T02:20:39.582 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T02:20:39.582 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T02:20:39.582 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T02:20:39.582 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T02:20:39.582 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T02:20:39.582 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T02:20:39.582 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T02:20:39.582 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T02:20:39.582 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T02:20:39.583 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T02:20:39.583 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T02:20:39.583 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T02:20:39.583 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T02:20:39.583 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T02:20:39.583 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T02:20:39.583 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T02:20:39.583 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T02:20:39.583 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T02:20:39.583 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T02:20:39.584 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T02:20:39.584 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T02:20:39.584 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T02:20:39.584 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T02:20:39.584 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T02:20:39.584 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T02:20:39.584 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T02:20:39.584 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T02:20:39.584 INFO:teuthology.orchestra.run.smithi191.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T02:20:39.584 INFO:teuthology.orchestra.run.smithi191.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T02:20:39.584 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T02:20:39.585 INFO:teuthology.orchestra.run.smithi191.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T02:20:39.585 INFO:teuthology.orchestra.run.smithi191.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T02:20:39.585 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T02:20:39.585 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T02:20:39.585 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T02:20:39.585 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T02:20:39.585 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T02:20:39.585 INFO:teuthology.orchestra.run.smithi191.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T02:20:39.585 INFO:teuthology.orchestra.run.smithi191.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T02:20:39.585 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T02:20:39.586 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T02:20:39.586 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:20:39.586 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2023-10-06T02:20:39.586 INFO:teuthology.orchestra.run.smithi191.stdout:====================================================================================================================== 2023-10-06T02:20:39.586 INFO:teuthology.orchestra.run.smithi191.stdout:Install 118 Packages 2023-10-06T02:20:39.586 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrade 2 Packages 2023-10-06T02:20:39.586 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:20:39.587 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 201 M 2023-10-06T02:20:39.587 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2023-10-06T02:20:39.741 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-10-06T02:20:39.753 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================================================== 2023-10-06T02:20:39.753 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-10-06T02:20:39.753 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================================================== 2023-10-06T02:20:39.753 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-10-06T02:20:39.753 INFO:teuthology.orchestra.run.smithi037.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T02:20:39.753 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T02:20:39.753 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T02:20:39.754 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T02:20:39.754 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T02:20:39.754 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T02:20:39.754 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T02:20:39.754 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T02:20:39.754 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T02:20:39.754 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T02:20:39.754 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T02:20:39.754 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T02:20:39.754 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T02:20:39.754 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T02:20:39.755 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T02:20:39.755 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T02:20:39.755 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T02:20:39.755 INFO:teuthology.orchestra.run.smithi037.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T02:20:39.755 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T02:20:39.755 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T02:20:39.755 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T02:20:39.755 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T02:20:39.755 INFO:teuthology.orchestra.run.smithi037.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T02:20:39.755 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T02:20:39.755 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T02:20:39.755 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T02:20:39.756 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T02:20:39.756 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T02:20:39.756 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T02:20:39.756 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T02:20:39.756 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T02:20:39.756 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T02:20:39.756 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T02:20:39.756 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2023-10-06T02:20:39.756 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T02:20:39.756 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T02:20:39.756 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-10-06T02:20:39.757 INFO:teuthology.orchestra.run.smithi037.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T02:20:39.757 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T02:20:39.757 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T02:20:39.757 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T02:20:39.757 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T02:20:39.757 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T02:20:39.757 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T02:20:39.757 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T02:20:39.757 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T02:20:39.757 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T02:20:39.757 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T02:20:39.757 INFO:teuthology.orchestra.run.smithi037.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T02:20:39.758 INFO:teuthology.orchestra.run.smithi037.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T02:20:39.758 INFO:teuthology.orchestra.run.smithi037.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T02:20:39.758 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T02:20:39.758 INFO:teuthology.orchestra.run.smithi037.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T02:20:39.758 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T02:20:39.758 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T02:20:39.758 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T02:20:39.758 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T02:20:39.758 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T02:20:39.758 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T02:20:39.758 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T02:20:39.759 INFO:teuthology.orchestra.run.smithi037.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T02:20:39.759 INFO:teuthology.orchestra.run.smithi037.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T02:20:39.759 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T02:20:39.759 INFO:teuthology.orchestra.run.smithi037.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T02:20:39.759 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T02:20:39.759 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T02:20:39.759 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T02:20:39.759 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T02:20:39.759 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T02:20:39.759 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T02:20:39.759 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T02:20:39.759 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T02:20:39.760 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T02:20:39.760 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T02:20:39.760 INFO:teuthology.orchestra.run.smithi037.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T02:20:39.760 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T02:20:39.760 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T02:20:39.760 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T02:20:39.760 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T02:20:39.760 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T02:20:39.760 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T02:20:39.760 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T02:20:39.760 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T02:20:39.761 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T02:20:39.761 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T02:20:39.761 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T02:20:39.761 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T02:20:39.761 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T02:20:39.761 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T02:20:39.761 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T02:20:39.761 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T02:20:39.761 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T02:20:39.761 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T02:20:39.761 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T02:20:39.761 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T02:20:39.762 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T02:20:39.762 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T02:20:39.762 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T02:20:39.762 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T02:20:39.762 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T02:20:39.762 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T02:20:39.762 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T02:20:39.762 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T02:20:39.762 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T02:20:39.762 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T02:20:39.762 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T02:20:39.762 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T02:20:39.763 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T02:20:39.763 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T02:20:39.763 INFO:teuthology.orchestra.run.smithi037.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T02:20:39.763 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T02:20:39.763 INFO:teuthology.orchestra.run.smithi037.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T02:20:39.763 INFO:teuthology.orchestra.run.smithi037.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T02:20:39.763 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T02:20:39.763 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T02:20:39.763 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T02:20:39.763 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T02:20:39.763 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T02:20:39.763 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T02:20:39.763 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T02:20:39.764 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T02:20:39.764 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T02:20:39.764 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:20:39.764 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-10-06T02:20:39.764 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================================================== 2023-10-06T02:20:39.764 INFO:teuthology.orchestra.run.smithi037.stdout:Install 118 Packages 2023-10-06T02:20:39.764 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 2 Packages 2023-10-06T02:20:39.764 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:20:39.765 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 201 M 2023-10-06T02:20:39.765 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-10-06T02:20:39.824 INFO:teuthology.orchestra.run.smithi191.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 71 kB/s | 6.4 kB 00:00 2023-10-06T02:20:39.970 INFO:teuthology.orchestra.run.smithi191.stdout:(2/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 5.9 MB/s | 876 kB 00:00 2023-10-06T02:20:39.992 INFO:teuthology.orchestra.run.smithi191.stdout:(3/120): ceph-immutable-object-cache-17.2.6-129 7.1 MB/s | 162 kB 00:00 2023-10-06T02:20:40.041 INFO:teuthology.orchestra.run.smithi037.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 62 kB/s | 6.4 kB 00:00 2023-10-06T02:20:40.135 INFO:teuthology.orchestra.run.smithi191.stdout:(4/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 16 MB/s | 2.3 MB 00:00 2023-10-06T02:20:40.270 INFO:teuthology.orchestra.run.smithi191.stdout:(5/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 12 MB/s | 1.6 MB 00:00 2023-10-06T02:20:40.551 INFO:teuthology.orchestra.run.smithi191.stdout:(6/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 6.3 MB/s | 5.2 MB 00:00 2023-10-06T02:20:40.626 INFO:teuthology.orchestra.run.smithi191.stdout:(7/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 11 MB/s | 3.9 MB 00:00 2023-10-06T02:20:40.964 INFO:teuthology.orchestra.run.smithi037.stdout:(2/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 950 kB/s | 876 kB 00:00 2023-10-06T02:20:41.173 INFO:teuthology.orchestra.run.smithi037.stdout:(3/120): ceph-immutable-object-cache-17.2.6-129 772 kB/s | 162 kB 00:00 2023-10-06T02:20:42.436 INFO:teuthology.orchestra.run.smithi191.stdout:(8/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el8 9.3 MB/s | 17 MB 00:01 2023-10-06T02:20:42.480 INFO:teuthology.orchestra.run.smithi191.stdout:(9/120): ceph-selinux-17.2.6-1296.g736ac5ba.el8 557 kB/s | 24 kB 00:00 2023-10-06T02:20:42.907 INFO:teuthology.orchestra.run.smithi191.stdout:(10/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x8 7.1 MB/s | 17 MB 00:02 2023-10-06T02:20:42.951 INFO:teuthology.orchestra.run.smithi037.stdout:(4/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 1.3 MB/s | 2.3 MB 00:01 2023-10-06T02:20:43.097 INFO:teuthology.orchestra.run.smithi191.stdout:(11/120): ceph-common-17.2.6-1296.g736ac5ba.el8 7.0 MB/s | 23 MB 00:03 2023-10-06T02:20:43.100 INFO:teuthology.orchestra.run.smithi191.stdout:(12/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 1.3 MB/s | 255 kB 00:00 2023-10-06T02:20:43.149 INFO:teuthology.orchestra.run.smithi191.stdout:(13/120): libcephfs-devel-17.2.6-1296.g736ac5ba 506 kB/s | 25 kB 00:00 2023-10-06T02:20:43.207 INFO:teuthology.orchestra.run.smithi191.stdout:(14/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 2.8 MB/s | 174 kB 00:00 2023-10-06T02:20:43.208 INFO:teuthology.orchestra.run.smithi037.stdout:(5/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 1.6 MB/s | 5.2 MB 00:03 2023-10-06T02:20:43.219 INFO:teuthology.orchestra.run.smithi191.stdout:(15/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 6.5 MB/s | 797 kB 00:00 2023-10-06T02:20:43.249 INFO:teuthology.orchestra.run.smithi191.stdout:(16/120): librados-devel-17.2.6-1296.g736ac5ba. 3.1 MB/s | 130 kB 00:00 2023-10-06T02:20:43.296 INFO:teuthology.orchestra.run.smithi191.stdout:(17/120): libradosstriper1-17.2.6-1296.g736ac5b 6.4 MB/s | 507 kB 00:00 2023-10-06T02:20:43.373 INFO:teuthology.orchestra.run.smithi191.stdout:(18/120): python3-ceph-argparse-17.2.6-1296.g73 580 kB/s | 45 kB 00:00 2023-10-06T02:20:43.445 INFO:teuthology.orchestra.run.smithi191.stdout:(19/120): python3-ceph-common-17.2.6-1296.g736a 1.6 MB/s | 115 kB 00:00 2023-10-06T02:20:43.526 INFO:teuthology.orchestra.run.smithi191.stdout:(20/120): python3-cephfs-17.2.6-1296.g736ac5ba. 2.3 MB/s | 190 kB 00:00 2023-10-06T02:20:43.618 INFO:teuthology.orchestra.run.smithi191.stdout:(21/120): python3-rados-17.2.6-1296.g736ac5ba.e 4.0 MB/s | 371 kB 00:00 2023-10-06T02:20:43.706 INFO:teuthology.orchestra.run.smithi191.stdout:(22/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 4.0 MB/s | 358 kB 00:00 2023-10-06T02:20:43.785 INFO:teuthology.orchestra.run.smithi191.stdout:(23/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 1.3 MB/s | 107 kB 00:00 2023-10-06T02:20:43.817 INFO:teuthology.orchestra.run.smithi037.stdout:(6/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 1.8 MB/s | 1.6 MB 00:00 2023-10-06T02:20:43.866 INFO:teuthology.orchestra.run.smithi191.stdout:(24/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.1 MB/s | 90 kB 00:00 2023-10-06T02:20:43.889 INFO:teuthology.orchestra.run.smithi191.stdout:(25/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 8.7 MB/s | 5.6 MB 00:00 2023-10-06T02:20:43.967 INFO:teuthology.orchestra.run.smithi191.stdout:(26/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 2.2 MB/s | 173 kB 00:00 2023-10-06T02:20:44.040 INFO:teuthology.orchestra.run.smithi191.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1296.g 317 kB/s | 23 kB 00:00 2023-10-06T02:20:44.064 INFO:teuthology.orchestra.run.smithi037.stdout:(7/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 4.6 MB/s | 3.9 MB 00:00 2023-10-06T02:20:44.113 INFO:teuthology.orchestra.run.smithi191.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 1.6 MB/s | 121 kB 00:00 2023-10-06T02:20:44.370 INFO:teuthology.orchestra.run.smithi191.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 6.6 MB/s | 1.7 MB 00:00 2023-10-06T02:20:44.424 INFO:teuthology.orchestra.run.smithi191.stdout:(30/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 6.2 MB/s | 3.5 MB 00:00 2023-10-06T02:20:44.502 INFO:teuthology.orchestra.run.smithi191.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 3.0 MB/s | 238 kB 00:00 2023-10-06T02:20:44.564 INFO:teuthology.orchestra.run.smithi191.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 769 kB/s | 47 kB 00:00 2023-10-06T02:20:44.632 INFO:teuthology.orchestra.run.smithi191.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 214 kB/s | 14 kB 00:00 2023-10-06T02:20:44.710 INFO:teuthology.orchestra.run.smithi191.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 3.3 MB/s | 267 kB 00:00 2023-10-06T02:20:44.786 INFO:teuthology.orchestra.run.smithi191.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 1.0 MB/s | 80 kB 00:00 2023-10-06T02:20:44.856 INFO:teuthology.orchestra.run.smithi191.stdout:(36/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 258 kB/s | 18 kB 00:00 2023-10-06T02:20:45.091 INFO:teuthology.orchestra.run.smithi191.stdout:(37/120): ceph-mgr-diskprediction-local-17.2.6- 10 MB/s | 7.4 MB 00:00 2023-10-06T02:20:45.214 INFO:teuthology.orchestra.run.smithi191.stdout:(38/120): gperftools-libs-2.7-9.el8.x86_64.rpm 856 kB/s | 306 kB 00:00 2023-10-06T02:20:45.271 INFO:teuthology.orchestra.run.smithi191.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2023-10-06T02:20:45.340 INFO:teuthology.orchestra.run.smithi191.stdout:(40/120): liboath-2.6.2-3.el8.x86_64.rpm 236 kB/s | 59 kB 00:00 2023-10-06T02:20:45.376 INFO:teuthology.orchestra.run.smithi191.stdout:(41/120): python3-asyncssh-2.7.0-2.el8.noarch.r 4.4 MB/s | 476 kB 00:00 2023-10-06T02:20:45.409 INFO:teuthology.orchestra.run.smithi191.stdout:(42/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 636 kB/s | 44 kB 00:00 2023-10-06T02:20:45.433 INFO:teuthology.orchestra.run.smithi191.stdout:(43/120): python3-beautifulsoup4-4.6.3-2.el8.1. 3.2 MB/s | 185 kB 00:00 2023-10-06T02:20:45.473 INFO:teuthology.orchestra.run.smithi191.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 513 kB/s | 33 kB 00:00 2023-10-06T02:20:45.481 INFO:teuthology.orchestra.run.smithi191.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 336 kB/s | 16 kB 00:00 2023-10-06T02:20:45.546 INFO:teuthology.orchestra.run.smithi191.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 5.8 MB/s | 384 kB 00:00 2023-10-06T02:20:45.597 INFO:teuthology.orchestra.run.smithi191.stdout:(47/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2023-10-06T02:20:45.598 INFO:teuthology.orchestra.run.smithi191.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 1.5 MB/s | 81 kB 00:00 2023-10-06T02:20:45.647 INFO:teuthology.orchestra.run.smithi191.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 223 kB/s | 11 kB 00:00 2023-10-06T02:20:45.647 INFO:teuthology.orchestra.run.smithi191.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 359 kB/s | 18 kB 00:00 2023-10-06T02:20:45.703 INFO:teuthology.orchestra.run.smithi191.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 875 kB/s | 49 kB 00:00 2023-10-06T02:20:45.748 INFO:teuthology.orchestra.run.smithi191.stdout:(52/120): python3-kubernetes-11.0.0-6.el8.noarc 12 MB/s | 1.2 MB 00:00 2023-10-06T02:20:45.760 INFO:teuthology.orchestra.run.smithi191.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-10-06T02:20:45.797 INFO:teuthology.orchestra.run.smithi191.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-10-06T02:20:45.846 INFO:teuthology.orchestra.run.smithi191.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 321 kB/s | 16 kB 00:00 2023-10-06T02:20:45.852 INFO:teuthology.orchestra.run.smithi191.stdout:(56/120): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-10-06T02:20:45.895 INFO:teuthology.orchestra.run.smithi191.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 688 kB/s | 34 kB 00:00 2023-10-06T02:20:45.922 INFO:teuthology.orchestra.run.smithi191.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 2.7 MB/s | 196 kB 00:00 2023-10-06T02:20:45.945 INFO:teuthology.orchestra.run.smithi191.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2023-10-06T02:20:45.972 INFO:teuthology.orchestra.run.smithi191.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 374 kB/s | 19 kB 00:00 2023-10-06T02:20:45.994 INFO:teuthology.orchestra.run.smithi191.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 489 kB/s | 24 kB 00:00 2023-10-06T02:20:46.024 INFO:teuthology.orchestra.run.smithi191.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 574 kB/s | 29 kB 00:00 2023-10-06T02:20:46.043 INFO:teuthology.orchestra.run.smithi191.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 564 kB/s | 27 kB 00:00 2023-10-06T02:20:46.096 INFO:teuthology.orchestra.run.smithi191.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 4.6 MB/s | 251 kB 00:00 2023-10-06T02:20:46.100 INFO:teuthology.orchestra.run.smithi191.stdout:(65/120): python3-waitress-1.4.3-1.el8.noarch.r 3.3 MB/s | 255 kB 00:00 2023-10-06T02:20:46.144 INFO:teuthology.orchestra.run.smithi191.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-10-06T02:20:46.157 INFO:teuthology.orchestra.run.smithi191.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 1.5 MB/s | 85 kB 00:00 2023-10-06T02:20:46.193 INFO:teuthology.orchestra.run.smithi191.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 470 kB/s | 23 kB 00:00 2023-10-06T02:20:46.197 INFO:teuthology.orchestra.run.smithi191.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 19 MB/s | 70 kB 00:00 2023-10-06T02:20:46.235 INFO:teuthology.orchestra.run.smithi191.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 497 kB/s | 19 kB 00:00 2023-10-06T02:20:46.252 INFO:teuthology.orchestra.run.smithi191.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 2.5 MB/s | 43 kB 00:00 2023-10-06T02:20:46.271 INFO:teuthology.orchestra.run.smithi191.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 8.4 MB/s | 155 kB 00:00 2023-10-06T02:20:46.288 INFO:teuthology.orchestra.run.smithi191.stdout:(73/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 13 MB/s | 220 kB 00:00 2023-10-06T02:20:46.303 INFO:teuthology.orchestra.run.smithi191.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.0 MB/s | 48 kB 00:00 2023-10-06T02:20:46.323 INFO:teuthology.orchestra.run.smithi191.stdout:(75/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 12 MB/s | 229 kB 00:00 2023-10-06T02:20:46.337 INFO:teuthology.orchestra.run.smithi191.stdout:(76/120): thrift-0.13.0-2.el8.x86_64.rpm 9.7 MB/s | 1.7 MB 00:00 2023-10-06T02:20:46.341 INFO:teuthology.orchestra.run.smithi191.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 2.3 MB/s | 43 kB 00:00 2023-10-06T02:20:46.357 INFO:teuthology.orchestra.run.smithi191.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.1 MB/s | 18 kB 00:00 2023-10-06T02:20:46.383 INFO:teuthology.orchestra.run.smithi191.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 23 MB/s | 605 kB 00:00 2023-10-06T02:20:46.404 INFO:teuthology.orchestra.run.smithi191.stdout:(80/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 35 MB/s | 2.3 MB 00:00 2023-10-06T02:20:46.406 INFO:teuthology.orchestra.run.smithi191.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 3.6 MB/s | 83 kB 00:00 2023-10-06T02:20:46.419 INFO:teuthology.orchestra.run.smithi191.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 3.8 MB/s | 59 kB 00:00 2023-10-06T02:20:46.426 INFO:teuthology.orchestra.run.smithi191.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 8.7 MB/s | 169 kB 00:00 2023-10-06T02:20:46.437 INFO:teuthology.orchestra.run.smithi191.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.1 MB/s | 38 kB 00:00 2023-10-06T02:20:46.443 INFO:teuthology.orchestra.run.smithi191.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 4.8 MB/s | 86 kB 00:00 2023-10-06T02:20:46.456 INFO:teuthology.orchestra.run.smithi191.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.0 MB/s | 58 kB 00:00 2023-10-06T02:20:46.460 INFO:teuthology.orchestra.run.smithi191.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.7 MB/s | 47 kB 00:00 2023-10-06T02:20:46.481 INFO:teuthology.orchestra.run.smithi191.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 22 MB/s | 559 kB 00:00 2023-10-06T02:20:46.484 INFO:teuthology.orchestra.run.smithi191.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 26 MB/s | 639 kB 00:00 2023-10-06T02:20:46.498 INFO:teuthology.orchestra.run.smithi191.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 4.1 MB/s | 70 kB 00:00 2023-10-06T02:20:46.503 INFO:teuthology.orchestra.run.smithi191.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 10 MB/s | 200 kB 00:00 2023-10-06T02:20:46.514 INFO:teuthology.orchestra.run.smithi191.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 5.9 MB/s | 97 kB 00:00 2023-10-06T02:20:46.526 INFO:teuthology.orchestra.run.smithi037.stdout:(8/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el8 6.8 MB/s | 17 MB 00:02 2023-10-06T02:20:46.532 INFO:teuthology.orchestra.run.smithi191.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 2.5 MB/s | 44 kB 00:00 2023-10-06T02:20:46.547 INFO:teuthology.orchestra.run.smithi191.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.7 MB/s | 27 kB 00:00 2023-10-06T02:20:46.563 INFO:teuthology.orchestra.run.smithi191.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 9.8 MB/s | 161 kB 00:00 2023-10-06T02:20:46.566 INFO:teuthology.orchestra.run.smithi037.stdout:(9/120): ceph-selinux-17.2.6-1296.g736ac5ba.el8 607 kB/s | 24 kB 00:00 2023-10-06T02:20:46.582 INFO:teuthology.orchestra.run.smithi191.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 16 MB/s | 320 kB 00:00 2023-10-06T02:20:46.602 INFO:teuthology.orchestra.run.smithi191.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 23 MB/s | 457 kB 00:00 2023-10-06T02:20:46.802 INFO:teuthology.orchestra.run.smithi191.stdout:(98/120): python3-scipy-1.0.0-20.module+el8.1.0 49 MB/s | 15 MB 00:00 2023-10-06T02:20:46.827 INFO:teuthology.orchestra.run.smithi191.stdout:(99/120): python3-babel-2.5.1-5.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2023-10-06T02:20:47.266 INFO:teuthology.orchestra.run.smithi191.stdout:(100/120): ceph-test-17.2.6-1296.g736ac5ba.el8. 11 MB/s | 52 MB 00:04 2023-10-06T02:20:47.267 INFO:teuthology.orchestra.run.smithi191.stdout:(101/120): python3-markupsafe-0.23-19.el8.x86_6 83 kB/s | 39 kB 00:00 2023-10-06T02:20:47.276 INFO:teuthology.orchestra.run.smithi191.stdout:(102/120): bison-3.0.4-10.el8.x86_64.rpm 1.5 MB/s | 688 kB 00:00 2023-10-06T02:20:47.285 INFO:teuthology.orchestra.run.smithi191.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 13 MB/s | 225 kB 00:00 2023-10-06T02:20:47.301 INFO:teuthology.orchestra.run.smithi191.stdout:(104/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 7.4 MB/s | 259 kB 00:00 2023-10-06T02:20:47.303 INFO:teuthology.orchestra.run.smithi191.stdout:(105/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 6.1 MB/s | 126 kB 00:00 2023-10-06T02:20:47.318 INFO:teuthology.orchestra.run.smithi191.stdout:(106/120): oniguruma-6.8.2-2.el8.x86_64.rpm 11 MB/s | 187 kB 00:00 2023-10-06T02:20:47.326 INFO:teuthology.orchestra.run.smithi191.stdout:(107/120): python3-jinja2-2.10.1-2.el8_0.noarch 23 MB/s | 538 kB 00:00 2023-10-06T02:20:47.337 INFO:teuthology.orchestra.run.smithi191.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 16 MB/s | 302 kB 00:00 2023-10-06T02:20:47.344 INFO:teuthology.orchestra.run.smithi191.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 8.5 MB/s | 157 kB 00:00 2023-10-06T02:20:47.352 INFO:teuthology.orchestra.run.smithi191.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 7.2 MB/s | 110 kB 00:00 2023-10-06T02:20:47.363 INFO:teuthology.orchestra.run.smithi191.stdout:(111/120): python3-numpy-1.14.3-9.el8.x86_64.rp 48 MB/s | 3.7 MB 00:00 2023-10-06T02:20:47.364 INFO:teuthology.orchestra.run.smithi191.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.6 MB/s | 20 kB 00:00 2023-10-06T02:20:47.368 INFO:teuthology.orchestra.run.smithi191.stdout:(113/120): librdkafka-0.11.4-1.el8.x86_64.rpm 15 MB/s | 353 kB 00:00 2023-10-06T02:20:47.383 INFO:teuthology.orchestra.run.smithi191.stdout:(114/120): python3-pytz-2017.2-9.el8.noarch.rpm 2.8 MB/s | 54 kB 00:00 2023-10-06T02:20:47.387 INFO:teuthology.orchestra.run.smithi191.stdout:(115/120): libtool-2.4.6-25.el8.x86_64.rpm 30 MB/s | 709 kB 00:00 2023-10-06T02:20:47.415 INFO:teuthology.orchestra.run.smithi191.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 25 MB/s | 713 kB 00:00 2023-10-06T02:20:47.464 INFO:teuthology.orchestra.run.smithi191.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 50 MB/s | 4.7 MB 00:00 2023-10-06T02:20:47.479 INFO:teuthology.orchestra.run.smithi191.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 48 MB/s | 4.6 MB 00:00 2023-10-06T02:20:47.731 INFO:teuthology.orchestra.run.smithi191.stdout:(119/120): librados2-17.2.6-1296.g736ac5ba.el8. 11 MB/s | 3.5 MB 00:00 2023-10-06T02:20:48.104 INFO:teuthology.orchestra.run.smithi191.stdout:(120/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 5.6 MB/s | 3.6 MB 00:00 2023-10-06T02:20:48.140 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2023-10-06T02:20:48.140 INFO:teuthology.orchestra.run.smithi191.stdout:Total 24 MB/s | 201 MB 00:08 2023-10-06T02:20:48.155 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2023-10-06T02:20:48.267 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2023-10-06T02:20:48.280 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2023-10-06T02:20:48.657 INFO:teuthology.orchestra.run.smithi037.stdout:(10/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x8 3.5 MB/s | 17 MB 00:04 2023-10-06T02:20:48.710 INFO:teuthology.orchestra.run.smithi037.stdout:(11/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 4.7 MB/s | 255 kB 00:00 2023-10-06T02:20:48.732 INFO:teuthology.orchestra.run.smithi037.stdout:(12/120): libcephfs-devel-17.2.6-1296.g736ac5ba 1.2 MB/s | 25 kB 00:00 2023-10-06T02:20:48.963 INFO:teuthology.orchestra.run.smithi037.stdout:(13/120): ceph-common-17.2.6-1296.g736ac5ba.el8 2.6 MB/s | 23 MB 00:09 2023-10-06T02:20:49.025 INFO:teuthology.orchestra.run.smithi037.stdout:(14/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 2.7 MB/s | 797 kB 00:00 2023-10-06T02:20:49.027 INFO:teuthology.orchestra.run.smithi037.stdout:(15/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 2.7 MB/s | 174 kB 00:00 2023-10-06T02:20:49.057 INFO:teuthology.orchestra.run.smithi037.stdout:(16/120): librados-devel-17.2.6-1296.g736ac5ba. 3.9 MB/s | 130 kB 00:00 2023-10-06T02:20:49.166 INFO:teuthology.orchestra.run.smithi037.stdout:(17/120): libradosstriper1-17.2.6-1296.g736ac5b 3.5 MB/s | 507 kB 00:00 2023-10-06T02:20:49.203 INFO:teuthology.orchestra.run.smithi037.stdout:(18/120): python3-ceph-argparse-17.2.6-1296.g73 1.2 MB/s | 45 kB 00:00 2023-10-06T02:20:49.241 INFO:teuthology.orchestra.run.smithi037.stdout:(19/120): python3-ceph-common-17.2.6-1296.g736a 3.0 MB/s | 115 kB 00:00 2023-10-06T02:20:49.281 INFO:teuthology.orchestra.run.smithi037.stdout:(20/120): python3-cephfs-17.2.6-1296.g736ac5ba. 4.8 MB/s | 190 kB 00:00 2023-10-06T02:20:49.356 INFO:teuthology.orchestra.run.smithi037.stdout:(21/120): python3-rados-17.2.6-1296.g736ac5ba.e 4.8 MB/s | 371 kB 00:00 2023-10-06T02:20:49.432 INFO:teuthology.orchestra.run.smithi037.stdout:(22/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 4.6 MB/s | 358 kB 00:00 2023-10-06T02:20:49.470 INFO:teuthology.orchestra.run.smithi037.stdout:(23/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 2.8 MB/s | 107 kB 00:00 2023-10-06T02:20:49.507 INFO:teuthology.orchestra.run.smithi037.stdout:(24/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 2.4 MB/s | 90 kB 00:00 2023-10-06T02:20:49.727 INFO:teuthology.orchestra.run.smithi037.stdout:(25/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 8.3 MB/s | 5.6 MB 00:00 2023-10-06T02:20:49.761 INFO:teuthology.orchestra.run.smithi037.stdout:(26/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 5.1 MB/s | 173 kB 00:00 2023-10-06T02:20:49.782 INFO:teuthology.orchestra.run.smithi037.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1296.g 1.1 MB/s | 23 kB 00:00 2023-10-06T02:20:49.804 INFO:teuthology.orchestra.run.smithi037.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 5.5 MB/s | 121 kB 00:00 2023-10-06T02:20:50.001 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2023-10-06T02:20:50.003 INFO:teuthology.orchestra.run.smithi037.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 8.5 MB/s | 1.7 MB 00:00 2023-10-06T02:20:50.006 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2023-10-06T02:20:50.137 INFO:teuthology.orchestra.run.smithi037.stdout:(30/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 5.5 MB/s | 3.5 MB 00:00 2023-10-06T02:20:50.210 INFO:teuthology.orchestra.run.smithi037.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 3.2 MB/s | 238 kB 00:00 2023-10-06T02:20:50.247 INFO:teuthology.orchestra.run.smithi037.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 1.3 MB/s | 47 kB 00:00 2023-10-06T02:20:50.284 INFO:teuthology.orchestra.run.smithi037.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 400 kB/s | 14 kB 00:00 2023-10-06T02:20:50.356 INFO:teuthology.orchestra.run.smithi037.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 3.6 MB/s | 267 kB 00:00 2023-10-06T02:20:50.394 INFO:teuthology.orchestra.run.smithi037.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 2.1 MB/s | 80 kB 00:00 2023-10-06T02:20:50.430 INFO:teuthology.orchestra.run.smithi037.stdout:(36/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 497 kB/s | 18 kB 00:00 2023-10-06T02:20:50.780 INFO:teuthology.orchestra.run.smithi037.stdout:(37/120): ceph-mgr-diskprediction-local-17.2.6- 9.5 MB/s | 7.4 MB 00:00 2023-10-06T02:20:50.794 INFO:teuthology.orchestra.run.smithi037.stdout:(38/120): gperftools-libs-2.7-9.el8.x86_64.rpm 843 kB/s | 306 kB 00:00 2023-10-06T02:20:50.876 INFO:teuthology.orchestra.run.smithi037.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 914 kB/s | 75 kB 00:00 2023-10-06T02:20:51.269 INFO:teuthology.orchestra.run.smithi037.stdout:(40/120): ceph-test-17.2.6-1296.g736ac5ba.el8.x 11 MB/s | 52 MB 00:04 2023-10-06T02:20:51.274 INFO:teuthology.orchestra.run.smithi037.stdout:(41/120): python3-asyncssh-2.7.0-2.el8.noarch.r 1.2 MB/s | 476 kB 00:00 2023-10-06T02:20:51.355 INFO:teuthology.orchestra.run.smithi037.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 2.3 MB/s | 185 kB 00:00 2023-10-06T02:20:51.418 INFO:teuthology.orchestra.run.smithi037.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 522 kB/s | 33 kB 00:00 2023-10-06T02:20:51.448 INFO:teuthology.orchestra.run.smithi037.stdout:(44/120): liboath-2.6.2-3.el8.x86_64.rpm 88 kB/s | 59 kB 00:00 2023-10-06T02:20:51.476 INFO:teuthology.orchestra.run.smithi037.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 283 kB/s | 16 kB 00:00 2023-10-06T02:20:51.559 INFO:teuthology.orchestra.run.smithi037.stdout:(46/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 151 kB/s | 44 kB 00:00 2023-10-06T02:20:51.576 INFO:teuthology.orchestra.run.smithi037.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 3.7 MB/s | 384 kB 00:00 2023-10-06T02:20:51.605 INFO:teuthology.orchestra.run.smithi037.stdout:(48/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2023-10-06T02:20:51.625 INFO:teuthology.orchestra.run.smithi037.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 228 kB/s | 11 kB 00:00 2023-10-06T02:20:51.660 INFO:teuthology.orchestra.run.smithi037.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 326 kB/s | 18 kB 00:00 2023-10-06T02:20:51.688 INFO:teuthology.orchestra.run.smithi037.stdout:(51/120): python3-google-auth-1.1.1-10.el8.noar 630 kB/s | 81 kB 00:00 2023-10-06T02:20:51.720 INFO:teuthology.orchestra.run.smithi037.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 809 kB/s | 49 kB 00:00 2023-10-06T02:20:51.757 INFO:teuthology.orchestra.run.smithi037.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 853 kB/s | 59 kB 00:00 2023-10-06T02:20:51.774 INFO:teuthology.orchestra.run.smithi037.stdout:(54/120): python3-kubernetes-11.0.0-6.el8.noarc 7.9 MB/s | 1.2 MB 00:00 2023-10-06T02:20:51.782 INFO:teuthology.orchestra.run.smithi037.stdout:(55/120): python3-natsort-7.1.1-2.el8.noarch.rp 978 kB/s | 60 kB 00:00 2023-10-06T02:20:51.827 INFO:teuthology.orchestra.run.smithi037.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 292 kB/s | 16 kB 00:00 2023-10-06T02:20:51.846 INFO:teuthology.orchestra.run.smithi037.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 528 kB/s | 34 kB 00:00 2023-10-06T02:20:51.889 INFO:teuthology.orchestra.run.smithi037.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 3.1 MB/s | 196 kB 00:00 2023-10-06T02:20:51.905 INFO:teuthology.orchestra.run.smithi037.stdout:(59/120): python3-pecan-1.3.2-9.el8.noarch.rpm 1.9 MB/s | 283 kB 00:00 2023-10-06T02:20:51.909 INFO:teuthology.orchestra.run.smithi037.stdout:(60/120): python3-rsa-4.9-2.el8.noarch.rpm 1.0 MB/s | 64 kB 00:00 2023-10-06T02:20:51.942 INFO:teuthology.orchestra.run.smithi037.stdout:(61/120): python3-simplegeneric-0.8.1-17.el8.no 363 kB/s | 19 kB 00:00 2023-10-06T02:20:51.956 INFO:teuthology.orchestra.run.smithi037.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 474 kB/s | 24 kB 00:00 2023-10-06T02:20:51.965 INFO:teuthology.orchestra.run.smithi037.stdout:(63/120): python3-tempora-1.14.1-5.el8.noarch.r 533 kB/s | 29 kB 00:00 2023-10-06T02:20:51.990 INFO:teuthology.orchestra.run.smithi037.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 564 kB/s | 27 kB 00:00 2023-10-06T02:20:52.036 INFO:teuthology.orchestra.run.smithi037.stdout:(65/120): python3-waitress-1.4.3-1.el8.noarch.r 3.1 MB/s | 255 kB 00:00 2023-10-06T02:20:52.041 INFO:teuthology.orchestra.run.smithi037.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-10-06T02:20:52.074 INFO:teuthology.orchestra.run.smithi037.stdout:(67/120): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-10-06T02:20:52.094 INFO:teuthology.orchestra.run.smithi037.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 440 kB/s | 23 kB 00:00 2023-10-06T02:20:52.097 INFO:teuthology.orchestra.run.smithi037.stdout:(69/120): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2023-10-06T02:20:52.098 INFO:teuthology.orchestra.run.smithi037.stdout:(70/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 19 MB/s | 70 kB 00:00 2023-10-06T02:20:52.146 INFO:teuthology.orchestra.run.smithi037.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 904 kB/s | 43 kB 00:00 2023-10-06T02:20:52.165 INFO:teuthology.orchestra.run.smithi037.stdout:(72/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 277 kB/s | 19 kB 00:00 2023-10-06T02:20:52.177 INFO:teuthology.orchestra.run.smithi037.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 4.8 MB/s | 155 kB 00:00 2023-10-06T02:20:52.198 INFO:teuthology.orchestra.run.smithi037.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 6.5 MB/s | 220 kB 00:00 2023-10-06T02:20:52.211 INFO:teuthology.orchestra.run.smithi037.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 1.4 MB/s | 48 kB 00:00 2023-10-06T02:20:52.238 INFO:teuthology.orchestra.run.smithi037.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.6 MB/s | 229 kB 00:00 2023-10-06T02:20:52.240 INFO:teuthology.orchestra.run.smithi037.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 1.5 MB/s | 43 kB 00:00 2023-10-06T02:20:52.269 INFO:teuthology.orchestra.run.smithi037.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 628 kB/s | 18 kB 00:00 2023-10-06T02:20:52.286 INFO:teuthology.orchestra.run.smithi037.stdout:(79/120): thrift-0.13.0-2.el8.x86_64.rpm 8.2 MB/s | 1.7 MB 00:00 2023-10-06T02:20:52.317 INFO:teuthology.orchestra.run.smithi037.stdout:(80/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 30 MB/s | 2.3 MB 00:00 2023-10-06T02:20:52.323 INFO:teuthology.orchestra.run.smithi037.stdout:(81/120): pcre2-devel-10.32-2.el8.x86_64.rpm 11 MB/s | 605 kB 00:00 2023-10-06T02:20:52.345 INFO:teuthology.orchestra.run.smithi037.stdout:(82/120): fuse-2.9.7-12.el8.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2023-10-06T02:20:52.351 INFO:teuthology.orchestra.run.smithi037.stdout:(83/120): elfutils-libelf-devel-0.182-3.el8.x86 1.7 MB/s | 59 kB 00:00 2023-10-06T02:20:52.362 INFO:teuthology.orchestra.run.smithi037.stdout:(84/120): libquadmath-8.4.1-1.el8.x86_64.rpm 4.3 MB/s | 169 kB 00:00 2023-10-06T02:20:52.375 INFO:teuthology.orchestra.run.smithi037.stdout:(85/120): libcom_err-devel-1.45.6-1.el8.x86_64. 1.2 MB/s | 38 kB 00:00 2023-10-06T02:20:52.391 INFO:teuthology.orchestra.run.smithi037.stdout:(86/120): libsepol-devel-2.9-2.el8.x86_64.rpm 2.1 MB/s | 86 kB 00:00 2023-10-06T02:20:52.393 INFO:teuthology.orchestra.run.smithi037.stdout:(87/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 1.8 MB/s | 58 kB 00:00 2023-10-06T02:20:52.417 INFO:teuthology.orchestra.run.smithi037.stdout:(88/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-10-06T02:20:52.433 INFO:teuthology.orchestra.run.smithi037.stdout:(89/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 13 MB/s | 559 kB 00:00 2023-10-06T02:20:52.438 INFO:teuthology.orchestra.run.smithi037.stdout:(90/120): libgfortran-8.4.1-1.el8.x86_64.rpm 14 MB/s | 639 kB 00:00 2023-10-06T02:20:52.464 INFO:teuthology.orchestra.run.smithi037.stdout:(91/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 3.6 MB/s | 97 kB 00:00 2023-10-06T02:20:52.465 INFO:teuthology.orchestra.run.smithi037.stdout:(92/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-06T02:20:52.478 INFO:teuthology.orchestra.run.smithi037.stdout:(93/120): libselinux-devel-2.9-5.el8.x86_64.rpm 4.4 MB/s | 200 kB 00:00 2023-10-06T02:20:52.483 INFO:teuthology.orchestra.run.smithi037.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 2.4 MB/s | 44 kB 00:00 2023-10-06T02:20:52.499 INFO:teuthology.orchestra.run.smithi037.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.2 MB/s | 27 kB 00:00 2023-10-06T02:20:52.512 INFO:teuthology.orchestra.run.smithi037.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 5.4 MB/s | 161 kB 00:00 2023-10-06T02:20:52.521 INFO:teuthology.orchestra.run.smithi037.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 14 MB/s | 320 kB 00:00 2023-10-06T02:20:52.534 INFO:teuthology.orchestra.run.smithi037.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 21 MB/s | 457 kB 00:00 2023-10-06T02:20:52.548 INFO:teuthology.orchestra.run.smithi037.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.7 MB/s | 39 kB 00:00 2023-10-06T02:20:52.575 INFO:teuthology.orchestra.run.smithi037.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 25 MB/s | 688 kB 00:00 2023-10-06T02:20:52.594 INFO:teuthology.orchestra.run.smithi037.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 14 MB/s | 259 kB 00:00 2023-10-06T02:20:52.618 INFO:teuthology.orchestra.run.smithi037.stdout:(102/120): python3-babel-2.5.1-5.el8.noarch.rpm 50 MB/s | 4.8 MB 00:00 2023-10-06T02:20:52.621 INFO:teuthology.orchestra.run.smithi037.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 8.0 MB/s | 225 kB 00:00 2023-10-06T02:20:52.636 INFO:teuthology.orchestra.run.smithi037.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 6.8 MB/s | 126 kB 00:00 2023-10-06T02:20:52.656 INFO:teuthology.orchestra.run.smithi037.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 9.1 MB/s | 187 kB 00:00 2023-10-06T02:20:52.679 INFO:teuthology.orchestra.run.smithi037.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 24 MB/s | 538 kB 00:00 2023-10-06T02:20:52.787 INFO:teuthology.orchestra.run.smithi037.stdout:(107/120): python3-scipy-1.0.0-20.module+el8.1. 45 MB/s | 15 MB 00:00 2023-10-06T02:20:52.792 INFO:teuthology.orchestra.run.smithi037.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 2.6 MB/s | 302 kB 00:00 2023-10-06T02:20:52.808 INFO:teuthology.orchestra.run.smithi037.stdout:(109/120): python3-numpy-1.14.3-9.el8.x86_64.rp 20 MB/s | 3.7 MB 00:00 2023-10-06T02:20:52.810 INFO:teuthology.orchestra.run.smithi037.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 6.2 MB/s | 110 kB 00:00 2023-10-06T02:20:52.811 INFO:teuthology.orchestra.run.smithi037.stdout:(111/120): python3-mako-1.0.6-13.el8.noarch.rpm 6.5 MB/s | 157 kB 00:00 2023-10-06T02:20:52.828 INFO:teuthology.orchestra.run.smithi037.stdout:(112/120): librdkafka-0.11.4-1.el8.x86_64.rpm 17 MB/s | 353 kB 00:00 2023-10-06T02:20:52.829 INFO:teuthology.orchestra.run.smithi037.stdout:(113/120): python3-jsonpointer-1.10-11.el8.noar 1.1 MB/s | 20 kB 00:00 2023-10-06T02:20:52.837 INFO:teuthology.orchestra.run.smithi037.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 27 MB/s | 709 kB 00:00 2023-10-06T02:20:52.844 INFO:teuthology.orchestra.run.smithi037.stdout:(115/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.4 MB/s | 54 kB 00:00 2023-10-06T02:20:52.874 INFO:teuthology.orchestra.run.smithi037.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 23 MB/s | 713 kB 00:00 2023-10-06T02:20:52.918 INFO:teuthology.orchestra.run.smithi037.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 53 MB/s | 4.7 MB 00:00 2023-10-06T02:20:52.939 INFO:teuthology.orchestra.run.smithi037.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 45 MB/s | 4.6 MB 00:00 2023-10-06T02:20:53.287 INFO:teuthology.orchestra.run.smithi037.stdout:(119/120): librados2-17.2.6-1296.g736ac5ba.el8. 8.4 MB/s | 3.5 MB 00:00 2023-10-06T02:20:53.372 INFO:teuthology.orchestra.run.smithi037.stdout:(120/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 7.9 MB/s | 3.6 MB 00:00 2023-10-06T02:20:53.377 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-10-06T02:20:53.377 INFO:teuthology.orchestra.run.smithi037.stdout:Total 15 MB/s | 201 MB 00:13 2023-10-06T02:20:53.430 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-10-06T02:20:53.553 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-10-06T02:20:53.553 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-10-06T02:20:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2023-10-06T02:20:55.108 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T02:20:55.262 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-10-06T02:20:55.267 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-10-06T02:20:55.326 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T02:20:55.439 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T02:20:55.659 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T02:20:56.038 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T02:20:56.283 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:20:56.678 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:20:56.867 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T02:20:56.982 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T02:20:57.167 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:20:57.251 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:20:57.464 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T02:20:57.771 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-06T02:20:58.439 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T02:20:58.833 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:20:58.968 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:20:59.221 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T02:20:59.415 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T02:20:59.600 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:20:59.729 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:20:59.885 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-10-06T02:20:59.923 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T02:21:00.000 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T02:21:00.101 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T02:21:00.195 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-06T02:21:00.274 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T02:21:00.410 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T02:21:00.439 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-06T02:21:00.607 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T02:21:00.639 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-06T02:21:00.799 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-06T02:21:00.941 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T02:21:01.010 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T02:21:01.081 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T02:21:01.223 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:21:01.266 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T02:21:01.631 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:21:01.805 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T02:21:01.849 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T02:21:01.985 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T02:21:02.008 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T02:21:02.257 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:21:02.361 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:21:02.537 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T02:21:02.562 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T02:21:02.758 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T02:21:02.864 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-06T02:21:03.486 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T02:21:03.551 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T02:21:03.753 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:21:03.786 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-06T02:21:03.870 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:21:04.087 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T02:21:04.240 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T02:21:04.457 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:21:04.569 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:21:04.595 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-06T02:21:04.719 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T02:21:04.780 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T02:21:04.835 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T02:21:04.937 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-06T02:21:05.039 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T02:21:05.176 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T02:21:05.194 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-06T02:21:05.372 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-06T02:21:05.447 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T02:21:05.513 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-06T02:21:05.657 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T02:21:05.724 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-06T02:21:05.821 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T02:21:06.003 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-06T02:21:06.098 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T02:21:06.232 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T02:21:06.678 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T02:21:06.865 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T02:21:07.428 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T02:21:07.606 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T02:21:08.325 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T02:21:08.358 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T02:21:08.680 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-06T02:21:08.904 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-06T02:21:09.148 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-06T02:21:09.422 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T02:21:09.588 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T02:21:09.660 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-06T02:21:09.718 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T02:21:09.979 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T02:21:10.204 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-06T02:21:10.222 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-06T02:21:10.475 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-06T02:21:10.486 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-06T02:21:10.706 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T02:21:10.728 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T02:21:10.934 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T02:21:11.174 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T02:21:11.352 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T02:21:11.649 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T02:21:11.888 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-06T02:21:12.039 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-06T02:21:12.235 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-06T02:21:12.417 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-06T02:21:12.614 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T02:21:12.694 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T02:21:12.910 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T02:21:12.922 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-06T02:21:13.111 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-06T02:21:13.322 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-06T02:21:13.400 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-06T02:21:13.485 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-06T02:21:13.674 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-06T02:21:13.825 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-06T02:21:13.951 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-06T02:21:14.147 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-06T02:21:14.301 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-06T02:21:14.428 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-06T02:21:14.619 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-06T02:21:14.760 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-06T02:21:14.894 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-06T02:21:15.002 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-06T02:21:15.169 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-06T02:21:15.214 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T02:21:15.440 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-06T02:21:15.543 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T02:21:15.623 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T02:21:15.743 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T02:21:15.793 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T02:21:15.932 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T02:21:16.052 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T02:21:16.206 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T02:21:16.305 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T02:21:16.420 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-06T02:21:16.504 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T02:21:16.605 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-06T02:21:16.685 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T02:21:16.832 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-06T02:21:16.841 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T02:21:17.010 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-06T02:21:17.090 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T02:21:17.172 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T02:21:17.235 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T02:21:17.309 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T02:21:17.422 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-06T02:21:17.541 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T02:21:17.595 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-06T02:21:17.758 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T02:21:17.766 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-06T02:21:17.903 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T02:21:17.903 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-06T02:21:18.083 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-06T02:21:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T02:21:18.241 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-06T02:21:18.325 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T02:21:18.386 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-06T02:21:18.570 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T02:21:18.573 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-06T02:21:18.752 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-06T02:21:18.854 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T02:21:19.064 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-06T02:21:19.088 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T02:21:19.314 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T02:21:19.317 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-06T02:21:19.550 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T02:21:19.696 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-06T02:21:19.941 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-06T02:21:20.081 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T02:21:20.287 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T02:21:20.527 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T02:21:20.710 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T02:21:20.739 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T02:21:20.955 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T02:21:20.994 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T02:21:21.130 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T02:21:21.239 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T02:21:21.285 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T02:21:21.489 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T02:21:21.590 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T02:21:21.715 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T02:21:21.864 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T02:21:21.938 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T02:21:22.117 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T02:21:22.180 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T02:21:22.288 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T02:21:22.409 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T02:21:22.512 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T02:21:22.621 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T02:21:22.719 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T02:21:22.829 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T02:21:22.954 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T02:21:23.251 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T02:21:23.480 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T02:21:23.690 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T02:21:23.954 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T02:21:25.208 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T02:21:25.504 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T02:21:25.732 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T02:21:26.052 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T02:21:26.331 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T02:21:26.652 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T02:21:26.839 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T02:21:27.040 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T02:21:27.238 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T02:21:27.932 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:21:28.153 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:21:28.754 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:21:29.034 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T02:21:29.108 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T02:21:29.269 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T02:21:32.737 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:21:32.987 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:21:33.604 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:21:33.871 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T02:21:33.963 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T02:21:34.120 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T02:21:47.330 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T02:21:47.330 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /sys 2023-10-06T02:21:47.330 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /proc 2023-10-06T02:21:47.330 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /dev 2023-10-06T02:21:47.330 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /run 2023-10-06T02:21:47.330 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /mnt 2023-10-06T02:21:47.331 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /var/tmp 2023-10-06T02:21:47.331 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /home 2023-10-06T02:21:47.331 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /tmp 2023-10-06T02:21:47.331 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /dev 2023-10-06T02:21:47.331 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:21:47.725 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T02:21:49.221 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T02:21:49.397 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T02:21:49.627 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T02:21:49.799 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T02:21:50.207 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T02:21:50.365 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T02:21:50.431 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T02:21:52.797 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T02:21:52.827 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2023-10-06T02:21:52.828 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2023-10-06T02:21:52.828 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /dev 2023-10-06T02:21:52.828 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /run 2023-10-06T02:21:52.828 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2023-10-06T02:21:52.828 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2023-10-06T02:21:52.828 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2023-10-06T02:21:52.828 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2023-10-06T02:21:52.828 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /dev 2023-10-06T02:21:52.828 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:21:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T02:21:53.237 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T02:21:53.382 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T02:21:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T02:21:53.832 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T02:21:54.031 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T02:21:54.246 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T02:21:54.437 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T02:21:54.698 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T02:21:54.852 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T02:21:55.088 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T02:21:55.217 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T02:21:55.411 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T02:21:55.565 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T02:21:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T02:21:55.663 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T02:21:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T02:21:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T02:21:56.009 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T02:21:56.204 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T02:21:56.241 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T02:21:56.439 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T02:21:56.451 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T02:21:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T02:21:58.312 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T02:21:59.292 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T02:21:59.295 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T02:21:59.295 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T02:21:59.295 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T02:21:59.295 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T02:21:59.295 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T02:21:59.296 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T02:21:59.296 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T02:21:59.296 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T02:21:59.414 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T02:21:59.587 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T02:21:59.816 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T02:22:00.042 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T02:22:01.076 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T02:22:01.258 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T02:22:01.361 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T02:22:01.749 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T02:22:01.934 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T02:22:01.973 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T02:22:02.116 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T02:22:02.127 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T02:22:03.820 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T02:22:04.050 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T02:22:04.142 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T02:22:04.205 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T02:22:04.291 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T02:22:04.336 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T02:22:04.466 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T02:22:04.835 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T02:22:04.991 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T02:22:05.121 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T02:22:05.535 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-06T02:22:05.772 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 110/122 2023-10-06T02:22:06.011 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-06T02:22:06.196 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T02:22:06.208 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T02:22:06.367 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T02:22:06.551 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T02:22:06.679 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T02:22:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T02:22:07.099 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T02:22:07.321 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T02:22:07.376 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T02:22:07.546 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T02:22:07.555 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T02:22:07.715 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-06T02:22:07.715 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T02:22:07.898 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T02:22:07.899 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:22:08.769 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:22:08.769 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T02:22:08.769 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T02:22:08.769 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T02:22:08.769 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:22:08.770 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T02:22:08.770 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:22:08.770 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T02:22:08.770 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T02:22:08.770 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T02:22:08.770 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:22:08.770 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T02:22:08.770 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T02:22:08.770 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:22:08.770 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T02:22:08.770 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T02:22:08.771 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T02:22:08.771 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T02:22:08.771 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T02:22:08.771 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T02:22:08.771 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T02:22:08.771 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T02:22:08.771 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T02:22:08.771 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T02:22:08.771 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T02:22:08.771 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T02:22:08.771 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T02:22:08.771 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T02:22:08.780 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T02:22:08.780 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T02:22:08.780 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T02:22:08.780 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T02:22:08.780 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T02:22:08.780 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T02:22:08.780 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T02:22:08.780 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T02:22:08.780 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T02:22:08.781 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T02:22:08.781 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T02:22:08.781 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T02:22:08.781 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T02:22:08.781 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T02:22:08.781 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T02:22:08.781 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T02:22:08.781 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T02:22:08.781 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T02:22:08.781 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T02:22:08.781 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T02:22:08.781 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T02:22:08.782 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T02:22:08.782 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T02:22:08.782 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T02:22:08.782 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T02:22:08.782 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T02:22:08.782 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T02:22:08.782 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T02:22:08.782 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T02:22:08.782 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T02:22:08.782 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T02:22:08.782 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T02:22:08.783 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T02:22:08.783 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T02:22:08.783 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T02:22:08.783 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T02:22:08.783 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T02:22:08.783 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T02:22:08.783 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T02:22:08.783 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T02:22:08.783 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T02:22:08.783 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T02:22:08.783 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T02:22:08.783 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T02:22:08.784 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-06T02:22:08.784 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-06T02:22:08.784 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-06T02:22:08.784 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-06T02:22:08.784 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-06T02:22:08.784 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-06T02:22:08.784 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-06T02:22:08.784 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-06T02:22:08.784 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-06T02:22:08.784 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-06T02:22:08.784 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-06T02:22:08.785 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-06T02:22:08.785 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-06T02:22:08.785 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-06T02:22:08.785 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-06T02:22:08.785 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-06T02:22:08.785 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-06T02:22:08.785 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-06T02:22:08.785 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-06T02:22:08.785 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-06T02:22:08.785 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-06T02:22:08.785 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-06T02:22:08.786 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-06T02:22:08.786 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-06T02:22:08.786 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-06T02:22:08.786 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-06T02:22:08.786 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-06T02:22:08.786 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-06T02:22:08.786 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-06T02:22:08.786 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-06T02:22:08.786 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-06T02:22:08.786 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-06T02:22:08.786 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-06T02:22:08.787 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-06T02:22:08.787 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-06T02:22:08.787 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-06T02:22:08.787 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-06T02:22:08.787 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-06T02:22:08.787 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-06T02:22:08.787 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-06T02:22:08.787 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-06T02:22:08.787 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-06T02:22:08.787 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-06T02:22:08.787 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-06T02:22:08.787 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-06T02:22:08.788 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-06T02:22:08.788 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-06T02:22:08.788 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T02:22:08.788 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T02:22:08.788 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T02:22:10.225 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T02:22:10.956 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:22:10.956 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:40 ago on Fri 06 Oct 2023 02:20:30 AM UTC. 2023-10-06T02:22:11.201 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T02:22:11.573 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-06T02:22:11.767 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 110/122 2023-10-06T02:22:12.025 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-06T02:22:12.181 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T02:22:12.193 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T02:22:12.345 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T02:22:12.503 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T02:22:12.641 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T02:22:12.833 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T02:22:12.884 INFO:teuthology.orchestra.run.smithi191.stdout:Installed products updated. 2023-10-06T02:22:13.033 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:13.034 INFO:teuthology.orchestra.run.smithi191.stdout:Upgraded: 2023-10-06T02:22:13.034 INFO:teuthology.orchestra.run.smithi191.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.034 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.034 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2023-10-06T02:22:13.034 INFO:teuthology.orchestra.run.smithi191.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T02:22:13.034 INFO:teuthology.orchestra.run.smithi191.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T02:22:13.034 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.034 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.035 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.035 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.035 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:22:13.035 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.035 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.035 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.035 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:22:13.035 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:22:13.035 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:22:13.035 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:22:13.036 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:22:13.036 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.036 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.036 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:22:13.036 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.036 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.036 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.036 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:22:13.037 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:22:13.037 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.037 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:22:13.037 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T02:22:13.037 INFO:teuthology.orchestra.run.smithi191.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T02:22:13.037 INFO:teuthology.orchestra.run.smithi191.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T02:22:13.037 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T02:22:13.037 INFO:teuthology.orchestra.run.smithi191.stdout: jq-1.5-12.el8.x86_64 2023-10-06T02:22:13.037 INFO:teuthology.orchestra.run.smithi191.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T02:22:13.038 INFO:teuthology.orchestra.run.smithi191.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T02:22:13.038 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T02:22:13.038 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.038 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.038 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.038 INFO:teuthology.orchestra.run.smithi191.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T02:22:13.038 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T02:22:13.038 INFO:teuthology.orchestra.run.smithi191.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T02:22:13.038 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T02:22:13.038 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T02:22:13.039 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.039 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.039 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T02:22:13.039 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.039 INFO:teuthology.orchestra.run.smithi191.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T02:22:13.039 INFO:teuthology.orchestra.run.smithi191.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T02:22:13.039 INFO:teuthology.orchestra.run.smithi191.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T02:22:13.039 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T02:22:13.039 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T02:22:13.039 INFO:teuthology.orchestra.run.smithi191.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T02:22:13.039 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T02:22:13.040 INFO:teuthology.orchestra.run.smithi191.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T02:22:13.040 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T02:22:13.040 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T02:22:13.040 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T02:22:13.040 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T02:22:13.040 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T02:22:13.040 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T02:22:13.040 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T02:22:13.040 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T02:22:13.040 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T02:22:13.040 INFO:teuthology.orchestra.run.smithi191.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T02:22:13.040 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T02:22:13.041 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.041 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.041 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.041 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T02:22:13.041 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T02:22:13.041 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T02:22:13.041 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T02:22:13.041 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T02:22:13.041 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T02:22:13.041 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T02:22:13.042 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T02:22:13.042 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T02:22:13.042 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T02:22:13.042 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T02:22:13.042 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T02:22:13.042 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T02:22:13.042 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T02:22:13.042 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T02:22:13.043 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T02:22:13.043 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T02:22:13.043 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T02:22:13.043 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T02:22:13.043 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T02:22:13.043 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T02:22:13.043 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T02:22:13.043 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T02:22:13.044 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T02:22:13.044 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T02:22:13.044 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.044 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.044 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T02:22:13.044 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T02:22:13.044 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.044 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T02:22:13.044 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T02:22:13.045 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T02:22:13.045 INFO:teuthology.orchestra.run.smithi191.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T02:22:13.045 INFO:teuthology.orchestra.run.smithi191.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T02:22:13.045 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T02:22:13.045 INFO:teuthology.orchestra.run.smithi191.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T02:22:13.045 INFO:teuthology.orchestra.run.smithi191.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T02:22:13.045 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T02:22:13.045 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T02:22:13.046 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T02:22:13.046 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T02:22:13.046 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T02:22:13.046 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.046 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.046 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:13.046 INFO:teuthology.orchestra.run.smithi191.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T02:22:13.046 INFO:teuthology.orchestra.run.smithi191.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T02:22:13.046 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T02:22:13.046 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T02:22:13.047 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T02:22:13.047 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:13.047 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2023-10-06T02:22:13.088 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T02:22:13.282 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T02:22:13.322 DEBUG:teuthology.parallel:result is None 2023-10-06T02:22:13.339 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T02:22:13.515 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T02:22:13.524 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T02:22:13.650 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-06T02:22:13.651 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T02:22:13.860 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T02:22:13.860 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:22:14.708 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:22:14.708 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T02:22:14.708 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T02:22:14.708 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T02:22:14.708 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:22:14.708 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T02:22:14.708 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:22:14.708 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T02:22:14.709 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T02:22:14.709 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T02:22:14.709 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:22:14.709 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T02:22:14.709 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T02:22:14.709 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:22:14.709 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T02:22:14.709 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T02:22:14.709 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T02:22:14.709 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T02:22:14.709 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T02:22:14.709 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T02:22:14.710 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T02:22:14.710 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T02:22:14.710 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T02:22:14.710 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T02:22:14.710 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T02:22:14.710 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T02:22:14.710 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T02:22:14.710 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T02:22:14.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T02:22:14.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T02:22:14.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T02:22:14.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T02:22:14.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T02:22:14.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T02:22:14.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T02:22:14.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T02:22:14.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T02:22:14.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T02:22:14.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T02:22:14.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T02:22:14.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T02:22:14.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T02:22:14.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T02:22:14.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T02:22:14.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T02:22:14.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T02:22:14.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T02:22:14.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T02:22:14.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T02:22:14.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T02:22:14.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T02:22:14.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T02:22:14.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T02:22:14.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T02:22:14.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T02:22:14.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T02:22:14.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T02:22:14.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T02:22:14.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T02:22:14.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T02:22:14.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T02:22:14.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T02:22:14.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T02:22:14.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T02:22:14.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T02:22:14.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T02:22:14.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T02:22:14.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T02:22:14.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T02:22:14.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T02:22:14.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T02:22:14.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T02:22:14.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-06T02:22:14.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-06T02:22:14.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-06T02:22:14.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-06T02:22:14.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-06T02:22:14.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-06T02:22:14.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-06T02:22:14.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-06T02:22:14.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-06T02:22:14.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-06T02:22:14.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-06T02:22:14.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-06T02:22:14.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-06T02:22:14.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-06T02:22:14.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-06T02:22:14.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-06T02:22:14.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-06T02:22:14.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-06T02:22:14.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-06T02:22:14.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-06T02:22:14.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-06T02:22:14.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-06T02:22:14.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-06T02:22:14.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-06T02:22:14.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-06T02:22:14.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-06T02:22:14.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-06T02:22:14.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-06T02:22:14.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-06T02:22:14.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-06T02:22:14.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-06T02:22:14.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-06T02:22:14.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-06T02:22:14.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-06T02:22:14.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-06T02:22:14.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-06T02:22:14.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-06T02:22:14.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-06T02:22:14.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-06T02:22:14.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-06T02:22:14.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-06T02:22:14.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-06T02:22:14.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-06T02:22:14.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-06T02:22:14.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-06T02:22:14.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-06T02:22:14.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-06T02:22:14.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T02:22:14.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T02:22:14.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T02:22:16.853 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:22:16.853 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:46 ago on Fri 06 Oct 2023 02:20:30 AM UTC. 2023-10-06T02:22:18.883 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-10-06T02:22:19.038 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:19.038 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2023-10-06T02:22:19.039 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.039 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.039 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-10-06T02:22:19.039 INFO:teuthology.orchestra.run.smithi037.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T02:22:19.039 INFO:teuthology.orchestra.run.smithi037.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T02:22:19.039 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.039 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.039 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.039 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.039 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:22:19.039 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:22:19.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:22:19.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:22:19.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:22:19.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:22:19.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:22:19.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.041 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.041 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:22:19.041 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:22:19.041 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.041 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:22:19.041 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T02:22:19.041 INFO:teuthology.orchestra.run.smithi037.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T02:22:19.041 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T02:22:19.041 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T02:22:19.041 INFO:teuthology.orchestra.run.smithi037.stdout: jq-1.5-12.el8.x86_64 2023-10-06T02:22:19.041 INFO:teuthology.orchestra.run.smithi037.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T02:22:19.041 INFO:teuthology.orchestra.run.smithi037.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T02:22:19.042 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T02:22:19.042 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.042 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.042 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.042 INFO:teuthology.orchestra.run.smithi037.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T02:22:19.042 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T02:22:19.042 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T02:22:19.042 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T02:22:19.042 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T02:22:19.042 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.042 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.042 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T02:22:19.043 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.043 INFO:teuthology.orchestra.run.smithi037.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T02:22:19.043 INFO:teuthology.orchestra.run.smithi037.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T02:22:19.043 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T02:22:19.043 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T02:22:19.043 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T02:22:19.043 INFO:teuthology.orchestra.run.smithi037.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T02:22:19.043 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T02:22:19.043 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T02:22:19.043 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T02:22:19.043 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T02:22:19.043 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T02:22:19.044 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T02:22:19.044 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T02:22:19.044 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T02:22:19.044 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T02:22:19.044 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T02:22:19.044 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T02:22:19.044 INFO:teuthology.orchestra.run.smithi037.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T02:22:19.044 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T02:22:19.044 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.044 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.044 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.044 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T02:22:19.045 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T02:22:19.045 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T02:22:19.045 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T02:22:19.045 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T02:22:19.045 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T02:22:19.045 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T02:22:19.045 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T02:22:19.045 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T02:22:19.045 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T02:22:19.045 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T02:22:19.045 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T02:22:19.045 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T02:22:19.046 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T02:22:19.046 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T02:22:19.046 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T02:22:19.046 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T02:22:19.046 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T02:22:19.046 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T02:22:19.046 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T02:22:19.046 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T02:22:19.046 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T02:22:19.046 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T02:22:19.046 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T02:22:19.046 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T02:22:19.047 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.047 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.047 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T02:22:19.047 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T02:22:19.047 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.047 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T02:22:19.047 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T02:22:19.047 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T02:22:19.047 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T02:22:19.047 INFO:teuthology.orchestra.run.smithi037.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T02:22:19.047 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T02:22:19.047 INFO:teuthology.orchestra.run.smithi037.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T02:22:19.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T02:22:19.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T02:22:19.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T02:22:19.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T02:22:19.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T02:22:19.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T02:22:19.048 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.048 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.048 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:22:19.048 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T02:22:19.048 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T02:22:19.048 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T02:22:19.049 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T02:22:19.049 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T02:22:19.049 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:19.049 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-10-06T02:22:19.342 DEBUG:teuthology.parallel:result is None 2023-10-06T02:22:19.343 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:22:19.488 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T02:22:19.510 INFO:teuthology.orchestra.run.smithi037.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T02:22:19.511 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T02:22:19.511 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T02:22:19.511 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:22:19.729 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T02:22:19.751 INFO:teuthology.orchestra.run.smithi191.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T02:22:19.751 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T02:22:19.751 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T02:22:19.751 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T02:22:19.752 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:19.752 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T02:22:19.792 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:19.792 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T02:22:19.831 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T02:22:19.831 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:19.831 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T02:22:19.857 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T02:22:19.922 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:19.922 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T02:22:19.946 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T02:22:20.010 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T02:22:20.011 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:20.011 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T02:22:20.035 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T02:22:20.099 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:20.099 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T02:22:20.123 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T02:22:20.186 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T02:22:20.187 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:20.187 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T02:22:20.213 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T02:22:20.277 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:20.277 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T02:22:20.300 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T02:22:20.364 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T02:22:20.426 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T02:22:20.426 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2023-10-06T02:22:20.428 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /var/log/ceph 2023-10-06T02:22:20.453 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T02:22:20.453 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T02:22:20.493 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T02:22:20.516 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T02:22:20.517 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T02:22:20.557 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T02:22:20.586 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T02:22:20.587 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T02:22:20.587 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T02:22:20.587 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:20.587 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T02:22:20.635 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T02:22:20.745 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T02:22:20.770 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:20.770 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T02:22:20.785 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T02:22:20.894 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T02:22:20.923 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T02:22:20.923 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T02:22:20.923 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412141', 'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412141', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7519, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f', 'targets': {'smithi037.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJKZlYzKIoGjt9JFShyDF3oIYG1ZkOSvbkkzfJQ7aXa7ji9xesq8T8H2iwcL2Cnnfcmkm3GdqofyWGlMdZ1KwSk=', 'smithi191.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI+eWs6loppbmZWAWipjk8z8S8JkotjVclCjsg9hRbEYaaxuuKNuoqQ/fC4yOBXcb5I4YN2Ki9rolXWP+DPBhSI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:52:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T02:22:20.924 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T02:22:20.926 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T02:22:20.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T02:22:20.981 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T02:22:21.036 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:21.037 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T02:22:21.059 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T02:22:21.059 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2023-10-06T02:22:21.115 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T02:22:21.115 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:22:21.116 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 217959 Links: 1 2023-10-06T02:22:21.116 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:22:21.116 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:22:21.116 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-10-06 02:22:14.287039303 +0000 2023-10-06T02:22:21.116 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-10-06 02:19:46.359762286 +0000 2023-10-06T02:22:21.116 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-10-06 02:19:46.359762286 +0000 2023-10-06T02:22:21.116 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2023-10-06T02:22:21.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T02:22:21.180 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-10-06T02:22:21.180 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-10-06T02:22:21.180 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000271438 s, 1.9 MB/s 2023-10-06T02:22:21.181 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T02:22:21.237 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2023-10-06T02:22:21.292 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T02:22:21.292 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:22:21.292 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 217085 Links: 1 2023-10-06T02:22:21.292 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:22:21.292 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:22:21.292 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-10-06 02:22:14.288039291 +0000 2023-10-06T02:22:21.292 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-10-06 02:19:46.867755918 +0000 2023-10-06T02:22:21.292 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-10-06 02:19:46.867755918 +0000 2023-10-06T02:22:21.292 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2023-10-06T02:22:21.293 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T02:22:21.355 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-10-06T02:22:21.355 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-10-06T02:22:21.355 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000224932 s, 2.3 MB/s 2023-10-06T02:22:21.356 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T02:22:21.412 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2023-10-06T02:22:21.468 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T02:22:21.468 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:22:21.468 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 219665 Links: 1 2023-10-06T02:22:21.468 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:22:21.468 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:22:21.468 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-10-06 02:22:14.288039291 +0000 2023-10-06T02:22:21.468 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-10-06 02:19:47.368749637 +0000 2023-10-06T02:22:21.468 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-10-06 02:19:47.368749637 +0000 2023-10-06T02:22:21.469 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2023-10-06T02:22:21.469 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T02:22:21.531 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-10-06T02:22:21.531 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-10-06T02:22:21.531 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000220777 s, 2.3 MB/s 2023-10-06T02:22:21.532 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T02:22:21.588 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2023-10-06T02:22:21.643 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T02:22:21.643 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:22:21.643 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 221637 Links: 1 2023-10-06T02:22:21.643 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:22:21.643 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:22:21.643 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-10-06 02:22:14.288039291 +0000 2023-10-06T02:22:21.643 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-10-06 02:19:47.877743257 +0000 2023-10-06T02:22:21.643 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-10-06 02:19:47.877743257 +0000 2023-10-06T02:22:21.643 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2023-10-06T02:22:21.644 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T02:22:21.706 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-10-06T02:22:21.706 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-10-06T02:22:21.706 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000193676 s, 2.6 MB/s 2023-10-06T02:22:21.707 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T02:22:21.762 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:22:21.763 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:21.763 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T02:22:21.778 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T02:22:21.779 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_1 2023-10-06T02:22:21.835 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T02:22:21.835 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:22:21.835 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 219971 Links: 1 2023-10-06T02:22:21.835 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:22:21.835 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:22:21.835 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2023-10-06 02:22:08.335637940 +0000 2023-10-06T02:22:21.835 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2023-10-06 02:19:37.614403527 +0000 2023-10-06T02:22:21.835 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2023-10-06 02:19:37.614403527 +0000 2023-10-06T02:22:21.835 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2023-10-06T02:22:21.836 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T02:22:21.899 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2023-10-06T02:22:21.900 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2023-10-06T02:22:21.900 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000268059 s, 1.9 MB/s 2023-10-06T02:22:21.901 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T02:22:21.958 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_2 2023-10-06T02:22:22.013 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T02:22:22.014 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:22:22.014 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 220002 Links: 1 2023-10-06T02:22:22.014 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:22:22.014 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:22:22.014 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2023-10-06 02:22:08.336637924 +0000 2023-10-06T02:22:22.014 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2023-10-06 02:19:38.106395369 +0000 2023-10-06T02:22:22.014 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2023-10-06 02:19:38.106395369 +0000 2023-10-06T02:22:22.014 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2023-10-06T02:22:22.015 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T02:22:22.077 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2023-10-06T02:22:22.077 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2023-10-06T02:22:22.077 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.00024723 s, 2.1 MB/s 2023-10-06T02:22:22.078 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T02:22:22.134 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_3 2023-10-06T02:22:22.190 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T02:22:22.190 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:22:22.190 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 220062 Links: 1 2023-10-06T02:22:22.190 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:22:22.190 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:22:22.190 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2023-10-06 02:22:08.336637924 +0000 2023-10-06T02:22:22.190 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2023-10-06 02:19:38.590387344 +0000 2023-10-06T02:22:22.190 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2023-10-06 02:19:38.590387344 +0000 2023-10-06T02:22:22.190 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2023-10-06T02:22:22.191 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T02:22:22.253 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2023-10-06T02:22:22.253 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2023-10-06T02:22:22.253 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000238222 s, 2.1 MB/s 2023-10-06T02:22:22.254 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T02:22:22.309 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_4 2023-10-06T02:22:22.364 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T02:22:22.364 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:22:22.364 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 220124 Links: 1 2023-10-06T02:22:22.365 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:22:22.365 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:22:22.365 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2023-10-06 02:22:08.336637924 +0000 2023-10-06T02:22:22.365 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2023-10-06 02:19:39.109378739 +0000 2023-10-06T02:22:22.365 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2023-10-06 02:19:39.109378739 +0000 2023-10-06T02:22:22.365 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2023-10-06T02:22:22.365 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T02:22:22.427 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2023-10-06T02:22:22.427 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2023-10-06T02:22:22.428 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000253094 s, 2.0 MB/s 2023-10-06T02:22:22.428 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T02:22:22.484 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:22:22.484 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi191.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T02:22:22.484 INFO:tasks.ceph:Generating config... 2023-10-06T02:22:22.485 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T02:22:22.486 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T02:22:22.486 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T02:22:22.486 INFO:tasks.ceph:[client] pid file = 2023-10-06T02:22:22.486 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T02:22:22.486 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T02:22:22.486 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T02:22:22.486 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T02:22:22.486 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T02:22:22.486 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T02:22:22.486 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T02:22:22.487 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T02:22:22.487 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T02:22:22.487 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T02:22:22.487 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T02:22:22.487 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T02:22:22.487 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T02:22:22.487 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T02:22:22.487 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T02:22:22.487 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T02:22:22.487 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T02:22:22.487 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-06T02:22:22.487 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-06T02:22:22.488 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-06T02:22:22.488 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T02:22:22.488 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T02:22:22.488 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-06T02:22:22.488 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-06T02:22:22.488 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T02:22:22.488 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T02:22:22.488 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-06T02:22:22.488 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T02:22:22.488 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T02:22:22.488 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T02:22:22.489 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T02:22:22.489 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T02:22:22.489 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T02:22:22.489 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T02:22:22.489 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T02:22:22.548 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T02:22:22.550 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T02:22:22.592 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:22:22.657 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.37'), ('mon.b', '172.21.15.191'), ('mon.c', '[v2:172.21.15.191:3301,v1:172.21.15.191:6790]')] 2023-10-06T02:22:22.657 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.37,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T02:22:22.658 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:22.658 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T02:22:22.712 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.37 --add b 172.21.15.191 --addv c '[v2:172.21.15.191:3301,v1:172.21.15.191:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:22:22.794 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:22:22.794 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: generated fsid d1f292a2-fd8c-430a-be88-f44de408e77c 2023-10-06T02:22:22.794 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = octopus 2023-10-06T02:22:22.795 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 0 2023-10-06T02:22:22.795 INFO:teuthology.orchestra.run.smithi037.stdout:fsid d1f292a2-fd8c-430a-be88-f44de408e77c 2023-10-06T02:22:22.795 INFO:teuthology.orchestra.run.smithi037.stdout:last_changed 2023-10-06T02:22:22.794901+0000 2023-10-06T02:22:22.795 INFO:teuthology.orchestra.run.smithi037.stdout:created 2023-10-06T02:22:22.794901+0000 2023-10-06T02:22:22.795 INFO:teuthology.orchestra.run.smithi037.stdout:min_mon_release 15 (octopus) 2023-10-06T02:22:22.795 INFO:teuthology.orchestra.run.smithi037.stdout:election_strategy: 1 2023-10-06T02:22:22.795 INFO:teuthology.orchestra.run.smithi037.stdout:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2023-10-06T02:22:22.795 INFO:teuthology.orchestra.run.smithi037.stdout:1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2023-10-06T02:22:22.795 INFO:teuthology.orchestra.run.smithi037.stdout:2: [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] mon.c 2023-10-06T02:22:22.795 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T02:22:22.796 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T02:22:22.852 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d1f292a2-fd8c-430a-be88-f44de408e77c... 2023-10-06T02:22:22.853 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:22:22.894 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:22:22.935 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2023-10-06T02:22:22.936 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2023-10-06T02:22:22.936 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:22:22.936 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2023-10-06T02:22:22.936 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.936 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2023-10-06T02:22:22.936 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.936 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2023-10-06T02:22:22.936 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.937 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2023-10-06T02:22:22.937 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2023-10-06T02:22:22.937 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.937 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2023-10-06T02:22:22.937 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2023-10-06T02:22:22.937 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.937 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:22:22.937 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2023-10-06T02:22:22.937 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.937 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:22:22.937 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:22:22.938 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.938 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2023-10-06T02:22:22.938 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.938 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2023-10-06T02:22:22.938 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2023-10-06T02:22:22.938 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:22:22.938 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:22:22.938 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2023-10-06T02:22:22.938 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:22:22.938 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2023-10-06T02:22:22.938 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:22:22.938 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:22:22.939 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2023-10-06T02:22:22.939 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.939 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:22:22.939 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.939 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2023-10-06T02:22:22.939 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.939 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2023-10-06T02:22:22.939 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.939 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2023-10-06T02:22:22.939 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2023-10-06T02:22:22.939 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2023-10-06T02:22:22.940 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]" 2023-10-06T02:22:22.940 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = d1f292a2-fd8c-430a-be88-f44de408e77c 2023-10-06T02:22:22.940 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.940 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2023-10-06T02:22:22.940 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2023-10-06T02:22:22.940 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.940 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2023-10-06T02:22:22.940 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2023-10-06T02:22:22.940 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:22:22.940 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.940 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2023-10-06T02:22:22.941 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2023-10-06T02:22:22.941 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.941 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2023-10-06T02:22:22.941 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2023-10-06T02:22:22.941 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2023-10-06T02:22:22.941 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.941 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2023-10-06T02:22:22.941 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2023-10-06T02:22:22.941 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.941 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:22:22.941 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.941 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2023-10-06T02:22:22.942 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.942 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2023-10-06T02:22:22.942 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.942 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:22:22.942 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2023-10-06T02:22:22.942 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.942 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2023-10-06T02:22:22.942 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2023-10-06T02:22:22.942 INFO:teuthology.orchestra.run.smithi037.stdout: bdev async discard = True 2023-10-06T02:22:22.942 INFO:teuthology.orchestra.run.smithi037.stdout: bdev enable discard = True 2023-10-06T02:22:22.942 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore allocator = bitmap 2023-10-06T02:22:22.943 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2023-10-06T02:22:22.943 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2023-10-06T02:22:22.943 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 1/20 2023-10-06T02:22:22.943 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 1/20 2023-10-06T02:22:22.943 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:22:22.943 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2023-10-06T02:22:22.943 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 4/10 2023-10-06T02:22:22.943 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:22:22.943 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2023-10-06T02:22:22.943 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:22:22.943 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:22:22.943 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2023-10-06T02:22:22.944 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-10-06T02:22:22.944 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.944 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2023-10-06T02:22:22.944 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:22:22.944 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2023-10-06T02:22:22.944 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-10-06T02:22:22.944 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-10-06T02:22:22.944 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:22:22.944 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:22:22.944 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2023-10-06T02:22:22.944 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.945 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2023-10-06T02:22:22.945 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:22:22.945 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-10-06T02:22:22.945 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2023-10-06T02:22:22.945 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-10-06T02:22:22.945 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2023-10-06T02:22:22.945 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2023-10-06T02:22:22.945 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:22:22.945 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2023-10-06T02:22:22.945 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2023-10-06T02:22:22.945 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:22:22.945 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.946 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:22:22.946 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:22:22.946 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:22:22.946 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.946 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:22:22.946 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:22:22.946 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:22:22.946 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.946 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2023-10-06T02:22:22.946 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:22:22.946 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.947 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:22:22.947 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2023-10-06T02:22:22.947 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:22.947 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2023-10-06T02:22:22.947 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2023-10-06T02:22:22.947 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2023-10-06T02:22:22.947 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2023-10-06T02:22:22.947 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:22:22.947 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:22:22.947 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2023-10-06T02:22:22.947 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2023-10-06T02:22:22.947 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:22:22.948 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = "" 2023-10-06T02:22:22.948 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-10-06T02:22:22.948 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-10-06T02:22:22.948 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2023-10-06T02:22:22.948 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2023-10-06T02:22:22.948 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2023-10-06T02:22:22.948 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-10-06T02:22:22.948 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-10-06T02:22:22.948 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-10-06T02:22:22.948 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-10-06T02:22:22.948 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2023-10-06T02:22:22.948 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2023-10-06T02:22:22.949 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:22:22.949 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2023-10-06T02:22:22.949 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = True 2023-10-06T02:22:22.949 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2023-10-06T02:22:22.949 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = True 2023-10-06T02:22:22.949 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-10-06T02:22:22.949 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-10-06T02:22:22.949 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-10-06T02:22:22.951 INFO:teuthology.orchestra.run.smithi191.stdout:[global] 2023-10-06T02:22:22.951 INFO:teuthology.orchestra.run.smithi191.stdout: chdir = "" 2023-10-06T02:22:22.951 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:22:22.951 INFO:teuthology.orchestra.run.smithi191.stdout: auth supported = cephx 2023-10-06T02:22:22.951 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.951 INFO:teuthology.orchestra.run.smithi191.stdout: filestore xattr use omap = true 2023-10-06T02:22:22.951 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.951 INFO:teuthology.orchestra.run.smithi191.stdout: mon clock drift allowed = 1.000 2023-10-06T02:22:22.951 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.952 INFO:teuthology.orchestra.run.smithi191.stdout: osd crush chooseleaf type = 0 2023-10-06T02:22:22.952 INFO:teuthology.orchestra.run.smithi191.stdout: auth debug = true 2023-10-06T02:22:22.952 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.952 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on old message = true 2023-10-06T02:22:22.952 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on bug = true 2023-10-06T02:22:22.952 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.952 INFO:teuthology.orchestra.run.smithi191.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:22:22.952 INFO:teuthology.orchestra.run.smithi191.stdout: mon pg warn max object skew = 0 2023-10-06T02:22:22.952 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.952 INFO:teuthology.orchestra.run.smithi191.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:22:22.952 INFO:teuthology.orchestra.run.smithi191.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:22:22.953 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.953 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default size = 2 2023-10-06T02:22:22.953 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.953 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow primary affinity = true 2023-10-06T02:22:22.953 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow pg remap = true 2023-10-06T02:22:22.953 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:22:22.953 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:22:22.953 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on no sortbitwise = false 2023-10-06T02:22:22.953 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:22:22.953 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on too few osds = false 2023-10-06T02:22:22.953 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:22:22.953 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:22:22.954 INFO:teuthology.orchestra.run.smithi191.stdout: mon_allow_pool_size_one = true 2023-10-06T02:22:22.954 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.954 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:22:22.954 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.954 INFO:teuthology.orchestra.run.smithi191.stdout: osd default data pool replay window = 5 2023-10-06T02:22:22.954 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.954 INFO:teuthology.orchestra.run.smithi191.stdout: mon allow pool delete = true 2023-10-06T02:22:22.954 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.954 INFO:teuthology.orchestra.run.smithi191.stdout: mon cluster log file level = debug 2023-10-06T02:22:22.954 INFO:teuthology.orchestra.run.smithi191.stdout: debug asserts on shutdown = true 2023-10-06T02:22:22.954 INFO:teuthology.orchestra.run.smithi191.stdout: mon health detail to clog = false 2023-10-06T02:22:22.954 INFO:teuthology.orchestra.run.smithi191.stdout: mon host = "172.21.15.37,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]" 2023-10-06T02:22:22.955 INFO:teuthology.orchestra.run.smithi191.stdout: fsid = d1f292a2-fd8c-430a-be88-f44de408e77c 2023-10-06T02:22:22.955 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.955 INFO:teuthology.orchestra.run.smithi191.stdout:[osd] 2023-10-06T02:22:22.955 INFO:teuthology.orchestra.run.smithi191.stdout: osd journal size = 100 2023-10-06T02:22:22.955 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.955 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub load threshold = 5.0 2023-10-06T02:22:22.955 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub max interval = 600 2023-10-06T02:22:22.955 INFO:teuthology.orchestra.run.smithi191.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:22:22.955 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.955 INFO:teuthology.orchestra.run.smithi191.stdout: osd recover clone overlap = true 2023-10-06T02:22:22.955 INFO:teuthology.orchestra.run.smithi191.stdout: osd recovery max chunk = 1048576 2023-10-06T02:22:22.955 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.956 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug shutdown = true 2023-10-06T02:22:22.956 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug op order = true 2023-10-06T02:22:22.956 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug verify stray on activate = true 2023-10-06T02:22:22.956 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.956 INFO:teuthology.orchestra.run.smithi191.stdout: osd open classes on start = true 2023-10-06T02:22:22.956 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug pg log writeout = true 2023-10-06T02:22:22.956 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.956 INFO:teuthology.orchestra.run.smithi191.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:22:22.956 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.956 INFO:teuthology.orchestra.run.smithi191.stdout: osd map max advance = 10 2023-10-06T02:22:22.956 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.957 INFO:teuthology.orchestra.run.smithi191.stdout: journal zero on create = true 2023-10-06T02:22:22.957 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.957 INFO:teuthology.orchestra.run.smithi191.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:22:22.957 INFO:teuthology.orchestra.run.smithi191.stdout: filestore apply finisher threads = 3 2023-10-06T02:22:22.957 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.957 INFO:teuthology.orchestra.run.smithi191.stdout: bdev debug aio = true 2023-10-06T02:22:22.957 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug misdirected ops = true 2023-10-06T02:22:22.957 INFO:teuthology.orchestra.run.smithi191.stdout: bdev async discard = True 2023-10-06T02:22:22.957 INFO:teuthology.orchestra.run.smithi191.stdout: bdev enable discard = True 2023-10-06T02:22:22.957 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore allocator = bitmap 2023-10-06T02:22:22.957 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore block size = 96636764160 2023-10-06T02:22:22.958 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore fsck on mount = True 2023-10-06T02:22:22.958 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluefs = 1/20 2023-10-06T02:22:22.958 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluestore = 1/20 2023-10-06T02:22:22.958 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:22:22.958 INFO:teuthology.orchestra.run.smithi191.stdout: debug osd = 20 2023-10-06T02:22:22.958 INFO:teuthology.orchestra.run.smithi191.stdout: debug rocksdb = 4/10 2023-10-06T02:22:22.958 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:22:22.958 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd full ratio = 0.9 2023-10-06T02:22:22.958 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:22:22.958 INFO:teuthology.orchestra.run.smithi191.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:22:22.958 INFO:teuthology.orchestra.run.smithi191.stdout: osd objectstore = bluestore 2023-10-06T02:22:22.958 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2023-10-06T02:22:22.959 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.959 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr] 2023-10-06T02:22:22.959 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:22:22.959 INFO:teuthology.orchestra.run.smithi191.stdout: debug mgr = 20 2023-10-06T02:22:22.959 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2023-10-06T02:22:22.959 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2023-10-06T02:22:22.959 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:22:22.959 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:22:22.959 INFO:teuthology.orchestra.run.smithi191.stdout: mgr/telemetry/nag = false 2023-10-06T02:22:22.959 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.959 INFO:teuthology.orchestra.run.smithi191.stdout:[mon] 2023-10-06T02:22:22.959 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:22:22.960 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2023-10-06T02:22:22.960 INFO:teuthology.orchestra.run.smithi191.stdout: debug paxos = 20 2023-10-06T02:22:22.960 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2023-10-06T02:22:22.960 INFO:teuthology.orchestra.run.smithi191.stdout: mon data avail warn = 5 2023-10-06T02:22:22.960 INFO:teuthology.orchestra.run.smithi191.stdout: mon mgr mkfs grace = 240 2023-10-06T02:22:22.960 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:22:22.960 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd reporter subtree level = osd 2023-10-06T02:22:22.960 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd prime pg temp = true 2023-10-06T02:22:22.960 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:22:22.960 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.960 INFO:teuthology.orchestra.run.smithi191.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:22:22.960 INFO:teuthology.orchestra.run.smithi191.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:22:22.960 INFO:teuthology.orchestra.run.smithi191.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:22:22.961 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.961 INFO:teuthology.orchestra.run.smithi191.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:22:22.961 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:22:22.961 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:22:22.961 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.961 INFO:teuthology.orchestra.run.smithi191.stdout: # 1m isn't quite enough 2023-10-06T02:22:22.961 INFO:teuthology.orchestra.run.smithi191.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:22:22.961 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.961 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:22:22.961 INFO:teuthology.orchestra.run.smithi191.stdout: mon op complaint time = 120 2023-10-06T02:22:22.961 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:22:22.961 INFO:teuthology.orchestra.run.smithi191.stdout:[client] 2023-10-06T02:22:22.962 INFO:teuthology.orchestra.run.smithi191.stdout: rgw cache enabled = true 2023-10-06T02:22:22.962 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable ops log = true 2023-10-06T02:22:22.962 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable usage log = true 2023-10-06T02:22:22.962 INFO:teuthology.orchestra.run.smithi191.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:22:22.962 INFO:teuthology.orchestra.run.smithi191.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:22:22.962 INFO:teuthology.orchestra.run.smithi191.stdout: client mount timeout = 600 2023-10-06T02:22:22.962 INFO:teuthology.orchestra.run.smithi191.stdout: debug client = 20 2023-10-06T02:22:22.962 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:22:22.962 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = "" 2023-10-06T02:22:22.962 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2023-10-06T02:22:22.962 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2023-10-06T02:22:22.963 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.a] 2023-10-06T02:22:22.963 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.b] 2023-10-06T02:22:22.963 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.c] 2023-10-06T02:22:22.963 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.a] 2023-10-06T02:22:22.963 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.c] 2023-10-06T02:22:22.963 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.b] 2023-10-06T02:22:22.963 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.d] 2023-10-06T02:22:22.963 INFO:teuthology.orchestra.run.smithi191.stdout:[mds] 2023-10-06T02:22:22.963 INFO:teuthology.orchestra.run.smithi191.stdout: debug mds = 20 2023-10-06T02:22:22.963 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:22:22.963 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug frag = True 2023-10-06T02:22:22.963 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug scatterstat = True 2023-10-06T02:22:22.964 INFO:teuthology.orchestra.run.smithi191.stdout: mds op complaint time = 180 2023-10-06T02:22:22.964 INFO:teuthology.orchestra.run.smithi191.stdout: mds verify scatter = True 2023-10-06T02:22:22.964 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2023-10-06T02:22:22.964 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2023-10-06T02:22:22.964 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2023-10-06T02:22:22.964 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T02:22:22.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T02:22:23.045 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T02:22:23.045 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:23.046 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T02:22:23.061 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:23.061 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T02:22:23.116 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:22:23.116 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:23.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T02:22:23.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:22:23.191 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:23.191 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:22:23.246 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:22:23.246 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:23.246 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T02:22:23.246 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:22:23.281 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:23.281 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:22:23.335 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T02:22:23.336 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T02:22:23.336 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T02:22:23.384 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T02:22:23.387 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T02:22:23.441 INFO:teuthology.orchestra.run.smithi191.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T02:22:23.444 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T02:22:23.444 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T02:22:23.494 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T02:22:23.496 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T02:22:23.520 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T02:22:23.610 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T02:22:23.612 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T02:22:23.637 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T02:22:23.684 INFO:teuthology.orchestra.run.smithi191.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T02:22:23.687 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T02:22:23.710 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T02:22:23.798 INFO:teuthology.orchestra.run.smithi191.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T02:22:23.800 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T02:22:23.823 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T02:22:23.824 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T02:22:23.862 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T02:22:23.875 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T02:22:23.954 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T02:22:23.966 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T02:22:24.003 INFO:teuthology.orchestra.run.smithi191.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T02:22:24.016 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T02:22:24.093 INFO:teuthology.orchestra.run.smithi191.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T02:22:24.105 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T02:22:24.105 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi191.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T02:22:24.105 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T02:22:24.131 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:22:24.131 INFO:tasks.ceph:role: osd.0 2023-10-06T02:22:24.131 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:22:24.131 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T02:22:24.203 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:22:24.203 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:22:24.203 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:22:24.204 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 2023-10-06T02:22:24.204 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:22:24.204 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:22:24.204 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:22:24.204 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:22:24.204 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:22:24.204 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:22:24.646 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-10-06T02:22:24.648 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-10-06T02:22:24.648 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T02:22:24.830 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T02:22:24.863 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T02:22:24.930 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:22:24.930 INFO:tasks.ceph:role: osd.1 2023-10-06T02:22:24.930 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:22:24.930 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T02:22:25.003 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:22:25.003 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:22:25.003 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:22:25.003 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 2023-10-06T02:22:25.003 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:22:25.003 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:22:25.003 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:22:25.004 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:22:25.004 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:22:25.004 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:22:25.419 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-10-06T02:22:25.421 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-10-06T02:22:25.421 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T02:22:25.540 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T02:22:25.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T02:22:25.637 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:22:25.637 INFO:tasks.ceph:role: osd.2 2023-10-06T02:22:25.637 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:22:25.637 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T02:22:25.710 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:22:25.800 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:22:25.800 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:22:25.800 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 2023-10-06T02:22:25.800 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:22:25.800 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:22:25.800 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:22:25.800 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:22:25.801 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:22:25.801 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:22:26.160 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-10-06T02:22:26.161 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-10-06T02:22:26.162 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T02:22:26.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T02:22:26.334 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T02:22:26.401 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:22:26.401 INFO:tasks.ceph:role: osd.3 2023-10-06T02:22:26.401 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:22:26.401 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T02:22:26.475 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:22:26.520 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:22:26.520 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:22:26.521 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 2023-10-06T02:22:26.521 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:22:26.521 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:22:26.521 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:22:26.521 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:22:26.521 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:22:26.521 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:22:26.918 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-10-06T02:22:26.920 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-10-06T02:22:26.920 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T02:22:27.093 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T02:22:27.125 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:22:27.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:27.223+0000 7f39824f9540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T02:22:27.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:27.224+0000 7f39824f9540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T02:22:27.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:27.224+0000 7f39824f9540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T02:22:27.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:27.224+0000 7f39824f9540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T02:22:27.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:27.224+0000 7f39824f9540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T02:22:27.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:27.224+0000 7f39824f9540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T02:22:27.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:27.753+0000 7f39824f9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:28.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:28.518+0000 7f39824f9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:29.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:29.280+0000 7f39824f9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:30.088 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T02:22:30.118 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:22:30.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:30.204+0000 7f810eb12540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T02:22:30.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:30.204+0000 7f810eb12540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T02:22:30.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:30.204+0000 7f810eb12540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T02:22:30.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:30.204+0000 7f810eb12540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T02:22:30.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:30.204+0000 7f810eb12540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T02:22:30.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:30.205+0000 7f810eb12540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T02:22:30.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:30.729+0000 7f810eb12540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:31.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:31.491+0000 7f810eb12540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:32.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:32.254+0000 7f810eb12540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:33.051 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T02:22:33.081 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:22:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:33.168+0000 7f8af13c9540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T02:22:33.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:33.168+0000 7f8af13c9540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T02:22:33.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:33.168+0000 7f8af13c9540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T02:22:33.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:33.168+0000 7f8af13c9540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T02:22:33.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:33.168+0000 7f8af13c9540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T02:22:33.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:33.169+0000 7f8af13c9540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T02:22:33.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:33.704+0000 7f8af13c9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:34.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:34.469+0000 7f8af13c9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:35.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:35.231+0000 7f8af13c9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:36.031 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T02:22:36.061 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:22:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:36.146+0000 7fca1970b540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T02:22:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:36.147+0000 7fca1970b540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T02:22:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:36.147+0000 7fca1970b540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T02:22:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:36.147+0000 7fca1970b540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T02:22:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:36.147+0000 7fca1970b540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T02:22:36.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:36.147+0000 7fca1970b540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T02:22:36.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:36.677+0000 7fca1970b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:37.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:37.438+0000 7fca1970b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:38.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:38.201+0000 7fca1970b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:38.993 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T02:22:39.026 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T02:22:39.056 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:22:39.056 INFO:tasks.ceph:role: osd.4 2023-10-06T02:22:39.056 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:22:39.056 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T02:22:39.129 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:22:39.130 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:22:39.130 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:22:39.130 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 2023-10-06T02:22:39.130 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:22:39.130 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:22:39.130 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:22:39.130 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:22:39.130 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:22:39.130 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:22:39.559 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2023-10-06T02:22:39.561 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2023-10-06T02:22:39.562 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T02:22:39.731 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T02:22:39.766 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T02:22:39.831 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:22:39.831 INFO:tasks.ceph:role: osd.5 2023-10-06T02:22:39.831 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:22:39.831 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T02:22:39.902 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:22:39.902 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:22:39.902 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:22:39.902 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 2023-10-06T02:22:39.902 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:22:39.902 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:22:39.902 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:22:39.902 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:22:39.903 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:22:39.903 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:22:40.327 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2023-10-06T02:22:40.329 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2023-10-06T02:22:40.329 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T02:22:40.435 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T02:22:40.464 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T02:22:40.529 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:22:40.529 INFO:tasks.ceph:role: osd.6 2023-10-06T02:22:40.529 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:22:40.529 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T02:22:40.601 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:22:40.601 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:22:40.601 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:22:40.601 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 2023-10-06T02:22:40.601 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:22:40.601 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:22:40.601 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:22:40.602 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:22:40.602 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:22:40.602 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:22:41.049 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2023-10-06T02:22:41.051 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2023-10-06T02:22:41.051 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T02:22:41.216 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T02:22:41.245 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T02:22:41.309 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:22:41.310 INFO:tasks.ceph:role: osd.7 2023-10-06T02:22:41.310 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:22:41.310 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T02:22:41.381 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:22:41.382 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:22:41.382 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:22:41.382 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 2023-10-06T02:22:41.382 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:22:41.382 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:22:41.382 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:22:41.382 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:22:41.382 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:22:41.382 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:22:41.834 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2023-10-06T02:22:41.836 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2023-10-06T02:22:41.836 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T02:22:42.015 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T02:22:42.046 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:22:42.149 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:42.149+0000 7f5a2be91540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T02:22:42.150 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:42.149+0000 7f5a2be91540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T02:22:42.150 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:42.149+0000 7f5a2be91540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T02:22:42.150 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:42.149+0000 7f5a2be91540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T02:22:42.150 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:42.149+0000 7f5a2be91540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T02:22:42.150 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:42.150+0000 7f5a2be91540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T02:22:42.679 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:42.679+0000 7f5a2be91540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:43.445 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:43.445+0000 7f5a2be91540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:44.208 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:44.208+0000 7f5a2be91540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:45.012 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T02:22:45.039 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:22:45.123 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:45.122+0000 7f888cf78540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T02:22:45.123 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:45.123+0000 7f888cf78540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T02:22:45.123 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:45.123+0000 7f888cf78540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T02:22:45.123 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:45.123+0000 7f888cf78540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T02:22:45.124 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:45.123+0000 7f888cf78540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T02:22:45.124 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:45.123+0000 7f888cf78540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T02:22:45.647 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:45.647+0000 7f888cf78540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:46.409 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:46.409+0000 7f888cf78540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:47.176 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:47.175+0000 7f888cf78540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:47.973 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T02:22:48.039 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:22:48.123 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:48.121+0000 7f2c9af05540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T02:22:48.123 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:48.121+0000 7f2c9af05540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T02:22:48.123 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:48.121+0000 7f2c9af05540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T02:22:48.123 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:48.121+0000 7f2c9af05540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T02:22:48.123 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:48.121+0000 7f2c9af05540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T02:22:48.123 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:48.122+0000 7f2c9af05540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T02:22:48.650 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:48.648+0000 7f2c9af05540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:49.412 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:49.411+0000 7f2c9af05540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:50.174 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:50.173+0000 7f2c9af05540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:50.925 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:22:50.928 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:22:50.990 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T02:22:51.016 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:22:51.113 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:51.111+0000 7fc116a96540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T02:22:51.113 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:51.112+0000 7fc116a96540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T02:22:51.113 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:51.112+0000 7fc116a96540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T02:22:51.113 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:51.112+0000 7fc116a96540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T02:22:51.113 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:51.112+0000 7fc116a96540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T02:22:51.114 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:51.112+0000 7fc116a96540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T02:22:51.636 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:51.635+0000 7fc116a96540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:52.398 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:52.397+0000 7fc116a96540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:53.161 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:53.160+0000 7fc116a96540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:22:53.954 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T02:22:54.018 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T02:22:54.018 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:54.019 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T02:22:54.047 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:54.047 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T02:22:54.114 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:54.114 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T02:22:54.180 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:54.180 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T02:22:54.247 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:54.247 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T02:22:54.312 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:54.313 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T02:22:54.378 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:54.378 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T02:22:54.443 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:54.443 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T02:22:54.467 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:54.467 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T02:22:54.532 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:54.532 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T02:22:54.595 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:54.595 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T02:22:54.658 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:54.659 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T02:22:54.722 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:54.723 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T02:22:54.786 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:54.787 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T02:22:54.850 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:54.850 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T02:22:54.866 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:54.866 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T02:22:54.921 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:54.921 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T02:22:54.935 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:54.935 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T02:22:54.990 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T02:22:54.990 DEBUG:teuthology.orchestra.run.smithi037:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T02:22:54.992 DEBUG:teuthology.orchestra.run.smithi191:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T02:22:55.033 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.y] 2023-10-06T02:22:55.033 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBfbx9l5BH7FhAAotvMdV8pKCJzZUqTviL3CQ== 2023-10-06T02:22:55.033 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-10-06T02:22:55.033 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBfbx9lkQF5HRAAmDbVzKumixz+mz8C9Ibu4w== 2023-10-06T02:22:55.033 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-10-06T02:22:55.033 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBfbx9lSQ5oJBAAvXZ5RKQNOEujDD8kM0QU+Q== 2023-10-06T02:22:55.034 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2023-10-06T02:22:55.034 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBjbx9lLEJuDRAA5astKYoPcHwja09KROk+tQ== 2023-10-06T02:22:55.034 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2023-10-06T02:22:55.034 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBmbx9lwdVEDBAA5TMlEiE5UAavPJzdV22Gtw== 2023-10-06T02:22:55.034 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2023-10-06T02:22:55.034 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBpbx9lF5UeChAA1fYYSrtxmm7yMS4pn/hacQ== 2023-10-06T02:22:55.034 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.3] 2023-10-06T02:22:55.034 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBsbx9l3oTYCBAADYVyJ6Yt2sZfXhundjqceQ== 2023-10-06T02:22:55.034 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.x] 2023-10-06T02:22:55.034 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBfbx9lg7hcGhAAelKPvNX7CL80KycBGoQ8cw== 2023-10-06T02:22:55.035 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-10-06T02:22:55.035 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBfbx9lpPDVKBAAdg+chey8icfN9/u/REprEw== 2023-10-06T02:22:55.035 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-10-06T02:22:55.035 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBfbx9lE5adLxAAb6XIxhNYBl7FVcprFY526g== 2023-10-06T02:22:55.035 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.4] 2023-10-06T02:22:55.035 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBybx9lhrfuCBAA7A97uVPnZDT9ia70W5180A== 2023-10-06T02:22:55.035 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.5] 2023-10-06T02:22:55.035 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQB1bx9lEntaBxAAzvIEHp4iJvnev2yuqPL3tA== 2023-10-06T02:22:55.035 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.6] 2023-10-06T02:22:55.035 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQB4bx9lZaxXBxAAE+FsUplhP39hVXuZ4btCqQ== 2023-10-06T02:22:55.035 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.7] 2023-10-06T02:22:55.035 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQB7bx9lAtvBBhAAZzUs75blYnu3OocrsTVHSg== 2023-10-06T02:22:55.036 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-10-06T02:22:55.036 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBfbx9llHl0MxAAPrpwRuKiAcn+W0aDwzBvvQ== 2023-10-06T02:22:55.036 INFO:teuthology.orchestra.run.smithi037.stdout:[client.2] 2023-10-06T02:22:55.036 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBfbx9lByLlOBAAeTJLSorscEidED7VHIPKCg== 2023-10-06T02:22:55.036 INFO:teuthology.orchestra.run.smithi037.stdout:[client.1] 2023-10-06T02:22:55.036 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBgbx9lgp1AABAA+oAQVt7MWVsWnRxbWVLNbA== 2023-10-06T02:22:55.036 INFO:teuthology.orchestra.run.smithi037.stdout:[client.3] 2023-10-06T02:22:55.036 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBgbx9l6LuWBRAAvYfXvGvgMYDPlB4CgKaNqw== 2023-10-06T02:22:55.052 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr.y] 2023-10-06T02:22:55.052 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBfbx9l5BH7FhAAotvMdV8pKCJzZUqTviL3CQ== 2023-10-06T02:22:55.052 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.a] 2023-10-06T02:22:55.052 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBfbx9lkQF5HRAAmDbVzKumixz+mz8C9Ibu4w== 2023-10-06T02:22:55.052 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.c] 2023-10-06T02:22:55.053 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBfbx9lSQ5oJBAAvXZ5RKQNOEujDD8kM0QU+Q== 2023-10-06T02:22:55.053 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.0] 2023-10-06T02:22:55.053 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBjbx9lLEJuDRAA5astKYoPcHwja09KROk+tQ== 2023-10-06T02:22:55.053 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.1] 2023-10-06T02:22:55.053 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBmbx9lwdVEDBAA5TMlEiE5UAavPJzdV22Gtw== 2023-10-06T02:22:55.053 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.2] 2023-10-06T02:22:55.053 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBpbx9lF5UeChAA1fYYSrtxmm7yMS4pn/hacQ== 2023-10-06T02:22:55.053 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.3] 2023-10-06T02:22:55.053 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBsbx9l3oTYCBAADYVyJ6Yt2sZfXhundjqceQ== 2023-10-06T02:22:55.053 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr.x] 2023-10-06T02:22:55.053 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBfbx9lg7hcGhAAelKPvNX7CL80KycBGoQ8cw== 2023-10-06T02:22:55.054 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.b] 2023-10-06T02:22:55.054 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBfbx9lpPDVKBAAdg+chey8icfN9/u/REprEw== 2023-10-06T02:22:55.054 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.d] 2023-10-06T02:22:55.054 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBfbx9lE5adLxAAb6XIxhNYBl7FVcprFY526g== 2023-10-06T02:22:55.054 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.4] 2023-10-06T02:22:55.054 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBybx9lhrfuCBAA7A97uVPnZDT9ia70W5180A== 2023-10-06T02:22:55.054 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.5] 2023-10-06T02:22:55.054 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQB1bx9lEntaBxAAzvIEHp4iJvnev2yuqPL3tA== 2023-10-06T02:22:55.054 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.6] 2023-10-06T02:22:55.054 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQB4bx9lZaxXBxAAE+FsUplhP39hVXuZ4btCqQ== 2023-10-06T02:22:55.054 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.7] 2023-10-06T02:22:55.055 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQB7bx9lAtvBBhAAZzUs75blYnu3OocrsTVHSg== 2023-10-06T02:22:55.055 INFO:teuthology.orchestra.run.smithi191.stdout:[client.0] 2023-10-06T02:22:55.055 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBfbx9llHl0MxAAPrpwRuKiAcn+W0aDwzBvvQ== 2023-10-06T02:22:55.055 INFO:teuthology.orchestra.run.smithi191.stdout:[client.2] 2023-10-06T02:22:55.055 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBfbx9lByLlOBAAeTJLSorscEidED7VHIPKCg== 2023-10-06T02:22:55.055 INFO:teuthology.orchestra.run.smithi191.stdout:[client.1] 2023-10-06T02:22:55.055 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBgbx9lgp1AABAA+oAQVt7MWVsWnRxbWVLNbA== 2023-10-06T02:22:55.055 INFO:teuthology.orchestra.run.smithi191.stdout:[client.3] 2023-10-06T02:22:55.055 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBgbx9l6LuWBRAAvYfXvGvgMYDPlB4CgKaNqw== 2023-10-06T02:22:55.056 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T02:22:55.080 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T02:22:55.142 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:22:55.144 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:22:55.195 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:22:55.197 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:22:55.247 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:22:55.249 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:22:55.296 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:22:55.299 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:22:55.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:22:55.348 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:22:55.395 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:22:55.397 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:22:55.444 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T02:22:55.446 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T02:22:55.493 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:22:55.494 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:22:55.545 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:22:55.546 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:22:55.596 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:22:55.599 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:22:55.646 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:22:55.649 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:22:55.696 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:22:55.698 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:22:55.745 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:22:55.747 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:22:55.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:22:55.796 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:22:55.846 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:22:55.848 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:22:55.899 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:22:55.901 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:22:55.951 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:22:55.953 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:22:56.004 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T02:22:56.004 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T02:22:56.029 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T02:22:56.122 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T02:22:56.146 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T02:22:56.170 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T02:22:56.263 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T02:22:56.287 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T02:22:56.352 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T02:22:56.443 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T02:22:56.467 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:22:56.470 DEBUG:teuthology.orchestra.run.smithi191:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:22:56.522 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T02:22:56.522 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T02:22:56.522 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T02:22:56.525 INFO:tasks.ceph.mon.a:Started 2023-10-06T02:22:56.525 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T02:22:56.525 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T02:22:56.564 INFO:tasks.ceph.mon.b:Started 2023-10-06T02:22:56.564 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T02:22:56.565 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T02:22:56.566 INFO:tasks.ceph.mon.c:Started 2023-10-06T02:22:56.566 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T02:22:56.567 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T02:22:56.567 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T02:22:56.569 INFO:tasks.ceph.mgr.y:Started 2023-10-06T02:22:56.569 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T02:22:56.569 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T02:22:56.571 INFO:tasks.ceph.mgr.x:Started 2023-10-06T02:22:56.571 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T02:22:56.571 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T02:22:56.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.688+0000 7fab02ca0700 1 Processor -- start 2023-10-06T02:22:56.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.688+0000 7fab02ca0700 1 -- start start 2023-10-06T02:22:56.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.689+0000 7fab02ca0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faafc0ca7d0 0x7faafc06c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:56.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.689+0000 7fab02ca0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faafc1597b0 0x7faafc069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:56.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.689+0000 7fab02ca0700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faafc06d4d0 con 0x7faafc0aee30 2023-10-06T02:22:56.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.689+0000 7fab02ca0700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faafc06c5f0 con 0x7faafc0ca7d0 2023-10-06T02:22:56.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.689+0000 7fab02ca0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc06c8c0 con 0x7faafc1597b0 2023-10-06T02:22:56.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.689+0000 7fab00a3c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faafc0ca7d0 0x7faafc06c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:56.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.689+0000 7fab00a3c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faafc0ca7d0 0x7faafc06c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44176/0 (socket says 172.21.15.37:44176) 2023-10-06T02:22:56.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.689+0000 7fab00a3c700 1 -- 172.21.15.37:0/3014383513 learned_addr learned my addr 172.21.15.37:0/3014383513 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:22:56.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.689+0000 7fab00a3c700 1 -- 172.21.15.37:0/3014383513 >> v2:172.21.15.37:3300/0 conn(0x7faafc0ca7d0 msgr2=0x7faafc06c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T02:22:56.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.689+0000 7fab00a3c700 1 -- 172.21.15.37:0/3014383513 >> v2:172.21.15.37:3300/0 conn(0x7faafc0ca7d0 msgr2=0x7faafc06c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:22:56.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.689+0000 7fab00a3c700 1 --2- 172.21.15.37:0/3014383513 >> v2:172.21.15.37:3300/0 conn(0x7faafc0ca7d0 0x7faafc06c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:22:56.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.689+0000 7fab00a3c700 1 --2- 172.21.15.37:0/3014383513 >> v2:172.21.15.37:3300/0 conn(0x7faafc0ca7d0 0x7faafc06c0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T02:22:56.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.690+0000 7fab0123d700 1 --2- 172.21.15.37:0/3014383513 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faafc1597b0 0x7faafc069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:56.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.690+0000 7fab0123d700 1 -- 172.21.15.37:0/3014383513 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faafc1597b0 msgr2=0x7faafc069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T02:22:56.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.690+0000 7fab0123d700 1 -- 172.21.15.37:0/3014383513 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faafc1597b0 msgr2=0x7faafc069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:22:56.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.690+0000 7fab0123d700 1 --2- 172.21.15.37:0/3014383513 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faafc1597b0 0x7faafc069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:22:56.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.690+0000 7fab0123d700 1 --2- 172.21.15.37:0/3014383513 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faafc1597b0 0x7faafc069f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T02:22:56.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.883+0000 7faafb7fe700 1 -- 172.21.15.37:0/3014383513 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966461243 0 0) 0x7faafc06d4d0 con 0x7faafc0aee30 2023-10-06T02:22:56.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.883+0000 7faafb7fe700 1 -- 172.21.15.37:0/3014383513 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faae4003570 con 0x7faafc0aee30 2023-10-06T02:22:56.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.883+0000 7faafb7fe700 1 -- 172.21.15.37:0/3014383513 <== mon.1 v1:172.21.15.191:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4217894489 0 0) 0x7faae4003570 con 0x7faafc0aee30 2023-10-06T02:22:56.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.883+0000 7faafb7fe700 1 -- 172.21.15.37:0/3014383513 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faafc1597b0 msgr2=0x7faafc069f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:22:56.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.883+0000 7faafb7fe700 1 --2- 172.21.15.37:0/3014383513 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faafc1597b0 0x7faafc069f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:56.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.883+0000 7faafb7fe700 1 -- 172.21.15.37:0/3014383513 >> v2:172.21.15.37:3300/0 conn(0x7faafc0ca7d0 msgr2=0x7faafc06c0b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:22:56.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.883+0000 7faafb7fe700 1 --2- 172.21.15.37:0/3014383513 >> v2:172.21.15.37:3300/0 conn(0x7faafc0ca7d0 0x7faafc06c0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:56.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.883+0000 7faafb7fe700 1 -- 172.21.15.37:0/3014383513 --> v1:172.21.15.191:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc06cba0 con 0x7faafc0aee30 2023-10-06T02:22:56.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.883+0000 7faafb7fe700 1 -- 172.21.15.37:0/3014383513 <== mon.1 v1:172.21.15.191:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7faaf0001470 con 0x7faafc0aee30 2023-10-06T02:22:56.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.884+0000 7faafb7fe700 1 -- 172.21.15.37:0/3014383513 >> v1:172.21.15.191:6789/0 conn(0x7faafc0aee30 legacy=0x7faafc1590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:56.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.884+0000 7faafb7fe700 1 --2- 172.21.15.37:0/3014383513 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faafc1597b0 0x7faae4003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:56.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.884+0000 7faafb7fe700 1 --2- 172.21.15.37:0/3014383513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faae4004160 0x7faae4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:56.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.884+0000 7faafb7fe700 1 --2- 172.21.15.37:0/3014383513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faae4004d50 0x7faae40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:56.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.884+0000 7faafb7fe700 1 -- 172.21.15.37:0/3014383513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc06c5f0 con 0x7faae4004160 2023-10-06T02:22:56.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.884+0000 7faafb7fe700 1 -- 172.21.15.37:0/3014383513 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc06c8c0 con 0x7faae4004d50 2023-10-06T02:22:56.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.884+0000 7faafb7fe700 1 -- 172.21.15.37:0/3014383513 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae400bd20 con 0x7faafc1597b0 2023-10-06T02:22:56.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.884+0000 7faafbfff700 1 --2- 172.21.15.37:0/3014383513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faae4004160 0x7faae4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.884+0000 7fab0123d700 1 --2- 172.21.15.37:0/3014383513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faae4004d50 0x7faae40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.884+0000 7fab00a3c700 1 --2- 172.21.15.37:0/3014383513 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faafc1597b0 0x7faae4003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.884+0000 7faafbfff700 1 -- 172.21.15.37:0/3014383513 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faafc1597b0 msgr2=0x7faae4003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:22:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.884+0000 7faafbfff700 1 --2- 172.21.15.37:0/3014383513 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faafc1597b0 0x7faae4003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.884+0000 7faafbfff700 1 -- 172.21.15.37:0/3014383513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faae4004d50 msgr2=0x7faae40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:22:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.884+0000 7faafbfff700 1 --2- 172.21.15.37:0/3014383513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faae4004d50 0x7faae40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.884+0000 7faafbfff700 1 -- 172.21.15.37:0/3014383513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae4003570 con 0x7faae4004160 2023-10-06T02:22:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.884+0000 7fab0123d700 1 --2- 172.21.15.37:0/3014383513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faae4004d50 0x7faae40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:22:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.884+0000 7faafbfff700 1 --2- 172.21.15.37:0/3014383513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faae4004160 0x7faae4004810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faaf000c160 tx=0x7faaf0002e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87bf9112c49ebda2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:22:56.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.885+0000 7faafb7fe700 1 -- 172.21.15.37:0/3014383513 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf000ca90 con 0x7faae4004160 2023-10-06T02:22:56.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.885+0000 7faafb7fe700 1 -- 172.21.15.37:0/3014383513 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf000cc10 con 0x7faae4004160 2023-10-06T02:22:56.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.885+0000 7faafb7fe700 1 -- 172.21.15.37:0/3014383513 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0006820 con 0x7faae4004160 2023-10-06T02:22:56.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.886+0000 7fab02ca0700 1 -- 172.21.15.37:0/3014383513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faae4004160 msgr2=0x7faae4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:56.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.886+0000 7fab02ca0700 1 --2- 172.21.15.37:0/3014383513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faae4004160 0x7faae4004810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faaf000c160 tx=0x7faaf0002e20 comp rx=0 tx=0).stop 2023-10-06T02:22:56.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.886+0000 7fab0123d700 1 -- 172.21.15.37:0/3014383513 reap_dead start 2023-10-06T02:22:56.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.886+0000 7fab02ca0700 1 -- 172.21.15.37:0/3014383513 shutdown_connections 2023-10-06T02:22:56.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.886+0000 7fab02ca0700 1 -- 172.21.15.37:0/3014383513 >> 172.21.15.37:0/3014383513 conn(0x7faafc0cd480 msgr2=0x7faafc0c9420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:22:56.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.886+0000 7fab02ca0700 1 -- 172.21.15.37:0/3014383513 shutdown_connections 2023-10-06T02:22:56.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.886+0000 7fab02ca0700 1 -- 172.21.15.37:0/3014383513 wait complete. 2023-10-06T02:22:56.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.887+0000 7fab02ca0700 1 Processor -- start 2023-10-06T02:22:56.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.887+0000 7fab02ca0700 1 -- start start 2023-10-06T02:22:56.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.888+0000 7fab02ca0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faae4004160 0x7faafc159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:56.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.888+0000 7fab02ca0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faafc14f7a0 0x7faafc0b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:56.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.888+0000 7fab02ca0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faafc0b06e0 0x7faafc069e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:56.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.888+0000 7fab02ca0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc0c4b40 con 0x7faafc0b06e0 2023-10-06T02:22:56.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.888+0000 7fab02ca0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc0c4e20 con 0x7faae4004160 2023-10-06T02:22:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.888+0000 7fab02ca0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc0c5100 con 0x7faafc14f7a0 2023-10-06T02:22:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.888+0000 7fab0123d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faafc0b06e0 0x7faafc069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.888+0000 7fab00a3c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faae4004160 0x7faafc159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.888+0000 7fab0123d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faafc0b06e0 0x7faafc069e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44182/0 (socket says 172.21.15.37:44182) 2023-10-06T02:22:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.888+0000 7fab0123d700 1 -- 172.21.15.37:0/56112037 learned_addr learned my addr 172.21.15.37:0/56112037 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:22:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.888+0000 7faafbfff700 1 --2- 172.21.15.37:0/56112037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faafc14f7a0 0x7faafc0b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.889+0000 7fab0123d700 1 -- 172.21.15.37:0/56112037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faafc14f7a0 msgr2=0x7faafc0b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.889+0000 7fab0123d700 1 --2- 172.21.15.37:0/56112037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faafc14f7a0 0x7faafc0b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.889+0000 7fab0123d700 1 -- 172.21.15.37:0/56112037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faae4004160 msgr2=0x7faafc159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.889+0000 7fab0123d700 1 --2- 172.21.15.37:0/56112037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faae4004160 0x7faafc159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.889+0000 7fab0123d700 1 -- 172.21.15.37:0/56112037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc0c53e0 con 0x7faafc0b06e0 2023-10-06T02:22:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.889+0000 7faafbfff700 1 --2- 172.21.15.37:0/56112037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faafc14f7a0 0x7faafc0b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:22:56.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.889+0000 7fab00a3c700 1 --2- 172.21.15.37:0/56112037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faae4004160 0x7faafc159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:22:56.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.889+0000 7fab0123d700 1 --2- 172.21.15.37:0/56112037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faafc0b06e0 0x7faafc069e30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faafc159c30 tx=0x7faaf4009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:22:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.890+0000 7faaf8ff9700 1 -- 172.21.15.37:0/56112037 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf4013580 con 0x7faafc0b06e0 2023-10-06T02:22:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.890+0000 7faaf8ff9700 1 -- 172.21.15.37:0/56112037 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf4013700 con 0x7faafc0b06e0 2023-10-06T02:22:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.890+0000 7fab02ca0700 1 -- 172.21.15.37:0/56112037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faafc0c56c0 con 0x7faafc0b06e0 2023-10-06T02:22:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.890+0000 7faaf8ff9700 1 -- 172.21.15.37:0/56112037 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf4013ac0 con 0x7faafc0b06e0 2023-10-06T02:22:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.891+0000 7fab02ca0700 1 -- 172.21.15.37:0/56112037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faafc0c47d0 con 0x7faafc0b06e0 2023-10-06T02:22:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.891+0000 7faaf8ff9700 1 -- 172.21.15.37:0/56112037 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7faaf4003040 con 0x7faafc0b06e0 2023-10-06T02:22:56.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.891+0000 7faaf8ff9700 1 -- 172.21.15.37:0/56112037 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7faaf4014760 con 0x7faafc0b06e0 2023-10-06T02:22:56.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.891+0000 7fab02ca0700 1 -- 172.21.15.37:0/56112037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faafc0c58b0 con 0x7faafc0b06e0 2023-10-06T02:22:56.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.894+0000 7faaf8ff9700 1 -- 172.21.15.37:0/56112037 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7faaf4007240 con 0x7faafc0b06e0 2023-10-06T02:22:56.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.969+0000 7fab02ca0700 1 -- 172.21.15.37:0/56112037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7faafc06ce80 con 0x7faafc0b06e0 2023-10-06T02:22:56.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.976+0000 7faaf8ff9700 1 -- 172.21.15.37:0/56112037 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7faaf401d820 con 0x7faafc0b06e0 2023-10-06T02:22:56.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.977+0000 7fab02ca0700 1 -- 172.21.15.37:0/56112037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faafc0b06e0 msgr2=0x7faafc069e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:56.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.977+0000 7fab02ca0700 1 --2- 172.21.15.37:0/56112037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faafc0b06e0 0x7faafc069e30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faafc159c30 tx=0x7faaf4009740 comp rx=0 tx=0).stop 2023-10-06T02:22:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.977+0000 7fab02ca0700 1 -- 172.21.15.37:0/56112037 shutdown_connections 2023-10-06T02:22:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.977+0000 7fab02ca0700 1 --2- 172.21.15.37:0/56112037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faafc0b06e0 0x7faafc069e30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.977+0000 7fab02ca0700 1 --2- 172.21.15.37:0/56112037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faae4004160 0x7faafc159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.977+0000 7fab02ca0700 1 --2- 172.21.15.37:0/56112037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faafc14f7a0 0x7faafc0b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.977+0000 7fab02ca0700 1 -- 172.21.15.37:0/56112037 >> 172.21.15.37:0/56112037 conn(0x7faafc0cd480 msgr2=0x7faafc0c2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:22:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.977+0000 7fab02ca0700 1 -- 172.21.15.37:0/56112037 shutdown_connections 2023-10-06T02:22:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:56.977+0000 7fab02ca0700 1 -- 172.21.15.37:0/56112037 wait complete. 2023-10-06T02:22:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2023-10-06T02:22:56.989 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T02:22:56.990 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:56.990 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T02:22:57.015 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:57.015 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T02:22:57.079 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:57.080 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T02:22:57.145 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-10-06T02:22:57.145 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T02:22:57.210 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:57.210 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T02:22:57.234 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:57.234 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T02:22:57.298 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:57.298 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T02:22:57.363 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-06T02:22:57.363 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T02:22:57.427 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 0aa502f4-2695-4923-81ba-2f763421893c 0 2023-10-06T02:22:57.583 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.581+0000 7f7675a16700 1 Processor -- start 2023-10-06T02:22:57.583 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.582+0000 7f7675a16700 1 -- start start 2023-10-06T02:22:57.585 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.582+0000 7f7675a16700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f76700c90f0 0x7f76700cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:57.585 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.582+0000 7f7675a16700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767006ddd0 con 0x7f7670142fc0 2023-10-06T02:22:57.585 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.582+0000 7f7675a16700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767006d1c0 con 0x7f7670142bf0 2023-10-06T02:22:57.585 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.582+0000 7f7675a16700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f767006d4a0 con 0x7f76700c90f0 2023-10-06T02:22:57.585 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.582+0000 7f766f7fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f76700c90f0 0x7f76700cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:57.585 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.582+0000 7f766effd700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f7670142bf0 0x7f767006e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:41704/0 (socket says 172.21.15.191:41704) 2023-10-06T02:22:57.586 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.583+0000 7f766effd700 1 -- 172.21.15.191:0/1751520219 learned_addr learned my addr 172.21.15.191:0/1751520219 (peer_addr_for_me v1:172.21.15.191:0/0) 2023-10-06T02:22:57.586 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.583+0000 7f766f7fe700 1 -- 172.21.15.191:0/1751520219 >> v1:172.21.15.191:6789/0 conn(0x7f7670142bf0 legacy=0x7f767006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:57.586 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.583+0000 7f766f7fe700 1 -- 172.21.15.191:0/1751520219 >> v1:172.21.15.37:6789/0 conn(0x7f7670142fc0 legacy=0x7f76700c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:57.586 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.583+0000 7f766f7fe700 1 -- 172.21.15.191:0/1751520219 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767006d780 con 0x7f76700c90f0 2023-10-06T02:22:57.586 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.583+0000 7f766dffb700 1 -- 172.21.15.191:0/1751520219 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896590308 0 0) 0x7f767006d1c0 con 0x7f7670142bf0 2023-10-06T02:22:57.586 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.583+0000 7f766f7fe700 1 --2- 172.21.15.191:0/1751520219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76700c90f0 0x7f76700cada0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7668009e60 tx=0x7f7668009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b8d4c910507154c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:22:57.586 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.583+0000 7f766dffb700 1 -- 172.21.15.191:0/1751520219 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766800e070 con 0x7f76700c90f0 2023-10-06T02:22:57.586 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.583+0000 7f766dffb700 1 -- 172.21.15.191:0/1751520219 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766800bc30 con 0x7f76700c90f0 2023-10-06T02:22:57.586 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.583+0000 7f766dffb700 1 -- 172.21.15.191:0/1751520219 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7668012430 con 0x7f76700c90f0 2023-10-06T02:22:57.586 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.584+0000 7f7675a16700 1 -- 172.21.15.191:0/1751520219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76700c90f0 msgr2=0x7f76700cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:57.587 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.584+0000 7f7675a16700 1 --2- 172.21.15.191:0/1751520219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76700c90f0 0x7f76700cada0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7668009e60 tx=0x7f7668009780 comp rx=0 tx=0).stop 2023-10-06T02:22:57.587 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.584+0000 7f7675a16700 1 -- 172.21.15.191:0/1751520219 shutdown_connections 2023-10-06T02:22:57.587 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.584+0000 7f7675a16700 1 --2- 172.21.15.191:0/1751520219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76700c90f0 0x7f76700cada0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:57.587 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.584+0000 7f7675a16700 1 -- 172.21.15.191:0/1751520219 >> 172.21.15.191:0/1751520219 conn(0x7f76700ce3a0 msgr2=0x7f76700ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:22:57.587 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.584+0000 7f7675a16700 1 -- 172.21.15.191:0/1751520219 shutdown_connections 2023-10-06T02:22:57.587 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.584+0000 7f7675a16700 1 -- 172.21.15.191:0/1751520219 wait complete. 2023-10-06T02:22:57.589 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.585+0000 7f7675a16700 1 Processor -- start 2023-10-06T02:22:57.589 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.585+0000 7f7675a16700 1 -- start start 2023-10-06T02:22:57.589 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.586+0000 7f7675a16700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76700c90f0 0x7f76700b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:57.589 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.586+0000 7f7675a16700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7670142bf0 0x7f76700b1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:57.590 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.586+0000 7f7675a16700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7670142fc0 0x7f767013d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:57.590 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.586+0000 7f7675a16700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76700b1680 con 0x7f76700c90f0 2023-10-06T02:22:57.590 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.586+0000 7f7675a16700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76700b2130 con 0x7f7670142fc0 2023-10-06T02:22:57.590 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.586+0000 7f7675a16700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76700b1890 con 0x7f7670142bf0 2023-10-06T02:22:57.590 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.586+0000 7f766e7fc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7670142bf0 0x7f76700b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:57.590 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.586+0000 7f766f7fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7670142fc0 0x7f767013d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:57.590 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.586+0000 7f766e7fc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7670142bf0 0x7f76700b1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:49928/0 (socket says 172.21.15.191:49928) 2023-10-06T02:22:57.590 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.586+0000 7f766e7fc700 1 -- 172.21.15.191:0/3978335737 learned_addr learned my addr 172.21.15.191:0/3978335737 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-10-06T02:22:57.590 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.586+0000 7f766effd700 1 --2- 172.21.15.191:0/3978335737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76700c90f0 0x7f76700b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:57.590 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.586+0000 7f766f7fe700 1 -- 172.21.15.191:0/3978335737 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7670142bf0 msgr2=0x7f76700b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:57.590 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.586+0000 7f766f7fe700 1 --2- 172.21.15.191:0/3978335737 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7670142bf0 0x7f76700b1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:57.591 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.586+0000 7f766f7fe700 1 -- 172.21.15.191:0/3978335737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76700c90f0 msgr2=0x7f76700b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:57.591 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.586+0000 7f766f7fe700 1 --2- 172.21.15.191:0/3978335737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76700c90f0 0x7f76700b3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:57.591 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.586+0000 7f766f7fe700 1 -- 172.21.15.191:0/3978335737 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7668009a20 con 0x7f7670142fc0 2023-10-06T02:22:57.591 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.587+0000 7f766e7fc700 1 --2- 172.21.15.191:0/3978335737 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7670142bf0 0x7f76700b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:22:57.591 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.587+0000 7f766f7fe700 1 --2- 172.21.15.191:0/3978335737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7670142fc0 0x7f767013d9c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7668016000 tx=0x7f7668019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:22:57.591 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.587+0000 7f7656ffd700 1 -- 172.21.15.191:0/3978335737 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76680263f0 con 0x7f7670142fc0 2023-10-06T02:22:57.591 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.587+0000 7f7656ffd700 1 -- 172.21.15.191:0/3978335737 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7668026550 con 0x7f7670142fc0 2023-10-06T02:22:57.591 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.587+0000 7f7675a16700 1 -- 172.21.15.191:0/3978335737 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76700b1b70 con 0x7f7670142fc0 2023-10-06T02:22:57.591 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.587+0000 7f7656ffd700 1 -- 172.21.15.191:0/3978335737 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7668026910 con 0x7f7670142fc0 2023-10-06T02:22:57.591 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.587+0000 7f7675a16700 1 -- 172.21.15.191:0/3978335737 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7670133770 con 0x7f7670142fc0 2023-10-06T02:22:57.591 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.588+0000 7f7656ffd700 1 -- 172.21.15.191:0/3978335737 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f766802f400 con 0x7f7670142fc0 2023-10-06T02:22:57.591 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.588+0000 7f7656ffd700 1 -- 172.21.15.191:0/3978335737 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f766801b740 con 0x7f7670142fc0 2023-10-06T02:22:57.592 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.588+0000 7f7675a16700 1 -- 172.21.15.191:0/3978335737 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7670133960 con 0x7f7670142fc0 2023-10-06T02:22:57.594 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.593+0000 7f7656ffd700 1 -- 172.21.15.191:0/3978335737 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f766802f890 con 0x7f7670142fc0 2023-10-06T02:22:57.677 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.676+0000 7f7675a16700 1 -- 172.21.15.191:0/3978335737 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0aa502f4-2695-4923-81ba-2f763421893c", "id": 0} v 0) v1 -- 0x7f76700ca0e0 con 0x7f7670142fc0 2023-10-06T02:22:57.682 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.681+0000 7f7656ffd700 1 -- 172.21.15.191:0/3978335737 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0aa502f4-2695-4923-81ba-2f763421893c", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f766802fa30 con 0x7f7670142fc0 2023-10-06T02:22:57.682 INFO:teuthology.orchestra.run.smithi191.stdout:0 2023-10-06T02:22:57.684 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.682+0000 7f7675a16700 1 -- 172.21.15.191:0/3978335737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7670142fc0 msgr2=0x7f767013d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:57.684 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.682+0000 7f7675a16700 1 --2- 172.21.15.191:0/3978335737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7670142fc0 0x7f767013d9c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7668016000 tx=0x7f7668019000 comp rx=0 tx=0).stop 2023-10-06T02:22:57.684 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.682+0000 7f7675a16700 1 -- 172.21.15.191:0/3978335737 shutdown_connections 2023-10-06T02:22:57.684 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.682+0000 7f7675a16700 1 --2- 172.21.15.191:0/3978335737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7670142fc0 0x7f767013d9c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:57.684 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.682+0000 7f7675a16700 1 --2- 172.21.15.191:0/3978335737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76700c90f0 0x7f76700b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:57.684 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.682+0000 7f7675a16700 1 --2- 172.21.15.191:0/3978335737 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7670142bf0 0x7f76700b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:57.684 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.682+0000 7f7675a16700 1 -- 172.21.15.191:0/3978335737 >> 172.21.15.191:0/3978335737 conn(0x7f76700ce3a0 msgr2=0x7f76700c94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:22:57.684 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.682+0000 7f7675a16700 1 -- 172.21.15.191:0/3978335737 shutdown_connections 2023-10-06T02:22:57.684 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.682+0000 7f7675a16700 1 -- 172.21.15.191:0/3978335737 wait complete. 2023-10-06T02:22:57.695 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 51351ef0-12c1-4d13-8839-eebdd005de0a 1 2023-10-06T02:22:57.810 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.809+0000 7f21643bd700 1 Processor -- start 2023-10-06T02:22:57.810 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.809+0000 7f21643bd700 1 -- start start 2023-10-06T02:22:57.812 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.810+0000 7f21643bd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f215c0b2a90 0x7f215c159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:57.813 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.810+0000 7f21643bd700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f215c0ccb30 0x7f215c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:57.813 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.810+0000 7f21643bd700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f215c0b07a0 con 0x7f215c1593c0 2023-10-06T02:22:57.813 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.810+0000 7f21643bd700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215c0cd8a0 con 0x7f215c0b2a90 2023-10-06T02:22:57.813 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.810+0000 7f21643bd700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215c0afe70 con 0x7f215c0ccb30 2023-10-06T02:22:57.813 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.810+0000 7f216295a700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f215c0ccb30 0x7f215c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:57.813 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.810+0000 7f2162159700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f215c1593c0 0x7f215c0b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:41712/0 (socket says 172.21.15.191:41712) 2023-10-06T02:22:57.813 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.810+0000 7f2162159700 1 -- 172.21.15.191:0/3593311409 learned_addr learned my addr 172.21.15.191:0/3593311409 (peer_addr_for_me v1:172.21.15.191:0/0) 2023-10-06T02:22:57.813 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.810+0000 7f2161958700 1 --2- 172.21.15.191:0/3593311409 >> v2:172.21.15.37:3300/0 conn(0x7f215c0b2a90 0x7f215c159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:57.813 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.810+0000 7f216295a700 1 -- 172.21.15.191:0/3593311409 >> v2:172.21.15.37:3300/0 conn(0x7f215c0b2a90 msgr2=0x7f215c159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:22:57.813 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.810+0000 7f216295a700 1 --2- 172.21.15.191:0/3593311409 >> v2:172.21.15.37:3300/0 conn(0x7f215c0b2a90 0x7f215c159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:57.814 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.810+0000 7f216295a700 1 -- 172.21.15.191:0/3593311409 >> v1:172.21.15.191:6789/0 conn(0x7f215c1593c0 legacy=0x7f215c0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:57.814 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.810+0000 7f2161157700 1 -- 172.21.15.191:0/3593311409 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3118597233 0 0) 0x7f215c0b07a0 con 0x7f215c1593c0 2023-10-06T02:22:57.814 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.810+0000 7f216295a700 1 -- 172.21.15.191:0/3593311409 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215c0b0150 con 0x7f215c0ccb30 2023-10-06T02:22:57.814 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.810+0000 7f2161958700 1 --2- 172.21.15.191:0/3593311409 >> v2:172.21.15.37:3300/0 conn(0x7f215c0b2a90 0x7f215c159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:22:57.814 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.810+0000 7f216295a700 1 --2- 172.21.15.191:0/3593311409 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f215c0ccb30 0x7f215c0ccf90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f215c0c74a0 tx=0x7f2154009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b546d1f423eb53aa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:22:57.814 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.810+0000 7f2161157700 1 -- 172.21.15.191:0/3593311409 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215400e070 con 0x7f215c0ccb30 2023-10-06T02:22:57.814 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.810+0000 7f2161157700 1 -- 172.21.15.191:0/3593311409 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215400bc30 con 0x7f215c0ccb30 2023-10-06T02:22:57.814 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.811+0000 7f2161157700 1 -- 172.21.15.191:0/3593311409 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2154012430 con 0x7f215c0ccb30 2023-10-06T02:22:57.814 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.811+0000 7f21643bd700 1 -- 172.21.15.191:0/3593311409 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f215c0ccb30 msgr2=0x7f215c0ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:57.814 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.811+0000 7f21643bd700 1 --2- 172.21.15.191:0/3593311409 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f215c0ccb30 0x7f215c0ccf90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f215c0c74a0 tx=0x7f2154009780 comp rx=0 tx=0).stop 2023-10-06T02:22:57.814 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.811+0000 7f21643bd700 1 -- 172.21.15.191:0/3593311409 shutdown_connections 2023-10-06T02:22:57.815 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.811+0000 7f21643bd700 1 --2- 172.21.15.191:0/3593311409 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f215c0ccb30 0x7f215c0ccf90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:57.815 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.811+0000 7f21643bd700 1 --2- 172.21.15.191:0/3593311409 >> v2:172.21.15.37:3300/0 conn(0x7f215c0b2a90 0x7f215c159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:57.815 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.811+0000 7f21643bd700 1 -- 172.21.15.191:0/3593311409 >> 172.21.15.191:0/3593311409 conn(0x7f215c06c0b0 msgr2=0x7f215c06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:22:57.815 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.811+0000 7f21643bd700 1 -- 172.21.15.191:0/3593311409 shutdown_connections 2023-10-06T02:22:57.815 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.811+0000 7f21643bd700 1 -- 172.21.15.191:0/3593311409 wait complete. 2023-10-06T02:22:57.817 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.812+0000 7f21643bd700 1 Processor -- start 2023-10-06T02:22:57.817 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.812+0000 7f21643bd700 1 -- start start 2023-10-06T02:22:57.817 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.813+0000 7f21643bd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f215c0b2a90 0x7f215c0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:57.817 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.813+0000 7f21643bd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f215c0ccb30 0x7f215c155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:57.817 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.813+0000 7f21643bd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f215c1593c0 0x7f215c15e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:57.817 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.813+0000 7f21643bd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c0c7530 con 0x7f215c1593c0 2023-10-06T02:22:57.817 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.813+0000 7f21643bd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c0c7ab0 con 0x7f215c0ccb30 2023-10-06T02:22:57.817 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.813+0000 7f21643bd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215c0c6530 con 0x7f215c0b2a90 2023-10-06T02:22:57.817 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.813+0000 7f2161958700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f215c0ccb30 0x7f215c155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:57.818 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.813+0000 7f2162159700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f215c0b2a90 0x7f215c0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:57.818 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.813+0000 7f2161958700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f215c0ccb30 0x7f215c155a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:50162/0 (socket says 172.21.15.191:50162) 2023-10-06T02:22:57.818 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.813+0000 7f2162159700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f215c0b2a90 0x7f215c0c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:49940/0 (socket says 172.21.15.191:49940) 2023-10-06T02:22:57.818 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.813+0000 7f2161958700 1 -- 172.21.15.191:0/3013972582 learned_addr learned my addr 172.21.15.191:0/3013972582 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-10-06T02:22:57.818 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.813+0000 7f216295a700 1 --2- 172.21.15.191:0/3013972582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f215c1593c0 0x7f215c15e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:57.818 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.813+0000 7f2161958700 1 -- 172.21.15.191:0/3013972582 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f215c0b2a90 msgr2=0x7f215c0c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:57.818 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.813+0000 7f2161958700 1 --2- 172.21.15.191:0/3013972582 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f215c0b2a90 0x7f215c0c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:57.818 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.813+0000 7f2161958700 1 -- 172.21.15.191:0/3013972582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f215c1593c0 msgr2=0x7f215c15e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:57.818 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.813+0000 7f2161958700 1 --2- 172.21.15.191:0/3013972582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f215c1593c0 0x7f215c15e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:57.818 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.813+0000 7f2161958700 1 -- 172.21.15.191:0/3013972582 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2154009a20 con 0x7f215c0ccb30 2023-10-06T02:22:57.818 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.813+0000 7f2162159700 1 --2- 172.21.15.191:0/3013972582 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f215c0b2a90 0x7f215c0c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:22:57.819 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.813+0000 7f2161958700 1 --2- 172.21.15.191:0/3013972582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f215c0ccb30 0x7f215c155a60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f215800e8d0 tx=0x7f2158008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:22:57.819 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.814+0000 7f21527fc700 1 -- 172.21.15.191:0/3013972582 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158013410 con 0x7f215c0ccb30 2023-10-06T02:22:57.819 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.814+0000 7f21527fc700 1 -- 172.21.15.191:0/3013972582 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2158013570 con 0x7f215c0ccb30 2023-10-06T02:22:57.819 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.814+0000 7f21527fc700 1 -- 172.21.15.191:0/3013972582 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158013910 con 0x7f215c0ccb30 2023-10-06T02:22:57.819 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.814+0000 7f21643bd700 1 -- 172.21.15.191:0/3013972582 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215c0c6810 con 0x7f215c0ccb30 2023-10-06T02:22:57.819 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.814+0000 7f21643bd700 1 -- 172.21.15.191:0/3013972582 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215c0ca3c0 con 0x7f215c0ccb30 2023-10-06T02:22:57.819 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.814+0000 7f21527fc700 1 -- 172.21.15.191:0/3013972582 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2158013d00 con 0x7f215c0ccb30 2023-10-06T02:22:57.819 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.814+0000 7f21527fc700 1 -- 172.21.15.191:0/3013972582 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f215800c3a0 con 0x7f215c0ccb30 2023-10-06T02:22:57.819 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.815+0000 7f21643bd700 1 -- 172.21.15.191:0/3013972582 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f215c088bb0 con 0x7f215c0ccb30 2023-10-06T02:22:57.820 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.817+0000 7f21527fc700 1 -- 172.21.15.191:0/3013972582 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f2158020060 con 0x7f215c0ccb30 2023-10-06T02:22:57.899 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.898+0000 7f21643bd700 1 -- 172.21.15.191:0/3013972582 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd new", "uuid": "51351ef0-12c1-4d13-8839-eebdd005de0a", "id": 1} v 0) v1 -- 0x7f215c0c7bf0 con 0x7f215c0ccb30 2023-10-06T02:22:57.904 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.903+0000 7f21527fc700 1 -- 172.21.15.191:0/3013972582 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "51351ef0-12c1-4d13-8839-eebdd005de0a", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f215800f040 con 0x7f215c0ccb30 2023-10-06T02:22:57.904 INFO:teuthology.orchestra.run.smithi191.stdout:1 2023-10-06T02:22:57.905 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.904+0000 7f21643bd700 1 -- 172.21.15.191:0/3013972582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f215c0ccb30 msgr2=0x7f215c155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:57.905 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.904+0000 7f21643bd700 1 --2- 172.21.15.191:0/3013972582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f215c0ccb30 0x7f215c155a60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f215800e8d0 tx=0x7f2158008040 comp rx=0 tx=0).stop 2023-10-06T02:22:57.905 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.904+0000 7f21643bd700 1 -- 172.21.15.191:0/3013972582 shutdown_connections 2023-10-06T02:22:57.905 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.904+0000 7f21643bd700 1 --2- 172.21.15.191:0/3013972582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f215c1593c0 0x7f215c15e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:57.905 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.904+0000 7f21643bd700 1 --2- 172.21.15.191:0/3013972582 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f215c0b2a90 0x7f215c0c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:57.905 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.904+0000 7f21643bd700 1 --2- 172.21.15.191:0/3013972582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f215c0ccb30 0x7f215c155a60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:57.906 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.904+0000 7f21643bd700 1 -- 172.21.15.191:0/3013972582 >> 172.21.15.191:0/3013972582 conn(0x7f215c06c0b0 msgr2=0x7f215c158960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:22:57.906 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.904+0000 7f21643bd700 1 -- 172.21.15.191:0/3013972582 shutdown_connections 2023-10-06T02:22:57.906 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:57.904+0000 7f21643bd700 1 -- 172.21.15.191:0/3013972582 wait complete. 2023-10-06T02:22:57.916 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 695ca0a7-3663-4c6e-8059-0995bbb3d7d7 2 2023-10-06T02:22:58.033 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.032+0000 7f292c334700 1 Processor -- start 2023-10-06T02:22:58.033 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.032+0000 7f292c334700 1 -- start start 2023-10-06T02:22:58.036 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.033+0000 7f292c334700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f29241599e0 0x7f29240b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.036 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.033+0000 7f292c334700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29240b3310 0x7f29240b4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.036 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.033+0000 7f292c334700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29240b43b0 con 0x7f2924159610 2023-10-06T02:22:58.036 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.033+0000 7f292c334700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29240cde50 con 0x7f29241599e0 2023-10-06T02:22:58.036 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.033+0000 7f292c334700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29240b1020 con 0x7f29240b3310 2023-10-06T02:22:58.036 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.033+0000 7f292a8d1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29240b3310 0x7f29240b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.036 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.033+0000 7f292a0d0700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f2924159610 0x7f29240d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:41716/0 (socket says 172.21.15.191:41716) 2023-10-06T02:22:58.036 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.033+0000 7f292a0d0700 1 -- 172.21.15.191:0/2192731310 learned_addr learned my addr 172.21.15.191:0/2192731310 (peer_addr_for_me v1:172.21.15.191:0/0) 2023-10-06T02:22:58.037 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.033+0000 7f29298cf700 1 --2- 172.21.15.191:0/2192731310 >> v2:172.21.15.37:3300/0 conn(0x7f29241599e0 0x7f29240b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.037 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.033+0000 7f292a8d1700 1 -- 172.21.15.191:0/2192731310 >> v2:172.21.15.37:3300/0 conn(0x7f29241599e0 msgr2=0x7f29240b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:22:58.037 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.033+0000 7f292a8d1700 1 --2- 172.21.15.191:0/2192731310 >> v2:172.21.15.37:3300/0 conn(0x7f29241599e0 0x7f29240b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.037 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.033+0000 7f292a8d1700 1 -- 172.21.15.191:0/2192731310 >> v1:172.21.15.191:6789/0 conn(0x7f2924159610 legacy=0x7f29240d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.037 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.033+0000 7f29290ce700 1 -- 172.21.15.191:0/2192731310 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908331665 0 0) 0x7f29240b43b0 con 0x7f2924159610 2023-10-06T02:22:58.037 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.033+0000 7f292a8d1700 1 -- 172.21.15.191:0/2192731310 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29240b37a0 con 0x7f29240b3310 2023-10-06T02:22:58.037 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.033+0000 7f292a8d1700 1 --2- 172.21.15.191:0/2192731310 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29240b3310 0x7f29240b4840 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f291c009e60 tx=0x7f291c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3478363f2e82e5fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:22:58.037 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.034+0000 7f29290ce700 1 -- 172.21.15.191:0/2192731310 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c00e070 con 0x7f29240b3310 2023-10-06T02:22:58.037 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.034+0000 7f29290ce700 1 -- 172.21.15.191:0/2192731310 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c00bb60 con 0x7f29240b3310 2023-10-06T02:22:58.037 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.034+0000 7f29290ce700 1 -- 172.21.15.191:0/2192731310 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c012430 con 0x7f29240b3310 2023-10-06T02:22:58.037 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.034+0000 7f292c334700 1 -- 172.21.15.191:0/2192731310 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29240b3310 msgr2=0x7f29240b4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.037 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.034+0000 7f292c334700 1 --2- 172.21.15.191:0/2192731310 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29240b3310 0x7f29240b4840 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f291c009e60 tx=0x7f291c009780 comp rx=0 tx=0).stop 2023-10-06T02:22:58.038 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.034+0000 7f292c334700 1 -- 172.21.15.191:0/2192731310 shutdown_connections 2023-10-06T02:22:58.038 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.034+0000 7f292c334700 1 --2- 172.21.15.191:0/2192731310 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29240b3310 0x7f29240b4840 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.038 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.034+0000 7f292c334700 1 --2- 172.21.15.191:0/2192731310 >> v2:172.21.15.37:3300/0 conn(0x7f29241599e0 0x7f29240b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.038 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.034+0000 7f292c334700 1 -- 172.21.15.191:0/2192731310 >> 172.21.15.191:0/2192731310 conn(0x7f292406c0b0 msgr2=0x7f292406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:22:58.038 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.034+0000 7f292c334700 1 -- 172.21.15.191:0/2192731310 shutdown_connections 2023-10-06T02:22:58.038 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.034+0000 7f292c334700 1 -- 172.21.15.191:0/2192731310 wait complete. 2023-10-06T02:22:58.040 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.035+0000 7f292c334700 1 Processor -- start 2023-10-06T02:22:58.040 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.036+0000 7f292c334700 1 -- start start 2023-10-06T02:22:58.040 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.036+0000 7f292c334700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29240b3310 0x7f29240b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.040 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.036+0000 7f292c334700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2924159610 0x7f2924159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.040 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.036+0000 7f292c334700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29241599e0 0x7f292415a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.041 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.036+0000 7f292c334700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29240c8b30 con 0x7f29240b3310 2023-10-06T02:22:58.041 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.036+0000 7f292c334700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29240c7d60 con 0x7f2924159610 2023-10-06T02:22:58.041 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.036+0000 7f292c334700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29240c84b0 con 0x7f29241599e0 2023-10-06T02:22:58.041 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.036+0000 7f292a8d1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29241599e0 0x7f292415a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.041 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.036+0000 7f29298cf700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2924159610 0x7f2924159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.041 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.036+0000 7f292a8d1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29241599e0 0x7f292415a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:49950/0 (socket says 172.21.15.191:49950) 2023-10-06T02:22:58.041 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.036+0000 7f292a8d1700 1 -- 172.21.15.191:0/861597884 learned_addr learned my addr 172.21.15.191:0/861597884 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-10-06T02:22:58.041 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.036+0000 7f292a0d0700 1 --2- 172.21.15.191:0/861597884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29240b3310 0x7f29240b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.041 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.037+0000 7f292a8d1700 1 -- 172.21.15.191:0/861597884 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2924159610 msgr2=0x7f2924159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.041 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.037+0000 7f292a8d1700 1 --2- 172.21.15.191:0/861597884 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2924159610 0x7f2924159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.041 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.037+0000 7f292a8d1700 1 -- 172.21.15.191:0/861597884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29240b3310 msgr2=0x7f29240b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.042 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.037+0000 7f292a8d1700 1 --2- 172.21.15.191:0/861597884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29240b3310 0x7f29240b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.042 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.037+0000 7f292a8d1700 1 -- 172.21.15.191:0/861597884 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c009a20 con 0x7f29241599e0 2023-10-06T02:22:58.042 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.037+0000 7f29298cf700 1 --2- 172.21.15.191:0/861597884 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2924159610 0x7f2924159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:22:58.042 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.037+0000 7f292a8d1700 1 --2- 172.21.15.191:0/861597884 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29241599e0 0x7f292415a2f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f29240cdf90 tx=0x7f291c019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:22:58.042 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.037+0000 7f291a7fc700 1 -- 172.21.15.191:0/861597884 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c012ea0 con 0x7f29241599e0 2023-10-06T02:22:58.042 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.037+0000 7f291a7fc700 1 -- 172.21.15.191:0/861597884 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c027470 con 0x7f29241599e0 2023-10-06T02:22:58.042 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.037+0000 7f292c334700 1 -- 172.21.15.191:0/861597884 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29240d0830 con 0x7f29241599e0 2023-10-06T02:22:58.042 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.037+0000 7f291a7fc700 1 -- 172.21.15.191:0/861597884 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c027830 con 0x7f29241599e0 2023-10-06T02:22:58.042 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.037+0000 7f292c334700 1 -- 172.21.15.191:0/861597884 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29240d0b10 con 0x7f29241599e0 2023-10-06T02:22:58.042 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.037+0000 7f291a7fc700 1 -- 172.21.15.191:0/861597884 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f291c024070 con 0x7f29241599e0 2023-10-06T02:22:58.042 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.037+0000 7f291a7fc700 1 -- 172.21.15.191:0/861597884 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f291c01d990 con 0x7f29241599e0 2023-10-06T02:22:58.042 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.038+0000 7f292c334700 1 -- 172.21.15.191:0/861597884 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29240c8c70 con 0x7f29241599e0 2023-10-06T02:22:58.043 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.040+0000 7f291a7fc700 1 -- 172.21.15.191:0/861597884 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f291c0466d0 con 0x7f29241599e0 2023-10-06T02:22:58.073 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:22:58.072+0000 7fba25dc5180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T02:22:58.121 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.120+0000 7f292c334700 1 -- 172.21.15.191:0/861597884 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd new", "uuid": "695ca0a7-3663-4c6e-8059-0995bbb3d7d7", "id": 2} v 0) v1 -- 0x7f29240b3a80 con 0x7f29241599e0 2023-10-06T02:22:58.126 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.125+0000 7f291a7fc700 1 -- 172.21.15.191:0/861597884 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "695ca0a7-3663-4c6e-8059-0995bbb3d7d7", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f291c035030 con 0x7f29241599e0 2023-10-06T02:22:58.126 INFO:teuthology.orchestra.run.smithi191.stdout:2 2023-10-06T02:22:58.128 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.126+0000 7f292c334700 1 -- 172.21.15.191:0/861597884 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29241599e0 msgr2=0x7f292415a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.128 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.126+0000 7f292c334700 1 --2- 172.21.15.191:0/861597884 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29241599e0 0x7f292415a2f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f29240cdf90 tx=0x7f291c019000 comp rx=0 tx=0).stop 2023-10-06T02:22:58.128 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.126+0000 7f292c334700 1 -- 172.21.15.191:0/861597884 shutdown_connections 2023-10-06T02:22:58.128 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.126+0000 7f292c334700 1 --2- 172.21.15.191:0/861597884 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29241599e0 0x7f292415a2f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.128 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.126+0000 7f292c334700 1 --2- 172.21.15.191:0/861597884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29240b3310 0x7f29240b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.128 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.126+0000 7f292c334700 1 --2- 172.21.15.191:0/861597884 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2924159610 0x7f2924159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.128 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.126+0000 7f292c334700 1 -- 172.21.15.191:0/861597884 >> 172.21.15.191:0/861597884 conn(0x7f292406c0b0 msgr2=0x7f29240ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:22:58.129 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.126+0000 7f292c334700 1 -- 172.21.15.191:0/861597884 shutdown_connections 2023-10-06T02:22:58.129 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.126+0000 7f292c334700 1 -- 172.21.15.191:0/861597884 wait complete. 2023-10-06T02:22:58.139 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 842b08b2-065f-40f4-a235-4552b31e3bf2 3 2023-10-06T02:22:58.210 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:22:58.209+0000 7fba25dc5180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T02:22:58.254 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.253+0000 7fce7af3a700 1 Processor -- start 2023-10-06T02:22:58.254 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.253+0000 7fce7af3a700 1 -- start start 2023-10-06T02:22:58.256 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.253+0000 7fce7af3a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce74155da0 0x7fce74160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.256 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.253+0000 7fce7af3a700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce740c73e0 con 0x7fce741559d0 2023-10-06T02:22:58.256 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.253+0000 7fce7af3a700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce740c67d0 con 0x7fce7406ecf0 2023-10-06T02:22:58.256 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.253+0000 7fce7af3a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce740c6ab0 con 0x7fce74155da0 2023-10-06T02:22:58.256 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.253+0000 7fce73fff700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fce7406ecf0 0x7fce74069e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:41728/0 (socket says 172.21.15.191:41728) 2023-10-06T02:22:58.256 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.253+0000 7fce73fff700 1 -- 172.21.15.191:0/2053922741 learned_addr learned my addr 172.21.15.191:0/2053922741 (peer_addr_for_me v1:172.21.15.191:0/0) 2023-10-06T02:22:58.257 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.253+0000 7fce794d7700 1 --2- 172.21.15.191:0/2053922741 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce74155da0 0x7fce74160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.257 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.254+0000 7fce737fe700 1 -- 172.21.15.191:0/2053922741 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882461727 0 0) 0x7fce740c67d0 con 0x7fce7406ecf0 2023-10-06T02:22:58.257 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.254+0000 7fce737fe700 1 -- 172.21.15.191:0/2053922741 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce64003570 con 0x7fce7406ecf0 2023-10-06T02:22:58.257 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.254+0000 7fce794d7700 1 -- 172.21.15.191:0/2053922741 >> v1:172.21.15.191:6789/0 conn(0x7fce7406ecf0 legacy=0x7fce74069e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.257 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.254+0000 7fce794d7700 1 -- 172.21.15.191:0/2053922741 >> v1:172.21.15.37:6789/0 conn(0x7fce741559d0 legacy=0x7fce7406e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.257 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.254+0000 7fce794d7700 1 -- 172.21.15.191:0/2053922741 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce740c6d90 con 0x7fce74155da0 2023-10-06T02:22:58.257 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.254+0000 7fce794d7700 1 --2- 172.21.15.191:0/2053922741 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce74155da0 0x7fce74160b10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009e90 tx=0x7fce6c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=790827492877bc24 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:22:58.257 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.254+0000 7fce737fe700 1 -- 172.21.15.191:0/2053922741 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c00e070 con 0x7fce74155da0 2023-10-06T02:22:58.257 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.254+0000 7fce737fe700 1 -- 172.21.15.191:0/2053922741 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c00bc30 con 0x7fce74155da0 2023-10-06T02:22:58.257 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.254+0000 7fce737fe700 1 -- 172.21.15.191:0/2053922741 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c012430 con 0x7fce74155da0 2023-10-06T02:22:58.257 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.255+0000 7fce7af3a700 1 -- 172.21.15.191:0/2053922741 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce74155da0 msgr2=0x7fce74160b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.257 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.255+0000 7fce7af3a700 1 --2- 172.21.15.191:0/2053922741 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce74155da0 0x7fce74160b10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009e90 tx=0x7fce6c009780 comp rx=0 tx=0).stop 2023-10-06T02:22:58.258 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.255+0000 7fce7af3a700 1 -- 172.21.15.191:0/2053922741 shutdown_connections 2023-10-06T02:22:58.258 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.255+0000 7fce7af3a700 1 --2- 172.21.15.191:0/2053922741 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce74155da0 0x7fce74160b10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.258 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.255+0000 7fce7af3a700 1 -- 172.21.15.191:0/2053922741 >> 172.21.15.191:0/2053922741 conn(0x7fce740cc100 msgr2=0x7fce740cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:22:58.258 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.255+0000 7fce7af3a700 1 -- 172.21.15.191:0/2053922741 shutdown_connections 2023-10-06T02:22:58.258 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.255+0000 7fce7af3a700 1 -- 172.21.15.191:0/2053922741 wait complete. 2023-10-06T02:22:58.258 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.257+0000 7fce7af3a700 1 Processor -- start 2023-10-06T02:22:58.258 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.257+0000 7fce7af3a700 1 -- start start 2023-10-06T02:22:58.260 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.258+0000 7fce7af3a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce7406ecf0 0x7fce740ac040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.261 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.258+0000 7fce7af3a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce741559d0 0x7fce741663b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.261 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.258+0000 7fce7af3a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce74155da0 0x7fce74167560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.261 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.258+0000 7fce7af3a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce740ac580 con 0x7fce74155da0 2023-10-06T02:22:58.261 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.258+0000 7fce7af3a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce740980c0 con 0x7fce741559d0 2023-10-06T02:22:58.261 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.258+0000 7fce7af3a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce74097d90 con 0x7fce7406ecf0 2023-10-06T02:22:58.261 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.258+0000 7fce78cd6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce7406ecf0 0x7fce740ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.261 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.258+0000 7fce73fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce741559d0 0x7fce741663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.261 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.258+0000 7fce78cd6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce7406ecf0 0x7fce740ac040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:49964/0 (socket says 172.21.15.191:49964) 2023-10-06T02:22:58.261 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.258+0000 7fce78cd6700 1 -- 172.21.15.191:0/1929591960 learned_addr learned my addr 172.21.15.191:0/1929591960 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-10-06T02:22:58.261 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.258+0000 7fce794d7700 1 --2- 172.21.15.191:0/1929591960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce74155da0 0x7fce74167560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.261 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.258+0000 7fce78cd6700 1 -- 172.21.15.191:0/1929591960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce741559d0 msgr2=0x7fce741663b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.262 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.258+0000 7fce78cd6700 1 --2- 172.21.15.191:0/1929591960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce741559d0 0x7fce741663b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.262 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.258+0000 7fce78cd6700 1 -- 172.21.15.191:0/1929591960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce74155da0 msgr2=0x7fce74167560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.262 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.258+0000 7fce78cd6700 1 --2- 172.21.15.191:0/1929591960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce74155da0 0x7fce74167560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.262 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.258+0000 7fce78cd6700 1 -- 172.21.15.191:0/1929591960 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c009a20 con 0x7fce7406ecf0 2023-10-06T02:22:58.262 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.258+0000 7fce794d7700 1 --2- 172.21.15.191:0/1929591960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce74155da0 0x7fce74167560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:22:58.262 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.258+0000 7fce73fff700 1 --2- 172.21.15.191:0/1929591960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce741559d0 0x7fce741663b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:22:58.262 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.259+0000 7fce78cd6700 1 --2- 172.21.15.191:0/1929591960 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce7406ecf0 0x7fce740ac040 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fce6800c590 tx=0x7fce6800c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:22:58.262 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.259+0000 7fce70ff9700 1 -- 172.21.15.191:0/1929591960 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce68011590 con 0x7fce7406ecf0 2023-10-06T02:22:58.262 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.259+0000 7fce70ff9700 1 -- 172.21.15.191:0/1929591960 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce68011710 con 0x7fce7406ecf0 2023-10-06T02:22:58.262 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.259+0000 7fce7af3a700 1 -- 172.21.15.191:0/1929591960 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce74166d20 con 0x7fce7406ecf0 2023-10-06T02:22:58.262 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.259+0000 7fce70ff9700 1 -- 172.21.15.191:0/1929591960 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce68011ad0 con 0x7fce7406ecf0 2023-10-06T02:22:58.262 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.259+0000 7fce7af3a700 1 -- 172.21.15.191:0/1929591960 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce741672e0 con 0x7fce7406ecf0 2023-10-06T02:22:58.263 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.260+0000 7fce70ff9700 1 -- 172.21.15.191:0/1929591960 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fce6801c6c0 con 0x7fce7406ecf0 2023-10-06T02:22:58.263 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.260+0000 7fce70ff9700 1 -- 172.21.15.191:0/1929591960 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fce680128c0 con 0x7fce7406ecf0 2023-10-06T02:22:58.263 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.260+0000 7fce7af3a700 1 -- 172.21.15.191:0/1929591960 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce74070c30 con 0x7fce7406ecf0 2023-10-06T02:22:58.263 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.262+0000 7fce70ff9700 1 -- 172.21.15.191:0/1929591960 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fce68017070 con 0x7fce7406ecf0 2023-10-06T02:22:58.308 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:22:58.307+0000 7fba25dc5180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T02:22:58.384 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.382+0000 7fce7af3a700 1 -- 172.21.15.191:0/1929591960 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd new", "uuid": "842b08b2-065f-40f4-a235-4552b31e3bf2", "id": 3} v 0) v1 -- 0x7fce7406a2c0 con 0x7fce7406ecf0 2023-10-06T02:22:58.387 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.386+0000 7fce70ff9700 1 -- 172.21.15.191:0/1929591960 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "842b08b2-065f-40f4-a235-4552b31e3bf2", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fce6801cba0 con 0x7fce7406ecf0 2023-10-06T02:22:58.387 INFO:teuthology.orchestra.run.smithi191.stdout:3 2023-10-06T02:22:58.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.387+0000 7fce7af3a700 1 -- 172.21.15.191:0/1929591960 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce7406ecf0 msgr2=0x7fce740ac040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.387+0000 7fce7af3a700 1 --2- 172.21.15.191:0/1929591960 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce7406ecf0 0x7fce740ac040 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fce6800c590 tx=0x7fce6800c8a0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.387+0000 7fce7af3a700 1 -- 172.21.15.191:0/1929591960 shutdown_connections 2023-10-06T02:22:58.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.387+0000 7fce7af3a700 1 --2- 172.21.15.191:0/1929591960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce74155da0 0x7fce74167560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.387+0000 7fce7af3a700 1 --2- 172.21.15.191:0/1929591960 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce7406ecf0 0x7fce740ac040 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.387+0000 7fce7af3a700 1 --2- 172.21.15.191:0/1929591960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce741559d0 0x7fce741663b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.387+0000 7fce7af3a700 1 -- 172.21.15.191:0/1929591960 >> 172.21.15.191:0/1929591960 conn(0x7fce740cc100 msgr2=0x7fce740a96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:22:58.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.387+0000 7fce7af3a700 1 -- 172.21.15.191:0/1929591960 shutdown_connections 2023-10-06T02:22:58.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.387+0000 7fce7af3a700 1 -- 172.21.15.191:0/1929591960 wait complete. 2023-10-06T02:22:58.400 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 6ffea2c6-af6b-47e7-a454-0d72f00c54ff 4 2023-10-06T02:22:58.446 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:22:58.446+0000 7f9decd25180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T02:22:58.516 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.515+0000 7f64ff19a700 1 Processor -- start 2023-10-06T02:22:58.516 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.515+0000 7f64ff19a700 1 -- start start 2023-10-06T02:22:58.518 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.515+0000 7f64ff19a700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f64f80ce700 0x7f64f8159110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.518 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.515+0000 7f64ff19a700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f80cf880 con 0x7f64f815dab0 2023-10-06T02:22:58.518 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.515+0000 7f64ff19a700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f80b42a0 con 0x7f64f80cbe90 2023-10-06T02:22:58.518 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.515+0000 7f64ff19a700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f80cec70 con 0x7f64f80ce700 2023-10-06T02:22:58.518 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.515+0000 7f64fd737700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f64f80ce700 0x7f64f8159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.518 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.516+0000 7f64fd737700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f64f80ce700 0x7f64f8159110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:50188/0 (socket says 172.21.15.191:50188) 2023-10-06T02:22:58.518 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.516+0000 7f64fcf36700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f64f80cbe90 0x7f64f815d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:41738/0 (socket says 172.21.15.191:41738) 2023-10-06T02:22:58.519 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.516+0000 7f64fd737700 1 -- 172.21.15.191:0/4141232437 learned_addr learned my addr 172.21.15.191:0/4141232437 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-10-06T02:22:58.519 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.516+0000 7f64fd737700 1 -- 172.21.15.191:0/4141232437 >> v1:172.21.15.191:6789/0 conn(0x7f64f80cbe90 legacy=0x7f64f815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.519 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.516+0000 7f64fd737700 1 -- 172.21.15.191:0/4141232437 >> v1:172.21.15.37:6789/0 conn(0x7f64f815dab0 legacy=0x7f64f80cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.519 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.516+0000 7f64fd737700 1 -- 172.21.15.191:0/4141232437 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f80cef50 con 0x7f64f80ce700 2023-10-06T02:22:58.519 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.516+0000 7f64fd737700 1 --2- 172.21.15.191:0/4141232437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f80ce700 0x7f64f8159110 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f64f0009f20 tx=0x7f64f0009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d8f20b3c91cf699 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:22:58.519 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.516+0000 7f64f77fe700 1 -- 172.21.15.191:0/4141232437 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f000e070 con 0x7f64f80ce700 2023-10-06T02:22:58.519 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.516+0000 7f64f77fe700 1 -- 172.21.15.191:0/4141232437 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f000ba80 con 0x7f64f80ce700 2023-10-06T02:22:58.519 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.516+0000 7f64f77fe700 1 -- 172.21.15.191:0/4141232437 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f00092e0 con 0x7f64f80ce700 2023-10-06T02:22:58.519 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.517+0000 7f64ff19a700 1 -- 172.21.15.191:0/4141232437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f80ce700 msgr2=0x7f64f8159110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.519 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.517+0000 7f64ff19a700 1 --2- 172.21.15.191:0/4141232437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f80ce700 0x7f64f8159110 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f64f0009f20 tx=0x7f64f0009840 comp rx=0 tx=0).stop 2023-10-06T02:22:58.519 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.517+0000 7f64ff19a700 1 -- 172.21.15.191:0/4141232437 shutdown_connections 2023-10-06T02:22:58.520 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.517+0000 7f64ff19a700 1 --2- 172.21.15.191:0/4141232437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f80ce700 0x7f64f8159110 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.520 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.517+0000 7f64ff19a700 1 -- 172.21.15.191:0/4141232437 >> 172.21.15.191:0/4141232437 conn(0x7f64f80997f0 msgr2=0x7f64f806c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:22:58.520 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.517+0000 7f64ff19a700 1 -- 172.21.15.191:0/4141232437 shutdown_connections 2023-10-06T02:22:58.520 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.517+0000 7f64ff19a700 1 -- 172.21.15.191:0/4141232437 wait complete. 2023-10-06T02:22:58.521 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.518+0000 7f64ff19a700 1 Processor -- start 2023-10-06T02:22:58.521 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.518+0000 7f64ff19a700 1 -- start start 2023-10-06T02:22:58.521 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64ff19a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f80cbe90 0x7f64f8159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.521 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64ff19a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64f80ce700 0x7f64f8158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.522 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64ff19a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f815dab0 0x7f64f80c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.522 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64ff19a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f80c5340 con 0x7f64f80cbe90 2023-10-06T02:22:58.522 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64ff19a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f815a0a0 con 0x7f64f815dab0 2023-10-06T02:22:58.522 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64ff19a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f815a330 con 0x7f64f80ce700 2023-10-06T02:22:58.522 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64fd737700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f815dab0 0x7f64f80c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.522 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64f7fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64f80ce700 0x7f64f8158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.522 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64fcf36700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f80cbe90 0x7f64f8159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.522 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64fd737700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f815dab0 0x7f64f80c92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:50194/0 (socket says 172.21.15.191:50194) 2023-10-06T02:22:58.522 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64fd737700 1 -- 172.21.15.191:0/1094846891 learned_addr learned my addr 172.21.15.191:0/1094846891 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-10-06T02:22:58.522 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64fcf36700 1 -- 172.21.15.191:0/1094846891 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64f80ce700 msgr2=0x7f64f8158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.522 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64fcf36700 1 --2- 172.21.15.191:0/1094846891 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64f80ce700 0x7f64f8158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.523 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64fcf36700 1 -- 172.21.15.191:0/1094846891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f815dab0 msgr2=0x7f64f80c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.523 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64fcf36700 1 --2- 172.21.15.191:0/1094846891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f815dab0 0x7f64f80c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.523 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64fcf36700 1 -- 172.21.15.191:0/1094846891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f0009ae0 con 0x7f64f80cbe90 2023-10-06T02:22:58.523 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64fd737700 1 --2- 172.21.15.191:0/1094846891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f815dab0 0x7f64f80c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:22:58.523 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64f7fff700 1 --2- 172.21.15.191:0/1094846891 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64f80ce700 0x7f64f8158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:22:58.523 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:22:58.519+0000 7fba25dc5180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T02:22:58.524 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64fcf36700 1 --2- 172.21.15.191:0/1094846891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f80cbe90 0x7f64f8159b60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f64ec00c7c0 tx=0x7f64ec007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:22:58.525 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64f4ff9700 1 -- 172.21.15.191:0/1094846891 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec005a70 con 0x7f64f80cbe90 2023-10-06T02:22:58.525 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64f4ff9700 1 -- 172.21.15.191:0/1094846891 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec005bd0 con 0x7f64f80cbe90 2023-10-06T02:22:58.525 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64ff19a700 1 -- 172.21.15.191:0/1094846891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f815a610 con 0x7f64f80cbe90 2023-10-06T02:22:58.525 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.519+0000 7f64f4ff9700 1 -- 172.21.15.191:0/1094846891 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec0070d0 con 0x7f64f80cbe90 2023-10-06T02:22:58.525 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.520+0000 7f64ff19a700 1 -- 172.21.15.191:0/1094846891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f8158b70 con 0x7f64f80cbe90 2023-10-06T02:22:58.525 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.520+0000 7f64f4ff9700 1 -- 172.21.15.191:0/1094846891 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f64ec01c440 con 0x7f64f80cbe90 2023-10-06T02:22:58.525 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.520+0000 7f64f4ff9700 1 -- 172.21.15.191:0/1094846891 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f64ec007700 con 0x7f64f80cbe90 2023-10-06T02:22:58.525 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.520+0000 7f64ff19a700 1 -- 172.21.15.191:0/1094846891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f80c5110 con 0x7f64f80cbe90 2023-10-06T02:22:58.525 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.523+0000 7f64f4ff9700 1 -- 172.21.15.191:0/1094846891 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f64f80c5110 con 0x7f64f80cbe90 2023-10-06T02:22:58.584 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:22:58.584+0000 7f9decd25180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T02:22:58.606 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.605+0000 7f64ff19a700 1 -- 172.21.15.191:0/1094846891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6ffea2c6-af6b-47e7-a454-0d72f00c54ff", "id": 4} v 0) v1 -- 0x7f64f806cb60 con 0x7f64f80cbe90 2023-10-06T02:22:58.609 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.608+0000 7f64f4ff9700 1 -- 172.21.15.191:0/1094846891 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6ffea2c6-af6b-47e7-a454-0d72f00c54ff", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f64ec017070 con 0x7f64f80cbe90 2023-10-06T02:22:58.610 INFO:teuthology.orchestra.run.smithi191.stdout:4 2023-10-06T02:22:58.611 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.609+0000 7f64ff19a700 1 -- 172.21.15.191:0/1094846891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f80cbe90 msgr2=0x7f64f8159b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.611 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.609+0000 7f64ff19a700 1 --2- 172.21.15.191:0/1094846891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f80cbe90 0x7f64f8159b60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f64ec00c7c0 tx=0x7f64ec007eb0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.611 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.609+0000 7f64ff19a700 1 -- 172.21.15.191:0/1094846891 shutdown_connections 2023-10-06T02:22:58.611 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.609+0000 7f64ff19a700 1 --2- 172.21.15.191:0/1094846891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f815dab0 0x7f64f80c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.611 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.609+0000 7f64ff19a700 1 --2- 172.21.15.191:0/1094846891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64f80cbe90 0x7f64f8159b60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.611 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.609+0000 7f64ff19a700 1 --2- 172.21.15.191:0/1094846891 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64f80ce700 0x7f64f8158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.611 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.609+0000 7f64ff19a700 1 -- 172.21.15.191:0/1094846891 >> 172.21.15.191:0/1094846891 conn(0x7f64f80997f0 msgr2=0x7f64f815b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:22:58.611 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.609+0000 7f64ff19a700 1 -- 172.21.15.191:0/1094846891 shutdown_connections 2023-10-06T02:22:58.611 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.609+0000 7f64ff19a700 1 -- 172.21.15.191:0/1094846891 wait complete. 2023-10-06T02:22:58.622 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 21e7e274-891d-4316-84bc-28ff01d9957d 5 2023-10-06T02:22:58.664 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:22:58.664+0000 7f9decd25180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T02:22:58.700 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:22:58.699+0000 7fba25dc5180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T02:22:58.737 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.736+0000 7f53cedcb700 1 Processor -- start 2023-10-06T02:22:58.737 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.736+0000 7f53cedcb700 1 -- start start 2023-10-06T02:22:58.746 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.736+0000 7f53cedcb700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53c80b2a90 0x7f53c8159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.746 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.736+0000 7f53cedcb700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f53c80ccb30 0x7f53c80ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.746 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.736+0000 7f53cedcb700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c80b07a0 con 0x7f53c81593c0 2023-10-06T02:22:58.747 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.736+0000 7f53cedcb700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c80cd8a0 con 0x7f53c80ccb30 2023-10-06T02:22:58.747 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.736+0000 7f53cedcb700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80afe70 con 0x7f53c80b2a90 2023-10-06T02:22:58.747 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.737+0000 7f53c7fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53c80b2a90 0x7f53c8159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.747 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.737+0000 7f53ccb67700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f53c81593c0 0x7f53c80b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:41752/0 (socket says 172.21.15.191:41752) 2023-10-06T02:22:58.747 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.737+0000 7f53ccb67700 1 -- 172.21.15.191:0/1593886430 learned_addr learned my addr 172.21.15.191:0/1593886430 (peer_addr_for_me v1:172.21.15.191:0/0) 2023-10-06T02:22:58.747 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.737+0000 7f53cd368700 1 --2- 172.21.15.191:0/1593886430 >> v2:172.21.15.37:3300/0 conn(0x7f53c80ccb30 0x7f53c80ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.748 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.737+0000 7f53c77fe700 1 -- 172.21.15.191:0/1593886430 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1041671714 0 0) 0x7f53c80b07a0 con 0x7f53c81593c0 2023-10-06T02:22:58.748 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.737+0000 7f53c77fe700 1 -- 172.21.15.191:0/1593886430 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53b8003570 con 0x7f53c81593c0 2023-10-06T02:22:58.748 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.737+0000 7f53c7fff700 1 -- 172.21.15.191:0/1593886430 >> v2:172.21.15.37:3300/0 conn(0x7f53c80ccb30 msgr2=0x7f53c80ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:22:58.748 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.737+0000 7f53c7fff700 1 --2- 172.21.15.191:0/1593886430 >> v2:172.21.15.37:3300/0 conn(0x7f53c80ccb30 0x7f53c80ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.748 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.737+0000 7f53c7fff700 1 -- 172.21.15.191:0/1593886430 >> v1:172.21.15.191:6789/0 conn(0x7f53c81593c0 legacy=0x7f53c80b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.749 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.737+0000 7f53c7fff700 1 -- 172.21.15.191:0/1593886430 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c80b0150 con 0x7f53c80b2a90 2023-10-06T02:22:58.749 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.737+0000 7f53c7fff700 1 --2- 172.21.15.191:0/1593886430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53c80b2a90 0x7f53c8159790 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f53b40098e0 tx=0x7f53b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=966952aa5fc18a9d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:22:58.749 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.737+0000 7f53c77fe700 1 -- 172.21.15.191:0/1593886430 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4011630 con 0x7f53c80b2a90 2023-10-06T02:22:58.749 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.737+0000 7f53c77fe700 1 -- 172.21.15.191:0/1593886430 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b4011790 con 0x7f53c80b2a90 2023-10-06T02:22:58.749 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.737+0000 7f53c77fe700 1 -- 172.21.15.191:0/1593886430 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4011b30 con 0x7f53c80b2a90 2023-10-06T02:22:58.749 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.738+0000 7f53cedcb700 1 -- 172.21.15.191:0/1593886430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53c80b2a90 msgr2=0x7f53c8159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.750 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.738+0000 7f53cedcb700 1 --2- 172.21.15.191:0/1593886430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53c80b2a90 0x7f53c8159790 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f53b40098e0 tx=0x7f53b40091a0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.750 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.738+0000 7f53cedcb700 1 -- 172.21.15.191:0/1593886430 shutdown_connections 2023-10-06T02:22:58.750 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.738+0000 7f53cedcb700 1 --2- 172.21.15.191:0/1593886430 >> v2:172.21.15.37:3300/0 conn(0x7f53c80ccb30 0x7f53c80ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.750 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.738+0000 7f53cedcb700 1 --2- 172.21.15.191:0/1593886430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53c80b2a90 0x7f53c8159790 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.751 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.738+0000 7f53cedcb700 1 -- 172.21.15.191:0/1593886430 >> 172.21.15.191:0/1593886430 conn(0x7f53c806c0b0 msgr2=0x7f53c806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:22:58.751 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.738+0000 7f53cedcb700 1 -- 172.21.15.191:0/1593886430 shutdown_connections 2023-10-06T02:22:58.751 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.738+0000 7f53cedcb700 1 -- 172.21.15.191:0/1593886430 wait complete. 2023-10-06T02:22:58.751 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.739+0000 7f53cedcb700 1 Processor -- start 2023-10-06T02:22:58.751 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.739+0000 7f53cedcb700 1 -- start start 2023-10-06T02:22:58.751 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.740+0000 7f53cedcb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53c80b2a90 0x7f53c80c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.751 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.740+0000 7f53cedcb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53c80ccb30 0x7f53c8154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.751 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.740+0000 7f53cedcb700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53c81593c0 0x7f53c8156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.751 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.740+0000 7f53cedcb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c8156780 con 0x7f53c80b2a90 2023-10-06T02:22:58.751 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.740+0000 7f53cedcb700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c81524f0 con 0x7f53c80ccb30 2023-10-06T02:22:58.752 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.740+0000 7f53cedcb700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c8155e50 con 0x7f53c81593c0 2023-10-06T02:22:58.752 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.740+0000 7f53c7fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53c80ccb30 0x7f53c8154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.752 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.740+0000 7f53cd368700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53c81593c0 0x7f53c8156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.752 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.740+0000 7f53c7fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53c80ccb30 0x7f53c8154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:50206/0 (socket says 172.21.15.191:50206) 2023-10-06T02:22:58.752 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.740+0000 7f53c7fff700 1 -- 172.21.15.191:0/4233185545 learned_addr learned my addr 172.21.15.191:0/4233185545 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-10-06T02:22:58.752 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.740+0000 7f53ccb67700 1 --2- 172.21.15.191:0/4233185545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53c80b2a90 0x7f53c80c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.752 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.740+0000 7f53c7fff700 1 -- 172.21.15.191:0/4233185545 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53c81593c0 msgr2=0x7f53c8156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.753 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.740+0000 7f53c7fff700 1 --2- 172.21.15.191:0/4233185545 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53c81593c0 0x7f53c8156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.753 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.740+0000 7f53c7fff700 1 -- 172.21.15.191:0/4233185545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53c80b2a90 msgr2=0x7f53c80c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.753 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.740+0000 7f53c7fff700 1 --2- 172.21.15.191:0/4233185545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53c80b2a90 0x7f53c80c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.753 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.740+0000 7f53c7fff700 1 -- 172.21.15.191:0/4233185545 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b4009420 con 0x7f53c80ccb30 2023-10-06T02:22:58.753 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.740+0000 7f53c7fff700 1 --2- 172.21.15.191:0/4233185545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53c80ccb30 0x7f53c8154d50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f53c80affb0 tx=0x7f53b4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:22:58.753 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.740+0000 7f53c4ff9700 1 -- 172.21.15.191:0/4233185545 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b401f070 con 0x7f53c80ccb30 2023-10-06T02:22:58.753 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.741+0000 7f53c4ff9700 1 -- 172.21.15.191:0/4233185545 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b4000bc0 con 0x7f53c80ccb30 2023-10-06T02:22:58.753 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.741+0000 7f53cedcb700 1 -- 172.21.15.191:0/4233185545 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c8156130 con 0x7f53c80ccb30 2023-10-06T02:22:58.753 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.741+0000 7f53c4ff9700 1 -- 172.21.15.191:0/4233185545 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4011b30 con 0x7f53c80ccb30 2023-10-06T02:22:58.753 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.741+0000 7f53cedcb700 1 -- 172.21.15.191:0/4233185545 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c8155600 con 0x7f53c80ccb30 2023-10-06T02:22:58.753 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.741+0000 7f53c4ff9700 1 -- 172.21.15.191:0/4233185545 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f53b4023070 con 0x7f53c80ccb30 2023-10-06T02:22:58.753 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.741+0000 7f53c4ff9700 1 -- 172.21.15.191:0/4233185545 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f53b402e930 con 0x7f53c80ccb30 2023-10-06T02:22:58.753 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.742+0000 7f53cedcb700 1 -- 172.21.15.191:0/4233185545 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c81568f0 con 0x7f53c80ccb30 2023-10-06T02:22:58.754 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.744+0000 7f53c4ff9700 1 -- 172.21.15.191:0/4233185545 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f53b402a070 con 0x7f53c80ccb30 2023-10-06T02:22:58.785 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:22:58.784+0000 7fba25dc5180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T02:22:58.832 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.831+0000 7f53cedcb700 1 -- 172.21.15.191:0/4233185545 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd new", "uuid": "21e7e274-891d-4316-84bc-28ff01d9957d", "id": 5} v 0) v1 -- 0x7f53c80b0430 con 0x7f53c80ccb30 2023-10-06T02:22:58.836 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.835+0000 7f53c4ff9700 1 -- 172.21.15.191:0/4233185545 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "21e7e274-891d-4316-84bc-28ff01d9957d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f53b4015020 con 0x7f53c80ccb30 2023-10-06T02:22:58.836 INFO:teuthology.orchestra.run.smithi191.stdout:5 2023-10-06T02:22:58.837 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.836+0000 7f53cedcb700 1 -- 172.21.15.191:0/4233185545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53c80ccb30 msgr2=0x7f53c8154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.837 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.836+0000 7f53cedcb700 1 --2- 172.21.15.191:0/4233185545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53c80ccb30 0x7f53c8154d50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f53c80affb0 tx=0x7f53b4017000 comp rx=0 tx=0).stop 2023-10-06T02:22:58.837 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.836+0000 7f53cedcb700 1 -- 172.21.15.191:0/4233185545 shutdown_connections 2023-10-06T02:22:58.838 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.836+0000 7f53cedcb700 1 --2- 172.21.15.191:0/4233185545 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53c81593c0 0x7f53c8156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.838 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.836+0000 7f53cedcb700 1 --2- 172.21.15.191:0/4233185545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53c80b2a90 0x7f53c80c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.838 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.836+0000 7f53cedcb700 1 --2- 172.21.15.191:0/4233185545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53c80ccb30 0x7f53c8154d50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.838 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.836+0000 7f53cedcb700 1 -- 172.21.15.191:0/4233185545 >> 172.21.15.191:0/4233185545 conn(0x7f53c806c0b0 msgr2=0x7f53c80cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:22:58.838 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.836+0000 7f53cedcb700 1 -- 172.21.15.191:0/4233185545 shutdown_connections 2023-10-06T02:22:58.838 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.836+0000 7f53cedcb700 1 -- 172.21.15.191:0/4233185545 wait complete. 2023-10-06T02:22:58.850 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 0a10ba9a-6c76-4dfb-8697-775b2f8b426d 6 2023-10-06T02:22:58.856 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:22:58.856+0000 7f9decd25180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T02:22:58.930 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:22:58.928+0000 7fba25dc5180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T02:22:58.966 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.965+0000 7f8b489eb700 1 Processor -- start 2023-10-06T02:22:58.966 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.965+0000 7f8b489eb700 1 -- start start 2023-10-06T02:22:58.969 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.966+0000 7f8b489eb700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8b441593c0 0x7f8b44159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.969 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.966+0000 7f8b489eb700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b440b2380 0x7f8b440b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.969 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.966+0000 7f8b489eb700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b440ccb30 0x7f8b440ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.969 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.966+0000 7f8b489eb700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b440b07a0 con 0x7f8b440ccb30 2023-10-06T02:22:58.969 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.966+0000 7f8b489eb700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b440cd8a0 con 0x7f8b441593c0 2023-10-06T02:22:58.970 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.966+0000 7f8b489eb700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440afe70 con 0x7f8b440b2380 2023-10-06T02:22:58.970 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.966+0000 7f8b4259c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8b441593c0 0x7f8b44159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.970 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.966+0000 7f8b41d9b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b440b2380 0x7f8b440b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.970 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.966+0000 7f8b4259c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8b441593c0 0x7f8b44159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:50210/0 (socket says 172.21.15.191:50210) 2023-10-06T02:22:58.970 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.966+0000 7f8b41d9b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b440b2380 0x7f8b440b27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:50002/0 (socket says 172.21.15.191:50002) 2023-10-06T02:22:58.970 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.966+0000 7f8b4259c700 1 -- 172.21.15.191:0/346645432 learned_addr learned my addr 172.21.15.191:0/346645432 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-10-06T02:22:58.970 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.966+0000 7f8b42d9d700 1 --2- 172.21.15.191:0/346645432 >> v2:172.21.15.37:3300/0 conn(0x7f8b440ccb30 0x7f8b440ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.970 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.967+0000 7f8b4259c700 1 -- 172.21.15.191:0/346645432 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b440b2380 msgr2=0x7f8b440b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:22:58.970 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.967+0000 7f8b4259c700 1 --2- 172.21.15.191:0/346645432 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b440b2380 0x7f8b440b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.970 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.967+0000 7f8b4259c700 1 -- 172.21.15.191:0/346645432 >> v2:172.21.15.37:3300/0 conn(0x7f8b440ccb30 msgr2=0x7f8b440ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:22:58.970 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.967+0000 7f8b4259c700 1 --2- 172.21.15.191:0/346645432 >> v2:172.21.15.37:3300/0 conn(0x7f8b440ccb30 0x7f8b440ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.971 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.967+0000 7f8b4259c700 1 -- 172.21.15.191:0/346645432 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b440b0150 con 0x7f8b441593c0 2023-10-06T02:22:58.971 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.967+0000 7f8b41d9b700 1 --2- 172.21.15.191:0/346645432 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b440b2380 0x7f8b440b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:22:58.971 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.967+0000 7f8b4259c700 1 --2- 172.21.15.191:0/346645432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b441593c0 0x7f8b44159790 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8b4406d520 tx=0x7f8b38009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=164711454e61e718 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:22:58.971 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.967+0000 7f8b4159a700 1 -- 172.21.15.191:0/346645432 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800b640 con 0x7f8b441593c0 2023-10-06T02:22:58.971 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.967+0000 7f8b4159a700 1 -- 172.21.15.191:0/346645432 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3800b7a0 con 0x7f8b441593c0 2023-10-06T02:22:58.971 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.967+0000 7f8b4159a700 1 -- 172.21.15.191:0/346645432 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800bb60 con 0x7f8b441593c0 2023-10-06T02:22:58.971 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.967+0000 7f8b489eb700 1 -- 172.21.15.191:0/346645432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b441593c0 msgr2=0x7f8b44159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.971 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.967+0000 7f8b489eb700 1 --2- 172.21.15.191:0/346645432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b441593c0 0x7f8b44159790 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8b4406d520 tx=0x7f8b38009250 comp rx=0 tx=0).stop 2023-10-06T02:22:58.971 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.968+0000 7f8b489eb700 1 -- 172.21.15.191:0/346645432 shutdown_connections 2023-10-06T02:22:58.971 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.968+0000 7f8b489eb700 1 --2- 172.21.15.191:0/346645432 >> v2:172.21.15.37:3300/0 conn(0x7f8b440ccb30 0x7f8b440ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.971 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.968+0000 7f8b489eb700 1 --2- 172.21.15.191:0/346645432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b441593c0 0x7f8b44159790 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.972 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.968+0000 7f8b489eb700 1 --2- 172.21.15.191:0/346645432 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b440b2380 0x7f8b440b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.972 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.968+0000 7f8b489eb700 1 -- 172.21.15.191:0/346645432 >> 172.21.15.191:0/346645432 conn(0x7f8b4406c0b0 msgr2=0x7f8b4406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:22:58.972 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.968+0000 7f8b489eb700 1 -- 172.21.15.191:0/346645432 shutdown_connections 2023-10-06T02:22:58.972 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.968+0000 7f8b489eb700 1 -- 172.21.15.191:0/346645432 wait complete. 2023-10-06T02:22:58.974 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.969+0000 7f8b489eb700 1 Processor -- start 2023-10-06T02:22:58.974 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.969+0000 7f8b489eb700 1 -- start start 2023-10-06T02:22:58.974 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.969+0000 7f8b489eb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b440b2380 0x7f8b4414a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.974 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.969+0000 7f8b489eb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b440ccb30 0x7f8b440c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.974 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.969+0000 7f8b489eb700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b441593c0 0x7f8b4415afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:58.974 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.969+0000 7f8b489eb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4414aea0 con 0x7f8b440b2380 2023-10-06T02:22:58.975 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.969+0000 7f8b489eb700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440c4530 con 0x7f8b440ccb30 2023-10-06T02:22:58.975 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.969+0000 7f8b489eb700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440c4810 con 0x7f8b441593c0 2023-10-06T02:22:58.975 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.969+0000 7f8b41d9b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b440ccb30 0x7f8b440c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.975 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.970+0000 7f8b41d9b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b440ccb30 0x7f8b440c3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:50212/0 (socket says 172.21.15.191:50212) 2023-10-06T02:22:58.975 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.970+0000 7f8b41d9b700 1 -- 172.21.15.191:0/1766489647 learned_addr learned my addr 172.21.15.191:0/1766489647 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-10-06T02:22:58.975 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.970+0000 7f8b42d9d700 1 --2- 172.21.15.191:0/1766489647 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b441593c0 0x7f8b4415afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.975 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.970+0000 7f8b4259c700 1 --2- 172.21.15.191:0/1766489647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b440b2380 0x7f8b4414a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:58.975 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.970+0000 7f8b41d9b700 1 -- 172.21.15.191:0/1766489647 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b441593c0 msgr2=0x7f8b4415afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.975 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.970+0000 7f8b41d9b700 1 --2- 172.21.15.191:0/1766489647 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b441593c0 0x7f8b4415afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.975 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.970+0000 7f8b41d9b700 1 -- 172.21.15.191:0/1766489647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b440b2380 msgr2=0x7f8b4414a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:58.975 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.970+0000 7f8b41d9b700 1 --2- 172.21.15.191:0/1766489647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b440b2380 0x7f8b4414a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:58.976 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.970+0000 7f8b41d9b700 1 -- 172.21.15.191:0/1766489647 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b34009420 con 0x7f8b440ccb30 2023-10-06T02:22:58.976 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.970+0000 7f8b41d9b700 1 --2- 172.21.15.191:0/1766489647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b440ccb30 0x7f8b440c3d00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400ec80 tx=0x7f8b340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:22:58.976 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.970+0000 7f8b327fc700 1 -- 172.21.15.191:0/1766489647 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3400c920 con 0x7f8b440ccb30 2023-10-06T02:22:58.976 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.970+0000 7f8b327fc700 1 -- 172.21.15.191:0/1766489647 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3400ca80 con 0x7f8b440ccb30 2023-10-06T02:22:58.976 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.970+0000 7f8b489eb700 1 -- 172.21.15.191:0/1766489647 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b380094f0 con 0x7f8b440ccb30 2023-10-06T02:22:58.976 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.970+0000 7f8b327fc700 1 -- 172.21.15.191:0/1766489647 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3400ce00 con 0x7f8b440ccb30 2023-10-06T02:22:58.976 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.970+0000 7f8b489eb700 1 -- 172.21.15.191:0/1766489647 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b440c4dd0 con 0x7f8b440ccb30 2023-10-06T02:22:58.976 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.970+0000 7f8b327fc700 1 -- 172.21.15.191:0/1766489647 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8b34005c80 con 0x7f8b440ccb30 2023-10-06T02:22:58.976 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.970+0000 7f8b327fc700 1 -- 172.21.15.191:0/1766489647 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f8b34013cc0 con 0x7f8b440ccb30 2023-10-06T02:22:58.976 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.971+0000 7f8b489eb700 1 -- 172.21.15.191:0/1766489647 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b44088bb0 con 0x7f8b440ccb30 2023-10-06T02:22:58.976 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:58.973+0000 7f8b327fc700 1 -- 172.21.15.191:0/1766489647 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8b34021060 con 0x7f8b440ccb30 2023-10-06T02:22:59.030 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:22:59.029+0000 7fba25dc5180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T02:22:59.037 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:22:59.037+0000 7f9decd25180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T02:22:59.056 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.055+0000 7f8b489eb700 1 -- 172.21.15.191:0/1766489647 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0a10ba9a-6c76-4dfb-8697-775b2f8b426d", "id": 6} v 0) v1 -- 0x7f8b440b0430 con 0x7f8b440ccb30 2023-10-06T02:22:59.062 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.061+0000 7f8b327fc700 1 -- 172.21.15.191:0/1766489647 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0a10ba9a-6c76-4dfb-8697-775b2f8b426d", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8b34017070 con 0x7f8b440ccb30 2023-10-06T02:22:59.063 INFO:teuthology.orchestra.run.smithi191.stdout:6 2023-10-06T02:22:59.064 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.062+0000 7f8b489eb700 1 -- 172.21.15.191:0/1766489647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b440ccb30 msgr2=0x7f8b440c3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:59.064 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.062+0000 7f8b489eb700 1 --2- 172.21.15.191:0/1766489647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b440ccb30 0x7f8b440c3d00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400ec80 tx=0x7f8b340091a0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.064 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.062+0000 7f8b489eb700 1 -- 172.21.15.191:0/1766489647 shutdown_connections 2023-10-06T02:22:59.064 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.062+0000 7f8b489eb700 1 --2- 172.21.15.191:0/1766489647 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b441593c0 0x7f8b4415afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.064 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.062+0000 7f8b489eb700 1 --2- 172.21.15.191:0/1766489647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b440b2380 0x7f8b4414a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.064 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.062+0000 7f8b489eb700 1 --2- 172.21.15.191:0/1766489647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b440ccb30 0x7f8b440c3d00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.064 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.062+0000 7f8b489eb700 1 -- 172.21.15.191:0/1766489647 >> 172.21.15.191:0/1766489647 conn(0x7f8b4406c0b0 msgr2=0x7f8b440cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:22:59.064 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.062+0000 7f8b489eb700 1 -- 172.21.15.191:0/1766489647 shutdown_connections 2023-10-06T02:22:59.064 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.062+0000 7f8b489eb700 1 -- 172.21.15.191:0/1766489647 wait complete. 2023-10-06T02:22:59.075 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 520bfada-3175-43ed-aeb3-f7ecf1a98cd7 7 2023-10-06T02:22:59.118 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:22:59.118+0000 7f9decd25180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T02:22:59.190 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.189+0000 7f71a68db700 1 Processor -- start 2023-10-06T02:22:59.190 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.189+0000 7f71a68db700 1 -- start start 2023-10-06T02:22:59.193 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.189+0000 7f71a68db700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71a014e2a0 0x7f71a00ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:59.194 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.189+0000 7f71a68db700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f71a014e670 0x7f71a00b3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:59.194 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.189+0000 7f71a68db700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f71a00b3cb0 0x7f71a0067990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:59.194 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.189+0000 7f71a68db700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a00b4130 con 0x7f71a00b3cb0 2023-10-06T02:22:59.194 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.189+0000 7f71a68db700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a01587a0 con 0x7f71a014e670 2023-10-06T02:22:59.194 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.189+0000 7f71a68db700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0157b90 con 0x7f71a014e2a0 2023-10-06T02:22:59.194 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.190+0000 7f719f7fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f71a014e670 0x7f71a00b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:59.194 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.190+0000 7f719ffff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71a014e2a0 0x7f71a00ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:59.194 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.190+0000 7f719f7fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f71a014e670 0x7f71a00b3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:50216/0 (socket says 172.21.15.191:50216) 2023-10-06T02:22:59.195 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.190+0000 7f719f7fe700 1 -- 172.21.15.191:0/3794791348 learned_addr learned my addr 172.21.15.191:0/3794791348 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-10-06T02:22:59.195 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.190+0000 7f719ffff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71a014e2a0 0x7f71a00ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:50006/0 (socket says 172.21.15.191:50006) 2023-10-06T02:22:59.195 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.190+0000 7f71a4e78700 1 --2- 172.21.15.191:0/3794791348 >> v2:172.21.15.37:3300/0 conn(0x7f71a00b3cb0 0x7f71a0067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:59.195 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.190+0000 7f719ffff700 1 -- 172.21.15.191:0/3794791348 >> v2:172.21.15.191:3300/0 conn(0x7f71a014e670 msgr2=0x7f71a00b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:22:59.195 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.190+0000 7f719ffff700 1 --2- 172.21.15.191:0/3794791348 >> v2:172.21.15.191:3300/0 conn(0x7f71a014e670 0x7f71a00b3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.195 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.190+0000 7f719ffff700 1 -- 172.21.15.191:0/3794791348 >> v2:172.21.15.37:3300/0 conn(0x7f71a00b3cb0 msgr2=0x7f71a0067990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:22:59.195 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.190+0000 7f719ffff700 1 --2- 172.21.15.191:0/3794791348 >> v2:172.21.15.37:3300/0 conn(0x7f71a00b3cb0 0x7f71a0067990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.195 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.190+0000 7f719ffff700 1 -- 172.21.15.191:0/3794791348 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a0157e70 con 0x7f71a014e2a0 2023-10-06T02:22:59.195 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.190+0000 7f719f7fe700 1 --2- 172.21.15.191:0/3794791348 >> v2:172.21.15.191:3300/0 conn(0x7f71a014e670 0x7f71a00b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:22:59.196 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.190+0000 7f71a4e78700 1 --2- 172.21.15.191:0/3794791348 >> v2:172.21.15.37:3300/0 conn(0x7f71a00b3cb0 0x7f71a0067990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:22:59.196 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.190+0000 7f719ffff700 1 --2- 172.21.15.191:0/3794791348 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71a014e2a0 0x7f71a00ce910 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f71a00b0d60 tx=0x7f71900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eb0661e834077a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:22:59.196 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.190+0000 7f719effd700 1 -- 172.21.15.191:0/3794791348 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7190011630 con 0x7f71a014e2a0 2023-10-06T02:22:59.196 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.190+0000 7f719effd700 1 -- 172.21.15.191:0/3794791348 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7190011790 con 0x7f71a014e2a0 2023-10-06T02:22:59.196 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.190+0000 7f719effd700 1 -- 172.21.15.191:0/3794791348 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7190011b30 con 0x7f71a014e2a0 2023-10-06T02:22:59.196 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.191+0000 7f71a68db700 1 -- 172.21.15.191:0/3794791348 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71a014e2a0 msgr2=0x7f71a00ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:59.196 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.191+0000 7f71a68db700 1 --2- 172.21.15.191:0/3794791348 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71a014e2a0 0x7f71a00ce910 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f71a00b0d60 tx=0x7f71900091a0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.197 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.191+0000 7f71a68db700 1 -- 172.21.15.191:0/3794791348 shutdown_connections 2023-10-06T02:22:59.197 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.191+0000 7f71a68db700 1 --2- 172.21.15.191:0/3794791348 >> v2:172.21.15.37:3300/0 conn(0x7f71a00b3cb0 0x7f71a0067990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.197 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.191+0000 7f71a68db700 1 --2- 172.21.15.191:0/3794791348 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71a014e2a0 0x7f71a00ce910 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.197 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.191+0000 7f71a68db700 1 --2- 172.21.15.191:0/3794791348 >> v2:172.21.15.191:3300/0 conn(0x7f71a014e670 0x7f71a00b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.197 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.191+0000 7f71a68db700 1 -- 172.21.15.191:0/3794791348 >> 172.21.15.191:0/3794791348 conn(0x7f71a006c0b0 msgr2=0x7f71a006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:22:59.197 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.191+0000 7f71a68db700 1 -- 172.21.15.191:0/3794791348 shutdown_connections 2023-10-06T02:22:59.197 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.191+0000 7f71a68db700 1 -- 172.21.15.191:0/3794791348 wait complete. 2023-10-06T02:22:59.197 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.192+0000 7f71a68db700 1 Processor -- start 2023-10-06T02:22:59.197 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.192+0000 7f71a68db700 1 -- start start 2023-10-06T02:22:59.200 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f71a68db700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71a00b3cb0 0x7f71a0138550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:59.201 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f71a68db700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71a014e2a0 0x7f71a014c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:59.201 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f71a68db700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71a014e670 0x7f71a014c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:59.201 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f71a68db700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a014bcc0 con 0x7f71a00b3cb0 2023-10-06T02:22:59.201 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f71a68db700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a014c150 con 0x7f71a014e670 2023-10-06T02:22:59.201 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f71a68db700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a014b0b0 con 0x7f71a014e2a0 2023-10-06T02:22:59.201 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f719f7fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71a014e2a0 0x7f71a014c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:59.201 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f71a4e78700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71a014e670 0x7f71a014c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:59.201 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f719f7fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71a014e2a0 0x7f71a014c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:50022/0 (socket says 172.21.15.191:50022) 2023-10-06T02:22:59.201 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f719f7fe700 1 -- 172.21.15.191:0/3558925474 learned_addr learned my addr 172.21.15.191:0/3558925474 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-10-06T02:22:59.201 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f719ffff700 1 --2- 172.21.15.191:0/3558925474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71a00b3cb0 0x7f71a0138550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:59.202 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f719f7fe700 1 -- 172.21.15.191:0/3558925474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71a014e670 msgr2=0x7f71a014c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:59.202 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f719f7fe700 1 --2- 172.21.15.191:0/3558925474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71a014e670 0x7f71a014c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.202 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f719f7fe700 1 -- 172.21.15.191:0/3558925474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71a00b3cb0 msgr2=0x7f71a0138550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:59.202 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f719f7fe700 1 --2- 172.21.15.191:0/3558925474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71a00b3cb0 0x7f71a0138550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.202 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f719f7fe700 1 -- 172.21.15.191:0/3558925474 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71940094f0 con 0x7f71a014e2a0 2023-10-06T02:22:59.202 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f719f7fe700 1 --2- 172.21.15.191:0/3558925474 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71a014e2a0 0x7f71a014c410 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f719400ec80 tx=0x7f7194009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:22:59.202 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f7187fff700 1 -- 172.21.15.191:0/3558925474 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719400c850 con 0x7f71a014e2a0 2023-10-06T02:22:59.203 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f7187fff700 1 -- 172.21.15.191:0/3558925474 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719400c9b0 con 0x7f71a014e2a0 2023-10-06T02:22:59.203 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f71a68db700 1 -- 172.21.15.191:0/3558925474 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7190009420 con 0x7f71a014e2a0 2023-10-06T02:22:59.203 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f7187fff700 1 -- 172.21.15.191:0/3558925474 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719400cd30 con 0x7f71a014e2a0 2023-10-06T02:22:59.203 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.193+0000 7f71a68db700 1 -- 172.21.15.191:0/3558925474 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a014b670 con 0x7f71a014e2a0 2023-10-06T02:22:59.203 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.194+0000 7f7187fff700 1 -- 172.21.15.191:0/3558925474 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7194005c80 con 0x7f71a014e2a0 2023-10-06T02:22:59.203 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.194+0000 7f7187fff700 1 -- 172.21.15.191:0/3558925474 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f7194006690 con 0x7f71a014e2a0 2023-10-06T02:22:59.203 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.194+0000 7f71a68db700 1 -- 172.21.15.191:0/3558925474 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a006a980 con 0x7f71a014e2a0 2023-10-06T02:22:59.203 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.196+0000 7f7187fff700 1 -- 172.21.15.191:0/3558925474 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7194021060 con 0x7f71a014e2a0 2023-10-06T02:22:59.258 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:22:59.258+0000 7f9decd25180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T02:22:59.279 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.278+0000 7f71a68db700 1 -- 172.21.15.191:0/3558925474 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd new", "uuid": "520bfada-3175-43ed-aeb3-f7ecf1a98cd7", "id": 7} v 0) v1 -- 0x7f71a004bb80 con 0x7f71a014e2a0 2023-10-06T02:22:59.284 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.283+0000 7f7187fff700 1 -- 172.21.15.191:0/3558925474 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "520bfada-3175-43ed-aeb3-f7ecf1a98cd7", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7194017070 con 0x7f71a014e2a0 2023-10-06T02:22:59.284 INFO:teuthology.orchestra.run.smithi191.stdout:7 2023-10-06T02:22:59.285 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.284+0000 7f71a68db700 1 -- 172.21.15.191:0/3558925474 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71a014e2a0 msgr2=0x7f71a014c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:59.285 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.284+0000 7f71a68db700 1 --2- 172.21.15.191:0/3558925474 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71a014e2a0 0x7f71a014c410 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f719400ec80 tx=0x7f7194009250 comp rx=0 tx=0).stop 2023-10-06T02:22:59.286 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.284+0000 7f71a68db700 1 -- 172.21.15.191:0/3558925474 shutdown_connections 2023-10-06T02:22:59.286 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.284+0000 7f71a68db700 1 --2- 172.21.15.191:0/3558925474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71a014e670 0x7f71a014c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.286 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.284+0000 7f71a68db700 1 --2- 172.21.15.191:0/3558925474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71a00b3cb0 0x7f71a0138550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.286 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.284+0000 7f71a68db700 1 --2- 172.21.15.191:0/3558925474 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71a014e2a0 0x7f71a014c410 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.286 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.284+0000 7f71a68db700 1 -- 172.21.15.191:0/3558925474 >> 172.21.15.191:0/3558925474 conn(0x7f71a006c0b0 msgr2=0x7f71a00aec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:22:59.286 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.284+0000 7f71a68db700 1 -- 172.21.15.191:0/3558925474 shutdown_connections 2023-10-06T02:22:59.286 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-06T02:22:59.284+0000 7f71a68db700 1 -- 172.21.15.191:0/3558925474 wait complete. 2023-10-06T02:22:59.297 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T02:22:59.297 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T02:22:59.299 INFO:tasks.ceph.osd.0:Started 2023-10-06T02:22:59.299 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T02:22:59.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T02:22:59.301 INFO:tasks.ceph.osd.1:Started 2023-10-06T02:22:59.301 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T02:22:59.301 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T02:22:59.303 INFO:tasks.ceph.osd.2:Started 2023-10-06T02:22:59.303 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T02:22:59.303 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T02:22:59.305 INFO:tasks.ceph.osd.3:Started 2023-10-06T02:22:59.305 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T02:22:59.306 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T02:22:59.308 INFO:tasks.ceph.osd.4:Started 2023-10-06T02:22:59.308 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T02:22:59.308 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T02:22:59.310 INFO:tasks.ceph.osd.5:Started 2023-10-06T02:22:59.310 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T02:22:59.310 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T02:22:59.312 INFO:tasks.ceph.osd.6:Started 2023-10-06T02:22:59.312 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T02:22:59.312 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T02:22:59.314 INFO:tasks.ceph.osd.7:Started 2023-10-06T02:22:59.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:22:59.394 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:22:59.394+0000 7f9decd25180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T02:22:59.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.447+0000 7f6a80de7700 1 Processor -- start 2023-10-06T02:22:59.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.447+0000 7f6a80de7700 1 -- start start 2023-10-06T02:22:59.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.449+0000 7f6a80de7700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6a7c159370 0x7f6a7c159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:59.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.449+0000 7f6a80de7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a7c0b0620 0x7f6a7c15db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:59.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.449+0000 7f6a80de7700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7c0cb200 con 0x7f6a7c0b2270 2023-10-06T02:22:59.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.449+0000 7f6a80de7700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7c0b5c00 con 0x7f6a7c159370 2023-10-06T02:22:59.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.449+0000 7f6a80de7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c0cb7c0 con 0x7f6a7c0b0620 2023-10-06T02:22:59.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.449+0000 7f6a7b7fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6a7c159370 0x7f6a7c159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:59.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.449+0000 7f6a7bfff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a7c0b0620 0x7f6a7c15db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:59.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.449+0000 7f6a7affd700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f6a7c0b2270 0x7f6a7c0aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:47674/0 (socket says 172.21.15.37:47674) 2023-10-06T02:22:59.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.449+0000 7f6a7affd700 1 -- 172.21.15.37:0/137660400 learned_addr learned my addr 172.21.15.37:0/137660400 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:22:59.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.449+0000 7f6a7bfff700 1 -- 172.21.15.37:0/137660400 >> v2:172.21.15.191:3300/0 conn(0x7f6a7c159370 msgr2=0x7f6a7c159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:22:59.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.449+0000 7f6a7bfff700 1 --2- 172.21.15.37:0/137660400 >> v2:172.21.15.191:3300/0 conn(0x7f6a7c159370 0x7f6a7c159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.449+0000 7f6a7bfff700 1 -- 172.21.15.37:0/137660400 >> v1:172.21.15.191:6789/0 conn(0x7f6a7c0b2270 legacy=0x7f6a7c0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:59.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.449+0000 7f6a7bfff700 1 -- 172.21.15.37:0/137660400 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c15e0d0 con 0x7f6a7c0b0620 2023-10-06T02:22:59.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.449+0000 7f6a7b7fe700 1 --2- 172.21.15.37:0/137660400 >> v2:172.21.15.191:3300/0 conn(0x7f6a7c159370 0x7f6a7c159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:22:59.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.449+0000 7f6a7bfff700 1 --2- 172.21.15.37:0/137660400 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a7c0b0620 0x7f6a7c15db90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6a74009e60 tx=0x7f6a74009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c97e79edf70a620 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:22:59.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.450+0000 7f6a7a7fc700 1 -- 172.21.15.37:0/137660400 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7400e070 con 0x7f6a7c0b0620 2023-10-06T02:22:59.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.450+0000 7f6a7a7fc700 1 -- 172.21.15.37:0/137660400 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7400bb60 con 0x7f6a7c0b0620 2023-10-06T02:22:59.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.450+0000 7f6a7a7fc700 1 -- 172.21.15.37:0/137660400 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a74012430 con 0x7f6a7c0b0620 2023-10-06T02:22:59.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.450+0000 7f6a80de7700 1 -- 172.21.15.37:0/137660400 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a7c0b0620 msgr2=0x7f6a7c15db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:59.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.450+0000 7f6a80de7700 1 --2- 172.21.15.37:0/137660400 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a7c0b0620 0x7f6a7c15db90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6a74009e60 tx=0x7f6a74009780 comp rx=0 tx=0).stop 2023-10-06T02:22:59.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.451+0000 7f6a80de7700 1 -- 172.21.15.37:0/137660400 shutdown_connections 2023-10-06T02:22:59.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.451+0000 7f6a80de7700 1 --2- 172.21.15.37:0/137660400 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a7c0b0620 0x7f6a7c15db90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.451+0000 7f6a80de7700 1 --2- 172.21.15.37:0/137660400 >> v2:172.21.15.191:3300/0 conn(0x7f6a7c159370 0x7f6a7c159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.451+0000 7f6a80de7700 1 -- 172.21.15.37:0/137660400 >> 172.21.15.37:0/137660400 conn(0x7f6a7c06c0b0 msgr2=0x7f6a7c06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:22:59.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.451+0000 7f6a80de7700 1 -- 172.21.15.37:0/137660400 shutdown_connections 2023-10-06T02:22:59.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.451+0000 7f6a80de7700 1 -- 172.21.15.37:0/137660400 wait complete. 2023-10-06T02:22:59.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.452+0000 7f6a80de7700 1 Processor -- start 2023-10-06T02:22:59.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.452+0000 7f6a80de7700 1 -- start start 2023-10-06T02:22:59.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.453+0000 7f6a80de7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7c0b0620 0x7f6a7c0c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:59.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.453+0000 7f6a80de7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a7c0b2270 0x7f6a7c0c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:59.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.453+0000 7f6a80de7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a7c159370 0x7f6a7c1578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:22:59.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.453+0000 7f6a80de7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c0c4e10 con 0x7f6a7c0b0620 2023-10-06T02:22:59.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.453+0000 7f6a80de7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c157e10 con 0x7f6a7c159370 2023-10-06T02:22:59.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.453+0000 7f6a80de7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c0a6e10 con 0x7f6a7c0b2270 2023-10-06T02:22:59.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.454+0000 7f6a7b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7c0b0620 0x7f6a7c0c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:59.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.454+0000 7f6a7b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7c0b0620 0x7f6a7c0c61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44206/0 (socket says 172.21.15.37:44206) 2023-10-06T02:22:59.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.454+0000 7f6a7affd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a7c0b2270 0x7f6a7c0c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:59.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.454+0000 7f6a7b7fe700 1 -- 172.21.15.37:0/204116717 learned_addr learned my addr 172.21.15.37:0/204116717 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:22:59.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.454+0000 7f6a7bfff700 1 --2- 172.21.15.37:0/204116717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a7c159370 0x7f6a7c1578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:22:59.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.454+0000 7f6a7affd700 1 -- 172.21.15.37:0/204116717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a7c159370 msgr2=0x7f6a7c1578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:59.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.454+0000 7f6a7affd700 1 --2- 172.21.15.37:0/204116717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a7c159370 0x7f6a7c1578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.454+0000 7f6a7affd700 1 -- 172.21.15.37:0/204116717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7c0b0620 msgr2=0x7f6a7c0c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:59.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.454+0000 7f6a7affd700 1 --2- 172.21.15.37:0/204116717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7c0b0620 0x7f6a7c0c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.454+0000 7f6a7affd700 1 -- 172.21.15.37:0/204116717 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c009420 con 0x7f6a7c0b2270 2023-10-06T02:22:59.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.454+0000 7f6a7b7fe700 1 --2- 172.21.15.37:0/204116717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7c0b0620 0x7f6a7c0c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:22:59.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.454+0000 7f6a7affd700 1 --2- 172.21.15.37:0/204116717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a7c0b2270 0x7f6a7c0c48d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6a7000c790 tx=0x7f6a70007eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:22:59.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.454+0000 7f6a637fe700 1 -- 172.21.15.37:0/204116717 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a70005b30 con 0x7f6a7c0b2270 2023-10-06T02:22:59.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.454+0000 7f6a637fe700 1 -- 172.21.15.37:0/204116717 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a70005cb0 con 0x7f6a7c0b2270 2023-10-06T02:22:59.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.454+0000 7f6a80de7700 1 -- 172.21.15.37:0/204116717 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a74009a20 con 0x7f6a7c0b2270 2023-10-06T02:22:59.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.454+0000 7f6a637fe700 1 -- 172.21.15.37:0/204116717 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a70004a80 con 0x7f6a7c0b2270 2023-10-06T02:22:59.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.454+0000 7f6a80de7700 1 -- 172.21.15.37:0/204116717 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7c0c40d0 con 0x7f6a7c0b2270 2023-10-06T02:22:59.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.454+0000 7f6a637fe700 1 -- 172.21.15.37:0/204116717 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6a70007350 con 0x7f6a7c0b2270 2023-10-06T02:22:59.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.455+0000 7f6a637fe700 1 -- 172.21.15.37:0/204116717 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f6a70007600 con 0x7f6a7c0b2270 2023-10-06T02:22:59.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.455+0000 7f6a80de7700 1 -- 172.21.15.37:0/204116717 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7c0c3f40 con 0x7f6a7c0b2270 2023-10-06T02:22:59.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.457+0000 7f6a637fe700 1 -- 172.21.15.37:0/204116717 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f6a70021060 con 0x7f6a7c0b2270 2023-10-06T02:22:59.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.528+0000 7f6a80de7700 1 -- 172.21.15.37:0/204116717 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a7c064b00 con 0x7f6a7c0b2270 2023-10-06T02:22:59.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.528+0000 7f6a637fe700 1 -- 172.21.15.37:0/204116717 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f6a70005030 con 0x7f6a7c0b2270 2023-10-06T02:22:59.529 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:22:59.529 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":10,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:22:59.280396+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:22:59.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.529+0000 7f6a80de7700 1 -- 172.21.15.37:0/204116717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a7c0b2270 msgr2=0x7f6a7c0c48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:22:59.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.529+0000 7f6a80de7700 1 --2- 172.21.15.37:0/204116717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a7c0b2270 0x7f6a7c0c48d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6a7000c790 tx=0x7f6a70007eb0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.529+0000 7f6a80de7700 1 -- 172.21.15.37:0/204116717 shutdown_connections 2023-10-06T02:22:59.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.529+0000 7f6a80de7700 1 --2- 172.21.15.37:0/204116717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a7c159370 0x7f6a7c1578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.529+0000 7f6a80de7700 1 --2- 172.21.15.37:0/204116717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7c0b0620 0x7f6a7c0c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.529+0000 7f6a80de7700 1 --2- 172.21.15.37:0/204116717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a7c0b2270 0x7f6a7c0c48d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:22:59.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.529+0000 7f6a80de7700 1 -- 172.21.15.37:0/204116717 >> 172.21.15.37:0/204116717 conn(0x7f6a7c06c0b0 msgr2=0x7f6a7c0b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:22:59.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.530+0000 7f6a80de7700 1 -- 172.21.15.37:0/204116717 shutdown_connections 2023-10-06T02:22:59.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:22:59.530+0000 7f6a80de7700 1 -- 172.21.15.37:0/204116717 wait complete. 2023-10-06T02:22:59.542 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T02:22:59.542 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T02:22:59.583 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:22:59.582+0000 7fba25dc5180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T02:22:59.661 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:22:59.660+0000 7fba25dc5180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T02:22:59.739 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:22:59.738+0000 7fba25dc5180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T02:22:59.907 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-10-06T02:22:59.905+0000 7f949f9de540 -1 Falling back to public interface 2023-10-06T02:22:59.909 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-10-06T02:22:59.909+0000 7f27b7a9c540 -1 Falling back to public interface 2023-10-06T02:22:59.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-10-06T02:22:59.910+0000 7f93e7419540 -1 Falling back to public interface 2023-10-06T02:22:59.911 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-10-06T02:22:59.909+0000 7f0c995bc540 -1 Falling back to public interface 2023-10-06T02:22:59.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-10-06T02:22:59.919+0000 7fe38c17c540 -1 Falling back to public interface 2023-10-06T02:22:59.926 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-10-06T02:22:59.925+0000 7f9fe0394540 -1 Falling back to public interface 2023-10-06T02:22:59.926 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-10-06T02:22:59.926+0000 7f4b4f496540 -1 Falling back to public interface 2023-10-06T02:22:59.926 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-10-06T02:22:59.926+0000 7fdc1a3fd540 -1 Falling back to public interface 2023-10-06T02:22:59.928 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-10-06T02:22:59.928+0000 7fdc14826700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6821/0: (98) Address already in use 2023-10-06T02:22:59.942 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:22:59.942+0000 7f9decd25180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T02:23:00.024 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:23:00.023+0000 7f9decd25180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T02:23:00.105 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:23:00.105+0000 7f9decd25180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T02:23:00.322 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:23:00.321+0000 7fba25dc5180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T02:23:00.347 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:00.456 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.456+0000 7f0ed75e1700 1 Processor -- start 2023-10-06T02:23:00.456 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.456+0000 7f0ed75e1700 1 -- start start 2023-10-06T02:23:00.459 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.457+0000 7f0ed75e1700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0ed00cc080 0x7f0ed0067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:00.459 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.457+0000 7f0ed75e1700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed006af70 con 0x7f0ed0142df0 2023-10-06T02:23:00.459 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.457+0000 7f0ed75e1700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed0067fb0 con 0x7f0ed0067ba0 2023-10-06T02:23:00.459 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.457+0000 7f0ed75e1700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed00ccb40 con 0x7f0ed00cc080 2023-10-06T02:23:00.459 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.457+0000 7f0ed537d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0ed0142df0 0x7f0ed00c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49516/0 (socket says 172.21.15.37:49516) 2023-10-06T02:23:00.460 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.457+0000 7f0ed537d700 1 -- 172.21.15.37:0/1395905887 learned_addr learned my addr 172.21.15.37:0/1395905887 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:00.460 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.457+0000 7f0ed4b7c700 1 --2- 172.21.15.37:0/1395905887 >> v2:172.21.15.191:3300/0 conn(0x7f0ed00cc080 0x7f0ed0067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:00.460 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.458+0000 7f0ec3fff700 1 -- 172.21.15.37:0/1395905887 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252018869 0 0) 0x7f0ed006af70 con 0x7f0ed0142df0 2023-10-06T02:23:00.460 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.458+0000 7f0ec3fff700 1 -- 172.21.15.37:0/1395905887 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ebc003570 con 0x7f0ed0142df0 2023-10-06T02:23:00.460 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.458+0000 7f0ec3fff700 1 -- 172.21.15.37:0/1395905887 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863855689 0 0) 0x7f0ed0067fb0 con 0x7f0ed0067ba0 2023-10-06T02:23:00.460 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.458+0000 7f0ec3fff700 1 -- 172.21.15.37:0/1395905887 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ed006af70 con 0x7f0ed0067ba0 2023-10-06T02:23:00.460 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.458+0000 7f0ed4b7c700 1 -- 172.21.15.37:0/1395905887 >> v1:172.21.15.191:6789/0 conn(0x7f0ed0067ba0 legacy=0x7f0ed006b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:00.460 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.458+0000 7f0ed4b7c700 1 -- 172.21.15.37:0/1395905887 >> v1:172.21.15.37:6789/0 conn(0x7f0ed0142df0 legacy=0x7f0ed00c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:00.460 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.458+0000 7f0ed4b7c700 1 -- 172.21.15.37:0/1395905887 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed006a960 con 0x7f0ed00cc080 2023-10-06T02:23:00.460 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.458+0000 7f0ed4b7c700 1 --2- 172.21.15.37:0/1395905887 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ed00cc080 0x7f0ed0067660 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0098e0 tx=0x7f0ecc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b880eb854de71ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:00.460 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.458+0000 7f0ec3fff700 1 -- 172.21.15.37:0/1395905887 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc011630 con 0x7f0ed00cc080 2023-10-06T02:23:00.461 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.458+0000 7f0ec3fff700 1 -- 172.21.15.37:0/1395905887 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc011790 con 0x7f0ed00cc080 2023-10-06T02:23:00.461 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.458+0000 7f0ec3fff700 1 -- 172.21.15.37:0/1395905887 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc011b30 con 0x7f0ed00cc080 2023-10-06T02:23:00.461 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.459+0000 7f0ed75e1700 1 -- 172.21.15.37:0/1395905887 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ed00cc080 msgr2=0x7f0ed0067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:00.461 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.459+0000 7f0ed75e1700 1 --2- 172.21.15.37:0/1395905887 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ed00cc080 0x7f0ed0067660 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0098e0 tx=0x7f0ecc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:00.461 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.459+0000 7f0ed75e1700 1 -- 172.21.15.37:0/1395905887 shutdown_connections 2023-10-06T02:23:00.461 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.459+0000 7f0ed75e1700 1 --2- 172.21.15.37:0/1395905887 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ed00cc080 0x7f0ed0067660 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:00.461 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.459+0000 7f0ed75e1700 1 -- 172.21.15.37:0/1395905887 >> 172.21.15.37:0/1395905887 conn(0x7f0ed00cd250 msgr2=0x7f0ed00cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:00.461 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.459+0000 7f0ed75e1700 1 -- 172.21.15.37:0/1395905887 shutdown_connections 2023-10-06T02:23:00.461 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.459+0000 7f0ed75e1700 1 -- 172.21.15.37:0/1395905887 wait complete. 2023-10-06T02:23:00.462 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:23:00.458+0000 7fba25dc5180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T02:23:00.464 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.460+0000 7f0ed75e1700 1 Processor -- start 2023-10-06T02:23:00.464 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.460+0000 7f0ed75e1700 1 -- start start 2023-10-06T02:23:00.464 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.461+0000 7f0ed75e1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed0067ba0 0x7f0ed013f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:00.464 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.461+0000 7f0ed75e1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ed00cc080 0x7f0ed0158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:00.464 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.461+0000 7f0ed75e1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ed0142df0 0x7f0ed0169ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:00.464 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.461+0000 7f0ed75e1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed015d4c0 con 0x7f0ed0067ba0 2023-10-06T02:23:00.464 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.461+0000 7f0ed75e1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed015d1c0 con 0x7f0ed0142df0 2023-10-06T02:23:00.464 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.461+0000 7f0ed75e1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed016a560 con 0x7f0ed00cc080 2023-10-06T02:23:00.464 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.461+0000 7f0ed537d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed0067ba0 0x7f0ed013f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:00.465 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.461+0000 7f0ed537d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed0067ba0 0x7f0ed013f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44222/0 (socket says 172.21.15.37:44222) 2023-10-06T02:23:00.465 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.461+0000 7f0ed537d700 1 -- 172.21.15.37:0/1980203549 learned_addr learned my addr 172.21.15.37:0/1980203549 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:00.465 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.461+0000 7f0ed4b7c700 1 --2- 172.21.15.37:0/1980203549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ed00cc080 0x7f0ed0158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:00.465 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.461+0000 7f0ed5b7e700 1 --2- 172.21.15.37:0/1980203549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ed0142df0 0x7f0ed0169ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:00.465 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.461+0000 7f0ed537d700 1 -- 172.21.15.37:0/1980203549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ed00cc080 msgr2=0x7f0ed0158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:00.465 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.461+0000 7f0ed537d700 1 --2- 172.21.15.37:0/1980203549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ed00cc080 0x7f0ed0158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:00.465 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.461+0000 7f0ed537d700 1 -- 172.21.15.37:0/1980203549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ed0142df0 msgr2=0x7f0ed0169ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:00.465 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.461+0000 7f0ed537d700 1 --2- 172.21.15.37:0/1980203549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ed0142df0 0x7f0ed0169ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:00.465 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.462+0000 7f0ed537d700 1 -- 172.21.15.37:0/1980203549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc009420 con 0x7f0ed0067ba0 2023-10-06T02:23:00.465 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.462+0000 7f0ed537d700 1 --2- 172.21.15.37:0/1980203549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed0067ba0 0x7f0ed013f2d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400c790 tx=0x7f0ec4007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:00.465 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.462+0000 7f0ec17fa700 1 -- 172.21.15.37:0/1980203549 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4005b30 con 0x7f0ed0067ba0 2023-10-06T02:23:00.466 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.462+0000 7f0ec17fa700 1 -- 172.21.15.37:0/1980203549 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec4005c90 con 0x7f0ed0067ba0 2023-10-06T02:23:00.466 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.462+0000 7f0ed75e1700 1 -- 172.21.15.37:0/1980203549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed016a840 con 0x7f0ed0067ba0 2023-10-06T02:23:00.466 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.462+0000 7f0ec17fa700 1 -- 172.21.15.37:0/1980203549 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4007300 con 0x7f0ed0067ba0 2023-10-06T02:23:00.466 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.462+0000 7f0ed75e1700 1 -- 172.21.15.37:0/1980203549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed016a220 con 0x7f0ed0067ba0 2023-10-06T02:23:00.466 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.462+0000 7f0ec17fa700 1 -- 172.21.15.37:0/1980203549 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0ec401c6c0 con 0x7f0ed0067ba0 2023-10-06T02:23:00.466 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.462+0000 7f0ec17fa700 1 -- 172.21.15.37:0/1980203549 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f0ec4005e00 con 0x7f0ed0067ba0 2023-10-06T02:23:00.466 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.463+0000 7f0ed75e1700 1 -- 172.21.15.37:0/1980203549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed006da60 con 0x7f0ed0067ba0 2023-10-06T02:23:00.466 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.465+0000 7f0ec17fa700 1 -- 172.21.15.37:0/1980203549 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0ec4017070 con 0x7f0ed0067ba0 2023-10-06T02:23:00.535 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.535+0000 7f0ed75e1700 1 -- 172.21.15.37:0/1980203549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ed00abed0 con 0x7f0ed0067ba0 2023-10-06T02:23:00.537 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.537+0000 7f0ec17fa700 1 -- 172.21.15.37:0/1980203549 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f0ec401c970 con 0x7f0ed0067ba0 2023-10-06T02:23:00.538 INFO:teuthology.misc.health.smithi037.stdout: 2023-10-06T02:23:00.538 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":10,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:22:59.280396+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:00.539 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.538+0000 7f0ed75e1700 1 -- 172.21.15.37:0/1980203549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed0067ba0 msgr2=0x7f0ed013f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:00.539 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.538+0000 7f0ed75e1700 1 --2- 172.21.15.37:0/1980203549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed0067ba0 0x7f0ed013f2d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400c790 tx=0x7f0ec4007ea0 comp rx=0 tx=0).stop 2023-10-06T02:23:00.539 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.538+0000 7f0ed75e1700 1 -- 172.21.15.37:0/1980203549 shutdown_connections 2023-10-06T02:23:00.539 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.538+0000 7f0ed75e1700 1 --2- 172.21.15.37:0/1980203549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ed0142df0 0x7f0ed0169ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:00.539 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.538+0000 7f0ed75e1700 1 --2- 172.21.15.37:0/1980203549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed0067ba0 0x7f0ed013f2d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:00.539 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.538+0000 7f0ed75e1700 1 --2- 172.21.15.37:0/1980203549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ed00cc080 0x7f0ed0158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:00.539 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.538+0000 7f0ed75e1700 1 -- 172.21.15.37:0/1980203549 >> 172.21.15.37:0/1980203549 conn(0x7f0ed00cd250 msgr2=0x7f0ed0141680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:00.539 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.539+0000 7f0ed75e1700 1 -- 172.21.15.37:0/1980203549 shutdown_connections 2023-10-06T02:23:00.539 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:00.539+0000 7f0ed75e1700 1 -- 172.21.15.37:0/1980203549 wait complete. 2023-10-06T02:23:00.555 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:23:00.554+0000 7fba25dc5180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T02:23:00.558 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T02:23:00.718 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:23:00.718+0000 7f9decd25180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T02:23:00.805 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:23:00.804+0000 7fba25dc5180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T02:23:00.862 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:23:00.862+0000 7f9decd25180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T02:23:00.883 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:23:00.882+0000 7fba25dc5180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T02:23:00.953 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:23:00.953+0000 7f9decd25180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T02:23:01.210 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:23:01.210+0000 7f9decd25180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T02:23:01.290 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:23:01.290+0000 7f9decd25180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T02:23:01.713 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:23:01.712+0000 7fba25dc5180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T02:23:01.786 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:23:01.785+0000 7fba25dc5180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T02:23:01.862 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:23:01.861+0000 7fba25dc5180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T02:23:01.995 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:23:01.994+0000 7fba25dc5180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T02:23:02.083 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:23:02.082+0000 7fba25dc5180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T02:23:02.149 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:23:02.149+0000 7f9decd25180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T02:23:02.226 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:23:02.226+0000 7f9decd25180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T02:23:02.243 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:23:02.242+0000 7fba25dc5180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T02:23:02.303 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:23:02.303+0000 7f9decd25180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T02:23:02.319 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:23:02.318+0000 7fba25dc5180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T02:23:02.400 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:23:02.399+0000 7fba25dc5180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T02:23:02.446 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:23:02.446+0000 7f9decd25180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T02:23:02.486 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:23:02.485+0000 7fba25dc5180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T02:23:02.534 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:23:02.534+0000 7f9decd25180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T02:23:02.726 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:23:02.726+0000 7f9decd25180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T02:23:04.024 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-10-06T02:23:03.161+0000 7f27b7a9c540 -1 osd.5 0 log_to_monitors true 2023-10-06T02:23:04.031 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-10-06T02:23:03.394+0000 7f949f9de540 -1 osd.4 0 log_to_monitors true 2023-10-06T02:23:04.189 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-10-06T02:23:03.436+0000 7f9fe0394540 -1 osd.6 0 log_to_monitors true 2023-10-06T02:23:04.189 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:23:02.854+0000 7f9decd25180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T02:23:04.190 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:23:02.932+0000 7f9decd25180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T02:23:04.191 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-10-06T02:23:03.009+0000 7f9decd25180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T02:23:04.193 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-10-06T02:23:03.438+0000 7f0c995bc540 -1 osd.7 0 log_to_monitors true 2023-10-06T02:23:04.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-10-06T02:23:03.422+0000 7fe38c17c540 -1 osd.1 0 log_to_monitors true 2023-10-06T02:23:04.194 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-10-06T02:23:03.422+0000 7fdc1a3fd540 -1 osd.0 0 log_to_monitors true 2023-10-06T02:23:04.194 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:23:03.510+0000 7fb9df1c9700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T02:23:04.195 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-06T02:23:03.510+0000 7fb9df1c9700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T02:23:04.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-10-06T02:23:03.448+0000 7f93e7419540 -1 osd.2 0 log_to_monitors true 2023-10-06T02:23:04.195 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-10-06T02:23:03.451+0000 7f4b4f496540 -1 osd.3 0 log_to_monitors true 2023-10-06T02:23:06.650 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-10-06T02:23:06.650+0000 7f4b460b8700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T02:23:06.656 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-10-06T02:23:06.656+0000 7f4b3eeaf700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:23:06.657 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-10-06T02:23:06.656+0000 7f27ae6be700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T02:23:06.665 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-10-06T02:23:06.664+0000 7f27a74b5700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:23:06.672 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-10-06T02:23:06.671+0000 7f9496600700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T02:23:06.680 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-10-06T02:23:06.679+0000 7f948f3f7700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:23:06.689 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-10-06T02:23:06.688+0000 7f9fd6fb6700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T02:23:06.694 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-10-06T02:23:06.693+0000 7f0c901de700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T02:23:06.695 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-10-06T02:23:06.694+0000 7f9fcfdad700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:23:06.698 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-10-06T02:23:06.697+0000 7f0c88fd5700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:23:06.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-10-06T02:23:06.701+0000 7fe382d9e700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T02:23:06.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-10-06T02:23:06.705+0000 7fe37bb95700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:23:06.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-10-06T02:23:06.714+0000 7f93de03b700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T02:23:06.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-10-06T02:23:06.717+0000 7f93d6e32700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:23:06.737 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-10-06T02:23:06.737+0000 7fdc12822700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T02:23:06.741 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-10-06T02:23:06.741+0000 7fdc09e16700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:23:07.364 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:07.485 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.482+0000 7f5a9e15c700 1 Processor -- start 2023-10-06T02:23:07.485 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.483+0000 7f5a9e15c700 1 -- start start 2023-10-06T02:23:07.485 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.483+0000 7f5a9e15c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a9815abd0 0x7f5a980b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:07.486 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.483+0000 7f5a9e15c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5a980b1810 0x7f5a980ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:07.486 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.483+0000 7f5a9e15c700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a980afdc0 con 0x7f5a9815afa0 2023-10-06T02:23:07.486 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.483+0000 7f5a9e15c700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a980b09d0 con 0x7f5a980b1810 2023-10-06T02:23:07.486 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.483+0000 7f5a9e15c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a980b00a0 con 0x7f5a9815abd0 2023-10-06T02:23:07.486 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.483+0000 7f5a96ffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5a9815afa0 0x7f5a980b1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35234/0 (socket says 172.21.15.37:35234) 2023-10-06T02:23:07.486 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.483+0000 7f5a96ffd700 1 -- 172.21.15.37:0/2942940305 learned_addr learned my addr 172.21.15.37:0/2942940305 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:07.486 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.484+0000 7f5a97fff700 1 --2- 172.21.15.37:0/2942940305 >> v2:172.21.15.191:3300/0 conn(0x7f5a980b1810 0x7f5a980ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:07.486 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.484+0000 7f5a977fe700 1 --2- 172.21.15.37:0/2942940305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a9815abd0 0x7f5a980b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:07.486 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.484+0000 7f5a967fc700 1 -- 172.21.15.37:0/2942940305 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 78800668 0 0) 0x7f5a980afdc0 con 0x7f5a9815afa0 2023-10-06T02:23:07.486 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.484+0000 7f5a967fc700 1 -- 172.21.15.37:0/2942940305 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a80003570 con 0x7f5a9815afa0 2023-10-06T02:23:07.487 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.484+0000 7f5a97fff700 1 -- 172.21.15.37:0/2942940305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a9815abd0 msgr2=0x7f5a980b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:07.487 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.484+0000 7f5a97fff700 1 --2- 172.21.15.37:0/2942940305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a9815abd0 0x7f5a980b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:07.487 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.484+0000 7f5a97fff700 1 -- 172.21.15.37:0/2942940305 >> v1:172.21.15.37:6789/0 conn(0x7f5a9815afa0 legacy=0x7f5a980b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:07.487 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.484+0000 7f5a97fff700 1 -- 172.21.15.37:0/2942940305 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a980b0380 con 0x7f5a980b1810 2023-10-06T02:23:07.487 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.484+0000 7f5a97fff700 1 --2- 172.21.15.37:0/2942940305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a980b1810 0x7f5a980ca6b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5a90009e60 tx=0x7f5a90009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54e9ef41410f0b22 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:07.487 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.484+0000 7f5a967fc700 1 -- 172.21.15.37:0/2942940305 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9000e070 con 0x7f5a980b1810 2023-10-06T02:23:07.487 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.484+0000 7f5a967fc700 1 -- 172.21.15.37:0/2942940305 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9000bb40 con 0x7f5a980b1810 2023-10-06T02:23:07.487 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.484+0000 7f5a967fc700 1 -- 172.21.15.37:0/2942940305 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a90012430 con 0x7f5a980b1810 2023-10-06T02:23:07.488 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.485+0000 7f5a9e15c700 1 -- 172.21.15.37:0/2942940305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a980b1810 msgr2=0x7f5a980ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:07.488 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.485+0000 7f5a9e15c700 1 --2- 172.21.15.37:0/2942940305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a980b1810 0x7f5a980ca6b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5a90009e60 tx=0x7f5a90009780 comp rx=0 tx=0).stop 2023-10-06T02:23:07.488 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.485+0000 7f5a9e15c700 1 -- 172.21.15.37:0/2942940305 shutdown_connections 2023-10-06T02:23:07.488 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.485+0000 7f5a9e15c700 1 --2- 172.21.15.37:0/2942940305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a980b1810 0x7f5a980ca6b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:07.488 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.485+0000 7f5a9e15c700 1 --2- 172.21.15.37:0/2942940305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a9815abd0 0x7f5a980b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:07.488 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.485+0000 7f5a9e15c700 1 -- 172.21.15.37:0/2942940305 >> 172.21.15.37:0/2942940305 conn(0x7f5a98087fc0 msgr2=0x7f5a980ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:07.488 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.485+0000 7f5a9e15c700 1 -- 172.21.15.37:0/2942940305 shutdown_connections 2023-10-06T02:23:07.488 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.485+0000 7f5a9e15c700 1 -- 172.21.15.37:0/2942940305 wait complete. 2023-10-06T02:23:07.491 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.486+0000 7f5a9e15c700 1 Processor -- start 2023-10-06T02:23:07.491 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.486+0000 7f5a9e15c700 1 -- start start 2023-10-06T02:23:07.491 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.487+0000 7f5a9e15c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a980b1810 0x7f5a98153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:07.491 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.487+0000 7f5a9e15c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a9815abd0 0x7f5a980aade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:07.491 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.487+0000 7f5a9e15c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a9815afa0 0x7f5a980ab320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:07.491 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.487+0000 7f5a9e15c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a980ac6c0 con 0x7f5a9815abd0 2023-10-06T02:23:07.491 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.487+0000 7f5a9e15c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a980ab860 con 0x7f5a9815afa0 2023-10-06T02:23:07.491 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.487+0000 7f5a9e15c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a980abab0 con 0x7f5a980b1810 2023-10-06T02:23:07.492 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.487+0000 7f5a96ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a9815abd0 0x7f5a980aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:07.492 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.487+0000 7f5a96ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a9815abd0 0x7f5a980aade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60688/0 (socket says 172.21.15.37:60688) 2023-10-06T02:23:07.492 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.487+0000 7f5a96ffd700 1 -- 172.21.15.37:0/2203735970 learned_addr learned my addr 172.21.15.37:0/2203735970 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:07.492 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.487+0000 7f5a977fe700 1 --2- 172.21.15.37:0/2203735970 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a980b1810 0x7f5a98153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:07.492 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.487+0000 7f5a97fff700 1 --2- 172.21.15.37:0/2203735970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a9815afa0 0x7f5a980ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:07.492 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.487+0000 7f5a96ffd700 1 -- 172.21.15.37:0/2203735970 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a980b1810 msgr2=0x7f5a98153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:07.492 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.487+0000 7f5a96ffd700 1 --2- 172.21.15.37:0/2203735970 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a980b1810 0x7f5a98153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:07.492 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.487+0000 7f5a96ffd700 1 -- 172.21.15.37:0/2203735970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a9815afa0 msgr2=0x7f5a980ab320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:07.492 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.487+0000 7f5a96ffd700 1 --2- 172.21.15.37:0/2203735970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a9815afa0 0x7f5a980ab320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:07.492 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.487+0000 7f5a96ffd700 1 -- 172.21.15.37:0/2203735970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a90009a20 con 0x7f5a9815abd0 2023-10-06T02:23:07.493 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.487+0000 7f5a977fe700 1 --2- 172.21.15.37:0/2203735970 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a980b1810 0x7f5a98153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:07.493 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.487+0000 7f5a97fff700 1 --2- 172.21.15.37:0/2203735970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a9815afa0 0x7f5a980ab320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:07.493 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.487+0000 7f5a96ffd700 1 --2- 172.21.15.37:0/2203735970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a9815abd0 0x7f5a980aade0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c00c590 tx=0x7f5a8c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:07.493 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.488+0000 7f5a7f7fe700 1 -- 172.21.15.37:0/2203735970 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c005b30 con 0x7f5a9815abd0 2023-10-06T02:23:07.493 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.488+0000 7f5a7f7fe700 1 -- 172.21.15.37:0/2203735970 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8c005cb0 con 0x7f5a9815abd0 2023-10-06T02:23:07.493 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.488+0000 7f5a9e15c700 1 -- 172.21.15.37:0/2203735970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a980abd90 con 0x7f5a9815abd0 2023-10-06T02:23:07.493 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.488+0000 7f5a7f7fe700 1 -- 172.21.15.37:0/2203735970 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c007320 con 0x7f5a9815abd0 2023-10-06T02:23:07.493 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.488+0000 7f5a9e15c700 1 -- 172.21.15.37:0/2203735970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a980ac350 con 0x7f5a9815abd0 2023-10-06T02:23:07.493 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.488+0000 7f5a9e15c700 1 -- 172.21.15.37:0/2203735970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9815b3d0 con 0x7f5a9815abd0 2023-10-06T02:23:07.493 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.489+0000 7f5a7f7fe700 1 -- 172.21.15.37:0/2203735970 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f5a8c01b3b0 con 0x7f5a9815abd0 2023-10-06T02:23:07.493 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.489+0000 7f5a7f7fe700 1 --2- 172.21.15.37:0/2203735970 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5a84066f20 0x7f5a840693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:07.494 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.490+0000 7f5a7f7fe700 1 -- 172.21.15.37:0/2203735970 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7f5a8c082d40 con 0x7f5a9815abd0 2023-10-06T02:23:07.494 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.490+0000 7f5a977fe700 1 --2- 172.21.15.37:0/2203735970 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5a84066f20 0x7f5a840693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:07.494 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.490+0000 7f5a977fe700 1 --2- 172.21.15.37:0/2203735970 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5a84066f20 0x7f5a840693d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5a88006ea0 tx=0x7f5a88008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:07.494 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.494+0000 7f5a7f7fe700 1 -- 172.21.15.37:0/2203735970 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a9815b3d0 con 0x7f5a9815abd0 2023-10-06T02:23:07.699 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.698+0000 7f5a9e15c700 1 -- 172.21.15.37:0/2203735970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a9815b3d0 con 0x7f5a9815abd0 2023-10-06T02:23:07.699 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.699+0000 7f5a7f7fe700 1 -- 172.21.15.37:0/2203735970 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10396 (secure 0 0 0) 0x7f5a9815b3d0 con 0x7f5a9815abd0 2023-10-06T02:23:07.699 INFO:teuthology.misc.health.smithi037.stdout: 2023-10-06T02:23:07.700 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":13,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:23:07.658112+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:07.702 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.701+0000 7f5a9e15c700 1 -- 172.21.15.37:0/2203735970 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5a84066f20 msgr2=0x7f5a840693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:07.702 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.701+0000 7f5a9e15c700 1 --2- 172.21.15.37:0/2203735970 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5a84066f20 0x7f5a840693d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5a88006ea0 tx=0x7f5a88008040 comp rx=0 tx=0).stop 2023-10-06T02:23:07.702 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.701+0000 7f5a9e15c700 1 -- 172.21.15.37:0/2203735970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a9815abd0 msgr2=0x7f5a980aade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:07.702 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.701+0000 7f5a9e15c700 1 --2- 172.21.15.37:0/2203735970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a9815abd0 0x7f5a980aade0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c00c590 tx=0x7f5a8c007e00 comp rx=0 tx=0).stop 2023-10-06T02:23:07.702 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.701+0000 7f5a9e15c700 1 -- 172.21.15.37:0/2203735970 shutdown_connections 2023-10-06T02:23:07.702 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.701+0000 7f5a9e15c700 1 --2- 172.21.15.37:0/2203735970 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5a84066f20 0x7f5a840693d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:07.702 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.701+0000 7f5a9e15c700 1 --2- 172.21.15.37:0/2203735970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a9815afa0 0x7f5a980ab320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:07.702 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.701+0000 7f5a9e15c700 1 --2- 172.21.15.37:0/2203735970 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a980b1810 0x7f5a98153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:07.702 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.701+0000 7f5a9e15c700 1 --2- 172.21.15.37:0/2203735970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a9815abd0 0x7f5a980aade0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:07.703 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.701+0000 7f5a9e15c700 1 -- 172.21.15.37:0/2203735970 >> 172.21.15.37:0/2203735970 conn(0x7f5a98087fc0 msgr2=0x7f5a9806b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:07.703 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.701+0000 7f5a9e15c700 1 -- 172.21.15.37:0/2203735970 shutdown_connections 2023-10-06T02:23:07.703 INFO:teuthology.misc.health.smithi037.stderr:2023-10-06T02:23:07.701+0000 7f5a9e15c700 1 -- 172.21.15.37:0/2203735970 wait complete. 2023-10-06T02:23:07.713 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T02:23:07.713 INFO:tasks.ceph:Creating RBD pool 2023-10-06T02:23:07.713 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T02:23:07.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.832+0000 7ff91686c700 1 Processor -- start 2023-10-06T02:23:07.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.832+0000 7ff91686c700 1 -- start start 2023-10-06T02:23:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.832+0000 7ff91686c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff9101593c0 0x7ff910159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.832+0000 7ff91686c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9100ccb30 0x7ff9100ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.832+0000 7ff91686c700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9100b07a0 con 0x7ff9100b2380 2023-10-06T02:23:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.832+0000 7ff91686c700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9100cd8a0 con 0x7ff9100ccb30 2023-10-06T02:23:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.832+0000 7ff91686c700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9100afe70 con 0x7ff9101593c0 2023-10-06T02:23:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.833+0000 7ff914e09700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9100ccb30 0x7ff9100ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.833+0000 7ff914e09700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9100ccb30 0x7ff9100ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60694/0 (socket says 172.21.15.37:60694) 2023-10-06T02:23:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.833+0000 7ff914e09700 1 -- 172.21.15.37:0/1995282564 learned_addr learned my addr 172.21.15.37:0/1995282564 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.833+0000 7ff90ffff700 1 --2- 172.21.15.37:0/1995282564 >> v2:172.21.15.191:3300/0 conn(0x7ff9101593c0 0x7ff910159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.833+0000 7ff914e09700 1 -- 172.21.15.37:0/1995282564 >> v2:172.21.15.191:3300/0 conn(0x7ff9101593c0 msgr2=0x7ff910159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.833+0000 7ff914e09700 1 --2- 172.21.15.37:0/1995282564 >> v2:172.21.15.191:3300/0 conn(0x7ff9101593c0 0x7ff910159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.833+0000 7ff914e09700 1 -- 172.21.15.37:0/1995282564 >> v1:172.21.15.191:6789/0 conn(0x7ff9100b2380 legacy=0x7ff9100b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:07.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.833+0000 7ff914e09700 1 -- 172.21.15.37:0/1995282564 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9100b0150 con 0x7ff9100ccb30 2023-10-06T02:23:07.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.833+0000 7ff914e09700 1 --2- 172.21.15.37:0/1995282564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9100ccb30 0x7ff9100ccf90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff91006d520 tx=0x7ff908009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c732d7429c169c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:07.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.833+0000 7ff90effd700 1 -- 172.21.15.37:0/1995282564 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90800e070 con 0x7ff9100ccb30 2023-10-06T02:23:07.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.833+0000 7ff90effd700 1 -- 172.21.15.37:0/1995282564 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90800ba10 con 0x7ff9100ccb30 2023-10-06T02:23:07.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.833+0000 7ff90effd700 1 -- 172.21.15.37:0/1995282564 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9080092e0 con 0x7ff9100ccb30 2023-10-06T02:23:07.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.834+0000 7ff91686c700 1 -- 172.21.15.37:0/1995282564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9100ccb30 msgr2=0x7ff9100ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:07.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.834+0000 7ff91686c700 1 --2- 172.21.15.37:0/1995282564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9100ccb30 0x7ff9100ccf90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff91006d520 tx=0x7ff908009840 comp rx=0 tx=0).stop 2023-10-06T02:23:07.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.834+0000 7ff91686c700 1 -- 172.21.15.37:0/1995282564 shutdown_connections 2023-10-06T02:23:07.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.834+0000 7ff91686c700 1 --2- 172.21.15.37:0/1995282564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9100ccb30 0x7ff9100ccf90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:07.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.834+0000 7ff91686c700 1 --2- 172.21.15.37:0/1995282564 >> v2:172.21.15.191:3300/0 conn(0x7ff9101593c0 0x7ff910159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:07.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.834+0000 7ff91686c700 1 -- 172.21.15.37:0/1995282564 >> 172.21.15.37:0/1995282564 conn(0x7ff91006c0b0 msgr2=0x7ff91006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:07.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.834+0000 7ff91686c700 1 -- 172.21.15.37:0/1995282564 shutdown_connections 2023-10-06T02:23:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.834+0000 7ff91686c700 1 -- 172.21.15.37:0/1995282564 wait complete. 2023-10-06T02:23:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.835+0000 7ff91686c700 1 Processor -- start 2023-10-06T02:23:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.835+0000 7ff91686c700 1 -- start start 2023-10-06T02:23:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff91686c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9100b2380 0x7ff9100c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff91686c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9100ccb30 0x7ff91015b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff91686c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9101593c0 0x7ff91015b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff91686c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff910169e90 con 0x7ff9100b2380 2023-10-06T02:23:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff91686c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9100c51d0 con 0x7ff9101593c0 2023-10-06T02:23:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff91686c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9100c54b0 con 0x7ff9100ccb30 2023-10-06T02:23:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff90ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9100b2380 0x7ff9100c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff90ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9100b2380 0x7ff9100c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60700/0 (socket says 172.21.15.37:60700) 2023-10-06T02:23:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff90ffff700 1 -- 172.21.15.37:0/183177756 learned_addr learned my addr 172.21.15.37:0/183177756 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:07.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff914e09700 1 --2- 172.21.15.37:0/183177756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9101593c0 0x7ff91015b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:07.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff90f7fe700 1 --2- 172.21.15.37:0/183177756 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9100ccb30 0x7ff91015b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:07.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff90ffff700 1 -- 172.21.15.37:0/183177756 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9100ccb30 msgr2=0x7ff91015b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:07.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff90ffff700 1 --2- 172.21.15.37:0/183177756 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9100ccb30 0x7ff91015b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:07.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff90ffff700 1 -- 172.21.15.37:0/183177756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9101593c0 msgr2=0x7ff91015b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:07.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff90ffff700 1 --2- 172.21.15.37:0/183177756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9101593c0 0x7ff91015b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:07.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff90ffff700 1 -- 172.21.15.37:0/183177756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff908009ae0 con 0x7ff9100b2380 2023-10-06T02:23:07.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff90f7fe700 1 --2- 172.21.15.37:0/183177756 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9100ccb30 0x7ff91015b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:07.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff90ffff700 1 --2- 172.21.15.37:0/183177756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9100b2380 0x7ff9100c46c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff90000c880 tx=0x7ff900008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:07.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff907fff700 1 -- 172.21.15.37:0/183177756 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff900011600 con 0x7ff9100b2380 2023-10-06T02:23:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff907fff700 1 -- 172.21.15.37:0/183177756 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff900011780 con 0x7ff9100b2380 2023-10-06T02:23:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff91686c700 1 -- 172.21.15.37:0/183177756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9100c5790 con 0x7ff9100b2380 2023-10-06T02:23:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.836+0000 7ff907fff700 1 -- 172.21.15.37:0/183177756 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff900011b40 con 0x7ff9100b2380 2023-10-06T02:23:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.837+0000 7ff91686c700 1 -- 172.21.15.37:0/183177756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9100c6740 con 0x7ff9100b2380 2023-10-06T02:23:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.837+0000 7ff91686c700 1 -- 172.21.15.37:0/183177756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff910088bb0 con 0x7ff9100b2380 2023-10-06T02:23:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.838+0000 7ff907fff700 1 -- 172.21.15.37:0/183177756 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7ff900018360 con 0x7ff9100b2380 2023-10-06T02:23:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.838+0000 7ff907fff700 1 --2- 172.21.15.37:0/183177756 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff8f0066ea0 0x7ff8f0069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.839+0000 7ff907fff700 1 -- 172.21.15.37:0/183177756 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7ff900083cf0 con 0x7ff9100b2380 2023-10-06T02:23:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.839+0000 7ff90f7fe700 1 --2- 172.21.15.37:0/183177756 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff8f0066ea0 0x7ff8f0069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:07.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.839+0000 7ff90f7fe700 1 --2- 172.21.15.37:0/183177756 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff8f0066ea0 0x7ff8f0069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff9100b5440 tx=0x7ff8f8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:07.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:07.843+0000 7ff907fff700 1 -- 172.21.15.37:0/183177756 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff900051470 con 0x7ff9100b2380 2023-10-06T02:23:08.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.036+0000 7ff91686c700 1 -- 172.21.15.37:0/183177756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7ff9100b0430 con 0x7ff9100b2380 2023-10-06T02:23:08.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.809+0000 7ff907fff700 1 -- 172.21.15.37:0/183177756 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7ff9000150a0 con 0x7ff9100b2380 2023-10-06T02:23:08.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.812+0000 7ff91686c700 1 -- 172.21.15.37:0/183177756 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff8f0066ea0 msgr2=0x7ff8f0069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:08.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.812+0000 7ff91686c700 1 --2- 172.21.15.37:0/183177756 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff8f0066ea0 0x7ff8f0069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff9100b5440 tx=0x7ff8f8009040 comp rx=0 tx=0).stop 2023-10-06T02:23:08.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.812+0000 7ff91686c700 1 -- 172.21.15.37:0/183177756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9100b2380 msgr2=0x7ff9100c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:08.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.812+0000 7ff91686c700 1 --2- 172.21.15.37:0/183177756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9100b2380 0x7ff9100c46c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff90000c880 tx=0x7ff900008040 comp rx=0 tx=0).stop 2023-10-06T02:23:08.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.812+0000 7ff91686c700 1 -- 172.21.15.37:0/183177756 shutdown_connections 2023-10-06T02:23:08.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.812+0000 7ff91686c700 1 --2- 172.21.15.37:0/183177756 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff8f0066ea0 0x7ff8f0069350 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:08.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.812+0000 7ff91686c700 1 --2- 172.21.15.37:0/183177756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9101593c0 0x7ff91015b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:08.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.812+0000 7ff91686c700 1 --2- 172.21.15.37:0/183177756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9100b2380 0x7ff9100c46c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:08.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.812+0000 7ff91686c700 1 --2- 172.21.15.37:0/183177756 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9100ccb30 0x7ff91015b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:08.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.812+0000 7ff91686c700 1 -- 172.21.15.37:0/183177756 >> 172.21.15.37:0/183177756 conn(0x7ff91006c0b0 msgr2=0x7ff9100cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:08.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.812+0000 7ff91686c700 1 -- 172.21.15.37:0/183177756 shutdown_connections 2023-10-06T02:23:08.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.812+0000 7ff91686c700 1 -- 172.21.15.37:0/183177756 wait complete. 2023-10-06T02:23:08.814 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'rbd' created 2023-10-06T02:23:08.826 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T02:23:08.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.951+0000 7f7e26f66700 1 Processor -- start 2023-10-06T02:23:08.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.951+0000 7f7e26f66700 1 -- start start 2023-10-06T02:23:08.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.952+0000 7f7e26f66700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7e200ac540 0x7f7e200aef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:08.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.952+0000 7f7e26f66700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e20069c10 con 0x7f7e200ac910 2023-10-06T02:23:08.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.952+0000 7f7e26f66700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2006a790 con 0x7f7e200c9e80 2023-10-06T02:23:08.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.952+0000 7f7e26f66700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e200abe90 con 0x7f7e200ac540 2023-10-06T02:23:08.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.952+0000 7f7e24d02700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7e200ac540 0x7f7e200aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:08.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.952+0000 7f7e25503700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7e200ac910 0x7f7e2006ac20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35250/0 (socket says 172.21.15.37:35250) 2023-10-06T02:23:08.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.952+0000 7f7e25503700 1 -- 172.21.15.37:0/3309971537 learned_addr learned my addr 172.21.15.37:0/3309971537 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:08.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.952+0000 7f7e24d02700 1 -- 172.21.15.37:0/3309971537 >> v1:172.21.15.191:6789/0 conn(0x7f7e200c9e80 legacy=0x7f7e200af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:08.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.952+0000 7f7e24d02700 1 -- 172.21.15.37:0/3309971537 >> v1:172.21.15.37:6789/0 conn(0x7f7e200ac910 legacy=0x7f7e2006ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:08.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.952+0000 7f7e1f7fe700 1 -- 172.21.15.37:0/3309971537 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113767092 0 0) 0x7f7e20069c10 con 0x7f7e200ac910 2023-10-06T02:23:08.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.952+0000 7f7e24d02700 1 -- 172.21.15.37:0/3309971537 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e20069e60 con 0x7f7e200ac540 2023-10-06T02:23:08.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.952+0000 7f7e24d02700 1 --2- 172.21.15.37:0/3309971537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e200ac540 0x7f7e200aef10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e140098e0 tx=0x7f7e140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815b246f0802778 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:08.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.952+0000 7f7e1f7fe700 1 -- 172.21.15.37:0/3309971537 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e14009e80 con 0x7f7e200ac540 2023-10-06T02:23:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.953+0000 7f7e1f7fe700 1 -- 172.21.15.37:0/3309971537 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1400b860 con 0x7f7e200ac540 2023-10-06T02:23:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.953+0000 7f7e1f7fe700 1 -- 172.21.15.37:0/3309971537 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1400bbe0 con 0x7f7e200ac540 2023-10-06T02:23:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.953+0000 7f7e26f66700 1 -- 172.21.15.37:0/3309971537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e200ac540 msgr2=0x7f7e200aef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.953+0000 7f7e26f66700 1 --2- 172.21.15.37:0/3309971537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e200ac540 0x7f7e200aef10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e140098e0 tx=0x7f7e140091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.953+0000 7f7e26f66700 1 -- 172.21.15.37:0/3309971537 shutdown_connections 2023-10-06T02:23:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.953+0000 7f7e26f66700 1 --2- 172.21.15.37:0/3309971537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e200ac540 0x7f7e200aef10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.953+0000 7f7e26f66700 1 -- 172.21.15.37:0/3309971537 >> 172.21.15.37:0/3309971537 conn(0x7f7e200cd480 msgr2=0x7f7e200c9420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.953+0000 7f7e26f66700 1 -- 172.21.15.37:0/3309971537 shutdown_connections 2023-10-06T02:23:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.953+0000 7f7e26f66700 1 -- 172.21.15.37:0/3309971537 wait complete. 2023-10-06T02:23:08.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.954+0000 7f7e26f66700 1 Processor -- start 2023-10-06T02:23:08.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.954+0000 7f7e26f66700 1 -- start start 2023-10-06T02:23:08.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.955+0000 7f7e26f66700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e200ac540 0x7f7e2015ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:08.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.955+0000 7f7e26f66700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e200ac910 0x7f7e200c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:08.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.955+0000 7f7e26f66700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e200c9e80 0x7f7e20149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.955+0000 7f7e26f66700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2015e350 con 0x7f7e200c9e80 2023-10-06T02:23:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.955+0000 7f7e26f66700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2015ce50 con 0x7f7e200ac910 2023-10-06T02:23:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.955+0000 7f7e26f66700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2015d2e0 con 0x7f7e200ac540 2023-10-06T02:23:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.955+0000 7f7e25503700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e200c9e80 0x7f7e20149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.955+0000 7f7e25503700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e200c9e80 0x7f7e20149bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60710/0 (socket says 172.21.15.37:60710) 2023-10-06T02:23:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.955+0000 7f7e25503700 1 -- 172.21.15.37:0/1345251987 learned_addr learned my addr 172.21.15.37:0/1345251987 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.955+0000 7f7e24d02700 1 --2- 172.21.15.37:0/1345251987 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e200ac540 0x7f7e2015ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.955+0000 7f7e1ffff700 1 --2- 172.21.15.37:0/1345251987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e200ac910 0x7f7e200c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.956+0000 7f7e25503700 1 -- 172.21.15.37:0/1345251987 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e200ac540 msgr2=0x7f7e2015ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.956+0000 7f7e25503700 1 --2- 172.21.15.37:0/1345251987 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e200ac540 0x7f7e2015ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.956+0000 7f7e25503700 1 -- 172.21.15.37:0/1345251987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e200ac910 msgr2=0x7f7e200c2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.956+0000 7f7e25503700 1 --2- 172.21.15.37:0/1345251987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e200ac910 0x7f7e200c2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.956+0000 7f7e25503700 1 -- 172.21.15.37:0/1345251987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e14009420 con 0x7f7e200c9e80 2023-10-06T02:23:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.956+0000 7f7e25503700 1 --2- 172.21.15.37:0/1345251987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e200c9e80 0x7f7e20149bb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800cc90 tx=0x7f7e18001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.956+0000 7f7e1cff9700 1 -- 172.21.15.37:0/1345251987 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1800a940 con 0x7f7e200c9e80 2023-10-06T02:23:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.956+0000 7f7e1cff9700 1 -- 172.21.15.37:0/1345251987 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1800aaa0 con 0x7f7e200c9e80 2023-10-06T02:23:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.956+0000 7f7e26f66700 1 -- 172.21.15.37:0/1345251987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2015c240 con 0x7f7e200c9e80 2023-10-06T02:23:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.956+0000 7f7e1cff9700 1 -- 172.21.15.37:0/1345251987 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1800ae60 con 0x7f7e200c9e80 2023-10-06T02:23:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.956+0000 7f7e26f66700 1 -- 172.21.15.37:0/1345251987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2015c5d0 con 0x7f7e200c9e80 2023-10-06T02:23:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.957+0000 7f7e26f66700 1 -- 172.21.15.37:0/1345251987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2015cc00 con 0x7f7e200c9e80 2023-10-06T02:23:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.957+0000 7f7e1cff9700 1 -- 172.21.15.37:0/1345251987 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f7e18007300 con 0x7f7e200c9e80 2023-10-06T02:23:08.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.958+0000 7f7e1cff9700 1 --2- 172.21.15.37:0/1345251987 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7e04066ed0 0x7f7e04069380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:08.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.958+0000 7f7e1cff9700 1 -- 172.21.15.37:0/1345251987 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 5184+0+0 (secure 0 0 0) 0x7f7e180845d0 con 0x7f7e200c9e80 2023-10-06T02:23:08.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.958+0000 7f7e24d02700 1 --2- 172.21.15.37:0/1345251987 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7e04066ed0 0x7f7e04069380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:08.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.958+0000 7f7e24d02700 1 --2- 172.21.15.37:0/1345251987 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7e04066ed0 0x7f7e04069380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7e140093f0 tx=0x7f7e14017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:08.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:08.962+0000 7f7e1cff9700 1 -- 172.21.15.37:0/1345251987 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e18051bb0 con 0x7f7e200c9e80 2023-10-06T02:23:09.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.158+0000 7f7e26f66700 1 -- 172.21.15.37:0/1345251987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7e2015cf90 con 0x7f7e200c9e80 2023-10-06T02:23:09.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.818+0000 7f7e1cff9700 1 -- 172.21.15.37:0/1345251987 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7e180551d0 con 0x7f7e200c9e80 2023-10-06T02:23:09.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.821+0000 7f7e26f66700 1 -- 172.21.15.37:0/1345251987 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7e04066ed0 msgr2=0x7f7e04069380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:09.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.821+0000 7f7e26f66700 1 --2- 172.21.15.37:0/1345251987 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7e04066ed0 0x7f7e04069380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7e140093f0 tx=0x7f7e14017000 comp rx=0 tx=0).stop 2023-10-06T02:23:09.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.821+0000 7f7e26f66700 1 -- 172.21.15.37:0/1345251987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e200c9e80 msgr2=0x7f7e20149bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:09.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.821+0000 7f7e26f66700 1 --2- 172.21.15.37:0/1345251987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e200c9e80 0x7f7e20149bb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800cc90 tx=0x7f7e18001a80 comp rx=0 tx=0).stop 2023-10-06T02:23:09.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.821+0000 7f7e26f66700 1 -- 172.21.15.37:0/1345251987 shutdown_connections 2023-10-06T02:23:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.821+0000 7f7e26f66700 1 --2- 172.21.15.37:0/1345251987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e200c9e80 0x7f7e20149bb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.821+0000 7f7e26f66700 1 --2- 172.21.15.37:0/1345251987 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e200ac540 0x7f7e2015ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.821+0000 7f7e26f66700 1 --2- 172.21.15.37:0/1345251987 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7e04066ed0 0x7f7e04069380 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.821+0000 7f7e26f66700 1 --2- 172.21.15.37:0/1345251987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e200ac910 0x7f7e200c2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.821+0000 7f7e26f66700 1 -- 172.21.15.37:0/1345251987 >> 172.21.15.37:0/1345251987 conn(0x7f7e200cd480 msgr2=0x7f7e2006c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.822+0000 7f7e26f66700 1 -- 172.21.15.37:0/1345251987 shutdown_connections 2023-10-06T02:23:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.822+0000 7f7e26f66700 1 -- 172.21.15.37:0/1345251987 wait complete. 2023-10-06T02:23:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T02:23:09.837 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T02:23:09.837 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:23:09.837 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:23:09.839 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:23:09.839 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:23:09.839 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:23:09.841 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:23:09.841 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:23:09.841 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:23:09.844 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:23:09.844 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:23:09.844 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:23:09.846 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:23:09.846 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T02:23:09.846 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:09.927 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-10-06T02:23:09.928 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-10-06T02:23:09.929 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-10-06T02:23:09.929+0000 7f2cce999700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6833/0: (98) Address already in use 2023-10-06T02:23:09.932 INFO:tasks.ceph.mds.b.smithi191.stdout:starting mds.b at 2023-10-06T02:23:09.934 INFO:tasks.ceph.mds.d.smithi191.stdout:starting mds.d at 2023-10-06T02:23:09.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.985+0000 7f5816087700 1 Processor -- start 2023-10-06T02:23:09.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.985+0000 7f5816087700 1 -- start start 2023-10-06T02:23:09.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.986+0000 7f5816087700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f58100c63d0 0x7f581015dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:09.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.986+0000 7f5816087700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f581006ad60 0x7f58100c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:09.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.986+0000 7f5816087700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f581006a8d0 con 0x7f58101596d0 2023-10-06T02:23:09.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.986+0000 7f5816087700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f581006b6d0 con 0x7f58100c63d0 2023-10-06T02:23:09.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.986+0000 7f5816087700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5810063800 con 0x7f581006ad60 2023-10-06T02:23:09.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.986+0000 7f580effd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f58100c63d0 0x7f581015dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:09.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.986+0000 7f580f7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f58101596d0 0x7f58100c5cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35280/0 (socket says 172.21.15.37:35280) 2023-10-06T02:23:09.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.986+0000 7f580f7fe700 1 -- 172.21.15.37:0/2233555608 learned_addr learned my addr 172.21.15.37:0/2233555608 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:09.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.986+0000 7f580ffff700 1 --2- 172.21.15.37:0/2233555608 >> v2:172.21.15.191:3300/0 conn(0x7f581006ad60 0x7f58100c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:09.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.987+0000 7f580effd700 1 -- 172.21.15.37:0/2233555608 >> v2:172.21.15.191:3300/0 conn(0x7f581006ad60 msgr2=0x7f58100c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:09.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.987+0000 7f580effd700 1 --2- 172.21.15.37:0/2233555608 >> v2:172.21.15.191:3300/0 conn(0x7f581006ad60 0x7f58100c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:09.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.987+0000 7f580effd700 1 -- 172.21.15.37:0/2233555608 >> v1:172.21.15.37:6789/0 conn(0x7f58101596d0 legacy=0x7f58100c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:09.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.987+0000 7f580effd700 1 -- 172.21.15.37:0/2233555608 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5810069fa0 con 0x7f58100c63d0 2023-10-06T02:23:09.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.987+0000 7f580e7fc700 1 -- 172.21.15.37:0/2233555608 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953042015 0 0) 0x7f581006a8d0 con 0x7f58101596d0 2023-10-06T02:23:09.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.987+0000 7f580effd700 1 --2- 172.21.15.37:0/2233555608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58100c63d0 0x7f581015dc20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f58100cc990 tx=0x7f58040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece8b63890875afa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:09.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.987+0000 7f580e7fc700 1 -- 172.21.15.37:0/2233555608 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580400b6b0 con 0x7f58100c63d0 2023-10-06T02:23:09.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.987+0000 7f580e7fc700 1 -- 172.21.15.37:0/2233555608 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580400b810 con 0x7f58100c63d0 2023-10-06T02:23:09.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.987+0000 7f580e7fc700 1 -- 172.21.15.37:0/2233555608 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580400bbb0 con 0x7f58100c63d0 2023-10-06T02:23:09.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.987+0000 7f5816087700 1 -- 172.21.15.37:0/2233555608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58100c63d0 msgr2=0x7f581015dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:09.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.987+0000 7f5816087700 1 --2- 172.21.15.37:0/2233555608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58100c63d0 0x7f581015dc20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f58100cc990 tx=0x7f58040091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:09.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.987+0000 7f5816087700 1 -- 172.21.15.37:0/2233555608 shutdown_connections 2023-10-06T02:23:09.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.987+0000 7f5816087700 1 --2- 172.21.15.37:0/2233555608 >> v2:172.21.15.191:3300/0 conn(0x7f581006ad60 0x7f58100c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:09.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.987+0000 7f5816087700 1 --2- 172.21.15.37:0/2233555608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58100c63d0 0x7f581015dc20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:09.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.987+0000 7f5816087700 1 -- 172.21.15.37:0/2233555608 >> 172.21.15.37:0/2233555608 conn(0x7f58100cd490 msgr2=0x7f58100c9430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:09.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.988+0000 7f5816087700 1 -- 172.21.15.37:0/2233555608 shutdown_connections 2023-10-06T02:23:09.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.988+0000 7f5816087700 1 -- 172.21.15.37:0/2233555608 wait complete. 2023-10-06T02:23:09.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.989+0000 7f5816087700 1 Processor -- start 2023-10-06T02:23:09.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.989+0000 7f5816087700 1 -- start start 2023-10-06T02:23:09.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f5816087700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581006ad60 0x7f58101559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:09.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f5816087700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58100c63d0 0x7f581016a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:09.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f5816087700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58101596d0 0x7f581015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:09.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f5816087700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5810155ee0 con 0x7f581006ad60 2023-10-06T02:23:09.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f5816087700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581015ce80 con 0x7f58101596d0 2023-10-06T02:23:09.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f5816087700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581016ae70 con 0x7f58100c63d0 2023-10-06T02:23:09.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f580f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581006ad60 0x7f58101559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:09.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f580f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581006ad60 0x7f58101559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60748/0 (socket says 172.21.15.37:60748) 2023-10-06T02:23:09.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f580f7fe700 1 -- 172.21.15.37:0/1195176385 learned_addr learned my addr 172.21.15.37:0/1195176385 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:09.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f580ffff700 1 --2- 172.21.15.37:0/1195176385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58101596d0 0x7f581015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:09.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f580effd700 1 --2- 172.21.15.37:0/1195176385 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58100c63d0 0x7f581016a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:09.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f580f7fe700 1 -- 172.21.15.37:0/1195176385 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58100c63d0 msgr2=0x7f581016a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:09.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f580f7fe700 1 --2- 172.21.15.37:0/1195176385 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58100c63d0 0x7f581016a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:09.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f580f7fe700 1 -- 172.21.15.37:0/1195176385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58101596d0 msgr2=0x7f581015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:09.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f580f7fe700 1 --2- 172.21.15.37:0/1195176385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58101596d0 0x7f581015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:09.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f580f7fe700 1 -- 172.21.15.37:0/1195176385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5804009420 con 0x7f581006ad60 2023-10-06T02:23:09.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f580ffff700 1 --2- 172.21.15.37:0/1195176385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58101596d0 0x7f581015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:09.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f580effd700 1 --2- 172.21.15.37:0/1195176385 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58100c63d0 0x7f581016a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:09.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f580f7fe700 1 --2- 172.21.15.37:0/1195176385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581006ad60 0x7f58101559a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f580000c7e0 tx=0x7f5800007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:09.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f57f77fe700 1 -- 172.21.15.37:0/1195176385 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800005b30 con 0x7f581006ad60 2023-10-06T02:23:09.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f57f77fe700 1 -- 172.21.15.37:0/1195176385 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5800005c90 con 0x7f581006ad60 2023-10-06T02:23:09.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f5816087700 1 -- 172.21.15.37:0/1195176385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581015bb00 con 0x7f581006ad60 2023-10-06T02:23:09.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f57f77fe700 1 -- 172.21.15.37:0/1195176385 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800007300 con 0x7f581006ad60 2023-10-06T02:23:09.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.990+0000 7f5816087700 1 -- 172.21.15.37:0/1195176385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581015be90 con 0x7f581006ad60 2023-10-06T02:23:09.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.991+0000 7f5816087700 1 -- 172.21.15.37:0/1195176385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5810068c30 con 0x7f581006ad60 2023-10-06T02:23:09.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.992+0000 7f57f77fe700 1 -- 172.21.15.37:0/1195176385 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f580001b400 con 0x7f581006ad60 2023-10-06T02:23:09.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.992+0000 7f57f77fe700 1 --2- 172.21.15.37:0/1195176385 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f57fc066ea0 0x7f57fc069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:09.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.992+0000 7f57f77fe700 1 -- 172.21.15.37:0/1195176385 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5800083d00 con 0x7f581006ad60 2023-10-06T02:23:09.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.992+0000 7f580effd700 1 --2- 172.21.15.37:0/1195176385 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f57fc066ea0 0x7f57fc069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:09.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.993+0000 7f580effd700 1 --2- 172.21.15.37:0/1195176385 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f57fc066ea0 0x7f57fc069350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f581015b820 tx=0x7f5804017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:09.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:09.996+0000 7f57f77fe700 1 -- 172.21.15.37:0/1195176385 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58000512c0 con 0x7f581006ad60 2023-10-06T02:23:10.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.198+0000 7f5816087700 1 -- 172.21.15.37:0/1195176385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f581004bb80 con 0x7f581006ad60 2023-10-06T02:23:10.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.199+0000 7f57f77fe700 1 -- 172.21.15.37:0/1195176385 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+13674 (secure 0 0 0) 0x7f58000548e0 con 0x7f581006ad60 2023-10-06T02:23:10.200 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:10.200 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":15,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:23:09.806533+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:10.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.201+0000 7f5816087700 1 -- 172.21.15.37:0/1195176385 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f57fc066ea0 msgr2=0x7f57fc069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:10.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.201+0000 7f5816087700 1 --2- 172.21.15.37:0/1195176385 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f57fc066ea0 0x7f57fc069350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f581015b820 tx=0x7f5804017000 comp rx=0 tx=0).stop 2023-10-06T02:23:10.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.201+0000 7f5816087700 1 -- 172.21.15.37:0/1195176385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581006ad60 msgr2=0x7f58101559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:10.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.201+0000 7f5816087700 1 --2- 172.21.15.37:0/1195176385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581006ad60 0x7f58101559a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f580000c7e0 tx=0x7f5800007df0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.201+0000 7f5816087700 1 -- 172.21.15.37:0/1195176385 shutdown_connections 2023-10-06T02:23:10.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.201+0000 7f5816087700 1 --2- 172.21.15.37:0/1195176385 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f57fc066ea0 0x7f57fc069350 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.201+0000 7f5816087700 1 --2- 172.21.15.37:0/1195176385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58101596d0 0x7f581015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.201+0000 7f5816087700 1 --2- 172.21.15.37:0/1195176385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581006ad60 0x7f58101559a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.201+0000 7f5816087700 1 --2- 172.21.15.37:0/1195176385 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58100c63d0 0x7f581016a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.201+0000 7f5816087700 1 -- 172.21.15.37:0/1195176385 >> 172.21.15.37:0/1195176385 conn(0x7f58100cd490 msgr2=0x7f58101566d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:10.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.201+0000 7f5816087700 1 -- 172.21.15.37:0/1195176385 shutdown_connections 2023-10-06T02:23:10.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.201+0000 7f5816087700 1 -- 172.21.15.37:0/1195176385 wait complete. 2023-10-06T02:23:10.215 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:23:08.066048+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:23:08.561964+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T02:23:10.215 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:23:10.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.339+0000 7f60fb309700 1 Processor -- start 2023-10-06T02:23:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.339+0000 7f60fb309700 1 -- start start 2023-10-06T02:23:10.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.340+0000 7f60fb309700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f60f41599e0 0x7f60f40b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:10.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.340+0000 7f60fb309700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60f40b3310 0x7f60f40b4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:10.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.340+0000 7f60fb309700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f40b43b0 con 0x7f60f4159610 2023-10-06T02:23:10.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.340+0000 7f60fb309700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f40cde50 con 0x7f60f41599e0 2023-10-06T02:23:10.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.340+0000 7f60fb309700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f40b1020 con 0x7f60f40b3310 2023-10-06T02:23:10.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.340+0000 7f60f98a6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60f40b3310 0x7f60f40b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.340+0000 7f60f98a6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60f40b3310 0x7f60f40b4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:54498/0 (socket says 172.21.15.37:54498) 2023-10-06T02:23:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.340+0000 7f60f98a6700 1 -- 172.21.15.37:0/657706472 learned_addr learned my addr 172.21.15.37:0/657706472 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.340+0000 7f60f88a4700 1 --2- 172.21.15.37:0/657706472 >> v2:172.21.15.191:3300/0 conn(0x7f60f41599e0 0x7f60f40b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.341+0000 7f60f98a6700 1 -- 172.21.15.37:0/657706472 >> v2:172.21.15.191:3300/0 conn(0x7f60f41599e0 msgr2=0x7f60f40b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.341+0000 7f60f98a6700 1 --2- 172.21.15.37:0/657706472 >> v2:172.21.15.191:3300/0 conn(0x7f60f41599e0 0x7f60f40b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.340+0000 7f60ebfff700 1 -- 172.21.15.37:0/657706472 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359824385 0 0) 0x7f60f40b43b0 con 0x7f60f4159610 2023-10-06T02:23:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.341+0000 7f60f98a6700 1 -- 172.21.15.37:0/657706472 >> v1:172.21.15.191:6789/0 conn(0x7f60f4159610 legacy=0x7f60f40d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.341+0000 7f60f98a6700 1 -- 172.21.15.37:0/657706472 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f40b37a0 con 0x7f60f40b3310 2023-10-06T02:23:10.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.341+0000 7f60f98a6700 1 --2- 172.21.15.37:0/657706472 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60f40b3310 0x7f60f40b4840 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009f20 tx=0x7f60ec009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=816299cb5b35a5f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:10.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.341+0000 7f60ebfff700 1 -- 172.21.15.37:0/657706472 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec00e070 con 0x7f60f40b3310 2023-10-06T02:23:10.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.341+0000 7f60ebfff700 1 -- 172.21.15.37:0/657706472 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec00b9d0 con 0x7f60f40b3310 2023-10-06T02:23:10.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.341+0000 7f60ebfff700 1 -- 172.21.15.37:0/657706472 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec0092e0 con 0x7f60f40b3310 2023-10-06T02:23:10.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.341+0000 7f60fb309700 1 -- 172.21.15.37:0/657706472 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60f40b3310 msgr2=0x7f60f40b4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:10.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.341+0000 7f60fb309700 1 --2- 172.21.15.37:0/657706472 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60f40b3310 0x7f60f40b4840 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009f20 tx=0x7f60ec009840 comp rx=0 tx=0).stop 2023-10-06T02:23:10.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.341+0000 7f60fb309700 1 -- 172.21.15.37:0/657706472 shutdown_connections 2023-10-06T02:23:10.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.341+0000 7f60fb309700 1 --2- 172.21.15.37:0/657706472 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60f40b3310 0x7f60f40b4840 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.341+0000 7f60fb309700 1 --2- 172.21.15.37:0/657706472 >> v2:172.21.15.191:3300/0 conn(0x7f60f41599e0 0x7f60f40b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.341+0000 7f60fb309700 1 -- 172.21.15.37:0/657706472 >> 172.21.15.37:0/657706472 conn(0x7f60f406c0b0 msgr2=0x7f60f406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.342+0000 7f60fb309700 1 -- 172.21.15.37:0/657706472 shutdown_connections 2023-10-06T02:23:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.342+0000 7f60fb309700 1 -- 172.21.15.37:0/657706472 wait complete. 2023-10-06T02:23:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.343+0000 7f60fb309700 1 Processor -- start 2023-10-06T02:23:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.343+0000 7f60fb309700 1 -- start start 2023-10-06T02:23:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.343+0000 7f60fb309700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f40b3310 0x7f60f4145150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.343+0000 7f60fb309700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60f4159610 0x7f60f415a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.343+0000 7f60fb309700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60f41599e0 0x7f60f40cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:10.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.344+0000 7f60fb309700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f415bae0 con 0x7f60f40b3310 2023-10-06T02:23:10.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.344+0000 7f60fb309700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f415aed0 con 0x7f60f41599e0 2023-10-06T02:23:10.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.344+0000 7f60fb309700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f415b1b0 con 0x7f60f4159610 2023-10-06T02:23:10.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.344+0000 7f60f90a5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f40b3310 0x7f60f4145150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:10.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.344+0000 7f60f90a5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f40b3310 0x7f60f4145150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60754/0 (socket says 172.21.15.37:60754) 2023-10-06T02:23:10.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.344+0000 7f60f90a5700 1 -- 172.21.15.37:0/1410473506 learned_addr learned my addr 172.21.15.37:0/1410473506 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:10.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.344+0000 7f60f88a4700 1 --2- 172.21.15.37:0/1410473506 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60f4159610 0x7f60f415a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:10.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.344+0000 7f60f98a6700 1 --2- 172.21.15.37:0/1410473506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60f41599e0 0x7f60f40cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:10.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.344+0000 7f60f90a5700 1 -- 172.21.15.37:0/1410473506 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60f4159610 msgr2=0x7f60f415a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:10.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.344+0000 7f60f90a5700 1 --2- 172.21.15.37:0/1410473506 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60f4159610 0x7f60f415a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.344+0000 7f60f90a5700 1 -- 172.21.15.37:0/1410473506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60f41599e0 msgr2=0x7f60f40cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:10.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.344+0000 7f60f90a5700 1 --2- 172.21.15.37:0/1410473506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60f41599e0 0x7f60f40cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.344+0000 7f60f90a5700 1 -- 172.21.15.37:0/1410473506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec009ae0 con 0x7f60f40b3310 2023-10-06T02:23:10.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.344+0000 7f60f90a5700 1 --2- 172.21.15.37:0/1410473506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f40b3310 0x7f60f4145150 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f60e400c7e0 tx=0x7f60e4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:10.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.344+0000 7f60e97fa700 1 -- 172.21.15.37:0/1410473506 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4011590 con 0x7f60f40b3310 2023-10-06T02:23:10.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.344+0000 7f60e97fa700 1 -- 172.21.15.37:0/1410473506 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e4011710 con 0x7f60f40b3310 2023-10-06T02:23:10.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.344+0000 7f60e97fa700 1 -- 172.21.15.37:0/1410473506 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4011ad0 con 0x7f60f40b3310 2023-10-06T02:23:10.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.344+0000 7f60fb309700 1 -- 172.21.15.37:0/1410473506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f415b490 con 0x7f60f40b3310 2023-10-06T02:23:10.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.344+0000 7f60fb309700 1 -- 172.21.15.37:0/1410473506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f40c8160 con 0x7f60f40b3310 2023-10-06T02:23:10.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.345+0000 7f60fb309700 1 -- 172.21.15.37:0/1410473506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f4088b30 con 0x7f60f40b3310 2023-10-06T02:23:10.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.346+0000 7f60e97fa700 1 -- 172.21.15.37:0/1410473506 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f60e401c460 con 0x7f60f40b3310 2023-10-06T02:23:10.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.346+0000 7f60e97fa700 1 --2- 172.21.15.37:0/1410473506 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f60d8066f20 0x7f60d80693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:10.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.347+0000 7f60e97fa700 1 -- 172.21.15.37:0/1410473506 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f60e4084a40 con 0x7f60f40b3310 2023-10-06T02:23:10.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.347+0000 7f60f88a4700 1 --2- 172.21.15.37:0/1410473506 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f60d8066f20 0x7f60d80693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:10.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.347+0000 7f60f88a4700 1 --2- 172.21.15.37:0/1410473506 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f60d8066f20 0x7f60d80693d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f60f40b61e0 tx=0x7f60f00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:10.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.350+0000 7f60e97fa700 1 -- 172.21.15.37:0/1410473506 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60e4051f60 con 0x7f60f40b3310 2023-10-06T02:23:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.548+0000 7f60fb309700 1 -- 172.21.15.37:0/1410473506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f60f40b3a80 con 0x7f60f40b3310 2023-10-06T02:23:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.548+0000 7f60e97fa700 1 -- 172.21.15.37:0/1410473506 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f60e4055580 con 0x7f60f40b3310 2023-10-06T02:23:10.549 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T02:23:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.550+0000 7f60fb309700 1 -- 172.21.15.37:0/1410473506 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f60d8066f20 msgr2=0x7f60d80693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.550+0000 7f60fb309700 1 --2- 172.21.15.37:0/1410473506 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f60d8066f20 0x7f60d80693d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f60f40b61e0 tx=0x7f60f00091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.550+0000 7f60fb309700 1 -- 172.21.15.37:0/1410473506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f40b3310 msgr2=0x7f60f4145150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.550+0000 7f60fb309700 1 --2- 172.21.15.37:0/1410473506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f40b3310 0x7f60f4145150 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f60e400c7e0 tx=0x7f60e4007df0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.551+0000 7f60fb309700 1 -- 172.21.15.37:0/1410473506 shutdown_connections 2023-10-06T02:23:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.551+0000 7f60fb309700 1 --2- 172.21.15.37:0/1410473506 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f60d8066f20 0x7f60d80693d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.551+0000 7f60fb309700 1 --2- 172.21.15.37:0/1410473506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60f41599e0 0x7f60f40cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.551+0000 7f60fb309700 1 --2- 172.21.15.37:0/1410473506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f40b3310 0x7f60f4145150 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.551+0000 7f60fb309700 1 --2- 172.21.15.37:0/1410473506 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60f4159610 0x7f60f415a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.551+0000 7f60fb309700 1 -- 172.21.15.37:0/1410473506 >> 172.21.15.37:0/1410473506 conn(0x7f60f406c0b0 msgr2=0x7f60f40ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.551+0000 7f60fb309700 1 -- 172.21.15.37:0/1410473506 shutdown_connections 2023-10-06T02:23:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.551+0000 7f60fb309700 1 -- 172.21.15.37:0/1410473506 wait complete. 2023-10-06T02:23:10.563 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:23:10.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.684+0000 7f6eba2bb700 1 Processor -- start 2023-10-06T02:23:10.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.684+0000 7f6eba2bb700 1 -- start start 2023-10-06T02:23:10.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.685+0000 7f6eba2bb700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6eb41593c0 0x7f6eb4159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:10.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.685+0000 7f6eba2bb700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb40b07a0 con 0x7f6eb40b2380 2023-10-06T02:23:10.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.685+0000 7f6eba2bb700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb40cd8a0 con 0x7f6eb40ccb30 2023-10-06T02:23:10.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.685+0000 7f6eba2bb700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb40cd6a0 con 0x7f6eb41593c0 2023-10-06T02:23:10.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.685+0000 7f6eb3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6eb41593c0 0x7f6eb4159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:10.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.685+0000 7f6eb37fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6eb40b2380 0x7f6eb40b2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35288/0 (socket says 172.21.15.37:35288) 2023-10-06T02:23:10.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.685+0000 7f6eb3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6eb41593c0 0x7f6eb4159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60770/0 (socket says 172.21.15.37:60770) 2023-10-06T02:23:10.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.685+0000 7f6eb37fe700 1 -- 172.21.15.37:0/3194177397 learned_addr learned my addr 172.21.15.37:0/3194177397 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:10.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.685+0000 7f6eb3fff700 1 -- 172.21.15.37:0/3194177397 >> v1:172.21.15.191:6789/0 conn(0x7f6eb40ccb30 legacy=0x7f6eb40ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:10.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.685+0000 7f6eb3fff700 1 -- 172.21.15.37:0/3194177397 >> v1:172.21.15.37:6789/0 conn(0x7f6eb40b2380 legacy=0x7f6eb40b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:10.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.686+0000 7f6eb3fff700 1 -- 172.21.15.37:0/3194177397 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb40afe70 con 0x7f6eb41593c0 2023-10-06T02:23:10.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.686+0000 7f6eb2ffd700 1 -- 172.21.15.37:0/3194177397 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104909639 0 0) 0x7f6eb40b07a0 con 0x7f6eb40b2380 2023-10-06T02:23:10.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.686+0000 7f6eb3fff700 1 --2- 172.21.15.37:0/3194177397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb41593c0 0x7f6eb4159790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40098e0 tx=0x7f6ea40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345f368e5c7169b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:10.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.686+0000 7f6eb2ffd700 1 -- 172.21.15.37:0/3194177397 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4009e80 con 0x7f6eb41593c0 2023-10-06T02:23:10.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.686+0000 7f6eb2ffd700 1 -- 172.21.15.37:0/3194177397 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea400b860 con 0x7f6eb41593c0 2023-10-06T02:23:10.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.686+0000 7f6eb2ffd700 1 -- 172.21.15.37:0/3194177397 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea400bbe0 con 0x7f6eb41593c0 2023-10-06T02:23:10.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.686+0000 7f6eba2bb700 1 -- 172.21.15.37:0/3194177397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb41593c0 msgr2=0x7f6eb4159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:10.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.686+0000 7f6eba2bb700 1 --2- 172.21.15.37:0/3194177397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb41593c0 0x7f6eb4159790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40098e0 tx=0x7f6ea40091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.686+0000 7f6eba2bb700 1 -- 172.21.15.37:0/3194177397 shutdown_connections 2023-10-06T02:23:10.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.686+0000 7f6eba2bb700 1 --2- 172.21.15.37:0/3194177397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb41593c0 0x7f6eb4159790 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.686+0000 7f6eba2bb700 1 -- 172.21.15.37:0/3194177397 >> 172.21.15.37:0/3194177397 conn(0x7f6eb406c0b0 msgr2=0x7f6eb406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:10.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.686+0000 7f6eba2bb700 1 -- 172.21.15.37:0/3194177397 shutdown_connections 2023-10-06T02:23:10.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.686+0000 7f6eba2bb700 1 -- 172.21.15.37:0/3194177397 wait complete. 2023-10-06T02:23:10.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.687+0000 7f6eba2bb700 1 Processor -- start 2023-10-06T02:23:10.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.688+0000 7f6eba2bb700 1 -- start start 2023-10-06T02:23:10.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.688+0000 7f6eba2bb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6eb40b2380 0x7f6eb40c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:10.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.688+0000 7f6eba2bb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb40ccb30 0x7f6eb415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:10.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.688+0000 7f6eba2bb700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6eb41593c0 0x7f6eb4159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:10.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.688+0000 7f6eba2bb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4169b60 con 0x7f6eb40ccb30 2023-10-06T02:23:10.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.688+0000 7f6eba2bb700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4169e40 con 0x7f6eb40b2380 2023-10-06T02:23:10.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.688+0000 7f6eba2bb700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb416a120 con 0x7f6eb41593c0 2023-10-06T02:23:10.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.688+0000 7f6eb37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb40ccb30 0x7f6eb415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:10.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.688+0000 7f6eb37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb40ccb30 0x7f6eb415acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60782/0 (socket says 172.21.15.37:60782) 2023-10-06T02:23:10.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.688+0000 7f6eb37fe700 1 -- 172.21.15.37:0/3596274110 learned_addr learned my addr 172.21.15.37:0/3596274110 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:10.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.688+0000 7f6eb3fff700 1 --2- 172.21.15.37:0/3596274110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6eb40b2380 0x7f6eb40c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:10.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.689+0000 7f6eb8858700 1 --2- 172.21.15.37:0/3596274110 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6eb41593c0 0x7f6eb4159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:10.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.689+0000 7f6eb37fe700 1 -- 172.21.15.37:0/3596274110 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6eb41593c0 msgr2=0x7f6eb4159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:10.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.689+0000 7f6eb37fe700 1 --2- 172.21.15.37:0/3596274110 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6eb41593c0 0x7f6eb4159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.689+0000 7f6eb37fe700 1 -- 172.21.15.37:0/3596274110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6eb40b2380 msgr2=0x7f6eb40c3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:10.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.689+0000 7f6eb37fe700 1 --2- 172.21.15.37:0/3596274110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6eb40b2380 0x7f6eb40c3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.689+0000 7f6eb37fe700 1 -- 172.21.15.37:0/3596274110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea4009420 con 0x7f6eb40ccb30 2023-10-06T02:23:10.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.689+0000 7f6eb37fe700 1 --2- 172.21.15.37:0/3596274110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb40ccb30 0x7f6eb415acd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800c810 tx=0x7f6ea8007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:10.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.689+0000 7f6e9bfff700 1 -- 172.21.15.37:0/3596274110 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8005c00 con 0x7f6eb40ccb30 2023-10-06T02:23:10.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.689+0000 7f6e9bfff700 1 -- 172.21.15.37:0/3596274110 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea8005d60 con 0x7f6eb40ccb30 2023-10-06T02:23:10.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.689+0000 7f6eba2bb700 1 -- 172.21.15.37:0/3596274110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb416a400 con 0x7f6eb40ccb30 2023-10-06T02:23:10.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.689+0000 7f6e9bfff700 1 -- 172.21.15.37:0/3596274110 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8007320 con 0x7f6eb40ccb30 2023-10-06T02:23:10.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.689+0000 7f6eba2bb700 1 -- 172.21.15.37:0/3596274110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb4169910 con 0x7f6eb40ccb30 2023-10-06T02:23:10.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.690+0000 7f6eba2bb700 1 -- 172.21.15.37:0/3596274110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb40c63c0 con 0x7f6eb40ccb30 2023-10-06T02:23:10.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.691+0000 7f6e9bfff700 1 -- 172.21.15.37:0/3596274110 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f6ea801b3b0 con 0x7f6eb40ccb30 2023-10-06T02:23:10.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.691+0000 7f6e9bfff700 1 --2- 172.21.15.37:0/3596274110 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ea0066ea0 0x7f6ea0069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:10.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.691+0000 7f6e9bfff700 1 -- 172.21.15.37:0/3596274110 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6ea8083680 con 0x7f6eb40ccb30 2023-10-06T02:23:10.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.691+0000 7f6eb3fff700 1 --2- 172.21.15.37:0/3596274110 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ea0066ea0 0x7f6ea0069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:10.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.691+0000 7f6eb3fff700 1 --2- 172.21.15.37:0/3596274110 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ea0066ea0 0x7f6ea0069350 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40093f0 tx=0x7f6ea4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:10.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.695+0000 7f6e9bfff700 1 -- 172.21.15.37:0/3596274110 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6eb40c63c0 con 0x7f6eb40ccb30 2023-10-06T02:23:10.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.891+0000 7f6eba2bb700 1 -- 172.21.15.37:0/3596274110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6eb40c63c0 con 0x7f6eb40ccb30 2023-10-06T02:23:10.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.891+0000 7f6e9bfff700 1 -- 172.21.15.37:0/3596274110 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6eb40c63c0 con 0x7f6eb40ccb30 2023-10-06T02:23:10.891 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T02:23:10.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.893+0000 7f6eba2bb700 1 -- 172.21.15.37:0/3596274110 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ea0066ea0 msgr2=0x7f6ea0069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:10.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.893+0000 7f6eba2bb700 1 --2- 172.21.15.37:0/3596274110 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ea0066ea0 0x7f6ea0069350 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40093f0 tx=0x7f6ea4017000 comp rx=0 tx=0).stop 2023-10-06T02:23:10.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.893+0000 7f6eba2bb700 1 -- 172.21.15.37:0/3596274110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb40ccb30 msgr2=0x7f6eb415acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:10.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.893+0000 7f6eba2bb700 1 --2- 172.21.15.37:0/3596274110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb40ccb30 0x7f6eb415acd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800c810 tx=0x7f6ea8007d90 comp rx=0 tx=0).stop 2023-10-06T02:23:10.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.893+0000 7f6eba2bb700 1 -- 172.21.15.37:0/3596274110 shutdown_connections 2023-10-06T02:23:10.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.893+0000 7f6eba2bb700 1 --2- 172.21.15.37:0/3596274110 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6eb41593c0 0x7f6eb4159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.893+0000 7f6eba2bb700 1 --2- 172.21.15.37:0/3596274110 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ea0066ea0 0x7f6ea0069350 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.893+0000 7f6eba2bb700 1 --2- 172.21.15.37:0/3596274110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6eb40b2380 0x7f6eb40c3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.893+0000 7f6eba2bb700 1 --2- 172.21.15.37:0/3596274110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb40ccb30 0x7f6eb415acd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:10.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.893+0000 7f6eba2bb700 1 -- 172.21.15.37:0/3596274110 >> 172.21.15.37:0/3596274110 conn(0x7f6eb406c0b0 msgr2=0x7f6eb406c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:10.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.894+0000 7f6eba2bb700 1 -- 172.21.15.37:0/3596274110 shutdown_connections 2023-10-06T02:23:10.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:10.894+0000 7f6eba2bb700 1 -- 172.21.15.37:0/3596274110 wait complete. 2023-10-06T02:23:10.906 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:23:11.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.025+0000 7fe6169ea700 1 Processor -- start 2023-10-06T02:23:11.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.025+0000 7fe6169ea700 1 -- start start 2023-10-06T02:23:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.026+0000 7fe6169ea700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe6100b3fb0 0x7fe610067a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.026+0000 7fe6169ea700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe61015be40 0x7fe610067f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.026+0000 7fe6169ea700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe610158db0 con 0x7fe6100b3be0 2023-10-06T02:23:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.026+0000 7fe6169ea700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6101582f0 con 0x7fe6100b3fb0 2023-10-06T02:23:11.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.026+0000 7fe6169ea700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100cc2f0 con 0x7fe61015be40 2023-10-06T02:23:11.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.026+0000 7fe60ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe6100b3be0 0x7fe610157be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35300/0 (socket says 172.21.15.37:35300) 2023-10-06T02:23:11.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.026+0000 7fe60ffff700 1 -- 172.21.15.37:0/709461832 learned_addr learned my addr 172.21.15.37:0/709461832 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:11.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.027+0000 7fe614f87700 1 --2- 172.21.15.37:0/709461832 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe61015be40 0x7fe610067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:11.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.027+0000 7fe60f7fe700 1 --2- 172.21.15.37:0/709461832 >> v2:172.21.15.191:3300/0 conn(0x7fe6100b3fb0 0x7fe610067a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:11.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.027+0000 7fe60effd700 1 -- 172.21.15.37:0/709461832 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517257516 0 0) 0x7fe610158db0 con 0x7fe6100b3be0 2023-10-06T02:23:11.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.027+0000 7fe60effd700 1 -- 172.21.15.37:0/709461832 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5fc003570 con 0x7fe6100b3be0 2023-10-06T02:23:11.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.027+0000 7fe60effd700 1 -- 172.21.15.37:0/709461832 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1147901302 0 0) 0x7fe5fc003570 con 0x7fe6100b3be0 2023-10-06T02:23:11.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.027+0000 7fe614f87700 1 -- 172.21.15.37:0/709461832 >> v2:172.21.15.191:3300/0 conn(0x7fe6100b3fb0 msgr2=0x7fe610067a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:11.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.027+0000 7fe614f87700 1 --2- 172.21.15.37:0/709461832 >> v2:172.21.15.191:3300/0 conn(0x7fe6100b3fb0 0x7fe610067a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.027+0000 7fe614f87700 1 -- 172.21.15.37:0/709461832 >> v1:172.21.15.37:6789/0 conn(0x7fe6100b3be0 legacy=0x7fe610157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.027+0000 7fe614f87700 1 -- 172.21.15.37:0/709461832 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6100cd790 con 0x7fe61015be40 2023-10-06T02:23:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.027+0000 7fe60f7fe700 1 --2- 172.21.15.37:0/709461832 >> v2:172.21.15.191:3300/0 conn(0x7fe6100b3fb0 0x7fe610067a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.027+0000 7fe614f87700 1 --2- 172.21.15.37:0/709461832 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe61015be40 0x7fe610067f70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe608009e60 tx=0x7fe608009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab636745e897693a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.027+0000 7fe60effd700 1 -- 172.21.15.37:0/709461832 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60800e070 con 0x7fe61015be40 2023-10-06T02:23:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.027+0000 7fe60effd700 1 -- 172.21.15.37:0/709461832 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60800b7a0 con 0x7fe61015be40 2023-10-06T02:23:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.027+0000 7fe60effd700 1 -- 172.21.15.37:0/709461832 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6000015f0 con 0x7fe61015be40 2023-10-06T02:23:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.028+0000 7fe6169ea700 1 -- 172.21.15.37:0/709461832 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe61015be40 msgr2=0x7fe610067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.028+0000 7fe6169ea700 1 --2- 172.21.15.37:0/709461832 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe61015be40 0x7fe610067f70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe608009e60 tx=0x7fe608009780 comp rx=0 tx=0).stop 2023-10-06T02:23:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.028+0000 7fe6169ea700 1 -- 172.21.15.37:0/709461832 shutdown_connections 2023-10-06T02:23:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.028+0000 7fe6169ea700 1 --2- 172.21.15.37:0/709461832 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe61015be40 0x7fe610067f70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.028+0000 7fe6169ea700 1 --2- 172.21.15.37:0/709461832 >> v2:172.21.15.191:3300/0 conn(0x7fe6100b3fb0 0x7fe610067a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.028+0000 7fe6169ea700 1 -- 172.21.15.37:0/709461832 >> 172.21.15.37:0/709461832 conn(0x7fe6100ce330 msgr2=0x7fe6100ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.028+0000 7fe6169ea700 1 -- 172.21.15.37:0/709461832 shutdown_connections 2023-10-06T02:23:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.028+0000 7fe6169ea700 1 -- 172.21.15.37:0/709461832 wait complete. 2023-10-06T02:23:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.029+0000 7fe6169ea700 1 Processor -- start 2023-10-06T02:23:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.029+0000 7fe6169ea700 1 -- start start 2023-10-06T02:23:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.030+0000 7fe6169ea700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6100b3be0 0x7fe6100c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.030+0000 7fe6169ea700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6100b3fb0 0x7fe610147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.030+0000 7fe6169ea700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe61015be40 0x7fe6100c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.030+0000 7fe6169ea700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100c5da0 con 0x7fe6100b3fb0 2023-10-06T02:23:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.030+0000 7fe6169ea700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100c40c0 con 0x7fe61015be40 2023-10-06T02:23:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.030+0000 7fe6169ea700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100c43a0 con 0x7fe6100b3be0 2023-10-06T02:23:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.030+0000 7fe60f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6100b3fb0 0x7fe610147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.030+0000 7fe60f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6100b3fb0 0x7fe610147120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60784/0 (socket says 172.21.15.37:60784) 2023-10-06T02:23:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.030+0000 7fe60f7fe700 1 -- 172.21.15.37:0/1772264991 learned_addr learned my addr 172.21.15.37:0/1772264991 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.030+0000 7fe614f87700 1 --2- 172.21.15.37:0/1772264991 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe61015be40 0x7fe6100c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.030+0000 7fe60ffff700 1 --2- 172.21.15.37:0/1772264991 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6100b3be0 0x7fe6100c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.030+0000 7fe60f7fe700 1 -- 172.21.15.37:0/1772264991 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6100b3be0 msgr2=0x7fe6100c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.030+0000 7fe60f7fe700 1 --2- 172.21.15.37:0/1772264991 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6100b3be0 0x7fe6100c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.030+0000 7fe60f7fe700 1 -- 172.21.15.37:0/1772264991 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe61015be40 msgr2=0x7fe6100c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:11.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.030+0000 7fe60f7fe700 1 --2- 172.21.15.37:0/1772264991 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe61015be40 0x7fe6100c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.030+0000 7fe60f7fe700 1 -- 172.21.15.37:0/1772264991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f8009420 con 0x7fe6100b3fb0 2023-10-06T02:23:11.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.030+0000 7fe60f7fe700 1 --2- 172.21.15.37:0/1772264991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6100b3fb0 0x7fe610147120 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800ec80 tx=0x7fe5f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:11.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.031+0000 7fe607fff700 1 -- 172.21.15.37:0/1772264991 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800c850 con 0x7fe6100b3fb0 2023-10-06T02:23:11.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.031+0000 7fe607fff700 1 -- 172.21.15.37:0/1772264991 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f800c9b0 con 0x7fe6100b3fb0 2023-10-06T02:23:11.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.031+0000 7fe6169ea700 1 -- 172.21.15.37:0/1772264991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe608009a20 con 0x7fe6100b3fb0 2023-10-06T02:23:11.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.031+0000 7fe607fff700 1 -- 172.21.15.37:0/1772264991 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800cd50 con 0x7fe6100b3fb0 2023-10-06T02:23:11.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.031+0000 7fe6169ea700 1 -- 172.21.15.37:0/1772264991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6100c4960 con 0x7fe6100b3fb0 2023-10-06T02:23:11.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.031+0000 7fe6169ea700 1 -- 172.21.15.37:0/1772264991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6100cde60 con 0x7fe6100b3fb0 2023-10-06T02:23:11.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.032+0000 7fe607fff700 1 -- 172.21.15.37:0/1772264991 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fe5f8013680 con 0x7fe6100b3fb0 2023-10-06T02:23:11.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.032+0000 7fe607fff700 1 --2- 172.21.15.37:0/1772264991 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe5f0066ea0 0x7fe5f0069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:11.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.033+0000 7fe607fff700 1 -- 172.21.15.37:0/1772264991 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe5f80845d0 con 0x7fe6100b3fb0 2023-10-06T02:23:11.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.033+0000 7fe60ffff700 1 --2- 172.21.15.37:0/1772264991 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe5f0066ea0 0x7fe5f0069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:11.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.033+0000 7fe60ffff700 1 --2- 172.21.15.37:0/1772264991 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe5f0066ea0 0x7fe5f0069350 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe600000ef0 tx=0x7fe600002ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:11.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.037+0000 7fe607fff700 1 -- 172.21.15.37:0/1772264991 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5f8051b10 con 0x7fe6100b3fb0 2023-10-06T02:23:11.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.273+0000 7fe6169ea700 1 -- 172.21.15.37:0/1772264991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6100681a0 con 0x7fe6100b3fb0 2023-10-06T02:23:11.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.273+0000 7fe607fff700 1 -- 172.21.15.37:0/1772264991 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7fe5f8017de0 con 0x7fe6100b3fb0 2023-10-06T02:23:11.274 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:11.274 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/651376696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":651376696},{"type":"v1","addr":"172.21.15.191:6837","nonce":651376696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1345849362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1345849362},{"type":"v1","addr":"172.21.15.37:6834","nonce":1345849362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/434738958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":434738958},{"type":"v1","addr":"172.21.15.37:6835","nonce":434738958}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1723334905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1723334905},{"type":"v1","addr":"172.21.15.191:6835","nonce":1723334905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-06T02:23:11.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.275+0000 7fe6169ea700 1 -- 172.21.15.37:0/1772264991 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe5f0066ea0 msgr2=0x7fe5f0069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:11.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.275+0000 7fe6169ea700 1 --2- 172.21.15.37:0/1772264991 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe5f0066ea0 0x7fe5f0069350 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe600000ef0 tx=0x7fe600002ea0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.275+0000 7fe6169ea700 1 -- 172.21.15.37:0/1772264991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6100b3fb0 msgr2=0x7fe610147120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:11.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.275+0000 7fe6169ea700 1 --2- 172.21.15.37:0/1772264991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6100b3fb0 0x7fe610147120 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800ec80 tx=0x7fe5f80091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.275+0000 7fe6169ea700 1 -- 172.21.15.37:0/1772264991 shutdown_connections 2023-10-06T02:23:11.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.275+0000 7fe6169ea700 1 --2- 172.21.15.37:0/1772264991 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe5f0066ea0 0x7fe5f0069350 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.275+0000 7fe6169ea700 1 --2- 172.21.15.37:0/1772264991 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe61015be40 0x7fe6100c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.275+0000 7fe6169ea700 1 --2- 172.21.15.37:0/1772264991 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6100b3be0 0x7fe6100c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.275+0000 7fe6169ea700 1 --2- 172.21.15.37:0/1772264991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6100b3fb0 0x7fe610147120 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.275+0000 7fe6169ea700 1 -- 172.21.15.37:0/1772264991 >> 172.21.15.37:0/1772264991 conn(0x7fe6100ce330 msgr2=0x7fe6100aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:11.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.275+0000 7fe6169ea700 1 -- 172.21.15.37:0/1772264991 shutdown_connections 2023-10-06T02:23:11.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.275+0000 7fe6169ea700 1 -- 172.21.15.37:0/1772264991 wait complete. 2023-10-06T02:23:11.278 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 3 2023-10-06T02:23:11.288 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.407+0000 7f67c8c26700 1 Processor -- start 2023-10-06T02:23:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.407+0000 7f67c8c26700 1 -- start start 2023-10-06T02:23:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.408+0000 7f67c8c26700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f67c4159370 0x7f67c4159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.408+0000 7f67c8c26700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67c40b2270 0x7f67c415db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.408+0000 7f67c8c26700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c40cb200 con 0x7f67c40aff10 2023-10-06T02:23:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.408+0000 7f67c8c26700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c40b5c00 con 0x7f67c4159370 2023-10-06T02:23:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.408+0000 7f67c8c26700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c40cb7c0 con 0x7f67c40b2270 2023-10-06T02:23:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.408+0000 7f67c37fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f67c4159370 0x7f67c4159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.408+0000 7f67c3fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f67c40aff10 0x7f67c406d640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35316/0 (socket says 172.21.15.37:35316) 2023-10-06T02:23:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.408+0000 7f67c3fff700 1 -- 172.21.15.37:0/1286319713 learned_addr learned my addr 172.21.15.37:0/1286319713 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.408+0000 7f67c2ffd700 1 --2- 172.21.15.37:0/1286319713 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67c40b2270 0x7f67c415db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.408+0000 7f67c37fe700 1 -- 172.21.15.37:0/1286319713 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67c40b2270 msgr2=0x7f67c415db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.408+0000 7f67c37fe700 1 --2- 172.21.15.37:0/1286319713 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67c40b2270 0x7f67c415db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.408+0000 7f67c37fe700 1 -- 172.21.15.37:0/1286319713 >> v1:172.21.15.37:6789/0 conn(0x7f67c40aff10 legacy=0x7f67c406d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.408+0000 7f67c37fe700 1 -- 172.21.15.37:0/1286319713 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c415e0d0 con 0x7f67c4159370 2023-10-06T02:23:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.408+0000 7f67c27fc700 1 -- 172.21.15.37:0/1286319713 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 580462580 0 0) 0x7f67c40cb200 con 0x7f67c40aff10 2023-10-06T02:23:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.409+0000 7f67c37fe700 1 --2- 172.21.15.37:0/1286319713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67c4159370 0x7f67c4159740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f67b40098e0 tx=0x7f67b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35c60fb7e576ff5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.409+0000 7f67c27fc700 1 -- 172.21.15.37:0/1286319713 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b4009e80 con 0x7f67c4159370 2023-10-06T02:23:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.409+0000 7f67c27fc700 1 -- 172.21.15.37:0/1286319713 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b400b860 con 0x7f67c4159370 2023-10-06T02:23:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.409+0000 7f67c27fc700 1 -- 172.21.15.37:0/1286319713 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b400bbe0 con 0x7f67c4159370 2023-10-06T02:23:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.409+0000 7f67c8c26700 1 -- 172.21.15.37:0/1286319713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67c4159370 msgr2=0x7f67c4159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.409+0000 7f67c8c26700 1 --2- 172.21.15.37:0/1286319713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67c4159370 0x7f67c4159740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f67b40098e0 tx=0x7f67b40091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.409+0000 7f67c8c26700 1 -- 172.21.15.37:0/1286319713 shutdown_connections 2023-10-06T02:23:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.409+0000 7f67c8c26700 1 --2- 172.21.15.37:0/1286319713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67c4159370 0x7f67c4159740 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.409+0000 7f67c8c26700 1 --2- 172.21.15.37:0/1286319713 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67c40b2270 0x7f67c415db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.409+0000 7f67c8c26700 1 -- 172.21.15.37:0/1286319713 >> 172.21.15.37:0/1286319713 conn(0x7f67c406c0b0 msgr2=0x7f67c406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.409+0000 7f67c8c26700 1 -- 172.21.15.37:0/1286319713 shutdown_connections 2023-10-06T02:23:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.409+0000 7f67c8c26700 1 -- 172.21.15.37:0/1286319713 wait complete. 2023-10-06T02:23:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.410+0000 7f67c8c26700 1 Processor -- start 2023-10-06T02:23:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.411+0000 7f67c8c26700 1 -- start start 2023-10-06T02:23:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.411+0000 7f67c8c26700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67c40aff10 0x7f67c41553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.411+0000 7f67c8c26700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67c40b2270 0x7f67c40c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.411+0000 7f67c8c26700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67c4159370 0x7f67c40c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.411+0000 7f67c8c26700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c416a630 con 0x7f67c40b2270 2023-10-06T02:23:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.411+0000 7f67c8c26700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c4169a20 con 0x7f67c4159370 2023-10-06T02:23:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.411+0000 7f67c8c26700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c4169d00 con 0x7f67c40aff10 2023-10-06T02:23:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.411+0000 7f67c2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67c40b2270 0x7f67c40c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.411+0000 7f67c2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67c40b2270 0x7f67c40c5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60804/0 (socket says 172.21.15.37:60804) 2023-10-06T02:23:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.411+0000 7f67c2ffd700 1 -- 172.21.15.37:0/3550983921 learned_addr learned my addr 172.21.15.37:0/3550983921 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.411+0000 7f67c37fe700 1 --2- 172.21.15.37:0/3550983921 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67c40aff10 0x7f67c41553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.411+0000 7f67c3fff700 1 --2- 172.21.15.37:0/3550983921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67c4159370 0x7f67c40c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.412+0000 7f67c2ffd700 1 -- 172.21.15.37:0/3550983921 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67c40aff10 msgr2=0x7f67c41553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.412+0000 7f67c2ffd700 1 --2- 172.21.15.37:0/3550983921 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67c40aff10 0x7f67c41553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.412+0000 7f67c2ffd700 1 -- 172.21.15.37:0/3550983921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67c4159370 msgr2=0x7f67c40c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.412+0000 7f67c2ffd700 1 --2- 172.21.15.37:0/3550983921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67c4159370 0x7f67c40c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.412+0000 7f67c2ffd700 1 -- 172.21.15.37:0/3550983921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b4009420 con 0x7f67c40b2270 2023-10-06T02:23:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.412+0000 7f67c3fff700 1 --2- 172.21.15.37:0/3550983921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67c4159370 0x7f67c40c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.412+0000 7f67c2ffd700 1 --2- 172.21.15.37:0/3550983921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67c40b2270 0x7f67c40c5fb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f67b800d860 tx=0x7f67b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.412+0000 7f67ab7fe700 1 -- 172.21.15.37:0/3550983921 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b80125f0 con 0x7f67c40b2270 2023-10-06T02:23:11.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.412+0000 7f67ab7fe700 1 -- 172.21.15.37:0/3550983921 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b8012750 con 0x7f67c40b2270 2023-10-06T02:23:11.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.412+0000 7f67ab7fe700 1 -- 172.21.15.37:0/3550983921 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b8012af0 con 0x7f67c40b2270 2023-10-06T02:23:11.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.412+0000 7f67c8c26700 1 -- 172.21.15.37:0/3550983921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c4169fe0 con 0x7f67c40b2270 2023-10-06T02:23:11.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.412+0000 7f67c8c26700 1 -- 172.21.15.37:0/3550983921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c40c47d0 con 0x7f67c40b2270 2023-10-06T02:23:11.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.413+0000 7f67c8c26700 1 -- 172.21.15.37:0/3550983921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c416a7a0 con 0x7f67c40b2270 2023-10-06T02:23:11.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.413+0000 7f67ab7fe700 1 -- 172.21.15.37:0/3550983921 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f67b801e460 con 0x7f67c40b2270 2023-10-06T02:23:11.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.414+0000 7f67ab7fe700 1 --2- 172.21.15.37:0/3550983921 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f67b0066ea0 0x7f67b0069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:11.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.414+0000 7f67ab7fe700 1 -- 172.21.15.37:0/3550983921 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f67b8084790 con 0x7f67c40b2270 2023-10-06T02:23:11.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.414+0000 7f67c37fe700 1 --2- 172.21.15.37:0/3550983921 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f67b0066ea0 0x7f67b0069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:11.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.414+0000 7f67c37fe700 1 --2- 172.21.15.37:0/3550983921 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f67b0066ea0 0x7f67b0069350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f67b40091e0 tx=0x7f67b4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:11.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.418+0000 7f67ab7fe700 1 -- 172.21.15.37:0/3550983921 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67b8051cd0 con 0x7f67c40b2270 2023-10-06T02:23:11.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.489+0000 7f67ab7fe700 1 -- 172.21.15.37:0/3550983921 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f67b80520a0 con 0x7f67c40b2270 2023-10-06T02:23:11.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.613+0000 7f67c8c26700 1 -- 172.21.15.37:0/3550983921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67c4064b00 con 0x7f67c40b2270 2023-10-06T02:23:11.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.613+0000 7f67ab7fe700 1 -- 172.21.15.37:0/3550983921 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13648 (secure 0 0 0) 0x7f67b8055760 con 0x7f67c40b2270 2023-10-06T02:23:11.614 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:11.614 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:23:10.814610+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.615+0000 7f67c8c26700 1 -- 172.21.15.37:0/3550983921 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f67b0066ea0 msgr2=0x7f67b0069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.615+0000 7f67c8c26700 1 --2- 172.21.15.37:0/3550983921 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f67b0066ea0 0x7f67b0069350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f67b40091e0 tx=0x7f67b4017000 comp rx=0 tx=0).stop 2023-10-06T02:23:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.615+0000 7f67c8c26700 1 -- 172.21.15.37:0/3550983921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67c40b2270 msgr2=0x7f67c40c5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.615+0000 7f67c8c26700 1 --2- 172.21.15.37:0/3550983921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67c40b2270 0x7f67c40c5fb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f67b800d860 tx=0x7f67b8008040 comp rx=0 tx=0).stop 2023-10-06T02:23:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.616+0000 7f67c8c26700 1 -- 172.21.15.37:0/3550983921 shutdown_connections 2023-10-06T02:23:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.616+0000 7f67c8c26700 1 --2- 172.21.15.37:0/3550983921 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f67b0066ea0 0x7f67b0069350 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.616+0000 7f67c8c26700 1 --2- 172.21.15.37:0/3550983921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67c4159370 0x7f67c40c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.616+0000 7f67c8c26700 1 --2- 172.21.15.37:0/3550983921 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67c40aff10 0x7f67c41553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.616+0000 7f67c8c26700 1 --2- 172.21.15.37:0/3550983921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67c40b2270 0x7f67c40c5fb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.616+0000 7f67c8c26700 1 -- 172.21.15.37:0/3550983921 >> 172.21.15.37:0/3550983921 conn(0x7f67c406c0b0 msgr2=0x7f67c40ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.616+0000 7f67c8c26700 1 -- 172.21.15.37:0/3550983921 shutdown_connections 2023-10-06T02:23:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.616+0000 7f67c8c26700 1 -- 172.21.15.37:0/3550983921 wait complete. 2023-10-06T02:23:11.628 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:23:08.066048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:23:08.561964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T02:23:11.628 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:23:11.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.749+0000 7f13b84ff700 1 Processor -- start 2023-10-06T02:23:11.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.749+0000 7f13b84ff700 1 -- start start 2023-10-06T02:23:11.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.750+0000 7f13b84ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13b01593c0 0x7f13b0159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:11.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.750+0000 7f13b84ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13b00ccb30 0x7f13b00ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:11.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.750+0000 7f13b84ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b00b07a0 con 0x7f13b00b2380 2023-10-06T02:23:11.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.750+0000 7f13b84ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b00cd8a0 con 0x7f13b01593c0 2023-10-06T02:23:11.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.750+0000 7f13b84ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00afe70 con 0x7f13b00ccb30 2023-10-06T02:23:11.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.750+0000 7f13b629b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13b01593c0 0x7f13b0159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:11.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.750+0000 7f13b629b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13b01593c0 0x7f13b0159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60814/0 (socket says 172.21.15.37:60814) 2023-10-06T02:23:11.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.750+0000 7f13b629b700 1 -- 172.21.15.37:0/3000053691 learned_addr learned my addr 172.21.15.37:0/3000053691 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:11.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.750+0000 7f13b6a9c700 1 --2- 172.21.15.37:0/3000053691 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13b00ccb30 0x7f13b00ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:11.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.750+0000 7f13b629b700 1 -- 172.21.15.37:0/3000053691 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13b00ccb30 msgr2=0x7f13b00ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:11.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.751+0000 7f13b629b700 1 --2- 172.21.15.37:0/3000053691 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13b00ccb30 0x7f13b00ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.751+0000 7f13b629b700 1 -- 172.21.15.37:0/3000053691 >> v1:172.21.15.191:6789/0 conn(0x7f13b00b2380 legacy=0x7f13b00b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:11.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.751+0000 7f13b629b700 1 -- 172.21.15.37:0/3000053691 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b00b0150 con 0x7f13b01593c0 2023-10-06T02:23:11.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.751+0000 7f13b629b700 1 --2- 172.21.15.37:0/3000053691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b01593c0 0x7f13b0159790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f13a80099b0 tx=0x7f13a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf8bbe51e0f8ed8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:11.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.751+0000 7f13b5299700 1 -- 172.21.15.37:0/3000053691 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a800b860 con 0x7f13b01593c0 2023-10-06T02:23:11.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.751+0000 7f13b5299700 1 -- 172.21.15.37:0/3000053691 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a800b9c0 con 0x7f13b01593c0 2023-10-06T02:23:11.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.751+0000 7f13b5299700 1 -- 172.21.15.37:0/3000053691 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a800bd60 con 0x7f13b01593c0 2023-10-06T02:23:11.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.751+0000 7f13b84ff700 1 -- 172.21.15.37:0/3000053691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b01593c0 msgr2=0x7f13b0159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:11.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.751+0000 7f13b84ff700 1 --2- 172.21.15.37:0/3000053691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b01593c0 0x7f13b0159790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f13a80099b0 tx=0x7f13a8009250 comp rx=0 tx=0).stop 2023-10-06T02:23:11.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.751+0000 7f13b84ff700 1 -- 172.21.15.37:0/3000053691 shutdown_connections 2023-10-06T02:23:11.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.751+0000 7f13b84ff700 1 --2- 172.21.15.37:0/3000053691 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13b00ccb30 0x7f13b00ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.751+0000 7f13b84ff700 1 --2- 172.21.15.37:0/3000053691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b01593c0 0x7f13b0159790 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.751+0000 7f13b84ff700 1 -- 172.21.15.37:0/3000053691 >> 172.21.15.37:0/3000053691 conn(0x7f13b006c0b0 msgr2=0x7f13b006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:11.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.751+0000 7f13b84ff700 1 -- 172.21.15.37:0/3000053691 shutdown_connections 2023-10-06T02:23:11.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.751+0000 7f13b84ff700 1 -- 172.21.15.37:0/3000053691 wait complete. 2023-10-06T02:23:11.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.752+0000 7f13b84ff700 1 Processor -- start 2023-10-06T02:23:11.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.753+0000 7f13b84ff700 1 -- start start 2023-10-06T02:23:11.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.753+0000 7f13b84ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b00b2380 0x7f13b00c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:11.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.753+0000 7f13b84ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13b00ccb30 0x7f13b0154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:11.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.753+0000 7f13b84ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13b01593c0 0x7f13b00c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.753+0000 7f13b84ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00c8ce0 con 0x7f13b00b2380 2023-10-06T02:23:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.753+0000 7f13b84ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00b4410 con 0x7f13b01593c0 2023-10-06T02:23:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.753+0000 7f13b84ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00b46f0 con 0x7f13b00ccb30 2023-10-06T02:23:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.753+0000 7f13b629b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b00b2380 0x7f13b00c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.753+0000 7f13b629b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b00b2380 0x7f13b00c8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60822/0 (socket says 172.21.15.37:60822) 2023-10-06T02:23:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.753+0000 7f13b629b700 1 -- 172.21.15.37:0/1956749755 learned_addr learned my addr 172.21.15.37:0/1956749755 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.753+0000 7f13b6a9c700 1 --2- 172.21.15.37:0/1956749755 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13b01593c0 0x7f13b00c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.753+0000 7f13b5a9a700 1 --2- 172.21.15.37:0/1956749755 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13b00ccb30 0x7f13b0154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.754+0000 7f13b629b700 1 -- 172.21.15.37:0/1956749755 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13b00ccb30 msgr2=0x7f13b0154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.754+0000 7f13b629b700 1 --2- 172.21.15.37:0/1956749755 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13b00ccb30 0x7f13b0154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.754+0000 7f13b629b700 1 -- 172.21.15.37:0/1956749755 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13b01593c0 msgr2=0x7f13b00c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:11.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.754+0000 7f13b629b700 1 --2- 172.21.15.37:0/1956749755 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13b01593c0 0x7f13b00c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.754+0000 7f13b629b700 1 -- 172.21.15.37:0/1956749755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a80094f0 con 0x7f13b00b2380 2023-10-06T02:23:11.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.754+0000 7f13b629b700 1 --2- 172.21.15.37:0/1956749755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b00b2380 0x7f13b00c8420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f13b00894a0 tx=0x7f13a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:11.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.754+0000 7f13ae7fc700 1 -- 172.21.15.37:0/1956749755 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a8011e40 con 0x7f13b00b2380 2023-10-06T02:23:11.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.754+0000 7f13ae7fc700 1 -- 172.21.15.37:0/1956749755 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a801a420 con 0x7f13b00b2380 2023-10-06T02:23:11.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.754+0000 7f13b84ff700 1 -- 172.21.15.37:0/1956749755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b00b49d0 con 0x7f13b00b2380 2023-10-06T02:23:11.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.754+0000 7f13ae7fc700 1 -- 172.21.15.37:0/1956749755 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a801a7e0 con 0x7f13b00b2380 2023-10-06T02:23:11.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.754+0000 7f13b84ff700 1 -- 172.21.15.37:0/1956749755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b00c8960 con 0x7f13b00b2380 2023-10-06T02:23:11.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.755+0000 7f13b84ff700 1 -- 172.21.15.37:0/1956749755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b0088bb0 con 0x7f13b00b2380 2023-10-06T02:23:11.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.755+0000 7f13ae7fc700 1 -- 172.21.15.37:0/1956749755 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13a801ab50 con 0x7f13b00b2380 2023-10-06T02:23:11.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.756+0000 7f13ae7fc700 1 --2- 172.21.15.37:0/1956749755 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f139c066f30 0x7f139c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:11.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.756+0000 7f13ae7fc700 1 -- 172.21.15.37:0/1956749755 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f13a8085c40 con 0x7f13b00b2380 2023-10-06T02:23:11.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.756+0000 7f13b5a9a700 1 --2- 172.21.15.37:0/1956749755 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f139c066f30 0x7f139c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:11.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.756+0000 7f13b5a9a700 1 --2- 172.21.15.37:0/1956749755 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f139c066f30 0x7f139c0693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f13b00ca5d0 tx=0x7f13a4007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:11.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.760+0000 7f13ae7fc700 1 -- 172.21.15.37:0/1956749755 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13a80530a0 con 0x7f13b00b2380 2023-10-06T02:23:11.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.952+0000 7f13b84ff700 1 -- 172.21.15.37:0/1956749755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f13b00b0430 con 0x7f13b00b2380 2023-10-06T02:23:11.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.952+0000 7f13ae7fc700 1 -- 172.21.15.37:0/1956749755 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f13a80566c0 con 0x7f13b00b2380 2023-10-06T02:23:11.953 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T02:23:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.954+0000 7f13b84ff700 1 -- 172.21.15.37:0/1956749755 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f139c066f30 msgr2=0x7f139c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.954+0000 7f13b84ff700 1 --2- 172.21.15.37:0/1956749755 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f139c066f30 0x7f139c0693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f13b00ca5d0 tx=0x7f13a4007ec0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.954+0000 7f13b84ff700 1 -- 172.21.15.37:0/1956749755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b00b2380 msgr2=0x7f13b00c8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.954+0000 7f13b84ff700 1 --2- 172.21.15.37:0/1956749755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b00b2380 0x7f13b00c8420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f13b00894a0 tx=0x7f13a8017000 comp rx=0 tx=0).stop 2023-10-06T02:23:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.954+0000 7f13b84ff700 1 -- 172.21.15.37:0/1956749755 shutdown_connections 2023-10-06T02:23:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.954+0000 7f13b84ff700 1 --2- 172.21.15.37:0/1956749755 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f139c066f30 0x7f139c0693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.954+0000 7f13b84ff700 1 --2- 172.21.15.37:0/1956749755 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13b01593c0 0x7f13b00c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.954+0000 7f13b84ff700 1 --2- 172.21.15.37:0/1956749755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b00b2380 0x7f13b00c8420 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.954+0000 7f13b84ff700 1 --2- 172.21.15.37:0/1956749755 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13b00ccb30 0x7f13b0154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.954+0000 7f13b84ff700 1 -- 172.21.15.37:0/1956749755 >> 172.21.15.37:0/1956749755 conn(0x7f13b006c0b0 msgr2=0x7f13b00d0500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.954+0000 7f13b84ff700 1 -- 172.21.15.37:0/1956749755 shutdown_connections 2023-10-06T02:23:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:11.954+0000 7f13b84ff700 1 -- 172.21.15.37:0/1956749755 wait complete. 2023-10-06T02:23:11.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:23:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.088+0000 7fd08f155700 1 Processor -- start 2023-10-06T02:23:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.088+0000 7fd08f155700 1 -- start start 2023-10-06T02:23:12.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.088+0000 7fd08f155700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0880cb540 0x7fd088159870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:12.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.088+0000 7fd08f155700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0880c8940 con 0x7fd0880c78a0 2023-10-06T02:23:12.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.088+0000 7fd08f155700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0880c7d30 con 0x7fd0881594a0 2023-10-06T02:23:12.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.088+0000 7fd08f155700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0880c8010 con 0x7fd0880cb540 2023-10-06T02:23:12.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.088+0000 7fd087fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd0880c78a0 0x7fd0880c92a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35324/0 (socket says 172.21.15.37:35324) 2023-10-06T02:23:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.089+0000 7fd087fff700 1 -- 172.21.15.37:0/11312303 learned_addr learned my addr 172.21.15.37:0/11312303 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.089+0000 7fd08d6f2700 1 --2- 172.21.15.37:0/11312303 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0880cb540 0x7fd088159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.089+0000 7fd0877fe700 1 -- 172.21.15.37:0/11312303 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 802493515 0 0) 0x7fd0880c8940 con 0x7fd0880c78a0 2023-10-06T02:23:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.089+0000 7fd0877fe700 1 -- 172.21.15.37:0/11312303 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd070003570 con 0x7fd0880c78a0 2023-10-06T02:23:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.089+0000 7fd0877fe700 1 -- 172.21.15.37:0/11312303 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359399719 0 0) 0x7fd0880c7d30 con 0x7fd0881594a0 2023-10-06T02:23:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.089+0000 7fd0877fe700 1 -- 172.21.15.37:0/11312303 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0880c8940 con 0x7fd0881594a0 2023-10-06T02:23:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.089+0000 7fd08d6f2700 1 -- 172.21.15.37:0/11312303 >> v1:172.21.15.191:6789/0 conn(0x7fd0881594a0 legacy=0x7fd0880cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.089+0000 7fd08d6f2700 1 -- 172.21.15.37:0/11312303 >> v1:172.21.15.37:6789/0 conn(0x7fd0880c78a0 legacy=0x7fd0880c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.089+0000 7fd08d6f2700 1 -- 172.21.15.37:0/11312303 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0880c82f0 con 0x7fd0880cb540 2023-10-06T02:23:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.089+0000 7fd08d6f2700 1 --2- 172.21.15.37:0/11312303 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0880cb540 0x7fd088159870 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd080009e90 tx=0x7fd080009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e90bf2b07abfd16 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.089+0000 7fd0877fe700 1 -- 172.21.15.37:0/11312303 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08000e070 con 0x7fd0880cb540 2023-10-06T02:23:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.089+0000 7fd0877fe700 1 -- 172.21.15.37:0/11312303 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08000bb80 con 0x7fd0880cb540 2023-10-06T02:23:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.089+0000 7fd0877fe700 1 -- 172.21.15.37:0/11312303 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080012430 con 0x7fd0880cb540 2023-10-06T02:23:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.090+0000 7fd08f155700 1 -- 172.21.15.37:0/11312303 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0880cb540 msgr2=0x7fd088159870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.090+0000 7fd08f155700 1 --2- 172.21.15.37:0/11312303 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0880cb540 0x7fd088159870 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd080009e90 tx=0x7fd080009780 comp rx=0 tx=0).stop 2023-10-06T02:23:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.090+0000 7fd08f155700 1 -- 172.21.15.37:0/11312303 shutdown_connections 2023-10-06T02:23:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.090+0000 7fd08f155700 1 --2- 172.21.15.37:0/11312303 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0880cb540 0x7fd088159870 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.090+0000 7fd08f155700 1 -- 172.21.15.37:0/11312303 >> 172.21.15.37:0/11312303 conn(0x7fd0880680f0 msgr2=0x7fd08806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.090+0000 7fd08f155700 1 -- 172.21.15.37:0/11312303 shutdown_connections 2023-10-06T02:23:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.090+0000 7fd08f155700 1 -- 172.21.15.37:0/11312303 wait complete. 2023-10-06T02:23:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.091+0000 7fd08f155700 1 Processor -- start 2023-10-06T02:23:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.091+0000 7fd08f155700 1 -- start start 2023-10-06T02:23:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.092+0000 7fd08f155700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0880c78a0 0x7fd08814f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.092+0000 7fd08f155700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0880cb540 0x7fd0880ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.092+0000 7fd08f155700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0881594a0 0x7fd0880adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.092+0000 7fd08f155700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0880aa090 con 0x7fd0880cb540 2023-10-06T02:23:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.092+0000 7fd08f155700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0880ae430 con 0x7fd0881594a0 2023-10-06T02:23:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.092+0000 7fd08f155700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0880b1830 con 0x7fd0880c78a0 2023-10-06T02:23:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.092+0000 7fd087fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0880cb540 0x7fd0880ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.092+0000 7fd087fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0880cb540 0x7fd0880ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60824/0 (socket says 172.21.15.37:60824) 2023-10-06T02:23:12.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.092+0000 7fd087fff700 1 -- 172.21.15.37:0/3286108801 learned_addr learned my addr 172.21.15.37:0/3286108801 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:12.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.092+0000 7fd08d6f2700 1 --2- 172.21.15.37:0/3286108801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0881594a0 0x7fd0880adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:12.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.092+0000 7fd08cef1700 1 --2- 172.21.15.37:0/3286108801 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0880c78a0 0x7fd08814f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:12.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.092+0000 7fd087fff700 1 -- 172.21.15.37:0/3286108801 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0880c78a0 msgr2=0x7fd08814f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:12.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.092+0000 7fd087fff700 1 --2- 172.21.15.37:0/3286108801 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0880c78a0 0x7fd08814f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.092+0000 7fd087fff700 1 -- 172.21.15.37:0/3286108801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0881594a0 msgr2=0x7fd0880adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:12.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.092+0000 7fd087fff700 1 --2- 172.21.15.37:0/3286108801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0881594a0 0x7fd0880adef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.092+0000 7fd087fff700 1 -- 172.21.15.37:0/3286108801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd080009a20 con 0x7fd0880cb540 2023-10-06T02:23:12.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.092+0000 7fd08cef1700 1 --2- 172.21.15.37:0/3286108801 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0880c78a0 0x7fd08814f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:12.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.093+0000 7fd087fff700 1 --2- 172.21.15.37:0/3286108801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0880cb540 0x7fd0880ad9b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00c790 tx=0x7fd07c007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:12.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.093+0000 7fd084ff9700 1 -- 172.21.15.37:0/3286108801 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c005c00 con 0x7fd0880cb540 2023-10-06T02:23:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.093+0000 7fd084ff9700 1 -- 172.21.15.37:0/3286108801 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07c005d60 con 0x7fd0880cb540 2023-10-06T02:23:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.093+0000 7fd084ff9700 1 -- 172.21.15.37:0/3286108801 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c007300 con 0x7fd0880cb540 2023-10-06T02:23:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.093+0000 7fd08f155700 1 -- 172.21.15.37:0/3286108801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0880a9a40 con 0x7fd0880cb540 2023-10-06T02:23:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.093+0000 7fd08f155700 1 -- 172.21.15.37:0/3286108801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0880aea50 con 0x7fd0880cb540 2023-10-06T02:23:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.094+0000 7fd08f155700 1 -- 172.21.15.37:0/3286108801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0880a98a0 con 0x7fd0880cb540 2023-10-06T02:23:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.094+0000 7fd084ff9700 1 -- 172.21.15.37:0/3286108801 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd07c01b3b0 con 0x7fd0880cb540 2023-10-06T02:23:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.094+0000 7fd084ff9700 1 --2- 172.21.15.37:0/3286108801 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd074066f30 0x7fd0740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.095+0000 7fd084ff9700 1 -- 172.21.15.37:0/3286108801 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd07c083a00 con 0x7fd0880cb540 2023-10-06T02:23:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.095+0000 7fd08cef1700 1 --2- 172.21.15.37:0/3286108801 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd074066f30 0x7fd0740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.095+0000 7fd08cef1700 1 --2- 172.21.15.37:0/3286108801 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd074066f30 0x7fd0740693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd078003990 tx=0x7fd078009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:12.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.099+0000 7fd084ff9700 1 -- 172.21.15.37:0/3286108801 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0880a98a0 con 0x7fd0880cb540 2023-10-06T02:23:12.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.290+0000 7fd08f155700 1 -- 172.21.15.37:0/3286108801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0880a9ee0 con 0x7fd0880cb540 2023-10-06T02:23:12.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.291+0000 7fd084ff9700 1 -- 172.21.15.37:0/3286108801 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd07c017070 con 0x7fd0880cb540 2023-10-06T02:23:12.291 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T02:23:12.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.293+0000 7fd08f155700 1 -- 172.21.15.37:0/3286108801 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd074066f30 msgr2=0x7fd0740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:12.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.293+0000 7fd08f155700 1 --2- 172.21.15.37:0/3286108801 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd074066f30 0x7fd0740693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd078003990 tx=0x7fd078009040 comp rx=0 tx=0).stop 2023-10-06T02:23:12.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.293+0000 7fd08f155700 1 -- 172.21.15.37:0/3286108801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0880cb540 msgr2=0x7fd0880ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:12.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.293+0000 7fd08f155700 1 --2- 172.21.15.37:0/3286108801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0880cb540 0x7fd0880ad9b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00c790 tx=0x7fd07c007ea0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.293+0000 7fd08f155700 1 -- 172.21.15.37:0/3286108801 shutdown_connections 2023-10-06T02:23:12.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.293+0000 7fd08f155700 1 --2- 172.21.15.37:0/3286108801 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd074066f30 0x7fd0740693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.293+0000 7fd08f155700 1 --2- 172.21.15.37:0/3286108801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0881594a0 0x7fd0880adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.293+0000 7fd08f155700 1 --2- 172.21.15.37:0/3286108801 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0880c78a0 0x7fd08814f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.293+0000 7fd08f155700 1 --2- 172.21.15.37:0/3286108801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0880cb540 0x7fd0880ad9b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.293+0000 7fd08f155700 1 -- 172.21.15.37:0/3286108801 >> 172.21.15.37:0/3286108801 conn(0x7fd0880680f0 msgr2=0x7fd08806a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:12.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.293+0000 7fd08f155700 1 -- 172.21.15.37:0/3286108801 shutdown_connections 2023-10-06T02:23:12.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.293+0000 7fd08f155700 1 -- 172.21.15.37:0/3286108801 wait complete. 2023-10-06T02:23:12.305 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:23:12.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.423+0000 7f05f93b0700 1 Processor -- start 2023-10-06T02:23:12.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.423+0000 7f05f93b0700 1 -- start start 2023-10-06T02:23:12.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.424+0000 7f05f93b0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f05f40b29d0 0x7f05f40ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:12.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.424+0000 7f05f93b0700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f05f40ccdd0 0x7f05f4163250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:12.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.424+0000 7f05f93b0700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f40b2da0 con 0x7f05f40cb170 2023-10-06T02:23:12.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.424+0000 7f05f93b0700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f4099bd0 con 0x7f05f40b29d0 2023-10-06T02:23:12.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.424+0000 7f05f93b0700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f4159a70 con 0x7f05f40ccdd0 2023-10-06T02:23:12.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.424+0000 7f05f2ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f05f40b29d0 0x7f05f40ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:12.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.424+0000 7f05f2ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f05f40b29d0 0x7f05f40ce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60830/0 (socket says 172.21.15.37:60830) 2023-10-06T02:23:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.424+0000 7f05f2ffd700 1 -- 172.21.15.37:0/1042036175 learned_addr learned my addr 172.21.15.37:0/1042036175 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.424+0000 7f05f37fe700 1 --2- 172.21.15.37:0/1042036175 >> v2:172.21.15.191:3300/0 conn(0x7f05f40ccdd0 0x7f05f4163250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.424+0000 7f05f2ffd700 1 -- 172.21.15.37:0/1042036175 >> v2:172.21.15.191:3300/0 conn(0x7f05f40ccdd0 msgr2=0x7f05f4163250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.424+0000 7f05f2ffd700 1 --2- 172.21.15.37:0/1042036175 >> v2:172.21.15.191:3300/0 conn(0x7f05f40ccdd0 0x7f05f4163250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.424+0000 7f05f2ffd700 1 -- 172.21.15.37:0/1042036175 >> v1:172.21.15.191:6789/0 conn(0x7f05f40cb170 legacy=0x7f05f40cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.424+0000 7f05f2ffd700 1 -- 172.21.15.37:0/1042036175 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f40cb5e0 con 0x7f05f40b29d0 2023-10-06T02:23:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.425+0000 7f05f2ffd700 1 --2- 172.21.15.37:0/1042036175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f40b29d0 0x7f05f40ce8c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f05f40cf7d0 tx=0x7f05e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38234bfa4a15e2cb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.425+0000 7f05f1ffb700 1 -- 172.21.15.37:0/1042036175 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e400e070 con 0x7f05f40b29d0 2023-10-06T02:23:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.425+0000 7f05f1ffb700 1 -- 172.21.15.37:0/1042036175 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e400ba20 con 0x7f05f40b29d0 2023-10-06T02:23:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.425+0000 7f05f1ffb700 1 -- 172.21.15.37:0/1042036175 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e40092e0 con 0x7f05f40b29d0 2023-10-06T02:23:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.425+0000 7f05f93b0700 1 -- 172.21.15.37:0/1042036175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f40b29d0 msgr2=0x7f05f40ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.425+0000 7f05f93b0700 1 --2- 172.21.15.37:0/1042036175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f40b29d0 0x7f05f40ce8c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f05f40cf7d0 tx=0x7f05e4009840 comp rx=0 tx=0).stop 2023-10-06T02:23:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.425+0000 7f05f93b0700 1 -- 172.21.15.37:0/1042036175 shutdown_connections 2023-10-06T02:23:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.425+0000 7f05f93b0700 1 --2- 172.21.15.37:0/1042036175 >> v2:172.21.15.191:3300/0 conn(0x7f05f40ccdd0 0x7f05f4163250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.425+0000 7f05f93b0700 1 --2- 172.21.15.37:0/1042036175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f40b29d0 0x7f05f40ce8c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.425+0000 7f05f93b0700 1 -- 172.21.15.37:0/1042036175 >> 172.21.15.37:0/1042036175 conn(0x7f05f4099610 msgr2=0x7f05f406c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.425+0000 7f05f93b0700 1 -- 172.21.15.37:0/1042036175 shutdown_connections 2023-10-06T02:23:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.425+0000 7f05f93b0700 1 -- 172.21.15.37:0/1042036175 wait complete. 2023-10-06T02:23:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.427+0000 7f05f93b0700 1 Processor -- start 2023-10-06T02:23:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.427+0000 7f05f93b0700 1 -- start start 2023-10-06T02:23:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.427+0000 7f05f93b0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f40b29d0 0x7f05f414df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.427+0000 7f05f93b0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05f40cb170 0x7f05f40b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.427+0000 7f05f93b0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05f40ccdd0 0x7f05f41571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.427+0000 7f05f93b0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f4156d20 con 0x7f05f40b29d0 2023-10-06T02:23:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.427+0000 7f05f93b0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f41569f0 con 0x7f05f40cb170 2023-10-06T02:23:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.427+0000 7f05f93b0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f40c9070 con 0x7f05f40ccdd0 2023-10-06T02:23:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.427+0000 7f05f2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f40b29d0 0x7f05f414df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.427+0000 7f05f2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f40b29d0 0x7f05f414df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60842/0 (socket says 172.21.15.37:60842) 2023-10-06T02:23:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.427+0000 7f05f2ffd700 1 -- 172.21.15.37:0/512270168 learned_addr learned my addr 172.21.15.37:0/512270168 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.428+0000 7f05f27fc700 1 --2- 172.21.15.37:0/512270168 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05f40cb170 0x7f05f40b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.428+0000 7f05f37fe700 1 --2- 172.21.15.37:0/512270168 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05f40ccdd0 0x7f05f41571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.428+0000 7f05f2ffd700 1 -- 172.21.15.37:0/512270168 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05f40ccdd0 msgr2=0x7f05f41571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.428+0000 7f05f2ffd700 1 --2- 172.21.15.37:0/512270168 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05f40ccdd0 0x7f05f41571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.428+0000 7f05f2ffd700 1 -- 172.21.15.37:0/512270168 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05f40cb170 msgr2=0x7f05f40b56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.428+0000 7f05f2ffd700 1 --2- 172.21.15.37:0/512270168 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05f40cb170 0x7f05f40b56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.428+0000 7f05f2ffd700 1 -- 172.21.15.37:0/512270168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e4009ae0 con 0x7f05f40b29d0 2023-10-06T02:23:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.428+0000 7f05f37fe700 1 --2- 172.21.15.37:0/512270168 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05f40ccdd0 0x7f05f41571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.428+0000 7f05f2ffd700 1 --2- 172.21.15.37:0/512270168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f40b29d0 0x7f05f414df30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f05f40d1430 tx=0x7f05e4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.428+0000 7f05eaffd700 1 -- 172.21.15.37:0/512270168 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e4008980 con 0x7f05f40b29d0 2023-10-06T02:23:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.428+0000 7f05eaffd700 1 -- 172.21.15.37:0/512270168 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e4008b00 con 0x7f05f40b29d0 2023-10-06T02:23:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.428+0000 7f05f93b0700 1 -- 172.21.15.37:0/512270168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f40c9350 con 0x7f05f40b29d0 2023-10-06T02:23:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.428+0000 7f05eaffd700 1 -- 172.21.15.37:0/512270168 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e4025460 con 0x7f05f40b29d0 2023-10-06T02:23:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.428+0000 7f05f93b0700 1 -- 172.21.15.37:0/512270168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f414e470 con 0x7f05f40b29d0 2023-10-06T02:23:12.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.429+0000 7f05f93b0700 1 -- 172.21.15.37:0/512270168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f40884f0 con 0x7f05f40b29d0 2023-10-06T02:23:12.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.429+0000 7f05eaffd700 1 -- 172.21.15.37:0/512270168 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f05e4003040 con 0x7f05f40b29d0 2023-10-06T02:23:12.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.430+0000 7f05eaffd700 1 --2- 172.21.15.37:0/512270168 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f05d4066f30 0x7f05d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:12.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.430+0000 7f05eaffd700 1 -- 172.21.15.37:0/512270168 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f05e4085cc0 con 0x7f05f40b29d0 2023-10-06T02:23:12.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.430+0000 7f05f27fc700 1 --2- 172.21.15.37:0/512270168 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f05d4066f30 0x7f05d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:12.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.430+0000 7f05f27fc700 1 --2- 172.21.15.37:0/512270168 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f05d4066f30 0x7f05d40693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f05f416d2d0 tx=0x7f05dc007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:12.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.434+0000 7f05eaffd700 1 -- 172.21.15.37:0/512270168 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05e4053120 con 0x7f05f40b29d0 2023-10-06T02:23:12.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.629+0000 7f05f93b0700 1 -- 172.21.15.37:0/512270168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f05f4064b00 con 0x7f05f40b29d0 2023-10-06T02:23:12.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.630+0000 7f05eaffd700 1 -- 172.21.15.37:0/512270168 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+126 (secure 0 0 0) 0x7f05e4020090 con 0x7f05f40b29d0 2023-10-06T02:23:12.630 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:12.630 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-10-06T02:23:12.630 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:23:12.631 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-10-06T02:23:12.631 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-10-06T02:23:12.631 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:23:12.631 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:23:12.631 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-10-06T02:23:12.631 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-10-06T02:23:12.631 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:23:12.631 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-10-06T02:23:12.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.632+0000 7f05f93b0700 1 -- 172.21.15.37:0/512270168 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f05d4066f30 msgr2=0x7f05d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:12.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.632+0000 7f05f93b0700 1 --2- 172.21.15.37:0/512270168 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f05d4066f30 0x7f05d40693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f05f416d2d0 tx=0x7f05dc007ec0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.632+0000 7f05f93b0700 1 -- 172.21.15.37:0/512270168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f40b29d0 msgr2=0x7f05f414df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:12.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.632+0000 7f05f93b0700 1 --2- 172.21.15.37:0/512270168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f40b29d0 0x7f05f414df30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f05f40d1430 tx=0x7f05e4018000 comp rx=0 tx=0).stop 2023-10-06T02:23:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.632+0000 7f05f93b0700 1 -- 172.21.15.37:0/512270168 shutdown_connections 2023-10-06T02:23:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.632+0000 7f05f93b0700 1 --2- 172.21.15.37:0/512270168 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05f40ccdd0 0x7f05f41571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.632+0000 7f05f93b0700 1 --2- 172.21.15.37:0/512270168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f40b29d0 0x7f05f414df30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.632+0000 7f05f93b0700 1 --2- 172.21.15.37:0/512270168 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f05d4066f30 0x7f05d40693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.632+0000 7f05f93b0700 1 --2- 172.21.15.37:0/512270168 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05f40cb170 0x7f05f40b56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.632+0000 7f05f93b0700 1 -- 172.21.15.37:0/512270168 >> 172.21.15.37:0/512270168 conn(0x7f05f4099610 msgr2=0x7f05f4158c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.632+0000 7f05f93b0700 1 -- 172.21.15.37:0/512270168 shutdown_connections 2023-10-06T02:23:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.632+0000 7f05f93b0700 1 -- 172.21.15.37:0/512270168 wait complete. 2023-10-06T02:23:12.644 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:23:12.644 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:23:12.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.767+0000 7f1e760d1700 1 Processor -- start 2023-10-06T02:23:12.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.767+0000 7f1e760d1700 1 -- start start 2023-10-06T02:23:12.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.768+0000 7f1e760d1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1e7006df40 0x7f1e70164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:12.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.768+0000 7f1e760d1700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7015d710 con 0x7f1e701595f0 2023-10-06T02:23:12.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.768+0000 7f1e760d1700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7015d9f0 con 0x7f1e701599c0 2023-10-06T02:23:12.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.768+0000 7f1e760d1700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e700cb320 con 0x7f1e7006df40 2023-10-06T02:23:12.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.768+0000 7f1e6f7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1e701595f0 0x7f1e700b0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35334/0 (socket says 172.21.15.37:35334) 2023-10-06T02:23:12.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.768+0000 7f1e6f7fe700 1 -- 172.21.15.37:0/3313079900 learned_addr learned my addr 172.21.15.37:0/3313079900 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:12.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.768+0000 7f1e6ffff700 1 --2- 172.21.15.37:0/3313079900 >> v2:172.21.15.37:3300/0 conn(0x7f1e7006df40 0x7f1e70164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:12.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.769+0000 7f1e6e7fc700 1 -- 172.21.15.37:0/3313079900 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594457974 0 0) 0x7f1e7015d710 con 0x7f1e701595f0 2023-10-06T02:23:12.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.769+0000 7f1e6e7fc700 1 -- 172.21.15.37:0/3313079900 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e58003570 con 0x7f1e701595f0 2023-10-06T02:23:12.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.769+0000 7f1e6ffff700 1 -- 172.21.15.37:0/3313079900 >> v1:172.21.15.191:6789/0 conn(0x7f1e701599c0 legacy=0x7f1e7006d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:12.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.769+0000 7f1e6ffff700 1 -- 172.21.15.37:0/3313079900 >> v1:172.21.15.37:6789/0 conn(0x7f1e701595f0 legacy=0x7f1e700b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:12.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.769+0000 7f1e6ffff700 1 -- 172.21.15.37:0/3313079900 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7015dcd0 con 0x7f1e7006df40 2023-10-06T02:23:12.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.769+0000 7f1e6ffff700 1 --2- 172.21.15.37:0/3313079900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7006df40 0x7f1e70164600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1e68009e60 tx=0x7f1e68009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7c628e20647f2d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:12.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.769+0000 7f1e6e7fc700 1 -- 172.21.15.37:0/3313079900 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6800e070 con 0x7f1e7006df40 2023-10-06T02:23:12.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.769+0000 7f1e6e7fc700 1 -- 172.21.15.37:0/3313079900 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6800bb60 con 0x7f1e7006df40 2023-10-06T02:23:12.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.769+0000 7f1e6e7fc700 1 -- 172.21.15.37:0/3313079900 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e68012430 con 0x7f1e7006df40 2023-10-06T02:23:12.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.770+0000 7f1e760d1700 1 -- 172.21.15.37:0/3313079900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7006df40 msgr2=0x7f1e70164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:12.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.770+0000 7f1e760d1700 1 --2- 172.21.15.37:0/3313079900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7006df40 0x7f1e70164600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1e68009e60 tx=0x7f1e68009780 comp rx=0 tx=0).stop 2023-10-06T02:23:12.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.770+0000 7f1e760d1700 1 -- 172.21.15.37:0/3313079900 shutdown_connections 2023-10-06T02:23:12.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.770+0000 7f1e760d1700 1 --2- 172.21.15.37:0/3313079900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7006df40 0x7f1e70164600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.770+0000 7f1e760d1700 1 -- 172.21.15.37:0/3313079900 >> 172.21.15.37:0/3313079900 conn(0x7f1e700ccf90 msgr2=0x7f1e700cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:12.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.770+0000 7f1e760d1700 1 -- 172.21.15.37:0/3313079900 shutdown_connections 2023-10-06T02:23:12.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.770+0000 7f1e760d1700 1 -- 172.21.15.37:0/3313079900 wait complete. 2023-10-06T02:23:12.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.771+0000 7f1e760d1700 1 Processor -- start 2023-10-06T02:23:12.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.771+0000 7f1e760d1700 1 -- start start 2023-10-06T02:23:12.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e760d1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7006df40 0x7f1e701573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:12.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e760d1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e701595f0 0x7f1e70155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:12.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e760d1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e701599c0 0x7f1e700b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:12.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e760d1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e701587e0 con 0x7f1e7006df40 2023-10-06T02:23:12.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e760d1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e70157930 con 0x7f1e701599c0 2023-10-06T02:23:12.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e760d1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e70157bd0 con 0x7f1e701595f0 2023-10-06T02:23:12.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e6f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7006df40 0x7f1e701573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:12.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e6f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7006df40 0x7f1e701573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60862/0 (socket says 172.21.15.37:60862) 2023-10-06T02:23:12.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e6f7fe700 1 -- 172.21.15.37:0/1111788609 learned_addr learned my addr 172.21.15.37:0/1111788609 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:12.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e6effd700 1 --2- 172.21.15.37:0/1111788609 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e701595f0 0x7f1e70155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:12.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e6ffff700 1 --2- 172.21.15.37:0/1111788609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e701599c0 0x7f1e700b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:12.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e6f7fe700 1 -- 172.21.15.37:0/1111788609 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e701595f0 msgr2=0x7f1e70155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:12.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e6f7fe700 1 --2- 172.21.15.37:0/1111788609 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e701595f0 0x7f1e70155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e6f7fe700 1 -- 172.21.15.37:0/1111788609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e701599c0 msgr2=0x7f1e700b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:12.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e6f7fe700 1 --2- 172.21.15.37:0/1111788609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e701599c0 0x7f1e700b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:12.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e6f7fe700 1 -- 172.21.15.37:0/1111788609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e68009a20 con 0x7f1e7006df40 2023-10-06T02:23:12.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e6f7fe700 1 --2- 172.21.15.37:0/1111788609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7006df40 0x7f1e701573f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1e6000c7c0 tx=0x7f1e60007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:12.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e577fe700 1 -- 172.21.15.37:0/1111788609 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60005b30 con 0x7f1e7006df40 2023-10-06T02:23:12.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e577fe700 1 -- 172.21.15.37:0/1111788609 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e60005c90 con 0x7f1e7006df40 2023-10-06T02:23:12.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e760d1700 1 -- 172.21.15.37:0/1111788609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e70157eb0 con 0x7f1e7006df40 2023-10-06T02:23:12.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e577fe700 1 -- 172.21.15.37:0/1111788609 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60007340 con 0x7f1e7006df40 2023-10-06T02:23:12.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.772+0000 7f1e760d1700 1 -- 172.21.15.37:0/1111788609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e70158470 con 0x7f1e7006df40 2023-10-06T02:23:12.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.773+0000 7f1e760d1700 1 -- 172.21.15.37:0/1111788609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e70088b10 con 0x7f1e7006df40 2023-10-06T02:23:12.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.774+0000 7f1e577fe700 1 -- 172.21.15.37:0/1111788609 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e6001b400 con 0x7f1e7006df40 2023-10-06T02:23:12.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.774+0000 7f1e577fe700 1 --2- 172.21.15.37:0/1111788609 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1e5c066f30 0x7f1e5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:12.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.774+0000 7f1e577fe700 1 -- 172.21.15.37:0/1111788609 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1e60083e10 con 0x7f1e7006df40 2023-10-06T02:23:12.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.774+0000 7f1e6effd700 1 --2- 172.21.15.37:0/1111788609 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1e5c066f30 0x7f1e5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:12.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.775+0000 7f1e6effd700 1 --2- 172.21.15.37:0/1111788609 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1e5c066f30 0x7f1e5c0693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1e7015d530 tx=0x7f1e64009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:12.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.779+0000 7f1e577fe700 1 -- 172.21.15.37:0/1111788609 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e600512f0 con 0x7f1e7006df40 2023-10-06T02:23:12.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:12.975+0000 7f1e760d1700 1 -- 172.21.15.37:0/1111788609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1e7004bb80 con 0x7f1e7006df40 2023-10-06T02:23:13.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:13.878+0000 7f1e577fe700 1 -- 172.21.15.37:0/1111788609 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1e60054910 con 0x7f1e7006df40 2023-10-06T02:23:13.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:13.883+0000 7f1e760d1700 1 -- 172.21.15.37:0/1111788609 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1e5c066f30 msgr2=0x7f1e5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:13.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:13.883+0000 7f1e760d1700 1 --2- 172.21.15.37:0/1111788609 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1e5c066f30 0x7f1e5c0693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1e7015d530 tx=0x7f1e64009040 comp rx=0 tx=0).stop 2023-10-06T02:23:13.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:13.883+0000 7f1e760d1700 1 -- 172.21.15.37:0/1111788609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7006df40 msgr2=0x7f1e701573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:13.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:13.883+0000 7f1e760d1700 1 --2- 172.21.15.37:0/1111788609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7006df40 0x7f1e701573f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1e6000c7c0 tx=0x7f1e60007e00 comp rx=0 tx=0).stop 2023-10-06T02:23:13.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:13.883+0000 7f1e760d1700 1 -- 172.21.15.37:0/1111788609 shutdown_connections 2023-10-06T02:23:13.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:13.883+0000 7f1e760d1700 1 --2- 172.21.15.37:0/1111788609 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1e5c066f30 0x7f1e5c0693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:13.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:13.883+0000 7f1e760d1700 1 --2- 172.21.15.37:0/1111788609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e701599c0 0x7f1e700b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:13.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:13.883+0000 7f1e760d1700 1 --2- 172.21.15.37:0/1111788609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7006df40 0x7f1e701573f0 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1e6000c7c0 tx=0x7f1e60007e00 comp rx=0 tx=0).stop 2023-10-06T02:23:13.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:13.883+0000 7f1e760d1700 1 --2- 172.21.15.37:0/1111788609 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e701595f0 0x7f1e70155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:13.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:13.883+0000 7f1e760d1700 1 -- 172.21.15.37:0/1111788609 >> 172.21.15.37:0/1111788609 conn(0x7f1e700ccf90 msgr2=0x7f1e700703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:13.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:13.884+0000 7f1e760d1700 1 -- 172.21.15.37:0/1111788609 shutdown_connections 2023-10-06T02:23:13.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:13.884+0000 7f1e760d1700 1 -- 172.21.15.37:0/1111788609 wait complete. 2023-10-06T02:23:13.886 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-10-06T02:23:13.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:23:14.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.034+0000 7f3615bbd700 1 Processor -- start 2023-10-06T02:23:14.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.034+0000 7f3615bbd700 1 -- start start 2023-10-06T02:23:14.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f3615bbd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3610156fa0 0x7f361015d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:14.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f3615bbd700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36100cb580 con 0x7f36100d0b10 2023-10-06T02:23:14.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f3615bbd700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361015d790 con 0x7f361015a5e0 2023-10-06T02:23:14.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f3615bbd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361015da70 con 0x7f3610156fa0 2023-10-06T02:23:14.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f360ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f36100d0b10 0x7f36100cba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35344/0 (socket says 172.21.15.37:35344) 2023-10-06T02:23:14.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f360ffff700 1 -- 172.21.15.37:0/3511636849 learned_addr learned my addr 172.21.15.37:0/3511636849 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:14.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f360f7fe700 1 --2- 172.21.15.37:0/3511636849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3610156fa0 0x7f361015d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:14.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f360e7fc700 1 -- 172.21.15.37:0/3511636849 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167485386 0 0) 0x7f36100cb580 con 0x7f36100d0b10 2023-10-06T02:23:14.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f360e7fc700 1 -- 172.21.15.37:0/3511636849 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35fc003570 con 0x7f36100d0b10 2023-10-06T02:23:14.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f360e7fc700 1 -- 172.21.15.37:0/3511636849 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252887897 0 0) 0x7f361015d790 con 0x7f361015a5e0 2023-10-06T02:23:14.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f360e7fc700 1 -- 172.21.15.37:0/3511636849 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36100cb580 con 0x7f361015a5e0 2023-10-06T02:23:14.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f360e7fc700 1 -- 172.21.15.37:0/3511636849 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2446590661 0 0) 0x7f35fc003570 con 0x7f36100d0b10 2023-10-06T02:23:14.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f360e7fc700 1 -- 172.21.15.37:0/3511636849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3610156fa0 msgr2=0x7f361015d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:14.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f360e7fc700 1 --2- 172.21.15.37:0/3511636849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3610156fa0 0x7f361015d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:14.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f360e7fc700 1 -- 172.21.15.37:0/3511636849 >> v1:172.21.15.191:6789/0 conn(0x7f361015a5e0 legacy=0x7f36100d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:14.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f360e7fc700 1 -- 172.21.15.37:0/3511636849 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361015dd50 con 0x7f36100d0b10 2023-10-06T02:23:14.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f360e7fc700 1 -- 172.21.15.37:0/3511636849 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f36000017f0 con 0x7f36100d0b10 2023-10-06T02:23:14.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f360f7fe700 1 --2- 172.21.15.37:0/3511636849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3610156fa0 0x7f361015d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:14.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f360e7fc700 1 -- 172.21.15.37:0/3511636849 >> v1:172.21.15.37:6789/0 conn(0x7f36100d0b10 legacy=0x7f36100cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:14.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f360e7fc700 1 --2- 172.21.15.37:0/3511636849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3610156fa0 0x7f35fc003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:14.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f360e7fc700 1 --2- 172.21.15.37:0/3511636849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35fc0041b0 0x7f35fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:14.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.035+0000 7f360e7fc700 1 --2- 172.21.15.37:0/3511636849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35fc004d50 0x7f35fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:14.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.036+0000 7f360e7fc700 1 -- 172.21.15.37:0/3511636849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361015da70 con 0x7f35fc004d50 2023-10-06T02:23:14.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.036+0000 7f360e7fc700 1 -- 172.21.15.37:0/3511636849 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc00bbf0 con 0x7f35fc0041b0 2023-10-06T02:23:14.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.036+0000 7f360e7fc700 1 -- 172.21.15.37:0/3511636849 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc00bdb0 con 0x7f3610156fa0 2023-10-06T02:23:14.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.036+0000 7f360ffff700 1 --2- 172.21.15.37:0/3511636849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35fc004d50 0x7f35fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:14.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.036+0000 7f360f7fe700 1 --2- 172.21.15.37:0/3511636849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3610156fa0 0x7f35fc003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:14.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.036+0000 7f360effd700 1 --2- 172.21.15.37:0/3511636849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35fc0041b0 0x7f35fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:14.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.036+0000 7f360ffff700 1 -- 172.21.15.37:0/3511636849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3610156fa0 msgr2=0x7f35fc003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:14.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.036+0000 7f360ffff700 1 --2- 172.21.15.37:0/3511636849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3610156fa0 0x7f35fc003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:14.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.036+0000 7f360ffff700 1 -- 172.21.15.37:0/3511636849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35fc0041b0 msgr2=0x7f35fc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:14.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.036+0000 7f360ffff700 1 --2- 172.21.15.37:0/3511636849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35fc0041b0 0x7f35fc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:14.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.036+0000 7f360ffff700 1 -- 172.21.15.37:0/3511636849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3608009420 con 0x7f35fc004d50 2023-10-06T02:23:14.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.036+0000 7f360ffff700 1 --2- 172.21.15.37:0/3511636849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35fc004d50 0x7f35fc0051c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f360000a800 tx=0x7f36000020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b462cc1232ff3b12 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:14.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.036+0000 7f360e7fc700 1 -- 172.21.15.37:0/3511636849 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36000071a0 con 0x7f35fc004d50 2023-10-06T02:23:14.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.036+0000 7f360e7fc700 1 -- 172.21.15.37:0/3511636849 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3600007300 con 0x7f35fc004d50 2023-10-06T02:23:14.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.036+0000 7f360e7fc700 1 -- 172.21.15.37:0/3511636849 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36000076c0 con 0x7f35fc004d50 2023-10-06T02:23:14.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.037+0000 7f3615bbd700 1 -- 172.21.15.37:0/3511636849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35fc004d50 msgr2=0x7f35fc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:14.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.037+0000 7f3615bbd700 1 --2- 172.21.15.37:0/3511636849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35fc004d50 0x7f35fc0051c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f360000a800 tx=0x7f36000020c0 comp rx=0 tx=0).stop 2023-10-06T02:23:14.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.037+0000 7f360ffff700 1 -- 172.21.15.37:0/3511636849 reap_dead start 2023-10-06T02:23:14.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.037+0000 7f3615bbd700 1 -- 172.21.15.37:0/3511636849 shutdown_connections 2023-10-06T02:23:14.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.037+0000 7f3615bbd700 1 -- 172.21.15.37:0/3511636849 >> 172.21.15.37:0/3511636849 conn(0x7f361006c0b0 msgr2=0x7f361006c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:14.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.037+0000 7f3615bbd700 1 -- 172.21.15.37:0/3511636849 shutdown_connections 2023-10-06T02:23:14.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.037+0000 7f3615bbd700 1 -- 172.21.15.37:0/3511636849 wait complete. 2023-10-06T02:23:14.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.038+0000 7f3615bbd700 1 Processor -- start 2023-10-06T02:23:14.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.038+0000 7f3615bbd700 1 -- start start 2023-10-06T02:23:14.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f3615bbd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35fc004d50 0x7f36100c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f3615bbd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3610155e20 0x7f3610145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f3615bbd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36100c9aa0 0x7f36100c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f3615bbd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36100ca480 con 0x7f35fc004d50 2023-10-06T02:23:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f3615bbd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3610157fa0 con 0x7f3610155e20 2023-10-06T02:23:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f3615bbd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36100c9720 con 0x7f36100c9aa0 2023-10-06T02:23:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f360f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35fc004d50 0x7f36100c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f360f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35fc004d50 0x7f36100c85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60876/0 (socket says 172.21.15.37:60876) 2023-10-06T02:23:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f360f7fe700 1 -- 172.21.15.37:0/1499319307 learned_addr learned my addr 172.21.15.37:0/1499319307 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f360effd700 1 --2- 172.21.15.37:0/1499319307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3610155e20 0x7f3610145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f360ffff700 1 --2- 172.21.15.37:0/1499319307 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36100c9aa0 0x7f36100c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f360f7fe700 1 -- 172.21.15.37:0/1499319307 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36100c9aa0 msgr2=0x7f36100c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f360f7fe700 1 --2- 172.21.15.37:0/1499319307 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36100c9aa0 0x7f36100c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f360f7fe700 1 -- 172.21.15.37:0/1499319307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3610155e20 msgr2=0x7f3610145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f360f7fe700 1 --2- 172.21.15.37:0/1499319307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3610155e20 0x7f3610145ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f360f7fe700 1 -- 172.21.15.37:0/1499319307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36100b3510 con 0x7f35fc004d50 2023-10-06T02:23:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f360f7fe700 1 --2- 172.21.15.37:0/1499319307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35fc004d50 0x7f36100c85c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3608011d70 tx=0x7f36080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f36077fe700 1 -- 172.21.15.37:0/1499319307 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3608011e70 con 0x7f35fc004d50 2023-10-06T02:23:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f36077fe700 1 -- 172.21.15.37:0/1499319307 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360800fcd0 con 0x7f35fc004d50 2023-10-06T02:23:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f3615bbd700 1 -- 172.21.15.37:0/1499319307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36100c8e80 con 0x7f35fc004d50 2023-10-06T02:23:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f36077fe700 1 -- 172.21.15.37:0/1499319307 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3608014670 con 0x7f35fc004d50 2023-10-06T02:23:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.039+0000 7f3615bbd700 1 -- 172.21.15.37:0/1499319307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36100c9440 con 0x7f35fc004d50 2023-10-06T02:23:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.040+0000 7f3615bbd700 1 -- 172.21.15.37:0/1499319307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361015b1b0 con 0x7f35fc004d50 2023-10-06T02:23:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.041+0000 7f36077fe700 1 -- 172.21.15.37:0/1499319307 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3608014aa0 con 0x7f35fc004d50 2023-10-06T02:23:14.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.041+0000 7f36077fe700 1 --2- 172.21.15.37:0/1499319307 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f35f0066f30 0x7f35f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:14.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.041+0000 7f36077fe700 1 -- 172.21.15.37:0/1499319307 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f3608018030 con 0x7f35fc004d50 2023-10-06T02:23:14.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.042+0000 7f360effd700 1 --2- 172.21.15.37:0/1499319307 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f35f0066f30 0x7f35f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:14.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.042+0000 7f360effd700 1 --2- 172.21.15.37:0/1499319307 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f35f0066f30 0x7f35f00693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f36100c6e70 tx=0x7f35f8007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:14.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.046+0000 7f36077fe700 1 -- 172.21.15.37:0/1499319307 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3608052340 con 0x7f35fc004d50 2023-10-06T02:23:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.239+0000 7f3615bbd700 1 -- 172.21.15.37:0/1499319307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f361004c3c0 con 0x7f35fc004d50 2023-10-06T02:23:14.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.885+0000 7f36077fe700 1 -- 172.21.15.37:0/1499319307 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f36080220d0 con 0x7f35fc004d50 2023-10-06T02:23:14.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.893+0000 7f3615bbd700 1 -- 172.21.15.37:0/1499319307 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f35f0066f30 msgr2=0x7f35f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:14.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.893+0000 7f3615bbd700 1 --2- 172.21.15.37:0/1499319307 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f35f0066f30 0x7f35f00693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f36100c6e70 tx=0x7f35f8007d30 comp rx=0 tx=0).stop 2023-10-06T02:23:14.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.893+0000 7f3615bbd700 1 -- 172.21.15.37:0/1499319307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35fc004d50 msgr2=0x7f36100c85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:14.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.893+0000 7f3615bbd700 1 --2- 172.21.15.37:0/1499319307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35fc004d50 0x7f36100c85c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3608011d70 tx=0x7f36080091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:14.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.893+0000 7f3615bbd700 1 -- 172.21.15.37:0/1499319307 shutdown_connections 2023-10-06T02:23:14.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.893+0000 7f3615bbd700 1 --2- 172.21.15.37:0/1499319307 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36100c9aa0 0x7f36100c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:14.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.893+0000 7f3615bbd700 1 --2- 172.21.15.37:0/1499319307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35fc004d50 0x7f36100c85c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:14.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.893+0000 7f3615bbd700 1 --2- 172.21.15.37:0/1499319307 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f35f0066f30 0x7f35f00693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:14.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.893+0000 7f3615bbd700 1 --2- 172.21.15.37:0/1499319307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3610155e20 0x7f3610145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:14.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.893+0000 7f3615bbd700 1 -- 172.21.15.37:0/1499319307 >> 172.21.15.37:0/1499319307 conn(0x7f361006c0b0 msgr2=0x7f36100b2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:14.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.894+0000 7f3615bbd700 1 -- 172.21.15.37:0/1499319307 shutdown_connections 2023-10-06T02:23:14.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:14.894+0000 7f3615bbd700 1 -- 172.21.15.37:0/1499319307 wait complete. 2023-10-06T02:23:14.899 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-10-06T02:23:14.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:23:15.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.046+0000 7f866cacd700 1 Processor -- start 2023-10-06T02:23:15.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.046+0000 7f866cacd700 1 -- start start 2023-10-06T02:23:15.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.047+0000 7f866cacd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86680b2a90 0x7f8668159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:15.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.047+0000 7f866cacd700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f86680ccb30 0x7f86680ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:15.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.047+0000 7f866cacd700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86680b07a0 con 0x7f86681593c0 2023-10-06T02:23:15.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.047+0000 7f866cacd700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86680cd8a0 con 0x7f86680b2a90 2023-10-06T02:23:15.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.047+0000 7f866cacd700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86680afe70 con 0x7f86680ccb30 2023-10-06T02:23:15.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.047+0000 7f8665d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86680b2a90 0x7f8668159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:15.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.047+0000 7f8665d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86680b2a90 0x7f8668159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60882/0 (socket says 172.21.15.37:60882) 2023-10-06T02:23:15.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.047+0000 7f8665d9b700 1 -- 172.21.15.37:0/271005523 learned_addr learned my addr 172.21.15.37:0/271005523 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:15.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.047+0000 7f8666d9d700 1 --2- 172.21.15.37:0/271005523 >> v2:172.21.15.191:3300/0 conn(0x7f86680ccb30 0x7f86680ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:15.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.047+0000 7f8665d9b700 1 -- 172.21.15.37:0/271005523 >> v2:172.21.15.191:3300/0 conn(0x7f86680ccb30 msgr2=0x7f86680ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:15.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.047+0000 7f8665d9b700 1 --2- 172.21.15.37:0/271005523 >> v2:172.21.15.191:3300/0 conn(0x7f86680ccb30 0x7f86680ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:15.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.047+0000 7f8665d9b700 1 -- 172.21.15.37:0/271005523 >> v1:172.21.15.191:6789/0 conn(0x7f86681593c0 legacy=0x7f86680b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:15.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.047+0000 7f8665d9b700 1 -- 172.21.15.37:0/271005523 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86680b0150 con 0x7f86680b2a90 2023-10-06T02:23:15.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.047+0000 7f8665d9b700 1 --2- 172.21.15.37:0/271005523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86680b2a90 0x7f8668159790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f86680c74a0 tx=0x7f8650009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddff6d8460e3ea01 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:15.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.047+0000 7f866559a700 1 -- 172.21.15.37:0/271005523 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8650009e70 con 0x7f86680b2a90 2023-10-06T02:23:15.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.047+0000 7f866559a700 1 -- 172.21.15.37:0/271005523 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865000b860 con 0x7f86680b2a90 2023-10-06T02:23:15.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.047+0000 7f866559a700 1 -- 172.21.15.37:0/271005523 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865000bc00 con 0x7f86680b2a90 2023-10-06T02:23:15.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.048+0000 7f866cacd700 1 -- 172.21.15.37:0/271005523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86680b2a90 msgr2=0x7f8668159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:15.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.048+0000 7f866cacd700 1 --2- 172.21.15.37:0/271005523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86680b2a90 0x7f8668159790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f86680c74a0 tx=0x7f8650009250 comp rx=0 tx=0).stop 2023-10-06T02:23:15.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.048+0000 7f866cacd700 1 -- 172.21.15.37:0/271005523 shutdown_connections 2023-10-06T02:23:15.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.048+0000 7f866cacd700 1 --2- 172.21.15.37:0/271005523 >> v2:172.21.15.191:3300/0 conn(0x7f86680ccb30 0x7f86680ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:15.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.048+0000 7f866cacd700 1 --2- 172.21.15.37:0/271005523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86680b2a90 0x7f8668159790 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:15.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.048+0000 7f866cacd700 1 -- 172.21.15.37:0/271005523 >> 172.21.15.37:0/271005523 conn(0x7f866806c0b0 msgr2=0x7f866806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:15.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.048+0000 7f866cacd700 1 -- 172.21.15.37:0/271005523 shutdown_connections 2023-10-06T02:23:15.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.048+0000 7f866cacd700 1 -- 172.21.15.37:0/271005523 wait complete. 2023-10-06T02:23:15.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.049+0000 7f866cacd700 1 Processor -- start 2023-10-06T02:23:15.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.049+0000 7f866cacd700 1 -- start start 2023-10-06T02:23:15.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.050+0000 7f866cacd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86680b2a90 0x7f866816ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:15.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.050+0000 7f866cacd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86680ccb30 0x7f8668169d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:15.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.050+0000 7f866cacd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86681593c0 0x7f86680c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:15.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.050+0000 7f866cacd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86680c7760 con 0x7f86680b2a90 2023-10-06T02:23:15.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.050+0000 7f866cacd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86680c99e0 con 0x7f86681593c0 2023-10-06T02:23:15.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.050+0000 7f866cacd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86680c8ec0 con 0x7f86680ccb30 2023-10-06T02:23:15.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.050+0000 7f866659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86680b2a90 0x7f866816ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:15.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.050+0000 7f866659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86680b2a90 0x7f866816ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60898/0 (socket says 172.21.15.37:60898) 2023-10-06T02:23:15.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.050+0000 7f866659c700 1 -- 172.21.15.37:0/2172905228 learned_addr learned my addr 172.21.15.37:0/2172905228 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:15.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.050+0000 7f8665d9b700 1 --2- 172.21.15.37:0/2172905228 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86680ccb30 0x7f8668169d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:15.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.050+0000 7f8666d9d700 1 --2- 172.21.15.37:0/2172905228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86681593c0 0x7f86680c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:15.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.050+0000 7f866659c700 1 -- 172.21.15.37:0/2172905228 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86680ccb30 msgr2=0x7f8668169d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:15.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.050+0000 7f866659c700 1 --2- 172.21.15.37:0/2172905228 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86680ccb30 0x7f8668169d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:15.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.050+0000 7f866659c700 1 -- 172.21.15.37:0/2172905228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86681593c0 msgr2=0x7f86680c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:15.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.050+0000 7f866659c700 1 --2- 172.21.15.37:0/2172905228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86681593c0 0x7f86680c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:15.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.050+0000 7f866659c700 1 -- 172.21.15.37:0/2172905228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86500094f0 con 0x7f86680b2a90 2023-10-06T02:23:15.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.050+0000 7f8665d9b700 1 --2- 172.21.15.37:0/2172905228 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86680ccb30 0x7f8668169d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:15.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.050+0000 7f8666d9d700 1 --2- 172.21.15.37:0/2172905228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86681593c0 0x7f86680c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:15.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.050+0000 7f866659c700 1 --2- 172.21.15.37:0/2172905228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86680b2a90 0x7f866816ae80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f866000c510 tx=0x7f866000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:15.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.050+0000 7f865e7fc700 1 -- 172.21.15.37:0/2172905228 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660011590 con 0x7f86680b2a90 2023-10-06T02:23:15.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.051+0000 7f865e7fc700 1 -- 172.21.15.37:0/2172905228 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8660011710 con 0x7f86680b2a90 2023-10-06T02:23:15.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.051+0000 7f865e7fc700 1 -- 172.21.15.37:0/2172905228 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660011ad0 con 0x7f86680b2a90 2023-10-06T02:23:15.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.051+0000 7f866cacd700 1 -- 172.21.15.37:0/2172905228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86680c9140 con 0x7f86680b2a90 2023-10-06T02:23:15.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.051+0000 7f866cacd700 1 -- 172.21.15.37:0/2172905228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86680c9700 con 0x7f86680b2a90 2023-10-06T02:23:15.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.051+0000 7f866cacd700 1 -- 172.21.15.37:0/2172905228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86680c7530 con 0x7f86680b2a90 2023-10-06T02:23:15.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.052+0000 7f865e7fc700 1 -- 172.21.15.37:0/2172905228 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f866001b3b0 con 0x7f86680b2a90 2023-10-06T02:23:15.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.052+0000 7f865e7fc700 1 --2- 172.21.15.37:0/2172905228 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8648066f60 0x7f8648069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:15.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.053+0000 7f865e7fc700 1 -- 172.21.15.37:0/2172905228 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f8660083b60 con 0x7f86680b2a90 2023-10-06T02:23:15.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.053+0000 7f8665d9b700 1 --2- 172.21.15.37:0/2172905228 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8648066f60 0x7f8648069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:15.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.053+0000 7f8665d9b700 1 --2- 172.21.15.37:0/2172905228 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8648066f60 0x7f8648069410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f86680c74a0 tx=0x7f8650017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:15.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.057+0000 7f865e7fc700 1 -- 172.21.15.37:0/2172905228 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86680c7530 con 0x7f86680b2a90 2023-10-06T02:23:15.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.297+0000 7f866cacd700 1 -- 172.21.15.37:0/2172905228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f86680c7530 con 0x7f86680b2a90 2023-10-06T02:23:15.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.889+0000 7f865e7fc700 1 -- 172.21.15.37:0/2172905228 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f86680c7530 con 0x7f86680b2a90 2023-10-06T02:23:15.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.896+0000 7f866cacd700 1 -- 172.21.15.37:0/2172905228 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8648066f60 msgr2=0x7f8648069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:15.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.896+0000 7f866cacd700 1 --2- 172.21.15.37:0/2172905228 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8648066f60 0x7f8648069410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f86680c74a0 tx=0x7f8650017000 comp rx=0 tx=0).stop 2023-10-06T02:23:15.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.896+0000 7f866cacd700 1 -- 172.21.15.37:0/2172905228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86680b2a90 msgr2=0x7f866816ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:15.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.896+0000 7f866cacd700 1 --2- 172.21.15.37:0/2172905228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86680b2a90 0x7f866816ae80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f866000c510 tx=0x7f866000c8d0 comp rx=0 tx=0).stop 2023-10-06T02:23:15.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.897+0000 7f866cacd700 1 -- 172.21.15.37:0/2172905228 shutdown_connections 2023-10-06T02:23:15.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.897+0000 7f866cacd700 1 --2- 172.21.15.37:0/2172905228 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8648066f60 0x7f8648069410 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:15.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.897+0000 7f866cacd700 1 --2- 172.21.15.37:0/2172905228 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86681593c0 0x7f86680c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:15.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.897+0000 7f866cacd700 1 --2- 172.21.15.37:0/2172905228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86680b2a90 0x7f866816ae80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:15.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.897+0000 7f866cacd700 1 --2- 172.21.15.37:0/2172905228 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86680ccb30 0x7f8668169d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:15.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.897+0000 7f866cacd700 1 -- 172.21.15.37:0/2172905228 >> 172.21.15.37:0/2172905228 conn(0x7f866806c0b0 msgr2=0x7f86680cf510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:15.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.900+0000 7f866cacd700 1 -- 172.21.15.37:0/2172905228 shutdown_connections 2023-10-06T02:23:15.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:15.902+0000 7f866cacd700 1 -- 172.21.15.37:0/2172905228 wait complete. 2023-10-06T02:23:15.913 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T02:23:15.928 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.051+0000 7fa1aa91c700 1 Processor -- start 2023-10-06T02:23:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.051+0000 7fa1aa91c700 1 -- start start 2023-10-06T02:23:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.051+0000 7fa1aa91c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa1a4156f50 0x7fa1a415a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:16.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.051+0000 7fa1aa91c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1a4157320 0x7fa1a40ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:16.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.051+0000 7fa1aa91c700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a415d710 con 0x7fa1a415d170 2023-10-06T02:23:16.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.051+0000 7fa1aa91c700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a40cb320 con 0x7fa1a4156f50 2023-10-06T02:23:16.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.051+0000 7fa1aa91c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a415d9f0 con 0x7fa1a4157320 2023-10-06T02:23:16.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.052+0000 7fa1a8eb9700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa1a415d170 0x7fa1a406c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40862/0 (socket says 172.21.15.37:40862) 2023-10-06T02:23:16.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.052+0000 7fa1a8eb9700 1 -- 172.21.15.37:0/1689029684 learned_addr learned my addr 172.21.15.37:0/1689029684 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:16.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.052+0000 7fa1a3fff700 1 --2- 172.21.15.37:0/1689029684 >> v2:172.21.15.191:3300/0 conn(0x7fa1a4156f50 0x7fa1a415a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:16.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.052+0000 7fa1a37fe700 1 --2- 172.21.15.37:0/1689029684 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1a4157320 0x7fa1a40ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.052+0000 7fa1a2ffd700 1 -- 172.21.15.37:0/1689029684 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23727508 0 0) 0x7fa1a415d710 con 0x7fa1a415d170 2023-10-06T02:23:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.052+0000 7fa1a2ffd700 1 -- 172.21.15.37:0/1689029684 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa18c003570 con 0x7fa1a415d170 2023-10-06T02:23:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.052+0000 7fa1a3fff700 1 -- 172.21.15.37:0/1689029684 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1a4157320 msgr2=0x7fa1a40ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.052+0000 7fa1a3fff700 1 --2- 172.21.15.37:0/1689029684 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1a4157320 0x7fa1a40ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.052+0000 7fa1a3fff700 1 -- 172.21.15.37:0/1689029684 >> v1:172.21.15.37:6789/0 conn(0x7fa1a415d170 legacy=0x7fa1a406c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.052+0000 7fa1a3fff700 1 -- 172.21.15.37:0/1689029684 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a415dcd0 con 0x7fa1a4156f50 2023-10-06T02:23:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.052+0000 7fa1a37fe700 1 --2- 172.21.15.37:0/1689029684 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1a4157320 0x7fa1a40ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.052+0000 7fa1a3fff700 1 --2- 172.21.15.37:0/1689029684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1a4156f50 0x7fa1a415a5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa1940098e0 tx=0x7fa1940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6026ecca366d7b43 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.052+0000 7fa1a2ffd700 1 -- 172.21.15.37:0/1689029684 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa194011630 con 0x7fa1a4156f50 2023-10-06T02:23:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.052+0000 7fa1a2ffd700 1 -- 172.21.15.37:0/1689029684 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa194011790 con 0x7fa1a4156f50 2023-10-06T02:23:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.052+0000 7fa1a2ffd700 1 -- 172.21.15.37:0/1689029684 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa194011b10 con 0x7fa1a4156f50 2023-10-06T02:23:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.053+0000 7fa1aa91c700 1 -- 172.21.15.37:0/1689029684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1a4156f50 msgr2=0x7fa1a415a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.053+0000 7fa1aa91c700 1 --2- 172.21.15.37:0/1689029684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1a4156f50 0x7fa1a415a5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa1940098e0 tx=0x7fa1940091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.053+0000 7fa1aa91c700 1 -- 172.21.15.37:0/1689029684 shutdown_connections 2023-10-06T02:23:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.053+0000 7fa1aa91c700 1 --2- 172.21.15.37:0/1689029684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1a4156f50 0x7fa1a415a5a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.053+0000 7fa1aa91c700 1 --2- 172.21.15.37:0/1689029684 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1a4157320 0x7fa1a40ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.053+0000 7fa1aa91c700 1 -- 172.21.15.37:0/1689029684 >> 172.21.15.37:0/1689029684 conn(0x7fa1a40d04f0 msgr2=0x7fa1a40d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.053+0000 7fa1aa91c700 1 -- 172.21.15.37:0/1689029684 shutdown_connections 2023-10-06T02:23:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.053+0000 7fa1aa91c700 1 -- 172.21.15.37:0/1689029684 wait complete. 2023-10-06T02:23:16.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.054+0000 7fa1aa91c700 1 Processor -- start 2023-10-06T02:23:16.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.054+0000 7fa1aa91c700 1 -- start start 2023-10-06T02:23:16.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.055+0000 7fa1aa91c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1a4156f50 0x7fa1a40c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:16.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.055+0000 7fa1aa91c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1a4157320 0x7fa1a416d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.055+0000 7fa1aa91c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1a415d170 0x7fa1a4148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.055+0000 7fa1aa91c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a40b3660 con 0x7fa1a415d170 2023-10-06T02:23:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.055+0000 7fa1aa91c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a40b3330 con 0x7fa1a4157320 2023-10-06T02:23:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.055+0000 7fa1aa91c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a416dfe0 con 0x7fa1a4156f50 2023-10-06T02:23:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.055+0000 7fa1a8eb9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1a415d170 0x7fa1a4148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.055+0000 7fa1a8eb9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1a415d170 0x7fa1a4148e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32928/0 (socket says 172.21.15.37:32928) 2023-10-06T02:23:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.055+0000 7fa1a8eb9700 1 -- 172.21.15.37:0/2286177849 learned_addr learned my addr 172.21.15.37:0/2286177849 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.055+0000 7fa1a37fe700 1 --2- 172.21.15.37:0/2286177849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1a4157320 0x7fa1a416d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.055+0000 7fa1a3fff700 1 --2- 172.21.15.37:0/2286177849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1a4156f50 0x7fa1a40c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.055+0000 7fa1a8eb9700 1 -- 172.21.15.37:0/2286177849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1a4156f50 msgr2=0x7fa1a40c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.055+0000 7fa1a8eb9700 1 --2- 172.21.15.37:0/2286177849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1a4156f50 0x7fa1a40c7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.055+0000 7fa1a8eb9700 1 -- 172.21.15.37:0/2286177849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1a4157320 msgr2=0x7fa1a416d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:16.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.055+0000 7fa1a8eb9700 1 --2- 172.21.15.37:0/2286177849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1a4157320 0x7fa1a416d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.055+0000 7fa1a8eb9700 1 -- 172.21.15.37:0/2286177849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa198009420 con 0x7fa1a415d170 2023-10-06T02:23:16.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.056+0000 7fa1a8eb9700 1 --2- 172.21.15.37:0/2286177849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1a415d170 0x7fa1a4148e70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa19c001460 tx=0x7fa19c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:16.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.056+0000 7fa18bfff700 1 -- 172.21.15.37:0/2286177849 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00a950 con 0x7fa1a415d170 2023-10-06T02:23:16.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.056+0000 7fa18bfff700 1 -- 172.21.15.37:0/2286177849 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19c00aab0 con 0x7fa1a415d170 2023-10-06T02:23:16.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.056+0000 7fa1aa91c700 1 -- 172.21.15.37:0/2286177849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa194009420 con 0x7fa1a415d170 2023-10-06T02:23:16.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.056+0000 7fa18bfff700 1 -- 172.21.15.37:0/2286177849 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00ae30 con 0x7fa1a415d170 2023-10-06T02:23:16.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.056+0000 7fa1aa91c700 1 -- 172.21.15.37:0/2286177849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a416e5a0 con 0x7fa1a415d170 2023-10-06T02:23:16.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.057+0000 7fa1aa91c700 1 -- 172.21.15.37:0/2286177849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a40b37d0 con 0x7fa1a415d170 2023-10-06T02:23:16.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.057+0000 7fa18bfff700 1 -- 172.21.15.37:0/2286177849 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa19c007300 con 0x7fa1a415d170 2023-10-06T02:23:16.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.057+0000 7fa18bfff700 1 --2- 172.21.15.37:0/2286177849 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa190066f30 0x7fa1900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:16.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.058+0000 7fa18bfff700 1 -- 172.21.15.37:0/2286177849 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa19c084b20 con 0x7fa1a415d170 2023-10-06T02:23:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.058+0000 7fa1a3fff700 1 --2- 172.21.15.37:0/2286177849 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa190066f30 0x7fa1900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.058+0000 7fa1a3fff700 1 --2- 172.21.15.37:0/2286177849 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa190066f30 0x7fa1900693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa1940091e0 tx=0x7fa194017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.062+0000 7fa18bfff700 1 -- 172.21.15.37:0/2286177849 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa19c051c10 con 0x7fa1a415d170 2023-10-06T02:23:16.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.255+0000 7fa1aa91c700 1 -- 172.21.15.37:0/2286177849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1a415dfb0 con 0x7fa1a415d170 2023-10-06T02:23:16.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.256+0000 7fa18bfff700 1 -- 172.21.15.37:0/2286177849 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16879 (secure 0 0 0) 0x7fa19c055230 con 0x7fa1a415d170 2023-10-06T02:23:16.256 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:16.256 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:23:15.298234+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:13.004596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:14.268809+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:16.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.258+0000 7fa1aa91c700 1 -- 172.21.15.37:0/2286177849 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa190066f30 msgr2=0x7fa1900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:16.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.258+0000 7fa1aa91c700 1 --2- 172.21.15.37:0/2286177849 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa190066f30 0x7fa1900693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa1940091e0 tx=0x7fa194017000 comp rx=0 tx=0).stop 2023-10-06T02:23:16.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.258+0000 7fa1aa91c700 1 -- 172.21.15.37:0/2286177849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1a415d170 msgr2=0x7fa1a4148e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:16.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.258+0000 7fa1aa91c700 1 --2- 172.21.15.37:0/2286177849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1a415d170 0x7fa1a4148e70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa19c001460 tx=0x7fa19c001a40 comp rx=0 tx=0).stop 2023-10-06T02:23:16.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.258+0000 7fa1aa91c700 1 -- 172.21.15.37:0/2286177849 shutdown_connections 2023-10-06T02:23:16.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.258+0000 7fa1aa91c700 1 --2- 172.21.15.37:0/2286177849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1a415d170 0x7fa1a4148e70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.258+0000 7fa1aa91c700 1 --2- 172.21.15.37:0/2286177849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1a4156f50 0x7fa1a40c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.258+0000 7fa1aa91c700 1 --2- 172.21.15.37:0/2286177849 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa190066f30 0x7fa1900693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.258+0000 7fa1aa91c700 1 --2- 172.21.15.37:0/2286177849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1a4157320 0x7fa1a416d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.258+0000 7fa1aa91c700 1 -- 172.21.15.37:0/2286177849 >> 172.21.15.37:0/2286177849 conn(0x7fa1a40d04f0 msgr2=0x7fa1a41561a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:16.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.258+0000 7fa1aa91c700 1 -- 172.21.15.37:0/2286177849 shutdown_connections 2023-10-06T02:23:16.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.258+0000 7fa1aa91c700 1 -- 172.21.15.37:0/2286177849 wait complete. 2023-10-06T02:23:16.270 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.389+0000 7f2dedb90700 1 Processor -- start 2023-10-06T02:23:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.389+0000 7f2dedb90700 1 -- start start 2023-10-06T02:23:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.390+0000 7f2dedb90700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2de8159760 0x7f2de815d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.390+0000 7f2dedb90700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2de815dd50 0x7f2de80cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.390+0000 7f2dedb90700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de815e1d0 con 0x7f2de815d8d0 2023-10-06T02:23:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.390+0000 7f2dedb90700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de80cc2d0 con 0x7f2de8159760 2023-10-06T02:23:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.390+0000 7f2dedb90700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de80cb650 con 0x7f2de815dd50 2023-10-06T02:23:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.390+0000 7f2de77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2de8159760 0x7f2de815d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.390+0000 7f2de77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2de8159760 0x7f2de815d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32940/0 (socket says 172.21.15.37:32940) 2023-10-06T02:23:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.390+0000 7f2de77fe700 1 -- 172.21.15.37:0/2730513842 learned_addr learned my addr 172.21.15.37:0/2730513842 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.390+0000 7f2de7fff700 1 --2- 172.21.15.37:0/2730513842 >> v2:172.21.15.191:3300/0 conn(0x7f2de815dd50 0x7f2de80cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.390+0000 7f2de77fe700 1 -- 172.21.15.37:0/2730513842 >> v2:172.21.15.191:3300/0 conn(0x7f2de815dd50 msgr2=0x7f2de80cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.390+0000 7f2de77fe700 1 --2- 172.21.15.37:0/2730513842 >> v2:172.21.15.191:3300/0 conn(0x7f2de815dd50 0x7f2de80cfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.390+0000 7f2de77fe700 1 -- 172.21.15.37:0/2730513842 >> v1:172.21.15.191:6789/0 conn(0x7f2de815d8d0 legacy=0x7f2de80c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.390+0000 7f2de77fe700 1 -- 172.21.15.37:0/2730513842 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de80cb930 con 0x7f2de8159760 2023-10-06T02:23:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.390+0000 7f2de77fe700 1 --2- 172.21.15.37:0/2730513842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de8159760 0x7f2de815d390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2de806beb0 tx=0x7f2dd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395b426b475ef3b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.391+0000 7f2de67fc700 1 -- 172.21.15.37:0/2730513842 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd800b8b0 con 0x7f2de8159760 2023-10-06T02:23:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.391+0000 7f2de67fc700 1 -- 172.21.15.37:0/2730513842 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd800ba10 con 0x7f2de8159760 2023-10-06T02:23:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.391+0000 7f2de67fc700 1 -- 172.21.15.37:0/2730513842 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd800bdb0 con 0x7f2de8159760 2023-10-06T02:23:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.391+0000 7f2dedb90700 1 -- 172.21.15.37:0/2730513842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de8159760 msgr2=0x7f2de815d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.391+0000 7f2dedb90700 1 --2- 172.21.15.37:0/2730513842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de8159760 0x7f2de815d390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2de806beb0 tx=0x7f2dd8009250 comp rx=0 tx=0).stop 2023-10-06T02:23:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.391+0000 7f2dedb90700 1 -- 172.21.15.37:0/2730513842 shutdown_connections 2023-10-06T02:23:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.391+0000 7f2dedb90700 1 --2- 172.21.15.37:0/2730513842 >> v2:172.21.15.191:3300/0 conn(0x7f2de815dd50 0x7f2de80cfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.391+0000 7f2dedb90700 1 --2- 172.21.15.37:0/2730513842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de8159760 0x7f2de815d390 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.391+0000 7f2dedb90700 1 -- 172.21.15.37:0/2730513842 >> 172.21.15.37:0/2730513842 conn(0x7f2de806c890 msgr2=0x7f2de80d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.391+0000 7f2dedb90700 1 -- 172.21.15.37:0/2730513842 shutdown_connections 2023-10-06T02:23:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.391+0000 7f2dedb90700 1 -- 172.21.15.37:0/2730513842 wait complete. 2023-10-06T02:23:16.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.392+0000 7f2dedb90700 1 Processor -- start 2023-10-06T02:23:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.393+0000 7f2dedb90700 1 -- start start 2023-10-06T02:23:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.393+0000 7f2dedb90700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2de8159760 0x7f2de8150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.393+0000 7f2dedb90700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2de815d8d0 0x7f2de80b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.393+0000 7f2dedb90700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de815dd50 0x7f2de80c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.393+0000 7f2dedb90700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de816e120 con 0x7f2de815dd50 2023-10-06T02:23:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.393+0000 7f2dedb90700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de814e030 con 0x7f2de8159760 2023-10-06T02:23:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.393+0000 7f2dedb90700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de8150ba0 con 0x7f2de815d8d0 2023-10-06T02:23:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.393+0000 7f2de7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de815dd50 0x7f2de80c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.393+0000 7f2de7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de815dd50 0x7f2de80c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32944/0 (socket says 172.21.15.37:32944) 2023-10-06T02:23:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.393+0000 7f2de7fff700 1 -- 172.21.15.37:0/2261667067 learned_addr learned my addr 172.21.15.37:0/2261667067 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.393+0000 7f2de77fe700 1 --2- 172.21.15.37:0/2261667067 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2de8159760 0x7f2de8150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.393+0000 7f2de6ffd700 1 --2- 172.21.15.37:0/2261667067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2de815d8d0 0x7f2de80b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.394+0000 7f2de7fff700 1 -- 172.21.15.37:0/2261667067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2de815d8d0 msgr2=0x7f2de80b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.394+0000 7f2de7fff700 1 --2- 172.21.15.37:0/2261667067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2de815d8d0 0x7f2de80b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.394+0000 7f2de7fff700 1 -- 172.21.15.37:0/2261667067 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2de8159760 msgr2=0x7f2de8150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.394+0000 7f2de7fff700 1 --2- 172.21.15.37:0/2261667067 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2de8159760 0x7f2de8150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.394+0000 7f2de7fff700 1 -- 172.21.15.37:0/2261667067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd80094f0 con 0x7f2de815dd50 2023-10-06T02:23:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.394+0000 7f2de7fff700 1 --2- 172.21.15.37:0/2261667067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de815dd50 0x7f2de80c85e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009fa0 tx=0x7f2de0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.394+0000 7f2dcf7fe700 1 -- 172.21.15.37:0/2261667067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de000ebc0 con 0x7f2de815dd50 2023-10-06T02:23:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.394+0000 7f2dcf7fe700 1 -- 172.21.15.37:0/2261667067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de000ed20 con 0x7f2de815dd50 2023-10-06T02:23:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.394+0000 7f2dedb90700 1 -- 172.21.15.37:0/2261667067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de816d4a0 con 0x7f2de815dd50 2023-10-06T02:23:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.394+0000 7f2dcf7fe700 1 -- 172.21.15.37:0/2261667067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0014670 con 0x7f2de815dd50 2023-10-06T02:23:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.394+0000 7f2dedb90700 1 -- 172.21.15.37:0/2261667067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de816da60 con 0x7f2de815dd50 2023-10-06T02:23:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.395+0000 7f2dedb90700 1 -- 172.21.15.37:0/2261667067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de806fbf0 con 0x7f2de815dd50 2023-10-06T02:23:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.395+0000 7f2dcf7fe700 1 -- 172.21.15.37:0/2261667067 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2de00149e0 con 0x7f2de815dd50 2023-10-06T02:23:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.396+0000 7f2dcf7fe700 1 --2- 172.21.15.37:0/2261667067 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2dd4066f30 0x7f2dd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.396+0000 7f2dcf7fe700 1 -- 172.21.15.37:0/2261667067 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2de0084d70 con 0x7f2de815dd50 2023-10-06T02:23:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.396+0000 7f2de77fe700 1 --2- 172.21.15.37:0/2261667067 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2dd4066f30 0x7f2dd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.396+0000 7f2de77fe700 1 --2- 172.21.15.37:0/2261667067 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2dd4066f30 0x7f2dd40693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2de806beb0 tx=0x7f2dd8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:16.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.400+0000 7f2dcf7fe700 1 -- 172.21.15.37:0/2261667067 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2de0051de0 con 0x7f2de815dd50 2023-10-06T02:23:16.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.593+0000 7f2dedb90700 1 -- 172.21.15.37:0/2261667067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2de8158f20 con 0x7f2de815dd50 2023-10-06T02:23:16.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.594+0000 7f2dcf7fe700 1 -- 172.21.15.37:0/2261667067 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16879 (secure 0 0 0) 0x7f2de0055400 con 0x7f2de815dd50 2023-10-06T02:23:16.594 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:16.595 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:23:15.298234+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:13.004596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:14.268809+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:16.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.596+0000 7f2dedb90700 1 -- 172.21.15.37:0/2261667067 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2dd4066f30 msgr2=0x7f2dd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:16.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.596+0000 7f2dedb90700 1 --2- 172.21.15.37:0/2261667067 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2dd4066f30 0x7f2dd40693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2de806beb0 tx=0x7f2dd8016000 comp rx=0 tx=0).stop 2023-10-06T02:23:16.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.596+0000 7f2dedb90700 1 -- 172.21.15.37:0/2261667067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de815dd50 msgr2=0x7f2de80c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:16.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.596+0000 7f2dedb90700 1 --2- 172.21.15.37:0/2261667067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de815dd50 0x7f2de80c85e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009fa0 tx=0x7f2de0009900 comp rx=0 tx=0).stop 2023-10-06T02:23:16.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.596+0000 7f2dedb90700 1 -- 172.21.15.37:0/2261667067 shutdown_connections 2023-10-06T02:23:16.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.596+0000 7f2dedb90700 1 --2- 172.21.15.37:0/2261667067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de815dd50 0x7f2de80c85e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.596+0000 7f2dedb90700 1 --2- 172.21.15.37:0/2261667067 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2dd4066f30 0x7f2dd40693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.596+0000 7f2dedb90700 1 --2- 172.21.15.37:0/2261667067 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2de8159760 0x7f2de8150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.596+0000 7f2dedb90700 1 --2- 172.21.15.37:0/2261667067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2de815d8d0 0x7f2de80b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.596+0000 7f2dedb90700 1 -- 172.21.15.37:0/2261667067 >> 172.21.15.37:0/2261667067 conn(0x7f2de806c890 msgr2=0x7f2de80cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:16.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.596+0000 7f2dedb90700 1 -- 172.21.15.37:0/2261667067 shutdown_connections 2023-10-06T02:23:16.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.596+0000 7f2dedb90700 1 -- 172.21.15.37:0/2261667067 wait complete. 2023-10-06T02:23:16.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:23:16.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.730+0000 7f5e0759e700 1 Processor -- start 2023-10-06T02:23:16.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.730+0000 7f5e0759e700 1 -- start start 2023-10-06T02:23:16.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.731+0000 7f5e0759e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e080cb170 0x7f5e080cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:16.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.731+0000 7f5e0759e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e080ccdd0 0x7f5e08163250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:16.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.731+0000 7f5e0759e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e080b2da0 con 0x7f5e080b29d0 2023-10-06T02:23:16.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.731+0000 7f5e0759e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e08099bd0 con 0x7f5e080ccdd0 2023-10-06T02:23:16.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.731+0000 7f5e0759e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e08159a70 con 0x7f5e080cb170 2023-10-06T02:23:16.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.731+0000 7f5e06d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e080ccdd0 0x7f5e08163250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:16.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.731+0000 7f5e06d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e080ccdd0 0x7f5e08163250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32960/0 (socket says 172.21.15.37:32960) 2023-10-06T02:23:16.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.731+0000 7f5e06d9d700 1 -- 172.21.15.37:0/3086443179 learned_addr learned my addr 172.21.15.37:0/3086443179 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:16.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.731+0000 7f5e05d9b700 1 --2- 172.21.15.37:0/3086443179 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e080cb170 0x7f5e080cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:16.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.731+0000 7f5e06d9d700 1 -- 172.21.15.37:0/3086443179 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e080cb170 msgr2=0x7f5e080cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:16.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.731+0000 7f5e06d9d700 1 --2- 172.21.15.37:0/3086443179 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e080cb170 0x7f5e080cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.731+0000 7f5e06d9d700 1 -- 172.21.15.37:0/3086443179 >> v1:172.21.15.191:6789/0 conn(0x7f5e080b29d0 legacy=0x7f5e080ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:16.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.731+0000 7f5e06d9d700 1 -- 172.21.15.37:0/3086443179 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e080cb5e0 con 0x7f5e080ccdd0 2023-10-06T02:23:16.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.732+0000 7f5e06d9d700 1 --2- 172.21.15.37:0/3086443179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e080ccdd0 0x7f5e08163250 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009f20 tx=0x7f5e00009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92f5478bfeb211f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:16.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.732+0000 7f5e0559a700 1 -- 172.21.15.37:0/3086443179 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0000e070 con 0x7f5e080ccdd0 2023-10-06T02:23:16.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.732+0000 7f5e0559a700 1 -- 172.21.15.37:0/3086443179 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0000ba80 con 0x7f5e080ccdd0 2023-10-06T02:23:16.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.732+0000 7f5e0559a700 1 -- 172.21.15.37:0/3086443179 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e000092e0 con 0x7f5e080ccdd0 2023-10-06T02:23:16.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.732+0000 7f5e0759e700 1 -- 172.21.15.37:0/3086443179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e080ccdd0 msgr2=0x7f5e08163250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:16.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.732+0000 7f5e0759e700 1 --2- 172.21.15.37:0/3086443179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e080ccdd0 0x7f5e08163250 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009f20 tx=0x7f5e00009840 comp rx=0 tx=0).stop 2023-10-06T02:23:16.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.732+0000 7f5e0759e700 1 -- 172.21.15.37:0/3086443179 shutdown_connections 2023-10-06T02:23:16.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.732+0000 7f5e0759e700 1 --2- 172.21.15.37:0/3086443179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e080ccdd0 0x7f5e08163250 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.732+0000 7f5e0759e700 1 --2- 172.21.15.37:0/3086443179 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e080cb170 0x7f5e080cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.732+0000 7f5e0759e700 1 -- 172.21.15.37:0/3086443179 >> 172.21.15.37:0/3086443179 conn(0x7f5e08099610 msgr2=0x7f5e0806c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:16.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.732+0000 7f5e0759e700 1 -- 172.21.15.37:0/3086443179 shutdown_connections 2023-10-06T02:23:16.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.732+0000 7f5e0759e700 1 -- 172.21.15.37:0/3086443179 wait complete. 2023-10-06T02:23:16.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.733+0000 7f5e0759e700 1 Processor -- start 2023-10-06T02:23:16.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.734+0000 7f5e0759e700 1 -- start start 2023-10-06T02:23:16.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.734+0000 7f5e0759e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e080b29d0 0x7f5e080b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:16.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.734+0000 7f5e0759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e080cb170 0x7f5e08141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:16.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.734+0000 7f5e0759e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e080ccdd0 0x7f5e08154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:16.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.734+0000 7f5e0759e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e080b4500 con 0x7f5e080cb170 2023-10-06T02:23:16.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.734+0000 7f5e0759e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e08153450 con 0x7f5e080b29d0 2023-10-06T02:23:16.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.734+0000 7f5e0759e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e080b3bd0 con 0x7f5e080ccdd0 2023-10-06T02:23:16.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.734+0000 7f5e05d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e080cb170 0x7f5e08141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.734+0000 7f5e05d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e080cb170 0x7f5e08141d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32976/0 (socket says 172.21.15.37:32976) 2023-10-06T02:23:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.734+0000 7f5e05d9b700 1 -- 172.21.15.37:0/796453966 learned_addr learned my addr 172.21.15.37:0/796453966 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.735+0000 7f5e06d9d700 1 --2- 172.21.15.37:0/796453966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e080ccdd0 0x7f5e08154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.735+0000 7f5e05d9b700 1 -- 172.21.15.37:0/796453966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e080ccdd0 msgr2=0x7f5e08154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.735+0000 7f5e05d9b700 1 --2- 172.21.15.37:0/796453966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e080ccdd0 0x7f5e08154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.735+0000 7f5e05d9b700 1 -- 172.21.15.37:0/796453966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e080b29d0 msgr2=0x7f5e080b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.735+0000 7f5e0659c700 1 --2- 172.21.15.37:0/796453966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e080b29d0 0x7f5e080b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.735+0000 7f5e05d9b700 1 --2- 172.21.15.37:0/796453966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e080b29d0 0x7f5e080b5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.735+0000 7f5e05d9b700 1 -- 172.21.15.37:0/796453966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e00009ae0 con 0x7f5e080cb170 2023-10-06T02:23:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.735+0000 7f5e05d9b700 1 --2- 172.21.15.37:0/796453966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e080cb170 0x7f5e08141d70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5df000d890 tx=0x7f5df0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.735+0000 7f5dfe7fc700 1 -- 172.21.15.37:0/796453966 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df00125f0 con 0x7f5e080cb170 2023-10-06T02:23:16.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.735+0000 7f5dfe7fc700 1 -- 172.21.15.37:0/796453966 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df0012770 con 0x7f5e080cb170 2023-10-06T02:23:16.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.735+0000 7f5e0759e700 1 -- 172.21.15.37:0/796453966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e080b3eb0 con 0x7f5e080cb170 2023-10-06T02:23:16.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.735+0000 7f5dfe7fc700 1 -- 172.21.15.37:0/796453966 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0012b30 con 0x7f5e080cb170 2023-10-06T02:23:16.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.735+0000 7f5e0759e700 1 -- 172.21.15.37:0/796453966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e081422b0 con 0x7f5e080cb170 2023-10-06T02:23:16.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.736+0000 7f5e0759e700 1 -- 172.21.15.37:0/796453966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e080b46b0 con 0x7f5e080cb170 2023-10-06T02:23:16.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.736+0000 7f5dfe7fc700 1 -- 172.21.15.37:0/796453966 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5df001e460 con 0x7f5e080cb170 2023-10-06T02:23:16.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.737+0000 7f5dfe7fc700 1 --2- 172.21.15.37:0/796453966 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5de8066f30 0x7f5de80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:16.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.737+0000 7f5dfe7fc700 1 -- 172.21.15.37:0/796453966 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5df0084dc0 con 0x7f5e080cb170 2023-10-06T02:23:16.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.737+0000 7f5e0659c700 1 --2- 172.21.15.37:0/796453966 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5de8066f30 0x7f5de80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:16.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.738+0000 7f5e0659c700 1 --2- 172.21.15.37:0/796453966 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5de8066f30 0x7f5de80693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5df8001760 tx=0x7f5df8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:16.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.741+0000 7f5dfe7fc700 1 -- 172.21.15.37:0/796453966 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e080b46b0 con 0x7f5e080cb170 2023-10-06T02:23:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:16.982+0000 7f5e0759e700 1 -- 172.21.15.37:0/796453966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5e080884f0 con 0x7f5e080cb170 2023-10-06T02:23:17.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:17.912+0000 7f5dfe7fc700 1 -- 172.21.15.37:0/796453966 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5df0055960 con 0x7f5e080cb170 2023-10-06T02:23:17.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:17.915+0000 7f5e0759e700 1 -- 172.21.15.37:0/796453966 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5de8066f30 msgr2=0x7f5de80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:17.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:17.915+0000 7f5e0759e700 1 --2- 172.21.15.37:0/796453966 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5de8066f30 0x7f5de80693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5df8001760 tx=0x7f5df8009040 comp rx=0 tx=0).stop 2023-10-06T02:23:17.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:17.915+0000 7f5e0759e700 1 -- 172.21.15.37:0/796453966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e080cb170 msgr2=0x7f5e08141d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:17.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:17.915+0000 7f5e0759e700 1 --2- 172.21.15.37:0/796453966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e080cb170 0x7f5e08141d70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5df000d890 tx=0x7f5df0008040 comp rx=0 tx=0).stop 2023-10-06T02:23:17.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:17.915+0000 7f5e0759e700 1 -- 172.21.15.37:0/796453966 shutdown_connections 2023-10-06T02:23:17.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:17.915+0000 7f5e0759e700 1 --2- 172.21.15.37:0/796453966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e080ccdd0 0x7f5e08154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:17.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:17.915+0000 7f5e0759e700 1 --2- 172.21.15.37:0/796453966 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5de8066f30 0x7f5de80693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:17.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:17.915+0000 7f5e0759e700 1 --2- 172.21.15.37:0/796453966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e080b29d0 0x7f5e080b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:17.915+0000 7f5e0759e700 1 --2- 172.21.15.37:0/796453966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e080cb170 0x7f5e08141d70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:17.915+0000 7f5e0759e700 1 -- 172.21.15.37:0/796453966 >> 172.21.15.37:0/796453966 conn(0x7f5e08099610 msgr2=0x7f5e08151e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:17.915+0000 7f5e0759e700 1 -- 172.21.15.37:0/796453966 shutdown_connections 2023-10-06T02:23:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:17.915+0000 7f5e0759e700 1 -- 172.21.15.37:0/796453966 wait complete. 2023-10-06T02:23:17.931 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:23:18.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.060+0000 7f55887ed700 1 Processor -- start 2023-10-06T02:23:18.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.060+0000 7f55887ed700 1 -- start start 2023-10-06T02:23:18.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.061+0000 7f55887ed700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5580159610 0x7f55800b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:18.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.061+0000 7f55887ed700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f55800b3310 0x7f55800b4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:18.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.061+0000 7f55887ed700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55800b43b0 con 0x7f55801599e0 2023-10-06T02:23:18.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.061+0000 7f55887ed700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55800cde50 con 0x7f5580159610 2023-10-06T02:23:18.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.061+0000 7f55887ed700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55800b1020 con 0x7f55800b3310 2023-10-06T02:23:18.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.061+0000 7f5586589700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5580159610 0x7f55800b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:18.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.061+0000 7f5586589700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5580159610 0x7f55800b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32978/0 (socket says 172.21.15.37:32978) 2023-10-06T02:23:18.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.061+0000 7f5586589700 1 -- 172.21.15.37:0/4215429029 learned_addr learned my addr 172.21.15.37:0/4215429029 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.061+0000 7f5586d8a700 1 --2- 172.21.15.37:0/4215429029 >> v2:172.21.15.191:3300/0 conn(0x7f55800b3310 0x7f55800b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.062+0000 7f5586589700 1 -- 172.21.15.37:0/4215429029 >> v2:172.21.15.191:3300/0 conn(0x7f55800b3310 msgr2=0x7f55800b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.062+0000 7f5586589700 1 --2- 172.21.15.37:0/4215429029 >> v2:172.21.15.191:3300/0 conn(0x7f55800b3310 0x7f55800b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.062+0000 7f5586589700 1 -- 172.21.15.37:0/4215429029 >> v1:172.21.15.191:6789/0 conn(0x7f55801599e0 legacy=0x7f55800d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.062+0000 7f5586589700 1 -- 172.21.15.37:0/4215429029 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55800b37a0 con 0x7f5580159610 2023-10-06T02:23:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.062+0000 7f5586d8a700 1 --2- 172.21.15.37:0/4215429029 >> v2:172.21.15.191:3300/0 conn(0x7f55800b3310 0x7f55800b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.062+0000 7f5586589700 1 --2- 172.21.15.37:0/4215429029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5580159610 0x7f55800b0ae0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f558015e380 tx=0x7f5570009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3438d36aac9d5526 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.062+0000 7f5585587700 1 -- 172.21.15.37:0/4215429029 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557000b820 con 0x7f5580159610 2023-10-06T02:23:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.062+0000 7f5585587700 1 -- 172.21.15.37:0/4215429029 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557000b980 con 0x7f5580159610 2023-10-06T02:23:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.062+0000 7f5585587700 1 -- 172.21.15.37:0/4215429029 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557000bd20 con 0x7f5580159610 2023-10-06T02:23:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.062+0000 7f55887ed700 1 -- 172.21.15.37:0/4215429029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5580159610 msgr2=0x7f55800b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.062+0000 7f55887ed700 1 --2- 172.21.15.37:0/4215429029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5580159610 0x7f55800b0ae0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f558015e380 tx=0x7f5570009250 comp rx=0 tx=0).stop 2023-10-06T02:23:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.063+0000 7f55887ed700 1 -- 172.21.15.37:0/4215429029 shutdown_connections 2023-10-06T02:23:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.063+0000 7f55887ed700 1 --2- 172.21.15.37:0/4215429029 >> v2:172.21.15.191:3300/0 conn(0x7f55800b3310 0x7f55800b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.063+0000 7f55887ed700 1 --2- 172.21.15.37:0/4215429029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5580159610 0x7f55800b0ae0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.063+0000 7f55887ed700 1 -- 172.21.15.37:0/4215429029 >> 172.21.15.37:0/4215429029 conn(0x7f558006c0b0 msgr2=0x7f558006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.063+0000 7f55887ed700 1 -- 172.21.15.37:0/4215429029 shutdown_connections 2023-10-06T02:23:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.063+0000 7f55887ed700 1 -- 172.21.15.37:0/4215429029 wait complete. 2023-10-06T02:23:18.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.064+0000 7f55887ed700 1 Processor -- start 2023-10-06T02:23:18.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.064+0000 7f55887ed700 1 -- start start 2023-10-06T02:23:18.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.064+0000 7f55887ed700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55800b3310 0x7f558014da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:18.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.064+0000 7f55887ed700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5580159610 0x7f558015c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:18.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.064+0000 7f55887ed700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55801599e0 0x7f55800d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:18.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.064+0000 7f55887ed700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558015ab80 con 0x7f55801599e0 2023-10-06T02:23:18.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.064+0000 7f55887ed700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558015bfd0 con 0x7f5580159610 2023-10-06T02:23:18.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.064+0000 7f55887ed700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5580159f70 con 0x7f55800b3310 2023-10-06T02:23:18.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.065+0000 7f5586d8a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55801599e0 0x7f55800d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:18.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.065+0000 7f5586d8a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55801599e0 0x7f55800d01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32986/0 (socket says 172.21.15.37:32986) 2023-10-06T02:23:18.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.065+0000 7f5586d8a700 1 -- 172.21.15.37:0/1479812215 learned_addr learned my addr 172.21.15.37:0/1479812215 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:18.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.065+0000 7f5586589700 1 --2- 172.21.15.37:0/1479812215 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55800b3310 0x7f558014da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.065+0000 7f5585d88700 1 --2- 172.21.15.37:0/1479812215 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5580159610 0x7f558015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.065+0000 7f5586d8a700 1 -- 172.21.15.37:0/1479812215 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55800b3310 msgr2=0x7f558014da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.065+0000 7f5586d8a700 1 --2- 172.21.15.37:0/1479812215 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55800b3310 0x7f558014da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.065+0000 7f5586d8a700 1 -- 172.21.15.37:0/1479812215 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5580159610 msgr2=0x7f558015c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.065+0000 7f5586d8a700 1 --2- 172.21.15.37:0/1479812215 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5580159610 0x7f558015c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.065+0000 7f5586d8a700 1 -- 172.21.15.37:0/1479812215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55700094f0 con 0x7f55801599e0 2023-10-06T02:23:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.065+0000 7f5586d8a700 1 --2- 172.21.15.37:0/1479812215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55801599e0 0x7f55800d01b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f557800cef0 tx=0x7f5578007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.065+0000 7f557e7fc700 1 -- 172.21.15.37:0/1479812215 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557800ad20 con 0x7f55801599e0 2023-10-06T02:23:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.065+0000 7f557e7fc700 1 -- 172.21.15.37:0/1479812215 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5578016420 con 0x7f55801599e0 2023-10-06T02:23:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.065+0000 7f55887ed700 1 -- 172.21.15.37:0/1479812215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558015a250 con 0x7f55801599e0 2023-10-06T02:23:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.065+0000 7f557e7fc700 1 -- 172.21.15.37:0/1479812215 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557800aea0 con 0x7f55801599e0 2023-10-06T02:23:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.065+0000 7f55887ed700 1 -- 172.21.15.37:0/1479812215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f558015a810 con 0x7f55801599e0 2023-10-06T02:23:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.066+0000 7f55887ed700 1 -- 172.21.15.37:0/1479812215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5580088b30 con 0x7f55801599e0 2023-10-06T02:23:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.067+0000 7f557e7fc700 1 -- 172.21.15.37:0/1479812215 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5578016a70 con 0x7f55801599e0 2023-10-06T02:23:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.067+0000 7f557e7fc700 1 --2- 172.21.15.37:0/1479812215 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f556c066f30 0x7f556c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.067+0000 7f557e7fc700 1 -- 172.21.15.37:0/1479812215 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5578012070 con 0x7f55801599e0 2023-10-06T02:23:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.067+0000 7f5586589700 1 --2- 172.21.15.37:0/1479812215 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f556c066f30 0x7f556c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.068+0000 7f5586589700 1 --2- 172.21.15.37:0/1479812215 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f556c066f30 0x7f556c0693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f558015e380 tx=0x7f5570016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.072+0000 7f557e7fc700 1 -- 172.21.15.37:0/1479812215 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55780520c0 con 0x7f55801599e0 2023-10-06T02:23:18.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.308+0000 7f55887ed700 1 -- 172.21.15.37:0/1479812215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f55800b3a80 con 0x7f55801599e0 2023-10-06T02:23:18.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.917+0000 7f557e7fc700 1 -- 172.21.15.37:0/1479812215 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f55780556e0 con 0x7f55801599e0 2023-10-06T02:23:18.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.919+0000 7f55887ed700 1 -- 172.21.15.37:0/1479812215 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f556c066f30 msgr2=0x7f556c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.919+0000 7f55887ed700 1 --2- 172.21.15.37:0/1479812215 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f556c066f30 0x7f556c0693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f558015e380 tx=0x7f5570016000 comp rx=0 tx=0).stop 2023-10-06T02:23:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.919+0000 7f55887ed700 1 -- 172.21.15.37:0/1479812215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55801599e0 msgr2=0x7f55800d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.919+0000 7f55887ed700 1 --2- 172.21.15.37:0/1479812215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55801599e0 0x7f55800d01b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f557800cef0 tx=0x7f5578007860 comp rx=0 tx=0).stop 2023-10-06T02:23:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.919+0000 7f55887ed700 1 -- 172.21.15.37:0/1479812215 shutdown_connections 2023-10-06T02:23:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.919+0000 7f55887ed700 1 --2- 172.21.15.37:0/1479812215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55801599e0 0x7f55800d01b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.919+0000 7f55887ed700 1 --2- 172.21.15.37:0/1479812215 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55800b3310 0x7f558014da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.919+0000 7f55887ed700 1 --2- 172.21.15.37:0/1479812215 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f556c066f30 0x7f556c0693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.919+0000 7f55887ed700 1 --2- 172.21.15.37:0/1479812215 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5580159610 0x7f558015c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.919+0000 7f55887ed700 1 -- 172.21.15.37:0/1479812215 >> 172.21.15.37:0/1479812215 conn(0x7f558006c0b0 msgr2=0x7f55800ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.919+0000 7f55887ed700 1 -- 172.21.15.37:0/1479812215 shutdown_connections 2023-10-06T02:23:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:18.919+0000 7f55887ed700 1 -- 172.21.15.37:0/1479812215 wait complete. 2023-10-06T02:23:18.934 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:23:19.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.058+0000 7fe2a5d04700 1 Processor -- start 2023-10-06T02:23:19.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.058+0000 7fe2a5d04700 1 -- start start 2023-10-06T02:23:19.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.059+0000 7fe2a5d04700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2a0159370 0x7fe2a0159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.059+0000 7fe2a5d04700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe2a00b2270 0x7fe2a015db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.059+0000 7fe2a5d04700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a00cb200 con 0x7fe2a00aff10 2023-10-06T02:23:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.059+0000 7fe2a5d04700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a00b5c00 con 0x7fe2a0159370 2023-10-06T02:23:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.059+0000 7fe2a5d04700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a00cb7c0 con 0x7fe2a00b2270 2023-10-06T02:23:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.059+0000 7fe2a4d02700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2a0159370 0x7fe2a0159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.059+0000 7fe2a4d02700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2a0159370 0x7fe2a0159740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32992/0 (socket says 172.21.15.37:32992) 2023-10-06T02:23:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.059+0000 7fe2a4d02700 1 -- 172.21.15.37:0/2776206597 learned_addr learned my addr 172.21.15.37:0/2776206597 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.059+0000 7fe29ffff700 1 --2- 172.21.15.37:0/2776206597 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe2a00b2270 0x7fe2a015db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.059+0000 7fe2a4d02700 1 -- 172.21.15.37:0/2776206597 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe2a00b2270 msgr2=0x7fe2a015db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.059+0000 7fe2a4d02700 1 --2- 172.21.15.37:0/2776206597 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe2a00b2270 0x7fe2a015db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.059+0000 7fe2a4d02700 1 -- 172.21.15.37:0/2776206597 >> v1:172.21.15.191:6789/0 conn(0x7fe2a00aff10 legacy=0x7fe2a006d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.059+0000 7fe2a4d02700 1 -- 172.21.15.37:0/2776206597 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a015e0d0 con 0x7fe2a0159370 2023-10-06T02:23:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.060+0000 7fe2a4d02700 1 --2- 172.21.15.37:0/2776206597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a0159370 0x7fe2a0159740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe2940099b0 tx=0x7fe294009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4401349046747e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.060+0000 7fe29f7fe700 1 -- 172.21.15.37:0/2776206597 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29400b860 con 0x7fe2a0159370 2023-10-06T02:23:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.060+0000 7fe29f7fe700 1 -- 172.21.15.37:0/2776206597 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29400b9c0 con 0x7fe2a0159370 2023-10-06T02:23:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.060+0000 7fe29f7fe700 1 -- 172.21.15.37:0/2776206597 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29400bd60 con 0x7fe2a0159370 2023-10-06T02:23:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.060+0000 7fe2a5d04700 1 -- 172.21.15.37:0/2776206597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a0159370 msgr2=0x7fe2a0159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.060+0000 7fe2a5d04700 1 --2- 172.21.15.37:0/2776206597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a0159370 0x7fe2a0159740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe2940099b0 tx=0x7fe294009250 comp rx=0 tx=0).stop 2023-10-06T02:23:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.060+0000 7fe2a5d04700 1 -- 172.21.15.37:0/2776206597 shutdown_connections 2023-10-06T02:23:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.060+0000 7fe2a5d04700 1 --2- 172.21.15.37:0/2776206597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a0159370 0x7fe2a0159740 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.060+0000 7fe2a5d04700 1 --2- 172.21.15.37:0/2776206597 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe2a00b2270 0x7fe2a015db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.060+0000 7fe2a5d04700 1 -- 172.21.15.37:0/2776206597 >> 172.21.15.37:0/2776206597 conn(0x7fe2a006c0b0 msgr2=0x7fe2a006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.060+0000 7fe2a5d04700 1 -- 172.21.15.37:0/2776206597 shutdown_connections 2023-10-06T02:23:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.060+0000 7fe2a5d04700 1 -- 172.21.15.37:0/2776206597 wait complete. 2023-10-06T02:23:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.061+0000 7fe2a5d04700 1 Processor -- start 2023-10-06T02:23:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.061+0000 7fe2a5d04700 1 -- start start 2023-10-06T02:23:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.062+0000 7fe2a5d04700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe2a00aff10 0x7fe2a01600e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.062+0000 7fe2a5d04700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2a00b2270 0x7fe2a016e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.062+0000 7fe2a5d04700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a0159370 0x7fe2a01506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.062+0000 7fe2a5d04700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a016e680 con 0x7fe2a0159370 2023-10-06T02:23:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.062+0000 7fe2a5d04700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a015fc50 con 0x7fe2a00b2270 2023-10-06T02:23:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.062+0000 7fe2a5d04700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a0156440 con 0x7fe2a00aff10 2023-10-06T02:23:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.062+0000 7fe2a5503700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a0159370 0x7fe2a01506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.062+0000 7fe2a5503700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a0159370 0x7fe2a01506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33002/0 (socket says 172.21.15.37:33002) 2023-10-06T02:23:19.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.062+0000 7fe2a5503700 1 -- 172.21.15.37:0/3495431774 learned_addr learned my addr 172.21.15.37:0/3495431774 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:19.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.062+0000 7fe29ffff700 1 --2- 172.21.15.37:0/3495431774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2a00b2270 0x7fe2a016e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.062+0000 7fe2a4d02700 1 --2- 172.21.15.37:0/3495431774 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe2a00aff10 0x7fe2a01600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.063+0000 7fe2a5503700 1 -- 172.21.15.37:0/3495431774 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe2a00aff10 msgr2=0x7fe2a01600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.063+0000 7fe2a5503700 1 --2- 172.21.15.37:0/3495431774 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe2a00aff10 0x7fe2a01600e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.063+0000 7fe2a5503700 1 -- 172.21.15.37:0/3495431774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2a00b2270 msgr2=0x7fe2a016e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.063+0000 7fe2a5503700 1 --2- 172.21.15.37:0/3495431774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2a00b2270 0x7fe2a016e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.063+0000 7fe2a5503700 1 -- 172.21.15.37:0/3495431774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2940094f0 con 0x7fe2a0159370 2023-10-06T02:23:19.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.063+0000 7fe2a5503700 1 --2- 172.21.15.37:0/3495431774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a0159370 0x7fe2a01506d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe29800c8e0 tx=0x7fe298001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:19.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.063+0000 7fe29cff9700 1 -- 172.21.15.37:0/3495431774 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe298012630 con 0x7fe2a0159370 2023-10-06T02:23:19.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.063+0000 7fe29cff9700 1 -- 172.21.15.37:0/3495431774 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe298012790 con 0x7fe2a0159370 2023-10-06T02:23:19.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.063+0000 7fe2a5d04700 1 -- 172.21.15.37:0/3495431774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a015f600 con 0x7fe2a0159370 2023-10-06T02:23:19.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.063+0000 7fe29cff9700 1 -- 172.21.15.37:0/3495431774 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe298012b50 con 0x7fe2a0159370 2023-10-06T02:23:19.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.063+0000 7fe2a5d04700 1 -- 172.21.15.37:0/3495431774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a0150c10 con 0x7fe2a0159370 2023-10-06T02:23:19.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.064+0000 7fe2a5d04700 1 -- 172.21.15.37:0/3495431774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a015fe00 con 0x7fe2a0159370 2023-10-06T02:23:19.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.064+0000 7fe29cff9700 1 -- 172.21.15.37:0/3495431774 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe29801a3a0 con 0x7fe2a0159370 2023-10-06T02:23:19.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.065+0000 7fe29cff9700 1 --2- 172.21.15.37:0/3495431774 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe284066f30 0x7fe2840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.065+0000 7fe29cff9700 1 -- 172.21.15.37:0/3495431774 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe2980847f0 con 0x7fe2a0159370 2023-10-06T02:23:19.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.065+0000 7fe2a4d02700 1 --2- 172.21.15.37:0/3495431774 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe284066f30 0x7fe2840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.065+0000 7fe2a4d02700 1 --2- 172.21.15.37:0/3495431774 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe284066f30 0x7fe2840693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe2940099b0 tx=0x7fe294017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.069+0000 7fe29cff9700 1 -- 172.21.15.37:0/3495431774 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2a015fe00 con 0x7fe2a0159370 2023-10-06T02:23:19.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.305+0000 7fe2a5d04700 1 -- 172.21.15.37:0/3495431774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2a00b60a0 con 0x7fe2a0159370 2023-10-06T02:23:19.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.305+0000 7fe29cff9700 1 -- 172.21.15.37:0/3495431774 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4591 (secure 0 0 0) 0x7fe298051900 con 0x7fe2a0159370 2023-10-06T02:23:19.306 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:19.306 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/651376696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":651376696},{"type":"v1","addr":"172.21.15.191:6837","nonce":651376696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1345849362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1345849362},{"type":"v1","addr":"172.21.15.37:6834","nonce":1345849362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/434738958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":434738958},{"type":"v1","addr":"172.21.15.37:6835","nonce":434738958}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:15.298562+0000","modified":"2023-10-06T02:23:18.911651+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6835/1723334905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1723334905},{"type":"v1","addr":"172.21.15.191:6835","nonce":1723334905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:23:19.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.307+0000 7fe2a5d04700 1 -- 172.21.15.37:0/3495431774 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe284066f30 msgr2=0x7fe2840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.307+0000 7fe2a5d04700 1 --2- 172.21.15.37:0/3495431774 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe284066f30 0x7fe2840693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe2940099b0 tx=0x7fe294017000 comp rx=0 tx=0).stop 2023-10-06T02:23:19.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.307+0000 7fe2a5d04700 1 -- 172.21.15.37:0/3495431774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a0159370 msgr2=0x7fe2a01506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.307+0000 7fe2a5d04700 1 --2- 172.21.15.37:0/3495431774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a0159370 0x7fe2a01506d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe29800c8e0 tx=0x7fe298001710 comp rx=0 tx=0).stop 2023-10-06T02:23:19.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.307+0000 7fe2a5d04700 1 -- 172.21.15.37:0/3495431774 shutdown_connections 2023-10-06T02:23:19.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.307+0000 7fe2a5d04700 1 --2- 172.21.15.37:0/3495431774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a0159370 0x7fe2a01506d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.307+0000 7fe2a5d04700 1 --2- 172.21.15.37:0/3495431774 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe2a00aff10 0x7fe2a01600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.307+0000 7fe2a5d04700 1 --2- 172.21.15.37:0/3495431774 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe284066f30 0x7fe2840693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.307+0000 7fe2a5d04700 1 --2- 172.21.15.37:0/3495431774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2a00b2270 0x7fe2a016e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.307+0000 7fe2a5d04700 1 -- 172.21.15.37:0/3495431774 >> 172.21.15.37:0/3495431774 conn(0x7fe2a006c0b0 msgr2=0x7fe2a015d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:19.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.308+0000 7fe2a5d04700 1 -- 172.21.15.37:0/3495431774 shutdown_connections 2023-10-06T02:23:19.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.308+0000 7fe2a5d04700 1 -- 172.21.15.37:0/3495431774 wait complete. 2023-10-06T02:23:19.309 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-10-06T02:23:19.320 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:19.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.438+0000 7f6caaed9700 1 Processor -- start 2023-10-06T02:23:19.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.438+0000 7f6caaed9700 1 -- start start 2023-10-06T02:23:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.439+0000 7f6caaed9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ca41596d0 0x7f6ca40b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.439+0000 7f6caaed9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6ca40b3840 0x7f6ca40c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.439+0000 7f6caaed9700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca40c5300 con 0x7f6ca4159aa0 2023-10-06T02:23:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.439+0000 7f6caaed9700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca40c6160 con 0x7f6ca40b3840 2023-10-06T02:23:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.439+0000 7f6caaed9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca40c5550 con 0x7f6ca41596d0 2023-10-06T02:23:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.439+0000 7f6ca3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6ca40b3840 0x7f6ca40c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.439+0000 7f6ca3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6ca40b3840 0x7f6ca40c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33012/0 (socket says 172.21.15.37:33012) 2023-10-06T02:23:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.439+0000 7f6ca3fff700 1 -- 172.21.15.37:0/492149687 learned_addr learned my addr 172.21.15.37:0/492149687 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.439+0000 7f6ca8c75700 1 --2- 172.21.15.37:0/492149687 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ca41596d0 0x7f6ca40b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.440+0000 7f6ca3fff700 1 -- 172.21.15.37:0/492149687 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ca41596d0 msgr2=0x7f6ca40b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.440+0000 7f6ca3fff700 1 --2- 172.21.15.37:0/492149687 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ca41596d0 0x7f6ca40b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.440+0000 7f6ca3fff700 1 -- 172.21.15.37:0/492149687 >> v1:172.21.15.191:6789/0 conn(0x7f6ca4159aa0 legacy=0x7f6ca40caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.440+0000 7f6ca3fff700 1 -- 172.21.15.37:0/492149687 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca40c5830 con 0x7f6ca40b3840 2023-10-06T02:23:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.440+0000 7f6ca37fe700 1 -- 172.21.15.37:0/492149687 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728488018 0 0) 0x7f6ca40c5300 con 0x7f6ca4159aa0 2023-10-06T02:23:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.440+0000 7f6ca3fff700 1 --2- 172.21.15.37:0/492149687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ca40b3840 0x7f6ca40c65f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6c980099b0 tx=0x7f6c98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9060445eff0cf65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.440+0000 7f6ca37fe700 1 -- 172.21.15.37:0/492149687 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98009ea0 con 0x7f6ca40b3840 2023-10-06T02:23:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.440+0000 7f6ca37fe700 1 -- 172.21.15.37:0/492149687 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9800b860 con 0x7f6ca40b3840 2023-10-06T02:23:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.440+0000 7f6ca37fe700 1 -- 172.21.15.37:0/492149687 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9800bc00 con 0x7f6ca40b3840 2023-10-06T02:23:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.440+0000 7f6caaed9700 1 -- 172.21.15.37:0/492149687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ca40b3840 msgr2=0x7f6ca40c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.440+0000 7f6caaed9700 1 --2- 172.21.15.37:0/492149687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ca40b3840 0x7f6ca40c65f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6c980099b0 tx=0x7f6c98009250 comp rx=0 tx=0).stop 2023-10-06T02:23:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.440+0000 7f6caaed9700 1 -- 172.21.15.37:0/492149687 shutdown_connections 2023-10-06T02:23:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.440+0000 7f6caaed9700 1 --2- 172.21.15.37:0/492149687 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ca41596d0 0x7f6ca40b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.440+0000 7f6caaed9700 1 --2- 172.21.15.37:0/492149687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ca40b3840 0x7f6ca40c65f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.440+0000 7f6caaed9700 1 -- 172.21.15.37:0/492149687 >> 172.21.15.37:0/492149687 conn(0x7f6ca406c890 msgr2=0x7f6ca40d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.440+0000 7f6caaed9700 1 -- 172.21.15.37:0/492149687 shutdown_connections 2023-10-06T02:23:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.440+0000 7f6caaed9700 1 -- 172.21.15.37:0/492149687 wait complete. 2023-10-06T02:23:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.442+0000 7f6caaed9700 1 Processor -- start 2023-10-06T02:23:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.442+0000 7f6caaed9700 1 -- start start 2023-10-06T02:23:19.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.442+0000 7f6caaed9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ca40b3840 0x7f6ca415ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.442+0000 7f6caaed9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ca41596d0 0x7f6ca40cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.442+0000 7f6caaed9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ca4159aa0 0x7f6ca4153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.442+0000 7f6caaed9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca409ab40 con 0x7f6ca40b3840 2023-10-06T02:23:19.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.442+0000 7f6caaed9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca4153f40 con 0x7f6ca41596d0 2023-10-06T02:23:19.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.442+0000 7f6caaed9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca415e620 con 0x7f6ca4159aa0 2023-10-06T02:23:19.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.443+0000 7f6ca8c75700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ca40b3840 0x7f6ca415ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.443+0000 7f6ca8c75700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ca40b3840 0x7f6ca415ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33014/0 (socket says 172.21.15.37:33014) 2023-10-06T02:23:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.443+0000 7f6ca8c75700 1 -- 172.21.15.37:0/553549427 learned_addr learned my addr 172.21.15.37:0/553549427 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.443+0000 7f6ca3fff700 1 --2- 172.21.15.37:0/553549427 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ca41596d0 0x7f6ca40cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.443+0000 7f6ca9476700 1 --2- 172.21.15.37:0/553549427 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ca4159aa0 0x7f6ca4153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.443+0000 7f6ca8c75700 1 -- 172.21.15.37:0/553549427 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ca4159aa0 msgr2=0x7f6ca4153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.443+0000 7f6ca8c75700 1 --2- 172.21.15.37:0/553549427 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ca4159aa0 0x7f6ca4153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.443+0000 7f6ca8c75700 1 -- 172.21.15.37:0/553549427 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ca41596d0 msgr2=0x7f6ca40cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.443+0000 7f6ca8c75700 1 --2- 172.21.15.37:0/553549427 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ca41596d0 0x7f6ca40cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.443+0000 7f6ca8c75700 1 -- 172.21.15.37:0/553549427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c980094f0 con 0x7f6ca40b3840 2023-10-06T02:23:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.443+0000 7f6ca8c75700 1 --2- 172.21.15.37:0/553549427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ca40b3840 0x7f6ca415ef60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009f10 tx=0x7f6c9c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.443+0000 7f6ca0ff9700 1 -- 172.21.15.37:0/553549427 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c00cb70 con 0x7f6ca40b3840 2023-10-06T02:23:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.443+0000 7f6ca0ff9700 1 -- 172.21.15.37:0/553549427 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9c00f040 con 0x7f6ca40b3840 2023-10-06T02:23:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.443+0000 7f6caaed9700 1 -- 172.21.15.37:0/553549427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca415e900 con 0x7f6ca40b3840 2023-10-06T02:23:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.443+0000 7f6ca0ff9700 1 -- 172.21.15.37:0/553549427 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c014480 con 0x7f6ca40b3840 2023-10-06T02:23:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.443+0000 7f6caaed9700 1 -- 172.21.15.37:0/553549427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca409b280 con 0x7f6ca40b3840 2023-10-06T02:23:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.444+0000 7f6caaed9700 1 -- 172.21.15.37:0/553549427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca406fbf0 con 0x7f6ca40b3840 2023-10-06T02:23:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.445+0000 7f6ca0ff9700 1 -- 172.21.15.37:0/553549427 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c9c014830 con 0x7f6ca40b3840 2023-10-06T02:23:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.445+0000 7f6ca0ff9700 1 --2- 172.21.15.37:0/553549427 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6c90066f30 0x7f6c900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.445+0000 7f6ca0ff9700 1 -- 172.21.15.37:0/553549427 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6c9c085040 con 0x7f6ca40b3840 2023-10-06T02:23:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.445+0000 7f6ca3fff700 1 --2- 172.21.15.37:0/553549427 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6c90066f30 0x7f6c900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.446+0000 7f6ca3fff700 1 --2- 172.21.15.37:0/553549427 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6c90066f30 0x7f6c900693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6c980099b0 tx=0x7f6c98017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.449+0000 7f6ca0ff9700 1 -- 172.21.15.37:0/553549427 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c9c052150 con 0x7f6ca40b3840 2023-10-06T02:23:19.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.643+0000 7f6caaed9700 1 -- 172.21.15.37:0/553549427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ca40cc2f0 con 0x7f6ca40b3840 2023-10-06T02:23:19.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.644+0000 7f6ca0ff9700 1 -- 172.21.15.37:0/553549427 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f6c9c055770 con 0x7f6ca40b3840 2023-10-06T02:23:19.645 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:19.645 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:23:16.897625+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:13.004596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:14.268809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:19.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.646+0000 7f6caaed9700 1 -- 172.21.15.37:0/553549427 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6c90066f30 msgr2=0x7f6c900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.646+0000 7f6caaed9700 1 --2- 172.21.15.37:0/553549427 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6c90066f30 0x7f6c900693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6c980099b0 tx=0x7f6c98017000 comp rx=0 tx=0).stop 2023-10-06T02:23:19.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.646+0000 7f6caaed9700 1 -- 172.21.15.37:0/553549427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ca40b3840 msgr2=0x7f6ca415ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.646+0000 7f6caaed9700 1 --2- 172.21.15.37:0/553549427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ca40b3840 0x7f6ca415ef60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009f10 tx=0x7f6c9c00b040 comp rx=0 tx=0).stop 2023-10-06T02:23:19.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.646+0000 7f6caaed9700 1 -- 172.21.15.37:0/553549427 shutdown_connections 2023-10-06T02:23:19.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.646+0000 7f6caaed9700 1 --2- 172.21.15.37:0/553549427 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ca4159aa0 0x7f6ca4153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.646+0000 7f6caaed9700 1 --2- 172.21.15.37:0/553549427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ca40b3840 0x7f6ca415ef60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.646+0000 7f6caaed9700 1 --2- 172.21.15.37:0/553549427 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6c90066f30 0x7f6c900693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.646+0000 7f6caaed9700 1 --2- 172.21.15.37:0/553549427 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ca41596d0 0x7f6ca40cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.646+0000 7f6caaed9700 1 -- 172.21.15.37:0/553549427 >> 172.21.15.37:0/553549427 conn(0x7f6ca406c890 msgr2=0x7f6ca41573f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:19.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.646+0000 7f6caaed9700 1 -- 172.21.15.37:0/553549427 shutdown_connections 2023-10-06T02:23:19.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.646+0000 7f6caaed9700 1 -- 172.21.15.37:0/553549427 wait complete. 2023-10-06T02:23:19.660 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:23:19.660 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:23:19.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.778+0000 7fb9831d5700 1 Processor -- start 2023-10-06T02:23:19.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.778+0000 7fb9831d5700 1 -- start start 2023-10-06T02:23:19.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.778+0000 7fb9831d5700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb97c0c63a0 0x7fb97c15daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.778+0000 7fb9831d5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb97c15dfe0 0x7fb97c0cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.778+0000 7fb9831d5700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97c0cb650 con 0x7fb97c159760 2023-10-06T02:23:19.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.778+0000 7fb9831d5700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb97c0cc2d0 con 0x7fb97c0c63a0 2023-10-06T02:23:19.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.778+0000 7fb9831d5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c0cb930 con 0x7fb97c15dfe0 2023-10-06T02:23:19.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.778+0000 7fb980f71700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb97c159760 0x7fb97c15d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40876/0 (socket says 172.21.15.37:40876) 2023-10-06T02:23:19.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.778+0000 7fb980f71700 1 -- 172.21.15.37:0/1677963231 learned_addr learned my addr 172.21.15.37:0/1677963231 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:19.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.779+0000 7fb981772700 1 --2- 172.21.15.37:0/1677963231 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb97c15dfe0 0x7fb97c0cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.779+0000 7fb97bfff700 1 --2- 172.21.15.37:0/1677963231 >> v2:172.21.15.191:3300/0 conn(0x7fb97c0c63a0 0x7fb97c15daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.779+0000 7fb97b7fe700 1 -- 172.21.15.37:0/1677963231 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594575443 0 0) 0x7fb97c0cb650 con 0x7fb97c159760 2023-10-06T02:23:19.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.779+0000 7fb97b7fe700 1 -- 172.21.15.37:0/1677963231 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb964003570 con 0x7fb97c159760 2023-10-06T02:23:19.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.779+0000 7fb97b7fe700 1 -- 172.21.15.37:0/1677963231 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4058047581 0 0) 0x7fb964003570 con 0x7fb97c159760 2023-10-06T02:23:19.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.779+0000 7fb97bfff700 1 -- 172.21.15.37:0/1677963231 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb97c15dfe0 msgr2=0x7fb97c0cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:19.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.779+0000 7fb97bfff700 1 --2- 172.21.15.37:0/1677963231 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb97c15dfe0 0x7fb97c0cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.779+0000 7fb97bfff700 1 -- 172.21.15.37:0/1677963231 >> v1:172.21.15.37:6789/0 conn(0x7fb97c159760 legacy=0x7fb97c15d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.779+0000 7fb97bfff700 1 -- 172.21.15.37:0/1677963231 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c0cbc10 con 0x7fb97c0c63a0 2023-10-06T02:23:19.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.779+0000 7fb981772700 1 --2- 172.21.15.37:0/1677963231 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb97c15dfe0 0x7fb97c0cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:19.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.779+0000 7fb97bfff700 1 --2- 172.21.15.37:0/1677963231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb97c0c63a0 0x7fb97c15daa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb9700098e0 tx=0x7fb9700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2d4a32160f3bec0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:19.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.779+0000 7fb97b7fe700 1 -- 172.21.15.37:0/1677963231 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9740017f0 con 0x7fb97c0c63a0 2023-10-06T02:23:19.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.779+0000 7fb97b7fe700 1 -- 172.21.15.37:0/1677963231 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb970011420 con 0x7fb97c0c63a0 2023-10-06T02:23:19.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.779+0000 7fb97b7fe700 1 -- 172.21.15.37:0/1677963231 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9700117a0 con 0x7fb97c0c63a0 2023-10-06T02:23:19.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.780+0000 7fb9831d5700 1 -- 172.21.15.37:0/1677963231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb97c0c63a0 msgr2=0x7fb97c15daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.780+0000 7fb9831d5700 1 --2- 172.21.15.37:0/1677963231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb97c0c63a0 0x7fb97c15daa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb9700098e0 tx=0x7fb9700091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.780+0000 7fb9831d5700 1 -- 172.21.15.37:0/1677963231 shutdown_connections 2023-10-06T02:23:19.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.780+0000 7fb9831d5700 1 --2- 172.21.15.37:0/1677963231 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb97c15dfe0 0x7fb97c0cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.780+0000 7fb9831d5700 1 --2- 172.21.15.37:0/1677963231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb97c0c63a0 0x7fb97c15daa0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.780+0000 7fb9831d5700 1 -- 172.21.15.37:0/1677963231 >> 172.21.15.37:0/1677963231 conn(0x7fb97c06c890 msgr2=0x7fb97c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:19.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.780+0000 7fb9831d5700 1 -- 172.21.15.37:0/1677963231 shutdown_connections 2023-10-06T02:23:19.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.780+0000 7fb9831d5700 1 -- 172.21.15.37:0/1677963231 wait complete. 2023-10-06T02:23:19.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.781+0000 7fb9831d5700 1 Processor -- start 2023-10-06T02:23:19.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.781+0000 7fb9831d5700 1 -- start start 2023-10-06T02:23:19.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.782+0000 7fb9831d5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb97c0c63a0 0x7fb97c0b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.782+0000 7fb9831d5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb97c159760 0x7fb97c16a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.782+0000 7fb9831d5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb97c15dfe0 0x7fb97c158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.782+0000 7fb9831d5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c0b4d00 con 0x7fb97c15dfe0 2023-10-06T02:23:19.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.782+0000 7fb9831d5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c16aac0 con 0x7fb97c159760 2023-10-06T02:23:19.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.782+0000 7fb9831d5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c0b4330 con 0x7fb97c0c63a0 2023-10-06T02:23:19.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.782+0000 7fb981772700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb97c15dfe0 0x7fb97c158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.782+0000 7fb981772700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb97c15dfe0 0x7fb97c158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33022/0 (socket says 172.21.15.37:33022) 2023-10-06T02:23:19.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.782+0000 7fb981772700 1 -- 172.21.15.37:0/708018665 learned_addr learned my addr 172.21.15.37:0/708018665 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:19.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.782+0000 7fb97bfff700 1 --2- 172.21.15.37:0/708018665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb97c159760 0x7fb97c16a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.782+0000 7fb980f71700 1 --2- 172.21.15.37:0/708018665 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb97c0c63a0 0x7fb97c0b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.782+0000 7fb981772700 1 -- 172.21.15.37:0/708018665 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb97c0c63a0 msgr2=0x7fb97c0b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.782+0000 7fb981772700 1 --2- 172.21.15.37:0/708018665 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb97c0c63a0 0x7fb97c0b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.782+0000 7fb981772700 1 -- 172.21.15.37:0/708018665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb97c159760 msgr2=0x7fb97c16a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.782+0000 7fb981772700 1 --2- 172.21.15.37:0/708018665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb97c159760 0x7fb97c16a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.782+0000 7fb981772700 1 -- 172.21.15.37:0/708018665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c009420 con 0x7fb97c15dfe0 2023-10-06T02:23:19.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.782+0000 7fb980f71700 1 --2- 172.21.15.37:0/708018665 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb97c0c63a0 0x7fb97c0b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:19.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.782+0000 7fb981772700 1 --2- 172.21.15.37:0/708018665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb97c15dfe0 0x7fb97c158890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb96c00ea20 tx=0x7fb96c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:19.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.783+0000 7fb978ff9700 1 -- 172.21.15.37:0/708018665 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c00c850 con 0x7fb97c15dfe0 2023-10-06T02:23:19.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.783+0000 7fb978ff9700 1 -- 172.21.15.37:0/708018665 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c00c9b0 con 0x7fb97c15dfe0 2023-10-06T02:23:19.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.783+0000 7fb9831d5700 1 -- 172.21.15.37:0/708018665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb970009420 con 0x7fb97c15dfe0 2023-10-06T02:23:19.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.783+0000 7fb978ff9700 1 -- 172.21.15.37:0/708018665 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c00cd70 con 0x7fb97c15dfe0 2023-10-06T02:23:19.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.783+0000 7fb9831d5700 1 -- 172.21.15.37:0/708018665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97c0b3720 con 0x7fb97c15dfe0 2023-10-06T02:23:19.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.784+0000 7fb9831d5700 1 -- 172.21.15.37:0/708018665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97c06fbf0 con 0x7fb97c15dfe0 2023-10-06T02:23:19.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.784+0000 7fb978ff9700 1 -- 172.21.15.37:0/708018665 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb96c013680 con 0x7fb97c15dfe0 2023-10-06T02:23:19.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.785+0000 7fb978ff9700 1 --2- 172.21.15.37:0/708018665 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb968066f30 0x7fb9680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:19.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.785+0000 7fb978ff9700 1 -- 172.21.15.37:0/708018665 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb96c084640 con 0x7fb97c15dfe0 2023-10-06T02:23:19.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.785+0000 7fb980f71700 1 --2- 172.21.15.37:0/708018665 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb968066f30 0x7fb9680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:19.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.785+0000 7fb980f71700 1 --2- 172.21.15.37:0/708018665 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb968066f30 0x7fb9680693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb974001fb0 tx=0x7fb974007f30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:19.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.789+0000 7fb978ff9700 1 -- 172.21.15.37:0/708018665 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb96c051750 con 0x7fb97c15dfe0 2023-10-06T02:23:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.979+0000 7fb9831d5700 1 -- 172.21.15.37:0/708018665 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb97c04bb80 con 0x7fb968066f30 2023-10-06T02:23:19.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.987+0000 7fb978ff9700 1 -- 172.21.15.37:0/708018665 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272189 (secure 0 0 0) 0x7fb97c04bb80 con 0x7fb968066f30 2023-10-06T02:23:19.990 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:19.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.990+0000 7fb9831d5700 1 -- 172.21.15.37:0/708018665 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb968066f30 msgr2=0x7fb9680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.990+0000 7fb9831d5700 1 --2- 172.21.15.37:0/708018665 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb968066f30 0x7fb9680693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb974001fb0 tx=0x7fb974007f30 comp rx=0 tx=0).stop 2023-10-06T02:23:19.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.990+0000 7fb9831d5700 1 -- 172.21.15.37:0/708018665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb97c15dfe0 msgr2=0x7fb97c158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:19.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.990+0000 7fb9831d5700 1 --2- 172.21.15.37:0/708018665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb97c15dfe0 0x7fb97c158890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb96c00ea20 tx=0x7fb96c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.990+0000 7fb9831d5700 1 -- 172.21.15.37:0/708018665 shutdown_connections 2023-10-06T02:23:19.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.990+0000 7fb9831d5700 1 --2- 172.21.15.37:0/708018665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb97c15dfe0 0x7fb97c158890 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.990+0000 7fb9831d5700 1 --2- 172.21.15.37:0/708018665 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb97c0c63a0 0x7fb97c0b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.990+0000 7fb9831d5700 1 --2- 172.21.15.37:0/708018665 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb968066f30 0x7fb9680693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.990+0000 7fb9831d5700 1 --2- 172.21.15.37:0/708018665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb97c159760 0x7fb97c16a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:19.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.990+0000 7fb9831d5700 1 -- 172.21.15.37:0/708018665 >> 172.21.15.37:0/708018665 conn(0x7fb97c06c890 msgr2=0x7fb97c06de40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:19.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.990+0000 7fb9831d5700 1 -- 172.21.15.37:0/708018665 shutdown_connections 2023-10-06T02:23:19.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:19.990+0000 7fb9831d5700 1 -- 172.21.15.37:0/708018665 wait complete. 2023-10-06T02:23:19.994 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:23:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-06T02:23:18.508265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381360,"kb_used_data":2364,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593360,"statfs":{"total":773094113280,"available":770655600640,"internally_reserved":0,"allocated":2420736,"data_stored":1557965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.629867"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T02:23:10.475883+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:23:10.475883+0000","last_peered":"2023-10-06T02:23:10.475883+0000","last_clean":"2023-10-06T02:23:10.475883+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:23:10.475883+0000","last_undegraded":"2023-10-06T02:23:10.475883+0000","last_fullsized":"2023-10-06T02:23:10.475883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T02:23:09.821820+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:23:09.821820+0000","last_peered":"2023-10-06T02:23:09.821820+0000","last_clean":"2023-10-06T02:23:09.821820+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:23:09.821820+0000","last_undegraded":"2023-10-06T02:23:09.821820+0000","last_fullsized":"2023-10-06T02:23:09.821820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T02:23:09.834025+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:23:09.834025+0000","last_peered":"2023-10-06T02:23:09.834025+0000","last_clean":"2023-10-06T02:23:09.834025+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:23:09.834025+0000","last_undegraded":"2023-10-06T02:23:09.834025+0000","last_fullsized":"2023-10-06T02:23:09.834025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":159,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-06T02:23:10.943140+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:23:10.943140+0000","last_peered":"2023-10-06T02:23:10.943140+0000","last_clean":"2023-10-06T02:23:10.943140+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:23:10.943140+0000","last_undegraded":"2023-10-06T02:23:10.943140+0000","last_fullsized":"2023-10-06T02:23:10.943140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T02:23:10.569825+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:23:10.569825+0000","last_peered":"2023-10-06T02:23:10.569825+0000","last_clean":"2023-10-06T02:23:10.569825+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:23:10.569825+0000","last_undegraded":"2023-10-06T02:23:10.569825+0000","last_fullsized":"2023-10-06T02:23:10.569825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T02:23:10.569774+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:23:10.569774+0000","last_peered":"2023-10-06T02:23:10.569774+0000","last_clean":"2023-10-06T02:23:10.569774+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:23:10.569774+0000","last_undegraded":"2023-10-06T02:23:10.569774+0000","last_fullsized":"2023-10-06T02:23:10.569774+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T02:23:10.569621+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:23:10.569621+0000","last_peered":"2023-10-06T02:23:10.569621+0000","last_clean":"2023-10-06T02:23:10.569621+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:23:10.569621+0000","last_undegraded":"2023-10-06T02:23:10.569621+0000","last_fullsized":"2023-10-06T02:23:10.569621+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T02:23:10.572517+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:23:10.572517+0000","last_peered":"2023-10-06T02:23:10.572517+0000","last_clean":"2023-10-06T02:23:10.572517+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:23:10.572517+0000","last_undegraded":"2023-10-06T02:23:10.572517+0000","last_fullsized":"2023-10-06T02:23:10.572517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T02:23:09.821878+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:23:09.821878+0000","last_peered":"2023-10-06T02:23:09.821878+0000","last_clean":"2023-10-06T02:23:09.821878+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:23:09.821878+0000","last_undegraded":"2023-10-06T02:23:09.821878+0000","last_fullsized":"2023-10-06T02:23:09.821878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":749568,"data_stored":638029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":46308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298584,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073256,"statfs":{"total":96636764160,"available":96331014144,"internally_reserved":0,"allocated":749568,"data_stored":638029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":46308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":47661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":46308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":47661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":47661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:23:20.008 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:23:20.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.161+0000 7f61b2fe9700 1 Processor -- start 2023-10-06T02:23:20.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.161+0000 7f61b2fe9700 1 -- start start 2023-10-06T02:23:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.162+0000 7f61b2fe9700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f61ac0b0620 0x7f61ac159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.162+0000 7f61b2fe9700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ac0cb200 con 0x7f61ac159370 2023-10-06T02:23:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.162+0000 7f61b2fe9700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ac0cb7c0 con 0x7f61ac0b2270 2023-10-06T02:23:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.162+0000 7f61b2fe9700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ac0b5c00 con 0x7f61ac0b0620 2023-10-06T02:23:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.162+0000 7f61b17e6700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f61ac0b0620 0x7f61ac159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.162+0000 7f61b27e8700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f61ac0b2270 0x7f61ac0cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:37794/0 (socket says 172.21.15.37:37794) 2023-10-06T02:23:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.162+0000 7f61b1fe7700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f61ac159370 0x7f61ac0aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40884/0 (socket says 172.21.15.37:40884) 2023-10-06T02:23:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.162+0000 7f61b27e8700 1 -- 172.21.15.37:0/1356808011 learned_addr learned my addr 172.21.15.37:0/1356808011 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.162+0000 7f61b0fe5700 1 -- 172.21.15.37:0/1356808011 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202130542 0 0) 0x7f61ac0cb200 con 0x7f61ac159370 2023-10-06T02:23:20.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.162+0000 7f61b0fe5700 1 -- 172.21.15.37:0/1356808011 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6194003570 con 0x7f61ac159370 2023-10-06T02:23:20.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.162+0000 7f61b17e6700 1 -- 172.21.15.37:0/1356808011 >> v1:172.21.15.191:6789/0 conn(0x7f61ac0b2270 legacy=0x7f61ac0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:20.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.162+0000 7f61b17e6700 1 -- 172.21.15.37:0/1356808011 >> v1:172.21.15.37:6789/0 conn(0x7f61ac159370 legacy=0x7f61ac0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:20.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.162+0000 7f61b17e6700 1 -- 172.21.15.37:0/1356808011 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac0b2750 con 0x7f61ac0b0620 2023-10-06T02:23:20.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.163+0000 7f61b17e6700 1 --2- 172.21.15.37:0/1356808011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61ac0b0620 0x7f61ac159740 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f61a00098e0 tx=0x7f61a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12702fbf3cdd206c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:20.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.163+0000 7f61b0fe5700 1 -- 172.21.15.37:0/1356808011 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a000b640 con 0x7f61ac0b0620 2023-10-06T02:23:20.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.163+0000 7f61b0fe5700 1 -- 172.21.15.37:0/1356808011 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a000b7a0 con 0x7f61ac0b0620 2023-10-06T02:23:20.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.163+0000 7f61b0fe5700 1 -- 172.21.15.37:0/1356808011 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a000bb20 con 0x7f61ac0b0620 2023-10-06T02:23:20.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.163+0000 7f61b2fe9700 1 -- 172.21.15.37:0/1356808011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61ac0b0620 msgr2=0x7f61ac159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:20.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.163+0000 7f61b2fe9700 1 --2- 172.21.15.37:0/1356808011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61ac0b0620 0x7f61ac159740 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f61a00098e0 tx=0x7f61a00091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.163+0000 7f61b2fe9700 1 -- 172.21.15.37:0/1356808011 shutdown_connections 2023-10-06T02:23:20.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.163+0000 7f61b2fe9700 1 --2- 172.21.15.37:0/1356808011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61ac0b0620 0x7f61ac159740 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.163+0000 7f61b2fe9700 1 -- 172.21.15.37:0/1356808011 >> 172.21.15.37:0/1356808011 conn(0x7f61ac06c0b0 msgr2=0x7f61ac06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:20.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.163+0000 7f61b2fe9700 1 -- 172.21.15.37:0/1356808011 shutdown_connections 2023-10-06T02:23:20.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.164+0000 7f61b2fe9700 1 -- 172.21.15.37:0/1356808011 wait complete. 2023-10-06T02:23:20.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.165+0000 7f61b2fe9700 1 Processor -- start 2023-10-06T02:23:20.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.165+0000 7f61b2fe9700 1 -- start start 2023-10-06T02:23:20.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.165+0000 7f61b2fe9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61ac0b0620 0x7f61ac16a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:20.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.165+0000 7f61b2fe9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61ac0b2270 0x7f61ac16af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.165+0000 7f61b2fe9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61ac159370 0x7f61ac15b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.165+0000 7f61b2fe9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac16d150 con 0x7f61ac0b0620 2023-10-06T02:23:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.165+0000 7f61b2fe9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac0ceff0 con 0x7f61ac0b2270 2023-10-06T02:23:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.165+0000 7f61b2fe9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac16ad30 con 0x7f61ac159370 2023-10-06T02:23:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.165+0000 7f61b1fe7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61ac0b0620 0x7f61ac16a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.165+0000 7f61b1fe7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61ac0b0620 0x7f61ac16a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33024/0 (socket says 172.21.15.37:33024) 2023-10-06T02:23:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.165+0000 7f61b1fe7700 1 -- 172.21.15.37:0/1712073923 learned_addr learned my addr 172.21.15.37:0/1712073923 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.166+0000 7f61b17e6700 1 --2- 172.21.15.37:0/1712073923 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61ac0b2270 0x7f61ac16af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.166+0000 7f61b27e8700 1 --2- 172.21.15.37:0/1712073923 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61ac159370 0x7f61ac15b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.166+0000 7f61b1fe7700 1 -- 172.21.15.37:0/1712073923 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61ac159370 msgr2=0x7f61ac15b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.166+0000 7f61b1fe7700 1 --2- 172.21.15.37:0/1712073923 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61ac159370 0x7f61ac15b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.166+0000 7f61b1fe7700 1 -- 172.21.15.37:0/1712073923 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61ac0b2270 msgr2=0x7f61ac16af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:20.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.166+0000 7f61b1fe7700 1 --2- 172.21.15.37:0/1712073923 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61ac0b2270 0x7f61ac16af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.166+0000 7f61b1fe7700 1 -- 172.21.15.37:0/1712073923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a0009420 con 0x7f61ac0b0620 2023-10-06T02:23:20.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.166+0000 7f61b27e8700 1 --2- 172.21.15.37:0/1712073923 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61ac159370 0x7f61ac15b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:20.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.166+0000 7f61b1fe7700 1 --2- 172.21.15.37:0/1712073923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61ac0b0620 0x7f61ac16a7f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f619c00cd00 tx=0x7f619c001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:20.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.166+0000 7f61a9ffb700 1 -- 172.21.15.37:0/1712073923 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c00ce60 con 0x7f61ac0b0620 2023-10-06T02:23:20.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.166+0000 7f61a9ffb700 1 -- 172.21.15.37:0/1712073923 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619c005df0 con 0x7f61ac0b0620 2023-10-06T02:23:20.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.166+0000 7f61b2fe9700 1 -- 172.21.15.37:0/1712073923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ac16b480 con 0x7f61ac0b0620 2023-10-06T02:23:20.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.166+0000 7f61a9ffb700 1 -- 172.21.15.37:0/1712073923 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c00ab90 con 0x7f61ac0b0620 2023-10-06T02:23:20.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.166+0000 7f61b2fe9700 1 -- 172.21.15.37:0/1712073923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ac0ce6c0 con 0x7f61ac0b0620 2023-10-06T02:23:20.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.167+0000 7f61a9ffb700 1 -- 172.21.15.37:0/1712073923 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f619c0070f0 con 0x7f61ac0b0620 2023-10-06T02:23:20.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.167+0000 7f61b2fe9700 1 -- 172.21.15.37:0/1712073923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ac064b00 con 0x7f61ac0b0620 2023-10-06T02:23:20.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.168+0000 7f61a9ffb700 1 --2- 172.21.15.37:0/1712073923 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6198066f30 0x7f61980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:20.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.168+0000 7f61a9ffb700 1 -- 172.21.15.37:0/1712073923 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f619c084850 con 0x7f61ac0b0620 2023-10-06T02:23:20.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.168+0000 7f61b17e6700 1 --2- 172.21.15.37:0/1712073923 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6198066f30 0x7f61980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:20.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.168+0000 7f61b17e6700 1 --2- 172.21.15.37:0/1712073923 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6198066f30 0x7f61980693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f61a00093f0 tx=0x7f61a0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:20.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.172+0000 7f61a9ffb700 1 -- 172.21.15.37:0/1712073923 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f619c051940 con 0x7f61ac0b0620 2023-10-06T02:23:20.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.361+0000 7f61b2fe9700 1 -- 172.21.15.37:0/1712073923 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61ac0b2a30 con 0x7f6198066f30 2023-10-06T02:23:20.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.368+0000 7f61a9ffb700 1 -- 172.21.15.37:0/1712073923 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272189 (secure 0 0 0) 0x7f61ac0b2a30 con 0x7f6198066f30 2023-10-06T02:23:20.375 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:20.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.371+0000 7f61b2fe9700 1 -- 172.21.15.37:0/1712073923 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6198066f30 msgr2=0x7f61980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:20.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.371+0000 7f61b2fe9700 1 --2- 172.21.15.37:0/1712073923 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6198066f30 0x7f61980693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f61a00093f0 tx=0x7f61a0017000 comp rx=0 tx=0).stop 2023-10-06T02:23:20.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.371+0000 7f61b2fe9700 1 -- 172.21.15.37:0/1712073923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61ac0b0620 msgr2=0x7f61ac16a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:20.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.371+0000 7f61b2fe9700 1 --2- 172.21.15.37:0/1712073923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61ac0b0620 0x7f61ac16a7f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f619c00cd00 tx=0x7f619c001b30 comp rx=0 tx=0).stop 2023-10-06T02:23:20.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.371+0000 7f61b2fe9700 1 -- 172.21.15.37:0/1712073923 shutdown_connections 2023-10-06T02:23:20.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.371+0000 7f61b2fe9700 1 --2- 172.21.15.37:0/1712073923 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61ac159370 0x7f61ac15b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.371+0000 7f61b2fe9700 1 --2- 172.21.15.37:0/1712073923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61ac0b0620 0x7f61ac16a7f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.371+0000 7f61b2fe9700 1 --2- 172.21.15.37:0/1712073923 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6198066f30 0x7f61980693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.371+0000 7f61b2fe9700 1 --2- 172.21.15.37:0/1712073923 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61ac0b2270 0x7f61ac16af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.371+0000 7f61b2fe9700 1 -- 172.21.15.37:0/1712073923 >> 172.21.15.37:0/1712073923 conn(0x7f61ac06c0b0 msgr2=0x7f61ac0c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:20.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.371+0000 7f61b2fe9700 1 -- 172.21.15.37:0/1712073923 shutdown_connections 2023-10-06T02:23:20.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.372+0000 7f61b2fe9700 1 -- 172.21.15.37:0/1712073923 wait complete. 2023-10-06T02:23:20.379 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:23:20.383 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-06T02:23:18.508265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381360,"kb_used_data":2364,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593360,"statfs":{"total":773094113280,"available":770655600640,"internally_reserved":0,"allocated":2420736,"data_stored":1557965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.629867"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T02:23:10.475883+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:23:10.475883+0000","last_peered":"2023-10-06T02:23:10.475883+0000","last_clean":"2023-10-06T02:23:10.475883+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:23:10.475883+0000","last_undegraded":"2023-10-06T02:23:10.475883+0000","last_fullsized":"2023-10-06T02:23:10.475883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T02:23:09.821820+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:23:09.821820+0000","last_peered":"2023-10-06T02:23:09.821820+0000","last_clean":"2023-10-06T02:23:09.821820+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:23:09.821820+0000","last_undegraded":"2023-10-06T02:23:09.821820+0000","last_fullsized":"2023-10-06T02:23:09.821820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T02:23:09.834025+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:23:09.834025+0000","last_peered":"2023-10-06T02:23:09.834025+0000","last_clean":"2023-10-06T02:23:09.834025+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:23:09.834025+0000","last_undegraded":"2023-10-06T02:23:09.834025+0000","last_fullsized":"2023-10-06T02:23:09.834025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":159,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-06T02:23:10.943140+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:23:10.943140+0000","last_peered":"2023-10-06T02:23:10.943140+0000","last_clean":"2023-10-06T02:23:10.943140+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:23:10.943140+0000","last_undegraded":"2023-10-06T02:23:10.943140+0000","last_fullsized":"2023-10-06T02:23:10.943140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T02:23:10.569825+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:23:10.569825+0000","last_peered":"2023-10-06T02:23:10.569825+0000","last_clean":"2023-10-06T02:23:10.569825+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:23:10.569825+0000","last_undegraded":"2023-10-06T02:23:10.569825+0000","last_fullsized":"2023-10-06T02:23:10.569825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T02:23:10.569774+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:23:10.569774+0000","last_peered":"2023-10-06T02:23:10.569774+0000","last_clean":"2023-10-06T02:23:10.569774+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:23:10.569774+0000","last_undegraded":"2023-10-06T02:23:10.569774+0000","last_fullsized":"2023-10-06T02:23:10.569774+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T02:23:10.569621+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:23:10.569621+0000","last_peered":"2023-10-06T02:23:10.569621+0000","last_clean":"2023-10-06T02:23:10.569621+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:23:10.569621+0000","last_undegraded":"2023-10-06T02:23:10.569621+0000","last_fullsized":"2023-10-06T02:23:10.569621+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T02:23:10.572517+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:23:10.572517+0000","last_peered":"2023-10-06T02:23:10.572517+0000","last_clean":"2023-10-06T02:23:10.572517+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:23:10.572517+0000","last_undegraded":"2023-10-06T02:23:10.572517+0000","last_fullsized":"2023-10-06T02:23:10.572517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T02:23:09.821878+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:23:09.821878+0000","last_peered":"2023-10-06T02:23:09.821878+0000","last_clean":"2023-10-06T02:23:09.821878+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:23:09.821878+0000","last_undegraded":"2023-10-06T02:23:09.821878+0000","last_fullsized":"2023-10-06T02:23:09.821878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:13.872192+0000","last_change":"2023-10-06T02:23:13.872192+0000","last_active":"2023-10-06T02:23:13.872192+0000","last_peered":"2023-10-06T02:23:13.872192+0000","last_clean":"2023-10-06T02:23:13.872192+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:13.872192+0000","last_undegraded":"2023-10-06T02:23:13.872192+0000","last_fullsized":"2023-10-06T02:23:13.872192+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:23:14.877714+0000","last_change":"2023-10-06T02:23:14.877714+0000","last_active":"2023-10-06T02:23:14.877714+0000","last_peered":"2023-10-06T02:23:14.877714+0000","last_clean":"2023-10-06T02:23:14.877714+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:23:14.877714+0000","last_undegraded":"2023-10-06T02:23:14.877714+0000","last_fullsized":"2023-10-06T02:23:14.877714+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":749568,"data_stored":638029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":46308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298584,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073256,"statfs":{"total":96636764160,"available":96331014144,"internally_reserved":0,"allocated":749568,"data_stored":638029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":46308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":47661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":46308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":47661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":47661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:23:20.392 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:23:20.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.543+0000 7fb395489700 1 Processor -- start 2023-10-06T02:23:20.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.543+0000 7fb395489700 1 -- start start 2023-10-06T02:23:20.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.544+0000 7fb395489700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb3900b2270 0x7fb390159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:20.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.544+0000 7fb395489700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3900cb200 con 0x7fb3900b0620 2023-10-06T02:23:20.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.544+0000 7fb395489700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3900cb7c0 con 0x7fb390159370 2023-10-06T02:23:20.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.544+0000 7fb395489700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3900b5c00 con 0x7fb3900b2270 2023-10-06T02:23:20.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.544+0000 7fb394c88700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb3900b2270 0x7fb390159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:20.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.544+0000 7fb38f7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb3900b0620 0x7fb3900cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40900/0 (socket says 172.21.15.37:40900) 2023-10-06T02:23:20.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.544+0000 7fb38f7fe700 1 -- 172.21.15.37:0/3496611147 learned_addr learned my addr 172.21.15.37:0/3496611147 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:20.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.544+0000 7fb394c88700 1 -- 172.21.15.37:0/3496611147 >> v1:172.21.15.191:6789/0 conn(0x7fb390159370 legacy=0x7fb3900aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:20.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.544+0000 7fb394c88700 1 -- 172.21.15.37:0/3496611147 >> v1:172.21.15.37:6789/0 conn(0x7fb3900b0620 legacy=0x7fb3900cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:20.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.544+0000 7fb394c88700 1 -- 172.21.15.37:0/3496611147 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3900b2750 con 0x7fb3900b2270 2023-10-06T02:23:20.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.544+0000 7fb38effd700 1 -- 172.21.15.37:0/3496611147 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576006249 0 0) 0x7fb3900cb200 con 0x7fb3900b0620 2023-10-06T02:23:20.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.545+0000 7fb394c88700 1 --2- 172.21.15.37:0/3496611147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3900b2270 0x7fb390159740 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb388009e60 tx=0x7fb388009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da026ad4416b92a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:20.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.545+0000 7fb38effd700 1 -- 172.21.15.37:0/3496611147 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38800e070 con 0x7fb3900b2270 2023-10-06T02:23:20.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.545+0000 7fb38effd700 1 -- 172.21.15.37:0/3496611147 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38800bc30 con 0x7fb3900b2270 2023-10-06T02:23:20.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.545+0000 7fb38effd700 1 -- 172.21.15.37:0/3496611147 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388012430 con 0x7fb3900b2270 2023-10-06T02:23:20.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.545+0000 7fb395489700 1 -- 172.21.15.37:0/3496611147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3900b2270 msgr2=0x7fb390159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:20.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.545+0000 7fb395489700 1 --2- 172.21.15.37:0/3496611147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3900b2270 0x7fb390159740 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb388009e60 tx=0x7fb388009780 comp rx=0 tx=0).stop 2023-10-06T02:23:20.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.545+0000 7fb395489700 1 -- 172.21.15.37:0/3496611147 shutdown_connections 2023-10-06T02:23:20.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.545+0000 7fb395489700 1 --2- 172.21.15.37:0/3496611147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3900b2270 0x7fb390159740 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.545+0000 7fb395489700 1 -- 172.21.15.37:0/3496611147 >> 172.21.15.37:0/3496611147 conn(0x7fb39006c0b0 msgr2=0x7fb39006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:20.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.545+0000 7fb395489700 1 -- 172.21.15.37:0/3496611147 shutdown_connections 2023-10-06T02:23:20.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.545+0000 7fb395489700 1 -- 172.21.15.37:0/3496611147 wait complete. 2023-10-06T02:23:20.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.546+0000 7fb395489700 1 Processor -- start 2023-10-06T02:23:20.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.547+0000 7fb395489700 1 -- start start 2023-10-06T02:23:20.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.547+0000 7fb395489700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3900b0620 0x7fb3900d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:20.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.547+0000 7fb395489700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3900b2270 0x7fb390151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:20.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.547+0000 7fb395489700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb390159370 0x7fb3900cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:20.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.547+0000 7fb395489700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3900c84f0 con 0x7fb390159370 2023-10-06T02:23:20.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.547+0000 7fb395489700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3900c78e0 con 0x7fb3900b2270 2023-10-06T02:23:20.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.547+0000 7fb395489700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3900c7bc0 con 0x7fb3900b0620 2023-10-06T02:23:20.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.547+0000 7fb394c88700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb390159370 0x7fb3900cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:20.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.547+0000 7fb394c88700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb390159370 0x7fb3900cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33052/0 (socket says 172.21.15.37:33052) 2023-10-06T02:23:20.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.547+0000 7fb394c88700 1 -- 172.21.15.37:0/2212858288 learned_addr learned my addr 172.21.15.37:0/2212858288 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:20.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.548+0000 7fb38f7fe700 1 --2- 172.21.15.37:0/2212858288 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3900b2270 0x7fb390151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.548+0000 7fb38ffff700 1 --2- 172.21.15.37:0/2212858288 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3900b0620 0x7fb3900d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.548+0000 7fb394c88700 1 -- 172.21.15.37:0/2212858288 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3900b0620 msgr2=0x7fb3900d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.548+0000 7fb394c88700 1 --2- 172.21.15.37:0/2212858288 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3900b0620 0x7fb3900d00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.548+0000 7fb394c88700 1 -- 172.21.15.37:0/2212858288 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3900b2270 msgr2=0x7fb390151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.548+0000 7fb394c88700 1 --2- 172.21.15.37:0/2212858288 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3900b2270 0x7fb390151900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.548+0000 7fb394c88700 1 -- 172.21.15.37:0/2212858288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb388009a20 con 0x7fb390159370 2023-10-06T02:23:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.548+0000 7fb38ffff700 1 --2- 172.21.15.37:0/2212858288 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3900b0620 0x7fb3900d00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.548+0000 7fb394c88700 1 --2- 172.21.15.37:0/2212858288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb390159370 0x7fb3900cf2a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb388013000 tx=0x7fb388019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.548+0000 7fb377fff700 1 -- 172.21.15.37:0/2212858288 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38801b630 con 0x7fb390159370 2023-10-06T02:23:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.548+0000 7fb377fff700 1 -- 172.21.15.37:0/2212858288 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38801b790 con 0x7fb390159370 2023-10-06T02:23:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.548+0000 7fb395489700 1 -- 172.21.15.37:0/2212858288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3900c7ea0 con 0x7fb390159370 2023-10-06T02:23:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.548+0000 7fb377fff700 1 -- 172.21.15.37:0/2212858288 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38801bb10 con 0x7fb390159370 2023-10-06T02:23:20.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.548+0000 7fb395489700 1 -- 172.21.15.37:0/2212858288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3900d05e0 con 0x7fb390159370 2023-10-06T02:23:20.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.549+0000 7fb395489700 1 -- 172.21.15.37:0/2212858288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3900c8660 con 0x7fb390159370 2023-10-06T02:23:20.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.549+0000 7fb377fff700 1 -- 172.21.15.37:0/2212858288 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb38801c400 con 0x7fb390159370 2023-10-06T02:23:20.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.550+0000 7fb377fff700 1 --2- 172.21.15.37:0/2212858288 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb37c066f30 0x7fb37c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:20.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.550+0000 7fb377fff700 1 -- 172.21.15.37:0/2212858288 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb3880865b0 con 0x7fb390159370 2023-10-06T02:23:20.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.550+0000 7fb38ffff700 1 --2- 172.21.15.37:0/2212858288 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb37c066f30 0x7fb37c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:20.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.550+0000 7fb38ffff700 1 --2- 172.21.15.37:0/2212858288 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb37c066f30 0x7fb37c0693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb3800017a0 tx=0x7fb380009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:20.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.554+0000 7fb377fff700 1 -- 172.21.15.37:0/2212858288 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb388053770 con 0x7fb390159370 2023-10-06T02:23:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.742+0000 7fb395489700 1 -- 172.21.15.37:0/2212858288 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3900645f0 con 0x7fb37c066f30 2023-10-06T02:23:20.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.751+0000 7fb377fff700 1 -- 172.21.15.37:0/2212858288 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286897 (secure 0 0 0) 0x7fb3900645f0 con 0x7fb37c066f30 2023-10-06T02:23:20.754 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:20.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.754+0000 7fb395489700 1 -- 172.21.15.37:0/2212858288 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb37c066f30 msgr2=0x7fb37c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:20.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.754+0000 7fb395489700 1 --2- 172.21.15.37:0/2212858288 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb37c066f30 0x7fb37c0693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb3800017a0 tx=0x7fb380009040 comp rx=0 tx=0).stop 2023-10-06T02:23:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.754+0000 7fb395489700 1 -- 172.21.15.37:0/2212858288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb390159370 msgr2=0x7fb3900cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.754+0000 7fb395489700 1 --2- 172.21.15.37:0/2212858288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb390159370 0x7fb3900cf2a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb388013000 tx=0x7fb388019000 comp rx=0 tx=0).stop 2023-10-06T02:23:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.754+0000 7fb395489700 1 -- 172.21.15.37:0/2212858288 shutdown_connections 2023-10-06T02:23:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.754+0000 7fb395489700 1 --2- 172.21.15.37:0/2212858288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb390159370 0x7fb3900cf2a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.754+0000 7fb395489700 1 --2- 172.21.15.37:0/2212858288 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3900b0620 0x7fb3900d00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.754+0000 7fb395489700 1 --2- 172.21.15.37:0/2212858288 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb37c066f30 0x7fb37c0693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.754+0000 7fb395489700 1 --2- 172.21.15.37:0/2212858288 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3900b2270 0x7fb390151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.754+0000 7fb395489700 1 -- 172.21.15.37:0/2212858288 >> 172.21.15.37:0/2212858288 conn(0x7fb39006c0b0 msgr2=0x7fb39006c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.754+0000 7fb395489700 1 -- 172.21.15.37:0/2212858288 shutdown_connections 2023-10-06T02:23:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.754+0000 7fb395489700 1 -- 172.21.15.37:0/2212858288 wait complete. 2023-10-06T02:23:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:23:20.766 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-06T02:23:20.508623+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381116,"kb_used_data":2812,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593604,"statfs":{"total":773094113280,"available":770655850496,"internally_reserved":0,"allocated":2879488,"data_stored":1774761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001307"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919168+0000","last_change":"2023-10-06T02:23:15.908982+0000","last_active":"2023-10-06T02:23:15.919168+0000","last_peered":"2023-10-06T02:23:15.919168+0000","last_clean":"2023-10-06T02:23:15.919168+0000","last_became_active":"2023-10-06T02:23:15.908698+0000","last_became_peered":"2023-10-06T02:23:15.908698+0000","last_unstale":"2023-10-06T02:23:15.919168+0000","last_undegraded":"2023-10-06T02:23:15.919168+0000","last_fullsized":"2023-10-06T02:23:15.919168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:10.934479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913252+0000","last_change":"2023-10-06T02:23:15.912067+0000","last_active":"2023-10-06T02:23:15.913252+0000","last_peered":"2023-10-06T02:23:15.913252+0000","last_clean":"2023-10-06T02:23:15.913252+0000","last_became_active":"2023-10-06T02:23:15.911773+0000","last_became_peered":"2023-10-06T02:23:15.911773+0000","last_unstale":"2023-10-06T02:23:15.913252+0000","last_undegraded":"2023-10-06T02:23:15.913252+0000","last_fullsized":"2023-10-06T02:23:15.913252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:29.341324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910351+0000","last_change":"2023-10-06T02:23:15.897603+0000","last_active":"2023-10-06T02:23:15.910351+0000","last_peered":"2023-10-06T02:23:15.910351+0000","last_clean":"2023-10-06T02:23:15.910351+0000","last_became_active":"2023-10-06T02:23:15.897331+0000","last_became_peered":"2023-10-06T02:23:15.897331+0000","last_unstale":"2023-10-06T02:23:15.910351+0000","last_undegraded":"2023-10-06T02:23:15.910351+0000","last_fullsized":"2023-10-06T02:23:15.910351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:22.459072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.909617+0000","last_change":"2023-10-06T02:23:15.906142+0000","last_active":"2023-10-06T02:23:15.909617+0000","last_peered":"2023-10-06T02:23:15.909617+0000","last_clean":"2023-10-06T02:23:15.909617+0000","last_became_active":"2023-10-06T02:23:15.905889+0000","last_became_peered":"2023-10-06T02:23:15.905889+0000","last_unstale":"2023-10-06T02:23:15.909617+0000","last_undegraded":"2023-10-06T02:23:15.909617+0000","last_fullsized":"2023-10-06T02:23:15.909617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:41.861335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915400+0000","last_change":"2023-10-06T02:23:15.903558+0000","last_active":"2023-10-06T02:23:15.915400+0000","last_peered":"2023-10-06T02:23:15.915400+0000","last_clean":"2023-10-06T02:23:15.915400+0000","last_became_active":"2023-10-06T02:23:15.903280+0000","last_became_peered":"2023-10-06T02:23:15.903280+0000","last_unstale":"2023-10-06T02:23:15.915400+0000","last_undegraded":"2023-10-06T02:23:15.915400+0000","last_fullsized":"2023-10-06T02:23:15.915400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.911955+0000","last_change":"2023-10-06T02:23:15.899437+0000","last_active":"2023-10-06T02:23:15.911955+0000","last_peered":"2023-10-06T02:23:15.911955+0000","last_clean":"2023-10-06T02:23:15.911955+0000","last_became_active":"2023-10-06T02:23:15.897553+0000","last_became_peered":"2023-10-06T02:23:15.897553+0000","last_unstale":"2023-10-06T02:23:15.911955+0000","last_undegraded":"2023-10-06T02:23:15.911955+0000","last_fullsized":"2023-10-06T02:23:15.911955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:28.665851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919223+0000","last_change":"2023-10-06T02:23:15.918090+0000","last_active":"2023-10-06T02:23:15.919223+0000","last_peered":"2023-10-06T02:23:15.919223+0000","last_clean":"2023-10-06T02:23:15.919223+0000","last_became_active":"2023-10-06T02:23:15.917887+0000","last_became_peered":"2023-10-06T02:23:15.917887+0000","last_unstale":"2023-10-06T02:23:15.919223+0000","last_undegraded":"2023-10-06T02:23:15.919223+0000","last_fullsized":"2023-10-06T02:23:15.919223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.903010+0000","last_change":"2023-10-06T02:23:15.899230+0000","last_active":"2023-10-06T02:23:15.903010+0000","last_peered":"2023-10-06T02:23:15.903010+0000","last_clean":"2023-10-06T02:23:15.903010+0000","last_became_active":"2023-10-06T02:23:15.898928+0000","last_became_peered":"2023-10-06T02:23:15.898928+0000","last_unstale":"2023-10-06T02:23:15.903010+0000","last_undegraded":"2023-10-06T02:23:15.903010+0000","last_fullsized":"2023-10-06T02:23:15.903010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:58.461395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913512+0000","last_change":"2023-10-06T02:23:15.906778+0000","last_active":"2023-10-06T02:23:15.913512+0000","last_peered":"2023-10-06T02:23:15.913512+0000","last_clean":"2023-10-06T02:23:15.913512+0000","last_became_active":"2023-10-06T02:23:15.906117+0000","last_became_peered":"2023-10-06T02:23:15.906117+0000","last_unstale":"2023-10-06T02:23:15.913512+0000","last_undegraded":"2023-10-06T02:23:15.913512+0000","last_fullsized":"2023-10-06T02:23:15.913512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.899401+0000","last_change":"2023-10-06T02:23:15.897067+0000","last_active":"2023-10-06T02:23:15.899401+0000","last_peered":"2023-10-06T02:23:15.899401+0000","last_clean":"2023-10-06T02:23:15.899401+0000","last_became_active":"2023-10-06T02:23:15.896690+0000","last_became_peered":"2023-10-06T02:23:15.896690+0000","last_unstale":"2023-10-06T02:23:15.899401+0000","last_undegraded":"2023-10-06T02:23:15.899401+0000","last_fullsized":"2023-10-06T02:23:15.899401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912295+0000","last_change":"2023-10-06T02:23:15.904332+0000","last_active":"2023-10-06T02:23:15.912295+0000","last_peered":"2023-10-06T02:23:15.912295+0000","last_clean":"2023-10-06T02:23:15.912295+0000","last_became_active":"2023-10-06T02:23:15.904107+0000","last_became_peered":"2023-10-06T02:23:15.904107+0000","last_unstale":"2023-10-06T02:23:15.912295+0000","last_undegraded":"2023-10-06T02:23:15.912295+0000","last_fullsized":"2023-10-06T02:23:15.912295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:08.354390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919232+0000","last_change":"2023-10-06T02:23:15.914369+0000","last_active":"2023-10-06T02:23:15.919232+0000","last_peered":"2023-10-06T02:23:15.919232+0000","last_clean":"2023-10-06T02:23:15.919232+0000","last_became_active":"2023-10-06T02:23:15.914083+0000","last_became_peered":"2023-10-06T02:23:15.914083+0000","last_unstale":"2023-10-06T02:23:15.919232+0000","last_undegraded":"2023-10-06T02:23:15.919232+0000","last_fullsized":"2023-10-06T02:23:15.919232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:26.544836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919123+0000","last_change":"2023-10-06T02:23:15.911961+0000","last_active":"2023-10-06T02:23:15.919123+0000","last_peered":"2023-10-06T02:23:15.919123+0000","last_clean":"2023-10-06T02:23:15.919123+0000","last_became_active":"2023-10-06T02:23:15.911674+0000","last_became_peered":"2023-10-06T02:23:15.911674+0000","last_unstale":"2023-10-06T02:23:15.919123+0000","last_undegraded":"2023-10-06T02:23:15.919123+0000","last_fullsized":"2023-10-06T02:23:15.919123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:48.704425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.911125+0000","last_change":"2023-10-06T02:23:15.909666+0000","last_active":"2023-10-06T02:23:15.911125+0000","last_peered":"2023-10-06T02:23:15.911125+0000","last_clean":"2023-10-06T02:23:15.911125+0000","last_became_active":"2023-10-06T02:23:15.909184+0000","last_became_peered":"2023-10-06T02:23:15.909184+0000","last_unstale":"2023-10-06T02:23:15.911125+0000","last_undegraded":"2023-10-06T02:23:15.911125+0000","last_fullsized":"2023-10-06T02:23:15.911125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:21.310729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919252+0000","last_change":"2023-10-06T02:23:15.918152+0000","last_active":"2023-10-06T02:23:15.919252+0000","last_peered":"2023-10-06T02:23:15.919252+0000","last_clean":"2023-10-06T02:23:15.919252+0000","last_became_active":"2023-10-06T02:23:15.917956+0000","last_became_peered":"2023-10-06T02:23:15.917956+0000","last_unstale":"2023-10-06T02:23:15.919252+0000","last_undegraded":"2023-10-06T02:23:15.919252+0000","last_fullsized":"2023-10-06T02:23:15.919252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.082330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910937+0000","last_change":"2023-10-06T02:23:15.898556+0000","last_active":"2023-10-06T02:23:15.910937+0000","last_peered":"2023-10-06T02:23:15.910937+0000","last_clean":"2023-10-06T02:23:15.910937+0000","last_became_active":"2023-10-06T02:23:15.897898+0000","last_became_peered":"2023-10-06T02:23:15.897898+0000","last_unstale":"2023-10-06T02:23:15.910937+0000","last_undegraded":"2023-10-06T02:23:15.910937+0000","last_fullsized":"2023-10-06T02:23:15.910937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:33.357066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913539+0000","last_change":"2023-10-06T02:23:15.906966+0000","last_active":"2023-10-06T02:23:15.913539+0000","last_peered":"2023-10-06T02:23:15.913539+0000","last_clean":"2023-10-06T02:23:15.913539+0000","last_became_active":"2023-10-06T02:23:15.906471+0000","last_became_peered":"2023-10-06T02:23:15.906471+0000","last_unstale":"2023-10-06T02:23:15.913539+0000","last_undegraded":"2023-10-06T02:23:15.913539+0000","last_fullsized":"2023-10-06T02:23:15.913539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.082330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912480+0000","last_change":"2023-10-06T02:23:15.909298+0000","last_active":"2023-10-06T02:23:15.912480+0000","last_peered":"2023-10-06T02:23:15.912480+0000","last_clean":"2023-10-06T02:23:15.912480+0000","last_became_active":"2023-10-06T02:23:15.908984+0000","last_became_peered":"2023-10-06T02:23:15.908984+0000","last_unstale":"2023-10-06T02:23:15.912480+0000","last_undegraded":"2023-10-06T02:23:15.912480+0000","last_fullsized":"2023-10-06T02:23:15.912480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:45.070037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919178+0000","last_change":"2023-10-06T02:23:15.908066+0000","last_active":"2023-10-06T02:23:15.919178+0000","last_peered":"2023-10-06T02:23:15.919178+0000","last_clean":"2023-10-06T02:23:15.919178+0000","last_became_active":"2023-10-06T02:23:15.907732+0000","last_became_peered":"2023-10-06T02:23:15.907732+0000","last_unstale":"2023-10-06T02:23:15.919178+0000","last_undegraded":"2023-10-06T02:23:15.919178+0000","last_fullsized":"2023-10-06T02:23:15.919178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:08.585650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913105+0000","last_change":"2023-10-06T02:23:15.907581+0000","last_active":"2023-10-06T02:23:15.913105+0000","last_peered":"2023-10-06T02:23:15.913105+0000","last_clean":"2023-10-06T02:23:15.913105+0000","last_became_active":"2023-10-06T02:23:15.905503+0000","last_became_peered":"2023-10-06T02:23:15.905503+0000","last_unstale":"2023-10-06T02:23:15.913105+0000","last_undegraded":"2023-10-06T02:23:15.913105+0000","last_fullsized":"2023-10-06T02:23:15.913105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:18.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916852+0000","last_change":"2023-10-06T02:23:15.914944+0000","last_active":"2023-10-06T02:23:15.916852+0000","last_peered":"2023-10-06T02:23:15.916852+0000","last_clean":"2023-10-06T02:23:15.916852+0000","last_became_active":"2023-10-06T02:23:15.914700+0000","last_became_peered":"2023-10-06T02:23:15.914700+0000","last_unstale":"2023-10-06T02:23:15.916852+0000","last_undegraded":"2023-10-06T02:23:15.916852+0000","last_fullsized":"2023-10-06T02:23:15.916852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920587+0000","last_change":"2023-10-06T02:23:15.913463+0000","last_active":"2023-10-06T02:23:15.920587+0000","last_peered":"2023-10-06T02:23:15.920587+0000","last_clean":"2023-10-06T02:23:15.920587+0000","last_became_active":"2023-10-06T02:23:15.913127+0000","last_became_peered":"2023-10-06T02:23:15.913127+0000","last_unstale":"2023-10-06T02:23:15.920587+0000","last_undegraded":"2023-10-06T02:23:15.920587+0000","last_fullsized":"2023-10-06T02:23:15.920587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:33.357066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920526+0000","last_change":"2023-10-06T02:23:15.914489+0000","last_active":"2023-10-06T02:23:15.920526+0000","last_peered":"2023-10-06T02:23:15.920526+0000","last_clean":"2023-10-06T02:23:15.920526+0000","last_became_active":"2023-10-06T02:23:15.914221+0000","last_became_peered":"2023-10-06T02:23:15.914221+0000","last_unstale":"2023-10-06T02:23:15.920526+0000","last_undegraded":"2023-10-06T02:23:15.920526+0000","last_fullsized":"2023-10-06T02:23:15.920526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:45.070037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.917128+0000","last_change":"2023-10-06T02:23:15.914958+0000","last_active":"2023-10-06T02:23:15.917128+0000","last_peered":"2023-10-06T02:23:15.917128+0000","last_clean":"2023-10-06T02:23:15.917128+0000","last_became_active":"2023-10-06T02:23:15.914682+0000","last_became_peered":"2023-10-06T02:23:15.914682+0000","last_unstale":"2023-10-06T02:23:15.917128+0000","last_undegraded":"2023-10-06T02:23:15.917128+0000","last_fullsized":"2023-10-06T02:23:15.917128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915313+0000","last_change":"2023-10-06T02:23:15.907412+0000","last_active":"2023-10-06T02:23:15.915313+0000","last_peered":"2023-10-06T02:23:15.915313+0000","last_clean":"2023-10-06T02:23:15.915313+0000","last_became_active":"2023-10-06T02:23:15.906449+0000","last_became_peered":"2023-10-06T02:23:15.906449+0000","last_unstale":"2023-10-06T02:23:15.915313+0000","last_undegraded":"2023-10-06T02:23:15.915313+0000","last_fullsized":"2023-10-06T02:23:15.915313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:32.631860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919905+0000","last_change":"2023-10-06T02:23:15.912982+0000","last_active":"2023-10-06T02:23:15.919905+0000","last_peered":"2023-10-06T02:23:15.919905+0000","last_clean":"2023-10-06T02:23:15.919905+0000","last_became_active":"2023-10-06T02:23:15.910404+0000","last_became_peered":"2023-10-06T02:23:15.910404+0000","last_unstale":"2023-10-06T02:23:15.919905+0000","last_undegraded":"2023-10-06T02:23:15.919905+0000","last_fullsized":"2023-10-06T02:23:15.919905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:56.873370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.918347+0000","last_change":"2023-10-06T02:23:15.916449+0000","last_active":"2023-10-06T02:23:15.918347+0000","last_peered":"2023-10-06T02:23:15.918347+0000","last_clean":"2023-10-06T02:23:15.918347+0000","last_became_active":"2023-10-06T02:23:15.915750+0000","last_became_peered":"2023-10-06T02:23:15.915750+0000","last_unstale":"2023-10-06T02:23:15.918347+0000","last_undegraded":"2023-10-06T02:23:15.918347+0000","last_fullsized":"2023-10-06T02:23:15.918347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910324+0000","last_change":"2023-10-06T02:23:14.907348+0000","last_active":"2023-10-06T02:23:15.910324+0000","last_peered":"2023-10-06T02:23:15.910324+0000","last_clean":"2023-10-06T02:23:15.910324+0000","last_became_active":"2023-10-06T02:23:14.907035+0000","last_became_peered":"2023-10-06T02:23:14.907035+0000","last_unstale":"2023-10-06T02:23:15.910324+0000","last_undegraded":"2023-10-06T02:23:15.910324+0000","last_fullsized":"2023-10-06T02:23:15.910324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:12.131483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.906846+0000","last_change":"2023-10-06T02:23:15.902629+0000","last_active":"2023-10-06T02:23:15.906846+0000","last_peered":"2023-10-06T02:23:15.906846+0000","last_clean":"2023-10-06T02:23:15.906846+0000","last_became_active":"2023-10-06T02:23:15.902328+0000","last_became_peered":"2023-10-06T02:23:15.902328+0000","last_unstale":"2023-10-06T02:23:15.906846+0000","last_undegraded":"2023-10-06T02:23:15.906846+0000","last_fullsized":"2023-10-06T02:23:15.906846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:11.466544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.900770+0000","last_change":"2023-10-06T02:23:14.908961+0000","last_active":"2023-10-06T02:23:15.900770+0000","last_peered":"2023-10-06T02:23:15.900770+0000","last_clean":"2023-10-06T02:23:15.900770+0000","last_became_active":"2023-10-06T02:23:14.908549+0000","last_became_peered":"2023-10-06T02:23:14.908549+0000","last_unstale":"2023-10-06T02:23:15.900770+0000","last_undegraded":"2023-10-06T02:23:15.900770+0000","last_fullsized":"2023-10-06T02:23:15.900770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:37.900811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.925219+0000","last_change":"2023-10-06T02:23:15.921091+0000","last_active":"2023-10-06T02:23:15.925219+0000","last_peered":"2023-10-06T02:23:15.925219+0000","last_clean":"2023-10-06T02:23:15.925219+0000","last_became_active":"2023-10-06T02:23:15.920772+0000","last_became_peered":"2023-10-06T02:23:15.920772+0000","last_unstale":"2023-10-06T02:23:15.925219+0000","last_undegraded":"2023-10-06T02:23:15.925219+0000","last_fullsized":"2023-10-06T02:23:15.925219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:58.461395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.896633+0000","last_change":"2023-10-06T02:23:14.905101+0000","last_active":"2023-10-06T02:23:15.896633+0000","last_peered":"2023-10-06T02:23:15.896633+0000","last_clean":"2023-10-06T02:23:15.896633+0000","last_became_active":"2023-10-06T02:23:14.902379+0000","last_became_peered":"2023-10-06T02:23:14.902379+0000","last_unstale":"2023-10-06T02:23:15.896633+0000","last_undegraded":"2023-10-06T02:23:15.896633+0000","last_fullsized":"2023-10-06T02:23:15.896633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.054986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910630+0000","last_change":"2023-10-06T02:23:15.908338+0000","last_active":"2023-10-06T02:23:15.910630+0000","last_peered":"2023-10-06T02:23:15.910630+0000","last_clean":"2023-10-06T02:23:15.910630+0000","last_became_active":"2023-10-06T02:23:15.907880+0000","last_became_peered":"2023-10-06T02:23:15.907880+0000","last_unstale":"2023-10-06T02:23:15.910630+0000","last_undegraded":"2023-10-06T02:23:15.910630+0000","last_fullsized":"2023-10-06T02:23:15.910630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.350772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.889655+0000","last_change":"2023-10-06T02:23:14.904479+0000","last_active":"2023-10-06T02:23:15.889655+0000","last_peered":"2023-10-06T02:23:15.889655+0000","last_clean":"2023-10-06T02:23:15.889655+0000","last_became_active":"2023-10-06T02:23:14.904187+0000","last_became_peered":"2023-10-06T02:23:14.904187+0000","last_unstale":"2023-10-06T02:23:15.889655+0000","last_undegraded":"2023-10-06T02:23:15.889655+0000","last_fullsized":"2023-10-06T02:23:15.889655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:09.928957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912505+0000","last_change":"2023-10-06T02:23:15.905556+0000","last_active":"2023-10-06T02:23:15.912505+0000","last_peered":"2023-10-06T02:23:15.912505+0000","last_clean":"2023-10-06T02:23:15.912505+0000","last_became_active":"2023-10-06T02:23:15.905335+0000","last_became_peered":"2023-10-06T02:23:15.905335+0000","last_unstale":"2023-10-06T02:23:15.912505+0000","last_undegraded":"2023-10-06T02:23:15.912505+0000","last_fullsized":"2023-10-06T02:23:15.912505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:18.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.892042+0000","last_change":"2023-10-06T02:23:14.900860+0000","last_active":"2023-10-06T02:23:15.892042+0000","last_peered":"2023-10-06T02:23:15.892042+0000","last_clean":"2023-10-06T02:23:15.892042+0000","last_became_active":"2023-10-06T02:23:14.900471+0000","last_became_peered":"2023-10-06T02:23:14.900471+0000","last_unstale":"2023-10-06T02:23:15.892042+0000","last_undegraded":"2023-10-06T02:23:15.892042+0000","last_fullsized":"2023-10-06T02:23:15.892042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:09.928957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920751+0000","last_change":"2023-10-06T02:23:15.917245+0000","last_active":"2023-10-06T02:23:15.920751+0000","last_peered":"2023-10-06T02:23:15.920751+0000","last_clean":"2023-10-06T02:23:15.920751+0000","last_became_active":"2023-10-06T02:23:15.916930+0000","last_became_peered":"2023-10-06T02:23:15.916930+0000","last_unstale":"2023-10-06T02:23:15.920751+0000","last_undegraded":"2023-10-06T02:23:15.920751+0000","last_fullsized":"2023-10-06T02:23:15.920751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:29.341324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915462+0000","last_change":"2023-10-06T02:23:14.908736+0000","last_active":"2023-10-06T02:23:15.915462+0000","last_peered":"2023-10-06T02:23:15.915462+0000","last_clean":"2023-10-06T02:23:15.915462+0000","last_became_active":"2023-10-06T02:23:14.908432+0000","last_became_peered":"2023-10-06T02:23:14.908432+0000","last_unstale":"2023-10-06T02:23:15.915462+0000","last_undegraded":"2023-10-06T02:23:15.915462+0000","last_fullsized":"2023-10-06T02:23:15.915462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:12.345251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.911912+0000","last_change":"2023-10-06T02:23:15.906639+0000","last_active":"2023-10-06T02:23:15.911912+0000","last_peered":"2023-10-06T02:23:15.911912+0000","last_clean":"2023-10-06T02:23:15.911912+0000","last_became_active":"2023-10-06T02:23:15.906358+0000","last_became_peered":"2023-10-06T02:23:15.906358+0000","last_unstale":"2023-10-06T02:23:15.911912+0000","last_undegraded":"2023-10-06T02:23:15.911912+0000","last_fullsized":"2023-10-06T02:23:15.911912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:41.861335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919121+0000","last_change":"2023-10-06T02:23:14.904865+0000","last_active":"2023-10-06T02:23:15.919121+0000","last_peered":"2023-10-06T02:23:15.919121+0000","last_clean":"2023-10-06T02:23:15.919121+0000","last_became_active":"2023-10-06T02:23:14.904563+0000","last_became_peered":"2023-10-06T02:23:14.904563+0000","last_unstale":"2023-10-06T02:23:15.919121+0000","last_undegraded":"2023-10-06T02:23:15.919121+0000","last_fullsized":"2023-10-06T02:23:15.919121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:07.580128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912663+0000","last_change":"2023-10-06T02:23:15.900282+0000","last_active":"2023-10-06T02:23:15.912663+0000","last_peered":"2023-10-06T02:23:15.912663+0000","last_clean":"2023-10-06T02:23:15.912663+0000","last_became_active":"2023-10-06T02:23:15.899729+0000","last_became_peered":"2023-10-06T02:23:15.899729+0000","last_unstale":"2023-10-06T02:23:15.912663+0000","last_undegraded":"2023-10-06T02:23:15.912663+0000","last_fullsized":"2023-10-06T02:23:15.912663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:16.019119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915056+0000","last_change":"2023-10-06T02:23:14.908091+0000","last_active":"2023-10-06T02:23:15.915056+0000","last_peered":"2023-10-06T02:23:15.915056+0000","last_clean":"2023-10-06T02:23:15.915056+0000","last_became_active":"2023-10-06T02:23:14.907787+0000","last_became_peered":"2023-10-06T02:23:14.907787+0000","last_unstale":"2023-10-06T02:23:15.915056+0000","last_undegraded":"2023-10-06T02:23:15.915056+0000","last_fullsized":"2023-10-06T02:23:15.915056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:51.619050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919379+0000","last_change":"2023-10-06T02:23:15.912494+0000","last_active":"2023-10-06T02:23:15.919379+0000","last_peered":"2023-10-06T02:23:15.919379+0000","last_clean":"2023-10-06T02:23:15.919379+0000","last_became_active":"2023-10-06T02:23:15.911909+0000","last_became_peered":"2023-10-06T02:23:15.911909+0000","last_unstale":"2023-10-06T02:23:15.919379+0000","last_undegraded":"2023-10-06T02:23:15.919379+0000","last_fullsized":"2023-10-06T02:23:15.919379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:16.019119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.889128+0000","last_change":"2023-10-06T02:23:14.900521+0000","last_active":"2023-10-06T02:23:15.889128+0000","last_peered":"2023-10-06T02:23:15.889128+0000","last_clean":"2023-10-06T02:23:15.889128+0000","last_became_active":"2023-10-06T02:23:14.900208+0000","last_became_peered":"2023-10-06T02:23:14.900208+0000","last_unstale":"2023-10-06T02:23:15.889128+0000","last_undegraded":"2023-10-06T02:23:15.889128+0000","last_fullsized":"2023-10-06T02:23:15.889128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:12.131483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916972+0000","last_change":"2023-10-06T02:23:15.915762+0000","last_active":"2023-10-06T02:23:15.916972+0000","last_peered":"2023-10-06T02:23:15.916972+0000","last_clean":"2023-10-06T02:23:15.916972+0000","last_became_active":"2023-10-06T02:23:15.915415+0000","last_became_peered":"2023-10-06T02:23:15.915415+0000","last_unstale":"2023-10-06T02:23:15.916972+0000","last_undegraded":"2023-10-06T02:23:15.916972+0000","last_fullsized":"2023-10-06T02:23:15.916972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.082330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.903833+0000","last_change":"2023-10-06T02:23:14.907899+0000","last_active":"2023-10-06T02:23:15.903833+0000","last_peered":"2023-10-06T02:23:15.903833+0000","last_clean":"2023-10-06T02:23:15.903833+0000","last_became_active":"2023-10-06T02:23:14.907600+0000","last_became_peered":"2023-10-06T02:23:14.907600+0000","last_unstale":"2023-10-06T02:23:15.903833+0000","last_undegraded":"2023-10-06T02:23:15.903833+0000","last_fullsized":"2023-10-06T02:23:15.903833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:50.363282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913744+0000","last_change":"2023-10-06T02:23:15.904238+0000","last_active":"2023-10-06T02:23:15.913744+0000","last_peered":"2023-10-06T02:23:15.913744+0000","last_clean":"2023-10-06T02:23:15.913744+0000","last_became_active":"2023-10-06T02:23:15.903899+0000","last_became_peered":"2023-10-06T02:23:15.903899+0000","last_unstale":"2023-10-06T02:23:15.913744+0000","last_undegraded":"2023-10-06T02:23:15.913744+0000","last_fullsized":"2023-10-06T02:23:15.913744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:29.341324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915845+0000","last_change":"2023-10-06T02:23:14.902984+0000","last_active":"2023-10-06T02:23:15.915845+0000","last_peered":"2023-10-06T02:23:15.915845+0000","last_clean":"2023-10-06T02:23:15.915845+0000","last_became_active":"2023-10-06T02:23:14.902743+0000","last_became_peered":"2023-10-06T02:23:14.902743+0000","last_unstale":"2023-10-06T02:23:15.915845+0000","last_undegraded":"2023-10-06T02:23:15.915845+0000","last_fullsized":"2023-10-06T02:23:15.915845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:07.580128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920917+0000","last_change":"2023-10-06T02:23:15.917272+0000","last_active":"2023-10-06T02:23:15.920917+0000","last_peered":"2023-10-06T02:23:15.920917+0000","last_clean":"2023-10-06T02:23:15.920917+0000","last_became_active":"2023-10-06T02:23:15.916874+0000","last_became_peered":"2023-10-06T02:23:15.916874+0000","last_unstale":"2023-10-06T02:23:15.920917+0000","last_undegraded":"2023-10-06T02:23:15.920917+0000","last_fullsized":"2023-10-06T02:23:15.920917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:22.459072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.914495+0000","last_change":"2023-10-06T02:23:14.908202+0000","last_active":"2023-10-06T02:23:15.914495+0000","last_peered":"2023-10-06T02:23:15.914495+0000","last_clean":"2023-10-06T02:23:15.914495+0000","last_became_active":"2023-10-06T02:23:14.907936+0000","last_became_peered":"2023-10-06T02:23:14.907936+0000","last_unstale":"2023-10-06T02:23:15.914495+0000","last_undegraded":"2023-10-06T02:23:15.914495+0000","last_fullsized":"2023-10-06T02:23:15.914495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:43.560751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916861+0000","last_change":"2023-10-06T02:23:15.914877+0000","last_active":"2023-10-06T02:23:15.916861+0000","last_peered":"2023-10-06T02:23:15.916861+0000","last_clean":"2023-10-06T02:23:15.916861+0000","last_became_active":"2023-10-06T02:23:15.914592+0000","last_became_peered":"2023-10-06T02:23:15.914592+0000","last_unstale":"2023-10-06T02:23:15.916861+0000","last_undegraded":"2023-10-06T02:23:15.916861+0000","last_fullsized":"2023-10-06T02:23:15.916861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.914703+0000","last_change":"2023-10-06T02:23:14.908061+0000","last_active":"2023-10-06T02:23:15.914703+0000","last_peered":"2023-10-06T02:23:15.914703+0000","last_clean":"2023-10-06T02:23:15.914703+0000","last_became_active":"2023-10-06T02:23:14.907687+0000","last_became_peered":"2023-10-06T02:23:14.907687+0000","last_unstale":"2023-10-06T02:23:15.914703+0000","last_undegraded":"2023-10-06T02:23:15.914703+0000","last_fullsized":"2023-10-06T02:23:15.914703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:23:20.174592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912220+0000","last_change":"2023-10-06T02:23:15.907204+0000","last_active":"2023-10-06T02:23:15.912220+0000","last_peered":"2023-10-06T02:23:15.912220+0000","last_clean":"2023-10-06T02:23:15.912220+0000","last_became_active":"2023-10-06T02:23:15.906946+0000","last_became_peered":"2023-10-06T02:23:15.906946+0000","last_unstale":"2023-10-06T02:23:15.912220+0000","last_undegraded":"2023-10-06T02:23:15.912220+0000","last_fullsized":"2023-10-06T02:23:15.912220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:48.105101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915301+0000","last_change":"2023-10-06T02:23:14.907440+0000","last_active":"2023-10-06T02:23:15.915301+0000","last_peered":"2023-10-06T02:23:15.915301+0000","last_clean":"2023-10-06T02:23:15.915301+0000","last_became_active":"2023-10-06T02:23:14.907153+0000","last_became_peered":"2023-10-06T02:23:14.907153+0000","last_unstale":"2023-10-06T02:23:15.915301+0000","last_undegraded":"2023-10-06T02:23:15.915301+0000","last_fullsized":"2023-10-06T02:23:15.915301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:41.976855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913457+0000","last_change":"2023-10-06T02:23:15.910344+0000","last_active":"2023-10-06T02:23:15.913457+0000","last_peered":"2023-10-06T02:23:15.913457+0000","last_clean":"2023-10-06T02:23:15.913457+0000","last_became_active":"2023-10-06T02:23:15.910087+0000","last_became_peered":"2023-10-06T02:23:15.910087+0000","last_unstale":"2023-10-06T02:23:15.913457+0000","last_undegraded":"2023-10-06T02:23:15.913457+0000","last_fullsized":"2023-10-06T02:23:15.913457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:32.631860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.891617+0000","last_change":"2023-10-06T02:23:14.899169+0000","last_active":"2023-10-06T02:23:15.891617+0000","last_peered":"2023-10-06T02:23:15.891617+0000","last_clean":"2023-10-06T02:23:15.891617+0000","last_became_active":"2023-10-06T02:23:14.898905+0000","last_became_peered":"2023-10-06T02:23:14.898905+0000","last_unstale":"2023-10-06T02:23:15.891617+0000","last_undegraded":"2023-10-06T02:23:15.891617+0000","last_fullsized":"2023-10-06T02:23:15.891617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:25.539314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915422+0000","last_change":"2023-10-06T02:23:15.906479+0000","last_active":"2023-10-06T02:23:15.915422+0000","last_peered":"2023-10-06T02:23:15.915422+0000","last_clean":"2023-10-06T02:23:15.915422+0000","last_became_active":"2023-10-06T02:23:15.906192+0000","last_became_peered":"2023-10-06T02:23:15.906192+0000","last_unstale":"2023-10-06T02:23:15.915422+0000","last_undegraded":"2023-10-06T02:23:15.915422+0000","last_fullsized":"2023-10-06T02:23:15.915422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:22.459072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.921109+0000","last_change":"2023-10-06T02:23:14.907796+0000","last_active":"2023-10-06T02:23:15.921109+0000","last_peered":"2023-10-06T02:23:15.921109+0000","last_clean":"2023-10-06T02:23:15.921109+0000","last_became_active":"2023-10-06T02:23:14.907286+0000","last_became_peered":"2023-10-06T02:23:14.907286+0000","last_unstale":"2023-10-06T02:23:15.921109+0000","last_undegraded":"2023-10-06T02:23:15.921109+0000","last_fullsized":"2023-10-06T02:23:15.921109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:09.928957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913082+0000","last_change":"2023-10-06T02:23:15.905225+0000","last_active":"2023-10-06T02:23:15.913082+0000","last_peered":"2023-10-06T02:23:15.913082+0000","last_clean":"2023-10-06T02:23:15.913082+0000","last_became_active":"2023-10-06T02:23:15.904931+0000","last_became_peered":"2023-10-06T02:23:15.904931+0000","last_unstale":"2023-10-06T02:23:15.913082+0000","last_undegraded":"2023-10-06T02:23:15.913082+0000","last_fullsized":"2023-10-06T02:23:15.913082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:12.297625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.898775+0000","last_change":"2023-10-06T02:23:14.905972+0000","last_active":"2023-10-06T02:23:15.898775+0000","last_peered":"2023-10-06T02:23:15.898775+0000","last_clean":"2023-10-06T02:23:15.898775+0000","last_became_active":"2023-10-06T02:23:14.905683+0000","last_became_peered":"2023-10-06T02:23:14.905683+0000","last_unstale":"2023-10-06T02:23:15.898775+0000","last_undegraded":"2023-10-06T02:23:15.898775+0000","last_fullsized":"2023-10-06T02:23:15.898775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:12.131483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913680+0000","last_change":"2023-10-06T02:23:15.909799+0000","last_active":"2023-10-06T02:23:15.913680+0000","last_peered":"2023-10-06T02:23:15.913680+0000","last_clean":"2023-10-06T02:23:15.913680+0000","last_became_active":"2023-10-06T02:23:15.909263+0000","last_became_peered":"2023-10-06T02:23:15.909263+0000","last_unstale":"2023-10-06T02:23:15.913680+0000","last_undegraded":"2023-10-06T02:23:15.913680+0000","last_fullsized":"2023-10-06T02:23:15.913680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:11.466544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.892075+0000","last_change":"2023-10-06T02:23:14.898612+0000","last_active":"2023-10-06T02:23:15.892075+0000","last_peered":"2023-10-06T02:23:15.892075+0000","last_clean":"2023-10-06T02:23:15.892075+0000","last_became_active":"2023-10-06T02:23:14.898323+0000","last_became_peered":"2023-10-06T02:23:14.898323+0000","last_unstale":"2023-10-06T02:23:15.892075+0000","last_undegraded":"2023-10-06T02:23:15.892075+0000","last_fullsized":"2023-10-06T02:23:15.892075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:25.539314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912215+0000","last_change":"2023-10-06T02:23:15.906103+0000","last_active":"2023-10-06T02:23:15.912215+0000","last_peered":"2023-10-06T02:23:15.912215+0000","last_clean":"2023-10-06T02:23:15.912215+0000","last_became_active":"2023-10-06T02:23:15.905549+0000","last_became_peered":"2023-10-06T02:23:15.905549+0000","last_unstale":"2023-10-06T02:23:15.912215+0000","last_undegraded":"2023-10-06T02:23:15.912215+0000","last_fullsized":"2023-10-06T02:23:15.912215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:25.497567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.896485+0000","last_change":"2023-10-06T02:23:14.907451+0000","last_active":"2023-10-06T02:23:15.896485+0000","last_peered":"2023-10-06T02:23:15.896485+0000","last_clean":"2023-10-06T02:23:15.896485+0000","last_became_active":"2023-10-06T02:23:14.907166+0000","last_became_peered":"2023-10-06T02:23:14.907166+0000","last_unstale":"2023-10-06T02:23:15.896485+0000","last_undegraded":"2023-10-06T02:23:15.896485+0000","last_fullsized":"2023-10-06T02:23:15.896485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:51.619050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920149+0000","last_change":"2023-10-06T02:23:15.916593+0000","last_active":"2023-10-06T02:23:15.920149+0000","last_peered":"2023-10-06T02:23:15.920149+0000","last_clean":"2023-10-06T02:23:15.920149+0000","last_became_active":"2023-10-06T02:23:15.916288+0000","last_became_peered":"2023-10-06T02:23:15.916288+0000","last_unstale":"2023-10-06T02:23:15.920149+0000","last_undegraded":"2023-10-06T02:23:15.920149+0000","last_fullsized":"2023-10-06T02:23:15.920149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.917451+0000","last_change":"2023-10-06T02:23:14.904396+0000","last_active":"2023-10-06T02:23:15.917451+0000","last_peered":"2023-10-06T02:23:15.917451+0000","last_clean":"2023-10-06T02:23:15.917451+0000","last_became_active":"2023-10-06T02:23:14.903093+0000","last_became_peered":"2023-10-06T02:23:14.903093+0000","last_unstale":"2023-10-06T02:23:15.917451+0000","last_undegraded":"2023-10-06T02:23:15.917451+0000","last_fullsized":"2023-10-06T02:23:15.917451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:47.698904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.893190+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:23:15.893190+0000","last_peered":"2023-10-06T02:23:15.893190+0000","last_clean":"2023-10-06T02:23:15.893190+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:23:15.893190+0000","last_undegraded":"2023-10-06T02:23:15.893190+0000","last_fullsized":"2023-10-06T02:23:15.893190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920866+0000","last_change":"2023-10-06T02:23:15.917453+0000","last_active":"2023-10-06T02:23:15.920866+0000","last_peered":"2023-10-06T02:23:15.920866+0000","last_clean":"2023-10-06T02:23:15.920866+0000","last_became_active":"2023-10-06T02:23:15.916802+0000","last_became_peered":"2023-10-06T02:23:15.916802+0000","last_unstale":"2023-10-06T02:23:15.920866+0000","last_undegraded":"2023-10-06T02:23:15.920866+0000","last_fullsized":"2023-10-06T02:23:15.920866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:28.665851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.895556+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:23:15.895556+0000","last_peered":"2023-10-06T02:23:15.895556+0000","last_clean":"2023-10-06T02:23:15.895556+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:23:15.895556+0000","last_undegraded":"2023-10-06T02:23:15.895556+0000","last_fullsized":"2023-10-06T02:23:15.895556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.890568+0000","last_change":"2023-10-06T02:23:14.907316+0000","last_active":"2023-10-06T02:23:15.890568+0000","last_peered":"2023-10-06T02:23:15.890568+0000","last_clean":"2023-10-06T02:23:15.890568+0000","last_became_active":"2023-10-06T02:23:14.907019+0000","last_became_peered":"2023-10-06T02:23:14.907019+0000","last_unstale":"2023-10-06T02:23:15.890568+0000","last_undegraded":"2023-10-06T02:23:15.890568+0000","last_fullsized":"2023-10-06T02:23:15.890568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:47.698904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910870+0000","last_change":"2023-10-06T02:23:15.898071+0000","last_active":"2023-10-06T02:23:15.910870+0000","last_peered":"2023-10-06T02:23:15.910870+0000","last_clean":"2023-10-06T02:23:15.910870+0000","last_became_active":"2023-10-06T02:23:15.897795+0000","last_became_peered":"2023-10-06T02:23:15.897795+0000","last_unstale":"2023-10-06T02:23:15.910870+0000","last_undegraded":"2023-10-06T02:23:15.910870+0000","last_fullsized":"2023-10-06T02:23:15.910870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.901685+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:23:15.901685+0000","last_peered":"2023-10-06T02:23:15.901685+0000","last_clean":"2023-10-06T02:23:15.901685+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:23:15.901685+0000","last_undegraded":"2023-10-06T02:23:15.901685+0000","last_fullsized":"2023-10-06T02:23:15.901685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.902452+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:23:15.902452+0000","last_peered":"2023-10-06T02:23:15.902452+0000","last_clean":"2023-10-06T02:23:15.902452+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:23:15.902452+0000","last_undegraded":"2023-10-06T02:23:15.902452+0000","last_fullsized":"2023-10-06T02:23:15.902452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.889151+0000","last_change":"2023-10-06T02:23:14.905959+0000","last_active":"2023-10-06T02:23:15.889151+0000","last_peered":"2023-10-06T02:23:15.889151+0000","last_clean":"2023-10-06T02:23:15.889151+0000","last_became_active":"2023-10-06T02:23:14.905642+0000","last_became_peered":"2023-10-06T02:23:14.905642+0000","last_unstale":"2023-10-06T02:23:15.889151+0000","last_undegraded":"2023-10-06T02:23:15.889151+0000","last_fullsized":"2023-10-06T02:23:15.889151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:37.900811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.921254+0000","last_change":"2023-10-06T02:23:15.913645+0000","last_active":"2023-10-06T02:23:15.921254+0000","last_peered":"2023-10-06T02:23:15.921254+0000","last_clean":"2023-10-06T02:23:15.921254+0000","last_became_active":"2023-10-06T02:23:15.913181+0000","last_became_peered":"2023-10-06T02:23:15.913181+0000","last_unstale":"2023-10-06T02:23:15.921254+0000","last_undegraded":"2023-10-06T02:23:15.921254+0000","last_fullsized":"2023-10-06T02:23:15.921254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:28.665851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.903221+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:23:15.903221+0000","last_peered":"2023-10-06T02:23:15.903221+0000","last_clean":"2023-10-06T02:23:15.903221+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:23:15.903221+0000","last_undegraded":"2023-10-06T02:23:15.903221+0000","last_fullsized":"2023-10-06T02:23:15.903221+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.900107+0000","last_change":"2023-10-06T02:23:14.905273+0000","last_active":"2023-10-06T02:23:15.900107+0000","last_peered":"2023-10-06T02:23:15.900107+0000","last_clean":"2023-10-06T02:23:15.900107+0000","last_became_active":"2023-10-06T02:23:14.905074+0000","last_became_peered":"2023-10-06T02:23:14.905074+0000","last_unstale":"2023-10-06T02:23:15.900107+0000","last_undegraded":"2023-10-06T02:23:15.900107+0000","last_fullsized":"2023-10-06T02:23:15.900107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:12.131483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920119+0000","last_change":"2023-10-06T02:23:15.915383+0000","last_active":"2023-10-06T02:23:15.920119+0000","last_peered":"2023-10-06T02:23:15.920119+0000","last_clean":"2023-10-06T02:23:15.920119+0000","last_became_active":"2023-10-06T02:23:15.914958+0000","last_became_peered":"2023-10-06T02:23:15.914958+0000","last_unstale":"2023-10-06T02:23:15.920119+0000","last_undegraded":"2023-10-06T02:23:15.920119+0000","last_fullsized":"2023-10-06T02:23:15.920119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.082330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.902020+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:23:15.902020+0000","last_peered":"2023-10-06T02:23:15.902020+0000","last_clean":"2023-10-06T02:23:15.902020+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:23:15.902020+0000","last_undegraded":"2023-10-06T02:23:15.902020+0000","last_fullsized":"2023-10-06T02:23:15.902020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.894837+0000","last_change":"2023-10-06T02:23:14.902760+0000","last_active":"2023-10-06T02:23:15.894837+0000","last_peered":"2023-10-06T02:23:15.894837+0000","last_clean":"2023-10-06T02:23:15.894837+0000","last_became_active":"2023-10-06T02:23:14.902458+0000","last_became_peered":"2023-10-06T02:23:14.902458+0000","last_unstale":"2023-10-06T02:23:15.894837+0000","last_undegraded":"2023-10-06T02:23:15.894837+0000","last_fullsized":"2023-10-06T02:23:15.894837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:43.560751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916289+0000","last_change":"2023-10-06T02:23:15.913677+0000","last_active":"2023-10-06T02:23:15.916289+0000","last_peered":"2023-10-06T02:23:15.916289+0000","last_clean":"2023-10-06T02:23:15.916289+0000","last_became_active":"2023-10-06T02:23:15.913379+0000","last_became_peered":"2023-10-06T02:23:15.913379+0000","last_unstale":"2023-10-06T02:23:15.916289+0000","last_undegraded":"2023-10-06T02:23:15.916289+0000","last_fullsized":"2023-10-06T02:23:15.916289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:42.982377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.890388+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:23:15.890388+0000","last_peered":"2023-10-06T02:23:15.890388+0000","last_clean":"2023-10-06T02:23:15.890388+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:23:15.890388+0000","last_undegraded":"2023-10-06T02:23:15.890388+0000","last_fullsized":"2023-10-06T02:23:15.890388+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.891338+0000","last_change":"2023-10-06T02:23:14.904576+0000","last_active":"2023-10-06T02:23:15.891338+0000","last_peered":"2023-10-06T02:23:15.891338+0000","last_clean":"2023-10-06T02:23:15.891338+0000","last_became_active":"2023-10-06T02:23:14.904268+0000","last_became_peered":"2023-10-06T02:23:14.904268+0000","last_unstale":"2023-10-06T02:23:15.891338+0000","last_undegraded":"2023-10-06T02:23:15.891338+0000","last_fullsized":"2023-10-06T02:23:15.891338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:47.698904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919339+0000","last_change":"2023-10-06T02:23:15.909310+0000","last_active":"2023-10-06T02:23:15.919339+0000","last_peered":"2023-10-06T02:23:15.919339+0000","last_clean":"2023-10-06T02:23:15.919339+0000","last_became_active":"2023-10-06T02:23:15.908957+0000","last_became_peered":"2023-10-06T02:23:15.908957+0000","last_unstale":"2023-10-06T02:23:15.919339+0000","last_undegraded":"2023-10-06T02:23:15.919339+0000","last_fullsized":"2023-10-06T02:23:15.919339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:21.310729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.899923+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:23:15.899923+0000","last_peered":"2023-10-06T02:23:15.899923+0000","last_clean":"2023-10-06T02:23:15.899923+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:23:15.899923+0000","last_undegraded":"2023-10-06T02:23:15.899923+0000","last_fullsized":"2023-10-06T02:23:15.899923+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.901669+0000","last_change":"2023-10-06T02:23:14.906039+0000","last_active":"2023-10-06T02:23:15.901669+0000","last_peered":"2023-10-06T02:23:15.901669+0000","last_clean":"2023-10-06T02:23:15.901669+0000","last_became_active":"2023-10-06T02:23:14.905477+0000","last_became_peered":"2023-10-06T02:23:14.905477+0000","last_unstale":"2023-10-06T02:23:15.901669+0000","last_undegraded":"2023-10-06T02:23:15.901669+0000","last_fullsized":"2023-10-06T02:23:15.901669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:07.580128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.897843+0000","last_change":"2023-10-06T02:23:15.895373+0000","last_active":"2023-10-06T02:23:15.897843+0000","last_peered":"2023-10-06T02:23:15.897843+0000","last_clean":"2023-10-06T02:23:15.897843+0000","last_became_active":"2023-10-06T02:23:15.895175+0000","last_became_peered":"2023-10-06T02:23:15.895175+0000","last_unstale":"2023-10-06T02:23:15.897843+0000","last_undegraded":"2023-10-06T02:23:15.897843+0000","last_fullsized":"2023-10-06T02:23:15.897843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.899917+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:23:15.899917+0000","last_peered":"2023-10-06T02:23:15.899917+0000","last_clean":"2023-10-06T02:23:15.899917+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:23:15.899917+0000","last_undegraded":"2023-10-06T02:23:15.899917+0000","last_fullsized":"2023-10-06T02:23:15.899917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.892937+0000","last_change":"2023-10-06T02:23:14.897008+0000","last_active":"2023-10-06T02:23:15.892937+0000","last_peered":"2023-10-06T02:23:15.892937+0000","last_clean":"2023-10-06T02:23:15.892937+0000","last_became_active":"2023-10-06T02:23:14.896700+0000","last_became_peered":"2023-10-06T02:23:14.896700+0000","last_unstale":"2023-10-06T02:23:15.892937+0000","last_undegraded":"2023-10-06T02:23:15.892937+0000","last_fullsized":"2023-10-06T02:23:15.892937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:43.560751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919846+0000","last_change":"2023-10-06T02:23:15.911793+0000","last_active":"2023-10-06T02:23:15.919846+0000","last_peered":"2023-10-06T02:23:15.919846+0000","last_clean":"2023-10-06T02:23:15.919846+0000","last_became_active":"2023-10-06T02:23:15.909785+0000","last_became_peered":"2023-10-06T02:23:15.909785+0000","last_unstale":"2023-10-06T02:23:15.919846+0000","last_undegraded":"2023-10-06T02:23:15.919846+0000","last_fullsized":"2023-10-06T02:23:15.919846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.350772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915797+0000","last_change":"2023-10-06T02:23:14.908268+0000","last_active":"2023-10-06T02:23:15.915797+0000","last_peered":"2023-10-06T02:23:15.915797+0000","last_clean":"2023-10-06T02:23:15.915797+0000","last_became_active":"2023-10-06T02:23:14.907843+0000","last_became_peered":"2023-10-06T02:23:14.907843+0000","last_unstale":"2023-10-06T02:23:15.915797+0000","last_undegraded":"2023-10-06T02:23:15.915797+0000","last_fullsized":"2023-10-06T02:23:15.915797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:25.539314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919213+0000","last_change":"2023-10-06T02:23:15.907616+0000","last_active":"2023-10-06T02:23:15.919213+0000","last_peered":"2023-10-06T02:23:15.919213+0000","last_clean":"2023-10-06T02:23:15.919213+0000","last_became_active":"2023-10-06T02:23:15.907283+0000","last_became_peered":"2023-10-06T02:23:15.907283+0000","last_unstale":"2023-10-06T02:23:15.919213+0000","last_undegraded":"2023-10-06T02:23:15.919213+0000","last_fullsized":"2023-10-06T02:23:15.919213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:35.060508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913466+0000","last_change":"2023-10-06T02:23:14.895063+0000","last_active":"2023-10-06T02:23:15.913466+0000","last_peered":"2023-10-06T02:23:15.913466+0000","last_clean":"2023-10-06T02:23:15.913466+0000","last_became_active":"2023-10-06T02:23:14.894694+0000","last_became_peered":"2023-10-06T02:23:14.894694+0000","last_unstale":"2023-10-06T02:23:15.913466+0000","last_undegraded":"2023-10-06T02:23:15.913466+0000","last_fullsized":"2023-10-06T02:23:15.913466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.054986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916712+0000","last_change":"2023-10-06T02:23:15.912820+0000","last_active":"2023-10-06T02:23:15.916712+0000","last_peered":"2023-10-06T02:23:15.916712+0000","last_clean":"2023-10-06T02:23:15.916712+0000","last_became_active":"2023-10-06T02:23:15.912469+0000","last_became_peered":"2023-10-06T02:23:15.912469+0000","last_unstale":"2023-10-06T02:23:15.916712+0000","last_undegraded":"2023-10-06T02:23:15.916712+0000","last_fullsized":"2023-10-06T02:23:15.916712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:07.345058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912740+0000","last_change":"2023-10-06T02:23:14.904850+0000","last_active":"2023-10-06T02:23:15.912740+0000","last_peered":"2023-10-06T02:23:15.912740+0000","last_clean":"2023-10-06T02:23:15.912740+0000","last_became_active":"2023-10-06T02:23:14.904569+0000","last_became_peered":"2023-10-06T02:23:14.904569+0000","last_unstale":"2023-10-06T02:23:15.912740+0000","last_undegraded":"2023-10-06T02:23:15.912740+0000","last_fullsized":"2023-10-06T02:23:15.912740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:47.698904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912380+0000","last_change":"2023-10-06T02:23:15.905102+0000","last_active":"2023-10-06T02:23:15.912380+0000","last_peered":"2023-10-06T02:23:15.912380+0000","last_clean":"2023-10-06T02:23:15.912380+0000","last_became_active":"2023-10-06T02:23:15.904796+0000","last_became_peered":"2023-10-06T02:23:15.904796+0000","last_unstale":"2023-10-06T02:23:15.912380+0000","last_undegraded":"2023-10-06T02:23:15.912380+0000","last_fullsized":"2023-10-06T02:23:15.912380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:47.162284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912504+0000","last_change":"2023-10-06T02:23:14.903685+0000","last_active":"2023-10-06T02:23:15.912504+0000","last_peered":"2023-10-06T02:23:15.912504+0000","last_clean":"2023-10-06T02:23:15.912504+0000","last_became_active":"2023-10-06T02:23:14.902829+0000","last_became_peered":"2023-10-06T02:23:14.902829+0000","last_unstale":"2023-10-06T02:23:15.912504+0000","last_undegraded":"2023-10-06T02:23:15.912504+0000","last_fullsized":"2023-10-06T02:23:15.912504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:50.363282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912866+0000","last_change":"2023-10-06T02:23:15.909237+0000","last_active":"2023-10-06T02:23:15.912866+0000","last_peered":"2023-10-06T02:23:15.912866+0000","last_clean":"2023-10-06T02:23:15.912866+0000","last_became_active":"2023-10-06T02:23:15.908957+0000","last_became_peered":"2023-10-06T02:23:15.908957+0000","last_unstale":"2023-10-06T02:23:15.912866+0000","last_undegraded":"2023-10-06T02:23:15.912866+0000","last_fullsized":"2023-10-06T02:23:15.912866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910567+0000","last_change":"2023-10-06T02:23:14.904438+0000","last_active":"2023-10-06T02:23:15.910567+0000","last_peered":"2023-10-06T02:23:15.910567+0000","last_clean":"2023-10-06T02:23:15.910567+0000","last_became_active":"2023-10-06T02:23:14.904157+0000","last_became_peered":"2023-10-06T02:23:14.904157+0000","last_unstale":"2023-10-06T02:23:15.910567+0000","last_undegraded":"2023-10-06T02:23:15.910567+0000","last_fullsized":"2023-10-06T02:23:15.910567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.054986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913770+0000","last_change":"2023-10-06T02:23:15.909579+0000","last_active":"2023-10-06T02:23:15.913770+0000","last_peered":"2023-10-06T02:23:15.913770+0000","last_clean":"2023-10-06T02:23:15.913770+0000","last_became_active":"2023-10-06T02:23:15.909173+0000","last_became_peered":"2023-10-06T02:23:15.909173+0000","last_unstale":"2023-10-06T02:23:15.913770+0000","last_undegraded":"2023-10-06T02:23:15.913770+0000","last_fullsized":"2023-10-06T02:23:15.913770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:14.278390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913856+0000","last_change":"2023-10-06T02:23:15.911519+0000","last_active":"2023-10-06T02:23:15.913856+0000","last_peered":"2023-10-06T02:23:15.913856+0000","last_clean":"2023-10-06T02:23:15.913856+0000","last_became_active":"2023-10-06T02:23:15.911040+0000","last_became_peered":"2023-10-06T02:23:15.911040+0000","last_unstale":"2023-10-06T02:23:15.913856+0000","last_undegraded":"2023-10-06T02:23:15.913856+0000","last_fullsized":"2023-10-06T02:23:15.913856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:23:21.180114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919359+0000","last_change":"2023-10-06T02:23:15.912783+0000","last_active":"2023-10-06T02:23:15.919359+0000","last_peered":"2023-10-06T02:23:15.919359+0000","last_clean":"2023-10-06T02:23:15.919359+0000","last_became_active":"2023-10-06T02:23:15.912284+0000","last_became_peered":"2023-10-06T02:23:15.912284+0000","last_unstale":"2023-10-06T02:23:15.919359+0000","last_undegraded":"2023-10-06T02:23:15.919359+0000","last_fullsized":"2023-10-06T02:23:15.919359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:25.497567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912361+0000","last_change":"2023-10-06T02:23:15.902724+0000","last_active":"2023-10-06T02:23:15.912361+0000","last_peered":"2023-10-06T02:23:15.912361+0000","last_clean":"2023-10-06T02:23:15.912361+0000","last_became_active":"2023-10-06T02:23:15.902437+0000","last_became_peered":"2023-10-06T02:23:15.902437+0000","last_unstale":"2023-10-06T02:23:15.912361+0000","last_undegraded":"2023-10-06T02:23:15.912361+0000","last_fullsized":"2023-10-06T02:23:15.912361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:35.495163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920718+0000","last_change":"2023-10-06T02:23:15.918968+0000","last_active":"2023-10-06T02:23:15.920718+0000","last_peered":"2023-10-06T02:23:15.920718+0000","last_clean":"2023-10-06T02:23:15.920718+0000","last_became_active":"2023-10-06T02:23:15.918669+0000","last_became_peered":"2023-10-06T02:23:15.918669+0000","last_unstale":"2023-10-06T02:23:15.920718+0000","last_undegraded":"2023-10-06T02:23:15.920718+0000","last_fullsized":"2023-10-06T02:23:15.920718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:33.357066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920160+0000","last_change":"2023-10-06T02:23:15.918229+0000","last_active":"2023-10-06T02:23:15.920160+0000","last_peered":"2023-10-06T02:23:15.920160+0000","last_clean":"2023-10-06T02:23:15.920160+0000","last_became_active":"2023-10-06T02:23:15.917809+0000","last_became_peered":"2023-10-06T02:23:15.917809+0000","last_unstale":"2023-10-06T02:23:15.920160+0000","last_undegraded":"2023-10-06T02:23:15.920160+0000","last_fullsized":"2023-10-06T02:23:15.920160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:58.461395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":664552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":73385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":74184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":72921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:23:20.772 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T02:23:20.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.924+0000 7f9a5d6ea700 1 Processor -- start 2023-10-06T02:23:20.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.924+0000 7f9a5d6ea700 1 -- start start 2023-10-06T02:23:20.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.925+0000 7f9a5d6ea700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a58159320 0x7f9a5815d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:20.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.925+0000 7f9a5d6ea700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9a581596f0 0x7f9a5806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:20.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.925+0000 7f9a5d6ea700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5806d840 con 0x7f9a580ca730 2023-10-06T02:23:20.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.925+0000 7f9a5d6ea700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5806d4f0 con 0x7f9a581596f0 2023-10-06T02:23:20.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.925+0000 7f9a5d6ea700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5815d930 con 0x7f9a58159320 2023-10-06T02:23:20.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.925+0000 7f9a5cee9700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9a580ca730 0x7f9a580b0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40908/0 (socket says 172.21.15.37:40908) 2023-10-06T02:23:20.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.925+0000 7f9a5cee9700 1 -- 172.21.15.37:0/1853074426 learned_addr learned my addr 172.21.15.37:0/1853074426 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:20.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.925+0000 7f9a57fff700 1 --2- 172.21.15.37:0/1853074426 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a58159320 0x7f9a5815d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:20.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.925+0000 7f9a577fe700 1 --2- 172.21.15.37:0/1853074426 >> v2:172.21.15.191:3300/0 conn(0x7f9a581596f0 0x7f9a5806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:20.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.925+0000 7f9a56ffd700 1 -- 172.21.15.37:0/1853074426 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503241998 0 0) 0x7f9a5806d840 con 0x7f9a580ca730 2023-10-06T02:23:20.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.925+0000 7f9a56ffd700 1 -- 172.21.15.37:0/1853074426 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a40003570 con 0x7f9a580ca730 2023-10-06T02:23:20.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.926+0000 7f9a577fe700 1 -- 172.21.15.37:0/1853074426 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a58159320 msgr2=0x7f9a5815d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:20.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.926+0000 7f9a577fe700 1 --2- 172.21.15.37:0/1853074426 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a58159320 0x7f9a5815d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.926+0000 7f9a577fe700 1 -- 172.21.15.37:0/1853074426 >> v1:172.21.15.37:6789/0 conn(0x7f9a580ca730 legacy=0x7f9a580b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:20.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.926+0000 7f9a577fe700 1 -- 172.21.15.37:0/1853074426 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5815dc10 con 0x7f9a581596f0 2023-10-06T02:23:20.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.926+0000 7f9a57fff700 1 --2- 172.21.15.37:0/1853074426 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a58159320 0x7f9a5815d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:20.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.926+0000 7f9a577fe700 1 --2- 172.21.15.37:0/1853074426 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a581596f0 0x7f9a5806dcd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9a480098e0 tx=0x7f9a480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d82edbaff7f9ff1d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:20.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.926+0000 7f9a56ffd700 1 -- 172.21.15.37:0/1853074426 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a48011630 con 0x7f9a581596f0 2023-10-06T02:23:20.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.926+0000 7f9a56ffd700 1 -- 172.21.15.37:0/1853074426 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a48011790 con 0x7f9a581596f0 2023-10-06T02:23:20.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.926+0000 7f9a56ffd700 1 -- 172.21.15.37:0/1853074426 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a48011b30 con 0x7f9a581596f0 2023-10-06T02:23:20.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.926+0000 7f9a5d6ea700 1 -- 172.21.15.37:0/1853074426 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a581596f0 msgr2=0x7f9a5806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:20.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.926+0000 7f9a5d6ea700 1 --2- 172.21.15.37:0/1853074426 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a581596f0 0x7f9a5806dcd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9a480098e0 tx=0x7f9a480091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.926+0000 7f9a5d6ea700 1 -- 172.21.15.37:0/1853074426 shutdown_connections 2023-10-06T02:23:20.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.926+0000 7f9a5d6ea700 1 --2- 172.21.15.37:0/1853074426 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a58159320 0x7f9a5815d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.926+0000 7f9a5d6ea700 1 --2- 172.21.15.37:0/1853074426 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a581596f0 0x7f9a5806dcd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.926+0000 7f9a5d6ea700 1 -- 172.21.15.37:0/1853074426 >> 172.21.15.37:0/1853074426 conn(0x7f9a580ce190 msgr2=0x7f9a580ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:20.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.927+0000 7f9a5d6ea700 1 -- 172.21.15.37:0/1853074426 shutdown_connections 2023-10-06T02:23:20.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.927+0000 7f9a5d6ea700 1 -- 172.21.15.37:0/1853074426 wait complete. 2023-10-06T02:23:20.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.928+0000 7f9a5d6ea700 1 Processor -- start 2023-10-06T02:23:20.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.928+0000 7f9a5d6ea700 1 -- start start 2023-10-06T02:23:20.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.928+0000 7f9a5d6ea700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a580ca730 0x7f9a580c2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:20.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.928+0000 7f9a5d6ea700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a58159320 0x7f9a581581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:20.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.928+0000 7f9a5d6ea700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a581596f0 0x7f9a58158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:20.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.928+0000 7f9a5d6ea700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a580b1350 con 0x7f9a581596f0 2023-10-06T02:23:20.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.928+0000 7f9a5d6ea700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a580c7e10 con 0x7f9a58159320 2023-10-06T02:23:20.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.928+0000 7f9a5d6ea700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a580c48d0 con 0x7f9a580ca730 2023-10-06T02:23:20.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.929+0000 7f9a5cee9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a581596f0 0x7f9a58158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:20.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.929+0000 7f9a5cee9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a581596f0 0x7f9a58158700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33054/0 (socket says 172.21.15.37:33054) 2023-10-06T02:23:20.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.929+0000 7f9a5cee9700 1 -- 172.21.15.37:0/3000996119 learned_addr learned my addr 172.21.15.37:0/3000996119 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:20.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.929+0000 7f9a577fe700 1 --2- 172.21.15.37:0/3000996119 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a58159320 0x7f9a581581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:20.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.929+0000 7f9a57fff700 1 --2- 172.21.15.37:0/3000996119 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a580ca730 0x7f9a580c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:20.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.929+0000 7f9a5cee9700 1 -- 172.21.15.37:0/3000996119 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a580ca730 msgr2=0x7f9a580c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:20.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.929+0000 7f9a5cee9700 1 --2- 172.21.15.37:0/3000996119 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a580ca730 0x7f9a580c2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.929+0000 7f9a5cee9700 1 -- 172.21.15.37:0/3000996119 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a58159320 msgr2=0x7f9a581581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:20.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.929+0000 7f9a5cee9700 1 --2- 172.21.15.37:0/3000996119 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a58159320 0x7f9a581581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:20.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.929+0000 7f9a5cee9700 1 -- 172.21.15.37:0/3000996119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c009420 con 0x7f9a581596f0 2023-10-06T02:23:20.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.929+0000 7f9a5cee9700 1 --2- 172.21.15.37:0/3000996119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a581596f0 0x7f9a58158700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000cca0 tx=0x7f9a50001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:20.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.929+0000 7f9a3ffff700 1 -- 172.21.15.37:0/3000996119 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5000ab30 con 0x7f9a581596f0 2023-10-06T02:23:20.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.929+0000 7f9a3ffff700 1 -- 172.21.15.37:0/3000996119 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5000ac90 con 0x7f9a581596f0 2023-10-06T02:23:20.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.929+0000 7f9a5d6ea700 1 -- 172.21.15.37:0/3000996119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a48009420 con 0x7f9a581596f0 2023-10-06T02:23:20.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.929+0000 7f9a3ffff700 1 -- 172.21.15.37:0/3000996119 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a50007300 con 0x7f9a581596f0 2023-10-06T02:23:20.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.929+0000 7f9a5d6ea700 1 -- 172.21.15.37:0/3000996119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a580c4e90 con 0x7f9a581596f0 2023-10-06T02:23:20.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.930+0000 7f9a5d6ea700 1 -- 172.21.15.37:0/3000996119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a58064b00 con 0x7f9a581596f0 2023-10-06T02:23:20.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.931+0000 7f9a3ffff700 1 -- 172.21.15.37:0/3000996119 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a50007730 con 0x7f9a581596f0 2023-10-06T02:23:20.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.931+0000 7f9a3ffff700 1 --2- 172.21.15.37:0/3000996119 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9a44066f30 0x7f9a440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:20.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.931+0000 7f9a3ffff700 1 -- 172.21.15.37:0/3000996119 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9a50084b90 con 0x7f9a581596f0 2023-10-06T02:23:20.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.931+0000 7f9a57fff700 1 --2- 172.21.15.37:0/3000996119 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9a44066f30 0x7f9a440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:20.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.932+0000 7f9a57fff700 1 --2- 172.21.15.37:0/3000996119 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9a44066f30 0x7f9a440693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c0093f0 tx=0x7f9a4c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:20.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:20.935+0000 7f9a3ffff700 1 -- 172.21.15.37:0/3000996119 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a50051d20 con 0x7f9a581596f0 2023-10-06T02:23:20.951 INFO:tasks.ceph.mds.b.smithi191.stderr:2023-10-06T02:23:20.950+0000 7fe3df873700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:23:21.031 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:23:21.034 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:23:21.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.209+0000 7f9a5d6ea700 1 -- 172.21.15.37:0/3000996119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9a5815def0 con 0x7f9a581596f0 2023-10-06T02:23:21.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.210+0000 7f9a3ffff700 1 -- 172.21.15.37:0/3000996119 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1015 (secure 0 0 0) 0x7f9a50055340 con 0x7f9a581596f0 2023-10-06T02:23:21.210 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:21.210 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":24,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1696558987,"num_in_osds":8,"osd_in_since":1696558979,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592674,"bytes_used":2438262784,"bytes_avail":770655850496,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4288}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-06T02:22:56.857675+0000","services":{}},"progress_events":{}} 2023-10-06T02:23:21.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.212+0000 7f9a5d6ea700 1 -- 172.21.15.37:0/3000996119 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9a44066f30 msgr2=0x7f9a440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.212+0000 7f9a5d6ea700 1 --2- 172.21.15.37:0/3000996119 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9a44066f30 0x7f9a440693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c0093f0 tx=0x7f9a4c008040 comp rx=0 tx=0).stop 2023-10-06T02:23:21.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.212+0000 7f9a5d6ea700 1 -- 172.21.15.37:0/3000996119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a581596f0 msgr2=0x7f9a58158700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.212+0000 7f9a5d6ea700 1 --2- 172.21.15.37:0/3000996119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a581596f0 0x7f9a58158700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000cca0 tx=0x7f9a50001ae0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.212+0000 7f9a5d6ea700 1 -- 172.21.15.37:0/3000996119 shutdown_connections 2023-10-06T02:23:21.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.212+0000 7f9a5d6ea700 1 --2- 172.21.15.37:0/3000996119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a581596f0 0x7f9a58158700 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.212+0000 7f9a5d6ea700 1 --2- 172.21.15.37:0/3000996119 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a580ca730 0x7f9a580c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.212+0000 7f9a5d6ea700 1 --2- 172.21.15.37:0/3000996119 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9a44066f30 0x7f9a440693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.212+0000 7f9a5d6ea700 1 --2- 172.21.15.37:0/3000996119 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a58159320 0x7f9a581581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.212+0000 7f9a5d6ea700 1 -- 172.21.15.37:0/3000996119 >> 172.21.15.37:0/3000996119 conn(0x7f9a580ce190 msgr2=0x7f9a581578d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:21.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.212+0000 7f9a5d6ea700 1 -- 172.21.15.37:0/3000996119 shutdown_connections 2023-10-06T02:23:21.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.212+0000 7f9a5d6ea700 1 -- 172.21.15.37:0/3000996119 wait complete. 2023-10-06T02:23:21.225 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T02:23:21.225 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:23:21.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.343+0000 7f1962e2a700 1 Processor -- start 2023-10-06T02:23:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.343+0000 7f1962e2a700 1 -- start start 2023-10-06T02:23:21.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.344+0000 7f1962e2a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f195c159aa0 0x7f195c0c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.344+0000 7f1962e2a700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f195c0c6b30 0x7f195c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.344+0000 7f1962e2a700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c0c5300 con 0x7f195c1596d0 2023-10-06T02:23:21.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.344+0000 7f1962e2a700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c0c6160 con 0x7f195c0c6b30 2023-10-06T02:23:21.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.344+0000 7f1962e2a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0c5550 con 0x7f195c159aa0 2023-10-06T02:23:21.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.344+0000 7f1960bc6700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f195c1596d0 0x7f195c0b3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40922/0 (socket says 172.21.15.37:40922) 2023-10-06T02:23:21.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.344+0000 7f1960bc6700 1 -- 172.21.15.37:0/1537888972 learned_addr learned my addr 172.21.15.37:0/1537888972 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:21.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.344+0000 7f19613c7700 1 --2- 172.21.15.37:0/1537888972 >> v2:172.21.15.191:3300/0 conn(0x7f195c0c6b30 0x7f195c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.344+0000 7f195bfff700 1 --2- 172.21.15.37:0/1537888972 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f195c159aa0 0x7f195c0c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.344+0000 7f195b7fe700 1 -- 172.21.15.37:0/1537888972 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030443815 0 0) 0x7f195c0c5300 con 0x7f195c1596d0 2023-10-06T02:23:21.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.344+0000 7f195b7fe700 1 -- 172.21.15.37:0/1537888972 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1948003570 con 0x7f195c1596d0 2023-10-06T02:23:21.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f195b7fe700 1 -- 172.21.15.37:0/1537888972 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1781704336 0 0) 0x7f1948003570 con 0x7f195c1596d0 2023-10-06T02:23:21.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f195b7fe700 1 -- 172.21.15.37:0/1537888972 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f195c159aa0 msgr2=0x7f195c0c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:21.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f195b7fe700 1 --2- 172.21.15.37:0/1537888972 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f195c159aa0 0x7f195c0c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f195b7fe700 1 -- 172.21.15.37:0/1537888972 >> v2:172.21.15.191:3300/0 conn(0x7f195c0c6b30 msgr2=0x7f195c0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:21.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f195b7fe700 1 --2- 172.21.15.37:0/1537888972 >> v2:172.21.15.191:3300/0 conn(0x7f195c0c6b30 0x7f195c0cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f195b7fe700 1 -- 172.21.15.37:0/1537888972 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c0c5830 con 0x7f195c1596d0 2023-10-06T02:23:21.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f195b7fe700 1 -- 172.21.15.37:0/1537888972 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f1954001470 con 0x7f195c1596d0 2023-10-06T02:23:21.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f195b7fe700 1 -- 172.21.15.37:0/1537888972 >> v1:172.21.15.37:6789/0 conn(0x7f195c1596d0 legacy=0x7f195c0b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f195b7fe700 1 --2- 172.21.15.37:0/1537888972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1948003a60 0x7f1948003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f195b7fe700 1 --2- 172.21.15.37:0/1537888972 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f195c159aa0 0x7f1948004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f195b7fe700 1 --2- 172.21.15.37:0/1537888972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1948004d50 0x7f19480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f195b7fe700 1 -- 172.21.15.37:0/1537888972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0c6160 con 0x7f1948003a60 2023-10-06T02:23:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f195b7fe700 1 -- 172.21.15.37:0/1537888972 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0c5550 con 0x7f1948004d50 2023-10-06T02:23:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f195b7fe700 1 -- 172.21.15.37:0/1537888972 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194800ba60 con 0x7f195c159aa0 2023-10-06T02:23:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f1960bc6700 1 --2- 172.21.15.37:0/1537888972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1948003a60 0x7f1948003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f195bfff700 1 --2- 172.21.15.37:0/1537888972 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f195c159aa0 0x7f1948004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f19613c7700 1 --2- 172.21.15.37:0/1537888972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1948004d50 0x7f19480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f1960bc6700 1 -- 172.21.15.37:0/1537888972 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f195c159aa0 msgr2=0x7f1948004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f1960bc6700 1 --2- 172.21.15.37:0/1537888972 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f195c159aa0 0x7f1948004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f1960bc6700 1 -- 172.21.15.37:0/1537888972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1948004d50 msgr2=0x7f19480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f1960bc6700 1 --2- 172.21.15.37:0/1537888972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1948004d50 0x7f19480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f1960bc6700 1 -- 172.21.15.37:0/1537888972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1948003570 con 0x7f1948003a60 2023-10-06T02:23:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f1960bc6700 1 --2- 172.21.15.37:0/1537888972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1948003a60 0x7f1948003e70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f195400c3c0 tx=0x7f1954001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9b02bfb7398818 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.345+0000 7f195b7fe700 1 -- 172.21.15.37:0/1537888972 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195400cc30 con 0x7f1948003a60 2023-10-06T02:23:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.346+0000 7f195b7fe700 1 -- 172.21.15.37:0/1537888972 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195400cdb0 con 0x7f1948003a60 2023-10-06T02:23:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.346+0000 7f195b7fe700 1 -- 172.21.15.37:0/1537888972 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1954005b70 con 0x7f1948003a60 2023-10-06T02:23:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.346+0000 7f1962e2a700 1 -- 172.21.15.37:0/1537888972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1948003a60 msgr2=0x7f1948003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.346+0000 7f1962e2a700 1 --2- 172.21.15.37:0/1537888972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1948003a60 0x7f1948003e70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f195400c3c0 tx=0x7f1954001e90 comp rx=0 tx=0).stop 2023-10-06T02:23:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.346+0000 7f19613c7700 1 -- 172.21.15.37:0/1537888972 reap_dead start 2023-10-06T02:23:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.346+0000 7f1962e2a700 1 -- 172.21.15.37:0/1537888972 shutdown_connections 2023-10-06T02:23:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.346+0000 7f1962e2a700 1 -- 172.21.15.37:0/1537888972 >> 172.21.15.37:0/1537888972 conn(0x7f195c06c890 msgr2=0x7f195c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.346+0000 7f1962e2a700 1 -- 172.21.15.37:0/1537888972 shutdown_connections 2023-10-06T02:23:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.346+0000 7f1962e2a700 1 -- 172.21.15.37:0/1537888972 wait complete. 2023-10-06T02:23:21.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.347+0000 7f1962e2a700 1 Processor -- start 2023-10-06T02:23:21.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.347+0000 7f1962e2a700 1 -- start start 2023-10-06T02:23:21.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.348+0000 7f1962e2a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1948003a60 0x7f195c154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.348+0000 7f1962e2a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f195c15d860 0x7f195c15ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.348+0000 7f1962e2a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c15c2a0 0x7f195c15c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.348+0000 7f1962e2a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c15cc50 con 0x7f195c15c2a0 2023-10-06T02:23:21.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.348+0000 7f1962e2a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c16a1d0 con 0x7f1948003a60 2023-10-06T02:23:21.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.348+0000 7f1962e2a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c15bb30 con 0x7f195c15d860 2023-10-06T02:23:21.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.348+0000 7f19613c7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c15c2a0 0x7f195c15c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.348+0000 7f19613c7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c15c2a0 0x7f195c15c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33074/0 (socket says 172.21.15.37:33074) 2023-10-06T02:23:21.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.348+0000 7f19613c7700 1 -- 172.21.15.37:0/1978761169 learned_addr learned my addr 172.21.15.37:0/1978761169 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:21.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.348+0000 7f1960bc6700 1 --2- 172.21.15.37:0/1978761169 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1948003a60 0x7f195c154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.348+0000 7f195bfff700 1 --2- 172.21.15.37:0/1978761169 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f195c15d860 0x7f195c15ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.348+0000 7f19613c7700 1 -- 172.21.15.37:0/1978761169 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f195c15d860 msgr2=0x7f195c15ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.348+0000 7f19613c7700 1 --2- 172.21.15.37:0/1978761169 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f195c15d860 0x7f195c15ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.348+0000 7f19613c7700 1 -- 172.21.15.37:0/1978761169 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1948003a60 msgr2=0x7f195c154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.348+0000 7f19613c7700 1 --2- 172.21.15.37:0/1978761169 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1948003a60 0x7f195c154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.348+0000 7f19613c7700 1 -- 172.21.15.37:0/1978761169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c169ea0 con 0x7f195c15c2a0 2023-10-06T02:23:21.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.349+0000 7f19613c7700 1 --2- 172.21.15.37:0/1978761169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c15c2a0 0x7f195c15c710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f195c08aa10 tx=0x7f19440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:21.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.349+0000 7f1958ff9700 1 -- 172.21.15.37:0/1978761169 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1944013680 con 0x7f195c15c2a0 2023-10-06T02:23:21.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.349+0000 7f1958ff9700 1 -- 172.21.15.37:0/1978761169 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19440137e0 con 0x7f195c15c2a0 2023-10-06T02:23:21.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.349+0000 7f1962e2a700 1 -- 172.21.15.37:0/1978761169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195c15b570 con 0x7f195c15c2a0 2023-10-06T02:23:21.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.349+0000 7f1958ff9700 1 -- 172.21.15.37:0/1978761169 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1944013b60 con 0x7f195c15c2a0 2023-10-06T02:23:21.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.349+0000 7f1962e2a700 1 -- 172.21.15.37:0/1978761169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195c15b180 con 0x7f195c15c2a0 2023-10-06T02:23:21.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.350+0000 7f1962e2a700 1 -- 172.21.15.37:0/1978761169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195c16a380 con 0x7f195c15c2a0 2023-10-06T02:23:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.350+0000 7f1958ff9700 1 -- 172.21.15.37:0/1978761169 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1944014440 con 0x7f195c15c2a0 2023-10-06T02:23:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.351+0000 7f1958ff9700 1 --2- 172.21.15.37:0/1978761169 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f193c066f30 0x7f193c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.351+0000 7f1958ff9700 1 -- 172.21.15.37:0/1978761169 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1944084990 con 0x7f195c15c2a0 2023-10-06T02:23:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.351+0000 7f1960bc6700 1 --2- 172.21.15.37:0/1978761169 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f193c066f30 0x7f193c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.351+0000 7f1960bc6700 1 --2- 172.21.15.37:0/1978761169 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f193c066f30 0x7f193c0693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1954001ed0 tx=0x7f1954015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.355+0000 7f1958ff9700 1 -- 172.21.15.37:0/1978761169 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f195c16a380 con 0x7f195c15c2a0 2023-10-06T02:23:21.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.543+0000 7f1962e2a700 1 -- 172.21.15.37:0/1978761169 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f195c0cfd30 con 0x7f193c066f30 2023-10-06T02:23:21.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.551+0000 7f1958ff9700 1 -- 172.21.15.37:0/1978761169 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286897 (secure 0 0 0) 0x7f195c0cfd30 con 0x7f193c066f30 2023-10-06T02:23:21.555 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:21.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.554+0000 7f1962e2a700 1 -- 172.21.15.37:0/1978761169 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f193c066f30 msgr2=0x7f193c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.554+0000 7f1962e2a700 1 --2- 172.21.15.37:0/1978761169 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f193c066f30 0x7f193c0693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1954001ed0 tx=0x7f1954015000 comp rx=0 tx=0).stop 2023-10-06T02:23:21.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.554+0000 7f1962e2a700 1 -- 172.21.15.37:0/1978761169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c15c2a0 msgr2=0x7f195c15c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:21.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.554+0000 7f1962e2a700 1 --2- 172.21.15.37:0/1978761169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c15c2a0 0x7f195c15c710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f195c08aa10 tx=0x7f19440091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.554+0000 7f1962e2a700 1 -- 172.21.15.37:0/1978761169 shutdown_connections 2023-10-06T02:23:21.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.554+0000 7f1962e2a700 1 --2- 172.21.15.37:0/1978761169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c15c2a0 0x7f195c15c710 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.554+0000 7f1962e2a700 1 --2- 172.21.15.37:0/1978761169 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f193c066f30 0x7f193c0693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.554+0000 7f1962e2a700 1 --2- 172.21.15.37:0/1978761169 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1948003a60 0x7f195c154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.554+0000 7f1962e2a700 1 --2- 172.21.15.37:0/1978761169 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f195c15d860 0x7f195c15ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:21.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.554+0000 7f1962e2a700 1 -- 172.21.15.37:0/1978761169 >> 172.21.15.37:0/1978761169 conn(0x7f195c06c890 msgr2=0x7f195c06f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:21.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.554+0000 7f1962e2a700 1 -- 172.21.15.37:0/1978761169 shutdown_connections 2023-10-06T02:23:21.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:21.554+0000 7f1962e2a700 1 -- 172.21.15.37:0/1978761169 wait complete. 2023-10-06T02:23:21.559 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:23:21.566 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-06T02:23:20.508623+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381116,"kb_used_data":2812,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593604,"statfs":{"total":773094113280,"available":770655850496,"internally_reserved":0,"allocated":2879488,"data_stored":1774761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001307"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919168+0000","last_change":"2023-10-06T02:23:15.908982+0000","last_active":"2023-10-06T02:23:15.919168+0000","last_peered":"2023-10-06T02:23:15.919168+0000","last_clean":"2023-10-06T02:23:15.919168+0000","last_became_active":"2023-10-06T02:23:15.908698+0000","last_became_peered":"2023-10-06T02:23:15.908698+0000","last_unstale":"2023-10-06T02:23:15.919168+0000","last_undegraded":"2023-10-06T02:23:15.919168+0000","last_fullsized":"2023-10-06T02:23:15.919168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:10.934479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913252+0000","last_change":"2023-10-06T02:23:15.912067+0000","last_active":"2023-10-06T02:23:15.913252+0000","last_peered":"2023-10-06T02:23:15.913252+0000","last_clean":"2023-10-06T02:23:15.913252+0000","last_became_active":"2023-10-06T02:23:15.911773+0000","last_became_peered":"2023-10-06T02:23:15.911773+0000","last_unstale":"2023-10-06T02:23:15.913252+0000","last_undegraded":"2023-10-06T02:23:15.913252+0000","last_fullsized":"2023-10-06T02:23:15.913252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:29.341324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910351+0000","last_change":"2023-10-06T02:23:15.897603+0000","last_active":"2023-10-06T02:23:15.910351+0000","last_peered":"2023-10-06T02:23:15.910351+0000","last_clean":"2023-10-06T02:23:15.910351+0000","last_became_active":"2023-10-06T02:23:15.897331+0000","last_became_peered":"2023-10-06T02:23:15.897331+0000","last_unstale":"2023-10-06T02:23:15.910351+0000","last_undegraded":"2023-10-06T02:23:15.910351+0000","last_fullsized":"2023-10-06T02:23:15.910351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:22.459072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.909617+0000","last_change":"2023-10-06T02:23:15.906142+0000","last_active":"2023-10-06T02:23:15.909617+0000","last_peered":"2023-10-06T02:23:15.909617+0000","last_clean":"2023-10-06T02:23:15.909617+0000","last_became_active":"2023-10-06T02:23:15.905889+0000","last_became_peered":"2023-10-06T02:23:15.905889+0000","last_unstale":"2023-10-06T02:23:15.909617+0000","last_undegraded":"2023-10-06T02:23:15.909617+0000","last_fullsized":"2023-10-06T02:23:15.909617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:41.861335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915400+0000","last_change":"2023-10-06T02:23:15.903558+0000","last_active":"2023-10-06T02:23:15.915400+0000","last_peered":"2023-10-06T02:23:15.915400+0000","last_clean":"2023-10-06T02:23:15.915400+0000","last_became_active":"2023-10-06T02:23:15.903280+0000","last_became_peered":"2023-10-06T02:23:15.903280+0000","last_unstale":"2023-10-06T02:23:15.915400+0000","last_undegraded":"2023-10-06T02:23:15.915400+0000","last_fullsized":"2023-10-06T02:23:15.915400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.911955+0000","last_change":"2023-10-06T02:23:15.899437+0000","last_active":"2023-10-06T02:23:15.911955+0000","last_peered":"2023-10-06T02:23:15.911955+0000","last_clean":"2023-10-06T02:23:15.911955+0000","last_became_active":"2023-10-06T02:23:15.897553+0000","last_became_peered":"2023-10-06T02:23:15.897553+0000","last_unstale":"2023-10-06T02:23:15.911955+0000","last_undegraded":"2023-10-06T02:23:15.911955+0000","last_fullsized":"2023-10-06T02:23:15.911955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:28.665851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919223+0000","last_change":"2023-10-06T02:23:15.918090+0000","last_active":"2023-10-06T02:23:15.919223+0000","last_peered":"2023-10-06T02:23:15.919223+0000","last_clean":"2023-10-06T02:23:15.919223+0000","last_became_active":"2023-10-06T02:23:15.917887+0000","last_became_peered":"2023-10-06T02:23:15.917887+0000","last_unstale":"2023-10-06T02:23:15.919223+0000","last_undegraded":"2023-10-06T02:23:15.919223+0000","last_fullsized":"2023-10-06T02:23:15.919223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.903010+0000","last_change":"2023-10-06T02:23:15.899230+0000","last_active":"2023-10-06T02:23:15.903010+0000","last_peered":"2023-10-06T02:23:15.903010+0000","last_clean":"2023-10-06T02:23:15.903010+0000","last_became_active":"2023-10-06T02:23:15.898928+0000","last_became_peered":"2023-10-06T02:23:15.898928+0000","last_unstale":"2023-10-06T02:23:15.903010+0000","last_undegraded":"2023-10-06T02:23:15.903010+0000","last_fullsized":"2023-10-06T02:23:15.903010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:58.461395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913512+0000","last_change":"2023-10-06T02:23:15.906778+0000","last_active":"2023-10-06T02:23:15.913512+0000","last_peered":"2023-10-06T02:23:15.913512+0000","last_clean":"2023-10-06T02:23:15.913512+0000","last_became_active":"2023-10-06T02:23:15.906117+0000","last_became_peered":"2023-10-06T02:23:15.906117+0000","last_unstale":"2023-10-06T02:23:15.913512+0000","last_undegraded":"2023-10-06T02:23:15.913512+0000","last_fullsized":"2023-10-06T02:23:15.913512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.899401+0000","last_change":"2023-10-06T02:23:15.897067+0000","last_active":"2023-10-06T02:23:15.899401+0000","last_peered":"2023-10-06T02:23:15.899401+0000","last_clean":"2023-10-06T02:23:15.899401+0000","last_became_active":"2023-10-06T02:23:15.896690+0000","last_became_peered":"2023-10-06T02:23:15.896690+0000","last_unstale":"2023-10-06T02:23:15.899401+0000","last_undegraded":"2023-10-06T02:23:15.899401+0000","last_fullsized":"2023-10-06T02:23:15.899401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912295+0000","last_change":"2023-10-06T02:23:15.904332+0000","last_active":"2023-10-06T02:23:15.912295+0000","last_peered":"2023-10-06T02:23:15.912295+0000","last_clean":"2023-10-06T02:23:15.912295+0000","last_became_active":"2023-10-06T02:23:15.904107+0000","last_became_peered":"2023-10-06T02:23:15.904107+0000","last_unstale":"2023-10-06T02:23:15.912295+0000","last_undegraded":"2023-10-06T02:23:15.912295+0000","last_fullsized":"2023-10-06T02:23:15.912295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:08.354390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919232+0000","last_change":"2023-10-06T02:23:15.914369+0000","last_active":"2023-10-06T02:23:15.919232+0000","last_peered":"2023-10-06T02:23:15.919232+0000","last_clean":"2023-10-06T02:23:15.919232+0000","last_became_active":"2023-10-06T02:23:15.914083+0000","last_became_peered":"2023-10-06T02:23:15.914083+0000","last_unstale":"2023-10-06T02:23:15.919232+0000","last_undegraded":"2023-10-06T02:23:15.919232+0000","last_fullsized":"2023-10-06T02:23:15.919232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:26.544836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919123+0000","last_change":"2023-10-06T02:23:15.911961+0000","last_active":"2023-10-06T02:23:15.919123+0000","last_peered":"2023-10-06T02:23:15.919123+0000","last_clean":"2023-10-06T02:23:15.919123+0000","last_became_active":"2023-10-06T02:23:15.911674+0000","last_became_peered":"2023-10-06T02:23:15.911674+0000","last_unstale":"2023-10-06T02:23:15.919123+0000","last_undegraded":"2023-10-06T02:23:15.919123+0000","last_fullsized":"2023-10-06T02:23:15.919123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:48.704425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.911125+0000","last_change":"2023-10-06T02:23:15.909666+0000","last_active":"2023-10-06T02:23:15.911125+0000","last_peered":"2023-10-06T02:23:15.911125+0000","last_clean":"2023-10-06T02:23:15.911125+0000","last_became_active":"2023-10-06T02:23:15.909184+0000","last_became_peered":"2023-10-06T02:23:15.909184+0000","last_unstale":"2023-10-06T02:23:15.911125+0000","last_undegraded":"2023-10-06T02:23:15.911125+0000","last_fullsized":"2023-10-06T02:23:15.911125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:21.310729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919252+0000","last_change":"2023-10-06T02:23:15.918152+0000","last_active":"2023-10-06T02:23:15.919252+0000","last_peered":"2023-10-06T02:23:15.919252+0000","last_clean":"2023-10-06T02:23:15.919252+0000","last_became_active":"2023-10-06T02:23:15.917956+0000","last_became_peered":"2023-10-06T02:23:15.917956+0000","last_unstale":"2023-10-06T02:23:15.919252+0000","last_undegraded":"2023-10-06T02:23:15.919252+0000","last_fullsized":"2023-10-06T02:23:15.919252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.082330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910937+0000","last_change":"2023-10-06T02:23:15.898556+0000","last_active":"2023-10-06T02:23:15.910937+0000","last_peered":"2023-10-06T02:23:15.910937+0000","last_clean":"2023-10-06T02:23:15.910937+0000","last_became_active":"2023-10-06T02:23:15.897898+0000","last_became_peered":"2023-10-06T02:23:15.897898+0000","last_unstale":"2023-10-06T02:23:15.910937+0000","last_undegraded":"2023-10-06T02:23:15.910937+0000","last_fullsized":"2023-10-06T02:23:15.910937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:33.357066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913539+0000","last_change":"2023-10-06T02:23:15.906966+0000","last_active":"2023-10-06T02:23:15.913539+0000","last_peered":"2023-10-06T02:23:15.913539+0000","last_clean":"2023-10-06T02:23:15.913539+0000","last_became_active":"2023-10-06T02:23:15.906471+0000","last_became_peered":"2023-10-06T02:23:15.906471+0000","last_unstale":"2023-10-06T02:23:15.913539+0000","last_undegraded":"2023-10-06T02:23:15.913539+0000","last_fullsized":"2023-10-06T02:23:15.913539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.082330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912480+0000","last_change":"2023-10-06T02:23:15.909298+0000","last_active":"2023-10-06T02:23:15.912480+0000","last_peered":"2023-10-06T02:23:15.912480+0000","last_clean":"2023-10-06T02:23:15.912480+0000","last_became_active":"2023-10-06T02:23:15.908984+0000","last_became_peered":"2023-10-06T02:23:15.908984+0000","last_unstale":"2023-10-06T02:23:15.912480+0000","last_undegraded":"2023-10-06T02:23:15.912480+0000","last_fullsized":"2023-10-06T02:23:15.912480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:45.070037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919178+0000","last_change":"2023-10-06T02:23:15.908066+0000","last_active":"2023-10-06T02:23:15.919178+0000","last_peered":"2023-10-06T02:23:15.919178+0000","last_clean":"2023-10-06T02:23:15.919178+0000","last_became_active":"2023-10-06T02:23:15.907732+0000","last_became_peered":"2023-10-06T02:23:15.907732+0000","last_unstale":"2023-10-06T02:23:15.919178+0000","last_undegraded":"2023-10-06T02:23:15.919178+0000","last_fullsized":"2023-10-06T02:23:15.919178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:08.585650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913105+0000","last_change":"2023-10-06T02:23:15.907581+0000","last_active":"2023-10-06T02:23:15.913105+0000","last_peered":"2023-10-06T02:23:15.913105+0000","last_clean":"2023-10-06T02:23:15.913105+0000","last_became_active":"2023-10-06T02:23:15.905503+0000","last_became_peered":"2023-10-06T02:23:15.905503+0000","last_unstale":"2023-10-06T02:23:15.913105+0000","last_undegraded":"2023-10-06T02:23:15.913105+0000","last_fullsized":"2023-10-06T02:23:15.913105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:18.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916852+0000","last_change":"2023-10-06T02:23:15.914944+0000","last_active":"2023-10-06T02:23:15.916852+0000","last_peered":"2023-10-06T02:23:15.916852+0000","last_clean":"2023-10-06T02:23:15.916852+0000","last_became_active":"2023-10-06T02:23:15.914700+0000","last_became_peered":"2023-10-06T02:23:15.914700+0000","last_unstale":"2023-10-06T02:23:15.916852+0000","last_undegraded":"2023-10-06T02:23:15.916852+0000","last_fullsized":"2023-10-06T02:23:15.916852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920587+0000","last_change":"2023-10-06T02:23:15.913463+0000","last_active":"2023-10-06T02:23:15.920587+0000","last_peered":"2023-10-06T02:23:15.920587+0000","last_clean":"2023-10-06T02:23:15.920587+0000","last_became_active":"2023-10-06T02:23:15.913127+0000","last_became_peered":"2023-10-06T02:23:15.913127+0000","last_unstale":"2023-10-06T02:23:15.920587+0000","last_undegraded":"2023-10-06T02:23:15.920587+0000","last_fullsized":"2023-10-06T02:23:15.920587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:33.357066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920526+0000","last_change":"2023-10-06T02:23:15.914489+0000","last_active":"2023-10-06T02:23:15.920526+0000","last_peered":"2023-10-06T02:23:15.920526+0000","last_clean":"2023-10-06T02:23:15.920526+0000","last_became_active":"2023-10-06T02:23:15.914221+0000","last_became_peered":"2023-10-06T02:23:15.914221+0000","last_unstale":"2023-10-06T02:23:15.920526+0000","last_undegraded":"2023-10-06T02:23:15.920526+0000","last_fullsized":"2023-10-06T02:23:15.920526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:45.070037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.917128+0000","last_change":"2023-10-06T02:23:15.914958+0000","last_active":"2023-10-06T02:23:15.917128+0000","last_peered":"2023-10-06T02:23:15.917128+0000","last_clean":"2023-10-06T02:23:15.917128+0000","last_became_active":"2023-10-06T02:23:15.914682+0000","last_became_peered":"2023-10-06T02:23:15.914682+0000","last_unstale":"2023-10-06T02:23:15.917128+0000","last_undegraded":"2023-10-06T02:23:15.917128+0000","last_fullsized":"2023-10-06T02:23:15.917128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915313+0000","last_change":"2023-10-06T02:23:15.907412+0000","last_active":"2023-10-06T02:23:15.915313+0000","last_peered":"2023-10-06T02:23:15.915313+0000","last_clean":"2023-10-06T02:23:15.915313+0000","last_became_active":"2023-10-06T02:23:15.906449+0000","last_became_peered":"2023-10-06T02:23:15.906449+0000","last_unstale":"2023-10-06T02:23:15.915313+0000","last_undegraded":"2023-10-06T02:23:15.915313+0000","last_fullsized":"2023-10-06T02:23:15.915313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:32.631860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919905+0000","last_change":"2023-10-06T02:23:15.912982+0000","last_active":"2023-10-06T02:23:15.919905+0000","last_peered":"2023-10-06T02:23:15.919905+0000","last_clean":"2023-10-06T02:23:15.919905+0000","last_became_active":"2023-10-06T02:23:15.910404+0000","last_became_peered":"2023-10-06T02:23:15.910404+0000","last_unstale":"2023-10-06T02:23:15.919905+0000","last_undegraded":"2023-10-06T02:23:15.919905+0000","last_fullsized":"2023-10-06T02:23:15.919905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:56.873370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.918347+0000","last_change":"2023-10-06T02:23:15.916449+0000","last_active":"2023-10-06T02:23:15.918347+0000","last_peered":"2023-10-06T02:23:15.918347+0000","last_clean":"2023-10-06T02:23:15.918347+0000","last_became_active":"2023-10-06T02:23:15.915750+0000","last_became_peered":"2023-10-06T02:23:15.915750+0000","last_unstale":"2023-10-06T02:23:15.918347+0000","last_undegraded":"2023-10-06T02:23:15.918347+0000","last_fullsized":"2023-10-06T02:23:15.918347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910324+0000","last_change":"2023-10-06T02:23:14.907348+0000","last_active":"2023-10-06T02:23:15.910324+0000","last_peered":"2023-10-06T02:23:15.910324+0000","last_clean":"2023-10-06T02:23:15.910324+0000","last_became_active":"2023-10-06T02:23:14.907035+0000","last_became_peered":"2023-10-06T02:23:14.907035+0000","last_unstale":"2023-10-06T02:23:15.910324+0000","last_undegraded":"2023-10-06T02:23:15.910324+0000","last_fullsized":"2023-10-06T02:23:15.910324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:12.131483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.906846+0000","last_change":"2023-10-06T02:23:15.902629+0000","last_active":"2023-10-06T02:23:15.906846+0000","last_peered":"2023-10-06T02:23:15.906846+0000","last_clean":"2023-10-06T02:23:15.906846+0000","last_became_active":"2023-10-06T02:23:15.902328+0000","last_became_peered":"2023-10-06T02:23:15.902328+0000","last_unstale":"2023-10-06T02:23:15.906846+0000","last_undegraded":"2023-10-06T02:23:15.906846+0000","last_fullsized":"2023-10-06T02:23:15.906846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:11.466544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.900770+0000","last_change":"2023-10-06T02:23:14.908961+0000","last_active":"2023-10-06T02:23:15.900770+0000","last_peered":"2023-10-06T02:23:15.900770+0000","last_clean":"2023-10-06T02:23:15.900770+0000","last_became_active":"2023-10-06T02:23:14.908549+0000","last_became_peered":"2023-10-06T02:23:14.908549+0000","last_unstale":"2023-10-06T02:23:15.900770+0000","last_undegraded":"2023-10-06T02:23:15.900770+0000","last_fullsized":"2023-10-06T02:23:15.900770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:37.900811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.925219+0000","last_change":"2023-10-06T02:23:15.921091+0000","last_active":"2023-10-06T02:23:15.925219+0000","last_peered":"2023-10-06T02:23:15.925219+0000","last_clean":"2023-10-06T02:23:15.925219+0000","last_became_active":"2023-10-06T02:23:15.920772+0000","last_became_peered":"2023-10-06T02:23:15.920772+0000","last_unstale":"2023-10-06T02:23:15.925219+0000","last_undegraded":"2023-10-06T02:23:15.925219+0000","last_fullsized":"2023-10-06T02:23:15.925219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:58.461395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.896633+0000","last_change":"2023-10-06T02:23:14.905101+0000","last_active":"2023-10-06T02:23:15.896633+0000","last_peered":"2023-10-06T02:23:15.896633+0000","last_clean":"2023-10-06T02:23:15.896633+0000","last_became_active":"2023-10-06T02:23:14.902379+0000","last_became_peered":"2023-10-06T02:23:14.902379+0000","last_unstale":"2023-10-06T02:23:15.896633+0000","last_undegraded":"2023-10-06T02:23:15.896633+0000","last_fullsized":"2023-10-06T02:23:15.896633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.054986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910630+0000","last_change":"2023-10-06T02:23:15.908338+0000","last_active":"2023-10-06T02:23:15.910630+0000","last_peered":"2023-10-06T02:23:15.910630+0000","last_clean":"2023-10-06T02:23:15.910630+0000","last_became_active":"2023-10-06T02:23:15.907880+0000","last_became_peered":"2023-10-06T02:23:15.907880+0000","last_unstale":"2023-10-06T02:23:15.910630+0000","last_undegraded":"2023-10-06T02:23:15.910630+0000","last_fullsized":"2023-10-06T02:23:15.910630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.350772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.889655+0000","last_change":"2023-10-06T02:23:14.904479+0000","last_active":"2023-10-06T02:23:15.889655+0000","last_peered":"2023-10-06T02:23:15.889655+0000","last_clean":"2023-10-06T02:23:15.889655+0000","last_became_active":"2023-10-06T02:23:14.904187+0000","last_became_peered":"2023-10-06T02:23:14.904187+0000","last_unstale":"2023-10-06T02:23:15.889655+0000","last_undegraded":"2023-10-06T02:23:15.889655+0000","last_fullsized":"2023-10-06T02:23:15.889655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:09.928957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912505+0000","last_change":"2023-10-06T02:23:15.905556+0000","last_active":"2023-10-06T02:23:15.912505+0000","last_peered":"2023-10-06T02:23:15.912505+0000","last_clean":"2023-10-06T02:23:15.912505+0000","last_became_active":"2023-10-06T02:23:15.905335+0000","last_became_peered":"2023-10-06T02:23:15.905335+0000","last_unstale":"2023-10-06T02:23:15.912505+0000","last_undegraded":"2023-10-06T02:23:15.912505+0000","last_fullsized":"2023-10-06T02:23:15.912505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:18.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.892042+0000","last_change":"2023-10-06T02:23:14.900860+0000","last_active":"2023-10-06T02:23:15.892042+0000","last_peered":"2023-10-06T02:23:15.892042+0000","last_clean":"2023-10-06T02:23:15.892042+0000","last_became_active":"2023-10-06T02:23:14.900471+0000","last_became_peered":"2023-10-06T02:23:14.900471+0000","last_unstale":"2023-10-06T02:23:15.892042+0000","last_undegraded":"2023-10-06T02:23:15.892042+0000","last_fullsized":"2023-10-06T02:23:15.892042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:09.928957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920751+0000","last_change":"2023-10-06T02:23:15.917245+0000","last_active":"2023-10-06T02:23:15.920751+0000","last_peered":"2023-10-06T02:23:15.920751+0000","last_clean":"2023-10-06T02:23:15.920751+0000","last_became_active":"2023-10-06T02:23:15.916930+0000","last_became_peered":"2023-10-06T02:23:15.916930+0000","last_unstale":"2023-10-06T02:23:15.920751+0000","last_undegraded":"2023-10-06T02:23:15.920751+0000","last_fullsized":"2023-10-06T02:23:15.920751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:29.341324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915462+0000","last_change":"2023-10-06T02:23:14.908736+0000","last_active":"2023-10-06T02:23:15.915462+0000","last_peered":"2023-10-06T02:23:15.915462+0000","last_clean":"2023-10-06T02:23:15.915462+0000","last_became_active":"2023-10-06T02:23:14.908432+0000","last_became_peered":"2023-10-06T02:23:14.908432+0000","last_unstale":"2023-10-06T02:23:15.915462+0000","last_undegraded":"2023-10-06T02:23:15.915462+0000","last_fullsized":"2023-10-06T02:23:15.915462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:12.345251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.911912+0000","last_change":"2023-10-06T02:23:15.906639+0000","last_active":"2023-10-06T02:23:15.911912+0000","last_peered":"2023-10-06T02:23:15.911912+0000","last_clean":"2023-10-06T02:23:15.911912+0000","last_became_active":"2023-10-06T02:23:15.906358+0000","last_became_peered":"2023-10-06T02:23:15.906358+0000","last_unstale":"2023-10-06T02:23:15.911912+0000","last_undegraded":"2023-10-06T02:23:15.911912+0000","last_fullsized":"2023-10-06T02:23:15.911912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:41.861335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919121+0000","last_change":"2023-10-06T02:23:14.904865+0000","last_active":"2023-10-06T02:23:15.919121+0000","last_peered":"2023-10-06T02:23:15.919121+0000","last_clean":"2023-10-06T02:23:15.919121+0000","last_became_active":"2023-10-06T02:23:14.904563+0000","last_became_peered":"2023-10-06T02:23:14.904563+0000","last_unstale":"2023-10-06T02:23:15.919121+0000","last_undegraded":"2023-10-06T02:23:15.919121+0000","last_fullsized":"2023-10-06T02:23:15.919121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:07.580128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912663+0000","last_change":"2023-10-06T02:23:15.900282+0000","last_active":"2023-10-06T02:23:15.912663+0000","last_peered":"2023-10-06T02:23:15.912663+0000","last_clean":"2023-10-06T02:23:15.912663+0000","last_became_active":"2023-10-06T02:23:15.899729+0000","last_became_peered":"2023-10-06T02:23:15.899729+0000","last_unstale":"2023-10-06T02:23:15.912663+0000","last_undegraded":"2023-10-06T02:23:15.912663+0000","last_fullsized":"2023-10-06T02:23:15.912663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:16.019119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915056+0000","last_change":"2023-10-06T02:23:14.908091+0000","last_active":"2023-10-06T02:23:15.915056+0000","last_peered":"2023-10-06T02:23:15.915056+0000","last_clean":"2023-10-06T02:23:15.915056+0000","last_became_active":"2023-10-06T02:23:14.907787+0000","last_became_peered":"2023-10-06T02:23:14.907787+0000","last_unstale":"2023-10-06T02:23:15.915056+0000","last_undegraded":"2023-10-06T02:23:15.915056+0000","last_fullsized":"2023-10-06T02:23:15.915056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:51.619050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919379+0000","last_change":"2023-10-06T02:23:15.912494+0000","last_active":"2023-10-06T02:23:15.919379+0000","last_peered":"2023-10-06T02:23:15.919379+0000","last_clean":"2023-10-06T02:23:15.919379+0000","last_became_active":"2023-10-06T02:23:15.911909+0000","last_became_peered":"2023-10-06T02:23:15.911909+0000","last_unstale":"2023-10-06T02:23:15.919379+0000","last_undegraded":"2023-10-06T02:23:15.919379+0000","last_fullsized":"2023-10-06T02:23:15.919379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:16.019119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.889128+0000","last_change":"2023-10-06T02:23:14.900521+0000","last_active":"2023-10-06T02:23:15.889128+0000","last_peered":"2023-10-06T02:23:15.889128+0000","last_clean":"2023-10-06T02:23:15.889128+0000","last_became_active":"2023-10-06T02:23:14.900208+0000","last_became_peered":"2023-10-06T02:23:14.900208+0000","last_unstale":"2023-10-06T02:23:15.889128+0000","last_undegraded":"2023-10-06T02:23:15.889128+0000","last_fullsized":"2023-10-06T02:23:15.889128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:12.131483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916972+0000","last_change":"2023-10-06T02:23:15.915762+0000","last_active":"2023-10-06T02:23:15.916972+0000","last_peered":"2023-10-06T02:23:15.916972+0000","last_clean":"2023-10-06T02:23:15.916972+0000","last_became_active":"2023-10-06T02:23:15.915415+0000","last_became_peered":"2023-10-06T02:23:15.915415+0000","last_unstale":"2023-10-06T02:23:15.916972+0000","last_undegraded":"2023-10-06T02:23:15.916972+0000","last_fullsized":"2023-10-06T02:23:15.916972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.082330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.903833+0000","last_change":"2023-10-06T02:23:14.907899+0000","last_active":"2023-10-06T02:23:15.903833+0000","last_peered":"2023-10-06T02:23:15.903833+0000","last_clean":"2023-10-06T02:23:15.903833+0000","last_became_active":"2023-10-06T02:23:14.907600+0000","last_became_peered":"2023-10-06T02:23:14.907600+0000","last_unstale":"2023-10-06T02:23:15.903833+0000","last_undegraded":"2023-10-06T02:23:15.903833+0000","last_fullsized":"2023-10-06T02:23:15.903833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:50.363282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913744+0000","last_change":"2023-10-06T02:23:15.904238+0000","last_active":"2023-10-06T02:23:15.913744+0000","last_peered":"2023-10-06T02:23:15.913744+0000","last_clean":"2023-10-06T02:23:15.913744+0000","last_became_active":"2023-10-06T02:23:15.903899+0000","last_became_peered":"2023-10-06T02:23:15.903899+0000","last_unstale":"2023-10-06T02:23:15.913744+0000","last_undegraded":"2023-10-06T02:23:15.913744+0000","last_fullsized":"2023-10-06T02:23:15.913744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:29.341324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915845+0000","last_change":"2023-10-06T02:23:14.902984+0000","last_active":"2023-10-06T02:23:15.915845+0000","last_peered":"2023-10-06T02:23:15.915845+0000","last_clean":"2023-10-06T02:23:15.915845+0000","last_became_active":"2023-10-06T02:23:14.902743+0000","last_became_peered":"2023-10-06T02:23:14.902743+0000","last_unstale":"2023-10-06T02:23:15.915845+0000","last_undegraded":"2023-10-06T02:23:15.915845+0000","last_fullsized":"2023-10-06T02:23:15.915845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:07.580128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920917+0000","last_change":"2023-10-06T02:23:15.917272+0000","last_active":"2023-10-06T02:23:15.920917+0000","last_peered":"2023-10-06T02:23:15.920917+0000","last_clean":"2023-10-06T02:23:15.920917+0000","last_became_active":"2023-10-06T02:23:15.916874+0000","last_became_peered":"2023-10-06T02:23:15.916874+0000","last_unstale":"2023-10-06T02:23:15.920917+0000","last_undegraded":"2023-10-06T02:23:15.920917+0000","last_fullsized":"2023-10-06T02:23:15.920917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:22.459072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.914495+0000","last_change":"2023-10-06T02:23:14.908202+0000","last_active":"2023-10-06T02:23:15.914495+0000","last_peered":"2023-10-06T02:23:15.914495+0000","last_clean":"2023-10-06T02:23:15.914495+0000","last_became_active":"2023-10-06T02:23:14.907936+0000","last_became_peered":"2023-10-06T02:23:14.907936+0000","last_unstale":"2023-10-06T02:23:15.914495+0000","last_undegraded":"2023-10-06T02:23:15.914495+0000","last_fullsized":"2023-10-06T02:23:15.914495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:43.560751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916861+0000","last_change":"2023-10-06T02:23:15.914877+0000","last_active":"2023-10-06T02:23:15.916861+0000","last_peered":"2023-10-06T02:23:15.916861+0000","last_clean":"2023-10-06T02:23:15.916861+0000","last_became_active":"2023-10-06T02:23:15.914592+0000","last_became_peered":"2023-10-06T02:23:15.914592+0000","last_unstale":"2023-10-06T02:23:15.916861+0000","last_undegraded":"2023-10-06T02:23:15.916861+0000","last_fullsized":"2023-10-06T02:23:15.916861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.914703+0000","last_change":"2023-10-06T02:23:14.908061+0000","last_active":"2023-10-06T02:23:15.914703+0000","last_peered":"2023-10-06T02:23:15.914703+0000","last_clean":"2023-10-06T02:23:15.914703+0000","last_became_active":"2023-10-06T02:23:14.907687+0000","last_became_peered":"2023-10-06T02:23:14.907687+0000","last_unstale":"2023-10-06T02:23:15.914703+0000","last_undegraded":"2023-10-06T02:23:15.914703+0000","last_fullsized":"2023-10-06T02:23:15.914703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:23:20.174592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912220+0000","last_change":"2023-10-06T02:23:15.907204+0000","last_active":"2023-10-06T02:23:15.912220+0000","last_peered":"2023-10-06T02:23:15.912220+0000","last_clean":"2023-10-06T02:23:15.912220+0000","last_became_active":"2023-10-06T02:23:15.906946+0000","last_became_peered":"2023-10-06T02:23:15.906946+0000","last_unstale":"2023-10-06T02:23:15.912220+0000","last_undegraded":"2023-10-06T02:23:15.912220+0000","last_fullsized":"2023-10-06T02:23:15.912220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:48.105101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915301+0000","last_change":"2023-10-06T02:23:14.907440+0000","last_active":"2023-10-06T02:23:15.915301+0000","last_peered":"2023-10-06T02:23:15.915301+0000","last_clean":"2023-10-06T02:23:15.915301+0000","last_became_active":"2023-10-06T02:23:14.907153+0000","last_became_peered":"2023-10-06T02:23:14.907153+0000","last_unstale":"2023-10-06T02:23:15.915301+0000","last_undegraded":"2023-10-06T02:23:15.915301+0000","last_fullsized":"2023-10-06T02:23:15.915301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:41.976855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913457+0000","last_change":"2023-10-06T02:23:15.910344+0000","last_active":"2023-10-06T02:23:15.913457+0000","last_peered":"2023-10-06T02:23:15.913457+0000","last_clean":"2023-10-06T02:23:15.913457+0000","last_became_active":"2023-10-06T02:23:15.910087+0000","last_became_peered":"2023-10-06T02:23:15.910087+0000","last_unstale":"2023-10-06T02:23:15.913457+0000","last_undegraded":"2023-10-06T02:23:15.913457+0000","last_fullsized":"2023-10-06T02:23:15.913457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:32.631860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.891617+0000","last_change":"2023-10-06T02:23:14.899169+0000","last_active":"2023-10-06T02:23:15.891617+0000","last_peered":"2023-10-06T02:23:15.891617+0000","last_clean":"2023-10-06T02:23:15.891617+0000","last_became_active":"2023-10-06T02:23:14.898905+0000","last_became_peered":"2023-10-06T02:23:14.898905+0000","last_unstale":"2023-10-06T02:23:15.891617+0000","last_undegraded":"2023-10-06T02:23:15.891617+0000","last_fullsized":"2023-10-06T02:23:15.891617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:25.539314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915422+0000","last_change":"2023-10-06T02:23:15.906479+0000","last_active":"2023-10-06T02:23:15.915422+0000","last_peered":"2023-10-06T02:23:15.915422+0000","last_clean":"2023-10-06T02:23:15.915422+0000","last_became_active":"2023-10-06T02:23:15.906192+0000","last_became_peered":"2023-10-06T02:23:15.906192+0000","last_unstale":"2023-10-06T02:23:15.915422+0000","last_undegraded":"2023-10-06T02:23:15.915422+0000","last_fullsized":"2023-10-06T02:23:15.915422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:22.459072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.921109+0000","last_change":"2023-10-06T02:23:14.907796+0000","last_active":"2023-10-06T02:23:15.921109+0000","last_peered":"2023-10-06T02:23:15.921109+0000","last_clean":"2023-10-06T02:23:15.921109+0000","last_became_active":"2023-10-06T02:23:14.907286+0000","last_became_peered":"2023-10-06T02:23:14.907286+0000","last_unstale":"2023-10-06T02:23:15.921109+0000","last_undegraded":"2023-10-06T02:23:15.921109+0000","last_fullsized":"2023-10-06T02:23:15.921109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:09.928957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913082+0000","last_change":"2023-10-06T02:23:15.905225+0000","last_active":"2023-10-06T02:23:15.913082+0000","last_peered":"2023-10-06T02:23:15.913082+0000","last_clean":"2023-10-06T02:23:15.913082+0000","last_became_active":"2023-10-06T02:23:15.904931+0000","last_became_peered":"2023-10-06T02:23:15.904931+0000","last_unstale":"2023-10-06T02:23:15.913082+0000","last_undegraded":"2023-10-06T02:23:15.913082+0000","last_fullsized":"2023-10-06T02:23:15.913082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:12.297625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.898775+0000","last_change":"2023-10-06T02:23:14.905972+0000","last_active":"2023-10-06T02:23:15.898775+0000","last_peered":"2023-10-06T02:23:15.898775+0000","last_clean":"2023-10-06T02:23:15.898775+0000","last_became_active":"2023-10-06T02:23:14.905683+0000","last_became_peered":"2023-10-06T02:23:14.905683+0000","last_unstale":"2023-10-06T02:23:15.898775+0000","last_undegraded":"2023-10-06T02:23:15.898775+0000","last_fullsized":"2023-10-06T02:23:15.898775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:12.131483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913680+0000","last_change":"2023-10-06T02:23:15.909799+0000","last_active":"2023-10-06T02:23:15.913680+0000","last_peered":"2023-10-06T02:23:15.913680+0000","last_clean":"2023-10-06T02:23:15.913680+0000","last_became_active":"2023-10-06T02:23:15.909263+0000","last_became_peered":"2023-10-06T02:23:15.909263+0000","last_unstale":"2023-10-06T02:23:15.913680+0000","last_undegraded":"2023-10-06T02:23:15.913680+0000","last_fullsized":"2023-10-06T02:23:15.913680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:11.466544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.892075+0000","last_change":"2023-10-06T02:23:14.898612+0000","last_active":"2023-10-06T02:23:15.892075+0000","last_peered":"2023-10-06T02:23:15.892075+0000","last_clean":"2023-10-06T02:23:15.892075+0000","last_became_active":"2023-10-06T02:23:14.898323+0000","last_became_peered":"2023-10-06T02:23:14.898323+0000","last_unstale":"2023-10-06T02:23:15.892075+0000","last_undegraded":"2023-10-06T02:23:15.892075+0000","last_fullsized":"2023-10-06T02:23:15.892075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:25.539314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912215+0000","last_change":"2023-10-06T02:23:15.906103+0000","last_active":"2023-10-06T02:23:15.912215+0000","last_peered":"2023-10-06T02:23:15.912215+0000","last_clean":"2023-10-06T02:23:15.912215+0000","last_became_active":"2023-10-06T02:23:15.905549+0000","last_became_peered":"2023-10-06T02:23:15.905549+0000","last_unstale":"2023-10-06T02:23:15.912215+0000","last_undegraded":"2023-10-06T02:23:15.912215+0000","last_fullsized":"2023-10-06T02:23:15.912215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:25.497567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.896485+0000","last_change":"2023-10-06T02:23:14.907451+0000","last_active":"2023-10-06T02:23:15.896485+0000","last_peered":"2023-10-06T02:23:15.896485+0000","last_clean":"2023-10-06T02:23:15.896485+0000","last_became_active":"2023-10-06T02:23:14.907166+0000","last_became_peered":"2023-10-06T02:23:14.907166+0000","last_unstale":"2023-10-06T02:23:15.896485+0000","last_undegraded":"2023-10-06T02:23:15.896485+0000","last_fullsized":"2023-10-06T02:23:15.896485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:51.619050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920149+0000","last_change":"2023-10-06T02:23:15.916593+0000","last_active":"2023-10-06T02:23:15.920149+0000","last_peered":"2023-10-06T02:23:15.920149+0000","last_clean":"2023-10-06T02:23:15.920149+0000","last_became_active":"2023-10-06T02:23:15.916288+0000","last_became_peered":"2023-10-06T02:23:15.916288+0000","last_unstale":"2023-10-06T02:23:15.920149+0000","last_undegraded":"2023-10-06T02:23:15.920149+0000","last_fullsized":"2023-10-06T02:23:15.920149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.917451+0000","last_change":"2023-10-06T02:23:14.904396+0000","last_active":"2023-10-06T02:23:15.917451+0000","last_peered":"2023-10-06T02:23:15.917451+0000","last_clean":"2023-10-06T02:23:15.917451+0000","last_became_active":"2023-10-06T02:23:14.903093+0000","last_became_peered":"2023-10-06T02:23:14.903093+0000","last_unstale":"2023-10-06T02:23:15.917451+0000","last_undegraded":"2023-10-06T02:23:15.917451+0000","last_fullsized":"2023-10-06T02:23:15.917451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:47.698904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.893190+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:23:15.893190+0000","last_peered":"2023-10-06T02:23:15.893190+0000","last_clean":"2023-10-06T02:23:15.893190+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:23:15.893190+0000","last_undegraded":"2023-10-06T02:23:15.893190+0000","last_fullsized":"2023-10-06T02:23:15.893190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920866+0000","last_change":"2023-10-06T02:23:15.917453+0000","last_active":"2023-10-06T02:23:15.920866+0000","last_peered":"2023-10-06T02:23:15.920866+0000","last_clean":"2023-10-06T02:23:15.920866+0000","last_became_active":"2023-10-06T02:23:15.916802+0000","last_became_peered":"2023-10-06T02:23:15.916802+0000","last_unstale":"2023-10-06T02:23:15.920866+0000","last_undegraded":"2023-10-06T02:23:15.920866+0000","last_fullsized":"2023-10-06T02:23:15.920866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:28.665851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.895556+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:23:15.895556+0000","last_peered":"2023-10-06T02:23:15.895556+0000","last_clean":"2023-10-06T02:23:15.895556+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:23:15.895556+0000","last_undegraded":"2023-10-06T02:23:15.895556+0000","last_fullsized":"2023-10-06T02:23:15.895556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.890568+0000","last_change":"2023-10-06T02:23:14.907316+0000","last_active":"2023-10-06T02:23:15.890568+0000","last_peered":"2023-10-06T02:23:15.890568+0000","last_clean":"2023-10-06T02:23:15.890568+0000","last_became_active":"2023-10-06T02:23:14.907019+0000","last_became_peered":"2023-10-06T02:23:14.907019+0000","last_unstale":"2023-10-06T02:23:15.890568+0000","last_undegraded":"2023-10-06T02:23:15.890568+0000","last_fullsized":"2023-10-06T02:23:15.890568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:47.698904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910870+0000","last_change":"2023-10-06T02:23:15.898071+0000","last_active":"2023-10-06T02:23:15.910870+0000","last_peered":"2023-10-06T02:23:15.910870+0000","last_clean":"2023-10-06T02:23:15.910870+0000","last_became_active":"2023-10-06T02:23:15.897795+0000","last_became_peered":"2023-10-06T02:23:15.897795+0000","last_unstale":"2023-10-06T02:23:15.910870+0000","last_undegraded":"2023-10-06T02:23:15.910870+0000","last_fullsized":"2023-10-06T02:23:15.910870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.901685+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:23:15.901685+0000","last_peered":"2023-10-06T02:23:15.901685+0000","last_clean":"2023-10-06T02:23:15.901685+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:23:15.901685+0000","last_undegraded":"2023-10-06T02:23:15.901685+0000","last_fullsized":"2023-10-06T02:23:15.901685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.902452+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:23:15.902452+0000","last_peered":"2023-10-06T02:23:15.902452+0000","last_clean":"2023-10-06T02:23:15.902452+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:23:15.902452+0000","last_undegraded":"2023-10-06T02:23:15.902452+0000","last_fullsized":"2023-10-06T02:23:15.902452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.889151+0000","last_change":"2023-10-06T02:23:14.905959+0000","last_active":"2023-10-06T02:23:15.889151+0000","last_peered":"2023-10-06T02:23:15.889151+0000","last_clean":"2023-10-06T02:23:15.889151+0000","last_became_active":"2023-10-06T02:23:14.905642+0000","last_became_peered":"2023-10-06T02:23:14.905642+0000","last_unstale":"2023-10-06T02:23:15.889151+0000","last_undegraded":"2023-10-06T02:23:15.889151+0000","last_fullsized":"2023-10-06T02:23:15.889151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:37.900811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.921254+0000","last_change":"2023-10-06T02:23:15.913645+0000","last_active":"2023-10-06T02:23:15.921254+0000","last_peered":"2023-10-06T02:23:15.921254+0000","last_clean":"2023-10-06T02:23:15.921254+0000","last_became_active":"2023-10-06T02:23:15.913181+0000","last_became_peered":"2023-10-06T02:23:15.913181+0000","last_unstale":"2023-10-06T02:23:15.921254+0000","last_undegraded":"2023-10-06T02:23:15.921254+0000","last_fullsized":"2023-10-06T02:23:15.921254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:28.665851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.903221+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:23:15.903221+0000","last_peered":"2023-10-06T02:23:15.903221+0000","last_clean":"2023-10-06T02:23:15.903221+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:23:15.903221+0000","last_undegraded":"2023-10-06T02:23:15.903221+0000","last_fullsized":"2023-10-06T02:23:15.903221+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.900107+0000","last_change":"2023-10-06T02:23:14.905273+0000","last_active":"2023-10-06T02:23:15.900107+0000","last_peered":"2023-10-06T02:23:15.900107+0000","last_clean":"2023-10-06T02:23:15.900107+0000","last_became_active":"2023-10-06T02:23:14.905074+0000","last_became_peered":"2023-10-06T02:23:14.905074+0000","last_unstale":"2023-10-06T02:23:15.900107+0000","last_undegraded":"2023-10-06T02:23:15.900107+0000","last_fullsized":"2023-10-06T02:23:15.900107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:12.131483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920119+0000","last_change":"2023-10-06T02:23:15.915383+0000","last_active":"2023-10-06T02:23:15.920119+0000","last_peered":"2023-10-06T02:23:15.920119+0000","last_clean":"2023-10-06T02:23:15.920119+0000","last_became_active":"2023-10-06T02:23:15.914958+0000","last_became_peered":"2023-10-06T02:23:15.914958+0000","last_unstale":"2023-10-06T02:23:15.920119+0000","last_undegraded":"2023-10-06T02:23:15.920119+0000","last_fullsized":"2023-10-06T02:23:15.920119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.082330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.902020+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:23:15.902020+0000","last_peered":"2023-10-06T02:23:15.902020+0000","last_clean":"2023-10-06T02:23:15.902020+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:23:15.902020+0000","last_undegraded":"2023-10-06T02:23:15.902020+0000","last_fullsized":"2023-10-06T02:23:15.902020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.894837+0000","last_change":"2023-10-06T02:23:14.902760+0000","last_active":"2023-10-06T02:23:15.894837+0000","last_peered":"2023-10-06T02:23:15.894837+0000","last_clean":"2023-10-06T02:23:15.894837+0000","last_became_active":"2023-10-06T02:23:14.902458+0000","last_became_peered":"2023-10-06T02:23:14.902458+0000","last_unstale":"2023-10-06T02:23:15.894837+0000","last_undegraded":"2023-10-06T02:23:15.894837+0000","last_fullsized":"2023-10-06T02:23:15.894837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:43.560751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916289+0000","last_change":"2023-10-06T02:23:15.913677+0000","last_active":"2023-10-06T02:23:15.916289+0000","last_peered":"2023-10-06T02:23:15.916289+0000","last_clean":"2023-10-06T02:23:15.916289+0000","last_became_active":"2023-10-06T02:23:15.913379+0000","last_became_peered":"2023-10-06T02:23:15.913379+0000","last_unstale":"2023-10-06T02:23:15.916289+0000","last_undegraded":"2023-10-06T02:23:15.916289+0000","last_fullsized":"2023-10-06T02:23:15.916289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:42.982377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.890388+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:23:15.890388+0000","last_peered":"2023-10-06T02:23:15.890388+0000","last_clean":"2023-10-06T02:23:15.890388+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:23:15.890388+0000","last_undegraded":"2023-10-06T02:23:15.890388+0000","last_fullsized":"2023-10-06T02:23:15.890388+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.891338+0000","last_change":"2023-10-06T02:23:14.904576+0000","last_active":"2023-10-06T02:23:15.891338+0000","last_peered":"2023-10-06T02:23:15.891338+0000","last_clean":"2023-10-06T02:23:15.891338+0000","last_became_active":"2023-10-06T02:23:14.904268+0000","last_became_peered":"2023-10-06T02:23:14.904268+0000","last_unstale":"2023-10-06T02:23:15.891338+0000","last_undegraded":"2023-10-06T02:23:15.891338+0000","last_fullsized":"2023-10-06T02:23:15.891338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:47.698904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919339+0000","last_change":"2023-10-06T02:23:15.909310+0000","last_active":"2023-10-06T02:23:15.919339+0000","last_peered":"2023-10-06T02:23:15.919339+0000","last_clean":"2023-10-06T02:23:15.919339+0000","last_became_active":"2023-10-06T02:23:15.908957+0000","last_became_peered":"2023-10-06T02:23:15.908957+0000","last_unstale":"2023-10-06T02:23:15.919339+0000","last_undegraded":"2023-10-06T02:23:15.919339+0000","last_fullsized":"2023-10-06T02:23:15.919339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:21.310729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.899923+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:23:15.899923+0000","last_peered":"2023-10-06T02:23:15.899923+0000","last_clean":"2023-10-06T02:23:15.899923+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:23:15.899923+0000","last_undegraded":"2023-10-06T02:23:15.899923+0000","last_fullsized":"2023-10-06T02:23:15.899923+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.901669+0000","last_change":"2023-10-06T02:23:14.906039+0000","last_active":"2023-10-06T02:23:15.901669+0000","last_peered":"2023-10-06T02:23:15.901669+0000","last_clean":"2023-10-06T02:23:15.901669+0000","last_became_active":"2023-10-06T02:23:14.905477+0000","last_became_peered":"2023-10-06T02:23:14.905477+0000","last_unstale":"2023-10-06T02:23:15.901669+0000","last_undegraded":"2023-10-06T02:23:15.901669+0000","last_fullsized":"2023-10-06T02:23:15.901669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:07.580128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.897843+0000","last_change":"2023-10-06T02:23:15.895373+0000","last_active":"2023-10-06T02:23:15.897843+0000","last_peered":"2023-10-06T02:23:15.897843+0000","last_clean":"2023-10-06T02:23:15.897843+0000","last_became_active":"2023-10-06T02:23:15.895175+0000","last_became_peered":"2023-10-06T02:23:15.895175+0000","last_unstale":"2023-10-06T02:23:15.897843+0000","last_undegraded":"2023-10-06T02:23:15.897843+0000","last_fullsized":"2023-10-06T02:23:15.897843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.899917+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:23:15.899917+0000","last_peered":"2023-10-06T02:23:15.899917+0000","last_clean":"2023-10-06T02:23:15.899917+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:23:15.899917+0000","last_undegraded":"2023-10-06T02:23:15.899917+0000","last_fullsized":"2023-10-06T02:23:15.899917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.892937+0000","last_change":"2023-10-06T02:23:14.897008+0000","last_active":"2023-10-06T02:23:15.892937+0000","last_peered":"2023-10-06T02:23:15.892937+0000","last_clean":"2023-10-06T02:23:15.892937+0000","last_became_active":"2023-10-06T02:23:14.896700+0000","last_became_peered":"2023-10-06T02:23:14.896700+0000","last_unstale":"2023-10-06T02:23:15.892937+0000","last_undegraded":"2023-10-06T02:23:15.892937+0000","last_fullsized":"2023-10-06T02:23:15.892937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:43.560751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919846+0000","last_change":"2023-10-06T02:23:15.911793+0000","last_active":"2023-10-06T02:23:15.919846+0000","last_peered":"2023-10-06T02:23:15.919846+0000","last_clean":"2023-10-06T02:23:15.919846+0000","last_became_active":"2023-10-06T02:23:15.909785+0000","last_became_peered":"2023-10-06T02:23:15.909785+0000","last_unstale":"2023-10-06T02:23:15.919846+0000","last_undegraded":"2023-10-06T02:23:15.919846+0000","last_fullsized":"2023-10-06T02:23:15.919846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.350772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915797+0000","last_change":"2023-10-06T02:23:14.908268+0000","last_active":"2023-10-06T02:23:15.915797+0000","last_peered":"2023-10-06T02:23:15.915797+0000","last_clean":"2023-10-06T02:23:15.915797+0000","last_became_active":"2023-10-06T02:23:14.907843+0000","last_became_peered":"2023-10-06T02:23:14.907843+0000","last_unstale":"2023-10-06T02:23:15.915797+0000","last_undegraded":"2023-10-06T02:23:15.915797+0000","last_fullsized":"2023-10-06T02:23:15.915797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:25.539314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919213+0000","last_change":"2023-10-06T02:23:15.907616+0000","last_active":"2023-10-06T02:23:15.919213+0000","last_peered":"2023-10-06T02:23:15.919213+0000","last_clean":"2023-10-06T02:23:15.919213+0000","last_became_active":"2023-10-06T02:23:15.907283+0000","last_became_peered":"2023-10-06T02:23:15.907283+0000","last_unstale":"2023-10-06T02:23:15.919213+0000","last_undegraded":"2023-10-06T02:23:15.919213+0000","last_fullsized":"2023-10-06T02:23:15.919213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:35.060508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913466+0000","last_change":"2023-10-06T02:23:14.895063+0000","last_active":"2023-10-06T02:23:15.913466+0000","last_peered":"2023-10-06T02:23:15.913466+0000","last_clean":"2023-10-06T02:23:15.913466+0000","last_became_active":"2023-10-06T02:23:14.894694+0000","last_became_peered":"2023-10-06T02:23:14.894694+0000","last_unstale":"2023-10-06T02:23:15.913466+0000","last_undegraded":"2023-10-06T02:23:15.913466+0000","last_fullsized":"2023-10-06T02:23:15.913466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.054986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916712+0000","last_change":"2023-10-06T02:23:15.912820+0000","last_active":"2023-10-06T02:23:15.916712+0000","last_peered":"2023-10-06T02:23:15.916712+0000","last_clean":"2023-10-06T02:23:15.916712+0000","last_became_active":"2023-10-06T02:23:15.912469+0000","last_became_peered":"2023-10-06T02:23:15.912469+0000","last_unstale":"2023-10-06T02:23:15.916712+0000","last_undegraded":"2023-10-06T02:23:15.916712+0000","last_fullsized":"2023-10-06T02:23:15.916712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:07.345058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912740+0000","last_change":"2023-10-06T02:23:14.904850+0000","last_active":"2023-10-06T02:23:15.912740+0000","last_peered":"2023-10-06T02:23:15.912740+0000","last_clean":"2023-10-06T02:23:15.912740+0000","last_became_active":"2023-10-06T02:23:14.904569+0000","last_became_peered":"2023-10-06T02:23:14.904569+0000","last_unstale":"2023-10-06T02:23:15.912740+0000","last_undegraded":"2023-10-06T02:23:15.912740+0000","last_fullsized":"2023-10-06T02:23:15.912740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:47.698904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912380+0000","last_change":"2023-10-06T02:23:15.905102+0000","last_active":"2023-10-06T02:23:15.912380+0000","last_peered":"2023-10-06T02:23:15.912380+0000","last_clean":"2023-10-06T02:23:15.912380+0000","last_became_active":"2023-10-06T02:23:15.904796+0000","last_became_peered":"2023-10-06T02:23:15.904796+0000","last_unstale":"2023-10-06T02:23:15.912380+0000","last_undegraded":"2023-10-06T02:23:15.912380+0000","last_fullsized":"2023-10-06T02:23:15.912380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:47.162284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912504+0000","last_change":"2023-10-06T02:23:14.903685+0000","last_active":"2023-10-06T02:23:15.912504+0000","last_peered":"2023-10-06T02:23:15.912504+0000","last_clean":"2023-10-06T02:23:15.912504+0000","last_became_active":"2023-10-06T02:23:14.902829+0000","last_became_peered":"2023-10-06T02:23:14.902829+0000","last_unstale":"2023-10-06T02:23:15.912504+0000","last_undegraded":"2023-10-06T02:23:15.912504+0000","last_fullsized":"2023-10-06T02:23:15.912504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:50.363282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912866+0000","last_change":"2023-10-06T02:23:15.909237+0000","last_active":"2023-10-06T02:23:15.912866+0000","last_peered":"2023-10-06T02:23:15.912866+0000","last_clean":"2023-10-06T02:23:15.912866+0000","last_became_active":"2023-10-06T02:23:15.908957+0000","last_became_peered":"2023-10-06T02:23:15.908957+0000","last_unstale":"2023-10-06T02:23:15.912866+0000","last_undegraded":"2023-10-06T02:23:15.912866+0000","last_fullsized":"2023-10-06T02:23:15.912866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910567+0000","last_change":"2023-10-06T02:23:14.904438+0000","last_active":"2023-10-06T02:23:15.910567+0000","last_peered":"2023-10-06T02:23:15.910567+0000","last_clean":"2023-10-06T02:23:15.910567+0000","last_became_active":"2023-10-06T02:23:14.904157+0000","last_became_peered":"2023-10-06T02:23:14.904157+0000","last_unstale":"2023-10-06T02:23:15.910567+0000","last_undegraded":"2023-10-06T02:23:15.910567+0000","last_fullsized":"2023-10-06T02:23:15.910567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.054986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913770+0000","last_change":"2023-10-06T02:23:15.909579+0000","last_active":"2023-10-06T02:23:15.913770+0000","last_peered":"2023-10-06T02:23:15.913770+0000","last_clean":"2023-10-06T02:23:15.913770+0000","last_became_active":"2023-10-06T02:23:15.909173+0000","last_became_peered":"2023-10-06T02:23:15.909173+0000","last_unstale":"2023-10-06T02:23:15.913770+0000","last_undegraded":"2023-10-06T02:23:15.913770+0000","last_fullsized":"2023-10-06T02:23:15.913770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:14.278390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913856+0000","last_change":"2023-10-06T02:23:15.911519+0000","last_active":"2023-10-06T02:23:15.913856+0000","last_peered":"2023-10-06T02:23:15.913856+0000","last_clean":"2023-10-06T02:23:15.913856+0000","last_became_active":"2023-10-06T02:23:15.911040+0000","last_became_peered":"2023-10-06T02:23:15.911040+0000","last_unstale":"2023-10-06T02:23:15.913856+0000","last_undegraded":"2023-10-06T02:23:15.913856+0000","last_fullsized":"2023-10-06T02:23:15.913856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:23:21.180114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919359+0000","last_change":"2023-10-06T02:23:15.912783+0000","last_active":"2023-10-06T02:23:15.919359+0000","last_peered":"2023-10-06T02:23:15.919359+0000","last_clean":"2023-10-06T02:23:15.919359+0000","last_became_active":"2023-10-06T02:23:15.912284+0000","last_became_peered":"2023-10-06T02:23:15.912284+0000","last_unstale":"2023-10-06T02:23:15.919359+0000","last_undegraded":"2023-10-06T02:23:15.919359+0000","last_fullsized":"2023-10-06T02:23:15.919359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:25.497567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912361+0000","last_change":"2023-10-06T02:23:15.902724+0000","last_active":"2023-10-06T02:23:15.912361+0000","last_peered":"2023-10-06T02:23:15.912361+0000","last_clean":"2023-10-06T02:23:15.912361+0000","last_became_active":"2023-10-06T02:23:15.902437+0000","last_became_peered":"2023-10-06T02:23:15.902437+0000","last_unstale":"2023-10-06T02:23:15.912361+0000","last_undegraded":"2023-10-06T02:23:15.912361+0000","last_fullsized":"2023-10-06T02:23:15.912361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:35.495163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920718+0000","last_change":"2023-10-06T02:23:15.918968+0000","last_active":"2023-10-06T02:23:15.920718+0000","last_peered":"2023-10-06T02:23:15.920718+0000","last_clean":"2023-10-06T02:23:15.920718+0000","last_became_active":"2023-10-06T02:23:15.918669+0000","last_became_peered":"2023-10-06T02:23:15.918669+0000","last_unstale":"2023-10-06T02:23:15.920718+0000","last_undegraded":"2023-10-06T02:23:15.920718+0000","last_fullsized":"2023-10-06T02:23:15.920718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:33.357066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920160+0000","last_change":"2023-10-06T02:23:15.918229+0000","last_active":"2023-10-06T02:23:15.920160+0000","last_peered":"2023-10-06T02:23:15.920160+0000","last_clean":"2023-10-06T02:23:15.920160+0000","last_became_active":"2023-10-06T02:23:15.917809+0000","last_became_peered":"2023-10-06T02:23:15.917809+0000","last_unstale":"2023-10-06T02:23:15.920160+0000","last_undegraded":"2023-10-06T02:23:15.920160+0000","last_fullsized":"2023-10-06T02:23:15.920160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:58.461395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":664552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":73385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":74184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":72921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:23:24.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:23:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.705+0000 7f0ef7e67700 1 Processor -- start 2023-10-06T02:23:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.705+0000 7f0ef7e67700 1 -- start start 2023-10-06T02:23:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.706+0000 7f0ef7e67700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ef00b3fb0 0x7f0ef0067a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.706+0000 7f0ef7e67700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ef015be40 0x7f0ef0067f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.706+0000 7f0ef7e67700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef0158db0 con 0x7f0ef00b3be0 2023-10-06T02:23:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.706+0000 7f0ef7e67700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef01582f0 con 0x7f0ef00b3fb0 2023-10-06T02:23:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.706+0000 7f0ef7e67700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef00cc2f0 con 0x7f0ef015be40 2023-10-06T02:23:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.707+0000 7f0ef5402700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ef00b3fb0 0x7f0ef0067a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.707+0000 7f0ef5c03700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f0ef00b3be0 0x7f0ef0157be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:37826/0 (socket says 172.21.15.37:37826) 2023-10-06T02:23:24.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.707+0000 7f0ef6404700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ef015be40 0x7f0ef0067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.707+0000 7f0ef5c03700 1 -- 172.21.15.37:0/437907757 learned_addr learned my addr 172.21.15.37:0/437907757 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:24.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.707+0000 7f0ef5402700 1 -- 172.21.15.37:0/437907757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ef015be40 msgr2=0x7f0ef0067f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:24.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.707+0000 7f0ef5402700 1 --2- 172.21.15.37:0/437907757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ef015be40 0x7f0ef0067f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.707+0000 7f0ef5402700 1 -- 172.21.15.37:0/437907757 >> v1:172.21.15.191:6789/0 conn(0x7f0ef00b3be0 legacy=0x7f0ef0157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.707+0000 7f0ef5402700 1 -- 172.21.15.37:0/437907757 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef00cd790 con 0x7f0ef00b3fb0 2023-10-06T02:23:24.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.707+0000 7f0ef5402700 1 --2- 172.21.15.37:0/437907757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ef00b3fb0 0x7f0ef0067a30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00098e0 tx=0x7f0ee00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc63961b0a9c96f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:24.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.707+0000 7f0ef4c01700 1 -- 172.21.15.37:0/437907757 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988402200 0 0) 0x7f0ef0158db0 con 0x7f0ef00b3be0 2023-10-06T02:23:24.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.707+0000 7f0ef4c01700 1 -- 172.21.15.37:0/437907757 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee000b640 con 0x7f0ef00b3fb0 2023-10-06T02:23:24.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.707+0000 7f0ef4c01700 1 -- 172.21.15.37:0/437907757 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee000b7a0 con 0x7f0ef00b3fb0 2023-10-06T02:23:24.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.707+0000 7f0ef4c01700 1 -- 172.21.15.37:0/437907757 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee000bb40 con 0x7f0ef00b3fb0 2023-10-06T02:23:24.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.708+0000 7f0ef7e67700 1 -- 172.21.15.37:0/437907757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ef00b3fb0 msgr2=0x7f0ef0067a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.708+0000 7f0ef7e67700 1 --2- 172.21.15.37:0/437907757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ef00b3fb0 0x7f0ef0067a30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00098e0 tx=0x7f0ee00091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.708+0000 7f0ef7e67700 1 -- 172.21.15.37:0/437907757 shutdown_connections 2023-10-06T02:23:24.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.708+0000 7f0ef7e67700 1 --2- 172.21.15.37:0/437907757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ef015be40 0x7f0ef0067f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.708+0000 7f0ef7e67700 1 --2- 172.21.15.37:0/437907757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ef00b3fb0 0x7f0ef0067a30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.708+0000 7f0ef7e67700 1 -- 172.21.15.37:0/437907757 >> 172.21.15.37:0/437907757 conn(0x7f0ef00ce330 msgr2=0x7f0ef00ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:24.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.708+0000 7f0ef7e67700 1 -- 172.21.15.37:0/437907757 shutdown_connections 2023-10-06T02:23:24.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.708+0000 7f0ef7e67700 1 -- 172.21.15.37:0/437907757 wait complete. 2023-10-06T02:23:24.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.709+0000 7f0ef7e67700 1 Processor -- start 2023-10-06T02:23:24.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.709+0000 7f0ef7e67700 1 -- start start 2023-10-06T02:23:24.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.710+0000 7f0ef7e67700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ef00b3be0 0x7f0ef01534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.710+0000 7f0ef7e67700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ef00b3fb0 0x7f0ef0067910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.710+0000 7f0ef7e67700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ef015be40 0x7f0ef0067e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.710+0000 7f0ef7e67700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef0153a20 con 0x7f0ef00b3fb0 2023-10-06T02:23:24.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.710+0000 7f0ef7e67700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef00c97c0 con 0x7f0ef015be40 2023-10-06T02:23:24.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.710+0000 7f0ef7e67700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef00c9aa0 con 0x7f0ef00b3be0 2023-10-06T02:23:24.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.710+0000 7f0ef5402700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ef00b3fb0 0x7f0ef0067910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.710+0000 7f0ef5402700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ef00b3fb0 0x7f0ef0067910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33090/0 (socket says 172.21.15.37:33090) 2023-10-06T02:23:24.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.710+0000 7f0ef5402700 1 -- 172.21.15.37:0/2713637853 learned_addr learned my addr 172.21.15.37:0/2713637853 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:24.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.710+0000 7f0ef5c03700 1 --2- 172.21.15.37:0/2713637853 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ef00b3be0 0x7f0ef01534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.710+0000 7f0ef6404700 1 --2- 172.21.15.37:0/2713637853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ef015be40 0x7f0ef0067e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.711+0000 7f0ef5402700 1 -- 172.21.15.37:0/2713637853 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ef00b3be0 msgr2=0x7f0ef01534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.711+0000 7f0ef5402700 1 --2- 172.21.15.37:0/2713637853 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ef00b3be0 0x7f0ef01534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.711+0000 7f0ef5402700 1 -- 172.21.15.37:0/2713637853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ef015be40 msgr2=0x7f0ef0067e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.711+0000 7f0ef5402700 1 --2- 172.21.15.37:0/2713637853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ef015be40 0x7f0ef0067e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.711+0000 7f0ef5402700 1 -- 172.21.15.37:0/2713637853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee0009420 con 0x7f0ef00b3fb0 2023-10-06T02:23:24.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.711+0000 7f0ef5402700 1 --2- 172.21.15.37:0/2713637853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ef00b3fb0 0x7f0ef0067910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0013000 tx=0x7f0ee0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:24.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.711+0000 7f0ee5ffb700 1 -- 172.21.15.37:0/2713637853 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee000bb20 con 0x7f0ef00b3fb0 2023-10-06T02:23:24.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.711+0000 7f0ee5ffb700 1 -- 172.21.15.37:0/2713637853 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee0000c90 con 0x7f0ef00b3fb0 2023-10-06T02:23:24.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.711+0000 7f0ee5ffb700 1 -- 172.21.15.37:0/2713637853 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0011650 con 0x7f0ef00b3fb0 2023-10-06T02:23:24.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.711+0000 7f0ef7e67700 1 -- 172.21.15.37:0/2713637853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef00c9d80 con 0x7f0ef00b3fb0 2023-10-06T02:23:24.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.711+0000 7f0ef7e67700 1 -- 172.21.15.37:0/2713637853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef00c8a20 con 0x7f0ef00b3fb0 2023-10-06T02:23:24.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.712+0000 7f0ef7e67700 1 -- 172.21.15.37:0/2713637853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef00ca3b0 con 0x7f0ef00b3fb0 2023-10-06T02:23:24.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.713+0000 7f0ee5ffb700 1 -- 172.21.15.37:0/2713637853 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ee0011a00 con 0x7f0ef00b3fb0 2023-10-06T02:23:24.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.713+0000 7f0ee5ffb700 1 --2- 172.21.15.37:0/2713637853 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0ed4066f30 0x7f0ed40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:24.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.713+0000 7f0ee5ffb700 1 -- 172.21.15.37:0/2713637853 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0ee0085be0 con 0x7f0ef00b3fb0 2023-10-06T02:23:24.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.713+0000 7f0ef5c03700 1 --2- 172.21.15.37:0/2713637853 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0ed4066f30 0x7f0ed40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:24.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.714+0000 7f0ef5c03700 1 --2- 172.21.15.37:0/2713637853 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0ed4066f30 0x7f0ed40693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0eec007260 tx=0x7f0eec001960 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:24.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.717+0000 7f0ee5ffb700 1 -- 172.21.15.37:0/2713637853 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ee0052cf0 con 0x7f0ef00b3fb0 2023-10-06T02:23:24.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.906+0000 7f0ef7e67700 1 -- 172.21.15.37:0/2713637853 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0ef0158a30 con 0x7f0ed4066f30 2023-10-06T02:23:24.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.915+0000 7f0ee5ffb700 1 -- 172.21.15.37:0/2713637853 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286829 (secure 0 0 0) 0x7f0ef0158a30 con 0x7f0ed4066f30 2023-10-06T02:23:24.918 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:24.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.918+0000 7f0ef7e67700 1 -- 172.21.15.37:0/2713637853 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0ed4066f30 msgr2=0x7f0ed40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.918+0000 7f0ef7e67700 1 --2- 172.21.15.37:0/2713637853 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0ed4066f30 0x7f0ed40693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0eec007260 tx=0x7f0eec001960 comp rx=0 tx=0).stop 2023-10-06T02:23:24.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.918+0000 7f0ef7e67700 1 -- 172.21.15.37:0/2713637853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ef00b3fb0 msgr2=0x7f0ef0067910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:24.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.918+0000 7f0ef7e67700 1 --2- 172.21.15.37:0/2713637853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ef00b3fb0 0x7f0ef0067910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0013000 tx=0x7f0ee0017000 comp rx=0 tx=0).stop 2023-10-06T02:23:24.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.918+0000 7f0ef7e67700 1 -- 172.21.15.37:0/2713637853 shutdown_connections 2023-10-06T02:23:24.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.918+0000 7f0ef7e67700 1 --2- 172.21.15.37:0/2713637853 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0ed4066f30 0x7f0ed40693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.918+0000 7f0ef7e67700 1 --2- 172.21.15.37:0/2713637853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ef015be40 0x7f0ef0067e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.918+0000 7f0ef7e67700 1 --2- 172.21.15.37:0/2713637853 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ef00b3be0 0x7f0ef01534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.918+0000 7f0ef7e67700 1 --2- 172.21.15.37:0/2713637853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ef00b3fb0 0x7f0ef0067910 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:24.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.918+0000 7f0ef7e67700 1 -- 172.21.15.37:0/2713637853 >> 172.21.15.37:0/2713637853 conn(0x7f0ef00ce330 msgr2=0x7f0ef0157be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:24.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.918+0000 7f0ef7e67700 1 -- 172.21.15.37:0/2713637853 shutdown_connections 2023-10-06T02:23:24.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:24.918+0000 7f0ef7e67700 1 -- 172.21.15.37:0/2713637853 wait complete. 2023-10-06T02:23:24.921 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:23:24.930 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-06T02:23:24.509595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381116,"kb_used_data":2812,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593604,"statfs":{"total":773094113280,"available":770655850496,"internally_reserved":0,"allocated":2879488,"data_stored":1774761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.620946"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919168+0000","last_change":"2023-10-06T02:23:15.908982+0000","last_active":"2023-10-06T02:23:15.919168+0000","last_peered":"2023-10-06T02:23:15.919168+0000","last_clean":"2023-10-06T02:23:15.919168+0000","last_became_active":"2023-10-06T02:23:15.908698+0000","last_became_peered":"2023-10-06T02:23:15.908698+0000","last_unstale":"2023-10-06T02:23:15.919168+0000","last_undegraded":"2023-10-06T02:23:15.919168+0000","last_fullsized":"2023-10-06T02:23:15.919168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:10.934479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913252+0000","last_change":"2023-10-06T02:23:15.912067+0000","last_active":"2023-10-06T02:23:15.913252+0000","last_peered":"2023-10-06T02:23:15.913252+0000","last_clean":"2023-10-06T02:23:15.913252+0000","last_became_active":"2023-10-06T02:23:15.911773+0000","last_became_peered":"2023-10-06T02:23:15.911773+0000","last_unstale":"2023-10-06T02:23:15.913252+0000","last_undegraded":"2023-10-06T02:23:15.913252+0000","last_fullsized":"2023-10-06T02:23:15.913252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:29.341324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910351+0000","last_change":"2023-10-06T02:23:15.897603+0000","last_active":"2023-10-06T02:23:15.910351+0000","last_peered":"2023-10-06T02:23:15.910351+0000","last_clean":"2023-10-06T02:23:15.910351+0000","last_became_active":"2023-10-06T02:23:15.897331+0000","last_became_peered":"2023-10-06T02:23:15.897331+0000","last_unstale":"2023-10-06T02:23:15.910351+0000","last_undegraded":"2023-10-06T02:23:15.910351+0000","last_fullsized":"2023-10-06T02:23:15.910351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:22.459072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.909617+0000","last_change":"2023-10-06T02:23:15.906142+0000","last_active":"2023-10-06T02:23:15.909617+0000","last_peered":"2023-10-06T02:23:15.909617+0000","last_clean":"2023-10-06T02:23:15.909617+0000","last_became_active":"2023-10-06T02:23:15.905889+0000","last_became_peered":"2023-10-06T02:23:15.905889+0000","last_unstale":"2023-10-06T02:23:15.909617+0000","last_undegraded":"2023-10-06T02:23:15.909617+0000","last_fullsized":"2023-10-06T02:23:15.909617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:41.861335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915400+0000","last_change":"2023-10-06T02:23:15.903558+0000","last_active":"2023-10-06T02:23:15.915400+0000","last_peered":"2023-10-06T02:23:15.915400+0000","last_clean":"2023-10-06T02:23:15.915400+0000","last_became_active":"2023-10-06T02:23:15.903280+0000","last_became_peered":"2023-10-06T02:23:15.903280+0000","last_unstale":"2023-10-06T02:23:15.915400+0000","last_undegraded":"2023-10-06T02:23:15.915400+0000","last_fullsized":"2023-10-06T02:23:15.915400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.911955+0000","last_change":"2023-10-06T02:23:15.899437+0000","last_active":"2023-10-06T02:23:15.911955+0000","last_peered":"2023-10-06T02:23:15.911955+0000","last_clean":"2023-10-06T02:23:15.911955+0000","last_became_active":"2023-10-06T02:23:15.897553+0000","last_became_peered":"2023-10-06T02:23:15.897553+0000","last_unstale":"2023-10-06T02:23:15.911955+0000","last_undegraded":"2023-10-06T02:23:15.911955+0000","last_fullsized":"2023-10-06T02:23:15.911955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:28.665851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919223+0000","last_change":"2023-10-06T02:23:15.918090+0000","last_active":"2023-10-06T02:23:15.919223+0000","last_peered":"2023-10-06T02:23:15.919223+0000","last_clean":"2023-10-06T02:23:15.919223+0000","last_became_active":"2023-10-06T02:23:15.917887+0000","last_became_peered":"2023-10-06T02:23:15.917887+0000","last_unstale":"2023-10-06T02:23:15.919223+0000","last_undegraded":"2023-10-06T02:23:15.919223+0000","last_fullsized":"2023-10-06T02:23:15.919223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.903010+0000","last_change":"2023-10-06T02:23:15.899230+0000","last_active":"2023-10-06T02:23:15.903010+0000","last_peered":"2023-10-06T02:23:15.903010+0000","last_clean":"2023-10-06T02:23:15.903010+0000","last_became_active":"2023-10-06T02:23:15.898928+0000","last_became_peered":"2023-10-06T02:23:15.898928+0000","last_unstale":"2023-10-06T02:23:15.903010+0000","last_undegraded":"2023-10-06T02:23:15.903010+0000","last_fullsized":"2023-10-06T02:23:15.903010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:58.461395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913512+0000","last_change":"2023-10-06T02:23:15.906778+0000","last_active":"2023-10-06T02:23:15.913512+0000","last_peered":"2023-10-06T02:23:15.913512+0000","last_clean":"2023-10-06T02:23:15.913512+0000","last_became_active":"2023-10-06T02:23:15.906117+0000","last_became_peered":"2023-10-06T02:23:15.906117+0000","last_unstale":"2023-10-06T02:23:15.913512+0000","last_undegraded":"2023-10-06T02:23:15.913512+0000","last_fullsized":"2023-10-06T02:23:15.913512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.899401+0000","last_change":"2023-10-06T02:23:15.897067+0000","last_active":"2023-10-06T02:23:15.899401+0000","last_peered":"2023-10-06T02:23:15.899401+0000","last_clean":"2023-10-06T02:23:15.899401+0000","last_became_active":"2023-10-06T02:23:15.896690+0000","last_became_peered":"2023-10-06T02:23:15.896690+0000","last_unstale":"2023-10-06T02:23:15.899401+0000","last_undegraded":"2023-10-06T02:23:15.899401+0000","last_fullsized":"2023-10-06T02:23:15.899401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912295+0000","last_change":"2023-10-06T02:23:15.904332+0000","last_active":"2023-10-06T02:23:15.912295+0000","last_peered":"2023-10-06T02:23:15.912295+0000","last_clean":"2023-10-06T02:23:15.912295+0000","last_became_active":"2023-10-06T02:23:15.904107+0000","last_became_peered":"2023-10-06T02:23:15.904107+0000","last_unstale":"2023-10-06T02:23:15.912295+0000","last_undegraded":"2023-10-06T02:23:15.912295+0000","last_fullsized":"2023-10-06T02:23:15.912295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:08.354390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919232+0000","last_change":"2023-10-06T02:23:15.914369+0000","last_active":"2023-10-06T02:23:15.919232+0000","last_peered":"2023-10-06T02:23:15.919232+0000","last_clean":"2023-10-06T02:23:15.919232+0000","last_became_active":"2023-10-06T02:23:15.914083+0000","last_became_peered":"2023-10-06T02:23:15.914083+0000","last_unstale":"2023-10-06T02:23:15.919232+0000","last_undegraded":"2023-10-06T02:23:15.919232+0000","last_fullsized":"2023-10-06T02:23:15.919232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:26.544836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919123+0000","last_change":"2023-10-06T02:23:15.911961+0000","last_active":"2023-10-06T02:23:15.919123+0000","last_peered":"2023-10-06T02:23:15.919123+0000","last_clean":"2023-10-06T02:23:15.919123+0000","last_became_active":"2023-10-06T02:23:15.911674+0000","last_became_peered":"2023-10-06T02:23:15.911674+0000","last_unstale":"2023-10-06T02:23:15.919123+0000","last_undegraded":"2023-10-06T02:23:15.919123+0000","last_fullsized":"2023-10-06T02:23:15.919123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:48.704425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.911125+0000","last_change":"2023-10-06T02:23:15.909666+0000","last_active":"2023-10-06T02:23:15.911125+0000","last_peered":"2023-10-06T02:23:15.911125+0000","last_clean":"2023-10-06T02:23:15.911125+0000","last_became_active":"2023-10-06T02:23:15.909184+0000","last_became_peered":"2023-10-06T02:23:15.909184+0000","last_unstale":"2023-10-06T02:23:15.911125+0000","last_undegraded":"2023-10-06T02:23:15.911125+0000","last_fullsized":"2023-10-06T02:23:15.911125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:21.310729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919252+0000","last_change":"2023-10-06T02:23:15.918152+0000","last_active":"2023-10-06T02:23:15.919252+0000","last_peered":"2023-10-06T02:23:15.919252+0000","last_clean":"2023-10-06T02:23:15.919252+0000","last_became_active":"2023-10-06T02:23:15.917956+0000","last_became_peered":"2023-10-06T02:23:15.917956+0000","last_unstale":"2023-10-06T02:23:15.919252+0000","last_undegraded":"2023-10-06T02:23:15.919252+0000","last_fullsized":"2023-10-06T02:23:15.919252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.082330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910937+0000","last_change":"2023-10-06T02:23:15.898556+0000","last_active":"2023-10-06T02:23:15.910937+0000","last_peered":"2023-10-06T02:23:15.910937+0000","last_clean":"2023-10-06T02:23:15.910937+0000","last_became_active":"2023-10-06T02:23:15.897898+0000","last_became_peered":"2023-10-06T02:23:15.897898+0000","last_unstale":"2023-10-06T02:23:15.910937+0000","last_undegraded":"2023-10-06T02:23:15.910937+0000","last_fullsized":"2023-10-06T02:23:15.910937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:33.357066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913539+0000","last_change":"2023-10-06T02:23:15.906966+0000","last_active":"2023-10-06T02:23:15.913539+0000","last_peered":"2023-10-06T02:23:15.913539+0000","last_clean":"2023-10-06T02:23:15.913539+0000","last_became_active":"2023-10-06T02:23:15.906471+0000","last_became_peered":"2023-10-06T02:23:15.906471+0000","last_unstale":"2023-10-06T02:23:15.913539+0000","last_undegraded":"2023-10-06T02:23:15.913539+0000","last_fullsized":"2023-10-06T02:23:15.913539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.082330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912480+0000","last_change":"2023-10-06T02:23:15.909298+0000","last_active":"2023-10-06T02:23:15.912480+0000","last_peered":"2023-10-06T02:23:15.912480+0000","last_clean":"2023-10-06T02:23:15.912480+0000","last_became_active":"2023-10-06T02:23:15.908984+0000","last_became_peered":"2023-10-06T02:23:15.908984+0000","last_unstale":"2023-10-06T02:23:15.912480+0000","last_undegraded":"2023-10-06T02:23:15.912480+0000","last_fullsized":"2023-10-06T02:23:15.912480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:45.070037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919178+0000","last_change":"2023-10-06T02:23:15.908066+0000","last_active":"2023-10-06T02:23:15.919178+0000","last_peered":"2023-10-06T02:23:15.919178+0000","last_clean":"2023-10-06T02:23:15.919178+0000","last_became_active":"2023-10-06T02:23:15.907732+0000","last_became_peered":"2023-10-06T02:23:15.907732+0000","last_unstale":"2023-10-06T02:23:15.919178+0000","last_undegraded":"2023-10-06T02:23:15.919178+0000","last_fullsized":"2023-10-06T02:23:15.919178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:08.585650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913105+0000","last_change":"2023-10-06T02:23:15.907581+0000","last_active":"2023-10-06T02:23:15.913105+0000","last_peered":"2023-10-06T02:23:15.913105+0000","last_clean":"2023-10-06T02:23:15.913105+0000","last_became_active":"2023-10-06T02:23:15.905503+0000","last_became_peered":"2023-10-06T02:23:15.905503+0000","last_unstale":"2023-10-06T02:23:15.913105+0000","last_undegraded":"2023-10-06T02:23:15.913105+0000","last_fullsized":"2023-10-06T02:23:15.913105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:18.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916852+0000","last_change":"2023-10-06T02:23:15.914944+0000","last_active":"2023-10-06T02:23:15.916852+0000","last_peered":"2023-10-06T02:23:15.916852+0000","last_clean":"2023-10-06T02:23:15.916852+0000","last_became_active":"2023-10-06T02:23:15.914700+0000","last_became_peered":"2023-10-06T02:23:15.914700+0000","last_unstale":"2023-10-06T02:23:15.916852+0000","last_undegraded":"2023-10-06T02:23:15.916852+0000","last_fullsized":"2023-10-06T02:23:15.916852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920587+0000","last_change":"2023-10-06T02:23:15.913463+0000","last_active":"2023-10-06T02:23:15.920587+0000","last_peered":"2023-10-06T02:23:15.920587+0000","last_clean":"2023-10-06T02:23:15.920587+0000","last_became_active":"2023-10-06T02:23:15.913127+0000","last_became_peered":"2023-10-06T02:23:15.913127+0000","last_unstale":"2023-10-06T02:23:15.920587+0000","last_undegraded":"2023-10-06T02:23:15.920587+0000","last_fullsized":"2023-10-06T02:23:15.920587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:33.357066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920526+0000","last_change":"2023-10-06T02:23:15.914489+0000","last_active":"2023-10-06T02:23:15.920526+0000","last_peered":"2023-10-06T02:23:15.920526+0000","last_clean":"2023-10-06T02:23:15.920526+0000","last_became_active":"2023-10-06T02:23:15.914221+0000","last_became_peered":"2023-10-06T02:23:15.914221+0000","last_unstale":"2023-10-06T02:23:15.920526+0000","last_undegraded":"2023-10-06T02:23:15.920526+0000","last_fullsized":"2023-10-06T02:23:15.920526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:45.070037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.917128+0000","last_change":"2023-10-06T02:23:15.914958+0000","last_active":"2023-10-06T02:23:15.917128+0000","last_peered":"2023-10-06T02:23:15.917128+0000","last_clean":"2023-10-06T02:23:15.917128+0000","last_became_active":"2023-10-06T02:23:15.914682+0000","last_became_peered":"2023-10-06T02:23:15.914682+0000","last_unstale":"2023-10-06T02:23:15.917128+0000","last_undegraded":"2023-10-06T02:23:15.917128+0000","last_fullsized":"2023-10-06T02:23:15.917128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915313+0000","last_change":"2023-10-06T02:23:15.907412+0000","last_active":"2023-10-06T02:23:15.915313+0000","last_peered":"2023-10-06T02:23:15.915313+0000","last_clean":"2023-10-06T02:23:15.915313+0000","last_became_active":"2023-10-06T02:23:15.906449+0000","last_became_peered":"2023-10-06T02:23:15.906449+0000","last_unstale":"2023-10-06T02:23:15.915313+0000","last_undegraded":"2023-10-06T02:23:15.915313+0000","last_fullsized":"2023-10-06T02:23:15.915313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:32.631860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919905+0000","last_change":"2023-10-06T02:23:15.912982+0000","last_active":"2023-10-06T02:23:15.919905+0000","last_peered":"2023-10-06T02:23:15.919905+0000","last_clean":"2023-10-06T02:23:15.919905+0000","last_became_active":"2023-10-06T02:23:15.910404+0000","last_became_peered":"2023-10-06T02:23:15.910404+0000","last_unstale":"2023-10-06T02:23:15.919905+0000","last_undegraded":"2023-10-06T02:23:15.919905+0000","last_fullsized":"2023-10-06T02:23:15.919905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:56.873370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.918347+0000","last_change":"2023-10-06T02:23:15.916449+0000","last_active":"2023-10-06T02:23:15.918347+0000","last_peered":"2023-10-06T02:23:15.918347+0000","last_clean":"2023-10-06T02:23:15.918347+0000","last_became_active":"2023-10-06T02:23:15.915750+0000","last_became_peered":"2023-10-06T02:23:15.915750+0000","last_unstale":"2023-10-06T02:23:15.918347+0000","last_undegraded":"2023-10-06T02:23:15.918347+0000","last_fullsized":"2023-10-06T02:23:15.918347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910324+0000","last_change":"2023-10-06T02:23:14.907348+0000","last_active":"2023-10-06T02:23:15.910324+0000","last_peered":"2023-10-06T02:23:15.910324+0000","last_clean":"2023-10-06T02:23:15.910324+0000","last_became_active":"2023-10-06T02:23:14.907035+0000","last_became_peered":"2023-10-06T02:23:14.907035+0000","last_unstale":"2023-10-06T02:23:15.910324+0000","last_undegraded":"2023-10-06T02:23:15.910324+0000","last_fullsized":"2023-10-06T02:23:15.910324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:12.131483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.906846+0000","last_change":"2023-10-06T02:23:15.902629+0000","last_active":"2023-10-06T02:23:15.906846+0000","last_peered":"2023-10-06T02:23:15.906846+0000","last_clean":"2023-10-06T02:23:15.906846+0000","last_became_active":"2023-10-06T02:23:15.902328+0000","last_became_peered":"2023-10-06T02:23:15.902328+0000","last_unstale":"2023-10-06T02:23:15.906846+0000","last_undegraded":"2023-10-06T02:23:15.906846+0000","last_fullsized":"2023-10-06T02:23:15.906846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:11.466544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.900770+0000","last_change":"2023-10-06T02:23:14.908961+0000","last_active":"2023-10-06T02:23:15.900770+0000","last_peered":"2023-10-06T02:23:15.900770+0000","last_clean":"2023-10-06T02:23:15.900770+0000","last_became_active":"2023-10-06T02:23:14.908549+0000","last_became_peered":"2023-10-06T02:23:14.908549+0000","last_unstale":"2023-10-06T02:23:15.900770+0000","last_undegraded":"2023-10-06T02:23:15.900770+0000","last_fullsized":"2023-10-06T02:23:15.900770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:37.900811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.925219+0000","last_change":"2023-10-06T02:23:15.921091+0000","last_active":"2023-10-06T02:23:15.925219+0000","last_peered":"2023-10-06T02:23:15.925219+0000","last_clean":"2023-10-06T02:23:15.925219+0000","last_became_active":"2023-10-06T02:23:15.920772+0000","last_became_peered":"2023-10-06T02:23:15.920772+0000","last_unstale":"2023-10-06T02:23:15.925219+0000","last_undegraded":"2023-10-06T02:23:15.925219+0000","last_fullsized":"2023-10-06T02:23:15.925219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:58.461395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.896633+0000","last_change":"2023-10-06T02:23:14.905101+0000","last_active":"2023-10-06T02:23:15.896633+0000","last_peered":"2023-10-06T02:23:15.896633+0000","last_clean":"2023-10-06T02:23:15.896633+0000","last_became_active":"2023-10-06T02:23:14.902379+0000","last_became_peered":"2023-10-06T02:23:14.902379+0000","last_unstale":"2023-10-06T02:23:15.896633+0000","last_undegraded":"2023-10-06T02:23:15.896633+0000","last_fullsized":"2023-10-06T02:23:15.896633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.054986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910630+0000","last_change":"2023-10-06T02:23:15.908338+0000","last_active":"2023-10-06T02:23:15.910630+0000","last_peered":"2023-10-06T02:23:15.910630+0000","last_clean":"2023-10-06T02:23:15.910630+0000","last_became_active":"2023-10-06T02:23:15.907880+0000","last_became_peered":"2023-10-06T02:23:15.907880+0000","last_unstale":"2023-10-06T02:23:15.910630+0000","last_undegraded":"2023-10-06T02:23:15.910630+0000","last_fullsized":"2023-10-06T02:23:15.910630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.350772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.889655+0000","last_change":"2023-10-06T02:23:14.904479+0000","last_active":"2023-10-06T02:23:15.889655+0000","last_peered":"2023-10-06T02:23:15.889655+0000","last_clean":"2023-10-06T02:23:15.889655+0000","last_became_active":"2023-10-06T02:23:14.904187+0000","last_became_peered":"2023-10-06T02:23:14.904187+0000","last_unstale":"2023-10-06T02:23:15.889655+0000","last_undegraded":"2023-10-06T02:23:15.889655+0000","last_fullsized":"2023-10-06T02:23:15.889655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:09.928957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912505+0000","last_change":"2023-10-06T02:23:15.905556+0000","last_active":"2023-10-06T02:23:15.912505+0000","last_peered":"2023-10-06T02:23:15.912505+0000","last_clean":"2023-10-06T02:23:15.912505+0000","last_became_active":"2023-10-06T02:23:15.905335+0000","last_became_peered":"2023-10-06T02:23:15.905335+0000","last_unstale":"2023-10-06T02:23:15.912505+0000","last_undegraded":"2023-10-06T02:23:15.912505+0000","last_fullsized":"2023-10-06T02:23:15.912505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:18.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.892042+0000","last_change":"2023-10-06T02:23:14.900860+0000","last_active":"2023-10-06T02:23:15.892042+0000","last_peered":"2023-10-06T02:23:15.892042+0000","last_clean":"2023-10-06T02:23:15.892042+0000","last_became_active":"2023-10-06T02:23:14.900471+0000","last_became_peered":"2023-10-06T02:23:14.900471+0000","last_unstale":"2023-10-06T02:23:15.892042+0000","last_undegraded":"2023-10-06T02:23:15.892042+0000","last_fullsized":"2023-10-06T02:23:15.892042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:09.928957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920751+0000","last_change":"2023-10-06T02:23:15.917245+0000","last_active":"2023-10-06T02:23:15.920751+0000","last_peered":"2023-10-06T02:23:15.920751+0000","last_clean":"2023-10-06T02:23:15.920751+0000","last_became_active":"2023-10-06T02:23:15.916930+0000","last_became_peered":"2023-10-06T02:23:15.916930+0000","last_unstale":"2023-10-06T02:23:15.920751+0000","last_undegraded":"2023-10-06T02:23:15.920751+0000","last_fullsized":"2023-10-06T02:23:15.920751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:29.341324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915462+0000","last_change":"2023-10-06T02:23:14.908736+0000","last_active":"2023-10-06T02:23:15.915462+0000","last_peered":"2023-10-06T02:23:15.915462+0000","last_clean":"2023-10-06T02:23:15.915462+0000","last_became_active":"2023-10-06T02:23:14.908432+0000","last_became_peered":"2023-10-06T02:23:14.908432+0000","last_unstale":"2023-10-06T02:23:15.915462+0000","last_undegraded":"2023-10-06T02:23:15.915462+0000","last_fullsized":"2023-10-06T02:23:15.915462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:12.345251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.911912+0000","last_change":"2023-10-06T02:23:15.906639+0000","last_active":"2023-10-06T02:23:15.911912+0000","last_peered":"2023-10-06T02:23:15.911912+0000","last_clean":"2023-10-06T02:23:15.911912+0000","last_became_active":"2023-10-06T02:23:15.906358+0000","last_became_peered":"2023-10-06T02:23:15.906358+0000","last_unstale":"2023-10-06T02:23:15.911912+0000","last_undegraded":"2023-10-06T02:23:15.911912+0000","last_fullsized":"2023-10-06T02:23:15.911912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:41.861335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919121+0000","last_change":"2023-10-06T02:23:14.904865+0000","last_active":"2023-10-06T02:23:15.919121+0000","last_peered":"2023-10-06T02:23:15.919121+0000","last_clean":"2023-10-06T02:23:15.919121+0000","last_became_active":"2023-10-06T02:23:14.904563+0000","last_became_peered":"2023-10-06T02:23:14.904563+0000","last_unstale":"2023-10-06T02:23:15.919121+0000","last_undegraded":"2023-10-06T02:23:15.919121+0000","last_fullsized":"2023-10-06T02:23:15.919121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:07.580128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912663+0000","last_change":"2023-10-06T02:23:15.900282+0000","last_active":"2023-10-06T02:23:15.912663+0000","last_peered":"2023-10-06T02:23:15.912663+0000","last_clean":"2023-10-06T02:23:15.912663+0000","last_became_active":"2023-10-06T02:23:15.899729+0000","last_became_peered":"2023-10-06T02:23:15.899729+0000","last_unstale":"2023-10-06T02:23:15.912663+0000","last_undegraded":"2023-10-06T02:23:15.912663+0000","last_fullsized":"2023-10-06T02:23:15.912663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:16.019119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915056+0000","last_change":"2023-10-06T02:23:14.908091+0000","last_active":"2023-10-06T02:23:15.915056+0000","last_peered":"2023-10-06T02:23:15.915056+0000","last_clean":"2023-10-06T02:23:15.915056+0000","last_became_active":"2023-10-06T02:23:14.907787+0000","last_became_peered":"2023-10-06T02:23:14.907787+0000","last_unstale":"2023-10-06T02:23:15.915056+0000","last_undegraded":"2023-10-06T02:23:15.915056+0000","last_fullsized":"2023-10-06T02:23:15.915056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:51.619050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919379+0000","last_change":"2023-10-06T02:23:15.912494+0000","last_active":"2023-10-06T02:23:15.919379+0000","last_peered":"2023-10-06T02:23:15.919379+0000","last_clean":"2023-10-06T02:23:15.919379+0000","last_became_active":"2023-10-06T02:23:15.911909+0000","last_became_peered":"2023-10-06T02:23:15.911909+0000","last_unstale":"2023-10-06T02:23:15.919379+0000","last_undegraded":"2023-10-06T02:23:15.919379+0000","last_fullsized":"2023-10-06T02:23:15.919379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:16.019119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.889128+0000","last_change":"2023-10-06T02:23:14.900521+0000","last_active":"2023-10-06T02:23:15.889128+0000","last_peered":"2023-10-06T02:23:15.889128+0000","last_clean":"2023-10-06T02:23:15.889128+0000","last_became_active":"2023-10-06T02:23:14.900208+0000","last_became_peered":"2023-10-06T02:23:14.900208+0000","last_unstale":"2023-10-06T02:23:15.889128+0000","last_undegraded":"2023-10-06T02:23:15.889128+0000","last_fullsized":"2023-10-06T02:23:15.889128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:12.131483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916972+0000","last_change":"2023-10-06T02:23:15.915762+0000","last_active":"2023-10-06T02:23:15.916972+0000","last_peered":"2023-10-06T02:23:15.916972+0000","last_clean":"2023-10-06T02:23:15.916972+0000","last_became_active":"2023-10-06T02:23:15.915415+0000","last_became_peered":"2023-10-06T02:23:15.915415+0000","last_unstale":"2023-10-06T02:23:15.916972+0000","last_undegraded":"2023-10-06T02:23:15.916972+0000","last_fullsized":"2023-10-06T02:23:15.916972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.082330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.903833+0000","last_change":"2023-10-06T02:23:14.907899+0000","last_active":"2023-10-06T02:23:15.903833+0000","last_peered":"2023-10-06T02:23:15.903833+0000","last_clean":"2023-10-06T02:23:15.903833+0000","last_became_active":"2023-10-06T02:23:14.907600+0000","last_became_peered":"2023-10-06T02:23:14.907600+0000","last_unstale":"2023-10-06T02:23:15.903833+0000","last_undegraded":"2023-10-06T02:23:15.903833+0000","last_fullsized":"2023-10-06T02:23:15.903833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:50.363282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913744+0000","last_change":"2023-10-06T02:23:15.904238+0000","last_active":"2023-10-06T02:23:15.913744+0000","last_peered":"2023-10-06T02:23:15.913744+0000","last_clean":"2023-10-06T02:23:15.913744+0000","last_became_active":"2023-10-06T02:23:15.903899+0000","last_became_peered":"2023-10-06T02:23:15.903899+0000","last_unstale":"2023-10-06T02:23:15.913744+0000","last_undegraded":"2023-10-06T02:23:15.913744+0000","last_fullsized":"2023-10-06T02:23:15.913744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:29.341324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915845+0000","last_change":"2023-10-06T02:23:14.902984+0000","last_active":"2023-10-06T02:23:15.915845+0000","last_peered":"2023-10-06T02:23:15.915845+0000","last_clean":"2023-10-06T02:23:15.915845+0000","last_became_active":"2023-10-06T02:23:14.902743+0000","last_became_peered":"2023-10-06T02:23:14.902743+0000","last_unstale":"2023-10-06T02:23:15.915845+0000","last_undegraded":"2023-10-06T02:23:15.915845+0000","last_fullsized":"2023-10-06T02:23:15.915845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:07.580128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920917+0000","last_change":"2023-10-06T02:23:15.917272+0000","last_active":"2023-10-06T02:23:15.920917+0000","last_peered":"2023-10-06T02:23:15.920917+0000","last_clean":"2023-10-06T02:23:15.920917+0000","last_became_active":"2023-10-06T02:23:15.916874+0000","last_became_peered":"2023-10-06T02:23:15.916874+0000","last_unstale":"2023-10-06T02:23:15.920917+0000","last_undegraded":"2023-10-06T02:23:15.920917+0000","last_fullsized":"2023-10-06T02:23:15.920917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:22.459072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.914495+0000","last_change":"2023-10-06T02:23:14.908202+0000","last_active":"2023-10-06T02:23:15.914495+0000","last_peered":"2023-10-06T02:23:15.914495+0000","last_clean":"2023-10-06T02:23:15.914495+0000","last_became_active":"2023-10-06T02:23:14.907936+0000","last_became_peered":"2023-10-06T02:23:14.907936+0000","last_unstale":"2023-10-06T02:23:15.914495+0000","last_undegraded":"2023-10-06T02:23:15.914495+0000","last_fullsized":"2023-10-06T02:23:15.914495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:43.560751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916861+0000","last_change":"2023-10-06T02:23:15.914877+0000","last_active":"2023-10-06T02:23:15.916861+0000","last_peered":"2023-10-06T02:23:15.916861+0000","last_clean":"2023-10-06T02:23:15.916861+0000","last_became_active":"2023-10-06T02:23:15.914592+0000","last_became_peered":"2023-10-06T02:23:15.914592+0000","last_unstale":"2023-10-06T02:23:15.916861+0000","last_undegraded":"2023-10-06T02:23:15.916861+0000","last_fullsized":"2023-10-06T02:23:15.916861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.914703+0000","last_change":"2023-10-06T02:23:14.908061+0000","last_active":"2023-10-06T02:23:15.914703+0000","last_peered":"2023-10-06T02:23:15.914703+0000","last_clean":"2023-10-06T02:23:15.914703+0000","last_became_active":"2023-10-06T02:23:14.907687+0000","last_became_peered":"2023-10-06T02:23:14.907687+0000","last_unstale":"2023-10-06T02:23:15.914703+0000","last_undegraded":"2023-10-06T02:23:15.914703+0000","last_fullsized":"2023-10-06T02:23:15.914703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:23:20.174592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912220+0000","last_change":"2023-10-06T02:23:15.907204+0000","last_active":"2023-10-06T02:23:15.912220+0000","last_peered":"2023-10-06T02:23:15.912220+0000","last_clean":"2023-10-06T02:23:15.912220+0000","last_became_active":"2023-10-06T02:23:15.906946+0000","last_became_peered":"2023-10-06T02:23:15.906946+0000","last_unstale":"2023-10-06T02:23:15.912220+0000","last_undegraded":"2023-10-06T02:23:15.912220+0000","last_fullsized":"2023-10-06T02:23:15.912220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:48.105101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915301+0000","last_change":"2023-10-06T02:23:14.907440+0000","last_active":"2023-10-06T02:23:15.915301+0000","last_peered":"2023-10-06T02:23:15.915301+0000","last_clean":"2023-10-06T02:23:15.915301+0000","last_became_active":"2023-10-06T02:23:14.907153+0000","last_became_peered":"2023-10-06T02:23:14.907153+0000","last_unstale":"2023-10-06T02:23:15.915301+0000","last_undegraded":"2023-10-06T02:23:15.915301+0000","last_fullsized":"2023-10-06T02:23:15.915301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:41.976855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913457+0000","last_change":"2023-10-06T02:23:15.910344+0000","last_active":"2023-10-06T02:23:15.913457+0000","last_peered":"2023-10-06T02:23:15.913457+0000","last_clean":"2023-10-06T02:23:15.913457+0000","last_became_active":"2023-10-06T02:23:15.910087+0000","last_became_peered":"2023-10-06T02:23:15.910087+0000","last_unstale":"2023-10-06T02:23:15.913457+0000","last_undegraded":"2023-10-06T02:23:15.913457+0000","last_fullsized":"2023-10-06T02:23:15.913457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:32.631860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.891617+0000","last_change":"2023-10-06T02:23:14.899169+0000","last_active":"2023-10-06T02:23:15.891617+0000","last_peered":"2023-10-06T02:23:15.891617+0000","last_clean":"2023-10-06T02:23:15.891617+0000","last_became_active":"2023-10-06T02:23:14.898905+0000","last_became_peered":"2023-10-06T02:23:14.898905+0000","last_unstale":"2023-10-06T02:23:15.891617+0000","last_undegraded":"2023-10-06T02:23:15.891617+0000","last_fullsized":"2023-10-06T02:23:15.891617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:25.539314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915422+0000","last_change":"2023-10-06T02:23:15.906479+0000","last_active":"2023-10-06T02:23:15.915422+0000","last_peered":"2023-10-06T02:23:15.915422+0000","last_clean":"2023-10-06T02:23:15.915422+0000","last_became_active":"2023-10-06T02:23:15.906192+0000","last_became_peered":"2023-10-06T02:23:15.906192+0000","last_unstale":"2023-10-06T02:23:15.915422+0000","last_undegraded":"2023-10-06T02:23:15.915422+0000","last_fullsized":"2023-10-06T02:23:15.915422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:22.459072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.921109+0000","last_change":"2023-10-06T02:23:14.907796+0000","last_active":"2023-10-06T02:23:15.921109+0000","last_peered":"2023-10-06T02:23:15.921109+0000","last_clean":"2023-10-06T02:23:15.921109+0000","last_became_active":"2023-10-06T02:23:14.907286+0000","last_became_peered":"2023-10-06T02:23:14.907286+0000","last_unstale":"2023-10-06T02:23:15.921109+0000","last_undegraded":"2023-10-06T02:23:15.921109+0000","last_fullsized":"2023-10-06T02:23:15.921109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:09.928957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913082+0000","last_change":"2023-10-06T02:23:15.905225+0000","last_active":"2023-10-06T02:23:15.913082+0000","last_peered":"2023-10-06T02:23:15.913082+0000","last_clean":"2023-10-06T02:23:15.913082+0000","last_became_active":"2023-10-06T02:23:15.904931+0000","last_became_peered":"2023-10-06T02:23:15.904931+0000","last_unstale":"2023-10-06T02:23:15.913082+0000","last_undegraded":"2023-10-06T02:23:15.913082+0000","last_fullsized":"2023-10-06T02:23:15.913082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:12.297625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.898775+0000","last_change":"2023-10-06T02:23:14.905972+0000","last_active":"2023-10-06T02:23:15.898775+0000","last_peered":"2023-10-06T02:23:15.898775+0000","last_clean":"2023-10-06T02:23:15.898775+0000","last_became_active":"2023-10-06T02:23:14.905683+0000","last_became_peered":"2023-10-06T02:23:14.905683+0000","last_unstale":"2023-10-06T02:23:15.898775+0000","last_undegraded":"2023-10-06T02:23:15.898775+0000","last_fullsized":"2023-10-06T02:23:15.898775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:12.131483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913680+0000","last_change":"2023-10-06T02:23:15.909799+0000","last_active":"2023-10-06T02:23:15.913680+0000","last_peered":"2023-10-06T02:23:15.913680+0000","last_clean":"2023-10-06T02:23:15.913680+0000","last_became_active":"2023-10-06T02:23:15.909263+0000","last_became_peered":"2023-10-06T02:23:15.909263+0000","last_unstale":"2023-10-06T02:23:15.913680+0000","last_undegraded":"2023-10-06T02:23:15.913680+0000","last_fullsized":"2023-10-06T02:23:15.913680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:11.466544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.892075+0000","last_change":"2023-10-06T02:23:14.898612+0000","last_active":"2023-10-06T02:23:15.892075+0000","last_peered":"2023-10-06T02:23:15.892075+0000","last_clean":"2023-10-06T02:23:15.892075+0000","last_became_active":"2023-10-06T02:23:14.898323+0000","last_became_peered":"2023-10-06T02:23:14.898323+0000","last_unstale":"2023-10-06T02:23:15.892075+0000","last_undegraded":"2023-10-06T02:23:15.892075+0000","last_fullsized":"2023-10-06T02:23:15.892075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:25.539314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912215+0000","last_change":"2023-10-06T02:23:15.906103+0000","last_active":"2023-10-06T02:23:15.912215+0000","last_peered":"2023-10-06T02:23:15.912215+0000","last_clean":"2023-10-06T02:23:15.912215+0000","last_became_active":"2023-10-06T02:23:15.905549+0000","last_became_peered":"2023-10-06T02:23:15.905549+0000","last_unstale":"2023-10-06T02:23:15.912215+0000","last_undegraded":"2023-10-06T02:23:15.912215+0000","last_fullsized":"2023-10-06T02:23:15.912215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:25.497567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.896485+0000","last_change":"2023-10-06T02:23:14.907451+0000","last_active":"2023-10-06T02:23:15.896485+0000","last_peered":"2023-10-06T02:23:15.896485+0000","last_clean":"2023-10-06T02:23:15.896485+0000","last_became_active":"2023-10-06T02:23:14.907166+0000","last_became_peered":"2023-10-06T02:23:14.907166+0000","last_unstale":"2023-10-06T02:23:15.896485+0000","last_undegraded":"2023-10-06T02:23:15.896485+0000","last_fullsized":"2023-10-06T02:23:15.896485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:51.619050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920149+0000","last_change":"2023-10-06T02:23:15.916593+0000","last_active":"2023-10-06T02:23:15.920149+0000","last_peered":"2023-10-06T02:23:15.920149+0000","last_clean":"2023-10-06T02:23:15.920149+0000","last_became_active":"2023-10-06T02:23:15.916288+0000","last_became_peered":"2023-10-06T02:23:15.916288+0000","last_unstale":"2023-10-06T02:23:15.920149+0000","last_undegraded":"2023-10-06T02:23:15.920149+0000","last_fullsized":"2023-10-06T02:23:15.920149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.917451+0000","last_change":"2023-10-06T02:23:14.904396+0000","last_active":"2023-10-06T02:23:15.917451+0000","last_peered":"2023-10-06T02:23:15.917451+0000","last_clean":"2023-10-06T02:23:15.917451+0000","last_became_active":"2023-10-06T02:23:14.903093+0000","last_became_peered":"2023-10-06T02:23:14.903093+0000","last_unstale":"2023-10-06T02:23:15.917451+0000","last_undegraded":"2023-10-06T02:23:15.917451+0000","last_fullsized":"2023-10-06T02:23:15.917451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:47.698904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.893190+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:23:15.893190+0000","last_peered":"2023-10-06T02:23:15.893190+0000","last_clean":"2023-10-06T02:23:15.893190+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:23:15.893190+0000","last_undegraded":"2023-10-06T02:23:15.893190+0000","last_fullsized":"2023-10-06T02:23:15.893190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920866+0000","last_change":"2023-10-06T02:23:15.917453+0000","last_active":"2023-10-06T02:23:15.920866+0000","last_peered":"2023-10-06T02:23:15.920866+0000","last_clean":"2023-10-06T02:23:15.920866+0000","last_became_active":"2023-10-06T02:23:15.916802+0000","last_became_peered":"2023-10-06T02:23:15.916802+0000","last_unstale":"2023-10-06T02:23:15.920866+0000","last_undegraded":"2023-10-06T02:23:15.920866+0000","last_fullsized":"2023-10-06T02:23:15.920866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:28.665851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.895556+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:23:15.895556+0000","last_peered":"2023-10-06T02:23:15.895556+0000","last_clean":"2023-10-06T02:23:15.895556+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:23:15.895556+0000","last_undegraded":"2023-10-06T02:23:15.895556+0000","last_fullsized":"2023-10-06T02:23:15.895556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:23:16.929311+0000","last_change":"2023-10-06T02:23:14.907316+0000","last_active":"2023-10-06T02:23:16.929311+0000","last_peered":"2023-10-06T02:23:16.929311+0000","last_clean":"2023-10-06T02:23:16.929311+0000","last_became_active":"2023-10-06T02:23:14.907019+0000","last_became_peered":"2023-10-06T02:23:14.907019+0000","last_unstale":"2023-10-06T02:23:16.929311+0000","last_undegraded":"2023-10-06T02:23:16.929311+0000","last_fullsized":"2023-10-06T02:23:16.929311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:47.698904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910870+0000","last_change":"2023-10-06T02:23:15.898071+0000","last_active":"2023-10-06T02:23:15.910870+0000","last_peered":"2023-10-06T02:23:15.910870+0000","last_clean":"2023-10-06T02:23:15.910870+0000","last_became_active":"2023-10-06T02:23:15.897795+0000","last_became_peered":"2023-10-06T02:23:15.897795+0000","last_unstale":"2023-10-06T02:23:15.910870+0000","last_undegraded":"2023-10-06T02:23:15.910870+0000","last_fullsized":"2023-10-06T02:23:15.910870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.901685+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:23:15.901685+0000","last_peered":"2023-10-06T02:23:15.901685+0000","last_clean":"2023-10-06T02:23:15.901685+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:23:15.901685+0000","last_undegraded":"2023-10-06T02:23:15.901685+0000","last_fullsized":"2023-10-06T02:23:15.901685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.902452+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:23:15.902452+0000","last_peered":"2023-10-06T02:23:15.902452+0000","last_clean":"2023-10-06T02:23:15.902452+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:23:15.902452+0000","last_undegraded":"2023-10-06T02:23:15.902452+0000","last_fullsized":"2023-10-06T02:23:15.902452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.889151+0000","last_change":"2023-10-06T02:23:14.905959+0000","last_active":"2023-10-06T02:23:15.889151+0000","last_peered":"2023-10-06T02:23:15.889151+0000","last_clean":"2023-10-06T02:23:15.889151+0000","last_became_active":"2023-10-06T02:23:14.905642+0000","last_became_peered":"2023-10-06T02:23:14.905642+0000","last_unstale":"2023-10-06T02:23:15.889151+0000","last_undegraded":"2023-10-06T02:23:15.889151+0000","last_fullsized":"2023-10-06T02:23:15.889151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:37.900811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.921254+0000","last_change":"2023-10-06T02:23:15.913645+0000","last_active":"2023-10-06T02:23:15.921254+0000","last_peered":"2023-10-06T02:23:15.921254+0000","last_clean":"2023-10-06T02:23:15.921254+0000","last_became_active":"2023-10-06T02:23:15.913181+0000","last_became_peered":"2023-10-06T02:23:15.913181+0000","last_unstale":"2023-10-06T02:23:15.921254+0000","last_undegraded":"2023-10-06T02:23:15.921254+0000","last_fullsized":"2023-10-06T02:23:15.921254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:28.665851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.903221+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:23:15.903221+0000","last_peered":"2023-10-06T02:23:15.903221+0000","last_clean":"2023-10-06T02:23:15.903221+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:23:15.903221+0000","last_undegraded":"2023-10-06T02:23:15.903221+0000","last_fullsized":"2023-10-06T02:23:15.903221+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.900107+0000","last_change":"2023-10-06T02:23:14.905273+0000","last_active":"2023-10-06T02:23:15.900107+0000","last_peered":"2023-10-06T02:23:15.900107+0000","last_clean":"2023-10-06T02:23:15.900107+0000","last_became_active":"2023-10-06T02:23:14.905074+0000","last_became_peered":"2023-10-06T02:23:14.905074+0000","last_unstale":"2023-10-06T02:23:15.900107+0000","last_undegraded":"2023-10-06T02:23:15.900107+0000","last_fullsized":"2023-10-06T02:23:15.900107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:12.131483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920119+0000","last_change":"2023-10-06T02:23:15.915383+0000","last_active":"2023-10-06T02:23:15.920119+0000","last_peered":"2023-10-06T02:23:15.920119+0000","last_clean":"2023-10-06T02:23:15.920119+0000","last_became_active":"2023-10-06T02:23:15.914958+0000","last_became_peered":"2023-10-06T02:23:15.914958+0000","last_unstale":"2023-10-06T02:23:15.920119+0000","last_undegraded":"2023-10-06T02:23:15.920119+0000","last_fullsized":"2023-10-06T02:23:15.920119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.082330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.902020+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:23:15.902020+0000","last_peered":"2023-10-06T02:23:15.902020+0000","last_clean":"2023-10-06T02:23:15.902020+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:23:15.902020+0000","last_undegraded":"2023-10-06T02:23:15.902020+0000","last_fullsized":"2023-10-06T02:23:15.902020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.894837+0000","last_change":"2023-10-06T02:23:14.902760+0000","last_active":"2023-10-06T02:23:15.894837+0000","last_peered":"2023-10-06T02:23:15.894837+0000","last_clean":"2023-10-06T02:23:15.894837+0000","last_became_active":"2023-10-06T02:23:14.902458+0000","last_became_peered":"2023-10-06T02:23:14.902458+0000","last_unstale":"2023-10-06T02:23:15.894837+0000","last_undegraded":"2023-10-06T02:23:15.894837+0000","last_fullsized":"2023-10-06T02:23:15.894837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:43.560751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916289+0000","last_change":"2023-10-06T02:23:15.913677+0000","last_active":"2023-10-06T02:23:15.916289+0000","last_peered":"2023-10-06T02:23:15.916289+0000","last_clean":"2023-10-06T02:23:15.916289+0000","last_became_active":"2023-10-06T02:23:15.913379+0000","last_became_peered":"2023-10-06T02:23:15.913379+0000","last_unstale":"2023-10-06T02:23:15.916289+0000","last_undegraded":"2023-10-06T02:23:15.916289+0000","last_fullsized":"2023-10-06T02:23:15.916289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:42.982377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.890388+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:23:15.890388+0000","last_peered":"2023-10-06T02:23:15.890388+0000","last_clean":"2023-10-06T02:23:15.890388+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:23:15.890388+0000","last_undegraded":"2023-10-06T02:23:15.890388+0000","last_fullsized":"2023-10-06T02:23:15.890388+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.891338+0000","last_change":"2023-10-06T02:23:14.904576+0000","last_active":"2023-10-06T02:23:15.891338+0000","last_peered":"2023-10-06T02:23:15.891338+0000","last_clean":"2023-10-06T02:23:15.891338+0000","last_became_active":"2023-10-06T02:23:14.904268+0000","last_became_peered":"2023-10-06T02:23:14.904268+0000","last_unstale":"2023-10-06T02:23:15.891338+0000","last_undegraded":"2023-10-06T02:23:15.891338+0000","last_fullsized":"2023-10-06T02:23:15.891338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:47.698904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919339+0000","last_change":"2023-10-06T02:23:15.909310+0000","last_active":"2023-10-06T02:23:15.919339+0000","last_peered":"2023-10-06T02:23:15.919339+0000","last_clean":"2023-10-06T02:23:15.919339+0000","last_became_active":"2023-10-06T02:23:15.908957+0000","last_became_peered":"2023-10-06T02:23:15.908957+0000","last_unstale":"2023-10-06T02:23:15.919339+0000","last_undegraded":"2023-10-06T02:23:15.919339+0000","last_fullsized":"2023-10-06T02:23:15.919339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:21.310729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.899923+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:23:15.899923+0000","last_peered":"2023-10-06T02:23:15.899923+0000","last_clean":"2023-10-06T02:23:15.899923+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:23:15.899923+0000","last_undegraded":"2023-10-06T02:23:15.899923+0000","last_fullsized":"2023-10-06T02:23:15.899923+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.901669+0000","last_change":"2023-10-06T02:23:14.906039+0000","last_active":"2023-10-06T02:23:15.901669+0000","last_peered":"2023-10-06T02:23:15.901669+0000","last_clean":"2023-10-06T02:23:15.901669+0000","last_became_active":"2023-10-06T02:23:14.905477+0000","last_became_peered":"2023-10-06T02:23:14.905477+0000","last_unstale":"2023-10-06T02:23:15.901669+0000","last_undegraded":"2023-10-06T02:23:15.901669+0000","last_fullsized":"2023-10-06T02:23:15.901669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:07.580128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.897843+0000","last_change":"2023-10-06T02:23:15.895373+0000","last_active":"2023-10-06T02:23:15.897843+0000","last_peered":"2023-10-06T02:23:15.897843+0000","last_clean":"2023-10-06T02:23:15.897843+0000","last_became_active":"2023-10-06T02:23:15.895175+0000","last_became_peered":"2023-10-06T02:23:15.895175+0000","last_unstale":"2023-10-06T02:23:15.897843+0000","last_undegraded":"2023-10-06T02:23:15.897843+0000","last_fullsized":"2023-10-06T02:23:15.897843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.899917+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:23:15.899917+0000","last_peered":"2023-10-06T02:23:15.899917+0000","last_clean":"2023-10-06T02:23:15.899917+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:23:15.899917+0000","last_undegraded":"2023-10-06T02:23:15.899917+0000","last_fullsized":"2023-10-06T02:23:15.899917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.892937+0000","last_change":"2023-10-06T02:23:14.897008+0000","last_active":"2023-10-06T02:23:15.892937+0000","last_peered":"2023-10-06T02:23:15.892937+0000","last_clean":"2023-10-06T02:23:15.892937+0000","last_became_active":"2023-10-06T02:23:14.896700+0000","last_became_peered":"2023-10-06T02:23:14.896700+0000","last_unstale":"2023-10-06T02:23:15.892937+0000","last_undegraded":"2023-10-06T02:23:15.892937+0000","last_fullsized":"2023-10-06T02:23:15.892937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:43.560751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919846+0000","last_change":"2023-10-06T02:23:15.911793+0000","last_active":"2023-10-06T02:23:15.919846+0000","last_peered":"2023-10-06T02:23:15.919846+0000","last_clean":"2023-10-06T02:23:15.919846+0000","last_became_active":"2023-10-06T02:23:15.909785+0000","last_became_peered":"2023-10-06T02:23:15.909785+0000","last_unstale":"2023-10-06T02:23:15.919846+0000","last_undegraded":"2023-10-06T02:23:15.919846+0000","last_fullsized":"2023-10-06T02:23:15.919846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.350772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915797+0000","last_change":"2023-10-06T02:23:14.908268+0000","last_active":"2023-10-06T02:23:15.915797+0000","last_peered":"2023-10-06T02:23:15.915797+0000","last_clean":"2023-10-06T02:23:15.915797+0000","last_became_active":"2023-10-06T02:23:14.907843+0000","last_became_peered":"2023-10-06T02:23:14.907843+0000","last_unstale":"2023-10-06T02:23:15.915797+0000","last_undegraded":"2023-10-06T02:23:15.915797+0000","last_fullsized":"2023-10-06T02:23:15.915797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:25.539314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919213+0000","last_change":"2023-10-06T02:23:15.907616+0000","last_active":"2023-10-06T02:23:15.919213+0000","last_peered":"2023-10-06T02:23:15.919213+0000","last_clean":"2023-10-06T02:23:15.919213+0000","last_became_active":"2023-10-06T02:23:15.907283+0000","last_became_peered":"2023-10-06T02:23:15.907283+0000","last_unstale":"2023-10-06T02:23:15.919213+0000","last_undegraded":"2023-10-06T02:23:15.919213+0000","last_fullsized":"2023-10-06T02:23:15.919213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:35.060508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913466+0000","last_change":"2023-10-06T02:23:14.895063+0000","last_active":"2023-10-06T02:23:15.913466+0000","last_peered":"2023-10-06T02:23:15.913466+0000","last_clean":"2023-10-06T02:23:15.913466+0000","last_became_active":"2023-10-06T02:23:14.894694+0000","last_became_peered":"2023-10-06T02:23:14.894694+0000","last_unstale":"2023-10-06T02:23:15.913466+0000","last_undegraded":"2023-10-06T02:23:15.913466+0000","last_fullsized":"2023-10-06T02:23:15.913466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.054986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916712+0000","last_change":"2023-10-06T02:23:15.912820+0000","last_active":"2023-10-06T02:23:15.916712+0000","last_peered":"2023-10-06T02:23:15.916712+0000","last_clean":"2023-10-06T02:23:15.916712+0000","last_became_active":"2023-10-06T02:23:15.912469+0000","last_became_peered":"2023-10-06T02:23:15.912469+0000","last_unstale":"2023-10-06T02:23:15.916712+0000","last_undegraded":"2023-10-06T02:23:15.916712+0000","last_fullsized":"2023-10-06T02:23:15.916712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:07.345058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912740+0000","last_change":"2023-10-06T02:23:14.904850+0000","last_active":"2023-10-06T02:23:15.912740+0000","last_peered":"2023-10-06T02:23:15.912740+0000","last_clean":"2023-10-06T02:23:15.912740+0000","last_became_active":"2023-10-06T02:23:14.904569+0000","last_became_peered":"2023-10-06T02:23:14.904569+0000","last_unstale":"2023-10-06T02:23:15.912740+0000","last_undegraded":"2023-10-06T02:23:15.912740+0000","last_fullsized":"2023-10-06T02:23:15.912740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:47.698904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912380+0000","last_change":"2023-10-06T02:23:15.905102+0000","last_active":"2023-10-06T02:23:15.912380+0000","last_peered":"2023-10-06T02:23:15.912380+0000","last_clean":"2023-10-06T02:23:15.912380+0000","last_became_active":"2023-10-06T02:23:15.904796+0000","last_became_peered":"2023-10-06T02:23:15.904796+0000","last_unstale":"2023-10-06T02:23:15.912380+0000","last_undegraded":"2023-10-06T02:23:15.912380+0000","last_fullsized":"2023-10-06T02:23:15.912380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:47.162284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912504+0000","last_change":"2023-10-06T02:23:14.903685+0000","last_active":"2023-10-06T02:23:15.912504+0000","last_peered":"2023-10-06T02:23:15.912504+0000","last_clean":"2023-10-06T02:23:15.912504+0000","last_became_active":"2023-10-06T02:23:14.902829+0000","last_became_peered":"2023-10-06T02:23:14.902829+0000","last_unstale":"2023-10-06T02:23:15.912504+0000","last_undegraded":"2023-10-06T02:23:15.912504+0000","last_fullsized":"2023-10-06T02:23:15.912504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:50.363282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912866+0000","last_change":"2023-10-06T02:23:15.909237+0000","last_active":"2023-10-06T02:23:15.912866+0000","last_peered":"2023-10-06T02:23:15.912866+0000","last_clean":"2023-10-06T02:23:15.912866+0000","last_became_active":"2023-10-06T02:23:15.908957+0000","last_became_peered":"2023-10-06T02:23:15.908957+0000","last_unstale":"2023-10-06T02:23:15.912866+0000","last_undegraded":"2023-10-06T02:23:15.912866+0000","last_fullsized":"2023-10-06T02:23:15.912866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910567+0000","last_change":"2023-10-06T02:23:14.904438+0000","last_active":"2023-10-06T02:23:15.910567+0000","last_peered":"2023-10-06T02:23:15.910567+0000","last_clean":"2023-10-06T02:23:15.910567+0000","last_became_active":"2023-10-06T02:23:14.904157+0000","last_became_peered":"2023-10-06T02:23:14.904157+0000","last_unstale":"2023-10-06T02:23:15.910567+0000","last_undegraded":"2023-10-06T02:23:15.910567+0000","last_fullsized":"2023-10-06T02:23:15.910567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.054986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913770+0000","last_change":"2023-10-06T02:23:15.909579+0000","last_active":"2023-10-06T02:23:15.913770+0000","last_peered":"2023-10-06T02:23:15.913770+0000","last_clean":"2023-10-06T02:23:15.913770+0000","last_became_active":"2023-10-06T02:23:15.909173+0000","last_became_peered":"2023-10-06T02:23:15.909173+0000","last_unstale":"2023-10-06T02:23:15.913770+0000","last_undegraded":"2023-10-06T02:23:15.913770+0000","last_fullsized":"2023-10-06T02:23:15.913770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:14.278390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913856+0000","last_change":"2023-10-06T02:23:15.911519+0000","last_active":"2023-10-06T02:23:15.913856+0000","last_peered":"2023-10-06T02:23:15.913856+0000","last_clean":"2023-10-06T02:23:15.913856+0000","last_became_active":"2023-10-06T02:23:15.911040+0000","last_became_peered":"2023-10-06T02:23:15.911040+0000","last_unstale":"2023-10-06T02:23:15.913856+0000","last_undegraded":"2023-10-06T02:23:15.913856+0000","last_fullsized":"2023-10-06T02:23:15.913856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:23:21.180114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919359+0000","last_change":"2023-10-06T02:23:15.912783+0000","last_active":"2023-10-06T02:23:15.919359+0000","last_peered":"2023-10-06T02:23:15.919359+0000","last_clean":"2023-10-06T02:23:15.919359+0000","last_became_active":"2023-10-06T02:23:15.912284+0000","last_became_peered":"2023-10-06T02:23:15.912284+0000","last_unstale":"2023-10-06T02:23:15.919359+0000","last_undegraded":"2023-10-06T02:23:15.919359+0000","last_fullsized":"2023-10-06T02:23:15.919359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:25.497567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912361+0000","last_change":"2023-10-06T02:23:15.902724+0000","last_active":"2023-10-06T02:23:15.912361+0000","last_peered":"2023-10-06T02:23:15.912361+0000","last_clean":"2023-10-06T02:23:15.912361+0000","last_became_active":"2023-10-06T02:23:15.902437+0000","last_became_peered":"2023-10-06T02:23:15.902437+0000","last_unstale":"2023-10-06T02:23:15.912361+0000","last_undegraded":"2023-10-06T02:23:15.912361+0000","last_fullsized":"2023-10-06T02:23:15.912361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:35.495163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920718+0000","last_change":"2023-10-06T02:23:15.918968+0000","last_active":"2023-10-06T02:23:15.920718+0000","last_peered":"2023-10-06T02:23:15.920718+0000","last_clean":"2023-10-06T02:23:15.920718+0000","last_became_active":"2023-10-06T02:23:15.918669+0000","last_became_peered":"2023-10-06T02:23:15.918669+0000","last_unstale":"2023-10-06T02:23:15.920718+0000","last_undegraded":"2023-10-06T02:23:15.920718+0000","last_fullsized":"2023-10-06T02:23:15.920718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:33.357066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920160+0000","last_change":"2023-10-06T02:23:15.918229+0000","last_active":"2023-10-06T02:23:15.920160+0000","last_peered":"2023-10-06T02:23:15.920160+0000","last_clean":"2023-10-06T02:23:15.920160+0000","last_became_active":"2023-10-06T02:23:15.917809+0000","last_became_peered":"2023-10-06T02:23:15.917809+0000","last_unstale":"2023-10-06T02:23:15.920160+0000","last_undegraded":"2023-10-06T02:23:15.920160+0000","last_fullsized":"2023-10-06T02:23:15.920160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:58.461395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":664552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":73385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":74184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":72921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:23:24.936 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:23:24.936 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T02:23:24.937 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T02:23:24.937 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T02:23:24.937 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T02:23:25.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.089+0000 7ff0e39c7700 1 Processor -- start 2023-10-06T02:23:25.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.089+0000 7ff0e39c7700 1 -- start start 2023-10-06T02:23:25.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.090+0000 7ff0e39c7700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff0dc159760 0x7ff0dc15d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.090+0000 7ff0e39c7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0dc15dd50 0x7ff0dc0cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.090+0000 7ff0e39c7700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0dc15e1d0 con 0x7ff0dc15d8d0 2023-10-06T02:23:25.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.090+0000 7ff0e39c7700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc0cc2d0 con 0x7ff0dc159760 2023-10-06T02:23:25.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.090+0000 7ff0e39c7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0cb650 con 0x7ff0dc15dd50 2023-10-06T02:23:25.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.090+0000 7ff0e1f64700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0dc15dd50 0x7ff0dc0cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.090+0000 7ff0e1763700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff0dc159760 0x7ff0dc15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.090+0000 7ff0e1f64700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0dc15dd50 0x7ff0dc0cfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:55482/0 (socket says 172.21.15.37:55482) 2023-10-06T02:23:25.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.090+0000 7ff0e1763700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff0dc159760 0x7ff0dc15d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:41948/0 (socket says 172.21.15.37:41948) 2023-10-06T02:23:25.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.090+0000 7ff0e0f62700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7ff0dc15d8d0 0x7ff0dc0c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:37834/0 (socket says 172.21.15.37:37834) 2023-10-06T02:23:25.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.090+0000 7ff0e1f64700 1 -- 172.21.15.37:0/3188918129 learned_addr learned my addr 172.21.15.37:0/3188918129 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:25.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.091+0000 7ff0e1763700 1 -- 172.21.15.37:0/3188918129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0dc15dd50 msgr2=0x7ff0dc0cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:25.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.091+0000 7ff0e1763700 1 --2- 172.21.15.37:0/3188918129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0dc15dd50 0x7ff0dc0cfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.091+0000 7ff0e1763700 1 -- 172.21.15.37:0/3188918129 >> v1:172.21.15.191:6789/0 conn(0x7ff0dc15d8d0 legacy=0x7ff0dc0c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.091+0000 7ff0e1763700 1 -- 172.21.15.37:0/3188918129 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc0cb930 con 0x7ff0dc159760 2023-10-06T02:23:25.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.091+0000 7ff0dbfff700 1 -- 172.21.15.37:0/3188918129 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948034780 0 0) 0x7ff0dc15e1d0 con 0x7ff0dc15d8d0 2023-10-06T02:23:25.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.091+0000 7ff0e1f64700 1 --2- 172.21.15.37:0/3188918129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0dc15dd50 0x7ff0dc0cfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:25.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.091+0000 7ff0e1763700 1 --2- 172.21.15.37:0/3188918129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0dc159760 0x7ff0dc15d390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0098e0 tx=0x7ff0cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a90a70b7b4b53620 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:25.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.091+0000 7ff0dbfff700 1 -- 172.21.15.37:0/3188918129 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc00b6d0 con 0x7ff0dc159760 2023-10-06T02:23:25.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.091+0000 7ff0dbfff700 1 -- 172.21.15.37:0/3188918129 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0cc00b830 con 0x7ff0dc159760 2023-10-06T02:23:25.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.091+0000 7ff0dbfff700 1 -- 172.21.15.37:0/3188918129 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc00bbd0 con 0x7ff0dc159760 2023-10-06T02:23:25.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.092+0000 7ff0e39c7700 1 -- 172.21.15.37:0/3188918129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0dc159760 msgr2=0x7ff0dc15d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.092+0000 7ff0e39c7700 1 --2- 172.21.15.37:0/3188918129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0dc159760 0x7ff0dc15d390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0098e0 tx=0x7ff0cc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.092+0000 7ff0e39c7700 1 -- 172.21.15.37:0/3188918129 shutdown_connections 2023-10-06T02:23:25.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.092+0000 7ff0e39c7700 1 --2- 172.21.15.37:0/3188918129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0dc15dd50 0x7ff0dc0cfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.092+0000 7ff0e39c7700 1 --2- 172.21.15.37:0/3188918129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0dc159760 0x7ff0dc15d390 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.092+0000 7ff0e39c7700 1 -- 172.21.15.37:0/3188918129 >> 172.21.15.37:0/3188918129 conn(0x7ff0dc06c890 msgr2=0x7ff0dc0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:25.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.092+0000 7ff0e39c7700 1 -- 172.21.15.37:0/3188918129 shutdown_connections 2023-10-06T02:23:25.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.092+0000 7ff0e39c7700 1 -- 172.21.15.37:0/3188918129 wait complete. 2023-10-06T02:23:25.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.093+0000 7ff0e39c7700 1 Processor -- start 2023-10-06T02:23:25.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.093+0000 7ff0e39c7700 1 -- start start 2023-10-06T02:23:25.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.094+0000 7ff0e39c7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0dc159760 0x7ff0dc16ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.094+0000 7ff0e39c7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0dc15d8d0 0x7ff0dc1589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.094+0000 7ff0e39c7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0dc15dd50 0x7ff0dc15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.094+0000 7ff0e39c7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0b6180 con 0x7ff0dc15d8d0 2023-10-06T02:23:25.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.094+0000 7ff0e39c7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc15a010 con 0x7ff0dc159760 2023-10-06T02:23:25.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.094+0000 7ff0e39c7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc15a2f0 con 0x7ff0dc15dd50 2023-10-06T02:23:25.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.094+0000 7ff0e0f62700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0dc15d8d0 0x7ff0dc1589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.094+0000 7ff0e0f62700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0dc15d8d0 0x7ff0dc1589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33100/0 (socket says 172.21.15.37:33100) 2023-10-06T02:23:25.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.094+0000 7ff0e0f62700 1 -- 172.21.15.37:0/2682988055 learned_addr learned my addr 172.21.15.37:0/2682988055 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:25.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.094+0000 7ff0e1763700 1 --2- 172.21.15.37:0/2682988055 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0dc159760 0x7ff0dc16ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.094+0000 7ff0e1f64700 1 --2- 172.21.15.37:0/2682988055 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0dc15dd50 0x7ff0dc15beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.094+0000 7ff0e0f62700 1 -- 172.21.15.37:0/2682988055 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0dc15dd50 msgr2=0x7ff0dc15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.094+0000 7ff0e0f62700 1 --2- 172.21.15.37:0/2682988055 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0dc15dd50 0x7ff0dc15beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.094+0000 7ff0e0f62700 1 -- 172.21.15.37:0/2682988055 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0dc159760 msgr2=0x7ff0dc16ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.094+0000 7ff0e0f62700 1 --2- 172.21.15.37:0/2682988055 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0dc159760 0x7ff0dc16ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.094+0000 7ff0e0f62700 1 -- 172.21.15.37:0/2682988055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d4009ae0 con 0x7ff0dc15d8d0 2023-10-06T02:23:25.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.094+0000 7ff0e0f62700 1 --2- 172.21.15.37:0/2682988055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0dc15d8d0 0x7ff0dc1589e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00011e0 tx=0x7ff0d0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:25.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.095+0000 7ff0d97fa700 1 -- 172.21.15.37:0/2682988055 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0005a70 con 0x7ff0dc15d8d0 2023-10-06T02:23:25.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.095+0000 7ff0d97fa700 1 -- 172.21.15.37:0/2682988055 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d0005bd0 con 0x7ff0dc15d8d0 2023-10-06T02:23:25.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.095+0000 7ff0d97fa700 1 -- 172.21.15.37:0/2682988055 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00070d0 con 0x7ff0dc15d8d0 2023-10-06T02:23:25.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.095+0000 7ff0e39c7700 1 -- 172.21.15.37:0/2682988055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0cc009420 con 0x7ff0dc15d8d0 2023-10-06T02:23:25.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.095+0000 7ff0e39c7700 1 -- 172.21.15.37:0/2682988055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0dc15a8b0 con 0x7ff0dc15d8d0 2023-10-06T02:23:25.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.096+0000 7ff0e39c7700 1 -- 172.21.15.37:0/2682988055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0dc06fbf0 con 0x7ff0dc15d8d0 2023-10-06T02:23:25.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.096+0000 7ff0d97fa700 1 -- 172.21.15.37:0/2682988055 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0d0007480 con 0x7ff0dc15d8d0 2023-10-06T02:23:25.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.097+0000 7ff0d97fa700 1 --2- 172.21.15.37:0/2682988055 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff0c8066f30 0x7ff0c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.097+0000 7ff0d97fa700 1 -- 172.21.15.37:0/2682988055 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff0d0083bc0 con 0x7ff0dc15d8d0 2023-10-06T02:23:25.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.097+0000 7ff0e1763700 1 --2- 172.21.15.37:0/2682988055 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff0c8066f30 0x7ff0c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.097+0000 7ff0e1763700 1 --2- 172.21.15.37:0/2682988055 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff0c8066f30 0x7ff0c80693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0097b0 tx=0x7ff0cc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:25.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.101+0000 7ff0d97fa700 1 -- 172.21.15.37:0/2682988055 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0d0050cd0 con 0x7ff0dc15d8d0 2023-10-06T02:23:25.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.349+0000 7ff0e39c7700 1 -- 172.21.15.37:0/2682988055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff0dc04bb80 con 0x7ff0dc15d8d0 2023-10-06T02:23:25.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.352+0000 7ff0d97fa700 1 -- 172.21.15.37:0/2682988055 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163706 (secure 0 0 0) 0x7ff0d0017070 con 0x7ff0dc15d8d0 2023-10-06T02:23:25.355 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:25.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.354+0000 7ff0e39c7700 1 -- 172.21.15.37:0/2682988055 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff0c8066f30 msgr2=0x7ff0c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.354+0000 7ff0e39c7700 1 --2- 172.21.15.37:0/2682988055 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff0c8066f30 0x7ff0c80693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0097b0 tx=0x7ff0cc017000 comp rx=0 tx=0).stop 2023-10-06T02:23:25.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.354+0000 7ff0e39c7700 1 -- 172.21.15.37:0/2682988055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0dc15d8d0 msgr2=0x7ff0dc1589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.354+0000 7ff0e39c7700 1 --2- 172.21.15.37:0/2682988055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0dc15d8d0 0x7ff0dc1589e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00011e0 tx=0x7ff0d0007e10 comp rx=0 tx=0).stop 2023-10-06T02:23:25.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.354+0000 7ff0e39c7700 1 -- 172.21.15.37:0/2682988055 shutdown_connections 2023-10-06T02:23:25.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.354+0000 7ff0e39c7700 1 --2- 172.21.15.37:0/2682988055 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0dc15dd50 0x7ff0dc15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.354+0000 7ff0e39c7700 1 --2- 172.21.15.37:0/2682988055 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff0c8066f30 0x7ff0c80693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.354+0000 7ff0e39c7700 1 --2- 172.21.15.37:0/2682988055 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0dc159760 0x7ff0dc16ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.354+0000 7ff0e39c7700 1 --2- 172.21.15.37:0/2682988055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0dc15d8d0 0x7ff0dc1589e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.354+0000 7ff0e39c7700 1 -- 172.21.15.37:0/2682988055 >> 172.21.15.37:0/2682988055 conn(0x7ff0dc06c890 msgr2=0x7ff0dc153b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:25.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.354+0000 7ff0e39c7700 1 -- 172.21.15.37:0/2682988055 shutdown_connections 2023-10-06T02:23:25.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.354+0000 7ff0e39c7700 1 -- 172.21.15.37:0/2682988055 wait complete. 2023-10-06T02:23:25.367 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":90267},{"type":"v1","addr":"172.21.15.191:6833","nonce":90267}]},"active_addr":"172.21.15.191:6833/90267","active_change":"2023-10-06T02:23:02.500197+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.191:0","nonce":2202352401}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.191:0","nonce":2112979390}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.191:0","nonce":1926284418}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.191:0","nonce":3728741288}]}]} 2023-10-06T02:23:25.371 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T02:23:25.371 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T02:23:25.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:25.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.489+0000 7f07087b9700 1 Processor -- start 2023-10-06T02:23:25.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.489+0000 7f07087b9700 1 -- start start 2023-10-06T02:23:25.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.490+0000 7f07087b9700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f070006abb0 0x7f0700156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.490+0000 7f07087b9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0700157130 0x7f07000ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.490+0000 7f07087b9700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0700157920 con 0x7f0700150ab0 2023-10-06T02:23:25.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.490+0000 7f07087b9700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f070015a0a0 con 0x7f0700157130 2023-10-06T02:23:25.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.490+0000 7f07087b9700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f070015a380 con 0x7f070006abb0 2023-10-06T02:23:25.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.490+0000 7f0706d56700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0700157130 0x7f07000ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.490+0000 7f0706d56700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0700157130 0x7f07000ab090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41942/0 (socket says 172.21.15.37:41942) 2023-10-06T02:23:25.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.491+0000 7f0706d56700 1 -- 172.21.15.37:0/2060427051 learned_addr learned my addr 172.21.15.37:0/2060427051 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:25.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.491+0000 7f0705d54700 1 --2- 172.21.15.37:0/2060427051 >> v2:172.21.15.191:3300/0 conn(0x7f070006abb0 0x7f0700156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.491+0000 7f0706d56700 1 -- 172.21.15.37:0/2060427051 >> v2:172.21.15.191:3300/0 conn(0x7f070006abb0 msgr2=0x7f0700156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:25.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.491+0000 7f0706d56700 1 --2- 172.21.15.37:0/2060427051 >> v2:172.21.15.191:3300/0 conn(0x7f070006abb0 0x7f0700156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.491+0000 7f0706d56700 1 -- 172.21.15.37:0/2060427051 >> v1:172.21.15.191:6789/0 conn(0x7f0700150ab0 legacy=0x7f070006a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.491+0000 7f0706d56700 1 -- 172.21.15.37:0/2060427051 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070015a660 con 0x7f0700157130 2023-10-06T02:23:25.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.491+0000 7f0706d56700 1 --2- 172.21.15.37:0/2060427051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0700157130 0x7f07000ab090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f07000aebe0 tx=0x7f06f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7ae90334c58d06 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:25.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.491+0000 7f0705553700 1 -- 172.21.15.37:0/2060427051 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8009e70 con 0x7f0700157130 2023-10-06T02:23:25.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.491+0000 7f0705553700 1 -- 172.21.15.37:0/2060427051 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f800b860 con 0x7f0700157130 2023-10-06T02:23:25.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.491+0000 7f0705553700 1 -- 172.21.15.37:0/2060427051 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f800bc00 con 0x7f0700157130 2023-10-06T02:23:25.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.492+0000 7f07087b9700 1 -- 172.21.15.37:0/2060427051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0700157130 msgr2=0x7f07000ab090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.492+0000 7f07087b9700 1 --2- 172.21.15.37:0/2060427051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0700157130 0x7f07000ab090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f07000aebe0 tx=0x7f06f8009250 comp rx=0 tx=0).stop 2023-10-06T02:23:25.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.492+0000 7f07087b9700 1 -- 172.21.15.37:0/2060427051 shutdown_connections 2023-10-06T02:23:25.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.492+0000 7f07087b9700 1 --2- 172.21.15.37:0/2060427051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0700157130 0x7f07000ab090 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.492+0000 7f07087b9700 1 --2- 172.21.15.37:0/2060427051 >> v2:172.21.15.191:3300/0 conn(0x7f070006abb0 0x7f0700156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.492+0000 7f07087b9700 1 -- 172.21.15.37:0/2060427051 >> 172.21.15.37:0/2060427051 conn(0x7f07000cc120 msgr2=0x7f07000cc520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:25.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.492+0000 7f07087b9700 1 -- 172.21.15.37:0/2060427051 shutdown_connections 2023-10-06T02:23:25.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.492+0000 7f07087b9700 1 -- 172.21.15.37:0/2060427051 wait complete. 2023-10-06T02:23:25.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.493+0000 7f07087b9700 1 Processor -- start 2023-10-06T02:23:25.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.493+0000 7f07087b9700 1 -- start start 2023-10-06T02:23:25.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f07087b9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070006abb0 0x7f0700151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f07087b9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0700150ab0 0x7f0700168250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f07087b9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0700157130 0x7f070014eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f07087b9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0700154c30 con 0x7f070006abb0 2023-10-06T02:23:25.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f07087b9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0700168790 con 0x7f0700150ab0 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f07087b9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070014f420 con 0x7f0700157130 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f0706555700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070006abb0 0x7f0700151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f0706555700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070006abb0 0x7f0700151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41944/0 (socket says 172.21.15.37:41944) 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f0706555700 1 -- 172.21.15.37:0/374014212 learned_addr learned my addr 172.21.15.37:0/374014212 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f0705d54700 1 --2- 172.21.15.37:0/374014212 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0700150ab0 0x7f0700168250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f0706d56700 1 --2- 172.21.15.37:0/374014212 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0700157130 0x7f070014eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f0706555700 1 -- 172.21.15.37:0/374014212 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0700157130 msgr2=0x7f070014eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f0706555700 1 --2- 172.21.15.37:0/374014212 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0700157130 0x7f070014eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f0706555700 1 -- 172.21.15.37:0/374014212 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0700150ab0 msgr2=0x7f0700168250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f0706555700 1 --2- 172.21.15.37:0/374014212 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0700150ab0 0x7f0700168250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f0706555700 1 -- 172.21.15.37:0/374014212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f80094f0 con 0x7f070006abb0 2023-10-06T02:23:25.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f0706555700 1 --2- 172.21.15.37:0/374014212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070006abb0 0x7f0700151f00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f06f000cb10 tx=0x7f06f00017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:25.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f06fe7fc700 1 -- 172.21.15.37:0/374014212 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f00020c0 con 0x7f070006abb0 2023-10-06T02:23:25.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f06fe7fc700 1 -- 172.21.15.37:0/374014212 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f000a7e0 con 0x7f070006abb0 2023-10-06T02:23:25.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f07087b9700 1 -- 172.21.15.37:0/374014212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0700152600 con 0x7f070006abb0 2023-10-06T02:23:25.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f06fe7fc700 1 -- 172.21.15.37:0/374014212 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f000ab80 con 0x7f070006abb0 2023-10-06T02:23:25.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.494+0000 7f07087b9700 1 -- 172.21.15.37:0/374014212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07001545e0 con 0x7f070006abb0 2023-10-06T02:23:25.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.495+0000 7f07087b9700 1 -- 172.21.15.37:0/374014212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07000689b0 con 0x7f070006abb0 2023-10-06T02:23:25.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.496+0000 7f06fe7fc700 1 -- 172.21.15.37:0/374014212 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f06f0003030 con 0x7f070006abb0 2023-10-06T02:23:25.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.496+0000 7f06fe7fc700 1 --2- 172.21.15.37:0/374014212 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f06ec066f30 0x7f06ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.496+0000 7f06fe7fc700 1 -- 172.21.15.37:0/374014212 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f06f0084710 con 0x7f070006abb0 2023-10-06T02:23:25.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.496+0000 7f0705d54700 1 --2- 172.21.15.37:0/374014212 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f06ec066f30 0x7f06ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.497+0000 7f0705d54700 1 --2- 172.21.15.37:0/374014212 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f06ec066f30 0x7f06ec0693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f070006e7b0 tx=0x7f06f40091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:25.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.500+0000 7f06fe7fc700 1 -- 172.21.15.37:0/374014212 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06f0051820 con 0x7f070006abb0 2023-10-06T02:23:25.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.694+0000 7f07087b9700 1 -- 172.21.15.37:0/374014212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f070015a940 con 0x7f070006abb0 2023-10-06T02:23:25.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.695+0000 7f06fe7fc700 1 -- 172.21.15.37:0/374014212 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f06f0054e40 con 0x7f070006abb0 2023-10-06T02:23:25.698 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:25.699 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:23:16.897625+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:13.004596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:14.268809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.697+0000 7f07087b9700 1 -- 172.21.15.37:0/374014212 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f06ec066f30 msgr2=0x7f06ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.697+0000 7f07087b9700 1 --2- 172.21.15.37:0/374014212 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f06ec066f30 0x7f06ec0693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f070006e7b0 tx=0x7f06f40091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.697+0000 7f07087b9700 1 -- 172.21.15.37:0/374014212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070006abb0 msgr2=0x7f0700151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.697+0000 7f07087b9700 1 --2- 172.21.15.37:0/374014212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070006abb0 0x7f0700151f00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f06f000cb10 tx=0x7f06f00017b0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.697+0000 7f07087b9700 1 -- 172.21.15.37:0/374014212 shutdown_connections 2023-10-06T02:23:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.697+0000 7f07087b9700 1 --2- 172.21.15.37:0/374014212 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0700157130 0x7f070014eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.697+0000 7f07087b9700 1 --2- 172.21.15.37:0/374014212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070006abb0 0x7f0700151f00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.697+0000 7f07087b9700 1 --2- 172.21.15.37:0/374014212 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f06ec066f30 0x7f06ec0693e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.697+0000 7f07087b9700 1 --2- 172.21.15.37:0/374014212 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0700150ab0 0x7f0700168250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.697+0000 7f07087b9700 1 -- 172.21.15.37:0/374014212 >> 172.21.15.37:0/374014212 conn(0x7f07000cc120 msgr2=0x7f07000ac2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.697+0000 7f07087b9700 1 -- 172.21.15.37:0/374014212 shutdown_connections 2023-10-06T02:23:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.697+0000 7f07087b9700 1 -- 172.21.15.37:0/374014212 wait complete. 2023-10-06T02:23:25.710 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T02:23:25.710 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:25.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.828+0000 7fa788635700 1 Processor -- start 2023-10-06T02:23:25.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.828+0000 7fa788635700 1 -- start start 2023-10-06T02:23:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.829+0000 7fa788635700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa7801573d0 0x7fa78015bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.829+0000 7fa788635700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7800b1c70 con 0x7fa7800aedf0 2023-10-06T02:23:25.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.829+0000 7fa788635700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78015c180 con 0x7fa78006b140 2023-10-06T02:23:25.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.829+0000 7fa788635700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7800af340 con 0x7fa7801573d0 2023-10-06T02:23:25.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.829+0000 7fa7863d1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa7801573d0 0x7fa78015bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.829+0000 7fa785bd0700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa7800aedf0 0x7fa7801577a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34346/0 (socket says 172.21.15.37:34346) 2023-10-06T02:23:25.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.829+0000 7fa785bd0700 1 -- 172.21.15.37:0/1966310951 learned_addr learned my addr 172.21.15.37:0/1966310951 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:25.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.829+0000 7fa7863d1700 1 -- 172.21.15.37:0/1966310951 >> v1:172.21.15.191:6789/0 conn(0x7fa78006b140 legacy=0x7fa7800b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.829+0000 7fa7863d1700 1 -- 172.21.15.37:0/1966310951 >> v1:172.21.15.37:6789/0 conn(0x7fa7800aedf0 legacy=0x7fa7801577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.829+0000 7fa7863d1700 1 -- 172.21.15.37:0/1966310951 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7800af620 con 0x7fa7801573d0 2023-10-06T02:23:25.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.829+0000 7fa7853cf700 1 -- 172.21.15.37:0/1966310951 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795307594 0 0) 0x7fa7800b1c70 con 0x7fa7800aedf0 2023-10-06T02:23:25.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.829+0000 7fa7863d1700 1 --2- 172.21.15.37:0/1966310951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7801573d0 0x7fa78015bc40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0098e0 tx=0x7fa77c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1ec5873ffb894b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:25.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.829+0000 7fa7853cf700 1 -- 172.21.15.37:0/1966310951 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c009e80 con 0x7fa7801573d0 2023-10-06T02:23:25.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.829+0000 7fa7853cf700 1 -- 172.21.15.37:0/1966310951 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c00b860 con 0x7fa7801573d0 2023-10-06T02:23:25.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.829+0000 7fa7853cf700 1 -- 172.21.15.37:0/1966310951 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c00bbe0 con 0x7fa7801573d0 2023-10-06T02:23:25.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.830+0000 7fa788635700 1 -- 172.21.15.37:0/1966310951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7801573d0 msgr2=0x7fa78015bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.830+0000 7fa788635700 1 --2- 172.21.15.37:0/1966310951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7801573d0 0x7fa78015bc40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0098e0 tx=0x7fa77c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.830+0000 7fa788635700 1 -- 172.21.15.37:0/1966310951 shutdown_connections 2023-10-06T02:23:25.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.830+0000 7fa788635700 1 --2- 172.21.15.37:0/1966310951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7801573d0 0x7fa78015bc40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.830+0000 7fa788635700 1 -- 172.21.15.37:0/1966310951 >> 172.21.15.37:0/1966310951 conn(0x7fa78006dc40 msgr2=0x7fa780067660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:25.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.830+0000 7fa788635700 1 -- 172.21.15.37:0/1966310951 shutdown_connections 2023-10-06T02:23:25.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.830+0000 7fa788635700 1 -- 172.21.15.37:0/1966310951 wait complete. 2023-10-06T02:23:25.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.831+0000 7fa788635700 1 Processor -- start 2023-10-06T02:23:25.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.831+0000 7fa788635700 1 -- start start 2023-10-06T02:23:25.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.832+0000 7fa788635700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa78006b140 0x7fa780144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.832+0000 7fa788635700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7800aedf0 0x7fa7800c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.832+0000 7fa788635700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7801573d0 0x7fa7800c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.832+0000 7fa788635700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa780145270 con 0x7fa7800aedf0 2023-10-06T02:23:25.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.832+0000 7fa788635700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7800c5190 con 0x7fa7801573d0 2023-10-06T02:23:25.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.832+0000 7fa788635700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7800c5470 con 0x7fa78006b140 2023-10-06T02:23:25.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.832+0000 7fa785bd0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7800aedf0 0x7fa7800c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.832+0000 7fa785bd0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7800aedf0 0x7fa7800c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41960/0 (socket says 172.21.15.37:41960) 2023-10-06T02:23:25.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.832+0000 7fa785bd0700 1 -- 172.21.15.37:0/2860227802 learned_addr learned my addr 172.21.15.37:0/2860227802 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:25.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.832+0000 7fa7863d1700 1 --2- 172.21.15.37:0/2860227802 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa78006b140 0x7fa780144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.832+0000 7fa786bd2700 1 --2- 172.21.15.37:0/2860227802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7801573d0 0x7fa7800c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.832+0000 7fa785bd0700 1 -- 172.21.15.37:0/2860227802 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa78006b140 msgr2=0x7fa780144d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.832+0000 7fa785bd0700 1 --2- 172.21.15.37:0/2860227802 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa78006b140 0x7fa780144d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.832+0000 7fa785bd0700 1 -- 172.21.15.37:0/2860227802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7801573d0 msgr2=0x7fa7800c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:25.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.832+0000 7fa785bd0700 1 --2- 172.21.15.37:0/2860227802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7801573d0 0x7fa7800c9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:25.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.832+0000 7fa785bd0700 1 -- 172.21.15.37:0/2860227802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c009420 con 0x7fa7800aedf0 2023-10-06T02:23:25.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.832+0000 7fa785bd0700 1 --2- 172.21.15.37:0/2860227802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7800aedf0 0x7fa7800c8fd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa77000c810 tx=0x7fa770007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:25.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.833+0000 7fa7767fc700 1 -- 172.21.15.37:0/2860227802 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa770005c00 con 0x7fa7800aedf0 2023-10-06T02:23:25.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.833+0000 7fa7767fc700 1 -- 172.21.15.37:0/2860227802 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa770005d60 con 0x7fa7800aedf0 2023-10-06T02:23:25.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.833+0000 7fa7767fc700 1 -- 172.21.15.37:0/2860227802 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa770007340 con 0x7fa7800aedf0 2023-10-06T02:23:25.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.833+0000 7fa788635700 1 -- 172.21.15.37:0/2860227802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7800c5750 con 0x7fa7800aedf0 2023-10-06T02:23:25.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.833+0000 7fa788635700 1 -- 172.21.15.37:0/2860227802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7800c43d0 con 0x7fa7800aedf0 2023-10-06T02:23:25.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.833+0000 7fa788635700 1 -- 172.21.15.37:0/2860227802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa780070c30 con 0x7fa7800aedf0 2023-10-06T02:23:25.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.834+0000 7fa7767fc700 1 -- 172.21.15.37:0/2860227802 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa77001b400 con 0x7fa7800aedf0 2023-10-06T02:23:25.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.834+0000 7fa7767fc700 1 --2- 172.21.15.37:0/2860227802 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa764066f30 0x7fa7640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:25.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.834+0000 7fa7767fc700 1 -- 172.21.15.37:0/2860227802 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa770084140 con 0x7fa7800aedf0 2023-10-06T02:23:25.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.834+0000 7fa7863d1700 1 --2- 172.21.15.37:0/2860227802 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa764066f30 0x7fa7640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:25.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.835+0000 7fa7863d1700 1 --2- 172.21.15.37:0/2860227802 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa764066f30 0x7fa7640693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0093f0 tx=0x7fa77c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:25.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:25.838+0000 7fa7767fc700 1 -- 172.21.15.37:0/2860227802 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7700512d0 con 0x7fa7800aedf0 2023-10-06T02:23:26.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.031+0000 7fa788635700 1 -- 172.21.15.37:0/2860227802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa78004bb80 con 0x7fa7800aedf0 2023-10-06T02:23:26.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.032+0000 7fa7767fc700 1 -- 172.21.15.37:0/2860227802 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fa7700548f0 con 0x7fa7800aedf0 2023-10-06T02:23:26.032 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:26.033 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:23:16.897625+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:13.004596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:14.268809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:26.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.034+0000 7fa788635700 1 -- 172.21.15.37:0/2860227802 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa764066f30 msgr2=0x7fa7640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.034+0000 7fa788635700 1 --2- 172.21.15.37:0/2860227802 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa764066f30 0x7fa7640693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0093f0 tx=0x7fa77c017000 comp rx=0 tx=0).stop 2023-10-06T02:23:26.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.034+0000 7fa788635700 1 -- 172.21.15.37:0/2860227802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7800aedf0 msgr2=0x7fa7800c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.034+0000 7fa788635700 1 --2- 172.21.15.37:0/2860227802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7800aedf0 0x7fa7800c8fd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa77000c810 tx=0x7fa770007d90 comp rx=0 tx=0).stop 2023-10-06T02:23:26.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.034+0000 7fa788635700 1 -- 172.21.15.37:0/2860227802 shutdown_connections 2023-10-06T02:23:26.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.034+0000 7fa788635700 1 --2- 172.21.15.37:0/2860227802 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa764066f30 0x7fa7640693e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.034+0000 7fa788635700 1 --2- 172.21.15.37:0/2860227802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7801573d0 0x7fa7800c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.034+0000 7fa788635700 1 --2- 172.21.15.37:0/2860227802 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa78006b140 0x7fa780144d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.034+0000 7fa788635700 1 --2- 172.21.15.37:0/2860227802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7800aedf0 0x7fa7800c8fd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.034+0000 7fa788635700 1 -- 172.21.15.37:0/2860227802 >> 172.21.15.37:0/2860227802 conn(0x7fa78006dc40 msgr2=0x7fa7800cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.034+0000 7fa788635700 1 -- 172.21.15.37:0/2860227802 shutdown_connections 2023-10-06T02:23:26.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.034+0000 7fa788635700 1 -- 172.21.15.37:0/2860227802 wait complete. 2023-10-06T02:23:26.047 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T02:23:26.048 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T02:23:26.049 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T02:23:26.049 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T02:23:26.050 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T02:23:26.051 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T02:23:26.051 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T02:23:26.052 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T02:23:26.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.251+0000 7f9e4ef5a700 1 Processor -- start 2023-10-06T02:23:26.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.254+0000 7f9e4ef5a700 1 -- start start 2023-10-06T02:23:26.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.255+0000 7f409b597700 1 Processor -- start 2023-10-06T02:23:26.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.255+0000 7f9e4ef5a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e4815a780 0x7f9e4815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.255+0000 7f9e4ef5a700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9e480c6e90 0x7f9e480c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.255+0000 7f9e4ef5a700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e480c2fc0 con 0x7f9e480c2610 2023-10-06T02:23:26.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.255+0000 7f9e4ef5a700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e4815b090 con 0x7f9e480c6e90 2023-10-06T02:23:26.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.255+0000 7f9e4ef5a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4806eca0 con 0x7f9e4815a780 2023-10-06T02:23:26.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.255+0000 7f9e4ccf6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e4815a780 0x7f9e4815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.255+0000 7f9e4ccf6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e4815a780 0x7f9e4815ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:55238/0 (socket says 172.21.15.37:55238) 2023-10-06T02:23:26.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.255+0000 7f9e4ccf6700 1 -- 172.21.15.37:0/291463485 learned_addr learned my addr 172.21.15.37:0/291463485 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.255+0000 7f409b597700 1 -- start start 2023-10-06T02:23:26.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.256+0000 7f9e4ccf6700 1 -- 172.21.15.37:0/291463485 >> v2:172.21.15.191:3300/0 conn(0x7f9e480c6e90 msgr2=0x7f9e480c2a80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:23:26.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.256+0000 7f9e4ccf6700 1 --2- 172.21.15.37:0/291463485 >> v2:172.21.15.191:3300/0 conn(0x7f9e480c6e90 0x7f9e480c2a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.256+0000 7f9e4ccf6700 1 -- 172.21.15.37:0/291463485 >> v1:172.21.15.37:6789/0 conn(0x7f9e480c2610 legacy=0x7f9e480c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:26.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.256+0000 7f9e4ccf6700 1 -- 172.21.15.37:0/291463485 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4815d750 con 0x7f9e4815a780 2023-10-06T02:23:26.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.256+0000 7f9e4ccf6700 1 --2- 172.21.15.37:0/291463485 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e4815a780 0x7f9e4815ab50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9e340099b0 tx=0x7f9e34009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=984984d2a43ac5bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.256+0000 7f9e477fe700 1 -- 172.21.15.37:0/291463485 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3400b820 con 0x7f9e4815a780 2023-10-06T02:23:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.256+0000 7f9e477fe700 1 -- 172.21.15.37:0/291463485 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3400b980 con 0x7f9e4815a780 2023-10-06T02:23:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.256+0000 7f9e477fe700 1 -- 172.21.15.37:0/291463485 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3400bd20 con 0x7f9e4815a780 2023-10-06T02:23:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.256+0000 7f409b597700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f409415dab0 0x7f40940ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.256+0000 7f409b597700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f409406e1c0 con 0x7f40940caa80 2023-10-06T02:23:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.256+0000 7f409b597700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40940caec0 con 0x7f409415d6e0 2023-10-06T02:23:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.256+0000 7f409b597700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40940af3a0 con 0x7f409415dab0 2023-10-06T02:23:26.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.257+0000 7f9e4ef5a700 1 -- 172.21.15.37:0/291463485 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e4815a780 msgr2=0x7f9e4815ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.257+0000 7f9e4ef5a700 1 --2- 172.21.15.37:0/291463485 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e4815a780 0x7f9e4815ab50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9e340099b0 tx=0x7f9e34009250 comp rx=0 tx=0).stop 2023-10-06T02:23:26.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.257+0000 7f4099b34700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f40940caa80 0x7f409406c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34372/0 (socket says 172.21.15.37:34372) 2023-10-06T02:23:26.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.257+0000 7f4099b34700 1 -- 172.21.15.37:0/418535618 learned_addr learned my addr 172.21.15.37:0/418535618 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:26.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.257+0000 7f4098b32700 1 --2- 172.21.15.37:0/418535618 >> v2:172.21.15.37:3300/0 conn(0x7f409415dab0 0x7f40940ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.258+0000 7f5356cb9700 1 Processor -- start 2023-10-06T02:23:26.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.258+0000 7f4098b32700 1 -- 172.21.15.37:0/418535618 >> v1:172.21.15.191:6789/0 conn(0x7f409415d6e0 legacy=0x7f40940aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:26.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.258+0000 7f4098b32700 1 -- 172.21.15.37:0/418535618 >> v1:172.21.15.37:6789/0 conn(0x7f40940caa80 legacy=0x7f409406c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.258+0000 7f4098b32700 1 -- 172.21.15.37:0/418535618 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409406e410 con 0x7f409415dab0 2023-10-06T02:23:26.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.258+0000 7f4098b32700 1 --2- 172.21.15.37:0/418535618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f409415dab0 0x7f40940ca540 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f40900098e0 tx=0x7f40900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ece5283fbddc768 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.258+0000 7f408bfff700 1 -- 172.21.15.37:0/418535618 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090009e80 con 0x7f409415dab0 2023-10-06T02:23:26.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.258+0000 7f408bfff700 1 -- 172.21.15.37:0/418535618 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409000b820 con 0x7f409415dab0 2023-10-06T02:23:26.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.258+0000 7f408bfff700 1 -- 172.21.15.37:0/418535618 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409000bba0 con 0x7f409415dab0 2023-10-06T02:23:26.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.258+0000 7f5356cb9700 1 -- start start 2023-10-06T02:23:26.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.259+0000 7f5356cb9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f535006d410 0x7f53500c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.259+0000 7f5356cb9700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53500c3a00 con 0x7f535006d7e0 2023-10-06T02:23:26.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.259+0000 7f5356cb9700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53500c3ce0 con 0x7f53500694a0 2023-10-06T02:23:26.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.259+0000 7f5356cb9700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53500c3fc0 con 0x7f535006d410 2023-10-06T02:23:26.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.259+0000 7f89a30a4700 1 Processor -- start 2023-10-06T02:23:26.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.259+0000 7f409b597700 1 -- 172.21.15.37:0/418535618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f409415dab0 msgr2=0x7f40940ca540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.259+0000 7f409b597700 1 --2- 172.21.15.37:0/418535618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f409415dab0 0x7f40940ca540 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f40900098e0 tx=0x7f40900091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.259+0000 7f534ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f535006d7e0 0x7f5350068d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34382/0 (socket says 172.21.15.37:34382) 2023-10-06T02:23:26.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.259+0000 7f534ffff700 1 -- 172.21.15.37:0/625659781 learned_addr learned my addr 172.21.15.37:0/625659781 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:26.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.259+0000 7f5354a55700 1 --2- 172.21.15.37:0/625659781 >> v2:172.21.15.37:3300/0 conn(0x7f535006d410 0x7f53500c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.260+0000 7f409b597700 1 -- 172.21.15.37:0/418535618 shutdown_connections 2023-10-06T02:23:26.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.260+0000 7f409b597700 1 --2- 172.21.15.37:0/418535618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f409415dab0 0x7f40940ca540 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.260+0000 7f409b597700 1 -- 172.21.15.37:0/418535618 >> 172.21.15.37:0/418535618 conn(0x7f40940cc970 msgr2=0x7f40940ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.260+0000 7f534f7fe700 1 -- 172.21.15.37:0/625659781 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062574169 0 0) 0x7f53500c3ce0 con 0x7f53500694a0 2023-10-06T02:23:26.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.260+0000 7f534f7fe700 1 -- 172.21.15.37:0/625659781 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5338003570 con 0x7f53500694a0 2023-10-06T02:23:26.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.260+0000 7f5354a55700 1 -- 172.21.15.37:0/625659781 >> v1:172.21.15.191:6789/0 conn(0x7f53500694a0 legacy=0x7f53501677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.260+0000 7f5354a55700 1 -- 172.21.15.37:0/625659781 >> v1:172.21.15.37:6789/0 conn(0x7f535006d7e0 legacy=0x7f5350068d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.260+0000 7f534f7fe700 1 -- 172.21.15.37:0/625659781 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2356693728 0 0) 0x7f53500c3a00 con 0x7f535006d7e0 2023-10-06T02:23:26.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.260+0000 7f5354a55700 1 -- 172.21.15.37:0/625659781 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53500c42a0 con 0x7f535006d410 2023-10-06T02:23:26.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.260+0000 7f409b597700 1 -- 172.21.15.37:0/418535618 shutdown_connections 2023-10-06T02:23:26.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.259+0000 7f89a30a4700 1 -- start start 2023-10-06T02:23:26.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.260+0000 7f409b597700 1 -- 172.21.15.37:0/418535618 wait complete. 2023-10-06T02:23:26.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.260+0000 7f5354a55700 1 --2- 172.21.15.37:0/625659781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f535006d410 0x7f53500c30b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5348009e60 tx=0x7f5348009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c871d8f532f173ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.261+0000 7f9e4ef5a700 1 -- 172.21.15.37:0/291463485 shutdown_connections 2023-10-06T02:23:26.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.261+0000 7f9e4ef5a700 1 --2- 172.21.15.37:0/291463485 >> v2:172.21.15.191:3300/0 conn(0x7f9e480c6e90 0x7f9e480c2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.261+0000 7f9e4ef5a700 1 --2- 172.21.15.37:0/291463485 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e4815a780 0x7f9e4815ab50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.261+0000 7f9e4ef5a700 1 -- 172.21.15.37:0/291463485 >> 172.21.15.37:0/291463485 conn(0x7f9e480cc140 msgr2=0x7f9e480cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.261+0000 7f534f7fe700 1 -- 172.21.15.37:0/625659781 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534800e070 con 0x7f535006d410 2023-10-06T02:23:26.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.261+0000 7f534f7fe700 1 -- 172.21.15.37:0/625659781 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534800bb60 con 0x7f535006d410 2023-10-06T02:23:26.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.261+0000 7f534f7fe700 1 -- 172.21.15.37:0/625659781 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5348012430 con 0x7f535006d410 2023-10-06T02:23:26.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.261+0000 7f89a30a4700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f899c15dd40 0x7f899c0b2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.261+0000 7f89a30a4700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f899c162230 0x7f899c0cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.261+0000 7f89a30a4700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899c15f2d0 con 0x7f899c0b2890 2023-10-06T02:23:26.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.261+0000 7f89a30a4700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899c162630 con 0x7f899c162230 2023-10-06T02:23:26.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.261+0000 7f89a30a4700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899c15ee40 con 0x7f899c15dd40 2023-10-06T02:23:26.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.261+0000 7f89a1641700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f899c162230 0x7f899c0cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.261+0000 7f89a1641700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f899c162230 0x7f899c0cadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41996/0 (socket says 172.21.15.37:41996) 2023-10-06T02:23:26.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.261+0000 7f89a1641700 1 -- 172.21.15.37:0/1426962193 learned_addr learned my addr 172.21.15.37:0/1426962193 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.261+0000 7f89a1641700 1 -- 172.21.15.37:0/1426962193 >> v2:172.21.15.191:3300/0 conn(0x7f899c15dd40 msgr2=0x7f899c0b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:26.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.261+0000 7f89a1641700 1 --2- 172.21.15.37:0/1426962193 >> v2:172.21.15.191:3300/0 conn(0x7f899c15dd40 0x7f899c0b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.261+0000 7f89a1641700 1 -- 172.21.15.37:0/1426962193 >> v1:172.21.15.37:6789/0 conn(0x7f899c0b2890 legacy=0x7f899c161b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:23:26.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.261+0000 7f89a1641700 1 -- 172.21.15.37:0/1426962193 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c0cbf00 con 0x7f899c162230 2023-10-06T02:23:26.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.261+0000 7f89a1641700 1 --2- 172.21.15.37:0/1426962193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f899c162230 0x7f899c0cadf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f899c089000 tx=0x7f8994009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad45ed7a5ebf13d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.262+0000 7f899b7fe700 1 -- 172.21.15.37:0/1426962193 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899400e070 con 0x7f899c162230 2023-10-06T02:23:26.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.262+0000 7f899b7fe700 1 -- 172.21.15.37:0/1426962193 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899400ba10 con 0x7f899c162230 2023-10-06T02:23:26.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.262+0000 7f899b7fe700 1 -- 172.21.15.37:0/1426962193 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89940092e0 con 0x7f899c162230 2023-10-06T02:23:26.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.262+0000 7f5356cb9700 1 -- 172.21.15.37:0/625659781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f535006d410 msgr2=0x7f53500c30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.262+0000 7f5356cb9700 1 --2- 172.21.15.37:0/625659781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f535006d410 0x7f53500c30b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5348009e60 tx=0x7f5348009780 comp rx=0 tx=0).stop 2023-10-06T02:23:26.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.262+0000 7f5356cb9700 1 -- 172.21.15.37:0/625659781 shutdown_connections 2023-10-06T02:23:26.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.262+0000 7f5356cb9700 1 --2- 172.21.15.37:0/625659781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f535006d410 0x7f53500c30b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.262+0000 7f5356cb9700 1 -- 172.21.15.37:0/625659781 >> 172.21.15.37:0/625659781 conn(0x7f5350067b30 msgr2=0x7f5350067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.262+0000 7f409b597700 1 Processor -- start 2023-10-06T02:23:26.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.262+0000 7f9e4ef5a700 1 -- 172.21.15.37:0/291463485 shutdown_connections 2023-10-06T02:23:26.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.262+0000 7f409b597700 1 -- start start 2023-10-06T02:23:26.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.262+0000 7f89a30a4700 1 -- 172.21.15.37:0/1426962193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f899c162230 msgr2=0x7f899c0cadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.262+0000 7f89a30a4700 1 --2- 172.21.15.37:0/1426962193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f899c162230 0x7f899c0cadf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f899c089000 tx=0x7f8994009840 comp rx=0 tx=0).stop 2023-10-06T02:23:26.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.263+0000 7f89a30a4700 1 -- 172.21.15.37:0/1426962193 shutdown_connections 2023-10-06T02:23:26.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.263+0000 7f89a30a4700 1 --2- 172.21.15.37:0/1426962193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f899c162230 0x7f899c0cadf0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.263+0000 7f89a30a4700 1 --2- 172.21.15.37:0/1426962193 >> v2:172.21.15.191:3300/0 conn(0x7f899c15dd40 0x7f899c0b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.263+0000 7f89a30a4700 1 -- 172.21.15.37:0/1426962193 >> 172.21.15.37:0/1426962193 conn(0x7f899c0ccf30 msgr2=0x7f899c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.262+0000 7f9e4ef5a700 1 -- 172.21.15.37:0/291463485 wait complete. 2023-10-06T02:23:26.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f5356cb9700 1 -- 172.21.15.37:0/625659781 shutdown_connections 2023-10-06T02:23:26.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f409b597700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40940caa80 0x7f409416de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f409b597700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f409415d6e0 0x7f40940b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f409b597700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f409415dab0 0x7f4094167d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f409b597700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409415ee60 con 0x7f409415dab0 2023-10-06T02:23:26.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f409b597700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40941682d0 con 0x7f40940caa80 2023-10-06T02:23:26.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f409b597700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409416e420 con 0x7f409415d6e0 2023-10-06T02:23:26.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f9e4ef5a700 1 Processor -- start 2023-10-06T02:23:26.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f89a30a4700 1 -- 172.21.15.37:0/1426962193 shutdown_connections 2023-10-06T02:23:26.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f4099333700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40940caa80 0x7f409416de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f4099b34700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f409415dab0 0x7f4094167d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f4099333700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40940caa80 0x7f409416de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:42638/0 (socket says 172.21.15.37:42638) 2023-10-06T02:23:26.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f4099333700 1 -- 172.21.15.37:0/3722409566 learned_addr learned my addr 172.21.15.37:0/3722409566 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f4098b32700 1 --2- 172.21.15.37:0/3722409566 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f409415d6e0 0x7f40940b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f89a30a4700 1 -- 172.21.15.37:0/1426962193 wait complete. 2023-10-06T02:23:26.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f08f53a5700 1 Processor -- start 2023-10-06T02:23:26.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f4099333700 1 -- 172.21.15.37:0/3722409566 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f409415d6e0 msgr2=0x7f40940b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f4099333700 1 --2- 172.21.15.37:0/3722409566 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f409415d6e0 0x7f40940b1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f4099333700 1 -- 172.21.15.37:0/3722409566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f409415dab0 msgr2=0x7f4094167d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f4099333700 1 --2- 172.21.15.37:0/3722409566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f409415dab0 0x7f4094167d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f4099333700 1 -- 172.21.15.37:0/3722409566 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4090009420 con 0x7f40940caa80 2023-10-06T02:23:26.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.265+0000 7f4099333700 1 --2- 172.21.15.37:0/3722409566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40940caa80 0x7f409416de40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f408400c5d0 tx=0x7f4084007f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.265+0000 7f08f53a5700 1 -- start start 2023-10-06T02:23:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.265+0000 7fdd595e9700 1 Processor -- start 2023-10-06T02:23:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.265+0000 7fdd595e9700 1 -- start start 2023-10-06T02:23:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.265+0000 7f40897fa700 1 -- 172.21.15.37:0/3722409566 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084011590 con 0x7f40940caa80 2023-10-06T02:23:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.265+0000 7f40897fa700 1 -- 172.21.15.37:0/3722409566 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4084011710 con 0x7f40940caa80 2023-10-06T02:23:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.265+0000 7f40897fa700 1 -- 172.21.15.37:0/3722409566 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084011ad0 con 0x7f40940caa80 2023-10-06T02:23:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.265+0000 7f409b597700 1 -- 172.21.15.37:0/3722409566 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f409416e700 con 0x7f40940caa80 2023-10-06T02:23:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.264+0000 7f9e4ef5a700 1 -- start start 2023-10-06T02:23:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.265+0000 7f9e4ef5a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e480c2610 0x7f9e480aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.265+0000 7f9e4ef5a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e480c6e90 0x7f9e48158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.265+0000 7f9e4ef5a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e4815a780 0x7f9e480cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.265+0000 7f9e4ef5a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e480ac540 con 0x7f9e480c6e90 2023-10-06T02:23:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.265+0000 7f9e4ef5a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e480ab8c0 con 0x7f9e4815a780 2023-10-06T02:23:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.265+0000 7f9e4ef5a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e480abba0 con 0x7f9e480c2610 2023-10-06T02:23:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.265+0000 7f9e4ccf6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e480c2610 0x7f9e480aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.265+0000 7f9e4ccf6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e480c2610 0x7f9e480aeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:55246/0 (socket says 172.21.15.37:55246) 2023-10-06T02:23:26.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.265+0000 7f9e4ccf6700 1 -- 172.21.15.37:0/1484049364 learned_addr learned my addr 172.21.15.37:0/1484049364 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.265+0000 7f9e47fff700 1 --2- 172.21.15.37:0/1484049364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e480c6e90 0x7f9e48158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7f9e4d4f7700 1 --2- 172.21.15.37:0/1484049364 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e4815a780 0x7f9e480cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.265+0000 7f409b597700 1 -- 172.21.15.37:0/3722409566 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f409416ecc0 con 0x7f40940caa80 2023-10-06T02:23:26.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7f89a30a4700 1 Processor -- start 2023-10-06T02:23:26.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7f89a30a4700 1 -- start start 2023-10-06T02:23:26.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7fdd595e9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdd541558e0 0x7fdd5406d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7fdd595e9700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fdd5406d8a0 0x7fdd5406e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7f08f53a5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08f0159560 0x7f08f00acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7f08f53a5700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f08f0159930 0x7f08f006c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7f08f53a5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08f006c5f0 0x7f08f00cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7f08f53a5700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f006ca90 con 0x7f08f006c5f0 2023-10-06T02:23:26.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7f08f53a5700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f00c9ea0 con 0x7f08f0159930 2023-10-06T02:23:26.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7f08f53a5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f00ca0f0 con 0x7f08f0159560 2023-10-06T02:23:26.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7f5356cb9700 1 -- 172.21.15.37:0/625659781 wait complete. 2023-10-06T02:23:26.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7fdd595e9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd5406e700 0x7fdd54069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7fdd595e9700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5406eb30 con 0x7fdd541558e0 2023-10-06T02:23:26.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7fdd595e9700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd540cb1c0 con 0x7fdd5406d8a0 2023-10-06T02:23:26.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7fdd595e9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd540cb4a0 con 0x7fdd5406e700 2023-10-06T02:23:26.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f08eeffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08f0159560 0x7f08f00acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f08ee7fc700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f08f0159930 0x7f08f006c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7f9e47fff700 1 -- 172.21.15.37:0/1484049364 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e480c2610 msgr2=0x7f9e480aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7f9e47fff700 1 --2- 172.21.15.37:0/1484049364 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e480c2610 0x7f9e480aeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7f9e47fff700 1 -- 172.21.15.37:0/1484049364 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e4815a780 msgr2=0x7f9e480cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7f9e47fff700 1 --2- 172.21.15.37:0/1484049364 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e4815a780 0x7f9e480cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.266+0000 7f9e47fff700 1 -- 172.21.15.37:0/1484049364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e340094f0 con 0x7f9e480c6e90 2023-10-06T02:23:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f08eeffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08f0159560 0x7f08f00acaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:55256/0 (socket says 172.21.15.37:55256) 2023-10-06T02:23:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f08ee7fc700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f08f0159930 0x7f08f006c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:42654/0 (socket says 172.21.15.37:42654) 2023-10-06T02:23:26.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f08eeffd700 1 -- 172.21.15.37:0/2618390551 learned_addr learned my addr 172.21.15.37:0/2618390551 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7fdd537fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd5406e700 0x7fdd54069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7fdd537fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd5406e700 0x7fdd54069cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:55266/0 (socket says 172.21.15.37:55266) 2023-10-06T02:23:26.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7fdd537fe700 1 -- 172.21.15.37:0/1523416515 learned_addr learned my addr 172.21.15.37:0/1523416515 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7fdd4a7fc700 1 --2- 172.21.15.37:0/1523416515 >> v2:172.21.15.191:3300/0 conn(0x7fdd5406d8a0 0x7fdd5406e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f89a30a4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f899c0b2890 0x7f899c15a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f89a30a4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f899c15dd40 0x7f899c16e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f89a30a4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f899c162230 0x7f899c16f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f89a30a4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c15a9f0 con 0x7f899c0b2890 2023-10-06T02:23:26.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f89a30a4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0c6290 con 0x7f899c15dd40 2023-10-06T02:23:26.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f08eeffd700 1 -- 172.21.15.37:0/2618390551 >> v2:172.21.15.191:3300/0 conn(0x7f08f0159930 msgr2=0x7f08f006c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:26.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f08eeffd700 1 --2- 172.21.15.37:0/2618390551 >> v2:172.21.15.191:3300/0 conn(0x7f08f0159930 0x7f08f006c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f89a30a4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899c16e8a0 con 0x7f899c162230 2023-10-06T02:23:26.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f08eeffd700 1 -- 172.21.15.37:0/2618390551 >> v2:172.21.15.37:3300/0 conn(0x7f08f006c5f0 msgr2=0x7f08f00cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:26.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f08eeffd700 1 --2- 172.21.15.37:0/2618390551 >> v2:172.21.15.37:3300/0 conn(0x7f08f006c5f0 0x7f08f00cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f08eeffd700 1 -- 172.21.15.37:0/2618390551 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f00ca3d0 con 0x7f08f0159560 2023-10-06T02:23:26.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f899bfff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f899c15dd40 0x7f899c16e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f899bfff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f899c15dd40 0x7f899c16e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:42674/0 (socket says 172.21.15.37:42674) 2023-10-06T02:23:26.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f899bfff700 1 -- 172.21.15.37:0/3916730105 learned_addr learned my addr 172.21.15.37:0/3916730105 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f89a1641700 1 --2- 172.21.15.37:0/3916730105 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f899c162230 0x7f899c16f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7fdd537fe700 1 -- 172.21.15.37:0/1523416515 >> v2:172.21.15.191:3300/0 conn(0x7fdd5406d8a0 msgr2=0x7fdd5406e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:26.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7fdd537fe700 1 --2- 172.21.15.37:0/1523416515 >> v2:172.21.15.191:3300/0 conn(0x7fdd5406d8a0 0x7fdd5406e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7fdd537fe700 1 -- 172.21.15.37:0/1523416515 >> v2:172.21.15.37:3300/0 conn(0x7fdd541558e0 msgr2=0x7fdd5406d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:26.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7fdd537fe700 1 --2- 172.21.15.37:0/1523416515 >> v2:172.21.15.37:3300/0 conn(0x7fdd541558e0 0x7fdd5406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7fdd537fe700 1 -- 172.21.15.37:0/1523416515 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd540cb780 con 0x7fdd5406e700 2023-10-06T02:23:26.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f08eeffd700 1 --2- 172.21.15.37:0/2618390551 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08f0159560 0x7f08f00acaa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f08f006a350 tx=0x7f08e8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b11392c233ca9c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f5356cb9700 1 Processor -- start 2023-10-06T02:23:26.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f08edffb700 1 -- 172.21.15.37:0/2618390551 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e800e070 con 0x7f08f0159560 2023-10-06T02:23:26.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f89a1641700 1 -- 172.21.15.37:0/3916730105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f899c15dd40 msgr2=0x7f899c16e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f89a1641700 1 --2- 172.21.15.37:0/3916730105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f899c15dd40 0x7f899c16e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f08edffb700 1 -- 172.21.15.37:0/2618390551 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e800ba50 con 0x7f08f0159560 2023-10-06T02:23:26.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.267+0000 7f08edffb700 1 -- 172.21.15.37:0/2618390551 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e80092e0 con 0x7f08f0159560 2023-10-06T02:23:26.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.268+0000 7f89a1641700 1 -- 172.21.15.37:0/3916730105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f899c0b2890 msgr2=0x7f899c15a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.268+0000 7f89a1641700 1 --2- 172.21.15.37:0/3916730105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f899c0b2890 0x7f899c15a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.268+0000 7f89a1641700 1 -- 172.21.15.37:0/3916730105 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8994009ae0 con 0x7f899c162230 2023-10-06T02:23:26.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.268+0000 7f899bfff700 1 --2- 172.21.15.37:0/3916730105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f899c15dd40 0x7f899c16e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:26.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.268+0000 7f5356cb9700 1 -- start start 2023-10-06T02:23:26.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.268+0000 7f89a1641700 1 --2- 172.21.15.37:0/3916730105 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f899c162230 0x7f899c16f510 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8994014000 tx=0x7f8994017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.268+0000 7f40897fa700 1 -- 172.21.15.37:0/3722409566 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f408401c460 con 0x7f40940caa80 2023-10-06T02:23:26.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.268+0000 7f8998ff9700 1 -- 172.21.15.37:0/3916730105 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994012b80 con 0x7f899c162230 2023-10-06T02:23:26.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.268+0000 7f8998ff9700 1 -- 172.21.15.37:0/3916730105 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8994012d20 con 0x7f899c162230 2023-10-06T02:23:26.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.268+0000 7f8998ff9700 1 -- 172.21.15.37:0/3916730105 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899401e680 con 0x7f899c162230 2023-10-06T02:23:26.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.268+0000 7f89a30a4700 1 -- 172.21.15.37:0/3916730105 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899c16eb20 con 0x7f899c162230 2023-10-06T02:23:26.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.268+0000 7f89a30a4700 1 -- 172.21.15.37:0/3916730105 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899c16f0e0 con 0x7f899c162230 2023-10-06T02:23:26.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.268+0000 7f40897fa700 1 --2- 172.21.15.37:0/3722409566 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4078066f30 0x7f40780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.268+0000 7f08f53a5700 1 -- 172.21.15.37:0/2618390551 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08f0159560 msgr2=0x7f08f00acaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.268+0000 7f08f53a5700 1 --2- 172.21.15.37:0/2618390551 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08f0159560 0x7f08f00acaa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f08f006a350 tx=0x7f08e8009840 comp rx=0 tx=0).stop 2023-10-06T02:23:26.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f40897fa700 1 -- 172.21.15.37:0/3722409566 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4084084350 con 0x7f40940caa80 2023-10-06T02:23:26.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.268+0000 7f08f53a5700 1 -- 172.21.15.37:0/2618390551 shutdown_connections 2023-10-06T02:23:26.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f08f53a5700 1 --2- 172.21.15.37:0/2618390551 >> v2:172.21.15.37:3300/0 conn(0x7f08f006c5f0 0x7f08f00cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f08f53a5700 1 --2- 172.21.15.37:0/2618390551 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08f0159560 0x7f08f00acaa0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f08f53a5700 1 --2- 172.21.15.37:0/2618390551 >> v2:172.21.15.191:3300/0 conn(0x7f08f0159930 0x7f08f006c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f08f53a5700 1 -- 172.21.15.37:0/2618390551 >> 172.21.15.37:0/2618390551 conn(0x7f08f006e9d0 msgr2=0x7f08f006edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7fdd537fe700 1 --2- 172.21.15.37:0/1523416515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd5406e700 0x7fdd54069cd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdd540c3910 tx=0x7fdd4c00b4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62b77cc96de69a9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f9e47fff700 1 --2- 172.21.15.37:0/1484049364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e480c6e90 0x7f9e48158c80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00b5b0 tx=0x7f9e3c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f5356cb9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53500694a0 0x7f53501430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f5356cb9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f535006d410 0x7f53500c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f5356cb9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f535006d7e0 0x7f53500c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f5356cb9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53500c8500 con 0x7f53500694a0 2023-10-06T02:23:26.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f5356cb9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535015f880 con 0x7f535006d7e0 2023-10-06T02:23:26.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f5356cb9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53500c7f40 con 0x7f535006d410 2023-10-06T02:23:26.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f89a30a4700 1 -- 172.21.15.37:0/3916730105 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f899c16f300 con 0x7f899c162230 2023-10-06T02:23:26.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7fdd527fc700 1 -- 172.21.15.37:0/1523416515 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c00da60 con 0x7fdd5406e700 2023-10-06T02:23:26.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7fdd527fc700 1 -- 172.21.15.37:0/1523416515 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4c00dbc0 con 0x7fdd5406e700 2023-10-06T02:23:26.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7fdd527fc700 1 -- 172.21.15.37:0/1523416515 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c017410 con 0x7fdd5406e700 2023-10-06T02:23:26.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f08f53a5700 1 -- 172.21.15.37:0/2618390551 shutdown_connections 2023-10-06T02:23:26.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f9e44ff9700 1 -- 172.21.15.37:0/1484049364 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c00f510 con 0x7f9e480c6e90 2023-10-06T02:23:26.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f9e44ff9700 1 -- 172.21.15.37:0/1484049364 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3c00f690 con 0x7f9e480c6e90 2023-10-06T02:23:26.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f9e44ff9700 1 -- 172.21.15.37:0/1484049364 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c00fa50 con 0x7f9e480c6e90 2023-10-06T02:23:26.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f5354a55700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53500694a0 0x7f53501430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f5354a55700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53500694a0 0x7f53501430c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42064/0 (socket says 172.21.15.37:42064) 2023-10-06T02:23:26.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f5354a55700 1 -- 172.21.15.37:0/1779199695 learned_addr learned my addr 172.21.15.37:0/1779199695 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f534ffff700 1 --2- 172.21.15.37:0/1779199695 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f535006d410 0x7f53500c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f5355256700 1 --2- 172.21.15.37:0/1779199695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f535006d7e0 0x7f53500c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f4098b32700 1 --2- 172.21.15.37:0/3722409566 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4078066f30 0x7f40780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.270+0000 7f534ffff700 1 -- 172.21.15.37:0/1779199695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f535006d7e0 msgr2=0x7f53500c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.270+0000 7f534ffff700 1 --2- 172.21.15.37:0/1779199695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f535006d7e0 0x7f53500c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.270+0000 7f534ffff700 1 -- 172.21.15.37:0/1779199695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53500694a0 msgr2=0x7f53501430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.270+0000 7f534ffff700 1 --2- 172.21.15.37:0/1779199695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53500694a0 0x7f53501430c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.270+0000 7f534ffff700 1 -- 172.21.15.37:0/1779199695 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5348009a20 con 0x7f535006d410 2023-10-06T02:23:26.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.270+0000 7f534ffff700 1 --2- 172.21.15.37:0/1779199695 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f535006d410 0x7f53500c73f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f534000c4f0 tx=0x7f5340007f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.270+0000 7f4098b32700 1 --2- 172.21.15.37:0/3722409566 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4078066f30 0x7f40780693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f40900030c0 tx=0x7f4090016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.270+0000 7f534cff9700 1 -- 172.21.15.37:0/1779199695 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534000cea0 con 0x7f535006d410 2023-10-06T02:23:26.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.270+0000 7f534cff9700 1 -- 172.21.15.37:0/1779199695 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5340005b30 con 0x7f535006d410 2023-10-06T02:23:26.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.270+0000 7f5356cb9700 1 -- 172.21.15.37:0/1779199695 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53500c8220 con 0x7f535006d410 2023-10-06T02:23:26.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.270+0000 7f5356cb9700 1 -- 172.21.15.37:0/1779199695 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535016f500 con 0x7f535006d410 2023-10-06T02:23:26.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.270+0000 7f534cff9700 1 -- 172.21.15.37:0/1779199695 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53400070d0 con 0x7f535006d410 2023-10-06T02:23:26.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.270+0000 7f9e4ef5a700 1 -- 172.21.15.37:0/1484049364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e480abe80 con 0x7f9e480c6e90 2023-10-06T02:23:26.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.270+0000 7f9e4ef5a700 1 -- 172.21.15.37:0/1484049364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e481591c0 con 0x7f9e480c6e90 2023-10-06T02:23:26.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.270+0000 7f60dc21f700 1 Processor -- start 2023-10-06T02:23:26.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.271+0000 7f409b597700 1 --2- 172.21.15.37:0/3722409566 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x7f409415bcd0 0x7f40940c1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.271+0000 7f409b597700 1 -- 172.21.15.37:0/3722409566 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f40940c88a0 con 0x7f409415bcd0 2023-10-06T02:23:26.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.271+0000 7f4099b34700 1 --2- 172.21.15.37:0/3722409566 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x7f409415bcd0 0x7f40940c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.270+0000 7f8998ff9700 1 -- 172.21.15.37:0/3916730105 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f899401ea30 con 0x7f899c162230 2023-10-06T02:23:26.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.271+0000 7f8998ff9700 1 --2- 172.21.15.37:0/3916730105 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8988066fb0 0x7f8988069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.271+0000 7f8998ff9700 1 -- 172.21.15.37:0/3916730105 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8994086550 con 0x7f899c162230 2023-10-06T02:23:26.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.271+0000 7f89a0e40700 1 --2- 172.21.15.37:0/3916730105 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8988066fb0 0x7f8988069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.271+0000 7f8998ff9700 1 --2- 172.21.15.37:0/3916730105 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x7f898806f860 0x7f8988071c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.271+0000 7f8998ff9700 1 -- 172.21.15.37:0/3916730105 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8988072320 con 0x7f898806f860 2023-10-06T02:23:26.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.271+0000 7f8998ff9700 1 -- 172.21.15.37:0/3916730105 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8994086880 con 0x7f899c162230 2023-10-06T02:23:26.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.269+0000 7f08f53a5700 1 -- 172.21.15.37:0/2618390551 wait complete. 2023-10-06T02:23:26.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.271+0000 7f08f53a5700 1 Processor -- start 2023-10-06T02:23:26.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.271+0000 7f89a0e40700 1 --2- 172.21.15.37:0/3916730105 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8988066fb0 0x7f8988069460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8990006fd0 tx=0x7f8990006db0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.271+0000 7f08f53a5700 1 -- start start 2023-10-06T02:23:26.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.272+0000 7f534cff9700 1 -- 172.21.15.37:0/1779199695 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53400074c0 con 0x7f535006d410 2023-10-06T02:23:26.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.272+0000 7f899bfff700 1 --2- 172.21.15.37:0/3916730105 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x7f898806f860 0x7f8988071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.271+0000 7f60dc21f700 1 -- start start 2023-10-06T02:23:26.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.272+0000 7f9e4ef5a700 1 -- 172.21.15.37:0/1484049364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e48068140 con 0x7f9e480c6e90 2023-10-06T02:23:26.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.272+0000 7f534cff9700 1 --2- 172.21.15.37:0/1779199695 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f533c066f30 0x7f533c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.272+0000 7fdd595e9700 1 -- 172.21.15.37:0/1523416515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd5406e700 msgr2=0x7fdd54069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7fdd595e9700 1 --2- 172.21.15.37:0/1523416515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd5406e700 0x7fdd54069cd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdd540c3910 tx=0x7fdd4c00b4e0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.272+0000 7f08f53a5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08f006c5f0 0x7f08f00a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.272+0000 7f08f53a5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08f0159560 0x7f08f00b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.272+0000 7f08f53a5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08f0159930 0x7f08f015a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.272+0000 7f08f53a5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f00b2e50 con 0x7f08f0159560 2023-10-06T02:23:26.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.272+0000 7f08f53a5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f0171e50 con 0x7f08f006c5f0 2023-10-06T02:23:26.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.272+0000 7f08f53a5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f0172130 con 0x7f08f0159930 2023-10-06T02:23:26.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f08eeffd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08f006c5f0 0x7f08f00a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f534cff9700 1 -- 172.21.15.37:0/1779199695 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f53400839d0 con 0x7f535006d410 2023-10-06T02:23:26.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f5354a55700 1 --2- 172.21.15.37:0/1779199695 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f533c066f30 0x7f533c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f08eeffd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08f006c5f0 0x7f08f00a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:42700/0 (socket says 172.21.15.37:42700) 2023-10-06T02:23:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f08eeffd700 1 -- 172.21.15.37:0/2930740431 learned_addr learned my addr 172.21.15.37:0/2930740431 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f08ef7fe700 1 --2- 172.21.15.37:0/2930740431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08f0159930 0x7f08f015a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f60dc21f700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f60d4155aa0 0x7f60d40c7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f60dc21f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60d4159870 0x7f60d4159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f60dc21f700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d415a210 con 0x7f60d4155e70 2023-10-06T02:23:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f60dc21f700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d40c2fc0 con 0x7f60d4159870 2023-10-06T02:23:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f60dc21f700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d40c1810 con 0x7f60d4155aa0 2023-10-06T02:23:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f4099b34700 1 --2- 172.21.15.37:0/3722409566 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x7f409415bcd0 0x7f40940c1710 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f899bfff700 1 --2- 172.21.15.37:0/3916730105 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x7f898806f860 0x7f8988071c70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f60d97ba700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f60d4155e70 0x7f60d40c28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34390/0 (socket says 172.21.15.37:34390) 2023-10-06T02:23:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f60d97ba700 1 -- 172.21.15.37:0/1100132923 learned_addr learned my addr 172.21.15.37:0/1100132923 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f60d9fbb700 1 --2- 172.21.15.37:0/1100132923 >> v2:172.21.15.191:3300/0 conn(0x7f60d4155aa0 0x7f60d40c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f08eeffd700 1 -- 172.21.15.37:0/2930740431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08f0159930 msgr2=0x7f08f015a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f08eeffd700 1 --2- 172.21.15.37:0/2930740431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08f0159930 0x7f08f015a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f08eeffd700 1 -- 172.21.15.37:0/2930740431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08f0159560 msgr2=0x7f08f00b2910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T02:23:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f08eeffd700 1 --2- 172.21.15.37:0/2930740431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08f0159560 0x7f08f00b2910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f08eeffd700 1 -- 172.21.15.37:0/2930740431 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e8009ae0 con 0x7f08f006c5f0 2023-10-06T02:23:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f9e44ff9700 1 -- 172.21.15.37:0/1484049364 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e3c01a400 con 0x7f9e480c6e90 2023-10-06T02:23:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f5354a55700 1 --2- 172.21.15.37:0/1779199695 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f533c066f30 0x7f533c0693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f53480099f0 tx=0x7f5348019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f60da7bc700 1 --2- 172.21.15.37:0/1100132923 >> v2:172.21.15.37:3300/0 conn(0x7f60d4159870 0x7f60d4159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.273+0000 7f08eeffd700 1 --2- 172.21.15.37:0/2930740431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08f006c5f0 0x7f08f00a6fb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f08f00ca230 tx=0x7f08e8018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7f60d9fbb700 1 -- 172.21.15.37:0/1100132923 >> v2:172.21.15.37:3300/0 conn(0x7f60d4159870 msgr2=0x7f60d4159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:26.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7f60d9fbb700 1 --2- 172.21.15.37:0/1100132923 >> v2:172.21.15.37:3300/0 conn(0x7f60d4159870 0x7f60d4159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7f60d9fbb700 1 -- 172.21.15.37:0/1100132923 >> v1:172.21.15.37:6789/0 conn(0x7f60d4155e70 legacy=0x7f60d40c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7f60d9fbb700 1 -- 172.21.15.37:0/1100132923 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d40c1af0 con 0x7f60d4155aa0 2023-10-06T02:23:26.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7f08d6ffd700 1 -- 172.21.15.37:0/2930740431 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e8008a00 con 0x7f08f006c5f0 2023-10-06T02:23:26.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7f08d6ffd700 1 -- 172.21.15.37:0/2930740431 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e8008b80 con 0x7f08f006c5f0 2023-10-06T02:23:26.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7f08d6ffd700 1 -- 172.21.15.37:0/2930740431 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e8026460 con 0x7f08f006c5f0 2023-10-06T02:23:26.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7f60da7bc700 1 --2- 172.21.15.37:0/1100132923 >> v2:172.21.15.37:3300/0 conn(0x7f60d4159870 0x7f60d4159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7f60d9fbb700 1 --2- 172.21.15.37:0/1100132923 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60d4155aa0 0x7f60d40c7090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f60cc009e60 tx=0x7f60cc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7955b934708f2b61 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7f5356cb9700 1 --2- 172.21.15.37:0/1779199695 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x7f53300015f0 0x7f5330003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7f5356cb9700 1 -- 172.21.15.37:0/1779199695 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5330006b90 con 0x7f53300015f0 2023-10-06T02:23:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7f08f53a5700 1 -- 172.21.15.37:0/2930740431 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f0172410 con 0x7f08f006c5f0 2023-10-06T02:23:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7f08f53a5700 1 -- 172.21.15.37:0/2930740431 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f00b2450 con 0x7f08f006c5f0 2023-10-06T02:23:26.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7fdd595e9700 1 -- 172.21.15.37:0/1523416515 shutdown_connections 2023-10-06T02:23:26.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7fdd595e9700 1 --2- 172.21.15.37:0/1523416515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd5406e700 0x7fdd54069cd0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7fdd595e9700 1 --2- 172.21.15.37:0/1523416515 >> v2:172.21.15.37:3300/0 conn(0x7fdd541558e0 0x7fdd5406d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7fdd595e9700 1 --2- 172.21.15.37:0/1523416515 >> v2:172.21.15.191:3300/0 conn(0x7fdd5406d8a0 0x7fdd5406e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7fdd595e9700 1 -- 172.21.15.37:0/1523416515 >> 172.21.15.37:0/1523416515 conn(0x7fdd540cc970 msgr2=0x7fdd540ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7f8998ff9700 1 -- 172.21.15.37:0/3916730105 <== osd.3 v2:172.21.15.37:6817/90628 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8988072320 con 0x7f898806f860 2023-10-06T02:23:26.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.275+0000 7f08f53a5700 1 -- 172.21.15.37:0/2930740431 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f08f016f580 con 0x7f08f006c5f0 2023-10-06T02:23:26.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.275+0000 7f40897fa700 1 -- 172.21.15.37:0/3722409566 <== osd.0 v2:172.21.15.37:6816/90621 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f40940c88a0 con 0x7f409415bcd0 2023-10-06T02:23:26.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7f9e44ff9700 1 --2- 172.21.15.37:0/1484049364 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9e2c067050 0x7f9e2c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7f9e44ff9700 1 -- 172.21.15.37:0/1484049364 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9e3c083f10 con 0x7f9e480c6e90 2023-10-06T02:23:26.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7f9e44ff9700 1 --2- 172.21.15.37:0/1484049364 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x7f9e2c06f880 0x7f9e2c071c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7f9e44ff9700 1 -- 172.21.15.37:0/1484049364 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e2c072340 con 0x7f9e2c06f880 2023-10-06T02:23:26.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.274+0000 7f9e4d4f7700 1 --2- 172.21.15.37:0/1484049364 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x7f9e2c06f880 0x7f9e2c071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.275+0000 7f9e4d4f7700 1 --2- 172.21.15.37:0/1484049364 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x7f9e2c06f880 0x7f9e2c071c90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.275+0000 7f9e4ccf6700 1 --2- 172.21.15.37:0/1484049364 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9e2c067050 0x7f9e2c069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.275+0000 7f5355256700 1 --2- 172.21.15.37:0/1779199695 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x7f53300015f0 0x7f5330003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.275+0000 7f5355256700 1 --2- 172.21.15.37:0/1779199695 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x7f53300015f0 0x7f5330003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.275+0000 7f9e44ff9700 1 -- 172.21.15.37:0/1484049364 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e3c009230 con 0x7f9e480c6e90 2023-10-06T02:23:26.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.276+0000 7f9e4ccf6700 1 --2- 172.21.15.37:0/1484049364 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9e2c067050 0x7f9e2c069500 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9e34003080 tx=0x7f9e34016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.276+0000 7f60d8fb9700 1 -- 172.21.15.37:0/1100132923 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc00e070 con 0x7f60d4155aa0 2023-10-06T02:23:26.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.276+0000 7f60d8fb9700 1 -- 172.21.15.37:0/1100132923 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60cc00bbf0 con 0x7f60d4155aa0 2023-10-06T02:23:26.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.276+0000 7f60d8fb9700 1 -- 172.21.15.37:0/1100132923 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc012430 con 0x7f60d4155aa0 2023-10-06T02:23:26.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.276+0000 7f08d6ffd700 1 -- 172.21.15.37:0/2930740431 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f08e8003040 con 0x7f08f006c5f0 2023-10-06T02:23:26.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.276+0000 7fdd595e9700 1 -- 172.21.15.37:0/1523416515 shutdown_connections 2023-10-06T02:23:26.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.276+0000 7f9e44ff9700 1 -- 172.21.15.37:0/1484049364 <== osd.1 v2:172.21.15.37:6808/90617 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9e2c072340 con 0x7f9e2c06f880 2023-10-06T02:23:26.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.277+0000 7f60dc21f700 1 -- 172.21.15.37:0/1100132923 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60d4155aa0 msgr2=0x7f60d40c7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.277+0000 7f60dc21f700 1 --2- 172.21.15.37:0/1100132923 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60d4155aa0 0x7f60d40c7090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f60cc009e60 tx=0x7f60cc009780 comp rx=0 tx=0).stop 2023-10-06T02:23:26.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.277+0000 7f60dc21f700 1 -- 172.21.15.37:0/1100132923 shutdown_connections 2023-10-06T02:23:26.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.277+0000 7f60dc21f700 1 --2- 172.21.15.37:0/1100132923 >> v2:172.21.15.37:3300/0 conn(0x7f60d4159870 0x7f60d4159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.277+0000 7f60dc21f700 1 --2- 172.21.15.37:0/1100132923 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60d4155aa0 0x7f60d40c7090 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.277+0000 7f60dc21f700 1 -- 172.21.15.37:0/1100132923 >> 172.21.15.37:0/1100132923 conn(0x7f60d40cc140 msgr2=0x7f60d40cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.276+0000 7f08d6ffd700 1 --2- 172.21.15.37:0/2930740431 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f08dc066fb0 0x7f08dc069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.276+0000 7f08d6ffd700 1 -- 172.21.15.37:0/2930740431 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f08e8085e70 con 0x7f08f006c5f0 2023-10-06T02:23:26.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.277+0000 7f08d6ffd700 1 --2- 172.21.15.37:0/2930740431 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x7f08dc06f860 0x7f08dc071c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.277+0000 7f08d6ffd700 1 -- 172.21.15.37:0/2930740431 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f08dc072320 con 0x7f08dc06f860 2023-10-06T02:23:26.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.277+0000 7f08d6ffd700 1 -- 172.21.15.37:0/2930740431 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08e8088410 con 0x7f08f006c5f0 2023-10-06T02:23:26.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.276+0000 7f534cff9700 1 -- 172.21.15.37:0/1779199695 <== osd.2 v2:172.21.15.37:6800/90611 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5330006b90 con 0x7f53300015f0 2023-10-06T02:23:26.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.277+0000 7f08ee7fc700 1 --2- 172.21.15.37:0/2930740431 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f08dc066fb0 0x7f08dc069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.277+0000 7f60dc21f700 1 -- 172.21.15.37:0/1100132923 shutdown_connections 2023-10-06T02:23:26.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.277+0000 7f60dc21f700 1 -- 172.21.15.37:0/1100132923 wait complete. 2023-10-06T02:23:26.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.277+0000 7f08ef7fe700 1 --2- 172.21.15.37:0/2930740431 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x7f08dc06f860 0x7f08dc071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.277+0000 7f08ee7fc700 1 --2- 172.21.15.37:0/2930740431 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f08dc066fb0 0x7f08dc069460 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f08f014cf20 tx=0x7f08e4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.277+0000 7f08ef7fe700 1 --2- 172.21.15.37:0/2930740431 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x7f08dc06f860 0x7f08dc071c70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.276+0000 7fdd595e9700 1 -- 172.21.15.37:0/1523416515 wait complete. 2023-10-06T02:23:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.278+0000 7fdd595e9700 1 Processor -- start 2023-10-06T02:23:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.278+0000 7f08d6ffd700 1 -- 172.21.15.37:0/2930740431 <== osd.6 v2:172.21.15.191:6824/90897 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f08dc072320 con 0x7f08dc06f860 2023-10-06T02:23:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.278+0000 7fdd595e9700 1 -- start start 2023-10-06T02:23:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.279+0000 7f60dc21f700 1 Processor -- start 2023-10-06T02:23:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.279+0000 7fdd595e9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd5406d8a0 0x7fdd540c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.279+0000 7fdd595e9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd5406e700 0x7fdd5416d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.279+0000 7fdd595e9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd541558e0 0x7fdd540adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.279+0000 7fdd595e9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd540b12b0 con 0x7fdd5406e700 2023-10-06T02:23:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.279+0000 7fdd595e9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd540c5a00 con 0x7fdd5406d8a0 2023-10-06T02:23:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.279+0000 7fdd595e9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd540afc40 con 0x7fdd541558e0 2023-10-06T02:23:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.280+0000 7fdd4a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd5406e700 0x7fdd5416d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.280+0000 7fdd4a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd5406e700 0x7fdd5416d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42082/0 (socket says 172.21.15.37:42082) 2023-10-06T02:23:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.280+0000 7fdd4a7fc700 1 -- 172.21.15.37:0/567332628 learned_addr learned my addr 172.21.15.37:0/567332628 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.280+0000 7fdd537fe700 1 --2- 172.21.15.37:0/567332628 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd541558e0 0x7fdd540adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.280+0000 7fdd52ffd700 1 --2- 172.21.15.37:0/567332628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd5406d8a0 0x7fdd540c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.280+0000 7fdd537fe700 1 -- 172.21.15.37:0/567332628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd5406d8a0 msgr2=0x7fdd540c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.280+0000 7fdd537fe700 1 --2- 172.21.15.37:0/567332628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd5406d8a0 0x7fdd540c54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.280+0000 7fdd537fe700 1 -- 172.21.15.37:0/567332628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd5406e700 msgr2=0x7fdd5416d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.280+0000 7fdd537fe700 1 --2- 172.21.15.37:0/567332628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd5406e700 0x7fdd5416d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.280+0000 7fdd537fe700 1 -- 172.21.15.37:0/567332628 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c00b780 con 0x7fdd541558e0 2023-10-06T02:23:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.280+0000 7fdd537fe700 1 --2- 172.21.15.37:0/567332628 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd541558e0 0x7fdd540adca0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c018000 tx=0x7fdd4c019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.279+0000 7f60dc21f700 1 -- start start 2023-10-06T02:23:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.280+0000 7f60dc21f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60d4155aa0 0x7f60d40c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.280+0000 7f60dc21f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60d4155e70 0x7f60d40ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.280+0000 7f60dc21f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60d4159870 0x7f60d40c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.280+0000 7f60dc21f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d40abf20 con 0x7f60d4155e70 2023-10-06T02:23:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.280+0000 7f60dc21f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d40ac9b0 con 0x7f60d4155aa0 2023-10-06T02:23:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.280+0000 7f60dc21f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d40ac110 con 0x7f60d4159870 2023-10-06T02:23:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.280+0000 7f60da7bc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60d4159870 0x7f60d40c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.280+0000 7f60da7bc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60d4159870 0x7f60d40c4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:55304/0 (socket says 172.21.15.37:55304) 2023-10-06T02:23:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.280+0000 7f60da7bc700 1 -- 172.21.15.37:0/2640477262 learned_addr learned my addr 172.21.15.37:0/2640477262 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.281+0000 7f60d97ba700 1 --2- 172.21.15.37:0/2640477262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60d4155e70 0x7f60d40ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.281+0000 7fdd4b7fe700 1 -- 172.21.15.37:0/567332628 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c025070 con 0x7fdd541558e0 2023-10-06T02:23:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.281+0000 7fdd4b7fe700 1 -- 172.21.15.37:0/567332628 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4c017410 con 0x7fdd541558e0 2023-10-06T02:23:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.281+0000 7fdd4b7fe700 1 -- 172.21.15.37:0/567332628 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c00da60 con 0x7fdd541558e0 2023-10-06T02:23:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.281+0000 7f60da7bc700 1 -- 172.21.15.37:0/2640477262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60d4155aa0 msgr2=0x7f60d40c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.281+0000 7f60da7bc700 1 --2- 172.21.15.37:0/2640477262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60d4155aa0 0x7f60d40c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.281+0000 7f60da7bc700 1 -- 172.21.15.37:0/2640477262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60d4155e70 msgr2=0x7f60d40ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.281+0000 7f60da7bc700 1 --2- 172.21.15.37:0/2640477262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60d4155e70 0x7f60d40ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.281+0000 7f60da7bc700 1 -- 172.21.15.37:0/2640477262 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc009a20 con 0x7f60d4159870 2023-10-06T02:23:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.281+0000 7fdd595e9700 1 -- 172.21.15.37:0/567332628 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd540aff20 con 0x7fdd541558e0 2023-10-06T02:23:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.281+0000 7fdd595e9700 1 -- 172.21.15.37:0/567332628 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd540b04e0 con 0x7fdd541558e0 2023-10-06T02:23:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.282+0000 7fdd595e9700 1 -- 172.21.15.37:0/567332628 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdd38000fd0 con 0x7fdd541558e0 2023-10-06T02:23:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.282+0000 7f60da7bc700 1 --2- 172.21.15.37:0/2640477262 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60d4159870 0x7f60d40c4d50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f60c400d890 tx=0x7f60c4008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.282+0000 7f60c9ffb700 1 -- 172.21.15.37:0/2640477262 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c40125f0 con 0x7f60d4159870 2023-10-06T02:23:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.282+0000 7f60c9ffb700 1 -- 172.21.15.37:0/2640477262 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c4012750 con 0x7f60d4159870 2023-10-06T02:23:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.282+0000 7f60c9ffb700 1 -- 172.21.15.37:0/2640477262 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c4012ad0 con 0x7f60d4159870 2023-10-06T02:23:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.282+0000 7f60dc21f700 1 -- 172.21.15.37:0/2640477262 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d40ac3f0 con 0x7f60d4159870 2023-10-06T02:23:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.283+0000 7f60dc21f700 1 -- 172.21.15.37:0/2640477262 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d4156800 con 0x7f60d4159870 2023-10-06T02:23:26.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.284+0000 7fdd4b7fe700 1 -- 172.21.15.37:0/567332628 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd4c015070 con 0x7fdd541558e0 2023-10-06T02:23:26.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.284+0000 7fdd4b7fe700 1 --2- 172.21.15.37:0/567332628 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdd34067080 0x7fdd34069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.284+0000 7fdd4b7fe700 1 -- 172.21.15.37:0/567332628 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdd4c085d30 con 0x7fdd541558e0 2023-10-06T02:23:26.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.284+0000 7fdd4b7fe700 1 --2- 172.21.15.37:0/567332628 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x7fdd3406f8b0 0x7fdd34071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.284+0000 7fdd4b7fe700 1 -- 172.21.15.37:0/567332628 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd34072370 con 0x7fdd3406f8b0 2023-10-06T02:23:26.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.285+0000 7fdd4b7fe700 1 -- 172.21.15.37:0/567332628 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd4c052e20 con 0x7fdd541558e0 2023-10-06T02:23:26.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.285+0000 7fdd52ffd700 1 --2- 172.21.15.37:0/567332628 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdd34067080 0x7fdd34069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.285+0000 7fdd4a7fc700 1 --2- 172.21.15.37:0/567332628 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x7fdd3406f8b0 0x7fdd34071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.285+0000 7f60c9ffb700 1 -- 172.21.15.37:0/2640477262 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60c4014430 con 0x7f60d4159870 2023-10-06T02:23:26.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.285+0000 7f60c9ffb700 1 --2- 172.21.15.37:0/2640477262 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f60b8067080 0x7f60b8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.285+0000 7f60c9ffb700 1 -- 172.21.15.37:0/2640477262 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f60c4084a70 con 0x7f60d4159870 2023-10-06T02:23:26.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.285+0000 7f60d9fbb700 1 --2- 172.21.15.37:0/2640477262 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f60b8067080 0x7f60b8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.286+0000 7f60dc21f700 1 --2- 172.21.15.37:0/2640477262 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x7f60d40c5290 0x7f60d40c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.286+0000 7f60dc21f700 1 -- 172.21.15.37:0/2640477262 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f60d40c8010 con 0x7f60d40c5290 2023-10-06T02:23:26.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.286+0000 7f60d97ba700 1 --2- 172.21.15.37:0/2640477262 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x7f60d40c5290 0x7f60d40c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.285+0000 7fdd4a7fc700 1 --2- 172.21.15.37:0/567332628 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x7fdd3406f8b0 0x7fdd34071cc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.286+0000 7fdd52ffd700 1 --2- 172.21.15.37:0/567332628 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdd34067080 0x7fdd34069530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdd44007580 tx=0x7fdd44009780 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.286+0000 7fdd4b7fe700 1 -- 172.21.15.37:0/567332628 <== osd.4 v2:172.21.15.191:6800/90852 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fdd34072370 con 0x7fdd3406f8b0 2023-10-06T02:23:26.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.286+0000 7f60d97ba700 1 --2- 172.21.15.37:0/2640477262 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x7f60d40c5290 0x7f60d40c5660 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.287+0000 7f00c8c76700 1 Processor -- start 2023-10-06T02:23:26.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.287+0000 7f00c8c76700 1 -- start start 2023-10-06T02:23:26.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.287+0000 7f60c9ffb700 1 -- 172.21.15.37:0/2640477262 <== osd.5 v2:172.21.15.191:6808/90853 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f60d40c8010 con 0x7f60d40c5290 2023-10-06T02:23:26.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.288+0000 7f60d9fbb700 1 --2- 172.21.15.37:0/2640477262 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f60b8067080 0x7f60b8069530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0097c0 tx=0x7f60cc019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.288+0000 7f00c8c76700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c4159930 0x7f00c406c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.288+0000 7f00c8c76700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c40c9ea0 con 0x7f00c4159560 2023-10-06T02:23:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.288+0000 7f00c8c76700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c40ca0f0 con 0x7f00c406c5f0 2023-10-06T02:23:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.288+0000 7f00c8c76700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c406ca90 con 0x7f00c4159930 2023-10-06T02:23:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.289+0000 7f00c1d9b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c4159930 0x7f00c406c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.289+0000 7f00c2d9d700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f00c406c5f0 0x7f00c4159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:57752/0 (socket says 172.21.15.37:57752) 2023-10-06T02:23:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.289+0000 7f00c2d9d700 1 -- 172.21.15.37:0/4082005373 learned_addr learned my addr 172.21.15.37:0/4082005373 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.289+0000 7f00c159a700 1 -- 172.21.15.37:0/4082005373 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213036226 0 0) 0x7f00c40ca0f0 con 0x7f00c406c5f0 2023-10-06T02:23:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.289+0000 7f00c1d9b700 1 -- 172.21.15.37:0/4082005373 >> v1:172.21.15.191:6789/0 conn(0x7f00c406c5f0 legacy=0x7f00c4159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.289+0000 7f00c1d9b700 1 -- 172.21.15.37:0/4082005373 >> v1:172.21.15.37:6789/0 conn(0x7f00c4159560 legacy=0x7f00c40acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.289+0000 7f00c1d9b700 1 -- 172.21.15.37:0/4082005373 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c40ca3d0 con 0x7f00c4159930 2023-10-06T02:23:26.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.289+0000 7f00c1d9b700 1 --2- 172.21.15.37:0/4082005373 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c4159930 0x7f00c406c0b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f00b4009910 tx=0x7f00b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d54e189e9f53cd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.289+0000 7f00c159a700 1 -- 172.21.15.37:0/4082005373 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b400b820 con 0x7f00c4159930 2023-10-06T02:23:26.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.289+0000 7f00c159a700 1 -- 172.21.15.37:0/4082005373 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b400b980 con 0x7f00c4159930 2023-10-06T02:23:26.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.289+0000 7f00c159a700 1 -- 172.21.15.37:0/4082005373 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b400bd20 con 0x7f00c4159930 2023-10-06T02:23:26.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.290+0000 7f00c8c76700 1 -- 172.21.15.37:0/4082005373 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c4159930 msgr2=0x7f00c406c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.290+0000 7f00c8c76700 1 --2- 172.21.15.37:0/4082005373 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c4159930 0x7f00c406c0b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f00b4009910 tx=0x7f00b40091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.290+0000 7f00c8c76700 1 -- 172.21.15.37:0/4082005373 shutdown_connections 2023-10-06T02:23:26.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.290+0000 7f00c8c76700 1 --2- 172.21.15.37:0/4082005373 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c4159930 0x7f00c406c0b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.290+0000 7f00c8c76700 1 -- 172.21.15.37:0/4082005373 >> 172.21.15.37:0/4082005373 conn(0x7f00c406e9d0 msgr2=0x7f00c406edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.291+0000 7f00c8c76700 1 -- 172.21.15.37:0/4082005373 shutdown_connections 2023-10-06T02:23:26.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.291+0000 7f00c8c76700 1 -- 172.21.15.37:0/4082005373 wait complete. 2023-10-06T02:23:26.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.292+0000 7f00c8c76700 1 Processor -- start 2023-10-06T02:23:26.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.292+0000 7f00c8c76700 1 -- start start 2023-10-06T02:23:26.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.294+0000 7f00c8c76700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00c406c5f0 0x7f00c4150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.294+0000 7f00c8c76700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c4159560 0x7f00c4150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.294+0000 7f00c8c76700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c4159930 0x7f00c416d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.294+0000 7f00c8c76700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40cc080 con 0x7f00c4159560 2023-10-06T02:23:26.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.294+0000 7f00c8c76700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c416ab30 con 0x7f00c406c5f0 2023-10-06T02:23:26.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.294+0000 7f00c8c76700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40b1430 con 0x7f00c4159930 2023-10-06T02:23:26.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.294+0000 7f00c259c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00c406c5f0 0x7f00c4150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.294+0000 7f00c259c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00c406c5f0 0x7f00c4150040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:42740/0 (socket says 172.21.15.37:42740) 2023-10-06T02:23:26.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.294+0000 7f00c259c700 1 -- 172.21.15.37:0/3818836955 learned_addr learned my addr 172.21.15.37:0/3818836955 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.294+0000 7f00c2d9d700 1 --2- 172.21.15.37:0/3818836955 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c4159930 0x7f00c416d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.294+0000 7f00c259c700 1 -- 172.21.15.37:0/3818836955 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c4159930 msgr2=0x7f00c416d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.294+0000 7f00c259c700 1 --2- 172.21.15.37:0/3818836955 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c4159930 0x7f00c416d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.294+0000 7f00c259c700 1 -- 172.21.15.37:0/3818836955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c4159560 msgr2=0x7f00c4150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.294+0000 7f00c259c700 1 --2- 172.21.15.37:0/3818836955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c4159560 0x7f00c4150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.294+0000 7f00c259c700 1 -- 172.21.15.37:0/3818836955 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b4009420 con 0x7f00c406c5f0 2023-10-06T02:23:26.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.295+0000 7f00c259c700 1 --2- 172.21.15.37:0/3818836955 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00c406c5f0 0x7f00c4150040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f00b800b630 tx=0x7f00b80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.295+0000 7f00b27fc700 1 -- 172.21.15.37:0/3818836955 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b800f510 con 0x7f00c406c5f0 2023-10-06T02:23:26.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.295+0000 7f00b27fc700 1 -- 172.21.15.37:0/3818836955 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b800f690 con 0x7f00c406c5f0 2023-10-06T02:23:26.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.295+0000 7f00c8c76700 1 -- 172.21.15.37:0/3818836955 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c416a570 con 0x7f00c406c5f0 2023-10-06T02:23:26.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.295+0000 7f00b27fc700 1 -- 172.21.15.37:0/3818836955 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b800fa50 con 0x7f00c406c5f0 2023-10-06T02:23:26.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.295+0000 7f00c8c76700 1 -- 172.21.15.37:0/3818836955 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c40b10c0 con 0x7f00c406c5f0 2023-10-06T02:23:26.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.296+0000 7f00c8c76700 1 -- 172.21.15.37:0/3818836955 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00c40692e0 con 0x7f00c406c5f0 2023-10-06T02:23:26.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.297+0000 7f00b27fc700 1 -- 172.21.15.37:0/3818836955 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00b801a400 con 0x7f00c406c5f0 2023-10-06T02:23:26.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.297+0000 7f00b27fc700 1 --2- 172.21.15.37:0/3818836955 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f00a4066f30 0x7f00a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.297+0000 7f00b27fc700 1 -- 172.21.15.37:0/3818836955 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f00b8084150 con 0x7f00c406c5f0 2023-10-06T02:23:26.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.297+0000 7f00c1d9b700 1 --2- 172.21.15.37:0/3818836955 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f00a4066f30 0x7f00a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.297+0000 7f00b27fc700 1 --2- 172.21.15.37:0/3818836955 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x7f00a406f7e0 0x7f00a4071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.298+0000 7f00b27fc700 1 -- 172.21.15.37:0/3818836955 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00a40722a0 con 0x7f00a406f7e0 2023-10-06T02:23:26.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.298+0000 7f00b27fc700 1 -- 172.21.15.37:0/3818836955 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00b80866b0 con 0x7f00c406c5f0 2023-10-06T02:23:26.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.298+0000 7f00c2d9d700 1 --2- 172.21.15.37:0/3818836955 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x7f00a406f7e0 0x7f00a4071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.298+0000 7f00c1d9b700 1 --2- 172.21.15.37:0/3818836955 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f00a4066f30 0x7f00a40693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f00c40b2e70 tx=0x7f00b4016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.298+0000 7f00c2d9d700 1 --2- 172.21.15.37:0/3818836955 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x7f00a406f7e0 0x7f00a4071bf0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.299+0000 7f00b27fc700 1 -- 172.21.15.37:0/3818836955 <== osd.7 v2:172.21.15.191:6813/90854 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f00a40722a0 con 0x7f00a406f7e0 2023-10-06T02:23:26.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.300+0000 7f5356cb9700 1 -- 172.21.15.37:0/1779199695 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5330005c80 con 0x7f53300015f0 2023-10-06T02:23:26.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.301+0000 7f534cff9700 1 -- 172.21.15.37:0/1779199695 <== osd.2 v2:172.21.15.37:6800/90611 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5330005c80 con 0x7f53300015f0 2023-10-06T02:23:26.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.301+0000 7f5356cb9700 1 -- 172.21.15.37:0/1779199695 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x7f53300015f0 msgr2=0x7f5330003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.301+0000 7f5356cb9700 1 --2- 172.21.15.37:0/1779199695 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x7f53300015f0 0x7f5330003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.301+0000 7f08f53a5700 1 -- 172.21.15.37:0/2930740431 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f08f00692e0 con 0x7f08dc06f860 2023-10-06T02:23:26.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.301+0000 7f5356cb9700 1 -- 172.21.15.37:0/1779199695 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f533c066f30 msgr2=0x7f533c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.301+0000 7f5356cb9700 1 --2- 172.21.15.37:0/1779199695 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f533c066f30 0x7f533c0693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f53480099f0 tx=0x7f5348019000 comp rx=0 tx=0).stop 2023-10-06T02:23:26.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.301+0000 7f5356cb9700 1 -- 172.21.15.37:0/1779199695 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f535006d410 msgr2=0x7f53500c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.301+0000 7f5356cb9700 1 --2- 172.21.15.37:0/1779199695 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f535006d410 0x7f53500c73f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f534000c4f0 tx=0x7f5340007f50 comp rx=0 tx=0).stop 2023-10-06T02:23:26.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.301+0000 7f5355256700 1 -- 172.21.15.37:0/1779199695 reap_dead start 2023-10-06T02:23:26.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.302+0000 7f89a30a4700 1 -- 172.21.15.37:0/3916730105 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f899c15f2d0 con 0x7f898806f860 2023-10-06T02:23:26.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.302+0000 7f08d6ffd700 1 -- 172.21.15.37:0/2930740431 <== osd.6 v2:172.21.15.191:6824/90897 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f08f00692e0 con 0x7f08dc06f860 2023-10-06T02:23:26.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.302+0000 7f8998ff9700 1 -- 172.21.15.37:0/3916730105 <== osd.3 v2:172.21.15.37:6817/90628 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f899c15f2d0 con 0x7f898806f860 2023-10-06T02:23:26.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.302+0000 7f89a30a4700 1 -- 172.21.15.37:0/3916730105 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x7f898806f860 msgr2=0x7f8988071c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.303+0000 7f89a30a4700 1 --2- 172.21.15.37:0/3916730105 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x7f898806f860 0x7f8988071c70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.302+0000 7f08f53a5700 1 -- 172.21.15.37:0/2930740431 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x7f08dc06f860 msgr2=0x7f08dc071c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.303+0000 7f08f53a5700 1 --2- 172.21.15.37:0/2930740431 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x7f08dc06f860 0x7f08dc071c70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.303+0000 7f89a30a4700 1 -- 172.21.15.37:0/3916730105 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8988066fb0 msgr2=0x7f8988069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.303+0000 7f89a30a4700 1 --2- 172.21.15.37:0/3916730105 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8988066fb0 0x7f8988069460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8990006fd0 tx=0x7f8990006db0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.303+0000 7f89a30a4700 1 -- 172.21.15.37:0/3916730105 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f899c162230 msgr2=0x7f899c16f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.303+0000 7f89a30a4700 1 --2- 172.21.15.37:0/3916730105 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f899c162230 0x7f899c16f510 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8994014000 tx=0x7f8994017000 comp rx=0 tx=0).stop 2023-10-06T02:23:26.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.303+0000 7f89a1641700 1 -- 172.21.15.37:0/3916730105 reap_dead start 2023-10-06T02:23:26.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.303+0000 7f89a30a4700 1 -- 172.21.15.37:0/3916730105 shutdown_connections 2023-10-06T02:23:26.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.303+0000 7f08f53a5700 1 -- 172.21.15.37:0/2930740431 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f08dc066fb0 msgr2=0x7f08dc069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.303+0000 7f08f53a5700 1 --2- 172.21.15.37:0/2930740431 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f08dc066fb0 0x7f08dc069460 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f08f014cf20 tx=0x7f08e4008040 comp rx=0 tx=0).stop 2023-10-06T02:23:26.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.303+0000 7f08f53a5700 1 -- 172.21.15.37:0/2930740431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08f006c5f0 msgr2=0x7f08f00a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.303+0000 7f08f53a5700 1 --2- 172.21.15.37:0/2930740431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f08f006c5f0 0x7f08f00a6fb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f08f00ca230 tx=0x7f08e8018000 comp rx=0 tx=0).stop 2023-10-06T02:23:26.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.303+0000 7f08ef7fe700 1 -- 172.21.15.37:0/2930740431 reap_dead start 2023-10-06T02:23:26.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.303+0000 7f89a30a4700 1 -- 172.21.15.37:0/3916730105 >> 172.21.15.37:0/3916730105 conn(0x7f899c0ccf30 msgr2=0x7f899c160080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.303+0000 7f08f53a5700 1 -- 172.21.15.37:0/2930740431 shutdown_connections 2023-10-06T02:23:26.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.303+0000 7f08f53a5700 1 -- 172.21.15.37:0/2930740431 >> 172.21.15.37:0/2930740431 conn(0x7f08f006e9d0 msgr2=0x7f08f014f600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.304+0000 7f5356cb9700 1 -- 172.21.15.37:0/1779199695 shutdown_connections 2023-10-06T02:23:26.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.304+0000 7f5356cb9700 1 -- 172.21.15.37:0/1779199695 >> 172.21.15.37:0/1779199695 conn(0x7f5350067b30 msgr2=0x7f535015e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.304+0000 7f89a30a4700 1 -- 172.21.15.37:0/3916730105 shutdown_connections 2023-10-06T02:23:26.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.304+0000 7f5356cb9700 1 -- 172.21.15.37:0/1779199695 shutdown_connections 2023-10-06T02:23:26.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.304+0000 7f89a30a4700 1 -- 172.21.15.37:0/3916730105 wait complete. 2023-10-06T02:23:26.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.307+0000 7f409b597700 1 -- 172.21.15.37:0/3722409566 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f409404bb80 con 0x7f409415bcd0 2023-10-06T02:23:26.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.307+0000 7f40897fa700 1 -- 172.21.15.37:0/3722409566 <== osd.0 v2:172.21.15.37:6816/90621 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f409404bb80 con 0x7f409415bcd0 2023-10-06T02:23:26.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.308+0000 7f409b597700 1 -- 172.21.15.37:0/3722409566 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x7f409415bcd0 msgr2=0x7f40940c1710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.308+0000 7f409b597700 1 --2- 172.21.15.37:0/3722409566 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x7f409415bcd0 0x7f40940c1710 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.308+0000 7f409b597700 1 -- 172.21.15.37:0/3722409566 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4078066f30 msgr2=0x7f40780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.308+0000 7f409b597700 1 --2- 172.21.15.37:0/3722409566 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4078066f30 0x7f40780693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f40900030c0 tx=0x7f4090016000 comp rx=0 tx=0).stop 2023-10-06T02:23:26.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.308+0000 7f409b597700 1 -- 172.21.15.37:0/3722409566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40940caa80 msgr2=0x7f409416de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.308+0000 7f409b597700 1 --2- 172.21.15.37:0/3722409566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40940caa80 0x7f409416de40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f408400c5d0 tx=0x7f4084007f60 comp rx=0 tx=0).stop 2023-10-06T02:23:26.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.308+0000 7f4099b34700 1 -- 172.21.15.37:0/3722409566 reap_dead start 2023-10-06T02:23:26.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.308+0000 7f409b597700 1 -- 172.21.15.37:0/3722409566 shutdown_connections 2023-10-06T02:23:26.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.308+0000 7f409b597700 1 -- 172.21.15.37:0/3722409566 >> 172.21.15.37:0/3722409566 conn(0x7f40940cc970 msgr2=0x7f409406c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.308+0000 7f409b597700 1 -- 172.21.15.37:0/3722409566 shutdown_connections 2023-10-06T02:23:26.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.308+0000 7f409b597700 1 -- 172.21.15.37:0/3722409566 wait complete. 2023-10-06T02:23:26.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.310+0000 7f08f53a5700 1 -- 172.21.15.37:0/2930740431 shutdown_connections 2023-10-06T02:23:26.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.314+0000 7fdd595e9700 1 -- 172.21.15.37:0/567332628 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdd38002d30 con 0x7fdd3406f8b0 2023-10-06T02:23:26.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.307+0000 7f5356cb9700 1 -- 172.21.15.37:0/1779199695 wait complete. 2023-10-06T02:23:26.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.314+0000 7f08f53a5700 1 -- 172.21.15.37:0/2930740431 wait complete. 2023-10-06T02:23:26.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.317+0000 7fdd4b7fe700 1 -- 172.21.15.37:0/567332628 <== osd.4 v2:172.21.15.191:6800/90852 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdd38002d30 con 0x7fdd3406f8b0 2023-10-06T02:23:26.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.317+0000 7f60dc21f700 1 -- 172.21.15.37:0/2640477262 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f60d404bb80 con 0x7f60d40c5290 2023-10-06T02:23:26.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.317+0000 7f60c9ffb700 1 -- 172.21.15.37:0/2640477262 <== osd.5 v2:172.21.15.191:6808/90853 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f60d404bb80 con 0x7f60d40c5290 2023-10-06T02:23:26.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.322+0000 7fdd595e9700 1 -- 172.21.15.37:0/567332628 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x7fdd3406f8b0 msgr2=0x7fdd34071cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.322+0000 7fdd595e9700 1 --2- 172.21.15.37:0/567332628 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x7fdd3406f8b0 0x7fdd34071cc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.322+0000 7fdd595e9700 1 -- 172.21.15.37:0/567332628 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdd34067080 msgr2=0x7fdd34069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.322+0000 7fdd595e9700 1 --2- 172.21.15.37:0/567332628 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdd34067080 0x7fdd34069530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdd44007580 tx=0x7fdd44009780 comp rx=0 tx=0).stop 2023-10-06T02:23:26.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.322+0000 7fdd595e9700 1 -- 172.21.15.37:0/567332628 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd541558e0 msgr2=0x7fdd540adca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.322+0000 7fdd595e9700 1 --2- 172.21.15.37:0/567332628 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd541558e0 0x7fdd540adca0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c018000 tx=0x7fdd4c019000 comp rx=0 tx=0).stop 2023-10-06T02:23:26.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.322+0000 7fdd537fe700 1 -- 172.21.15.37:0/567332628 reap_dead start 2023-10-06T02:23:26.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.322+0000 7fdd595e9700 1 -- 172.21.15.37:0/567332628 shutdown_connections 2023-10-06T02:23:26.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.322+0000 7fdd595e9700 1 -- 172.21.15.37:0/567332628 >> 172.21.15.37:0/567332628 conn(0x7fdd540cc970 msgr2=0x7fdd54151e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.360 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-10-06T02:23:26.360 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T02:23:26.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.323+0000 7fdd595e9700 1 -- 172.21.15.37:0/567332628 shutdown_connections 2023-10-06T02:23:26.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.323+0000 7fdd595e9700 1 -- 172.21.15.37:0/567332628 wait complete. 2023-10-06T02:23:26.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.327+0000 7f00c8c76700 1 -- 172.21.15.37:0/3818836955 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f00c404bb80 con 0x7f00a406f7e0 2023-10-06T02:23:26.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.328+0000 7f00b27fc700 1 -- 172.21.15.37:0/3818836955 <== osd.7 v2:172.21.15.191:6813/90854 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f00c404bb80 con 0x7f00a406f7e0 2023-10-06T02:23:26.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.328+0000 7f00c8c76700 1 -- 172.21.15.37:0/3818836955 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x7f00a406f7e0 msgr2=0x7f00a4071bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.328+0000 7f00c8c76700 1 --2- 172.21.15.37:0/3818836955 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x7f00a406f7e0 0x7f00a4071bf0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.328+0000 7f00c8c76700 1 -- 172.21.15.37:0/3818836955 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f00a4066f30 msgr2=0x7f00a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.328+0000 7f00c8c76700 1 --2- 172.21.15.37:0/3818836955 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f00a4066f30 0x7f00a40693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f00c40b2e70 tx=0x7f00b4016000 comp rx=0 tx=0).stop 2023-10-06T02:23:26.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.328+0000 7f00c8c76700 1 -- 172.21.15.37:0/3818836955 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00c406c5f0 msgr2=0x7f00c4150040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.328+0000 7f00c8c76700 1 --2- 172.21.15.37:0/3818836955 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00c406c5f0 0x7f00c4150040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f00b800b630 tx=0x7f00b80091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.363 INFO:teuthology.orchestra.run.smithi037.stdout:55834574857 2023-10-06T02:23:26.363 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T02:23:26.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.328+0000 7f00c2d9d700 1 -- 172.21.15.37:0/3818836955 reap_dead start 2023-10-06T02:23:26.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.328+0000 7f00c8c76700 1 -- 172.21.15.37:0/3818836955 shutdown_connections 2023-10-06T02:23:26.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.328+0000 7f00c8c76700 1 -- 172.21.15.37:0/3818836955 >> 172.21.15.37:0/3818836955 conn(0x7f00c406e9d0 msgr2=0x7f00c40a79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.329+0000 7f00c8c76700 1 -- 172.21.15.37:0/3818836955 shutdown_connections 2023-10-06T02:23:26.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.329+0000 7f60dc21f700 1 -- 172.21.15.37:0/2640477262 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x7f60d40c5290 msgr2=0x7f60d40c5660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.329+0000 7f60dc21f700 1 --2- 172.21.15.37:0/2640477262 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x7f60d40c5290 0x7f60d40c5660 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.329+0000 7f00c8c76700 1 -- 172.21.15.37:0/3818836955 wait complete. 2023-10-06T02:23:26.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.329+0000 7f60dc21f700 1 -- 172.21.15.37:0/2640477262 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f60b8067080 msgr2=0x7f60b8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.329+0000 7f60dc21f700 1 --2- 172.21.15.37:0/2640477262 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f60b8067080 0x7f60b8069530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0097c0 tx=0x7f60cc019000 comp rx=0 tx=0).stop 2023-10-06T02:23:26.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.329+0000 7f60dc21f700 1 -- 172.21.15.37:0/2640477262 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60d4159870 msgr2=0x7f60d40c4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.329+0000 7f60dc21f700 1 --2- 172.21.15.37:0/2640477262 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60d4159870 0x7f60d40c4d50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f60c400d890 tx=0x7f60c4008040 comp rx=0 tx=0).stop 2023-10-06T02:23:26.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.330+0000 7f9e4ef5a700 1 -- 172.21.15.37:0/1484049364 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9e480aeab0 con 0x7f9e2c06f880 2023-10-06T02:23:26.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.331+0000 7f9e44ff9700 1 -- 172.21.15.37:0/1484049364 <== osd.1 v2:172.21.15.37:6808/90617 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9e480aeab0 con 0x7f9e2c06f880 2023-10-06T02:23:26.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.331+0000 7f9e4ef5a700 1 -- 172.21.15.37:0/1484049364 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x7f9e2c06f880 msgr2=0x7f9e2c071c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.331+0000 7f9e4ef5a700 1 --2- 172.21.15.37:0/1484049364 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x7f9e2c06f880 0x7f9e2c071c90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.331+0000 7f9e4ef5a700 1 -- 172.21.15.37:0/1484049364 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9e2c067050 msgr2=0x7f9e2c069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.331+0000 7f9e4ef5a700 1 --2- 172.21.15.37:0/1484049364 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9e2c067050 0x7f9e2c069500 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9e34003080 tx=0x7f9e34016000 comp rx=0 tx=0).stop 2023-10-06T02:23:26.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.331+0000 7f9e4ef5a700 1 -- 172.21.15.37:0/1484049364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e480c6e90 msgr2=0x7f9e48158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.331+0000 7f9e4ef5a700 1 --2- 172.21.15.37:0/1484049364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e480c6e90 0x7f9e48158c80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00b5b0 tx=0x7f9e3c0090f0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.332+0000 7f9e4d4f7700 1 -- 172.21.15.37:0/1484049364 reap_dead start 2023-10-06T02:23:26.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.332+0000 7f9e4ef5a700 1 -- 172.21.15.37:0/1484049364 shutdown_connections 2023-10-06T02:23:26.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.332+0000 7f9e4ef5a700 1 -- 172.21.15.37:0/1484049364 >> 172.21.15.37:0/1484049364 conn(0x7f9e480cc140 msgr2=0x7f9e480c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.332+0000 7f9e4ef5a700 1 -- 172.21.15.37:0/1484049364 shutdown_connections 2023-10-06T02:23:26.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.332+0000 7f9e4ef5a700 1 -- 172.21.15.37:0/1484049364 wait complete. 2023-10-06T02:23:26.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.333+0000 7f60da7bc700 1 -- 172.21.15.37:0/2640477262 reap_dead start 2023-10-06T02:23:26.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.335+0000 7f60dc21f700 1 -- 172.21.15.37:0/2640477262 shutdown_connections 2023-10-06T02:23:26.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.335+0000 7f60dc21f700 1 -- 172.21.15.37:0/2640477262 >> 172.21.15.37:0/2640477262 conn(0x7f60d40cc140 msgr2=0x7f60d40ca040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.335+0000 7f60dc21f700 1 -- 172.21.15.37:0/2640477262 shutdown_connections 2023-10-06T02:23:26.370 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-10-06T02:23:26.370 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T02:23:26.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.336+0000 7f60dc21f700 1 -- 172.21.15.37:0/2640477262 wait complete. 2023-10-06T02:23:26.371 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-10-06T02:23:26.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T02:23:26.372 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-10-06T02:23:26.372 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T02:23:26.373 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-10-06T02:23:26.373 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T02:23:26.374 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-10-06T02:23:26.374 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T02:23:26.375 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-10-06T02:23:26.376 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T02:23:26.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.609+0000 7f04e36e8700 1 Processor -- start 2023-10-06T02:23:26.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.609+0000 7f04e36e8700 1 -- start start 2023-10-06T02:23:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.610+0000 7f04e36e8700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f04dc0cd400 0x7f04dc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.610+0000 7f04e36e8700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04dc156580 0x7f04dc0ad340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.610+0000 7f04e36e8700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04dc0ace90 con 0x7f04dc0cd7d0 2023-10-06T02:23:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.610+0000 7f04e36e8700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04dc0b30c0 con 0x7f04dc156580 2023-10-06T02:23:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.610+0000 7f04e36e8700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04dc06b1e0 con 0x7f04dc0cd400 2023-10-06T02:23:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.610+0000 7f04e1484700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f04dc0cd400 0x7f04dc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.610+0000 7f04e0c83700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f04dc0cd7d0 0x7f04dc155e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:57756/0 (socket says 172.21.15.37:57756) 2023-10-06T02:23:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.610+0000 7f04e0c83700 1 -- 172.21.15.37:0/3115033858 learned_addr learned my addr 172.21.15.37:0/3115033858 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.610+0000 7f04e1484700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f04dc0cd400 0x7f04dc06a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:42756/0 (socket says 172.21.15.37:42756) 2023-10-06T02:23:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.611+0000 7f04e1484700 1 -- 172.21.15.37:0/3115033858 >> v2:172.21.15.37:3300/0 conn(0x7f04dc156580 msgr2=0x7f04dc0ad340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.611+0000 7f04e1484700 1 --2- 172.21.15.37:0/3115033858 >> v2:172.21.15.37:3300/0 conn(0x7f04dc156580 0x7f04dc0ad340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.611+0000 7f04e1484700 1 -- 172.21.15.37:0/3115033858 >> v1:172.21.15.191:6789/0 conn(0x7f04dc0cd7d0 legacy=0x7f04dc155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.611+0000 7f04e1484700 1 -- 172.21.15.37:0/3115033858 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc06b4c0 con 0x7f04dc0cd400 2023-10-06T02:23:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.611+0000 7f04e1484700 1 --2- 172.21.15.37:0/3115033858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04dc0cd400 0x7f04dc06a870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f04dc06f9d0 tx=0x7f04d800b430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7aa196f2a2f5c147 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.612+0000 7f04d3fff700 1 -- 172.21.15.37:0/3115033858 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d800dc00 con 0x7f04dc0cd400 2023-10-06T02:23:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.612+0000 7f04d3fff700 1 -- 172.21.15.37:0/3115033858 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d800dd60 con 0x7f04dc0cd400 2023-10-06T02:23:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.612+0000 7f04d3fff700 1 -- 172.21.15.37:0/3115033858 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d80196b0 con 0x7f04dc0cd400 2023-10-06T02:23:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.613+0000 7fb0d5dce700 1 Processor -- start 2023-10-06T02:23:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.613+0000 7fb0d5dce700 1 -- start start 2023-10-06T02:23:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.613+0000 7f04e36e8700 1 -- 172.21.15.37:0/3115033858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04dc0cd400 msgr2=0x7f04dc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.613+0000 7f04e36e8700 1 --2- 172.21.15.37:0/3115033858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04dc0cd400 0x7f04dc06a870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f04dc06f9d0 tx=0x7f04d800b430 comp rx=0 tx=0).stop 2023-10-06T02:23:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.613+0000 7f04e36e8700 1 -- 172.21.15.37:0/3115033858 shutdown_connections 2023-10-06T02:23:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.613+0000 7f04e36e8700 1 --2- 172.21.15.37:0/3115033858 >> v2:172.21.15.37:3300/0 conn(0x7f04dc156580 0x7f04dc0ad340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.613+0000 7f04e36e8700 1 --2- 172.21.15.37:0/3115033858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04dc0cd400 0x7f04dc06a870 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.613+0000 7f04e36e8700 1 -- 172.21.15.37:0/3115033858 >> 172.21.15.37:0/3115033858 conn(0x7f04dc06e9d0 msgr2=0x7f04dc06edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.614+0000 7f04e36e8700 1 -- 172.21.15.37:0/3115033858 shutdown_connections 2023-10-06T02:23:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.614+0000 7f04e36e8700 1 -- 172.21.15.37:0/3115033858 wait complete. 2023-10-06T02:23:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.614+0000 7fb0d5dce700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0d0159330 0x7fb0d006e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.614+0000 7fb0d5dce700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb0d00ca540 0x7fb0d00ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.614+0000 7fb0d5dce700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d00caee0 con 0x7fb0d0159700 2023-10-06T02:23:26.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.614+0000 7fb0d5dce700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d006e7a0 con 0x7fb0d00ca540 2023-10-06T02:23:26.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.614+0000 7fb0d5dce700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d006ea80 con 0x7fb0d0159330 2023-10-06T02:23:26.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.614+0000 7f4eafc70700 1 Processor -- start 2023-10-06T02:23:26.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.615+0000 7fb0cffff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb0d00ca540 0x7fb0d00ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.615+0000 7fb0cf7fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0d0159330 0x7fb0d006e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.615+0000 7fb0cffff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb0d00ca540 0x7fb0d00ca9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:42768/0 (socket says 172.21.15.37:42768) 2023-10-06T02:23:26.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.615+0000 7fb0cf7fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0d0159330 0x7fb0d006e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:55336/0 (socket says 172.21.15.37:55336) 2023-10-06T02:23:26.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.615+0000 7fb0cffff700 1 -- 172.21.15.37:0/2377765637 learned_addr learned my addr 172.21.15.37:0/2377765637 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.615+0000 7fb0cf7fe700 1 -- 172.21.15.37:0/2377765637 >> v2:172.21.15.191:3300/0 conn(0x7fb0d00ca540 msgr2=0x7fb0d00ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:26.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.615+0000 7fb0cf7fe700 1 --2- 172.21.15.37:0/2377765637 >> v2:172.21.15.191:3300/0 conn(0x7fb0d00ca540 0x7fb0d00ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.615+0000 7fb0cf7fe700 1 -- 172.21.15.37:0/2377765637 >> v1:172.21.15.191:6789/0 conn(0x7fb0d0159700 legacy=0x7fb0d006a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:26.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.615+0000 7fb0cf7fe700 1 -- 172.21.15.37:0/2377765637 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d006ed60 con 0x7fb0d0159330 2023-10-06T02:23:26.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.615+0000 7f04e36e8700 1 Processor -- start 2023-10-06T02:23:26.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.615+0000 7fb0cf7fe700 1 --2- 172.21.15.37:0/2377765637 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0d0159330 0x7fb0d006e1c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009e60 tx=0x7fb0c8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b915b3469b05b0eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.615+0000 7f4eafc70700 1 -- start start 2023-10-06T02:23:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f4eafc70700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4ea815dd40 0x7f4ea80b2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f4eafc70700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ea8162230 0x7f4ea80cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f4eafc70700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea815f2d0 con 0x7f4ea80b2890 2023-10-06T02:23:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f4eafc70700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea8162670 con 0x7f4ea815dd40 2023-10-06T02:23:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f4eafc70700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea815ee40 con 0x7f4ea8162230 2023-10-06T02:23:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f4eada0c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4ea815dd40 0x7f4ea80b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f4eae20d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ea8162230 0x7f4ea80cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f4eada0c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4ea815dd40 0x7f4ea80b2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:42784/0 (socket says 172.21.15.37:42784) 2023-10-06T02:23:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f4eada0c700 1 -- 172.21.15.37:0/3452398364 learned_addr learned my addr 172.21.15.37:0/3452398364 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.615+0000 7f04e36e8700 1 -- start start 2023-10-06T02:23:26.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f9ade734700 1 Processor -- start 2023-10-06T02:23:26.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f04e36e8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04dc0cd400 0x7f04dc152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f04e36e8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04dc0cd7d0 0x7f04dc0cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f4eae20d700 1 -- 172.21.15.37:0/3452398364 >> v2:172.21.15.191:3300/0 conn(0x7f4ea815dd40 msgr2=0x7f4ea80b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:26.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f4eae20d700 1 --2- 172.21.15.37:0/3452398364 >> v2:172.21.15.191:3300/0 conn(0x7f4ea815dd40 0x7f4ea80b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f4eae20d700 1 -- 172.21.15.37:0/3452398364 >> v1:172.21.15.37:6789/0 conn(0x7f4ea80b2890 legacy=0x7f4ea8161b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:26.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f4eae20d700 1 -- 172.21.15.37:0/3452398364 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea80cbf00 con 0x7f4ea8162230 2023-10-06T02:23:26.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f04e36e8700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04dc156580 0x7f04dc0cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f04e36e8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc157f80 con 0x7f04dc0cd400 2023-10-06T02:23:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f04e36e8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc09a420 con 0x7f04dc0cd7d0 2023-10-06T02:23:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f04e36e8700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc09a700 con 0x7f04dc156580 2023-10-06T02:23:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.617+0000 7f04e0c83700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04dc0cd7d0 0x7f04dc0cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.617+0000 7f04e0c83700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04dc0cd7d0 0x7f04dc0cbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:42790/0 (socket says 172.21.15.37:42790) 2023-10-06T02:23:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.617+0000 7f04e0c83700 1 -- 172.21.15.37:0/1359980197 learned_addr learned my addr 172.21.15.37:0/1359980197 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.617+0000 7f4eae20d700 1 --2- 172.21.15.37:0/3452398364 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ea8162230 0x7f4ea80cadf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0009e60 tx=0x7f4ea0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5467df248d378b3a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.617+0000 7f04e1c85700 1 --2- 172.21.15.37:0/1359980197 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04dc156580 0x7f04dc0cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.617+0000 7f04e1484700 1 --2- 172.21.15.37:0/1359980197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04dc0cd400 0x7f04dc152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.616+0000 7f9ade734700 1 -- start start 2023-10-06T02:23:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.617+0000 7f04e1c85700 1 -- 172.21.15.37:0/1359980197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04dc0cd7d0 msgr2=0x7f04dc0cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.617+0000 7f04e1c85700 1 --2- 172.21.15.37:0/1359980197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04dc0cd7d0 0x7f04dc0cbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.617+0000 7f04e1c85700 1 -- 172.21.15.37:0/1359980197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04dc0cd400 msgr2=0x7f04dc152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.617+0000 7f04e1c85700 1 --2- 172.21.15.37:0/1359980197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04dc0cd400 0x7f04dc152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.617+0000 7f04e1c85700 1 -- 172.21.15.37:0/1359980197 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d800b6d0 con 0x7f04dc156580 2023-10-06T02:23:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.617+0000 7f04e0c83700 1 --2- 172.21.15.37:0/1359980197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04dc0cd7d0 0x7f04dc0cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.617+0000 7f04e1c85700 1 --2- 172.21.15.37:0/1359980197 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04dc156580 0x7f04dc0cc070 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f04d400bad0 tx=0x7f04d4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.617+0000 7fa093ca7700 1 Processor -- start 2023-10-06T02:23:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.617+0000 7fa093ca7700 1 -- start start 2023-10-06T02:23:26.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.618+0000 7f9ade734700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ad8155aa0 0x7f9ad80c7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.618+0000 7f9ade734700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9ad8159870 0x7f9ad8159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.618+0000 7f9ade734700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad80c2fc0 con 0x7f9ad8155e70 2023-10-06T02:23:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.618+0000 7f9ade734700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad815a230 con 0x7f9ad8159870 2023-10-06T02:23:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.618+0000 7f9ade734700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80c1810 con 0x7f9ad8155aa0 2023-10-06T02:23:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.618+0000 7f9ad7fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ad8155aa0 0x7f9ad80c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.618+0000 7f9ad77fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9ad8155e70 0x7f9ad80c28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34422/0 (socket says 172.21.15.37:34422) 2023-10-06T02:23:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.618+0000 7f9ad77fe700 1 -- 172.21.15.37:0/803181725 learned_addr learned my addr 172.21.15.37:0/803181725 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.618+0000 7f9adccd1700 1 --2- 172.21.15.37:0/803181725 >> v2:172.21.15.191:3300/0 conn(0x7f9ad8159870 0x7f9ad8159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.618+0000 7f9ad7fff700 1 -- 172.21.15.37:0/803181725 >> v2:172.21.15.191:3300/0 conn(0x7f9ad8159870 msgr2=0x7f9ad8159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.618+0000 7f9ad7fff700 1 --2- 172.21.15.37:0/803181725 >> v2:172.21.15.191:3300/0 conn(0x7f9ad8159870 0x7f9ad8159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.618+0000 7f9ad7fff700 1 -- 172.21.15.37:0/803181725 >> v1:172.21.15.37:6789/0 conn(0x7f9ad8155e70 legacy=0x7f9ad80c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.618+0000 7f9ad7fff700 1 -- 172.21.15.37:0/803181725 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad80c1af0 con 0x7f9ad8155aa0 2023-10-06T02:23:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.618+0000 7fa093ca7700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa08c06c7c0 0x7fa08c0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.618+0000 7fa093ca7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa08c15dcb0 0x7fa08c0cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.618+0000 7fa093ca7700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa08c0ca7d0 con 0x7fa08c15d8e0 2023-10-06T02:23:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.618+0000 7fa093ca7700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08c0c9f70 con 0x7fa08c15dcb0 2023-10-06T02:23:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.618+0000 7fa093ca7700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08c0cdc30 con 0x7fa08c06c7c0 2023-10-06T02:23:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7fa091a43700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa08c15d8e0 0x7fa08c06c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34436/0 (socket says 172.21.15.37:34436) 2023-10-06T02:23:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7fa091a43700 1 -- 172.21.15.37:0/425319776 learned_addr learned my addr 172.21.15.37:0/425319776 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7fa092244700 1 --2- 172.21.15.37:0/425319776 >> v2:172.21.15.37:3300/0 conn(0x7fa08c15dcb0 0x7fa08c0cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7fa091242700 1 --2- 172.21.15.37:0/425319776 >> v2:172.21.15.191:3300/0 conn(0x7fa08c06c7c0 0x7fa08c0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7f9ad7fff700 1 --2- 172.21.15.37:0/803181725 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ad8155aa0 0x7f9ad80c7090 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800aa90 tx=0x7f9ac800a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=887150666ce808a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7fa090a41700 1 -- 172.21.15.37:0/425319776 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250329109 0 0) 0x7fa08c0ca7d0 con 0x7fa08c15d8e0 2023-10-06T02:23:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7fa090a41700 1 -- 172.21.15.37:0/425319776 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa078003570 con 0x7fa08c15d8e0 2023-10-06T02:23:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7fa091242700 1 -- 172.21.15.37:0/425319776 >> v2:172.21.15.37:3300/0 conn(0x7fa08c15dcb0 msgr2=0x7fa08c0cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7fa091242700 1 --2- 172.21.15.37:0/425319776 >> v2:172.21.15.37:3300/0 conn(0x7fa08c15dcb0 0x7fa08c0cd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7fa091242700 1 -- 172.21.15.37:0/425319776 >> v1:172.21.15.37:6789/0 conn(0x7fa08c15d8e0 legacy=0x7fa08c06c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7fa091242700 1 -- 172.21.15.37:0/425319776 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c0af7f0 con 0x7fa08c06c7c0 2023-10-06T02:23:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7f4eaca0a700 1 -- 172.21.15.37:0/3452398364 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea000e070 con 0x7f4ea8162230 2023-10-06T02:23:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7fa091242700 1 --2- 172.21.15.37:0/425319776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa08c06c7c0 0x7fa08c0cd1b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa08c06a110 tx=0x7fa07c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6f4778b1bda0bbf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7f9ad6ffd700 1 -- 172.21.15.37:0/803181725 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac800c970 con 0x7f9ad8155aa0 2023-10-06T02:23:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7fb0ce7fc700 1 -- 172.21.15.37:0/2377765637 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c800e070 con 0x7fb0d0159330 2023-10-06T02:23:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7fb0ce7fc700 1 -- 172.21.15.37:0/2377765637 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c800bb20 con 0x7fb0d0159330 2023-10-06T02:23:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7fb0ce7fc700 1 -- 172.21.15.37:0/2377765637 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8012430 con 0x7fb0d0159330 2023-10-06T02:23:26.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7f9ad6ffd700 1 -- 172.21.15.37:0/803181725 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac800cad0 con 0x7f9ad8155aa0 2023-10-06T02:23:26.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7f9ad6ffd700 1 -- 172.21.15.37:0/803181725 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac800ce70 con 0x7f9ad8155aa0 2023-10-06T02:23:26.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.620+0000 7f9ade734700 1 -- 172.21.15.37:0/803181725 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ad8155aa0 msgr2=0x7f9ad80c7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.620+0000 7f9ade734700 1 --2- 172.21.15.37:0/803181725 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ad8155aa0 0x7f9ad80c7090 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800aa90 tx=0x7f9ac800a330 comp rx=0 tx=0).stop 2023-10-06T02:23:26.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7f4eaca0a700 1 -- 172.21.15.37:0/3452398364 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea000bbf0 con 0x7f4ea8162230 2023-10-06T02:23:26.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7f4eaca0a700 1 -- 172.21.15.37:0/3452398364 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0012430 con 0x7f4ea8162230 2023-10-06T02:23:26.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.620+0000 7f4eafc70700 1 -- 172.21.15.37:0/3452398364 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ea8162230 msgr2=0x7f4ea80cadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.620+0000 7f4eafc70700 1 --2- 172.21.15.37:0/3452398364 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ea8162230 0x7f4ea80cadf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0009e60 tx=0x7f4ea0009780 comp rx=0 tx=0).stop 2023-10-06T02:23:26.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7fa090a41700 1 -- 172.21.15.37:0/425319776 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c011630 con 0x7fa08c06c7c0 2023-10-06T02:23:26.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.620+0000 7fa090a41700 1 -- 172.21.15.37:0/425319776 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c0117b0 con 0x7fa08c06c7c0 2023-10-06T02:23:26.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.620+0000 7fa090a41700 1 -- 172.21.15.37:0/425319776 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c011b70 con 0x7fa08c06c7c0 2023-10-06T02:23:26.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.620+0000 7fa093ca7700 1 -- 172.21.15.37:0/425319776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa08c06c7c0 msgr2=0x7fa08c0cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.620+0000 7fa093ca7700 1 --2- 172.21.15.37:0/425319776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa08c06c7c0 0x7fa08c0cd1b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa08c06a110 tx=0x7fa07c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.619+0000 7f04d17fa700 1 -- 172.21.15.37:0/1359980197 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d400c760 con 0x7f04dc156580 2023-10-06T02:23:26.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.620+0000 7f04e36e8700 1 -- 172.21.15.37:0/1359980197 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04dc09a9e0 con 0x7f04dc156580 2023-10-06T02:23:26.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.620+0000 7fb0d5dce700 1 -- 172.21.15.37:0/2377765637 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0d0159330 msgr2=0x7fb0d006e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.620+0000 7fb0d5dce700 1 --2- 172.21.15.37:0/2377765637 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0d0159330 0x7fb0d006e1c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009e60 tx=0x7fb0c8009780 comp rx=0 tx=0).stop 2023-10-06T02:23:26.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.620+0000 7f04e36e8700 1 -- 172.21.15.37:0/1359980197 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc153000 con 0x7f04dc156580 2023-10-06T02:23:26.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.620+0000 7f04d17fa700 1 -- 172.21.15.37:0/1359980197 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d400c8c0 con 0x7f04dc156580 2023-10-06T02:23:26.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.620+0000 7f04d17fa700 1 -- 172.21.15.37:0/1359980197 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d400cc80 con 0x7f04dc156580 2023-10-06T02:23:26.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.621+0000 7fa093ca7700 1 -- 172.21.15.37:0/425319776 shutdown_connections 2023-10-06T02:23:26.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.621+0000 7fa093ca7700 1 --2- 172.21.15.37:0/425319776 >> v2:172.21.15.37:3300/0 conn(0x7fa08c15dcb0 0x7fa08c0cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.621+0000 7fa093ca7700 1 --2- 172.21.15.37:0/425319776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa08c06c7c0 0x7fa08c0cd1b0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa08c06a110 tx=0x7fa07c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.621+0000 7fa093ca7700 1 -- 172.21.15.37:0/425319776 >> 172.21.15.37:0/425319776 conn(0x7fa08c06e9d0 msgr2=0x7fa08c06edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.621+0000 7fb0d5dce700 1 -- 172.21.15.37:0/2377765637 shutdown_connections 2023-10-06T02:23:26.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.621+0000 7fb0d5dce700 1 --2- 172.21.15.37:0/2377765637 >> v2:172.21.15.191:3300/0 conn(0x7fb0d00ca540 0x7fb0d00ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.621+0000 7fb0d5dce700 1 --2- 172.21.15.37:0/2377765637 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0d0159330 0x7fb0d006e1c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.621+0000 7fb0d5dce700 1 -- 172.21.15.37:0/2377765637 >> 172.21.15.37:0/2377765637 conn(0x7fb0d00cc970 msgr2=0x7fb0d00ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.621+0000 7fb0d5dce700 1 -- 172.21.15.37:0/2377765637 shutdown_connections 2023-10-06T02:23:26.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.621+0000 7f4eafc70700 1 -- 172.21.15.37:0/3452398364 shutdown_connections 2023-10-06T02:23:26.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.621+0000 7f4eafc70700 1 --2- 172.21.15.37:0/3452398364 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ea8162230 0x7f4ea80cadf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.621+0000 7f4eafc70700 1 --2- 172.21.15.37:0/3452398364 >> v2:172.21.15.191:3300/0 conn(0x7f4ea815dd40 0x7f4ea80b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.621+0000 7f4eafc70700 1 -- 172.21.15.37:0/3452398364 >> 172.21.15.37:0/3452398364 conn(0x7f4ea80ccf30 msgr2=0x7f4ea80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.620+0000 7f9ade734700 1 -- 172.21.15.37:0/803181725 shutdown_connections 2023-10-06T02:23:26.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.620+0000 7f9ade734700 1 --2- 172.21.15.37:0/803181725 >> v2:172.21.15.191:3300/0 conn(0x7f9ad8159870 0x7f9ad8159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.620+0000 7f9ade734700 1 --2- 172.21.15.37:0/803181725 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ad8155aa0 0x7f9ad80c7090 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800aa90 tx=0x7f9ac800a330 comp rx=0 tx=0).stop 2023-10-06T02:23:26.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.620+0000 7f9ade734700 1 -- 172.21.15.37:0/803181725 >> 172.21.15.37:0/803181725 conn(0x7f9ad80cc140 msgr2=0x7f9ad80cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.621+0000 7f9ade734700 1 -- 172.21.15.37:0/803181725 shutdown_connections 2023-10-06T02:23:26.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.621+0000 7f9ade734700 1 -- 172.21.15.37:0/803181725 wait complete. 2023-10-06T02:23:26.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.621+0000 7fa093ca7700 1 -- 172.21.15.37:0/425319776 shutdown_connections 2023-10-06T02:23:26.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.621+0000 7fb0d5dce700 1 -- 172.21.15.37:0/2377765637 wait complete. 2023-10-06T02:23:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.622+0000 7f9ade734700 1 Processor -- start 2023-10-06T02:23:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.622+0000 7f04d17fa700 1 -- 172.21.15.37:0/1359980197 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04d4014620 con 0x7f04dc156580 2023-10-06T02:23:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.621+0000 7fa093ca7700 1 -- 172.21.15.37:0/425319776 wait complete. 2023-10-06T02:23:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.622+0000 7fa093ca7700 1 Processor -- start 2023-10-06T02:23:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.623+0000 7fa093ca7700 1 -- start start 2023-10-06T02:23:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.623+0000 7fb0d5dce700 1 Processor -- start 2023-10-06T02:23:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.621+0000 7f4eafc70700 1 -- 172.21.15.37:0/3452398364 shutdown_connections 2023-10-06T02:23:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7fb0d5dce700 1 -- start start 2023-10-06T02:23:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.623+0000 7f9ade734700 1 -- start start 2023-10-06T02:23:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7f9ade734700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ad8155e70 0x7f9ad8157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7f9ade734700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ad8159870 0x7f9ad80b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7f9ade734700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ad80981b0 0x7f9ad806e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7f9ade734700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad8099330 con 0x7f9ad8159870 2023-10-06T02:23:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7f9ade734700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80b1fb0 con 0x7f9ad8155e70 2023-10-06T02:23:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7f9ade734700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad8158a50 con 0x7f9ad80981b0 2023-10-06T02:23:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7fa093ca7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa08c15d8e0 0x7fa08c155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7fa093ca7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa08c15dcb0 0x7fa08c0a4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7fa093ca7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa08c098ec0 0x7fa08c099340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7fa093ca7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c099880 con 0x7fa08c15d8e0 2023-10-06T02:23:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7fa093ca7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c156250 con 0x7fa08c098ec0 2023-10-06T02:23:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7fa093ca7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c0a5380 con 0x7fa08c15dcb0 2023-10-06T02:23:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.623+0000 7f4eafc70700 1 -- 172.21.15.37:0/3452398364 wait complete. 2023-10-06T02:23:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7f4eafc70700 1 Processor -- start 2023-10-06T02:23:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7f9ad77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ad8159870 0x7f9ad80b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7f9ad77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ad8159870 0x7f9ad80b1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42152/0 (socket says 172.21.15.37:42152) 2023-10-06T02:23:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7f9ad77fe700 1 -- 172.21.15.37:0/1119511283 learned_addr learned my addr 172.21.15.37:0/1119511283 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.623+0000 7f04d17fa700 1 --2- 172.21.15.37:0/1359980197 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f04c0066f30 0x7f04c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.623+0000 7f04d17fa700 1 -- 172.21.15.37:0/1359980197 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f04d4084450 con 0x7f04dc156580 2023-10-06T02:23:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7f04e1484700 1 --2- 172.21.15.37:0/1359980197 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f04c0066f30 0x7f04c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7f9adccd1700 1 --2- 172.21.15.37:0/1119511283 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ad80981b0 0x7f9ad806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f9ad77fe700 1 -- 172.21.15.37:0/1119511283 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ad80981b0 msgr2=0x7f9ad806e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f9ad77fe700 1 --2- 172.21.15.37:0/1119511283 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ad80981b0 0x7f9ad806e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f9ad7fff700 1 --2- 172.21.15.37:0/1119511283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ad8155e70 0x7f9ad8157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7fa092244700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa08c098ec0 0x7fa08c099340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7fa092244700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa08c098ec0 0x7fa08c099340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:42802/0 (socket says 172.21.15.37:42802) 2023-10-06T02:23:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7fa092244700 1 -- 172.21.15.37:0/3473643512 learned_addr learned my addr 172.21.15.37:0/3473643512 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7fa091a43700 1 --2- 172.21.15.37:0/3473643512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa08c15d8e0 0x7fa08c155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7fa092244700 1 -- 172.21.15.37:0/3473643512 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa08c15dcb0 msgr2=0x7fa08c0a4570 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:23:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7fa092244700 1 --2- 172.21.15.37:0/3473643512 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa08c15dcb0 0x7fa08c0a4570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7fa092244700 1 -- 172.21.15.37:0/3473643512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa08c15d8e0 msgr2=0x7fa08c155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7fa092244700 1 --2- 172.21.15.37:0/3473643512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa08c15d8e0 0x7fa08c155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7fa092244700 1 -- 172.21.15.37:0/3473643512 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c009420 con 0x7fa08c098ec0 2023-10-06T02:23:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f9ad77fe700 1 -- 172.21.15.37:0/1119511283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ad8155e70 msgr2=0x7f9ad8157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f9ad77fe700 1 --2- 172.21.15.37:0/1119511283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ad8155e70 0x7f9ad8157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f9ad77fe700 1 -- 172.21.15.37:0/1119511283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac800a5d0 con 0x7f9ad8159870 2023-10-06T02:23:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f9ad7fff700 1 --2- 172.21.15.37:0/1119511283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ad8155e70 0x7f9ad8157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f9ad77fe700 1 --2- 172.21.15.37:0/1119511283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ad8159870 0x7f9ad80b1a70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000cd90 tx=0x7f9ad0001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f04e36e8700 1 -- 172.21.15.37:0/1359980197 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04bc0052b0 con 0x7f04dc156580 2023-10-06T02:23:26.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f9abffff700 1 -- 172.21.15.37:0/1119511283 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad000ce90 con 0x7f9ad8159870 2023-10-06T02:23:26.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f9abffff700 1 -- 172.21.15.37:0/1119511283 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad0004bb0 con 0x7f9ad8159870 2023-10-06T02:23:26.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f9abffff700 1 -- 172.21.15.37:0/1119511283 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad000aaf0 con 0x7f9ad8159870 2023-10-06T02:23:26.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f9ade734700 1 -- 172.21.15.37:0/1119511283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad8098720 con 0x7f9ad8159870 2023-10-06T02:23:26.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7fb0d5dce700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0d00ca540 0x7fb0d016e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7fb0d5dce700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0d0159330 0x7fb0d00aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7fb0d5dce700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0d0159700 0x7fb0d00c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7fb0d5dce700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d0157d10 con 0x7fb0d0159330 2023-10-06T02:23:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7fb0d5dce700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d015be60 con 0x7fb0d00ca540 2023-10-06T02:23:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7fb0d5dce700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d015c700 con 0x7fb0d0159700 2023-10-06T02:23:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7fb0cf7fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0d00ca540 0x7fb0d016e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7fb0cf7fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0d00ca540 0x7fb0d016e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:42816/0 (socket says 172.21.15.37:42816) 2023-10-06T02:23:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7fb0cf7fe700 1 -- 172.21.15.37:0/4113684441 learned_addr learned my addr 172.21.15.37:0/4113684441 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7fb0ceffd700 1 --2- 172.21.15.37:0/4113684441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0d0159330 0x7fb0d00aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7fb0cf7fe700 1 -- 172.21.15.37:0/4113684441 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0d0159700 msgr2=0x7fb0d00c2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7fb0cf7fe700 1 --2- 172.21.15.37:0/4113684441 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0d0159700 0x7fb0d00c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7fb0cf7fe700 1 -- 172.21.15.37:0/4113684441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0d0159330 msgr2=0x7fb0d00aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7fb0cf7fe700 1 --2- 172.21.15.37:0/4113684441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0d0159330 0x7fb0d00aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7fb0cf7fe700 1 -- 172.21.15.37:0/4113684441 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c8009a20 con 0x7fb0d00ca540 2023-10-06T02:23:26.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7fb0cf7fe700 1 --2- 172.21.15.37:0/4113684441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0d00ca540 0x7fb0d016e620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb0d006ebc0 tx=0x7fb0c8018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.624+0000 7f4eafc70700 1 -- start start 2023-10-06T02:23:26.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f4eafc70700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ea80b2890 0x7f4ea81503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f4eafc70700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ea815dd40 0x7f4ea80c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f4eafc70700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea8162230 0x7f4ea80ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f4eafc70700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea8150be0 con 0x7f4ea8162230 2023-10-06T02:23:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f4eafc70700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80c4f00 con 0x7f4ea815dd40 2023-10-06T02:23:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f4eafc70700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80c45d0 con 0x7f4ea80b2890 2023-10-06T02:23:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7f4ead20b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ea815dd40 0x7f4ea80c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7f4eada0c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ea80b2890 0x7f4ea81503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7f4eada0c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ea80b2890 0x7f4ea81503b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:55380/0 (socket says 172.21.15.37:55380) 2023-10-06T02:23:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7f4eada0c700 1 -- 172.21.15.37:0/1807635281 learned_addr learned my addr 172.21.15.37:0/1807635281 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7fa092244700 1 --2- 172.21.15.37:0/3473643512 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa08c098ec0 0x7fa08c099340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa08800ea80 tx=0x7fa0880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7fa081ffb700 1 -- 172.21.15.37:0/3473643512 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08800c920 con 0x7fa08c098ec0 2023-10-06T02:23:26.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7fa093ca7700 1 -- 172.21.15.37:0/3473643512 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08c0a50a0 con 0x7fa08c098ec0 2023-10-06T02:23:26.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7fa093ca7700 1 -- 172.21.15.37:0/3473643512 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08c0a5a60 con 0x7fa08c098ec0 2023-10-06T02:23:26.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7fb0b77fe700 1 -- 172.21.15.37:0/4113684441 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8009420 con 0x7fb0d00ca540 2023-10-06T02:23:26.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7fb0b77fe700 1 -- 172.21.15.37:0/4113684441 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c8012ce0 con 0x7fb0d00ca540 2023-10-06T02:23:26.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7fb0b77fe700 1 -- 172.21.15.37:0/4113684441 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c802f670 con 0x7fb0d00ca540 2023-10-06T02:23:26.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7f4ead20b700 1 -- 172.21.15.37:0/1807635281 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ea80b2890 msgr2=0x7f4ea81503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7f4ead20b700 1 --2- 172.21.15.37:0/1807635281 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ea80b2890 0x7f4ea81503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7f4ead20b700 1 -- 172.21.15.37:0/1807635281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea8162230 msgr2=0x7f4ea80ce1b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T02:23:26.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7f4ead20b700 1 --2- 172.21.15.37:0/1807635281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea8162230 0x7f4ea80ce1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7f4ead20b700 1 -- 172.21.15.37:0/1807635281 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea0009a20 con 0x7f4ea815dd40 2023-10-06T02:23:26.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.627+0000 7f4ead20b700 1 --2- 172.21.15.37:0/1807635281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ea815dd40 0x7f4ea80c5390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400b4c0 tx=0x7f4ea4009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.627+0000 7fa081ffb700 1 -- 172.21.15.37:0/3473643512 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08800caa0 con 0x7fa08c098ec0 2023-10-06T02:23:26.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.627+0000 7fa081ffb700 1 -- 172.21.15.37:0/3473643512 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08800ce60 con 0x7fa08c098ec0 2023-10-06T02:23:26.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7f9ade734700 1 -- 172.21.15.37:0/1119511283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad8098ce0 con 0x7f9ad8159870 2023-10-06T02:23:26.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.627+0000 7f4e9dffb700 1 -- 172.21.15.37:0/1807635281 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea400f510 con 0x7f4ea815dd40 2023-10-06T02:23:26.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.627+0000 7f4e9dffb700 1 -- 172.21.15.37:0/1807635281 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea400f670 con 0x7f4ea815dd40 2023-10-06T02:23:26.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.627+0000 7f4e9dffb700 1 -- 172.21.15.37:0/1807635281 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea400fa30 con 0x7f4ea815dd40 2023-10-06T02:23:26.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.627+0000 7f4eafc70700 1 -- 172.21.15.37:0/1807635281 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea80c48b0 con 0x7f4ea815dd40 2023-10-06T02:23:26.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.627+0000 7f4eafc70700 1 -- 172.21.15.37:0/1807635281 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea81508f0 con 0x7f4ea815dd40 2023-10-06T02:23:26.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.628+0000 7f04e1484700 1 --2- 172.21.15.37:0/1359980197 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f04c0066f30 0x7f04c00693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f04d800b470 tx=0x7f04d801b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.628+0000 7fb0d5dce700 1 -- 172.21.15.37:0/4113684441 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d015da20 con 0x7fb0d00ca540 2023-10-06T02:23:26.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.628+0000 7fb0d5dce700 1 -- 172.21.15.37:0/4113684441 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d015c390 con 0x7fb0d00ca540 2023-10-06T02:23:26.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f17603fe700 1 Processor -- start 2023-10-06T02:23:26.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.625+0000 7f17603fe700 1 -- start start 2023-10-06T02:23:26.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7f17603fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1758158220 0x7f17580c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7f17603fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f175815e010 0x7f17580c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7f17603fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f17580c70c0 0x7f17580ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7f17603fe700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17580c8840 con 0x7f1758158220 2023-10-06T02:23:26.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7f17603fe700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17580ca1a0 con 0x7f17580c70c0 2023-10-06T02:23:26.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7f17603fe700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17580c7520 con 0x7f175815e010 2023-10-06T02:23:26.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7f175e99b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f17580c70c0 0x7f17580ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.626+0000 7f175e99b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f17580c70c0 0x7f17580ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:42836/0 (socket says 172.21.15.37:42836) 2023-10-06T02:23:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.627+0000 7f175e99b700 1 -- 172.21.15.37:0/218716849 learned_addr learned my addr 172.21.15.37:0/218716849 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.627+0000 7f175e19a700 1 --2- 172.21.15.37:0/218716849 >> v2:172.21.15.37:3300/0 conn(0x7f1758158220 0x7f17580c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.627+0000 7f175d999700 1 --2- 172.21.15.37:0/218716849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f175815e010 0x7f17580c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.627+0000 7f175e99b700 1 -- 172.21.15.37:0/218716849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f175815e010 msgr2=0x7f17580c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.627+0000 7f175e99b700 1 --2- 172.21.15.37:0/218716849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f175815e010 0x7f17580c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.627+0000 7f175e99b700 1 -- 172.21.15.37:0/218716849 >> v2:172.21.15.37:3300/0 conn(0x7f1758158220 msgr2=0x7f17580c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.627+0000 7f175e99b700 1 --2- 172.21.15.37:0/218716849 >> v2:172.21.15.37:3300/0 conn(0x7f1758158220 0x7f17580c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.627+0000 7f175e99b700 1 -- 172.21.15.37:0/218716849 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1758064710 con 0x7f17580c70c0 2023-10-06T02:23:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.627+0000 7f175e99b700 1 --2- 172.21.15.37:0/218716849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17580c70c0 0x7f17580ca5f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f17580ab680 tx=0x7f1750009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2766d84284653670 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.628+0000 7f175d198700 1 -- 172.21.15.37:0/218716849 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17500090d0 con 0x7f17580c70c0 2023-10-06T02:23:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.628+0000 7f175d198700 1 -- 172.21.15.37:0/218716849 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1750030070 con 0x7f17580c70c0 2023-10-06T02:23:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.628+0000 7f175d198700 1 -- 172.21.15.37:0/218716849 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175000ba50 con 0x7f17580c70c0 2023-10-06T02:23:26.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.628+0000 7f9ade734700 1 -- 172.21.15.37:0/1119511283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad8068140 con 0x7f9ad8159870 2023-10-06T02:23:26.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.628+0000 7fa081ffb700 1 -- 172.21.15.37:0/3473643512 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa088013680 con 0x7fa08c098ec0 2023-10-06T02:23:26.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.629+0000 7fa081ffb700 1 --2- 172.21.15.37:0/3473643512 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa070066f30 0x7fa0700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.629+0000 7fa081ffb700 1 -- 172.21.15.37:0/3473643512 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa088084a50 con 0x7fa08c098ec0 2023-10-06T02:23:26.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.629+0000 7fa093ca7700 1 -- 172.21.15.37:0/3473643512 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08c0a55d0 con 0x7fa08c098ec0 2023-10-06T02:23:26.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.629+0000 7fa091a43700 1 --2- 172.21.15.37:0/3473643512 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa070066f30 0x7fa0700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.630+0000 7f9abffff700 1 -- 172.21.15.37:0/1119511283 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ad00070f0 con 0x7f9ad8159870 2023-10-06T02:23:26.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.629+0000 7f4e9dffb700 1 -- 172.21.15.37:0/1807635281 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ea401a400 con 0x7f4ea815dd40 2023-10-06T02:23:26.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.630+0000 7f4e9dffb700 1 --2- 172.21.15.37:0/1807635281 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4e8c067000 0x7f4e8c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.630+0000 7f4e9dffb700 1 -- 172.21.15.37:0/1807635281 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4ea4083e90 con 0x7f4ea815dd40 2023-10-06T02:23:26.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.630+0000 7f9abffff700 1 --2- 172.21.15.37:0/1119511283 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ac4067000 0x7f9ac40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.630+0000 7f4eada0c700 1 --2- 172.21.15.37:0/1807635281 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4e8c067000 0x7f4e8c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.630+0000 7f9abffff700 1 -- 172.21.15.37:0/1119511283 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9ad0084530 con 0x7f9ad8159870 2023-10-06T02:23:26.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.630+0000 7f9ad7fff700 1 --2- 172.21.15.37:0/1119511283 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ac4067000 0x7f9ac40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.629+0000 7f17603fe700 1 -- 172.21.15.37:0/218716849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17580c70c0 msgr2=0x7f17580ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.629+0000 7f17603fe700 1 --2- 172.21.15.37:0/218716849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17580c70c0 0x7f17580ca5f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f17580ab680 tx=0x7f1750009840 comp rx=0 tx=0).stop 2023-10-06T02:23:26.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.631+0000 7f4eafc70700 1 -- 172.21.15.37:0/1807635281 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea80cccd0 con 0x7f4ea815dd40 2023-10-06T02:23:26.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.631+0000 7fb0b77fe700 1 -- 172.21.15.37:0/4113684441 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb0c802faa0 con 0x7fb0d00ca540 2023-10-06T02:23:26.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.631+0000 7f4eada0c700 1 --2- 172.21.15.37:0/1807635281 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4e8c067000 0x7f4e8c0694b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4e98006b00 tx=0x7f4e98008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.631+0000 7f9ad7fff700 1 --2- 172.21.15.37:0/1119511283 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ac4067000 0x7f9ac40694b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8064e70 tx=0x7f9ac801a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.631+0000 7fa091a43700 1 --2- 172.21.15.37:0/3473643512 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa070066f30 0x7fa0700693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa084005c50 tx=0x7fa084009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.631+0000 7f17603fe700 1 -- 172.21.15.37:0/218716849 shutdown_connections 2023-10-06T02:23:26.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.631+0000 7f17603fe700 1 --2- 172.21.15.37:0/218716849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17580c70c0 0x7f17580ca5f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.631+0000 7f17603fe700 1 --2- 172.21.15.37:0/218716849 >> v2:172.21.15.37:3300/0 conn(0x7f1758158220 0x7f17580c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.631+0000 7f17603fe700 1 --2- 172.21.15.37:0/218716849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f175815e010 0x7f17580c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.631+0000 7f17603fe700 1 -- 172.21.15.37:0/218716849 >> 172.21.15.37:0/218716849 conn(0x7f175806ebf0 msgr2=0x7f175806c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.631+0000 7fb0d5dce700 1 -- 172.21.15.37:0/4113684441 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b00052b0 con 0x7fb0d00ca540 2023-10-06T02:23:26.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.631+0000 7fb0b77fe700 1 --2- 172.21.15.37:0/4113684441 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb0bc067000 0x7fb0bc0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.631+0000 7f17603fe700 1 -- 172.21.15.37:0/218716849 shutdown_connections 2023-10-06T02:23:26.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.631+0000 7f17603fe700 1 -- 172.21.15.37:0/218716849 wait complete. 2023-10-06T02:23:26.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.631+0000 7fb0ceffd700 1 --2- 172.21.15.37:0/4113684441 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb0bc067000 0x7fb0bc0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.631+0000 7fb0b77fe700 1 -- 172.21.15.37:0/4113684441 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb0c8097bc0 con 0x7fb0d00ca540 2023-10-06T02:23:26.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.632+0000 7fb0ceffd700 1 --2- 172.21.15.37:0/4113684441 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb0bc067000 0x7fb0bc0694b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb0d00caa50 tx=0x7fb0c4009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.633+0000 7f17603fe700 1 Processor -- start 2023-10-06T02:23:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.633+0000 7f17603fe700 1 -- start start 2023-10-06T02:23:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.633+0000 7f17603fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17580c70c0 0x7f17580c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.633+0000 7f17603fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1758158220 0x7f175814c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.633+0000 7f17603fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f175815e010 0x7f17580c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.633+0000 7f17603fe700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17580c4540 con 0x7f175815e010 2023-10-06T02:23:26.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.633+0000 7f17603fe700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17580c47e0 con 0x7f17580c70c0 2023-10-06T02:23:26.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.633+0000 7f17603fe700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17580c4ac0 con 0x7f1758158220 2023-10-06T02:23:26.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.634+0000 7f04d17fa700 1 -- 172.21.15.37:0/1359980197 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04d4051560 con 0x7f04dc156580 2023-10-06T02:23:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.634+0000 7f175e19a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17580c70c0 0x7f17580c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.634+0000 7f175d999700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1758158220 0x7f175814c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.634+0000 7f175e19a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17580c70c0 0x7f17580c4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:42846/0 (socket says 172.21.15.37:42846) 2023-10-06T02:23:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.634+0000 7f175d999700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1758158220 0x7f175814c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:55410/0 (socket says 172.21.15.37:55410) 2023-10-06T02:23:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.634+0000 7f175e19a700 1 -- 172.21.15.37:0/768110958 learned_addr learned my addr 172.21.15.37:0/768110958 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.634+0000 7f175e99b700 1 --2- 172.21.15.37:0/768110958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f175815e010 0x7f17580c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.634+0000 7f175e19a700 1 -- 172.21.15.37:0/768110958 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1758158220 msgr2=0x7f175814c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.634+0000 7f175e19a700 1 --2- 172.21.15.37:0/768110958 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1758158220 0x7f175814c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.634+0000 7f175e19a700 1 -- 172.21.15.37:0/768110958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f175815e010 msgr2=0x7f17580c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.634+0000 7f175e19a700 1 --2- 172.21.15.37:0/768110958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f175815e010 0x7f17580c5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.634+0000 7f175e19a700 1 -- 172.21.15.37:0/768110958 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1750009ae0 con 0x7f17580c70c0 2023-10-06T02:23:26.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.634+0000 7f175e19a700 1 --2- 172.21.15.37:0/768110958 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17580c70c0 0x7f17580c4000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f174800d860 tx=0x7f1748008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.636+0000 7f9abffff700 1 -- 172.21.15.37:0/1119511283 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ad00516a0 con 0x7f9ad8159870 2023-10-06T02:23:26.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.636+0000 7f4e9dffb700 1 -- 172.21.15.37:0/1807635281 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ea4054b90 con 0x7f4ea815dd40 2023-10-06T02:23:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.637+0000 7f406112b700 1 Processor -- start 2023-10-06T02:23:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.637+0000 7f406112b700 1 -- start start 2023-10-06T02:23:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.637+0000 7f406112b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f405c1558e0 0x7f405c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.638+0000 7f406112b700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f405c0cb1c0 con 0x7f405c06e8d0 2023-10-06T02:23:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.638+0000 7f406112b700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f405c0cb4a0 con 0x7f405c06d8a0 2023-10-06T02:23:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.638+0000 7f406112b700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405c0cb780 con 0x7f405c1558e0 2023-10-06T02:23:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.638+0000 7f162dc38700 1 Processor -- start 2023-10-06T02:23:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.638+0000 7f405ad9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f405c1558e0 0x7f405c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.638+0000 7f405b59e700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f405c06e8d0 0x7f405c0c7de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34444/0 (socket says 172.21.15.37:34444) 2023-10-06T02:23:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.638+0000 7f405b59e700 1 -- 172.21.15.37:0/3064585698 learned_addr learned my addr 172.21.15.37:0/3064585698 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.638+0000 7f405ad9d700 1 --2- 172.21.15.37:0/3064585698 >> v2:172.21.15.37:3300/0 conn(0x7f405c1558e0 0x7f405c06d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42196/0 (socket says 172.21.15.37:42196) 2023-10-06T02:23:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.638+0000 7f405ad9d700 1 -- 172.21.15.37:0/3064585698 >> v1:172.21.15.191:6789/0 conn(0x7f405c06d8a0 legacy=0x7f405c06e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.638+0000 7f405ad9d700 1 -- 172.21.15.37:0/3064585698 >> v1:172.21.15.37:6789/0 conn(0x7f405c06e8d0 legacy=0x7f405c0c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.638+0000 7f405ad9d700 1 -- 172.21.15.37:0/3064585698 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c0c78c0 con 0x7f405c1558e0 2023-10-06T02:23:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.638+0000 7f405ad9d700 1 --2- 172.21.15.37:0/3064585698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c1558e0 0x7f405c06d360 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f404c0098e0 tx=0x7f404c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5bd146d8a536a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.638+0000 7f4059d9b700 1 -- 172.21.15.37:0/3064585698 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c009e80 con 0x7f405c1558e0 2023-10-06T02:23:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.638+0000 7f4059d9b700 1 -- 172.21.15.37:0/3064585698 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c00b860 con 0x7f405c1558e0 2023-10-06T02:23:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.638+0000 7f4059d9b700 1 -- 172.21.15.37:0/3064585698 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c00bc00 con 0x7f405c1558e0 2023-10-06T02:23:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.638+0000 7f162dc38700 1 -- start start 2023-10-06T02:23:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.639+0000 7f162dc38700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f162806d410 0x7f16280c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.639+0000 7f162dc38700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16280c3a00 con 0x7f162806d7e0 2023-10-06T02:23:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.639+0000 7f162dc38700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16280c3ce0 con 0x7f16280694a0 2023-10-06T02:23:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.639+0000 7f162dc38700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16280c3fc0 con 0x7f162806d410 2023-10-06T02:23:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.639+0000 7f16277fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f162806d410 0x7f16280c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.639+0000 7f16277fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f162806d410 0x7f16280c30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:42862/0 (socket says 172.21.15.37:42862) 2023-10-06T02:23:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.639+0000 7f1627fff700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f16280694a0 0x7f16281677e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:57766/0 (socket says 172.21.15.37:57766) 2023-10-06T02:23:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.639+0000 7f16277fe700 1 -- 172.21.15.37:0/3624347295 learned_addr learned my addr 172.21.15.37:0/3624347295 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.639+0000 7f406112b700 1 -- 172.21.15.37:0/3064585698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c1558e0 msgr2=0x7f405c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.639+0000 7f406112b700 1 --2- 172.21.15.37:0/3064585698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c1558e0 0x7f405c06d360 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f404c0098e0 tx=0x7f404c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.639+0000 7f16277fe700 1 -- 172.21.15.37:0/3624347295 >> v1:172.21.15.191:6789/0 conn(0x7f16280694a0 legacy=0x7f16281677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.639+0000 7f16277fe700 1 -- 172.21.15.37:0/3624347295 >> v1:172.21.15.37:6789/0 conn(0x7f162806d7e0 legacy=0x7f1628068d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.639+0000 7f16277fe700 1 -- 172.21.15.37:0/3624347295 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16280c42a0 con 0x7f162806d410 2023-10-06T02:23:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.639+0000 7f406112b700 1 -- 172.21.15.37:0/3064585698 shutdown_connections 2023-10-06T02:23:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.639+0000 7f406112b700 1 --2- 172.21.15.37:0/3064585698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c1558e0 0x7f405c06d360 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.639+0000 7f406112b700 1 -- 172.21.15.37:0/3064585698 >> 172.21.15.37:0/3064585698 conn(0x7f405c0cc970 msgr2=0x7f405c0ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.640+0000 7f406112b700 1 -- 172.21.15.37:0/3064585698 shutdown_connections 2023-10-06T02:23:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.640+0000 7f16277fe700 1 --2- 172.21.15.37:0/3624347295 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162806d410 0x7f16280c30b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1618009f20 tx=0x7f1618009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=228645453042fba8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.640+0000 7f406112b700 1 -- 172.21.15.37:0/3064585698 wait complete. 2023-10-06T02:23:26.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.640+0000 7fa081ffb700 1 -- 172.21.15.37:0/3473643512 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa088051b60 con 0x7fa08c098ec0 2023-10-06T02:23:26.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.641+0000 7f406112b700 1 Processor -- start 2023-10-06T02:23:26.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.641+0000 7f406112b700 1 -- start start 2023-10-06T02:23:26.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.642+0000 7f406112b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c06d8a0 0x7f405c0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.642+0000 7f406112b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f405c06e8d0 0x7f405c146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.642+0000 7f406112b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f405c1558e0 0x7f405c15b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.642+0000 7f406112b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c159560 con 0x7f405c06d8a0 2023-10-06T02:23:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.642+0000 7f406112b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c158d50 con 0x7f405c06e8d0 2023-10-06T02:23:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.642+0000 7f406112b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0afc50 con 0x7f405c1558e0 2023-10-06T02:23:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.642+0000 7f405a59c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f405c06e8d0 0x7f405c146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.642+0000 7f405a59c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f405c06e8d0 0x7f405c146430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:42876/0 (socket says 172.21.15.37:42876) 2023-10-06T02:23:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.642+0000 7f405b59e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f405c1558e0 0x7f405c15b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.642+0000 7f405a59c700 1 -- 172.21.15.37:0/3049259815 learned_addr learned my addr 172.21.15.37:0/3049259815 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.642+0000 7f405a59c700 1 -- 172.21.15.37:0/3049259815 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f405c1558e0 msgr2=0x7f405c15b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.642+0000 7f405a59c700 1 --2- 172.21.15.37:0/3049259815 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f405c1558e0 0x7f405c15b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.642+0000 7f405a59c700 1 -- 172.21.15.37:0/3049259815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c06d8a0 msgr2=0x7f405c0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.642+0000 7f405a59c700 1 --2- 172.21.15.37:0/3049259815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c06d8a0 0x7f405c0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.642+0000 7f405a59c700 1 -- 172.21.15.37:0/3049259815 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c009420 con 0x7f405c06e8d0 2023-10-06T02:23:26.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.643+0000 7f405a59c700 1 --2- 172.21.15.37:0/3049259815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f405c06e8d0 0x7f405c146430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f405000c590 tx=0x7f405000c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.644+0000 7f16267fc700 1 -- 172.21.15.37:0/3624347295 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161800e070 con 0x7f162806d410 2023-10-06T02:23:26.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.644+0000 7f4042ffd700 1 -- 172.21.15.37:0/3049259815 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050011590 con 0x7f405c06e8d0 2023-10-06T02:23:26.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.644+0000 7fb0b77fe700 1 -- 172.21.15.37:0/4113684441 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0c80687e0 con 0x7fb0d00ca540 2023-10-06T02:23:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.644+0000 7f16267fc700 1 -- 172.21.15.37:0/3624347295 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161800ba80 con 0x7f162806d410 2023-10-06T02:23:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.644+0000 7f16267fc700 1 -- 172.21.15.37:0/3624347295 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180092e0 con 0x7f162806d410 2023-10-06T02:23:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.645+0000 7f162dc38700 1 -- 172.21.15.37:0/3624347295 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162806d410 msgr2=0x7f16280c30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.645+0000 7f162dc38700 1 --2- 172.21.15.37:0/3624347295 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162806d410 0x7f16280c30b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1618009f20 tx=0x7f1618009840 comp rx=0 tx=0).stop 2023-10-06T02:23:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.645+0000 7f162dc38700 1 -- 172.21.15.37:0/3624347295 shutdown_connections 2023-10-06T02:23:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.645+0000 7f162dc38700 1 --2- 172.21.15.37:0/3624347295 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162806d410 0x7f16280c30b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.645+0000 7f162dc38700 1 -- 172.21.15.37:0/3624347295 >> 172.21.15.37:0/3624347295 conn(0x7f1628067b30 msgr2=0x7f1628067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.644+0000 7f406112b700 1 -- 172.21.15.37:0/3049259815 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405c0b0620 con 0x7f405c06e8d0 2023-10-06T02:23:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.644+0000 7f406112b700 1 -- 172.21.15.37:0/3049259815 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405c159020 con 0x7f405c06e8d0 2023-10-06T02:23:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.644+0000 7f4042ffd700 1 -- 172.21.15.37:0/3049259815 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4050011710 con 0x7f405c06e8d0 2023-10-06T02:23:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.644+0000 7f4042ffd700 1 -- 172.21.15.37:0/3049259815 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050011ad0 con 0x7f405c06e8d0 2023-10-06T02:23:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.646+0000 7f4042ffd700 1 -- 172.21.15.37:0/3049259815 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f405001b3b0 con 0x7f405c06e8d0 2023-10-06T02:23:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.646+0000 7f406112b700 1 -- 172.21.15.37:0/3049259815 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f403c0052b0 con 0x7f405c06e8d0 2023-10-06T02:23:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.647+0000 7f4042ffd700 1 --2- 172.21.15.37:0/3049259815 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4048066f30 0x7f40480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.647+0000 7f4042ffd700 1 -- 172.21.15.37:0/3049259815 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4050083b90 con 0x7f405c06e8d0 2023-10-06T02:23:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.647+0000 7f405ad9d700 1 --2- 172.21.15.37:0/3049259815 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4048066f30 0x7f40480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.648+0000 7f162dc38700 1 -- 172.21.15.37:0/3624347295 shutdown_connections 2023-10-06T02:23:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.648+0000 7f162dc38700 1 -- 172.21.15.37:0/3624347295 wait complete. 2023-10-06T02:23:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.648+0000 7f405ad9d700 1 --2- 172.21.15.37:0/3049259815 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4048066f30 0x7f40480693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f404c006eb0 tx=0x7f404c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.650+0000 7f162dc38700 1 Processor -- start 2023-10-06T02:23:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.650+0000 7f162dc38700 1 -- start start 2023-10-06T02:23:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.651+0000 7f162dc38700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16280694a0 0x7f16280c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.651+0000 7f162dc38700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162806d410 0x7f1628160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.651+0000 7f162dc38700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f162806d7e0 0x7f1628155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.651+0000 7f162dc38700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280c7220 con 0x7f16280694a0 2023-10-06T02:23:26.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.651+0000 7f162dc38700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162815dba0 con 0x7f162806d410 2023-10-06T02:23:26.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.651+0000 7f162dc38700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162815d620 con 0x7f162806d7e0 2023-10-06T02:23:26.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.651+0000 7f16277fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16280694a0 0x7f16280c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.651+0000 7f16277fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16280694a0 0x7f16280c76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42212/0 (socket says 172.21.15.37:42212) 2023-10-06T02:23:26.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.651+0000 7f16277fe700 1 -- 172.21.15.37:0/3259683209 learned_addr learned my addr 172.21.15.37:0/3259683209 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:26.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.652+0000 7f4042ffd700 1 -- 172.21.15.37:0/3049259815 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4050050ca0 con 0x7f405c06e8d0 2023-10-06T02:23:26.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.652+0000 7f16277fe700 1 -- 172.21.15.37:0/3259683209 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f162806d7e0 msgr2=0x7f1628155e30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:23:26.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.652+0000 7f16277fe700 1 --2- 172.21.15.37:0/3259683209 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f162806d7e0 0x7f1628155e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.652+0000 7f16277fe700 1 -- 172.21.15.37:0/3259683209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162806d410 msgr2=0x7f1628160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.652+0000 7f16277fe700 1 --2- 172.21.15.37:0/3259683209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162806d410 0x7f1628160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.652+0000 7f16277fe700 1 -- 172.21.15.37:0/3259683209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1618009ae0 con 0x7f16280694a0 2023-10-06T02:23:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.652+0000 7f16277fe700 1 --2- 172.21.15.37:0/3259683209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16280694a0 0x7f16280c76b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f162806a660 tx=0x7f1618018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.653+0000 7f160f7fe700 1 -- 172.21.15.37:0/3259683209 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618008bb0 con 0x7f16280694a0 2023-10-06T02:23:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.653+0000 7f160f7fe700 1 -- 172.21.15.37:0/3259683209 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1618008d10 con 0x7f16280694a0 2023-10-06T02:23:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.653+0000 7f160f7fe700 1 -- 172.21.15.37:0/3259683209 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618026690 con 0x7f16280694a0 2023-10-06T02:23:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.654+0000 7f162dc38700 1 -- 172.21.15.37:0/3259683209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162815d8c0 con 0x7f16280694a0 2023-10-06T02:23:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.654+0000 7f162dc38700 1 -- 172.21.15.37:0/3259683209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16280c7bf0 con 0x7f16280694a0 2023-10-06T02:23:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.656+0000 7f162dc38700 1 -- 172.21.15.37:0/3259683209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16280c8950 con 0x7f16280694a0 2023-10-06T02:23:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.656+0000 7f160f7fe700 1 -- 172.21.15.37:0/3259683209 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1618003040 con 0x7f16280694a0 2023-10-06T02:23:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.657+0000 7f160f7fe700 1 --2- 172.21.15.37:0/3259683209 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1610067140 0x7f16100695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.657+0000 7f160f7fe700 1 -- 172.21.15.37:0/3259683209 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1618086640 con 0x7f16280694a0 2023-10-06T02:23:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.649+0000 7f174e7fc700 1 -- 172.21.15.37:0/768110958 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17480125f0 con 0x7f17580c70c0 2023-10-06T02:23:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.649+0000 7f174e7fc700 1 -- 172.21.15.37:0/768110958 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1748012750 con 0x7f17580c70c0 2023-10-06T02:23:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.649+0000 7f174e7fc700 1 -- 172.21.15.37:0/768110958 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748012b10 con 0x7f17580c70c0 2023-10-06T02:23:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.650+0000 7f17603fe700 1 -- 172.21.15.37:0/768110958 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17580c4da0 con 0x7f17580c70c0 2023-10-06T02:23:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.650+0000 7f17603fe700 1 -- 172.21.15.37:0/768110958 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17580c5360 con 0x7f17580c70c0 2023-10-06T02:23:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.650+0000 7f17603fe700 1 -- 172.21.15.37:0/768110958 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f175804c3c0 con 0x7f17580c70c0 2023-10-06T02:23:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.653+0000 7f174e7fc700 1 -- 172.21.15.37:0/768110958 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f174801e460 con 0x7f17580c70c0 2023-10-06T02:23:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.654+0000 7f174e7fc700 1 --2- 172.21.15.37:0/768110958 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f173c067080 0x7f173c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.654+0000 7f174e7fc700 1 -- 172.21.15.37:0/768110958 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f17480855c0 con 0x7f17580c70c0 2023-10-06T02:23:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.656+0000 7f174e7fc700 1 -- 172.21.15.37:0/768110958 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17480561c0 con 0x7f17580c70c0 2023-10-06T02:23:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.663+0000 7f1626ffd700 1 --2- 172.21.15.37:0/3259683209 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1610067140 0x7f16100695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.671+0000 7f160f7fe700 1 -- 172.21.15.37:0/3259683209 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1618053730 con 0x7f16280694a0 2023-10-06T02:23:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.672+0000 7f175d999700 1 --2- 172.21.15.37:0/768110958 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f173c067080 0x7f173c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:26.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.705+0000 7f1626ffd700 1 --2- 172.21.15.37:0/3259683209 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1610067140 0x7f16100695f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1628172560 tx=0x7f161c007b40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:26.716+0000 7f175d999700 1 --2- 172.21.15.37:0/768110958 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f173c067080 0x7f173c069530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1758168a30 tx=0x7f1754008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:27.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.031+0000 7f9ade734700 1 -- 172.21.15.37:0/1119511283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f9ad804bb80 con 0x7f9ad8159870 2023-10-06T02:23:27.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.033+0000 7f9abffff700 1 -- 172.21.15.37:0/1119511283 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ad0054cc0 con 0x7f9ad8159870 2023-10-06T02:23:27.039 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-10-06T02:23:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.040+0000 7f4eafc70700 1 -- 172.21.15.37:0/1807635281 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4ea8088310 con 0x7f4ea815dd40 2023-10-06T02:23:27.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.041+0000 7f9ade734700 1 -- 172.21.15.37:0/1119511283 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ac4067000 msgr2=0x7f9ac40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.041+0000 7f9ade734700 1 --2- 172.21.15.37:0/1119511283 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ac4067000 0x7f9ac40694b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8064e70 tx=0x7f9ac801a000 comp rx=0 tx=0).stop 2023-10-06T02:23:27.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.041+0000 7f9ade734700 1 -- 172.21.15.37:0/1119511283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ad8159870 msgr2=0x7f9ad80b1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.041+0000 7f9ade734700 1 --2- 172.21.15.37:0/1119511283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ad8159870 0x7f9ad80b1a70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000cd90 tx=0x7f9ad0001ad0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.041+0000 7fa093ca7700 1 -- 172.21.15.37:0/3473643512 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa08c04bb80 con 0x7fa08c098ec0 2023-10-06T02:23:27.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.042+0000 7fa081ffb700 1 -- 172.21.15.37:0/3473643512 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa088021020 con 0x7fa08c098ec0 2023-10-06T02:23:27.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.042+0000 7f4e9dffb700 1 -- 172.21.15.37:0/1807635281 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ea4054720 con 0x7f4ea815dd40 2023-10-06T02:23:27.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.042+0000 7f04e36e8700 1 -- 172.21.15.37:0/1359980197 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f04bc005830 con 0x7f04dc156580 2023-10-06T02:23:27.043 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-10-06T02:23:27.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.042+0000 7fb0d5dce700 1 -- 172.21.15.37:0/4113684441 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb0b0005830 con 0x7fb0d00ca540 2023-10-06T02:23:27.043 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-10-06T02:23:27.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.042+0000 7f04d17fa700 1 -- 172.21.15.37:0/1359980197 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f04d4054b80 con 0x7f04dc156580 2023-10-06T02:23:27.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.043+0000 7fb0b77fe700 1 -- 172.21.15.37:0/4113684441 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb0c8068370 con 0x7fb0d00ca540 2023-10-06T02:23:27.044 INFO:teuthology.orchestra.run.smithi037.stdout:55834574857 2023-10-06T02:23:27.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.044+0000 7f9ade734700 1 -- 172.21.15.37:0/1119511283 shutdown_connections 2023-10-06T02:23:27.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.044+0000 7f9ade734700 1 --2- 172.21.15.37:0/1119511283 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ad80981b0 0x7f9ad806e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.044+0000 7f9ade734700 1 --2- 172.21.15.37:0/1119511283 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ac4067000 0x7f9ac40694b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.044+0000 7f9ade734700 1 --2- 172.21.15.37:0/1119511283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ad8155e70 0x7f9ad8157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.044+0000 7f9ade734700 1 --2- 172.21.15.37:0/1119511283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ad8159870 0x7f9ad80b1a70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.044+0000 7f9ade734700 1 -- 172.21.15.37:0/1119511283 >> 172.21.15.37:0/1119511283 conn(0x7f9ad80cc140 msgr2=0x7f9ad806dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.045+0000 7f4eafc70700 1 -- 172.21.15.37:0/1807635281 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4e8c067000 msgr2=0x7f4e8c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.045+0000 7f4eafc70700 1 --2- 172.21.15.37:0/1807635281 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4e8c067000 0x7f4e8c0694b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4e98006b00 tx=0x7f4e98008040 comp rx=0 tx=0).stop 2023-10-06T02:23:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.045+0000 7f4eafc70700 1 -- 172.21.15.37:0/1807635281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ea815dd40 msgr2=0x7f4ea80c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.045+0000 7f4eafc70700 1 --2- 172.21.15.37:0/1807635281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ea815dd40 0x7f4ea80c5390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400b4c0 tx=0x7f4ea4009060 comp rx=0 tx=0).stop 2023-10-06T02:23:27.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.045+0000 7f4eafc70700 1 -- 172.21.15.37:0/1807635281 shutdown_connections 2023-10-06T02:23:27.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.045+0000 7f4eafc70700 1 --2- 172.21.15.37:0/1807635281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea8162230 0x7f4ea80ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.045+0000 7f4eafc70700 1 --2- 172.21.15.37:0/1807635281 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ea80b2890 0x7f4ea81503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.045+0000 7f4eafc70700 1 --2- 172.21.15.37:0/1807635281 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4e8c067000 0x7f4e8c0694b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.045+0000 7f4eafc70700 1 --2- 172.21.15.37:0/1807635281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ea815dd40 0x7f4ea80c5390 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.045+0000 7f4eafc70700 1 -- 172.21.15.37:0/1807635281 >> 172.21.15.37:0/1807635281 conn(0x7f4ea80ccf30 msgr2=0x7f4ea8160ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:27.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.045+0000 7f4eafc70700 1 -- 172.21.15.37:0/1807635281 shutdown_connections 2023-10-06T02:23:27.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.045+0000 7f4eafc70700 1 -- 172.21.15.37:0/1807635281 wait complete. 2023-10-06T02:23:27.048 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-10-06T02:23:27.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.046+0000 7f9ade734700 1 -- 172.21.15.37:0/1119511283 shutdown_connections 2023-10-06T02:23:27.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.046+0000 7f9ade734700 1 -- 172.21.15.37:0/1119511283 wait complete. 2023-10-06T02:23:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.045+0000 7fa093ca7700 1 -- 172.21.15.37:0/3473643512 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa070066f30 msgr2=0x7fa0700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.045+0000 7fa093ca7700 1 --2- 172.21.15.37:0/3473643512 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa070066f30 0x7fa0700693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa084005c50 tx=0x7fa084009040 comp rx=0 tx=0).stop 2023-10-06T02:23:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.046+0000 7fa093ca7700 1 -- 172.21.15.37:0/3473643512 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa08c098ec0 msgr2=0x7fa08c099340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.046+0000 7fa093ca7700 1 --2- 172.21.15.37:0/3473643512 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa08c098ec0 0x7fa08c099340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa08800ea80 tx=0x7fa0880091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.046+0000 7fa093ca7700 1 -- 172.21.15.37:0/3473643512 shutdown_connections 2023-10-06T02:23:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.046+0000 7fa093ca7700 1 --2- 172.21.15.37:0/3473643512 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa070066f30 0x7fa0700693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.046+0000 7fa093ca7700 1 --2- 172.21.15.37:0/3473643512 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa08c098ec0 0x7fa08c099340 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.046+0000 7fa093ca7700 1 --2- 172.21.15.37:0/3473643512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa08c15d8e0 0x7fa08c155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.046+0000 7fa093ca7700 1 --2- 172.21.15.37:0/3473643512 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa08c15dcb0 0x7fa08c0a4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.046+0000 7fa093ca7700 1 -- 172.21.15.37:0/3473643512 >> 172.21.15.37:0/3473643512 conn(0x7fa08c06e9d0 msgr2=0x7fa08c0cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.046+0000 7fa093ca7700 1 -- 172.21.15.37:0/3473643512 shutdown_connections 2023-10-06T02:23:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.046+0000 7fa093ca7700 1 -- 172.21.15.37:0/3473643512 wait complete. 2023-10-06T02:23:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.048+0000 7fb0d5dce700 1 -- 172.21.15.37:0/4113684441 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb0bc067000 msgr2=0x7fb0bc0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.048+0000 7fb0d5dce700 1 --2- 172.21.15.37:0/4113684441 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb0bc067000 0x7fb0bc0694b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb0d00caa50 tx=0x7fb0c4009060 comp rx=0 tx=0).stop 2023-10-06T02:23:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.048+0000 7fb0d5dce700 1 -- 172.21.15.37:0/4113684441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0d00ca540 msgr2=0x7fb0d016e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.048+0000 7fb0d5dce700 1 --2- 172.21.15.37:0/4113684441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0d00ca540 0x7fb0d016e620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb0d006ebc0 tx=0x7fb0c8018000 comp rx=0 tx=0).stop 2023-10-06T02:23:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.048+0000 7fb0d5dce700 1 -- 172.21.15.37:0/4113684441 shutdown_connections 2023-10-06T02:23:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.048+0000 7fb0d5dce700 1 --2- 172.21.15.37:0/4113684441 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0d0159700 0x7fb0d00c2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.048+0000 7fb0d5dce700 1 --2- 172.21.15.37:0/4113684441 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb0bc067000 0x7fb0bc0694b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.048+0000 7fb0d5dce700 1 --2- 172.21.15.37:0/4113684441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0d00ca540 0x7fb0d016e620 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb0d006ebc0 tx=0x7fb0c8018000 comp rx=0 tx=0).stop 2023-10-06T02:23:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.048+0000 7fb0d5dce700 1 --2- 172.21.15.37:0/4113684441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0d0159330 0x7fb0d00aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.048+0000 7fb0d5dce700 1 -- 172.21.15.37:0/4113684441 >> 172.21.15.37:0/4113684441 conn(0x7fb0d00cc970 msgr2=0x7fb0d00c1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.048+0000 7f04e36e8700 1 -- 172.21.15.37:0/1359980197 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f04c0066f30 msgr2=0x7f04c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.048+0000 7f04e36e8700 1 --2- 172.21.15.37:0/1359980197 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f04c0066f30 0x7f04c00693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f04d800b470 tx=0x7f04d801b000 comp rx=0 tx=0).stop 2023-10-06T02:23:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.048+0000 7f04e36e8700 1 -- 172.21.15.37:0/1359980197 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04dc156580 msgr2=0x7f04dc0cc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.048+0000 7f04e36e8700 1 --2- 172.21.15.37:0/1359980197 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04dc156580 0x7f04dc0cc070 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f04d400bad0 tx=0x7f04d4009780 comp rx=0 tx=0).stop 2023-10-06T02:23:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.049+0000 7f406112b700 1 -- 172.21.15.37:0/3049259815 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f403c005830 con 0x7f405c06e8d0 2023-10-06T02:23:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.049+0000 7f4042ffd700 1 -- 172.21.15.37:0/3049259815 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4050017070 con 0x7f405c06e8d0 2023-10-06T02:23:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.050+0000 7fb0d5dce700 1 -- 172.21.15.37:0/4113684441 shutdown_connections 2023-10-06T02:23:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.050+0000 7fb0d5dce700 1 -- 172.21.15.37:0/4113684441 wait complete. 2023-10-06T02:23:27.053 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-10-06T02:23:27.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.057+0000 7f04e36e8700 1 -- 172.21.15.37:0/1359980197 shutdown_connections 2023-10-06T02:23:27.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.057+0000 7f04e36e8700 1 --2- 172.21.15.37:0/1359980197 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04dc156580 0x7f04dc0cc070 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.057+0000 7f04e36e8700 1 --2- 172.21.15.37:0/1359980197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04dc0cd400 0x7f04dc152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.057+0000 7f04e36e8700 1 --2- 172.21.15.37:0/1359980197 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f04c0066f30 0x7f04c00693e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.057+0000 7f04e36e8700 1 --2- 172.21.15.37:0/1359980197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04dc0cd7d0 0x7f04dc0cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.057+0000 7f04e36e8700 1 -- 172.21.15.37:0/1359980197 >> 172.21.15.37:0/1359980197 conn(0x7f04dc06e9d0 msgr2=0x7f04dc06ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.057+0000 7f04e36e8700 1 -- 172.21.15.37:0/1359980197 shutdown_connections 2023-10-06T02:23:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.057+0000 7f04e36e8700 1 -- 172.21.15.37:0/1359980197 wait complete. 2023-10-06T02:23:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.059+0000 7f406112b700 1 -- 172.21.15.37:0/3049259815 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4048066f30 msgr2=0x7f40480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.059+0000 7f406112b700 1 --2- 172.21.15.37:0/3049259815 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4048066f30 0x7f40480693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f404c006eb0 tx=0x7f404c017000 comp rx=0 tx=0).stop 2023-10-06T02:23:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.059+0000 7f406112b700 1 -- 172.21.15.37:0/3049259815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f405c06e8d0 msgr2=0x7f405c146430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.059+0000 7f406112b700 1 --2- 172.21.15.37:0/3049259815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f405c06e8d0 0x7f405c146430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f405000c590 tx=0x7f405000c8a0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.060+0000 7f406112b700 1 -- 172.21.15.37:0/3049259815 shutdown_connections 2023-10-06T02:23:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.060+0000 7f406112b700 1 --2- 172.21.15.37:0/3049259815 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f405c1558e0 0x7f405c15b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.060+0000 7f406112b700 1 --2- 172.21.15.37:0/3049259815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c06d8a0 0x7f405c0b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.060+0000 7f406112b700 1 --2- 172.21.15.37:0/3049259815 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4048066f30 0x7f40480693e0 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f404c006eb0 tx=0x7f404c017000 comp rx=0 tx=0).stop 2023-10-06T02:23:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.060+0000 7f406112b700 1 --2- 172.21.15.37:0/3049259815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f405c06e8d0 0x7f405c146430 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.060+0000 7f406112b700 1 -- 172.21.15.37:0/3049259815 >> 172.21.15.37:0/3049259815 conn(0x7f405c0cc970 msgr2=0x7f405c0c27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.061+0000 7f17603fe700 1 -- 172.21.15.37:0/768110958 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f17580c9270 con 0x7f17580c70c0 2023-10-06T02:23:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.062+0000 7f174e7fc700 1 -- 172.21.15.37:0/768110958 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1748055d50 con 0x7f17580c70c0 2023-10-06T02:23:27.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-10-06T02:23:27.065 DEBUG:teuthology.parallel:result is None 2023-10-06T02:23:27.067 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-10-06T02:23:27.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2023-10-06T02:23:27.068 DEBUG:teuthology.parallel:result is None 2023-10-06T02:23:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.069+0000 7f406112b700 1 -- 172.21.15.37:0/3049259815 shutdown_connections 2023-10-06T02:23:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.069+0000 7f406112b700 1 -- 172.21.15.37:0/3049259815 wait complete. 2023-10-06T02:23:27.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.069+0000 7f17603fe700 1 -- 172.21.15.37:0/768110958 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f173c067080 msgr2=0x7f173c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.069+0000 7f17603fe700 1 --2- 172.21.15.37:0/768110958 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f173c067080 0x7f173c069530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1758168a30 tx=0x7f1754008040 comp rx=0 tx=0).stop 2023-10-06T02:23:27.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.069+0000 7f17603fe700 1 -- 172.21.15.37:0/768110958 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17580c70c0 msgr2=0x7f17580c4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.069+0000 7f17603fe700 1 --2- 172.21.15.37:0/768110958 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17580c70c0 0x7f17580c4000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f174800d860 tx=0x7f1748008040 comp rx=0 tx=0).stop 2023-10-06T02:23:27.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.069+0000 7f17603fe700 1 -- 172.21.15.37:0/768110958 shutdown_connections 2023-10-06T02:23:27.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.069+0000 7f17603fe700 1 --2- 172.21.15.37:0/768110958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f175815e010 0x7f17580c5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.069+0000 7f17603fe700 1 --2- 172.21.15.37:0/768110958 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f173c067080 0x7f173c069530 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.069+0000 7f17603fe700 1 --2- 172.21.15.37:0/768110958 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17580c70c0 0x7f17580c4000 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.069+0000 7f17603fe700 1 --2- 172.21.15.37:0/768110958 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1758158220 0x7f175814c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.069+0000 7f17603fe700 1 -- 172.21.15.37:0/768110958 >> 172.21.15.37:0/768110958 conn(0x7f175806ebf0 msgr2=0x7f1758151a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.069+0000 7f17603fe700 1 -- 172.21.15.37:0/768110958 shutdown_connections 2023-10-06T02:23:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.069+0000 7f17603fe700 1 -- 172.21.15.37:0/768110958 wait complete. 2023-10-06T02:23:27.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2023-10-06T02:23:27.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.073+0000 7f162dc38700 1 -- 172.21.15.37:0/3259683209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1608005160 con 0x7f16280694a0 2023-10-06T02:23:27.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.074+0000 7f160f7fe700 1 -- 172.21.15.37:0/3259683209 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1618056d50 con 0x7f16280694a0 2023-10-06T02:23:27.075 DEBUG:teuthology.parallel:result is None 2023-10-06T02:23:27.075 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-10-06T02:23:27.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.076+0000 7f162dc38700 1 -- 172.21.15.37:0/3259683209 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1610067140 msgr2=0x7f16100695f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.076+0000 7f162dc38700 1 --2- 172.21.15.37:0/3259683209 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1610067140 0x7f16100695f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1628172560 tx=0x7f161c007b40 comp rx=0 tx=0).stop 2023-10-06T02:23:27.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.076+0000 7f162dc38700 1 -- 172.21.15.37:0/3259683209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16280694a0 msgr2=0x7f16280c76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.076+0000 7f162dc38700 1 --2- 172.21.15.37:0/3259683209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16280694a0 0x7f16280c76b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f162806a660 tx=0x7f1618018000 comp rx=0 tx=0).stop 2023-10-06T02:23:27.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.076+0000 7f162dc38700 1 -- 172.21.15.37:0/3259683209 shutdown_connections 2023-10-06T02:23:27.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.076+0000 7f162dc38700 1 --2- 172.21.15.37:0/3259683209 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f162806d7e0 0x7f1628155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.076+0000 7f162dc38700 1 --2- 172.21.15.37:0/3259683209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16280694a0 0x7f16280c76b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.076+0000 7f162dc38700 1 --2- 172.21.15.37:0/3259683209 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1610067140 0x7f16100695f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.076+0000 7f162dc38700 1 --2- 172.21.15.37:0/3259683209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f162806d410 0x7f1628160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.076+0000 7f162dc38700 1 -- 172.21.15.37:0/3259683209 >> 172.21.15.37:0/3259683209 conn(0x7f1628067b30 msgr2=0x7f16280c8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:27.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.076+0000 7f162dc38700 1 -- 172.21.15.37:0/3259683209 shutdown_connections 2023-10-06T02:23:27.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.078+0000 7f162dc38700 1 -- 172.21.15.37:0/3259683209 wait complete. 2023-10-06T02:23:27.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-10-06T02:23:27.081 DEBUG:teuthology.parallel:result is None 2023-10-06T02:23:27.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2023-10-06T02:23:27.083 DEBUG:teuthology.parallel:result is None 2023-10-06T02:23:27.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-10-06T02:23:27.090 DEBUG:teuthology.parallel:result is None 2023-10-06T02:23:27.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-10-06T02:23:27.094 DEBUG:teuthology.parallel:result is None 2023-10-06T02:23:27.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2023-10-06T02:23:27.095 DEBUG:teuthology.parallel:result is None 2023-10-06T02:23:27.095 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T02:23:27.095 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:23:27.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.255+0000 7fb3ff234700 1 Processor -- start 2023-10-06T02:23:27.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.255+0000 7fb3ff234700 1 -- start start 2023-10-06T02:23:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.256+0000 7fb3ff234700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb3f8159760 0x7fb3f815d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.256+0000 7fb3ff234700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb3f815dd50 0x7fb3f80cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.256+0000 7fb3ff234700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f815e1d0 con 0x7fb3f815d8d0 2023-10-06T02:23:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.256+0000 7fb3ff234700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f80cc2d0 con 0x7fb3f815dd50 2023-10-06T02:23:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.256+0000 7fb3ff234700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f80cb650 con 0x7fb3f8159760 2023-10-06T02:23:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.256+0000 7fb3fd7d1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb3f815dd50 0x7fb3f80cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.256+0000 7fb3fd7d1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb3f815dd50 0x7fb3f80cfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42218/0 (socket says 172.21.15.37:42218) 2023-10-06T02:23:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.256+0000 7fb3fd7d1700 1 -- 172.21.15.37:0/3929144866 learned_addr learned my addr 172.21.15.37:0/3929144866 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.256+0000 7fb3fcfd0700 1 --2- 172.21.15.37:0/3929144866 >> v2:172.21.15.191:3300/0 conn(0x7fb3f8159760 0x7fb3f815d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.256+0000 7fb3fd7d1700 1 -- 172.21.15.37:0/3929144866 >> v2:172.21.15.191:3300/0 conn(0x7fb3f8159760 msgr2=0x7fb3f815d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.256+0000 7fb3fd7d1700 1 --2- 172.21.15.37:0/3929144866 >> v2:172.21.15.191:3300/0 conn(0x7fb3f8159760 0x7fb3f815d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.256+0000 7fb3fd7d1700 1 -- 172.21.15.37:0/3929144866 >> v1:172.21.15.191:6789/0 conn(0x7fb3f815d8d0 legacy=0x7fb3f80c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.256+0000 7fb3fd7d1700 1 -- 172.21.15.37:0/3929144866 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f80cb930 con 0x7fb3f815dd50 2023-10-06T02:23:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.257+0000 7fb3fd7d1700 1 --2- 172.21.15.37:0/3929144866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3f815dd50 0x7fb3f80cfc00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb3f80897f0 tx=0x7fb3e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183dd32da4efefd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.257+0000 7fb3f77fe700 1 -- 172.21.15.37:0/3929144866 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e800b8b0 con 0x7fb3f815dd50 2023-10-06T02:23:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.257+0000 7fb3f77fe700 1 -- 172.21.15.37:0/3929144866 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e800ba10 con 0x7fb3f815dd50 2023-10-06T02:23:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.257+0000 7fb3f77fe700 1 -- 172.21.15.37:0/3929144866 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e800bdb0 con 0x7fb3f815dd50 2023-10-06T02:23:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.257+0000 7fb3ff234700 1 -- 172.21.15.37:0/3929144866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3f815dd50 msgr2=0x7fb3f80cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.257+0000 7fb3ff234700 1 --2- 172.21.15.37:0/3929144866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3f815dd50 0x7fb3f80cfc00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb3f80897f0 tx=0x7fb3e8009250 comp rx=0 tx=0).stop 2023-10-06T02:23:27.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.257+0000 7fb3ff234700 1 -- 172.21.15.37:0/3929144866 shutdown_connections 2023-10-06T02:23:27.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.257+0000 7fb3ff234700 1 --2- 172.21.15.37:0/3929144866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3f815dd50 0x7fb3f80cfc00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.257+0000 7fb3ff234700 1 --2- 172.21.15.37:0/3929144866 >> v2:172.21.15.191:3300/0 conn(0x7fb3f8159760 0x7fb3f815d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.257+0000 7fb3ff234700 1 -- 172.21.15.37:0/3929144866 >> 172.21.15.37:0/3929144866 conn(0x7fb3f806c890 msgr2=0x7fb3f80d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:27.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.257+0000 7fb3ff234700 1 -- 172.21.15.37:0/3929144866 shutdown_connections 2023-10-06T02:23:27.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.257+0000 7fb3ff234700 1 -- 172.21.15.37:0/3929144866 wait complete. 2023-10-06T02:23:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.258+0000 7fb3ff234700 1 Processor -- start 2023-10-06T02:23:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.259+0000 7fb3ff234700 1 -- start start 2023-10-06T02:23:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.259+0000 7fb3ff234700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3f8159760 0x7fb3f80b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.259+0000 7fb3ff234700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3f815d8d0 0x7fb3f813f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.259+0000 7fb3ff234700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3f815dd50 0x7fb3f80b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.259+0000 7fb3ff234700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f815b0f0 con 0x7fb3f815d8d0 2023-10-06T02:23:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.259+0000 7fb3ff234700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f815a4e0 con 0x7fb3f8159760 2023-10-06T02:23:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.259+0000 7fb3ff234700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f815a7c0 con 0x7fb3f815dd50 2023-10-06T02:23:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.259+0000 7fb3f7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3f815d8d0 0x7fb3f813f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.260+0000 7fb3f7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3f815d8d0 0x7fb3f813f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42220/0 (socket says 172.21.15.37:42220) 2023-10-06T02:23:27.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.260+0000 7fb3f7fff700 1 -- 172.21.15.37:0/195014769 learned_addr learned my addr 172.21.15.37:0/195014769 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:27.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.260+0000 7fb3fcfd0700 1 --2- 172.21.15.37:0/195014769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3f8159760 0x7fb3f80b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:27.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.260+0000 7fb3fd7d1700 1 --2- 172.21.15.37:0/195014769 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3f815dd50 0x7fb3f80b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:27.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.260+0000 7fb3f7fff700 1 -- 172.21.15.37:0/195014769 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3f815dd50 msgr2=0x7fb3f80b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.260+0000 7fb3f7fff700 1 --2- 172.21.15.37:0/195014769 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3f815dd50 0x7fb3f80b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.260+0000 7fb3f7fff700 1 -- 172.21.15.37:0/195014769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3f8159760 msgr2=0x7fb3f80b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.260+0000 7fb3f7fff700 1 --2- 172.21.15.37:0/195014769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3f8159760 0x7fb3f80b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.260+0000 7fb3f7fff700 1 -- 172.21.15.37:0/195014769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e80094f0 con 0x7fb3f815d8d0 2023-10-06T02:23:27.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.260+0000 7fb3f7fff700 1 --2- 172.21.15.37:0/195014769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3f815d8d0 0x7fb3f813f690 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000c5d0 tx=0x7fb3e0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:27.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.260+0000 7fb3f4ff9700 1 -- 172.21.15.37:0/195014769 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0011590 con 0x7fb3f815d8d0 2023-10-06T02:23:27.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.260+0000 7fb3f4ff9700 1 -- 172.21.15.37:0/195014769 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e0011710 con 0x7fb3f815d8d0 2023-10-06T02:23:27.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.260+0000 7fb3ff234700 1 -- 172.21.15.37:0/195014769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f815aaa0 con 0x7fb3f815d8d0 2023-10-06T02:23:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.260+0000 7fb3f4ff9700 1 -- 172.21.15.37:0/195014769 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0011ad0 con 0x7fb3f815d8d0 2023-10-06T02:23:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.260+0000 7fb3ff234700 1 -- 172.21.15.37:0/195014769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f80b3a00 con 0x7fb3f815d8d0 2023-10-06T02:23:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.261+0000 7fb3ff234700 1 -- 172.21.15.37:0/195014769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f806fbf0 con 0x7fb3f815d8d0 2023-10-06T02:23:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.261+0000 7fb3f4ff9700 1 -- 172.21.15.37:0/195014769 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3e001c460 con 0x7fb3f815d8d0 2023-10-06T02:23:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.262+0000 7fb3f4ff9700 1 --2- 172.21.15.37:0/195014769 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb3d8066f30 0x7fb3d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.262+0000 7fb3f4ff9700 1 -- 172.21.15.37:0/195014769 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb3e00843f0 con 0x7fb3f815d8d0 2023-10-06T02:23:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.262+0000 7fb3fcfd0700 1 --2- 172.21.15.37:0/195014769 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb3d8066f30 0x7fb3d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.262+0000 7fb3fcfd0700 1 --2- 172.21.15.37:0/195014769 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb3d8066f30 0x7fb3d80693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb3f00075a0 tx=0x7fb3f00097e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:27.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.266+0000 7fb3f4ff9700 1 -- 172.21.15.37:0/195014769 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3e0051500 con 0x7fb3f815d8d0 2023-10-06T02:23:27.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.457+0000 7fb3ff234700 1 -- 172.21.15.37:0/195014769 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3f804bb80 con 0x7fb3d8066f30 2023-10-06T02:23:27.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.466+0000 7fb3f4ff9700 1 -- 172.21.15.37:0/195014769 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286855 (secure 0 0 0) 0x7fb3f804bb80 con 0x7fb3d8066f30 2023-10-06T02:23:27.469 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:27.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.469+0000 7fb3ff234700 1 -- 172.21.15.37:0/195014769 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb3d8066f30 msgr2=0x7fb3d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.469+0000 7fb3ff234700 1 --2- 172.21.15.37:0/195014769 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb3d8066f30 0x7fb3d80693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb3f00075a0 tx=0x7fb3f00097e0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.469+0000 7fb3ff234700 1 -- 172.21.15.37:0/195014769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3f815d8d0 msgr2=0x7fb3f813f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.469+0000 7fb3ff234700 1 --2- 172.21.15.37:0/195014769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3f815d8d0 0x7fb3f813f690 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000c5d0 tx=0x7fb3e0007f60 comp rx=0 tx=0).stop 2023-10-06T02:23:27.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.469+0000 7fb3ff234700 1 -- 172.21.15.37:0/195014769 shutdown_connections 2023-10-06T02:23:27.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.469+0000 7fb3ff234700 1 --2- 172.21.15.37:0/195014769 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3f815dd50 0x7fb3f80b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.469+0000 7fb3ff234700 1 --2- 172.21.15.37:0/195014769 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb3d8066f30 0x7fb3d80693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.469+0000 7fb3ff234700 1 --2- 172.21.15.37:0/195014769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3f8159760 0x7fb3f80b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.469+0000 7fb3ff234700 1 --2- 172.21.15.37:0/195014769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3f815d8d0 0x7fb3f813f690 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.469+0000 7fb3ff234700 1 -- 172.21.15.37:0/195014769 >> 172.21.15.37:0/195014769 conn(0x7fb3f806c890 msgr2=0x7fb3f806ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:27.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.469+0000 7fb3ff234700 1 -- 172.21.15.37:0/195014769 shutdown_connections 2023-10-06T02:23:27.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.469+0000 7fb3ff234700 1 -- 172.21.15.37:0/195014769 wait complete. 2023-10-06T02:23:27.472 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:23:27.481 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-06T02:23:26.510200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381116,"kb_used_data":2812,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593604,"statfs":{"total":773094113280,"available":770655850496,"internally_reserved":0,"allocated":2879488,"data_stored":1774761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002432"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919168+0000","last_change":"2023-10-06T02:23:15.908982+0000","last_active":"2023-10-06T02:23:15.919168+0000","last_peered":"2023-10-06T02:23:15.919168+0000","last_clean":"2023-10-06T02:23:15.919168+0000","last_became_active":"2023-10-06T02:23:15.908698+0000","last_became_peered":"2023-10-06T02:23:15.908698+0000","last_unstale":"2023-10-06T02:23:15.919168+0000","last_undegraded":"2023-10-06T02:23:15.919168+0000","last_fullsized":"2023-10-06T02:23:15.919168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:10.934479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913252+0000","last_change":"2023-10-06T02:23:15.912067+0000","last_active":"2023-10-06T02:23:15.913252+0000","last_peered":"2023-10-06T02:23:15.913252+0000","last_clean":"2023-10-06T02:23:15.913252+0000","last_became_active":"2023-10-06T02:23:15.911773+0000","last_became_peered":"2023-10-06T02:23:15.911773+0000","last_unstale":"2023-10-06T02:23:15.913252+0000","last_undegraded":"2023-10-06T02:23:15.913252+0000","last_fullsized":"2023-10-06T02:23:15.913252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:29.341324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910351+0000","last_change":"2023-10-06T02:23:15.897603+0000","last_active":"2023-10-06T02:23:15.910351+0000","last_peered":"2023-10-06T02:23:15.910351+0000","last_clean":"2023-10-06T02:23:15.910351+0000","last_became_active":"2023-10-06T02:23:15.897331+0000","last_became_peered":"2023-10-06T02:23:15.897331+0000","last_unstale":"2023-10-06T02:23:15.910351+0000","last_undegraded":"2023-10-06T02:23:15.910351+0000","last_fullsized":"2023-10-06T02:23:15.910351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:22.459072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.909617+0000","last_change":"2023-10-06T02:23:15.906142+0000","last_active":"2023-10-06T02:23:15.909617+0000","last_peered":"2023-10-06T02:23:15.909617+0000","last_clean":"2023-10-06T02:23:15.909617+0000","last_became_active":"2023-10-06T02:23:15.905889+0000","last_became_peered":"2023-10-06T02:23:15.905889+0000","last_unstale":"2023-10-06T02:23:15.909617+0000","last_undegraded":"2023-10-06T02:23:15.909617+0000","last_fullsized":"2023-10-06T02:23:15.909617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:41.861335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915400+0000","last_change":"2023-10-06T02:23:15.903558+0000","last_active":"2023-10-06T02:23:15.915400+0000","last_peered":"2023-10-06T02:23:15.915400+0000","last_clean":"2023-10-06T02:23:15.915400+0000","last_became_active":"2023-10-06T02:23:15.903280+0000","last_became_peered":"2023-10-06T02:23:15.903280+0000","last_unstale":"2023-10-06T02:23:15.915400+0000","last_undegraded":"2023-10-06T02:23:15.915400+0000","last_fullsized":"2023-10-06T02:23:15.915400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.911955+0000","last_change":"2023-10-06T02:23:15.899437+0000","last_active":"2023-10-06T02:23:15.911955+0000","last_peered":"2023-10-06T02:23:15.911955+0000","last_clean":"2023-10-06T02:23:15.911955+0000","last_became_active":"2023-10-06T02:23:15.897553+0000","last_became_peered":"2023-10-06T02:23:15.897553+0000","last_unstale":"2023-10-06T02:23:15.911955+0000","last_undegraded":"2023-10-06T02:23:15.911955+0000","last_fullsized":"2023-10-06T02:23:15.911955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:28.665851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919223+0000","last_change":"2023-10-06T02:23:15.918090+0000","last_active":"2023-10-06T02:23:15.919223+0000","last_peered":"2023-10-06T02:23:15.919223+0000","last_clean":"2023-10-06T02:23:15.919223+0000","last_became_active":"2023-10-06T02:23:15.917887+0000","last_became_peered":"2023-10-06T02:23:15.917887+0000","last_unstale":"2023-10-06T02:23:15.919223+0000","last_undegraded":"2023-10-06T02:23:15.919223+0000","last_fullsized":"2023-10-06T02:23:15.919223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.903010+0000","last_change":"2023-10-06T02:23:15.899230+0000","last_active":"2023-10-06T02:23:15.903010+0000","last_peered":"2023-10-06T02:23:15.903010+0000","last_clean":"2023-10-06T02:23:15.903010+0000","last_became_active":"2023-10-06T02:23:15.898928+0000","last_became_peered":"2023-10-06T02:23:15.898928+0000","last_unstale":"2023-10-06T02:23:15.903010+0000","last_undegraded":"2023-10-06T02:23:15.903010+0000","last_fullsized":"2023-10-06T02:23:15.903010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:58.461395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913512+0000","last_change":"2023-10-06T02:23:15.906778+0000","last_active":"2023-10-06T02:23:15.913512+0000","last_peered":"2023-10-06T02:23:15.913512+0000","last_clean":"2023-10-06T02:23:15.913512+0000","last_became_active":"2023-10-06T02:23:15.906117+0000","last_became_peered":"2023-10-06T02:23:15.906117+0000","last_unstale":"2023-10-06T02:23:15.913512+0000","last_undegraded":"2023-10-06T02:23:15.913512+0000","last_fullsized":"2023-10-06T02:23:15.913512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.899401+0000","last_change":"2023-10-06T02:23:15.897067+0000","last_active":"2023-10-06T02:23:15.899401+0000","last_peered":"2023-10-06T02:23:15.899401+0000","last_clean":"2023-10-06T02:23:15.899401+0000","last_became_active":"2023-10-06T02:23:15.896690+0000","last_became_peered":"2023-10-06T02:23:15.896690+0000","last_unstale":"2023-10-06T02:23:15.899401+0000","last_undegraded":"2023-10-06T02:23:15.899401+0000","last_fullsized":"2023-10-06T02:23:15.899401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912295+0000","last_change":"2023-10-06T02:23:15.904332+0000","last_active":"2023-10-06T02:23:15.912295+0000","last_peered":"2023-10-06T02:23:15.912295+0000","last_clean":"2023-10-06T02:23:15.912295+0000","last_became_active":"2023-10-06T02:23:15.904107+0000","last_became_peered":"2023-10-06T02:23:15.904107+0000","last_unstale":"2023-10-06T02:23:15.912295+0000","last_undegraded":"2023-10-06T02:23:15.912295+0000","last_fullsized":"2023-10-06T02:23:15.912295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:08.354390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919232+0000","last_change":"2023-10-06T02:23:15.914369+0000","last_active":"2023-10-06T02:23:15.919232+0000","last_peered":"2023-10-06T02:23:15.919232+0000","last_clean":"2023-10-06T02:23:15.919232+0000","last_became_active":"2023-10-06T02:23:15.914083+0000","last_became_peered":"2023-10-06T02:23:15.914083+0000","last_unstale":"2023-10-06T02:23:15.919232+0000","last_undegraded":"2023-10-06T02:23:15.919232+0000","last_fullsized":"2023-10-06T02:23:15.919232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:26.544836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919123+0000","last_change":"2023-10-06T02:23:15.911961+0000","last_active":"2023-10-06T02:23:15.919123+0000","last_peered":"2023-10-06T02:23:15.919123+0000","last_clean":"2023-10-06T02:23:15.919123+0000","last_became_active":"2023-10-06T02:23:15.911674+0000","last_became_peered":"2023-10-06T02:23:15.911674+0000","last_unstale":"2023-10-06T02:23:15.919123+0000","last_undegraded":"2023-10-06T02:23:15.919123+0000","last_fullsized":"2023-10-06T02:23:15.919123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:48.704425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.911125+0000","last_change":"2023-10-06T02:23:15.909666+0000","last_active":"2023-10-06T02:23:15.911125+0000","last_peered":"2023-10-06T02:23:15.911125+0000","last_clean":"2023-10-06T02:23:15.911125+0000","last_became_active":"2023-10-06T02:23:15.909184+0000","last_became_peered":"2023-10-06T02:23:15.909184+0000","last_unstale":"2023-10-06T02:23:15.911125+0000","last_undegraded":"2023-10-06T02:23:15.911125+0000","last_fullsized":"2023-10-06T02:23:15.911125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:21.310729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919252+0000","last_change":"2023-10-06T02:23:15.918152+0000","last_active":"2023-10-06T02:23:15.919252+0000","last_peered":"2023-10-06T02:23:15.919252+0000","last_clean":"2023-10-06T02:23:15.919252+0000","last_became_active":"2023-10-06T02:23:15.917956+0000","last_became_peered":"2023-10-06T02:23:15.917956+0000","last_unstale":"2023-10-06T02:23:15.919252+0000","last_undegraded":"2023-10-06T02:23:15.919252+0000","last_fullsized":"2023-10-06T02:23:15.919252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.082330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910937+0000","last_change":"2023-10-06T02:23:15.898556+0000","last_active":"2023-10-06T02:23:15.910937+0000","last_peered":"2023-10-06T02:23:15.910937+0000","last_clean":"2023-10-06T02:23:15.910937+0000","last_became_active":"2023-10-06T02:23:15.897898+0000","last_became_peered":"2023-10-06T02:23:15.897898+0000","last_unstale":"2023-10-06T02:23:15.910937+0000","last_undegraded":"2023-10-06T02:23:15.910937+0000","last_fullsized":"2023-10-06T02:23:15.910937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:33.357066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913539+0000","last_change":"2023-10-06T02:23:15.906966+0000","last_active":"2023-10-06T02:23:15.913539+0000","last_peered":"2023-10-06T02:23:15.913539+0000","last_clean":"2023-10-06T02:23:15.913539+0000","last_became_active":"2023-10-06T02:23:15.906471+0000","last_became_peered":"2023-10-06T02:23:15.906471+0000","last_unstale":"2023-10-06T02:23:15.913539+0000","last_undegraded":"2023-10-06T02:23:15.913539+0000","last_fullsized":"2023-10-06T02:23:15.913539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.082330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912480+0000","last_change":"2023-10-06T02:23:15.909298+0000","last_active":"2023-10-06T02:23:15.912480+0000","last_peered":"2023-10-06T02:23:15.912480+0000","last_clean":"2023-10-06T02:23:15.912480+0000","last_became_active":"2023-10-06T02:23:15.908984+0000","last_became_peered":"2023-10-06T02:23:15.908984+0000","last_unstale":"2023-10-06T02:23:15.912480+0000","last_undegraded":"2023-10-06T02:23:15.912480+0000","last_fullsized":"2023-10-06T02:23:15.912480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:45.070037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919178+0000","last_change":"2023-10-06T02:23:15.908066+0000","last_active":"2023-10-06T02:23:15.919178+0000","last_peered":"2023-10-06T02:23:15.919178+0000","last_clean":"2023-10-06T02:23:15.919178+0000","last_became_active":"2023-10-06T02:23:15.907732+0000","last_became_peered":"2023-10-06T02:23:15.907732+0000","last_unstale":"2023-10-06T02:23:15.919178+0000","last_undegraded":"2023-10-06T02:23:15.919178+0000","last_fullsized":"2023-10-06T02:23:15.919178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:08.585650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913105+0000","last_change":"2023-10-06T02:23:15.907581+0000","last_active":"2023-10-06T02:23:15.913105+0000","last_peered":"2023-10-06T02:23:15.913105+0000","last_clean":"2023-10-06T02:23:15.913105+0000","last_became_active":"2023-10-06T02:23:15.905503+0000","last_became_peered":"2023-10-06T02:23:15.905503+0000","last_unstale":"2023-10-06T02:23:15.913105+0000","last_undegraded":"2023-10-06T02:23:15.913105+0000","last_fullsized":"2023-10-06T02:23:15.913105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:18.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916852+0000","last_change":"2023-10-06T02:23:15.914944+0000","last_active":"2023-10-06T02:23:15.916852+0000","last_peered":"2023-10-06T02:23:15.916852+0000","last_clean":"2023-10-06T02:23:15.916852+0000","last_became_active":"2023-10-06T02:23:15.914700+0000","last_became_peered":"2023-10-06T02:23:15.914700+0000","last_unstale":"2023-10-06T02:23:15.916852+0000","last_undegraded":"2023-10-06T02:23:15.916852+0000","last_fullsized":"2023-10-06T02:23:15.916852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920587+0000","last_change":"2023-10-06T02:23:15.913463+0000","last_active":"2023-10-06T02:23:15.920587+0000","last_peered":"2023-10-06T02:23:15.920587+0000","last_clean":"2023-10-06T02:23:15.920587+0000","last_became_active":"2023-10-06T02:23:15.913127+0000","last_became_peered":"2023-10-06T02:23:15.913127+0000","last_unstale":"2023-10-06T02:23:15.920587+0000","last_undegraded":"2023-10-06T02:23:15.920587+0000","last_fullsized":"2023-10-06T02:23:15.920587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:33.357066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920526+0000","last_change":"2023-10-06T02:23:15.914489+0000","last_active":"2023-10-06T02:23:15.920526+0000","last_peered":"2023-10-06T02:23:15.920526+0000","last_clean":"2023-10-06T02:23:15.920526+0000","last_became_active":"2023-10-06T02:23:15.914221+0000","last_became_peered":"2023-10-06T02:23:15.914221+0000","last_unstale":"2023-10-06T02:23:15.920526+0000","last_undegraded":"2023-10-06T02:23:15.920526+0000","last_fullsized":"2023-10-06T02:23:15.920526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:45.070037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.917128+0000","last_change":"2023-10-06T02:23:15.914958+0000","last_active":"2023-10-06T02:23:15.917128+0000","last_peered":"2023-10-06T02:23:15.917128+0000","last_clean":"2023-10-06T02:23:15.917128+0000","last_became_active":"2023-10-06T02:23:15.914682+0000","last_became_peered":"2023-10-06T02:23:15.914682+0000","last_unstale":"2023-10-06T02:23:15.917128+0000","last_undegraded":"2023-10-06T02:23:15.917128+0000","last_fullsized":"2023-10-06T02:23:15.917128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915313+0000","last_change":"2023-10-06T02:23:15.907412+0000","last_active":"2023-10-06T02:23:15.915313+0000","last_peered":"2023-10-06T02:23:15.915313+0000","last_clean":"2023-10-06T02:23:15.915313+0000","last_became_active":"2023-10-06T02:23:15.906449+0000","last_became_peered":"2023-10-06T02:23:15.906449+0000","last_unstale":"2023-10-06T02:23:15.915313+0000","last_undegraded":"2023-10-06T02:23:15.915313+0000","last_fullsized":"2023-10-06T02:23:15.915313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:32.631860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919905+0000","last_change":"2023-10-06T02:23:15.912982+0000","last_active":"2023-10-06T02:23:15.919905+0000","last_peered":"2023-10-06T02:23:15.919905+0000","last_clean":"2023-10-06T02:23:15.919905+0000","last_became_active":"2023-10-06T02:23:15.910404+0000","last_became_peered":"2023-10-06T02:23:15.910404+0000","last_unstale":"2023-10-06T02:23:15.919905+0000","last_undegraded":"2023-10-06T02:23:15.919905+0000","last_fullsized":"2023-10-06T02:23:15.919905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:56.873370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.918347+0000","last_change":"2023-10-06T02:23:15.916449+0000","last_active":"2023-10-06T02:23:15.918347+0000","last_peered":"2023-10-06T02:23:15.918347+0000","last_clean":"2023-10-06T02:23:15.918347+0000","last_became_active":"2023-10-06T02:23:15.915750+0000","last_became_peered":"2023-10-06T02:23:15.915750+0000","last_unstale":"2023-10-06T02:23:15.918347+0000","last_undegraded":"2023-10-06T02:23:15.918347+0000","last_fullsized":"2023-10-06T02:23:15.918347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910324+0000","last_change":"2023-10-06T02:23:14.907348+0000","last_active":"2023-10-06T02:23:15.910324+0000","last_peered":"2023-10-06T02:23:15.910324+0000","last_clean":"2023-10-06T02:23:15.910324+0000","last_became_active":"2023-10-06T02:23:14.907035+0000","last_became_peered":"2023-10-06T02:23:14.907035+0000","last_unstale":"2023-10-06T02:23:15.910324+0000","last_undegraded":"2023-10-06T02:23:15.910324+0000","last_fullsized":"2023-10-06T02:23:15.910324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:12.131483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.906846+0000","last_change":"2023-10-06T02:23:15.902629+0000","last_active":"2023-10-06T02:23:15.906846+0000","last_peered":"2023-10-06T02:23:15.906846+0000","last_clean":"2023-10-06T02:23:15.906846+0000","last_became_active":"2023-10-06T02:23:15.902328+0000","last_became_peered":"2023-10-06T02:23:15.902328+0000","last_unstale":"2023-10-06T02:23:15.906846+0000","last_undegraded":"2023-10-06T02:23:15.906846+0000","last_fullsized":"2023-10-06T02:23:15.906846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:11.466544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.900770+0000","last_change":"2023-10-06T02:23:14.908961+0000","last_active":"2023-10-06T02:23:15.900770+0000","last_peered":"2023-10-06T02:23:15.900770+0000","last_clean":"2023-10-06T02:23:15.900770+0000","last_became_active":"2023-10-06T02:23:14.908549+0000","last_became_peered":"2023-10-06T02:23:14.908549+0000","last_unstale":"2023-10-06T02:23:15.900770+0000","last_undegraded":"2023-10-06T02:23:15.900770+0000","last_fullsized":"2023-10-06T02:23:15.900770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:37.900811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.925219+0000","last_change":"2023-10-06T02:23:15.921091+0000","last_active":"2023-10-06T02:23:15.925219+0000","last_peered":"2023-10-06T02:23:15.925219+0000","last_clean":"2023-10-06T02:23:15.925219+0000","last_became_active":"2023-10-06T02:23:15.920772+0000","last_became_peered":"2023-10-06T02:23:15.920772+0000","last_unstale":"2023-10-06T02:23:15.925219+0000","last_undegraded":"2023-10-06T02:23:15.925219+0000","last_fullsized":"2023-10-06T02:23:15.925219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:58.461395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.896633+0000","last_change":"2023-10-06T02:23:14.905101+0000","last_active":"2023-10-06T02:23:15.896633+0000","last_peered":"2023-10-06T02:23:15.896633+0000","last_clean":"2023-10-06T02:23:15.896633+0000","last_became_active":"2023-10-06T02:23:14.902379+0000","last_became_peered":"2023-10-06T02:23:14.902379+0000","last_unstale":"2023-10-06T02:23:15.896633+0000","last_undegraded":"2023-10-06T02:23:15.896633+0000","last_fullsized":"2023-10-06T02:23:15.896633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.054986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910630+0000","last_change":"2023-10-06T02:23:15.908338+0000","last_active":"2023-10-06T02:23:15.910630+0000","last_peered":"2023-10-06T02:23:15.910630+0000","last_clean":"2023-10-06T02:23:15.910630+0000","last_became_active":"2023-10-06T02:23:15.907880+0000","last_became_peered":"2023-10-06T02:23:15.907880+0000","last_unstale":"2023-10-06T02:23:15.910630+0000","last_undegraded":"2023-10-06T02:23:15.910630+0000","last_fullsized":"2023-10-06T02:23:15.910630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.350772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.889655+0000","last_change":"2023-10-06T02:23:14.904479+0000","last_active":"2023-10-06T02:23:15.889655+0000","last_peered":"2023-10-06T02:23:15.889655+0000","last_clean":"2023-10-06T02:23:15.889655+0000","last_became_active":"2023-10-06T02:23:14.904187+0000","last_became_peered":"2023-10-06T02:23:14.904187+0000","last_unstale":"2023-10-06T02:23:15.889655+0000","last_undegraded":"2023-10-06T02:23:15.889655+0000","last_fullsized":"2023-10-06T02:23:15.889655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:09.928957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912505+0000","last_change":"2023-10-06T02:23:15.905556+0000","last_active":"2023-10-06T02:23:15.912505+0000","last_peered":"2023-10-06T02:23:15.912505+0000","last_clean":"2023-10-06T02:23:15.912505+0000","last_became_active":"2023-10-06T02:23:15.905335+0000","last_became_peered":"2023-10-06T02:23:15.905335+0000","last_unstale":"2023-10-06T02:23:15.912505+0000","last_undegraded":"2023-10-06T02:23:15.912505+0000","last_fullsized":"2023-10-06T02:23:15.912505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:18.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.892042+0000","last_change":"2023-10-06T02:23:14.900860+0000","last_active":"2023-10-06T02:23:15.892042+0000","last_peered":"2023-10-06T02:23:15.892042+0000","last_clean":"2023-10-06T02:23:15.892042+0000","last_became_active":"2023-10-06T02:23:14.900471+0000","last_became_peered":"2023-10-06T02:23:14.900471+0000","last_unstale":"2023-10-06T02:23:15.892042+0000","last_undegraded":"2023-10-06T02:23:15.892042+0000","last_fullsized":"2023-10-06T02:23:15.892042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:09.928957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920751+0000","last_change":"2023-10-06T02:23:15.917245+0000","last_active":"2023-10-06T02:23:15.920751+0000","last_peered":"2023-10-06T02:23:15.920751+0000","last_clean":"2023-10-06T02:23:15.920751+0000","last_became_active":"2023-10-06T02:23:15.916930+0000","last_became_peered":"2023-10-06T02:23:15.916930+0000","last_unstale":"2023-10-06T02:23:15.920751+0000","last_undegraded":"2023-10-06T02:23:15.920751+0000","last_fullsized":"2023-10-06T02:23:15.920751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:29.341324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915462+0000","last_change":"2023-10-06T02:23:14.908736+0000","last_active":"2023-10-06T02:23:15.915462+0000","last_peered":"2023-10-06T02:23:15.915462+0000","last_clean":"2023-10-06T02:23:15.915462+0000","last_became_active":"2023-10-06T02:23:14.908432+0000","last_became_peered":"2023-10-06T02:23:14.908432+0000","last_unstale":"2023-10-06T02:23:15.915462+0000","last_undegraded":"2023-10-06T02:23:15.915462+0000","last_fullsized":"2023-10-06T02:23:15.915462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:12.345251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.911912+0000","last_change":"2023-10-06T02:23:15.906639+0000","last_active":"2023-10-06T02:23:15.911912+0000","last_peered":"2023-10-06T02:23:15.911912+0000","last_clean":"2023-10-06T02:23:15.911912+0000","last_became_active":"2023-10-06T02:23:15.906358+0000","last_became_peered":"2023-10-06T02:23:15.906358+0000","last_unstale":"2023-10-06T02:23:15.911912+0000","last_undegraded":"2023-10-06T02:23:15.911912+0000","last_fullsized":"2023-10-06T02:23:15.911912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:41.861335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919121+0000","last_change":"2023-10-06T02:23:14.904865+0000","last_active":"2023-10-06T02:23:15.919121+0000","last_peered":"2023-10-06T02:23:15.919121+0000","last_clean":"2023-10-06T02:23:15.919121+0000","last_became_active":"2023-10-06T02:23:14.904563+0000","last_became_peered":"2023-10-06T02:23:14.904563+0000","last_unstale":"2023-10-06T02:23:15.919121+0000","last_undegraded":"2023-10-06T02:23:15.919121+0000","last_fullsized":"2023-10-06T02:23:15.919121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:07.580128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912663+0000","last_change":"2023-10-06T02:23:15.900282+0000","last_active":"2023-10-06T02:23:15.912663+0000","last_peered":"2023-10-06T02:23:15.912663+0000","last_clean":"2023-10-06T02:23:15.912663+0000","last_became_active":"2023-10-06T02:23:15.899729+0000","last_became_peered":"2023-10-06T02:23:15.899729+0000","last_unstale":"2023-10-06T02:23:15.912663+0000","last_undegraded":"2023-10-06T02:23:15.912663+0000","last_fullsized":"2023-10-06T02:23:15.912663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:16.019119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915056+0000","last_change":"2023-10-06T02:23:14.908091+0000","last_active":"2023-10-06T02:23:15.915056+0000","last_peered":"2023-10-06T02:23:15.915056+0000","last_clean":"2023-10-06T02:23:15.915056+0000","last_became_active":"2023-10-06T02:23:14.907787+0000","last_became_peered":"2023-10-06T02:23:14.907787+0000","last_unstale":"2023-10-06T02:23:15.915056+0000","last_undegraded":"2023-10-06T02:23:15.915056+0000","last_fullsized":"2023-10-06T02:23:15.915056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:51.619050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919379+0000","last_change":"2023-10-06T02:23:15.912494+0000","last_active":"2023-10-06T02:23:15.919379+0000","last_peered":"2023-10-06T02:23:15.919379+0000","last_clean":"2023-10-06T02:23:15.919379+0000","last_became_active":"2023-10-06T02:23:15.911909+0000","last_became_peered":"2023-10-06T02:23:15.911909+0000","last_unstale":"2023-10-06T02:23:15.919379+0000","last_undegraded":"2023-10-06T02:23:15.919379+0000","last_fullsized":"2023-10-06T02:23:15.919379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:16.019119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.889128+0000","last_change":"2023-10-06T02:23:14.900521+0000","last_active":"2023-10-06T02:23:15.889128+0000","last_peered":"2023-10-06T02:23:15.889128+0000","last_clean":"2023-10-06T02:23:15.889128+0000","last_became_active":"2023-10-06T02:23:14.900208+0000","last_became_peered":"2023-10-06T02:23:14.900208+0000","last_unstale":"2023-10-06T02:23:15.889128+0000","last_undegraded":"2023-10-06T02:23:15.889128+0000","last_fullsized":"2023-10-06T02:23:15.889128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:12.131483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916972+0000","last_change":"2023-10-06T02:23:15.915762+0000","last_active":"2023-10-06T02:23:15.916972+0000","last_peered":"2023-10-06T02:23:15.916972+0000","last_clean":"2023-10-06T02:23:15.916972+0000","last_became_active":"2023-10-06T02:23:15.915415+0000","last_became_peered":"2023-10-06T02:23:15.915415+0000","last_unstale":"2023-10-06T02:23:15.916972+0000","last_undegraded":"2023-10-06T02:23:15.916972+0000","last_fullsized":"2023-10-06T02:23:15.916972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.082330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.903833+0000","last_change":"2023-10-06T02:23:14.907899+0000","last_active":"2023-10-06T02:23:15.903833+0000","last_peered":"2023-10-06T02:23:15.903833+0000","last_clean":"2023-10-06T02:23:15.903833+0000","last_became_active":"2023-10-06T02:23:14.907600+0000","last_became_peered":"2023-10-06T02:23:14.907600+0000","last_unstale":"2023-10-06T02:23:15.903833+0000","last_undegraded":"2023-10-06T02:23:15.903833+0000","last_fullsized":"2023-10-06T02:23:15.903833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:50.363282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913744+0000","last_change":"2023-10-06T02:23:15.904238+0000","last_active":"2023-10-06T02:23:15.913744+0000","last_peered":"2023-10-06T02:23:15.913744+0000","last_clean":"2023-10-06T02:23:15.913744+0000","last_became_active":"2023-10-06T02:23:15.903899+0000","last_became_peered":"2023-10-06T02:23:15.903899+0000","last_unstale":"2023-10-06T02:23:15.913744+0000","last_undegraded":"2023-10-06T02:23:15.913744+0000","last_fullsized":"2023-10-06T02:23:15.913744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:29.341324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915845+0000","last_change":"2023-10-06T02:23:14.902984+0000","last_active":"2023-10-06T02:23:15.915845+0000","last_peered":"2023-10-06T02:23:15.915845+0000","last_clean":"2023-10-06T02:23:15.915845+0000","last_became_active":"2023-10-06T02:23:14.902743+0000","last_became_peered":"2023-10-06T02:23:14.902743+0000","last_unstale":"2023-10-06T02:23:15.915845+0000","last_undegraded":"2023-10-06T02:23:15.915845+0000","last_fullsized":"2023-10-06T02:23:15.915845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:07.580128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920917+0000","last_change":"2023-10-06T02:23:15.917272+0000","last_active":"2023-10-06T02:23:15.920917+0000","last_peered":"2023-10-06T02:23:15.920917+0000","last_clean":"2023-10-06T02:23:15.920917+0000","last_became_active":"2023-10-06T02:23:15.916874+0000","last_became_peered":"2023-10-06T02:23:15.916874+0000","last_unstale":"2023-10-06T02:23:15.920917+0000","last_undegraded":"2023-10-06T02:23:15.920917+0000","last_fullsized":"2023-10-06T02:23:15.920917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:22.459072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.914495+0000","last_change":"2023-10-06T02:23:14.908202+0000","last_active":"2023-10-06T02:23:15.914495+0000","last_peered":"2023-10-06T02:23:15.914495+0000","last_clean":"2023-10-06T02:23:15.914495+0000","last_became_active":"2023-10-06T02:23:14.907936+0000","last_became_peered":"2023-10-06T02:23:14.907936+0000","last_unstale":"2023-10-06T02:23:15.914495+0000","last_undegraded":"2023-10-06T02:23:15.914495+0000","last_fullsized":"2023-10-06T02:23:15.914495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:43.560751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916861+0000","last_change":"2023-10-06T02:23:15.914877+0000","last_active":"2023-10-06T02:23:15.916861+0000","last_peered":"2023-10-06T02:23:15.916861+0000","last_clean":"2023-10-06T02:23:15.916861+0000","last_became_active":"2023-10-06T02:23:15.914592+0000","last_became_peered":"2023-10-06T02:23:15.914592+0000","last_unstale":"2023-10-06T02:23:15.916861+0000","last_undegraded":"2023-10-06T02:23:15.916861+0000","last_fullsized":"2023-10-06T02:23:15.916861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.914703+0000","last_change":"2023-10-06T02:23:14.908061+0000","last_active":"2023-10-06T02:23:15.914703+0000","last_peered":"2023-10-06T02:23:15.914703+0000","last_clean":"2023-10-06T02:23:15.914703+0000","last_became_active":"2023-10-06T02:23:14.907687+0000","last_became_peered":"2023-10-06T02:23:14.907687+0000","last_unstale":"2023-10-06T02:23:15.914703+0000","last_undegraded":"2023-10-06T02:23:15.914703+0000","last_fullsized":"2023-10-06T02:23:15.914703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:23:20.174592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912220+0000","last_change":"2023-10-06T02:23:15.907204+0000","last_active":"2023-10-06T02:23:15.912220+0000","last_peered":"2023-10-06T02:23:15.912220+0000","last_clean":"2023-10-06T02:23:15.912220+0000","last_became_active":"2023-10-06T02:23:15.906946+0000","last_became_peered":"2023-10-06T02:23:15.906946+0000","last_unstale":"2023-10-06T02:23:15.912220+0000","last_undegraded":"2023-10-06T02:23:15.912220+0000","last_fullsized":"2023-10-06T02:23:15.912220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:48.105101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915301+0000","last_change":"2023-10-06T02:23:14.907440+0000","last_active":"2023-10-06T02:23:15.915301+0000","last_peered":"2023-10-06T02:23:15.915301+0000","last_clean":"2023-10-06T02:23:15.915301+0000","last_became_active":"2023-10-06T02:23:14.907153+0000","last_became_peered":"2023-10-06T02:23:14.907153+0000","last_unstale":"2023-10-06T02:23:15.915301+0000","last_undegraded":"2023-10-06T02:23:15.915301+0000","last_fullsized":"2023-10-06T02:23:15.915301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:41.976855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913457+0000","last_change":"2023-10-06T02:23:15.910344+0000","last_active":"2023-10-06T02:23:15.913457+0000","last_peered":"2023-10-06T02:23:15.913457+0000","last_clean":"2023-10-06T02:23:15.913457+0000","last_became_active":"2023-10-06T02:23:15.910087+0000","last_became_peered":"2023-10-06T02:23:15.910087+0000","last_unstale":"2023-10-06T02:23:15.913457+0000","last_undegraded":"2023-10-06T02:23:15.913457+0000","last_fullsized":"2023-10-06T02:23:15.913457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:32.631860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.891617+0000","last_change":"2023-10-06T02:23:14.899169+0000","last_active":"2023-10-06T02:23:15.891617+0000","last_peered":"2023-10-06T02:23:15.891617+0000","last_clean":"2023-10-06T02:23:15.891617+0000","last_became_active":"2023-10-06T02:23:14.898905+0000","last_became_peered":"2023-10-06T02:23:14.898905+0000","last_unstale":"2023-10-06T02:23:15.891617+0000","last_undegraded":"2023-10-06T02:23:15.891617+0000","last_fullsized":"2023-10-06T02:23:15.891617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:25.539314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915422+0000","last_change":"2023-10-06T02:23:15.906479+0000","last_active":"2023-10-06T02:23:15.915422+0000","last_peered":"2023-10-06T02:23:15.915422+0000","last_clean":"2023-10-06T02:23:15.915422+0000","last_became_active":"2023-10-06T02:23:15.906192+0000","last_became_peered":"2023-10-06T02:23:15.906192+0000","last_unstale":"2023-10-06T02:23:15.915422+0000","last_undegraded":"2023-10-06T02:23:15.915422+0000","last_fullsized":"2023-10-06T02:23:15.915422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:22.459072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.921109+0000","last_change":"2023-10-06T02:23:14.907796+0000","last_active":"2023-10-06T02:23:15.921109+0000","last_peered":"2023-10-06T02:23:15.921109+0000","last_clean":"2023-10-06T02:23:15.921109+0000","last_became_active":"2023-10-06T02:23:14.907286+0000","last_became_peered":"2023-10-06T02:23:14.907286+0000","last_unstale":"2023-10-06T02:23:15.921109+0000","last_undegraded":"2023-10-06T02:23:15.921109+0000","last_fullsized":"2023-10-06T02:23:15.921109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:09.928957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913082+0000","last_change":"2023-10-06T02:23:15.905225+0000","last_active":"2023-10-06T02:23:15.913082+0000","last_peered":"2023-10-06T02:23:15.913082+0000","last_clean":"2023-10-06T02:23:15.913082+0000","last_became_active":"2023-10-06T02:23:15.904931+0000","last_became_peered":"2023-10-06T02:23:15.904931+0000","last_unstale":"2023-10-06T02:23:15.913082+0000","last_undegraded":"2023-10-06T02:23:15.913082+0000","last_fullsized":"2023-10-06T02:23:15.913082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:12.297625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.898775+0000","last_change":"2023-10-06T02:23:14.905972+0000","last_active":"2023-10-06T02:23:15.898775+0000","last_peered":"2023-10-06T02:23:15.898775+0000","last_clean":"2023-10-06T02:23:15.898775+0000","last_became_active":"2023-10-06T02:23:14.905683+0000","last_became_peered":"2023-10-06T02:23:14.905683+0000","last_unstale":"2023-10-06T02:23:15.898775+0000","last_undegraded":"2023-10-06T02:23:15.898775+0000","last_fullsized":"2023-10-06T02:23:15.898775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:12.131483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913680+0000","last_change":"2023-10-06T02:23:15.909799+0000","last_active":"2023-10-06T02:23:15.913680+0000","last_peered":"2023-10-06T02:23:15.913680+0000","last_clean":"2023-10-06T02:23:15.913680+0000","last_became_active":"2023-10-06T02:23:15.909263+0000","last_became_peered":"2023-10-06T02:23:15.909263+0000","last_unstale":"2023-10-06T02:23:15.913680+0000","last_undegraded":"2023-10-06T02:23:15.913680+0000","last_fullsized":"2023-10-06T02:23:15.913680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:11.466544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.892075+0000","last_change":"2023-10-06T02:23:14.898612+0000","last_active":"2023-10-06T02:23:15.892075+0000","last_peered":"2023-10-06T02:23:15.892075+0000","last_clean":"2023-10-06T02:23:15.892075+0000","last_became_active":"2023-10-06T02:23:14.898323+0000","last_became_peered":"2023-10-06T02:23:14.898323+0000","last_unstale":"2023-10-06T02:23:15.892075+0000","last_undegraded":"2023-10-06T02:23:15.892075+0000","last_fullsized":"2023-10-06T02:23:15.892075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:25.539314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912215+0000","last_change":"2023-10-06T02:23:15.906103+0000","last_active":"2023-10-06T02:23:15.912215+0000","last_peered":"2023-10-06T02:23:15.912215+0000","last_clean":"2023-10-06T02:23:15.912215+0000","last_became_active":"2023-10-06T02:23:15.905549+0000","last_became_peered":"2023-10-06T02:23:15.905549+0000","last_unstale":"2023-10-06T02:23:15.912215+0000","last_undegraded":"2023-10-06T02:23:15.912215+0000","last_fullsized":"2023-10-06T02:23:15.912215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:25.497567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.896485+0000","last_change":"2023-10-06T02:23:14.907451+0000","last_active":"2023-10-06T02:23:15.896485+0000","last_peered":"2023-10-06T02:23:15.896485+0000","last_clean":"2023-10-06T02:23:15.896485+0000","last_became_active":"2023-10-06T02:23:14.907166+0000","last_became_peered":"2023-10-06T02:23:14.907166+0000","last_unstale":"2023-10-06T02:23:15.896485+0000","last_undegraded":"2023-10-06T02:23:15.896485+0000","last_fullsized":"2023-10-06T02:23:15.896485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:51.619050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920149+0000","last_change":"2023-10-06T02:23:15.916593+0000","last_active":"2023-10-06T02:23:15.920149+0000","last_peered":"2023-10-06T02:23:15.920149+0000","last_clean":"2023-10-06T02:23:15.920149+0000","last_became_active":"2023-10-06T02:23:15.916288+0000","last_became_peered":"2023-10-06T02:23:15.916288+0000","last_unstale":"2023-10-06T02:23:15.920149+0000","last_undegraded":"2023-10-06T02:23:15.920149+0000","last_fullsized":"2023-10-06T02:23:15.920149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.917451+0000","last_change":"2023-10-06T02:23:14.904396+0000","last_active":"2023-10-06T02:23:15.917451+0000","last_peered":"2023-10-06T02:23:15.917451+0000","last_clean":"2023-10-06T02:23:15.917451+0000","last_became_active":"2023-10-06T02:23:14.903093+0000","last_became_peered":"2023-10-06T02:23:14.903093+0000","last_unstale":"2023-10-06T02:23:15.917451+0000","last_undegraded":"2023-10-06T02:23:15.917451+0000","last_fullsized":"2023-10-06T02:23:15.917451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:47.698904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.893190+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:23:15.893190+0000","last_peered":"2023-10-06T02:23:15.893190+0000","last_clean":"2023-10-06T02:23:15.893190+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:23:15.893190+0000","last_undegraded":"2023-10-06T02:23:15.893190+0000","last_fullsized":"2023-10-06T02:23:15.893190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920866+0000","last_change":"2023-10-06T02:23:15.917453+0000","last_active":"2023-10-06T02:23:15.920866+0000","last_peered":"2023-10-06T02:23:15.920866+0000","last_clean":"2023-10-06T02:23:15.920866+0000","last_became_active":"2023-10-06T02:23:15.916802+0000","last_became_peered":"2023-10-06T02:23:15.916802+0000","last_unstale":"2023-10-06T02:23:15.920866+0000","last_undegraded":"2023-10-06T02:23:15.920866+0000","last_fullsized":"2023-10-06T02:23:15.920866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:28.665851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.895556+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:23:15.895556+0000","last_peered":"2023-10-06T02:23:15.895556+0000","last_clean":"2023-10-06T02:23:15.895556+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:23:15.895556+0000","last_undegraded":"2023-10-06T02:23:15.895556+0000","last_fullsized":"2023-10-06T02:23:15.895556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:23:16.929311+0000","last_change":"2023-10-06T02:23:14.907316+0000","last_active":"2023-10-06T02:23:16.929311+0000","last_peered":"2023-10-06T02:23:16.929311+0000","last_clean":"2023-10-06T02:23:16.929311+0000","last_became_active":"2023-10-06T02:23:14.907019+0000","last_became_peered":"2023-10-06T02:23:14.907019+0000","last_unstale":"2023-10-06T02:23:16.929311+0000","last_undegraded":"2023-10-06T02:23:16.929311+0000","last_fullsized":"2023-10-06T02:23:16.929311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:47.698904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910870+0000","last_change":"2023-10-06T02:23:15.898071+0000","last_active":"2023-10-06T02:23:15.910870+0000","last_peered":"2023-10-06T02:23:15.910870+0000","last_clean":"2023-10-06T02:23:15.910870+0000","last_became_active":"2023-10-06T02:23:15.897795+0000","last_became_peered":"2023-10-06T02:23:15.897795+0000","last_unstale":"2023-10-06T02:23:15.910870+0000","last_undegraded":"2023-10-06T02:23:15.910870+0000","last_fullsized":"2023-10-06T02:23:15.910870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.901685+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:23:15.901685+0000","last_peered":"2023-10-06T02:23:15.901685+0000","last_clean":"2023-10-06T02:23:15.901685+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:23:15.901685+0000","last_undegraded":"2023-10-06T02:23:15.901685+0000","last_fullsized":"2023-10-06T02:23:15.901685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.902452+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:23:15.902452+0000","last_peered":"2023-10-06T02:23:15.902452+0000","last_clean":"2023-10-06T02:23:15.902452+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:23:15.902452+0000","last_undegraded":"2023-10-06T02:23:15.902452+0000","last_fullsized":"2023-10-06T02:23:15.902452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.889151+0000","last_change":"2023-10-06T02:23:14.905959+0000","last_active":"2023-10-06T02:23:15.889151+0000","last_peered":"2023-10-06T02:23:15.889151+0000","last_clean":"2023-10-06T02:23:15.889151+0000","last_became_active":"2023-10-06T02:23:14.905642+0000","last_became_peered":"2023-10-06T02:23:14.905642+0000","last_unstale":"2023-10-06T02:23:15.889151+0000","last_undegraded":"2023-10-06T02:23:15.889151+0000","last_fullsized":"2023-10-06T02:23:15.889151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:37.900811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.921254+0000","last_change":"2023-10-06T02:23:15.913645+0000","last_active":"2023-10-06T02:23:15.921254+0000","last_peered":"2023-10-06T02:23:15.921254+0000","last_clean":"2023-10-06T02:23:15.921254+0000","last_became_active":"2023-10-06T02:23:15.913181+0000","last_became_peered":"2023-10-06T02:23:15.913181+0000","last_unstale":"2023-10-06T02:23:15.921254+0000","last_undegraded":"2023-10-06T02:23:15.921254+0000","last_fullsized":"2023-10-06T02:23:15.921254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:28.665851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.903221+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:23:15.903221+0000","last_peered":"2023-10-06T02:23:15.903221+0000","last_clean":"2023-10-06T02:23:15.903221+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:23:15.903221+0000","last_undegraded":"2023-10-06T02:23:15.903221+0000","last_fullsized":"2023-10-06T02:23:15.903221+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.900107+0000","last_change":"2023-10-06T02:23:14.905273+0000","last_active":"2023-10-06T02:23:15.900107+0000","last_peered":"2023-10-06T02:23:15.900107+0000","last_clean":"2023-10-06T02:23:15.900107+0000","last_became_active":"2023-10-06T02:23:14.905074+0000","last_became_peered":"2023-10-06T02:23:14.905074+0000","last_unstale":"2023-10-06T02:23:15.900107+0000","last_undegraded":"2023-10-06T02:23:15.900107+0000","last_fullsized":"2023-10-06T02:23:15.900107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:12.131483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920119+0000","last_change":"2023-10-06T02:23:15.915383+0000","last_active":"2023-10-06T02:23:15.920119+0000","last_peered":"2023-10-06T02:23:15.920119+0000","last_clean":"2023-10-06T02:23:15.920119+0000","last_became_active":"2023-10-06T02:23:15.914958+0000","last_became_peered":"2023-10-06T02:23:15.914958+0000","last_unstale":"2023-10-06T02:23:15.920119+0000","last_undegraded":"2023-10-06T02:23:15.920119+0000","last_fullsized":"2023-10-06T02:23:15.920119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.082330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.902020+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:23:15.902020+0000","last_peered":"2023-10-06T02:23:15.902020+0000","last_clean":"2023-10-06T02:23:15.902020+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:23:15.902020+0000","last_undegraded":"2023-10-06T02:23:15.902020+0000","last_fullsized":"2023-10-06T02:23:15.902020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.894837+0000","last_change":"2023-10-06T02:23:14.902760+0000","last_active":"2023-10-06T02:23:15.894837+0000","last_peered":"2023-10-06T02:23:15.894837+0000","last_clean":"2023-10-06T02:23:15.894837+0000","last_became_active":"2023-10-06T02:23:14.902458+0000","last_became_peered":"2023-10-06T02:23:14.902458+0000","last_unstale":"2023-10-06T02:23:15.894837+0000","last_undegraded":"2023-10-06T02:23:15.894837+0000","last_fullsized":"2023-10-06T02:23:15.894837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:43.560751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916289+0000","last_change":"2023-10-06T02:23:15.913677+0000","last_active":"2023-10-06T02:23:15.916289+0000","last_peered":"2023-10-06T02:23:15.916289+0000","last_clean":"2023-10-06T02:23:15.916289+0000","last_became_active":"2023-10-06T02:23:15.913379+0000","last_became_peered":"2023-10-06T02:23:15.913379+0000","last_unstale":"2023-10-06T02:23:15.916289+0000","last_undegraded":"2023-10-06T02:23:15.916289+0000","last_fullsized":"2023-10-06T02:23:15.916289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:42.982377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.890388+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:23:15.890388+0000","last_peered":"2023-10-06T02:23:15.890388+0000","last_clean":"2023-10-06T02:23:15.890388+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:23:15.890388+0000","last_undegraded":"2023-10-06T02:23:15.890388+0000","last_fullsized":"2023-10-06T02:23:15.890388+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.891338+0000","last_change":"2023-10-06T02:23:14.904576+0000","last_active":"2023-10-06T02:23:15.891338+0000","last_peered":"2023-10-06T02:23:15.891338+0000","last_clean":"2023-10-06T02:23:15.891338+0000","last_became_active":"2023-10-06T02:23:14.904268+0000","last_became_peered":"2023-10-06T02:23:14.904268+0000","last_unstale":"2023-10-06T02:23:15.891338+0000","last_undegraded":"2023-10-06T02:23:15.891338+0000","last_fullsized":"2023-10-06T02:23:15.891338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:47.698904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919339+0000","last_change":"2023-10-06T02:23:15.909310+0000","last_active":"2023-10-06T02:23:15.919339+0000","last_peered":"2023-10-06T02:23:15.919339+0000","last_clean":"2023-10-06T02:23:15.919339+0000","last_became_active":"2023-10-06T02:23:15.908957+0000","last_became_peered":"2023-10-06T02:23:15.908957+0000","last_unstale":"2023-10-06T02:23:15.919339+0000","last_undegraded":"2023-10-06T02:23:15.919339+0000","last_fullsized":"2023-10-06T02:23:15.919339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:21.310729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.899923+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:23:15.899923+0000","last_peered":"2023-10-06T02:23:15.899923+0000","last_clean":"2023-10-06T02:23:15.899923+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:23:15.899923+0000","last_undegraded":"2023-10-06T02:23:15.899923+0000","last_fullsized":"2023-10-06T02:23:15.899923+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.901669+0000","last_change":"2023-10-06T02:23:14.906039+0000","last_active":"2023-10-06T02:23:15.901669+0000","last_peered":"2023-10-06T02:23:15.901669+0000","last_clean":"2023-10-06T02:23:15.901669+0000","last_became_active":"2023-10-06T02:23:14.905477+0000","last_became_peered":"2023-10-06T02:23:14.905477+0000","last_unstale":"2023-10-06T02:23:15.901669+0000","last_undegraded":"2023-10-06T02:23:15.901669+0000","last_fullsized":"2023-10-06T02:23:15.901669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:07.580128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.897843+0000","last_change":"2023-10-06T02:23:15.895373+0000","last_active":"2023-10-06T02:23:15.897843+0000","last_peered":"2023-10-06T02:23:15.897843+0000","last_clean":"2023-10-06T02:23:15.897843+0000","last_became_active":"2023-10-06T02:23:15.895175+0000","last_became_peered":"2023-10-06T02:23:15.895175+0000","last_unstale":"2023-10-06T02:23:15.897843+0000","last_undegraded":"2023-10-06T02:23:15.897843+0000","last_fullsized":"2023-10-06T02:23:15.897843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.899917+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:23:15.899917+0000","last_peered":"2023-10-06T02:23:15.899917+0000","last_clean":"2023-10-06T02:23:15.899917+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:23:15.899917+0000","last_undegraded":"2023-10-06T02:23:15.899917+0000","last_fullsized":"2023-10-06T02:23:15.899917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.892937+0000","last_change":"2023-10-06T02:23:14.897008+0000","last_active":"2023-10-06T02:23:15.892937+0000","last_peered":"2023-10-06T02:23:15.892937+0000","last_clean":"2023-10-06T02:23:15.892937+0000","last_became_active":"2023-10-06T02:23:14.896700+0000","last_became_peered":"2023-10-06T02:23:14.896700+0000","last_unstale":"2023-10-06T02:23:15.892937+0000","last_undegraded":"2023-10-06T02:23:15.892937+0000","last_fullsized":"2023-10-06T02:23:15.892937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:43.560751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919846+0000","last_change":"2023-10-06T02:23:15.911793+0000","last_active":"2023-10-06T02:23:15.919846+0000","last_peered":"2023-10-06T02:23:15.919846+0000","last_clean":"2023-10-06T02:23:15.919846+0000","last_became_active":"2023-10-06T02:23:15.909785+0000","last_became_peered":"2023-10-06T02:23:15.909785+0000","last_unstale":"2023-10-06T02:23:15.919846+0000","last_undegraded":"2023-10-06T02:23:15.919846+0000","last_fullsized":"2023-10-06T02:23:15.919846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.350772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915797+0000","last_change":"2023-10-06T02:23:14.908268+0000","last_active":"2023-10-06T02:23:15.915797+0000","last_peered":"2023-10-06T02:23:15.915797+0000","last_clean":"2023-10-06T02:23:15.915797+0000","last_became_active":"2023-10-06T02:23:14.907843+0000","last_became_peered":"2023-10-06T02:23:14.907843+0000","last_unstale":"2023-10-06T02:23:15.915797+0000","last_undegraded":"2023-10-06T02:23:15.915797+0000","last_fullsized":"2023-10-06T02:23:15.915797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:25.539314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919213+0000","last_change":"2023-10-06T02:23:15.907616+0000","last_active":"2023-10-06T02:23:15.919213+0000","last_peered":"2023-10-06T02:23:15.919213+0000","last_clean":"2023-10-06T02:23:15.919213+0000","last_became_active":"2023-10-06T02:23:15.907283+0000","last_became_peered":"2023-10-06T02:23:15.907283+0000","last_unstale":"2023-10-06T02:23:15.919213+0000","last_undegraded":"2023-10-06T02:23:15.919213+0000","last_fullsized":"2023-10-06T02:23:15.919213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:35.060508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913466+0000","last_change":"2023-10-06T02:23:14.895063+0000","last_active":"2023-10-06T02:23:15.913466+0000","last_peered":"2023-10-06T02:23:15.913466+0000","last_clean":"2023-10-06T02:23:15.913466+0000","last_became_active":"2023-10-06T02:23:14.894694+0000","last_became_peered":"2023-10-06T02:23:14.894694+0000","last_unstale":"2023-10-06T02:23:15.913466+0000","last_undegraded":"2023-10-06T02:23:15.913466+0000","last_fullsized":"2023-10-06T02:23:15.913466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.054986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916712+0000","last_change":"2023-10-06T02:23:15.912820+0000","last_active":"2023-10-06T02:23:15.916712+0000","last_peered":"2023-10-06T02:23:15.916712+0000","last_clean":"2023-10-06T02:23:15.916712+0000","last_became_active":"2023-10-06T02:23:15.912469+0000","last_became_peered":"2023-10-06T02:23:15.912469+0000","last_unstale":"2023-10-06T02:23:15.916712+0000","last_undegraded":"2023-10-06T02:23:15.916712+0000","last_fullsized":"2023-10-06T02:23:15.916712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:07.345058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912740+0000","last_change":"2023-10-06T02:23:14.904850+0000","last_active":"2023-10-06T02:23:15.912740+0000","last_peered":"2023-10-06T02:23:15.912740+0000","last_clean":"2023-10-06T02:23:15.912740+0000","last_became_active":"2023-10-06T02:23:14.904569+0000","last_became_peered":"2023-10-06T02:23:14.904569+0000","last_unstale":"2023-10-06T02:23:15.912740+0000","last_undegraded":"2023-10-06T02:23:15.912740+0000","last_fullsized":"2023-10-06T02:23:15.912740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:47.698904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912380+0000","last_change":"2023-10-06T02:23:15.905102+0000","last_active":"2023-10-06T02:23:15.912380+0000","last_peered":"2023-10-06T02:23:15.912380+0000","last_clean":"2023-10-06T02:23:15.912380+0000","last_became_active":"2023-10-06T02:23:15.904796+0000","last_became_peered":"2023-10-06T02:23:15.904796+0000","last_unstale":"2023-10-06T02:23:15.912380+0000","last_undegraded":"2023-10-06T02:23:15.912380+0000","last_fullsized":"2023-10-06T02:23:15.912380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:47.162284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912504+0000","last_change":"2023-10-06T02:23:14.903685+0000","last_active":"2023-10-06T02:23:15.912504+0000","last_peered":"2023-10-06T02:23:15.912504+0000","last_clean":"2023-10-06T02:23:15.912504+0000","last_became_active":"2023-10-06T02:23:14.902829+0000","last_became_peered":"2023-10-06T02:23:14.902829+0000","last_unstale":"2023-10-06T02:23:15.912504+0000","last_undegraded":"2023-10-06T02:23:15.912504+0000","last_fullsized":"2023-10-06T02:23:15.912504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:50.363282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912866+0000","last_change":"2023-10-06T02:23:15.909237+0000","last_active":"2023-10-06T02:23:15.912866+0000","last_peered":"2023-10-06T02:23:15.912866+0000","last_clean":"2023-10-06T02:23:15.912866+0000","last_became_active":"2023-10-06T02:23:15.908957+0000","last_became_peered":"2023-10-06T02:23:15.908957+0000","last_unstale":"2023-10-06T02:23:15.912866+0000","last_undegraded":"2023-10-06T02:23:15.912866+0000","last_fullsized":"2023-10-06T02:23:15.912866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910567+0000","last_change":"2023-10-06T02:23:14.904438+0000","last_active":"2023-10-06T02:23:15.910567+0000","last_peered":"2023-10-06T02:23:15.910567+0000","last_clean":"2023-10-06T02:23:15.910567+0000","last_became_active":"2023-10-06T02:23:14.904157+0000","last_became_peered":"2023-10-06T02:23:14.904157+0000","last_unstale":"2023-10-06T02:23:15.910567+0000","last_undegraded":"2023-10-06T02:23:15.910567+0000","last_fullsized":"2023-10-06T02:23:15.910567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.054986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913770+0000","last_change":"2023-10-06T02:23:15.909579+0000","last_active":"2023-10-06T02:23:15.913770+0000","last_peered":"2023-10-06T02:23:15.913770+0000","last_clean":"2023-10-06T02:23:15.913770+0000","last_became_active":"2023-10-06T02:23:15.909173+0000","last_became_peered":"2023-10-06T02:23:15.909173+0000","last_unstale":"2023-10-06T02:23:15.913770+0000","last_undegraded":"2023-10-06T02:23:15.913770+0000","last_fullsized":"2023-10-06T02:23:15.913770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:14.278390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913856+0000","last_change":"2023-10-06T02:23:15.911519+0000","last_active":"2023-10-06T02:23:15.913856+0000","last_peered":"2023-10-06T02:23:15.913856+0000","last_clean":"2023-10-06T02:23:15.913856+0000","last_became_active":"2023-10-06T02:23:15.911040+0000","last_became_peered":"2023-10-06T02:23:15.911040+0000","last_unstale":"2023-10-06T02:23:15.913856+0000","last_undegraded":"2023-10-06T02:23:15.913856+0000","last_fullsized":"2023-10-06T02:23:15.913856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:23:21.180114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919359+0000","last_change":"2023-10-06T02:23:15.912783+0000","last_active":"2023-10-06T02:23:15.919359+0000","last_peered":"2023-10-06T02:23:15.919359+0000","last_clean":"2023-10-06T02:23:15.919359+0000","last_became_active":"2023-10-06T02:23:15.912284+0000","last_became_peered":"2023-10-06T02:23:15.912284+0000","last_unstale":"2023-10-06T02:23:15.919359+0000","last_undegraded":"2023-10-06T02:23:15.919359+0000","last_fullsized":"2023-10-06T02:23:15.919359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:25.497567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912361+0000","last_change":"2023-10-06T02:23:15.902724+0000","last_active":"2023-10-06T02:23:15.912361+0000","last_peered":"2023-10-06T02:23:15.912361+0000","last_clean":"2023-10-06T02:23:15.912361+0000","last_became_active":"2023-10-06T02:23:15.902437+0000","last_became_peered":"2023-10-06T02:23:15.902437+0000","last_unstale":"2023-10-06T02:23:15.912361+0000","last_undegraded":"2023-10-06T02:23:15.912361+0000","last_fullsized":"2023-10-06T02:23:15.912361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:35.495163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920718+0000","last_change":"2023-10-06T02:23:15.918968+0000","last_active":"2023-10-06T02:23:15.920718+0000","last_peered":"2023-10-06T02:23:15.920718+0000","last_clean":"2023-10-06T02:23:15.920718+0000","last_became_active":"2023-10-06T02:23:15.918669+0000","last_became_peered":"2023-10-06T02:23:15.918669+0000","last_unstale":"2023-10-06T02:23:15.920718+0000","last_undegraded":"2023-10-06T02:23:15.920718+0000","last_fullsized":"2023-10-06T02:23:15.920718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:33.357066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920160+0000","last_change":"2023-10-06T02:23:15.918229+0000","last_active":"2023-10-06T02:23:15.920160+0000","last_peered":"2023-10-06T02:23:15.920160+0000","last_clean":"2023-10-06T02:23:15.920160+0000","last_became_active":"2023-10-06T02:23:15.917809+0000","last_became_peered":"2023-10-06T02:23:15.917809+0000","last_unstale":"2023-10-06T02:23:15.920160+0000","last_undegraded":"2023-10-06T02:23:15.920160+0000","last_fullsized":"2023-10-06T02:23:15.920160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:58.461395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":664552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.3639999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.7869999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.678000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.7270000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3460000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":73385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":74184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":72921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.217}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:23:27.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:23:27.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.640+0000 7f966ba09700 1 Processor -- start 2023-10-06T02:23:27.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.640+0000 7f966ba09700 1 -- start start 2023-10-06T02:23:27.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.641+0000 7f966ba09700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96641595a0 0x7f96640b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:27.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.641+0000 7f966ba09700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f966406d890 0x7f966406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:27.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.641+0000 7f966ba09700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f966406e240 con 0x7f966406c0b0 2023-10-06T02:23:27.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.641+0000 7f966ba09700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966415e180 con 0x7f96641595a0 2023-10-06T02:23:27.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.641+0000 7f966ba09700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96640b1000 con 0x7f966406d890 2023-10-06T02:23:27.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.641+0000 7f96697a5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96641595a0 0x7f96640b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:27.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.641+0000 7f9669fa6700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f966406c0b0 0x7f966406c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34462/0 (socket says 172.21.15.37:34462) 2023-10-06T02:23:27.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.641+0000 7f9669fa6700 1 -- 172.21.15.37:0/4104411873 learned_addr learned my addr 172.21.15.37:0/4104411873 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:27.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.642+0000 7f9668fa4700 1 --2- 172.21.15.37:0/4104411873 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f966406d890 0x7f966406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:27.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.642+0000 7f96697a5700 1 -- 172.21.15.37:0/4104411873 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f966406d890 msgr2=0x7f966406dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:27.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.642+0000 7f96697a5700 1 --2- 172.21.15.37:0/4104411873 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f966406d890 0x7f966406dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.642+0000 7f96697a5700 1 -- 172.21.15.37:0/4104411873 >> v1:172.21.15.37:6789/0 conn(0x7f966406c0b0 legacy=0x7f966406c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.642+0000 7f96697a5700 1 -- 172.21.15.37:0/4104411873 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966415d570 con 0x7f96641595a0 2023-10-06T02:23:27.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.642+0000 7f9668fa4700 1 --2- 172.21.15.37:0/4104411873 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f966406d890 0x7f966406dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:27.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.642+0000 7f96697a5700 1 --2- 172.21.15.37:0/4104411873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96641595a0 0x7f96640b0ac0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f965c009e60 tx=0x7f965c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0ae79e6db2c31 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:27.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.642+0000 7f9663fff700 1 -- 172.21.15.37:0/4104411873 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c00e070 con 0x7f96641595a0 2023-10-06T02:23:27.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.642+0000 7f9663fff700 1 -- 172.21.15.37:0/4104411873 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965c00bc30 con 0x7f96641595a0 2023-10-06T02:23:27.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.642+0000 7f9663fff700 1 -- 172.21.15.37:0/4104411873 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c012430 con 0x7f96641595a0 2023-10-06T02:23:27.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.643+0000 7f966ba09700 1 -- 172.21.15.37:0/4104411873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96641595a0 msgr2=0x7f96640b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.643+0000 7f966ba09700 1 --2- 172.21.15.37:0/4104411873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96641595a0 0x7f96640b0ac0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f965c009e60 tx=0x7f965c009780 comp rx=0 tx=0).stop 2023-10-06T02:23:27.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.643+0000 7f966ba09700 1 -- 172.21.15.37:0/4104411873 shutdown_connections 2023-10-06T02:23:27.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.643+0000 7f966ba09700 1 --2- 172.21.15.37:0/4104411873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96641595a0 0x7f96640b0ac0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.643+0000 7f966ba09700 1 --2- 172.21.15.37:0/4104411873 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f966406d890 0x7f966406dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.643+0000 7f966ba09700 1 -- 172.21.15.37:0/4104411873 >> 172.21.15.37:0/4104411873 conn(0x7f96640d04d0 msgr2=0x7f96640d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:27.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.643+0000 7f966ba09700 1 -- 172.21.15.37:0/4104411873 shutdown_connections 2023-10-06T02:23:27.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.643+0000 7f966ba09700 1 -- 172.21.15.37:0/4104411873 wait complete. 2023-10-06T02:23:27.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.644+0000 7f966ba09700 1 Processor -- start 2023-10-06T02:23:27.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.644+0000 7f966ba09700 1 -- start start 2023-10-06T02:23:27.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f966ba09700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f966406c0b0 0x7f9664169bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:27.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f966ba09700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f966406d890 0x7f96640c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:27.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f966ba09700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96641595a0 0x7f96641579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:27.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f966ba09700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9664156290 con 0x7f966406d890 2023-10-06T02:23:27.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f966ba09700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966415a540 con 0x7f96641595a0 2023-10-06T02:23:27.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f966ba09700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9664159970 con 0x7f966406c0b0 2023-10-06T02:23:27.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f9668fa4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f966406d890 0x7f96640c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:27.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f9668fa4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f966406d890 0x7f96640c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42240/0 (socket says 172.21.15.37:42240) 2023-10-06T02:23:27.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f9668fa4700 1 -- 172.21.15.37:0/108547746 learned_addr learned my addr 172.21.15.37:0/108547746 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:27.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f9669fa6700 1 --2- 172.21.15.37:0/108547746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96641595a0 0x7f96641579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:27.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f96697a5700 1 --2- 172.21.15.37:0/108547746 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f966406c0b0 0x7f9664169bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:27.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f9668fa4700 1 -- 172.21.15.37:0/108547746 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f966406c0b0 msgr2=0x7f9664169bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f9668fa4700 1 --2- 172.21.15.37:0/108547746 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f966406c0b0 0x7f9664169bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f9668fa4700 1 -- 172.21.15.37:0/108547746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96641595a0 msgr2=0x7f96641579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f9668fa4700 1 --2- 172.21.15.37:0/108547746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96641595a0 0x7f96641579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f9668fa4700 1 -- 172.21.15.37:0/108547746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965c009a20 con 0x7f966406d890 2023-10-06T02:23:27.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f9668fa4700 1 --2- 172.21.15.37:0/108547746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f966406d890 0x7f96640c7df0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f965800c830 tx=0x7f9658008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:27.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f96617fa700 1 -- 172.21.15.37:0/108547746 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9658011600 con 0x7f966406d890 2023-10-06T02:23:27.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f96617fa700 1 -- 172.21.15.37:0/108547746 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9658011760 con 0x7f966406d890 2023-10-06T02:23:27.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f966ba09700 1 -- 172.21.15.37:0/108547746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9664159c10 con 0x7f966406d890 2023-10-06T02:23:27.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f96617fa700 1 -- 172.21.15.37:0/108547746 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9658011b20 con 0x7f966406d890 2023-10-06T02:23:27.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.645+0000 7f966ba09700 1 -- 172.21.15.37:0/108547746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966415a1d0 con 0x7f966406d890 2023-10-06T02:23:27.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.646+0000 7f966ba09700 1 -- 172.21.15.37:0/108547746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966415a6f0 con 0x7f966406d890 2023-10-06T02:23:27.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.647+0000 7f96617fa700 1 -- 172.21.15.37:0/108547746 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f965800a3e0 con 0x7f966406d890 2023-10-06T02:23:27.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.647+0000 7f96617fa700 1 --2- 172.21.15.37:0/108547746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9650066f30 0x7f96500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:27.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.647+0000 7f96617fa700 1 -- 172.21.15.37:0/108547746 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9658084b20 con 0x7f966406d890 2023-10-06T02:23:27.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.647+0000 7f96697a5700 1 --2- 172.21.15.37:0/108547746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9650066f30 0x7f96500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:27.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.648+0000 7f96697a5700 1 --2- 172.21.15.37:0/108547746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9650066f30 0x7f96500693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f965c009e60 tx=0x7f965c019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:27.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.651+0000 7f96617fa700 1 -- 172.21.15.37:0/108547746 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f966415a6f0 con 0x7f966406d890 2023-10-06T02:23:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.841+0000 7f966ba09700 1 -- 172.21.15.37:0/108547746 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f966415a6b0 con 0x7f9650066f30 2023-10-06T02:23:27.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.849+0000 7f96617fa700 1 -- 172.21.15.37:0/108547746 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286855 (secure 0 0 0) 0x7f966415a6b0 con 0x7f9650066f30 2023-10-06T02:23:27.853 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.853+0000 7f966ba09700 1 -- 172.21.15.37:0/108547746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9650066f30 msgr2=0x7f96500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.853+0000 7f966ba09700 1 --2- 172.21.15.37:0/108547746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9650066f30 0x7f96500693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f965c009e60 tx=0x7f965c019000 comp rx=0 tx=0).stop 2023-10-06T02:23:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.853+0000 7f966ba09700 1 -- 172.21.15.37:0/108547746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f966406d890 msgr2=0x7f96640c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.853+0000 7f966ba09700 1 --2- 172.21.15.37:0/108547746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f966406d890 0x7f96640c7df0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f965800c830 tx=0x7f9658008040 comp rx=0 tx=0).stop 2023-10-06T02:23:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.853+0000 7f966ba09700 1 -- 172.21.15.37:0/108547746 shutdown_connections 2023-10-06T02:23:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.853+0000 7f966ba09700 1 --2- 172.21.15.37:0/108547746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9650066f30 0x7f96500693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.853+0000 7f966ba09700 1 --2- 172.21.15.37:0/108547746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96641595a0 0x7f96641579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.853+0000 7f966ba09700 1 --2- 172.21.15.37:0/108547746 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f966406c0b0 0x7f9664169bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.853+0000 7f966ba09700 1 --2- 172.21.15.37:0/108547746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f966406d890 0x7f96640c7df0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:27.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.853+0000 7f966ba09700 1 -- 172.21.15.37:0/108547746 >> 172.21.15.37:0/108547746 conn(0x7f96640d04d0 msgr2=0x7f96640d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:27.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.853+0000 7f966ba09700 1 -- 172.21.15.37:0/108547746 shutdown_connections 2023-10-06T02:23:27.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:27.853+0000 7f966ba09700 1 -- 172.21.15.37:0/108547746 wait complete. 2023-10-06T02:23:27.856 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:23:27.865 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-06T02:23:26.510200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381116,"kb_used_data":2812,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593604,"statfs":{"total":773094113280,"available":770655850496,"internally_reserved":0,"allocated":2879488,"data_stored":1774761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002432"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919168+0000","last_change":"2023-10-06T02:23:15.908982+0000","last_active":"2023-10-06T02:23:15.919168+0000","last_peered":"2023-10-06T02:23:15.919168+0000","last_clean":"2023-10-06T02:23:15.919168+0000","last_became_active":"2023-10-06T02:23:15.908698+0000","last_became_peered":"2023-10-06T02:23:15.908698+0000","last_unstale":"2023-10-06T02:23:15.919168+0000","last_undegraded":"2023-10-06T02:23:15.919168+0000","last_fullsized":"2023-10-06T02:23:15.919168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:10.934479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913252+0000","last_change":"2023-10-06T02:23:15.912067+0000","last_active":"2023-10-06T02:23:15.913252+0000","last_peered":"2023-10-06T02:23:15.913252+0000","last_clean":"2023-10-06T02:23:15.913252+0000","last_became_active":"2023-10-06T02:23:15.911773+0000","last_became_peered":"2023-10-06T02:23:15.911773+0000","last_unstale":"2023-10-06T02:23:15.913252+0000","last_undegraded":"2023-10-06T02:23:15.913252+0000","last_fullsized":"2023-10-06T02:23:15.913252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:29.341324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910351+0000","last_change":"2023-10-06T02:23:15.897603+0000","last_active":"2023-10-06T02:23:15.910351+0000","last_peered":"2023-10-06T02:23:15.910351+0000","last_clean":"2023-10-06T02:23:15.910351+0000","last_became_active":"2023-10-06T02:23:15.897331+0000","last_became_peered":"2023-10-06T02:23:15.897331+0000","last_unstale":"2023-10-06T02:23:15.910351+0000","last_undegraded":"2023-10-06T02:23:15.910351+0000","last_fullsized":"2023-10-06T02:23:15.910351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:22.459072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.909617+0000","last_change":"2023-10-06T02:23:15.906142+0000","last_active":"2023-10-06T02:23:15.909617+0000","last_peered":"2023-10-06T02:23:15.909617+0000","last_clean":"2023-10-06T02:23:15.909617+0000","last_became_active":"2023-10-06T02:23:15.905889+0000","last_became_peered":"2023-10-06T02:23:15.905889+0000","last_unstale":"2023-10-06T02:23:15.909617+0000","last_undegraded":"2023-10-06T02:23:15.909617+0000","last_fullsized":"2023-10-06T02:23:15.909617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:41.861335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915400+0000","last_change":"2023-10-06T02:23:15.903558+0000","last_active":"2023-10-06T02:23:15.915400+0000","last_peered":"2023-10-06T02:23:15.915400+0000","last_clean":"2023-10-06T02:23:15.915400+0000","last_became_active":"2023-10-06T02:23:15.903280+0000","last_became_peered":"2023-10-06T02:23:15.903280+0000","last_unstale":"2023-10-06T02:23:15.915400+0000","last_undegraded":"2023-10-06T02:23:15.915400+0000","last_fullsized":"2023-10-06T02:23:15.915400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.911955+0000","last_change":"2023-10-06T02:23:15.899437+0000","last_active":"2023-10-06T02:23:15.911955+0000","last_peered":"2023-10-06T02:23:15.911955+0000","last_clean":"2023-10-06T02:23:15.911955+0000","last_became_active":"2023-10-06T02:23:15.897553+0000","last_became_peered":"2023-10-06T02:23:15.897553+0000","last_unstale":"2023-10-06T02:23:15.911955+0000","last_undegraded":"2023-10-06T02:23:15.911955+0000","last_fullsized":"2023-10-06T02:23:15.911955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:28.665851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919223+0000","last_change":"2023-10-06T02:23:15.918090+0000","last_active":"2023-10-06T02:23:15.919223+0000","last_peered":"2023-10-06T02:23:15.919223+0000","last_clean":"2023-10-06T02:23:15.919223+0000","last_became_active":"2023-10-06T02:23:15.917887+0000","last_became_peered":"2023-10-06T02:23:15.917887+0000","last_unstale":"2023-10-06T02:23:15.919223+0000","last_undegraded":"2023-10-06T02:23:15.919223+0000","last_fullsized":"2023-10-06T02:23:15.919223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.903010+0000","last_change":"2023-10-06T02:23:15.899230+0000","last_active":"2023-10-06T02:23:15.903010+0000","last_peered":"2023-10-06T02:23:15.903010+0000","last_clean":"2023-10-06T02:23:15.903010+0000","last_became_active":"2023-10-06T02:23:15.898928+0000","last_became_peered":"2023-10-06T02:23:15.898928+0000","last_unstale":"2023-10-06T02:23:15.903010+0000","last_undegraded":"2023-10-06T02:23:15.903010+0000","last_fullsized":"2023-10-06T02:23:15.903010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:58.461395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913512+0000","last_change":"2023-10-06T02:23:15.906778+0000","last_active":"2023-10-06T02:23:15.913512+0000","last_peered":"2023-10-06T02:23:15.913512+0000","last_clean":"2023-10-06T02:23:15.913512+0000","last_became_active":"2023-10-06T02:23:15.906117+0000","last_became_peered":"2023-10-06T02:23:15.906117+0000","last_unstale":"2023-10-06T02:23:15.913512+0000","last_undegraded":"2023-10-06T02:23:15.913512+0000","last_fullsized":"2023-10-06T02:23:15.913512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.899401+0000","last_change":"2023-10-06T02:23:15.897067+0000","last_active":"2023-10-06T02:23:15.899401+0000","last_peered":"2023-10-06T02:23:15.899401+0000","last_clean":"2023-10-06T02:23:15.899401+0000","last_became_active":"2023-10-06T02:23:15.896690+0000","last_became_peered":"2023-10-06T02:23:15.896690+0000","last_unstale":"2023-10-06T02:23:15.899401+0000","last_undegraded":"2023-10-06T02:23:15.899401+0000","last_fullsized":"2023-10-06T02:23:15.899401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912295+0000","last_change":"2023-10-06T02:23:15.904332+0000","last_active":"2023-10-06T02:23:15.912295+0000","last_peered":"2023-10-06T02:23:15.912295+0000","last_clean":"2023-10-06T02:23:15.912295+0000","last_became_active":"2023-10-06T02:23:15.904107+0000","last_became_peered":"2023-10-06T02:23:15.904107+0000","last_unstale":"2023-10-06T02:23:15.912295+0000","last_undegraded":"2023-10-06T02:23:15.912295+0000","last_fullsized":"2023-10-06T02:23:15.912295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:08.354390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919232+0000","last_change":"2023-10-06T02:23:15.914369+0000","last_active":"2023-10-06T02:23:15.919232+0000","last_peered":"2023-10-06T02:23:15.919232+0000","last_clean":"2023-10-06T02:23:15.919232+0000","last_became_active":"2023-10-06T02:23:15.914083+0000","last_became_peered":"2023-10-06T02:23:15.914083+0000","last_unstale":"2023-10-06T02:23:15.919232+0000","last_undegraded":"2023-10-06T02:23:15.919232+0000","last_fullsized":"2023-10-06T02:23:15.919232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:26.544836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919123+0000","last_change":"2023-10-06T02:23:15.911961+0000","last_active":"2023-10-06T02:23:15.919123+0000","last_peered":"2023-10-06T02:23:15.919123+0000","last_clean":"2023-10-06T02:23:15.919123+0000","last_became_active":"2023-10-06T02:23:15.911674+0000","last_became_peered":"2023-10-06T02:23:15.911674+0000","last_unstale":"2023-10-06T02:23:15.919123+0000","last_undegraded":"2023-10-06T02:23:15.919123+0000","last_fullsized":"2023-10-06T02:23:15.919123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:48.704425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.911125+0000","last_change":"2023-10-06T02:23:15.909666+0000","last_active":"2023-10-06T02:23:15.911125+0000","last_peered":"2023-10-06T02:23:15.911125+0000","last_clean":"2023-10-06T02:23:15.911125+0000","last_became_active":"2023-10-06T02:23:15.909184+0000","last_became_peered":"2023-10-06T02:23:15.909184+0000","last_unstale":"2023-10-06T02:23:15.911125+0000","last_undegraded":"2023-10-06T02:23:15.911125+0000","last_fullsized":"2023-10-06T02:23:15.911125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:21.310729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919252+0000","last_change":"2023-10-06T02:23:15.918152+0000","last_active":"2023-10-06T02:23:15.919252+0000","last_peered":"2023-10-06T02:23:15.919252+0000","last_clean":"2023-10-06T02:23:15.919252+0000","last_became_active":"2023-10-06T02:23:15.917956+0000","last_became_peered":"2023-10-06T02:23:15.917956+0000","last_unstale":"2023-10-06T02:23:15.919252+0000","last_undegraded":"2023-10-06T02:23:15.919252+0000","last_fullsized":"2023-10-06T02:23:15.919252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.082330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910937+0000","last_change":"2023-10-06T02:23:15.898556+0000","last_active":"2023-10-06T02:23:15.910937+0000","last_peered":"2023-10-06T02:23:15.910937+0000","last_clean":"2023-10-06T02:23:15.910937+0000","last_became_active":"2023-10-06T02:23:15.897898+0000","last_became_peered":"2023-10-06T02:23:15.897898+0000","last_unstale":"2023-10-06T02:23:15.910937+0000","last_undegraded":"2023-10-06T02:23:15.910937+0000","last_fullsized":"2023-10-06T02:23:15.910937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:33.357066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913539+0000","last_change":"2023-10-06T02:23:15.906966+0000","last_active":"2023-10-06T02:23:15.913539+0000","last_peered":"2023-10-06T02:23:15.913539+0000","last_clean":"2023-10-06T02:23:15.913539+0000","last_became_active":"2023-10-06T02:23:15.906471+0000","last_became_peered":"2023-10-06T02:23:15.906471+0000","last_unstale":"2023-10-06T02:23:15.913539+0000","last_undegraded":"2023-10-06T02:23:15.913539+0000","last_fullsized":"2023-10-06T02:23:15.913539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.082330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912480+0000","last_change":"2023-10-06T02:23:15.909298+0000","last_active":"2023-10-06T02:23:15.912480+0000","last_peered":"2023-10-06T02:23:15.912480+0000","last_clean":"2023-10-06T02:23:15.912480+0000","last_became_active":"2023-10-06T02:23:15.908984+0000","last_became_peered":"2023-10-06T02:23:15.908984+0000","last_unstale":"2023-10-06T02:23:15.912480+0000","last_undegraded":"2023-10-06T02:23:15.912480+0000","last_fullsized":"2023-10-06T02:23:15.912480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:45.070037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919178+0000","last_change":"2023-10-06T02:23:15.908066+0000","last_active":"2023-10-06T02:23:15.919178+0000","last_peered":"2023-10-06T02:23:15.919178+0000","last_clean":"2023-10-06T02:23:15.919178+0000","last_became_active":"2023-10-06T02:23:15.907732+0000","last_became_peered":"2023-10-06T02:23:15.907732+0000","last_unstale":"2023-10-06T02:23:15.919178+0000","last_undegraded":"2023-10-06T02:23:15.919178+0000","last_fullsized":"2023-10-06T02:23:15.919178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:08.585650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913105+0000","last_change":"2023-10-06T02:23:15.907581+0000","last_active":"2023-10-06T02:23:15.913105+0000","last_peered":"2023-10-06T02:23:15.913105+0000","last_clean":"2023-10-06T02:23:15.913105+0000","last_became_active":"2023-10-06T02:23:15.905503+0000","last_became_peered":"2023-10-06T02:23:15.905503+0000","last_unstale":"2023-10-06T02:23:15.913105+0000","last_undegraded":"2023-10-06T02:23:15.913105+0000","last_fullsized":"2023-10-06T02:23:15.913105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:18.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916852+0000","last_change":"2023-10-06T02:23:15.914944+0000","last_active":"2023-10-06T02:23:15.916852+0000","last_peered":"2023-10-06T02:23:15.916852+0000","last_clean":"2023-10-06T02:23:15.916852+0000","last_became_active":"2023-10-06T02:23:15.914700+0000","last_became_peered":"2023-10-06T02:23:15.914700+0000","last_unstale":"2023-10-06T02:23:15.916852+0000","last_undegraded":"2023-10-06T02:23:15.916852+0000","last_fullsized":"2023-10-06T02:23:15.916852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920587+0000","last_change":"2023-10-06T02:23:15.913463+0000","last_active":"2023-10-06T02:23:15.920587+0000","last_peered":"2023-10-06T02:23:15.920587+0000","last_clean":"2023-10-06T02:23:15.920587+0000","last_became_active":"2023-10-06T02:23:15.913127+0000","last_became_peered":"2023-10-06T02:23:15.913127+0000","last_unstale":"2023-10-06T02:23:15.920587+0000","last_undegraded":"2023-10-06T02:23:15.920587+0000","last_fullsized":"2023-10-06T02:23:15.920587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:33.357066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920526+0000","last_change":"2023-10-06T02:23:15.914489+0000","last_active":"2023-10-06T02:23:15.920526+0000","last_peered":"2023-10-06T02:23:15.920526+0000","last_clean":"2023-10-06T02:23:15.920526+0000","last_became_active":"2023-10-06T02:23:15.914221+0000","last_became_peered":"2023-10-06T02:23:15.914221+0000","last_unstale":"2023-10-06T02:23:15.920526+0000","last_undegraded":"2023-10-06T02:23:15.920526+0000","last_fullsized":"2023-10-06T02:23:15.920526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:45.070037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.917128+0000","last_change":"2023-10-06T02:23:15.914958+0000","last_active":"2023-10-06T02:23:15.917128+0000","last_peered":"2023-10-06T02:23:15.917128+0000","last_clean":"2023-10-06T02:23:15.917128+0000","last_became_active":"2023-10-06T02:23:15.914682+0000","last_became_peered":"2023-10-06T02:23:15.914682+0000","last_unstale":"2023-10-06T02:23:15.917128+0000","last_undegraded":"2023-10-06T02:23:15.917128+0000","last_fullsized":"2023-10-06T02:23:15.917128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915313+0000","last_change":"2023-10-06T02:23:15.907412+0000","last_active":"2023-10-06T02:23:15.915313+0000","last_peered":"2023-10-06T02:23:15.915313+0000","last_clean":"2023-10-06T02:23:15.915313+0000","last_became_active":"2023-10-06T02:23:15.906449+0000","last_became_peered":"2023-10-06T02:23:15.906449+0000","last_unstale":"2023-10-06T02:23:15.915313+0000","last_undegraded":"2023-10-06T02:23:15.915313+0000","last_fullsized":"2023-10-06T02:23:15.915313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:32.631860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919905+0000","last_change":"2023-10-06T02:23:15.912982+0000","last_active":"2023-10-06T02:23:15.919905+0000","last_peered":"2023-10-06T02:23:15.919905+0000","last_clean":"2023-10-06T02:23:15.919905+0000","last_became_active":"2023-10-06T02:23:15.910404+0000","last_became_peered":"2023-10-06T02:23:15.910404+0000","last_unstale":"2023-10-06T02:23:15.919905+0000","last_undegraded":"2023-10-06T02:23:15.919905+0000","last_fullsized":"2023-10-06T02:23:15.919905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:56.873370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.918347+0000","last_change":"2023-10-06T02:23:15.916449+0000","last_active":"2023-10-06T02:23:15.918347+0000","last_peered":"2023-10-06T02:23:15.918347+0000","last_clean":"2023-10-06T02:23:15.918347+0000","last_became_active":"2023-10-06T02:23:15.915750+0000","last_became_peered":"2023-10-06T02:23:15.915750+0000","last_unstale":"2023-10-06T02:23:15.918347+0000","last_undegraded":"2023-10-06T02:23:15.918347+0000","last_fullsized":"2023-10-06T02:23:15.918347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910324+0000","last_change":"2023-10-06T02:23:14.907348+0000","last_active":"2023-10-06T02:23:15.910324+0000","last_peered":"2023-10-06T02:23:15.910324+0000","last_clean":"2023-10-06T02:23:15.910324+0000","last_became_active":"2023-10-06T02:23:14.907035+0000","last_became_peered":"2023-10-06T02:23:14.907035+0000","last_unstale":"2023-10-06T02:23:15.910324+0000","last_undegraded":"2023-10-06T02:23:15.910324+0000","last_fullsized":"2023-10-06T02:23:15.910324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:12.131483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.906846+0000","last_change":"2023-10-06T02:23:15.902629+0000","last_active":"2023-10-06T02:23:15.906846+0000","last_peered":"2023-10-06T02:23:15.906846+0000","last_clean":"2023-10-06T02:23:15.906846+0000","last_became_active":"2023-10-06T02:23:15.902328+0000","last_became_peered":"2023-10-06T02:23:15.902328+0000","last_unstale":"2023-10-06T02:23:15.906846+0000","last_undegraded":"2023-10-06T02:23:15.906846+0000","last_fullsized":"2023-10-06T02:23:15.906846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:11.466544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.900770+0000","last_change":"2023-10-06T02:23:14.908961+0000","last_active":"2023-10-06T02:23:15.900770+0000","last_peered":"2023-10-06T02:23:15.900770+0000","last_clean":"2023-10-06T02:23:15.900770+0000","last_became_active":"2023-10-06T02:23:14.908549+0000","last_became_peered":"2023-10-06T02:23:14.908549+0000","last_unstale":"2023-10-06T02:23:15.900770+0000","last_undegraded":"2023-10-06T02:23:15.900770+0000","last_fullsized":"2023-10-06T02:23:15.900770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:37.900811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.925219+0000","last_change":"2023-10-06T02:23:15.921091+0000","last_active":"2023-10-06T02:23:15.925219+0000","last_peered":"2023-10-06T02:23:15.925219+0000","last_clean":"2023-10-06T02:23:15.925219+0000","last_became_active":"2023-10-06T02:23:15.920772+0000","last_became_peered":"2023-10-06T02:23:15.920772+0000","last_unstale":"2023-10-06T02:23:15.925219+0000","last_undegraded":"2023-10-06T02:23:15.925219+0000","last_fullsized":"2023-10-06T02:23:15.925219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:58.461395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.896633+0000","last_change":"2023-10-06T02:23:14.905101+0000","last_active":"2023-10-06T02:23:15.896633+0000","last_peered":"2023-10-06T02:23:15.896633+0000","last_clean":"2023-10-06T02:23:15.896633+0000","last_became_active":"2023-10-06T02:23:14.902379+0000","last_became_peered":"2023-10-06T02:23:14.902379+0000","last_unstale":"2023-10-06T02:23:15.896633+0000","last_undegraded":"2023-10-06T02:23:15.896633+0000","last_fullsized":"2023-10-06T02:23:15.896633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.054986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910630+0000","last_change":"2023-10-06T02:23:15.908338+0000","last_active":"2023-10-06T02:23:15.910630+0000","last_peered":"2023-10-06T02:23:15.910630+0000","last_clean":"2023-10-06T02:23:15.910630+0000","last_became_active":"2023-10-06T02:23:15.907880+0000","last_became_peered":"2023-10-06T02:23:15.907880+0000","last_unstale":"2023-10-06T02:23:15.910630+0000","last_undegraded":"2023-10-06T02:23:15.910630+0000","last_fullsized":"2023-10-06T02:23:15.910630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.350772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.889655+0000","last_change":"2023-10-06T02:23:14.904479+0000","last_active":"2023-10-06T02:23:15.889655+0000","last_peered":"2023-10-06T02:23:15.889655+0000","last_clean":"2023-10-06T02:23:15.889655+0000","last_became_active":"2023-10-06T02:23:14.904187+0000","last_became_peered":"2023-10-06T02:23:14.904187+0000","last_unstale":"2023-10-06T02:23:15.889655+0000","last_undegraded":"2023-10-06T02:23:15.889655+0000","last_fullsized":"2023-10-06T02:23:15.889655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:09.928957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912505+0000","last_change":"2023-10-06T02:23:15.905556+0000","last_active":"2023-10-06T02:23:15.912505+0000","last_peered":"2023-10-06T02:23:15.912505+0000","last_clean":"2023-10-06T02:23:15.912505+0000","last_became_active":"2023-10-06T02:23:15.905335+0000","last_became_peered":"2023-10-06T02:23:15.905335+0000","last_unstale":"2023-10-06T02:23:15.912505+0000","last_undegraded":"2023-10-06T02:23:15.912505+0000","last_fullsized":"2023-10-06T02:23:15.912505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:18.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.892042+0000","last_change":"2023-10-06T02:23:14.900860+0000","last_active":"2023-10-06T02:23:15.892042+0000","last_peered":"2023-10-06T02:23:15.892042+0000","last_clean":"2023-10-06T02:23:15.892042+0000","last_became_active":"2023-10-06T02:23:14.900471+0000","last_became_peered":"2023-10-06T02:23:14.900471+0000","last_unstale":"2023-10-06T02:23:15.892042+0000","last_undegraded":"2023-10-06T02:23:15.892042+0000","last_fullsized":"2023-10-06T02:23:15.892042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:09.928957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920751+0000","last_change":"2023-10-06T02:23:15.917245+0000","last_active":"2023-10-06T02:23:15.920751+0000","last_peered":"2023-10-06T02:23:15.920751+0000","last_clean":"2023-10-06T02:23:15.920751+0000","last_became_active":"2023-10-06T02:23:15.916930+0000","last_became_peered":"2023-10-06T02:23:15.916930+0000","last_unstale":"2023-10-06T02:23:15.920751+0000","last_undegraded":"2023-10-06T02:23:15.920751+0000","last_fullsized":"2023-10-06T02:23:15.920751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:29.341324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915462+0000","last_change":"2023-10-06T02:23:14.908736+0000","last_active":"2023-10-06T02:23:15.915462+0000","last_peered":"2023-10-06T02:23:15.915462+0000","last_clean":"2023-10-06T02:23:15.915462+0000","last_became_active":"2023-10-06T02:23:14.908432+0000","last_became_peered":"2023-10-06T02:23:14.908432+0000","last_unstale":"2023-10-06T02:23:15.915462+0000","last_undegraded":"2023-10-06T02:23:15.915462+0000","last_fullsized":"2023-10-06T02:23:15.915462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:12.345251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.911912+0000","last_change":"2023-10-06T02:23:15.906639+0000","last_active":"2023-10-06T02:23:15.911912+0000","last_peered":"2023-10-06T02:23:15.911912+0000","last_clean":"2023-10-06T02:23:15.911912+0000","last_became_active":"2023-10-06T02:23:15.906358+0000","last_became_peered":"2023-10-06T02:23:15.906358+0000","last_unstale":"2023-10-06T02:23:15.911912+0000","last_undegraded":"2023-10-06T02:23:15.911912+0000","last_fullsized":"2023-10-06T02:23:15.911912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:41.861335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919121+0000","last_change":"2023-10-06T02:23:14.904865+0000","last_active":"2023-10-06T02:23:15.919121+0000","last_peered":"2023-10-06T02:23:15.919121+0000","last_clean":"2023-10-06T02:23:15.919121+0000","last_became_active":"2023-10-06T02:23:14.904563+0000","last_became_peered":"2023-10-06T02:23:14.904563+0000","last_unstale":"2023-10-06T02:23:15.919121+0000","last_undegraded":"2023-10-06T02:23:15.919121+0000","last_fullsized":"2023-10-06T02:23:15.919121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:07.580128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912663+0000","last_change":"2023-10-06T02:23:15.900282+0000","last_active":"2023-10-06T02:23:15.912663+0000","last_peered":"2023-10-06T02:23:15.912663+0000","last_clean":"2023-10-06T02:23:15.912663+0000","last_became_active":"2023-10-06T02:23:15.899729+0000","last_became_peered":"2023-10-06T02:23:15.899729+0000","last_unstale":"2023-10-06T02:23:15.912663+0000","last_undegraded":"2023-10-06T02:23:15.912663+0000","last_fullsized":"2023-10-06T02:23:15.912663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:16.019119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915056+0000","last_change":"2023-10-06T02:23:14.908091+0000","last_active":"2023-10-06T02:23:15.915056+0000","last_peered":"2023-10-06T02:23:15.915056+0000","last_clean":"2023-10-06T02:23:15.915056+0000","last_became_active":"2023-10-06T02:23:14.907787+0000","last_became_peered":"2023-10-06T02:23:14.907787+0000","last_unstale":"2023-10-06T02:23:15.915056+0000","last_undegraded":"2023-10-06T02:23:15.915056+0000","last_fullsized":"2023-10-06T02:23:15.915056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:51.619050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919379+0000","last_change":"2023-10-06T02:23:15.912494+0000","last_active":"2023-10-06T02:23:15.919379+0000","last_peered":"2023-10-06T02:23:15.919379+0000","last_clean":"2023-10-06T02:23:15.919379+0000","last_became_active":"2023-10-06T02:23:15.911909+0000","last_became_peered":"2023-10-06T02:23:15.911909+0000","last_unstale":"2023-10-06T02:23:15.919379+0000","last_undegraded":"2023-10-06T02:23:15.919379+0000","last_fullsized":"2023-10-06T02:23:15.919379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:16.019119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.889128+0000","last_change":"2023-10-06T02:23:14.900521+0000","last_active":"2023-10-06T02:23:15.889128+0000","last_peered":"2023-10-06T02:23:15.889128+0000","last_clean":"2023-10-06T02:23:15.889128+0000","last_became_active":"2023-10-06T02:23:14.900208+0000","last_became_peered":"2023-10-06T02:23:14.900208+0000","last_unstale":"2023-10-06T02:23:15.889128+0000","last_undegraded":"2023-10-06T02:23:15.889128+0000","last_fullsized":"2023-10-06T02:23:15.889128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:12.131483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916972+0000","last_change":"2023-10-06T02:23:15.915762+0000","last_active":"2023-10-06T02:23:15.916972+0000","last_peered":"2023-10-06T02:23:15.916972+0000","last_clean":"2023-10-06T02:23:15.916972+0000","last_became_active":"2023-10-06T02:23:15.915415+0000","last_became_peered":"2023-10-06T02:23:15.915415+0000","last_unstale":"2023-10-06T02:23:15.916972+0000","last_undegraded":"2023-10-06T02:23:15.916972+0000","last_fullsized":"2023-10-06T02:23:15.916972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.082330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.903833+0000","last_change":"2023-10-06T02:23:14.907899+0000","last_active":"2023-10-06T02:23:15.903833+0000","last_peered":"2023-10-06T02:23:15.903833+0000","last_clean":"2023-10-06T02:23:15.903833+0000","last_became_active":"2023-10-06T02:23:14.907600+0000","last_became_peered":"2023-10-06T02:23:14.907600+0000","last_unstale":"2023-10-06T02:23:15.903833+0000","last_undegraded":"2023-10-06T02:23:15.903833+0000","last_fullsized":"2023-10-06T02:23:15.903833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:50.363282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913744+0000","last_change":"2023-10-06T02:23:15.904238+0000","last_active":"2023-10-06T02:23:15.913744+0000","last_peered":"2023-10-06T02:23:15.913744+0000","last_clean":"2023-10-06T02:23:15.913744+0000","last_became_active":"2023-10-06T02:23:15.903899+0000","last_became_peered":"2023-10-06T02:23:15.903899+0000","last_unstale":"2023-10-06T02:23:15.913744+0000","last_undegraded":"2023-10-06T02:23:15.913744+0000","last_fullsized":"2023-10-06T02:23:15.913744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:29.341324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915845+0000","last_change":"2023-10-06T02:23:14.902984+0000","last_active":"2023-10-06T02:23:15.915845+0000","last_peered":"2023-10-06T02:23:15.915845+0000","last_clean":"2023-10-06T02:23:15.915845+0000","last_became_active":"2023-10-06T02:23:14.902743+0000","last_became_peered":"2023-10-06T02:23:14.902743+0000","last_unstale":"2023-10-06T02:23:15.915845+0000","last_undegraded":"2023-10-06T02:23:15.915845+0000","last_fullsized":"2023-10-06T02:23:15.915845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:07.580128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920917+0000","last_change":"2023-10-06T02:23:15.917272+0000","last_active":"2023-10-06T02:23:15.920917+0000","last_peered":"2023-10-06T02:23:15.920917+0000","last_clean":"2023-10-06T02:23:15.920917+0000","last_became_active":"2023-10-06T02:23:15.916874+0000","last_became_peered":"2023-10-06T02:23:15.916874+0000","last_unstale":"2023-10-06T02:23:15.920917+0000","last_undegraded":"2023-10-06T02:23:15.920917+0000","last_fullsized":"2023-10-06T02:23:15.920917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:22.459072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.914495+0000","last_change":"2023-10-06T02:23:14.908202+0000","last_active":"2023-10-06T02:23:15.914495+0000","last_peered":"2023-10-06T02:23:15.914495+0000","last_clean":"2023-10-06T02:23:15.914495+0000","last_became_active":"2023-10-06T02:23:14.907936+0000","last_became_peered":"2023-10-06T02:23:14.907936+0000","last_unstale":"2023-10-06T02:23:15.914495+0000","last_undegraded":"2023-10-06T02:23:15.914495+0000","last_fullsized":"2023-10-06T02:23:15.914495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:43.560751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916861+0000","last_change":"2023-10-06T02:23:15.914877+0000","last_active":"2023-10-06T02:23:15.916861+0000","last_peered":"2023-10-06T02:23:15.916861+0000","last_clean":"2023-10-06T02:23:15.916861+0000","last_became_active":"2023-10-06T02:23:15.914592+0000","last_became_peered":"2023-10-06T02:23:15.914592+0000","last_unstale":"2023-10-06T02:23:15.916861+0000","last_undegraded":"2023-10-06T02:23:15.916861+0000","last_fullsized":"2023-10-06T02:23:15.916861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.914703+0000","last_change":"2023-10-06T02:23:14.908061+0000","last_active":"2023-10-06T02:23:15.914703+0000","last_peered":"2023-10-06T02:23:15.914703+0000","last_clean":"2023-10-06T02:23:15.914703+0000","last_became_active":"2023-10-06T02:23:14.907687+0000","last_became_peered":"2023-10-06T02:23:14.907687+0000","last_unstale":"2023-10-06T02:23:15.914703+0000","last_undegraded":"2023-10-06T02:23:15.914703+0000","last_fullsized":"2023-10-06T02:23:15.914703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:23:20.174592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912220+0000","last_change":"2023-10-06T02:23:15.907204+0000","last_active":"2023-10-06T02:23:15.912220+0000","last_peered":"2023-10-06T02:23:15.912220+0000","last_clean":"2023-10-06T02:23:15.912220+0000","last_became_active":"2023-10-06T02:23:15.906946+0000","last_became_peered":"2023-10-06T02:23:15.906946+0000","last_unstale":"2023-10-06T02:23:15.912220+0000","last_undegraded":"2023-10-06T02:23:15.912220+0000","last_fullsized":"2023-10-06T02:23:15.912220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:04:48.105101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915301+0000","last_change":"2023-10-06T02:23:14.907440+0000","last_active":"2023-10-06T02:23:15.915301+0000","last_peered":"2023-10-06T02:23:15.915301+0000","last_clean":"2023-10-06T02:23:15.915301+0000","last_became_active":"2023-10-06T02:23:14.907153+0000","last_became_peered":"2023-10-06T02:23:14.907153+0000","last_unstale":"2023-10-06T02:23:15.915301+0000","last_undegraded":"2023-10-06T02:23:15.915301+0000","last_fullsized":"2023-10-06T02:23:15.915301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:41.976855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913457+0000","last_change":"2023-10-06T02:23:15.910344+0000","last_active":"2023-10-06T02:23:15.913457+0000","last_peered":"2023-10-06T02:23:15.913457+0000","last_clean":"2023-10-06T02:23:15.913457+0000","last_became_active":"2023-10-06T02:23:15.910087+0000","last_became_peered":"2023-10-06T02:23:15.910087+0000","last_unstale":"2023-10-06T02:23:15.913457+0000","last_undegraded":"2023-10-06T02:23:15.913457+0000","last_fullsized":"2023-10-06T02:23:15.913457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:32.631860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.891617+0000","last_change":"2023-10-06T02:23:14.899169+0000","last_active":"2023-10-06T02:23:15.891617+0000","last_peered":"2023-10-06T02:23:15.891617+0000","last_clean":"2023-10-06T02:23:15.891617+0000","last_became_active":"2023-10-06T02:23:14.898905+0000","last_became_peered":"2023-10-06T02:23:14.898905+0000","last_unstale":"2023-10-06T02:23:15.891617+0000","last_undegraded":"2023-10-06T02:23:15.891617+0000","last_fullsized":"2023-10-06T02:23:15.891617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:25.539314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915422+0000","last_change":"2023-10-06T02:23:15.906479+0000","last_active":"2023-10-06T02:23:15.915422+0000","last_peered":"2023-10-06T02:23:15.915422+0000","last_clean":"2023-10-06T02:23:15.915422+0000","last_became_active":"2023-10-06T02:23:15.906192+0000","last_became_peered":"2023-10-06T02:23:15.906192+0000","last_unstale":"2023-10-06T02:23:15.915422+0000","last_undegraded":"2023-10-06T02:23:15.915422+0000","last_fullsized":"2023-10-06T02:23:15.915422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:22.459072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.921109+0000","last_change":"2023-10-06T02:23:14.907796+0000","last_active":"2023-10-06T02:23:15.921109+0000","last_peered":"2023-10-06T02:23:15.921109+0000","last_clean":"2023-10-06T02:23:15.921109+0000","last_became_active":"2023-10-06T02:23:14.907286+0000","last_became_peered":"2023-10-06T02:23:14.907286+0000","last_unstale":"2023-10-06T02:23:15.921109+0000","last_undegraded":"2023-10-06T02:23:15.921109+0000","last_fullsized":"2023-10-06T02:23:15.921109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:09.928957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913082+0000","last_change":"2023-10-06T02:23:15.905225+0000","last_active":"2023-10-06T02:23:15.913082+0000","last_peered":"2023-10-06T02:23:15.913082+0000","last_clean":"2023-10-06T02:23:15.913082+0000","last_became_active":"2023-10-06T02:23:15.904931+0000","last_became_peered":"2023-10-06T02:23:15.904931+0000","last_unstale":"2023-10-06T02:23:15.913082+0000","last_undegraded":"2023-10-06T02:23:15.913082+0000","last_fullsized":"2023-10-06T02:23:15.913082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:12.297625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.898775+0000","last_change":"2023-10-06T02:23:14.905972+0000","last_active":"2023-10-06T02:23:15.898775+0000","last_peered":"2023-10-06T02:23:15.898775+0000","last_clean":"2023-10-06T02:23:15.898775+0000","last_became_active":"2023-10-06T02:23:14.905683+0000","last_became_peered":"2023-10-06T02:23:14.905683+0000","last_unstale":"2023-10-06T02:23:15.898775+0000","last_undegraded":"2023-10-06T02:23:15.898775+0000","last_fullsized":"2023-10-06T02:23:15.898775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:12.131483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913680+0000","last_change":"2023-10-06T02:23:15.909799+0000","last_active":"2023-10-06T02:23:15.913680+0000","last_peered":"2023-10-06T02:23:15.913680+0000","last_clean":"2023-10-06T02:23:15.913680+0000","last_became_active":"2023-10-06T02:23:15.909263+0000","last_became_peered":"2023-10-06T02:23:15.909263+0000","last_unstale":"2023-10-06T02:23:15.913680+0000","last_undegraded":"2023-10-06T02:23:15.913680+0000","last_fullsized":"2023-10-06T02:23:15.913680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:11.466544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.892075+0000","last_change":"2023-10-06T02:23:14.898612+0000","last_active":"2023-10-06T02:23:15.892075+0000","last_peered":"2023-10-06T02:23:15.892075+0000","last_clean":"2023-10-06T02:23:15.892075+0000","last_became_active":"2023-10-06T02:23:14.898323+0000","last_became_peered":"2023-10-06T02:23:14.898323+0000","last_unstale":"2023-10-06T02:23:15.892075+0000","last_undegraded":"2023-10-06T02:23:15.892075+0000","last_fullsized":"2023-10-06T02:23:15.892075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:25.539314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912215+0000","last_change":"2023-10-06T02:23:15.906103+0000","last_active":"2023-10-06T02:23:15.912215+0000","last_peered":"2023-10-06T02:23:15.912215+0000","last_clean":"2023-10-06T02:23:15.912215+0000","last_became_active":"2023-10-06T02:23:15.905549+0000","last_became_peered":"2023-10-06T02:23:15.905549+0000","last_unstale":"2023-10-06T02:23:15.912215+0000","last_undegraded":"2023-10-06T02:23:15.912215+0000","last_fullsized":"2023-10-06T02:23:15.912215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:25.497567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.896485+0000","last_change":"2023-10-06T02:23:14.907451+0000","last_active":"2023-10-06T02:23:15.896485+0000","last_peered":"2023-10-06T02:23:15.896485+0000","last_clean":"2023-10-06T02:23:15.896485+0000","last_became_active":"2023-10-06T02:23:14.907166+0000","last_became_peered":"2023-10-06T02:23:14.907166+0000","last_unstale":"2023-10-06T02:23:15.896485+0000","last_undegraded":"2023-10-06T02:23:15.896485+0000","last_fullsized":"2023-10-06T02:23:15.896485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:51.619050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920149+0000","last_change":"2023-10-06T02:23:15.916593+0000","last_active":"2023-10-06T02:23:15.920149+0000","last_peered":"2023-10-06T02:23:15.920149+0000","last_clean":"2023-10-06T02:23:15.920149+0000","last_became_active":"2023-10-06T02:23:15.916288+0000","last_became_peered":"2023-10-06T02:23:15.916288+0000","last_unstale":"2023-10-06T02:23:15.920149+0000","last_undegraded":"2023-10-06T02:23:15.920149+0000","last_fullsized":"2023-10-06T02:23:15.920149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.917451+0000","last_change":"2023-10-06T02:23:14.904396+0000","last_active":"2023-10-06T02:23:15.917451+0000","last_peered":"2023-10-06T02:23:15.917451+0000","last_clean":"2023-10-06T02:23:15.917451+0000","last_became_active":"2023-10-06T02:23:14.903093+0000","last_became_peered":"2023-10-06T02:23:14.903093+0000","last_unstale":"2023-10-06T02:23:15.917451+0000","last_undegraded":"2023-10-06T02:23:15.917451+0000","last_fullsized":"2023-10-06T02:23:15.917451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:47.698904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.893190+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:23:15.893190+0000","last_peered":"2023-10-06T02:23:15.893190+0000","last_clean":"2023-10-06T02:23:15.893190+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:23:15.893190+0000","last_undegraded":"2023-10-06T02:23:15.893190+0000","last_fullsized":"2023-10-06T02:23:15.893190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920866+0000","last_change":"2023-10-06T02:23:15.917453+0000","last_active":"2023-10-06T02:23:15.920866+0000","last_peered":"2023-10-06T02:23:15.920866+0000","last_clean":"2023-10-06T02:23:15.920866+0000","last_became_active":"2023-10-06T02:23:15.916802+0000","last_became_peered":"2023-10-06T02:23:15.916802+0000","last_unstale":"2023-10-06T02:23:15.920866+0000","last_undegraded":"2023-10-06T02:23:15.920866+0000","last_fullsized":"2023-10-06T02:23:15.920866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:28.665851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.895556+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:23:15.895556+0000","last_peered":"2023-10-06T02:23:15.895556+0000","last_clean":"2023-10-06T02:23:15.895556+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:23:15.895556+0000","last_undegraded":"2023-10-06T02:23:15.895556+0000","last_fullsized":"2023-10-06T02:23:15.895556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T02:23:16.929311+0000","last_change":"2023-10-06T02:23:14.907316+0000","last_active":"2023-10-06T02:23:16.929311+0000","last_peered":"2023-10-06T02:23:16.929311+0000","last_clean":"2023-10-06T02:23:16.929311+0000","last_became_active":"2023-10-06T02:23:14.907019+0000","last_became_peered":"2023-10-06T02:23:14.907019+0000","last_unstale":"2023-10-06T02:23:16.929311+0000","last_undegraded":"2023-10-06T02:23:16.929311+0000","last_fullsized":"2023-10-06T02:23:16.929311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:47.698904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910870+0000","last_change":"2023-10-06T02:23:15.898071+0000","last_active":"2023-10-06T02:23:15.910870+0000","last_peered":"2023-10-06T02:23:15.910870+0000","last_clean":"2023-10-06T02:23:15.910870+0000","last_became_active":"2023-10-06T02:23:15.897795+0000","last_became_peered":"2023-10-06T02:23:15.897795+0000","last_unstale":"2023-10-06T02:23:15.910870+0000","last_undegraded":"2023-10-06T02:23:15.910870+0000","last_fullsized":"2023-10-06T02:23:15.910870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:09.271518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.901685+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:23:15.901685+0000","last_peered":"2023-10-06T02:23:15.901685+0000","last_clean":"2023-10-06T02:23:15.901685+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:23:15.901685+0000","last_undegraded":"2023-10-06T02:23:15.901685+0000","last_fullsized":"2023-10-06T02:23:15.901685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.902452+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:23:15.902452+0000","last_peered":"2023-10-06T02:23:15.902452+0000","last_clean":"2023-10-06T02:23:15.902452+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:23:15.902452+0000","last_undegraded":"2023-10-06T02:23:15.902452+0000","last_fullsized":"2023-10-06T02:23:15.902452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.889151+0000","last_change":"2023-10-06T02:23:14.905959+0000","last_active":"2023-10-06T02:23:15.889151+0000","last_peered":"2023-10-06T02:23:15.889151+0000","last_clean":"2023-10-06T02:23:15.889151+0000","last_became_active":"2023-10-06T02:23:14.905642+0000","last_became_peered":"2023-10-06T02:23:14.905642+0000","last_unstale":"2023-10-06T02:23:15.889151+0000","last_undegraded":"2023-10-06T02:23:15.889151+0000","last_fullsized":"2023-10-06T02:23:15.889151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:37.900811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.921254+0000","last_change":"2023-10-06T02:23:15.913645+0000","last_active":"2023-10-06T02:23:15.921254+0000","last_peered":"2023-10-06T02:23:15.921254+0000","last_clean":"2023-10-06T02:23:15.921254+0000","last_became_active":"2023-10-06T02:23:15.913181+0000","last_became_peered":"2023-10-06T02:23:15.913181+0000","last_unstale":"2023-10-06T02:23:15.921254+0000","last_undegraded":"2023-10-06T02:23:15.921254+0000","last_fullsized":"2023-10-06T02:23:15.921254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:28.665851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.903221+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:23:15.903221+0000","last_peered":"2023-10-06T02:23:15.903221+0000","last_clean":"2023-10-06T02:23:15.903221+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:23:15.903221+0000","last_undegraded":"2023-10-06T02:23:15.903221+0000","last_fullsized":"2023-10-06T02:23:15.903221+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.900107+0000","last_change":"2023-10-06T02:23:14.905273+0000","last_active":"2023-10-06T02:23:15.900107+0000","last_peered":"2023-10-06T02:23:15.900107+0000","last_clean":"2023-10-06T02:23:15.900107+0000","last_became_active":"2023-10-06T02:23:14.905074+0000","last_became_peered":"2023-10-06T02:23:14.905074+0000","last_unstale":"2023-10-06T02:23:15.900107+0000","last_undegraded":"2023-10-06T02:23:15.900107+0000","last_fullsized":"2023-10-06T02:23:15.900107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:12.131483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920119+0000","last_change":"2023-10-06T02:23:15.915383+0000","last_active":"2023-10-06T02:23:15.920119+0000","last_peered":"2023-10-06T02:23:15.920119+0000","last_clean":"2023-10-06T02:23:15.920119+0000","last_became_active":"2023-10-06T02:23:15.914958+0000","last_became_peered":"2023-10-06T02:23:15.914958+0000","last_unstale":"2023-10-06T02:23:15.920119+0000","last_undegraded":"2023-10-06T02:23:15.920119+0000","last_fullsized":"2023-10-06T02:23:15.920119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:38:20.082330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.902020+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:23:15.902020+0000","last_peered":"2023-10-06T02:23:15.902020+0000","last_clean":"2023-10-06T02:23:15.902020+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:23:15.902020+0000","last_undegraded":"2023-10-06T02:23:15.902020+0000","last_fullsized":"2023-10-06T02:23:15.902020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.894837+0000","last_change":"2023-10-06T02:23:14.902760+0000","last_active":"2023-10-06T02:23:15.894837+0000","last_peered":"2023-10-06T02:23:15.894837+0000","last_clean":"2023-10-06T02:23:15.894837+0000","last_became_active":"2023-10-06T02:23:14.902458+0000","last_became_peered":"2023-10-06T02:23:14.902458+0000","last_unstale":"2023-10-06T02:23:15.894837+0000","last_undegraded":"2023-10-06T02:23:15.894837+0000","last_fullsized":"2023-10-06T02:23:15.894837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:43.560751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916289+0000","last_change":"2023-10-06T02:23:15.913677+0000","last_active":"2023-10-06T02:23:15.916289+0000","last_peered":"2023-10-06T02:23:15.916289+0000","last_clean":"2023-10-06T02:23:15.916289+0000","last_became_active":"2023-10-06T02:23:15.913379+0000","last_became_peered":"2023-10-06T02:23:15.913379+0000","last_unstale":"2023-10-06T02:23:15.916289+0000","last_undegraded":"2023-10-06T02:23:15.916289+0000","last_fullsized":"2023-10-06T02:23:15.916289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:42.982377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.890388+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:23:15.890388+0000","last_peered":"2023-10-06T02:23:15.890388+0000","last_clean":"2023-10-06T02:23:15.890388+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:23:15.890388+0000","last_undegraded":"2023-10-06T02:23:15.890388+0000","last_fullsized":"2023-10-06T02:23:15.890388+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.891338+0000","last_change":"2023-10-06T02:23:14.904576+0000","last_active":"2023-10-06T02:23:15.891338+0000","last_peered":"2023-10-06T02:23:15.891338+0000","last_clean":"2023-10-06T02:23:15.891338+0000","last_became_active":"2023-10-06T02:23:14.904268+0000","last_became_peered":"2023-10-06T02:23:14.904268+0000","last_unstale":"2023-10-06T02:23:15.891338+0000","last_undegraded":"2023-10-06T02:23:15.891338+0000","last_fullsized":"2023-10-06T02:23:15.891338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:47.698904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919339+0000","last_change":"2023-10-06T02:23:15.909310+0000","last_active":"2023-10-06T02:23:15.919339+0000","last_peered":"2023-10-06T02:23:15.919339+0000","last_clean":"2023-10-06T02:23:15.919339+0000","last_became_active":"2023-10-06T02:23:15.908957+0000","last_became_peered":"2023-10-06T02:23:15.908957+0000","last_unstale":"2023-10-06T02:23:15.919339+0000","last_undegraded":"2023-10-06T02:23:15.919339+0000","last_fullsized":"2023-10-06T02:23:15.919339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:21.310729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.899923+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:23:15.899923+0000","last_peered":"2023-10-06T02:23:15.899923+0000","last_clean":"2023-10-06T02:23:15.899923+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:23:15.899923+0000","last_undegraded":"2023-10-06T02:23:15.899923+0000","last_fullsized":"2023-10-06T02:23:15.899923+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.901669+0000","last_change":"2023-10-06T02:23:14.906039+0000","last_active":"2023-10-06T02:23:15.901669+0000","last_peered":"2023-10-06T02:23:15.901669+0000","last_clean":"2023-10-06T02:23:15.901669+0000","last_became_active":"2023-10-06T02:23:14.905477+0000","last_became_peered":"2023-10-06T02:23:14.905477+0000","last_unstale":"2023-10-06T02:23:15.901669+0000","last_undegraded":"2023-10-06T02:23:15.901669+0000","last_fullsized":"2023-10-06T02:23:15.901669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:07.580128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.897843+0000","last_change":"2023-10-06T02:23:15.895373+0000","last_active":"2023-10-06T02:23:15.897843+0000","last_peered":"2023-10-06T02:23:15.897843+0000","last_clean":"2023-10-06T02:23:15.897843+0000","last_became_active":"2023-10-06T02:23:15.895175+0000","last_became_peered":"2023-10-06T02:23:15.895175+0000","last_unstale":"2023-10-06T02:23:15.897843+0000","last_undegraded":"2023-10-06T02:23:15.897843+0000","last_fullsized":"2023-10-06T02:23:15.897843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.899917+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:23:15.899917+0000","last_peered":"2023-10-06T02:23:15.899917+0000","last_clean":"2023-10-06T02:23:15.899917+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:23:15.899917+0000","last_undegraded":"2023-10-06T02:23:15.899917+0000","last_fullsized":"2023-10-06T02:23:15.899917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.892937+0000","last_change":"2023-10-06T02:23:14.897008+0000","last_active":"2023-10-06T02:23:15.892937+0000","last_peered":"2023-10-06T02:23:15.892937+0000","last_clean":"2023-10-06T02:23:15.892937+0000","last_became_active":"2023-10-06T02:23:14.896700+0000","last_became_peered":"2023-10-06T02:23:14.896700+0000","last_unstale":"2023-10-06T02:23:15.892937+0000","last_undegraded":"2023-10-06T02:23:15.892937+0000","last_fullsized":"2023-10-06T02:23:15.892937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:43.560751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919846+0000","last_change":"2023-10-06T02:23:15.911793+0000","last_active":"2023-10-06T02:23:15.919846+0000","last_peered":"2023-10-06T02:23:15.919846+0000","last_clean":"2023-10-06T02:23:15.919846+0000","last_became_active":"2023-10-06T02:23:15.909785+0000","last_became_peered":"2023-10-06T02:23:15.909785+0000","last_unstale":"2023-10-06T02:23:15.919846+0000","last_undegraded":"2023-10-06T02:23:15.919846+0000","last_fullsized":"2023-10-06T02:23:15.919846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:13.350772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.915797+0000","last_change":"2023-10-06T02:23:14.908268+0000","last_active":"2023-10-06T02:23:15.915797+0000","last_peered":"2023-10-06T02:23:15.915797+0000","last_clean":"2023-10-06T02:23:15.915797+0000","last_became_active":"2023-10-06T02:23:14.907843+0000","last_became_peered":"2023-10-06T02:23:14.907843+0000","last_unstale":"2023-10-06T02:23:15.915797+0000","last_undegraded":"2023-10-06T02:23:15.915797+0000","last_fullsized":"2023-10-06T02:23:15.915797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:25.539314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919213+0000","last_change":"2023-10-06T02:23:15.907616+0000","last_active":"2023-10-06T02:23:15.919213+0000","last_peered":"2023-10-06T02:23:15.919213+0000","last_clean":"2023-10-06T02:23:15.919213+0000","last_became_active":"2023-10-06T02:23:15.907283+0000","last_became_peered":"2023-10-06T02:23:15.907283+0000","last_unstale":"2023-10-06T02:23:15.919213+0000","last_undegraded":"2023-10-06T02:23:15.919213+0000","last_fullsized":"2023-10-06T02:23:15.919213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:35.060508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913466+0000","last_change":"2023-10-06T02:23:14.895063+0000","last_active":"2023-10-06T02:23:15.913466+0000","last_peered":"2023-10-06T02:23:15.913466+0000","last_clean":"2023-10-06T02:23:15.913466+0000","last_became_active":"2023-10-06T02:23:14.894694+0000","last_became_peered":"2023-10-06T02:23:14.894694+0000","last_unstale":"2023-10-06T02:23:15.913466+0000","last_undegraded":"2023-10-06T02:23:15.913466+0000","last_fullsized":"2023-10-06T02:23:15.913466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.054986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.916712+0000","last_change":"2023-10-06T02:23:15.912820+0000","last_active":"2023-10-06T02:23:15.916712+0000","last_peered":"2023-10-06T02:23:15.916712+0000","last_clean":"2023-10-06T02:23:15.916712+0000","last_became_active":"2023-10-06T02:23:15.912469+0000","last_became_peered":"2023-10-06T02:23:15.912469+0000","last_unstale":"2023-10-06T02:23:15.916712+0000","last_undegraded":"2023-10-06T02:23:15.916712+0000","last_fullsized":"2023-10-06T02:23:15.916712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:20:07.345058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912740+0000","last_change":"2023-10-06T02:23:14.904850+0000","last_active":"2023-10-06T02:23:15.912740+0000","last_peered":"2023-10-06T02:23:15.912740+0000","last_clean":"2023-10-06T02:23:15.912740+0000","last_became_active":"2023-10-06T02:23:14.904569+0000","last_became_peered":"2023-10-06T02:23:14.904569+0000","last_unstale":"2023-10-06T02:23:15.912740+0000","last_undegraded":"2023-10-06T02:23:15.912740+0000","last_fullsized":"2023-10-06T02:23:15.912740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:47.698904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912380+0000","last_change":"2023-10-06T02:23:15.905102+0000","last_active":"2023-10-06T02:23:15.912380+0000","last_peered":"2023-10-06T02:23:15.912380+0000","last_clean":"2023-10-06T02:23:15.912380+0000","last_became_active":"2023-10-06T02:23:15.904796+0000","last_became_peered":"2023-10-06T02:23:15.904796+0000","last_unstale":"2023-10-06T02:23:15.912380+0000","last_undegraded":"2023-10-06T02:23:15.912380+0000","last_fullsized":"2023-10-06T02:23:15.912380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:47.162284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912504+0000","last_change":"2023-10-06T02:23:14.903685+0000","last_active":"2023-10-06T02:23:15.912504+0000","last_peered":"2023-10-06T02:23:15.912504+0000","last_clean":"2023-10-06T02:23:15.912504+0000","last_became_active":"2023-10-06T02:23:14.902829+0000","last_became_peered":"2023-10-06T02:23:14.902829+0000","last_unstale":"2023-10-06T02:23:15.912504+0000","last_undegraded":"2023-10-06T02:23:15.912504+0000","last_fullsized":"2023-10-06T02:23:15.912504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:50.363282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912866+0000","last_change":"2023-10-06T02:23:15.909237+0000","last_active":"2023-10-06T02:23:15.912866+0000","last_peered":"2023-10-06T02:23:15.912866+0000","last_clean":"2023-10-06T02:23:15.912866+0000","last_became_active":"2023-10-06T02:23:15.908957+0000","last_became_peered":"2023-10-06T02:23:15.908957+0000","last_unstale":"2023-10-06T02:23:15.912866+0000","last_undegraded":"2023-10-06T02:23:15.912866+0000","last_fullsized":"2023-10-06T02:23:15.912866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:58.662688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.910567+0000","last_change":"2023-10-06T02:23:14.904438+0000","last_active":"2023-10-06T02:23:15.910567+0000","last_peered":"2023-10-06T02:23:15.910567+0000","last_clean":"2023-10-06T02:23:15.910567+0000","last_became_active":"2023-10-06T02:23:14.904157+0000","last_became_peered":"2023-10-06T02:23:14.904157+0000","last_unstale":"2023-10-06T02:23:15.910567+0000","last_undegraded":"2023-10-06T02:23:15.910567+0000","last_fullsized":"2023-10-06T02:23:15.910567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:13.872192+0000","last_clean_scrub_stamp":"2023-10-06T02:23:13.872192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:34.054986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913770+0000","last_change":"2023-10-06T02:23:15.909579+0000","last_active":"2023-10-06T02:23:15.913770+0000","last_peered":"2023-10-06T02:23:15.913770+0000","last_clean":"2023-10-06T02:23:15.913770+0000","last_became_active":"2023-10-06T02:23:15.909173+0000","last_became_peered":"2023-10-06T02:23:15.909173+0000","last_unstale":"2023-10-06T02:23:15.913770+0000","last_undegraded":"2023-10-06T02:23:15.913770+0000","last_fullsized":"2023-10-06T02:23:15.913770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:14.278390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.913856+0000","last_change":"2023-10-06T02:23:15.911519+0000","last_active":"2023-10-06T02:23:15.913856+0000","last_peered":"2023-10-06T02:23:15.913856+0000","last_clean":"2023-10-06T02:23:15.913856+0000","last_became_active":"2023-10-06T02:23:15.911040+0000","last_became_peered":"2023-10-06T02:23:15.911040+0000","last_unstale":"2023-10-06T02:23:15.913856+0000","last_undegraded":"2023-10-06T02:23:15.913856+0000","last_fullsized":"2023-10-06T02:23:15.913856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:23:21.180114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.919359+0000","last_change":"2023-10-06T02:23:15.912783+0000","last_active":"2023-10-06T02:23:15.919359+0000","last_peered":"2023-10-06T02:23:15.919359+0000","last_clean":"2023-10-06T02:23:15.919359+0000","last_became_active":"2023-10-06T02:23:15.912284+0000","last_became_peered":"2023-10-06T02:23:15.912284+0000","last_unstale":"2023-10-06T02:23:15.919359+0000","last_undegraded":"2023-10-06T02:23:15.919359+0000","last_fullsized":"2023-10-06T02:23:15.919359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:25.497567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.912361+0000","last_change":"2023-10-06T02:23:15.902724+0000","last_active":"2023-10-06T02:23:15.912361+0000","last_peered":"2023-10-06T02:23:15.912361+0000","last_clean":"2023-10-06T02:23:15.912361+0000","last_became_active":"2023-10-06T02:23:15.902437+0000","last_became_peered":"2023-10-06T02:23:15.902437+0000","last_unstale":"2023-10-06T02:23:15.912361+0000","last_undegraded":"2023-10-06T02:23:15.912361+0000","last_fullsized":"2023-10-06T02:23:15.912361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:35.495163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920718+0000","last_change":"2023-10-06T02:23:15.918968+0000","last_active":"2023-10-06T02:23:15.920718+0000","last_peered":"2023-10-06T02:23:15.920718+0000","last_clean":"2023-10-06T02:23:15.920718+0000","last_became_active":"2023-10-06T02:23:15.918669+0000","last_became_peered":"2023-10-06T02:23:15.918669+0000","last_unstale":"2023-10-06T02:23:15.920718+0000","last_undegraded":"2023-10-06T02:23:15.920718+0000","last_fullsized":"2023-10-06T02:23:15.920718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:33.357066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T02:23:15.920160+0000","last_change":"2023-10-06T02:23:15.918229+0000","last_active":"2023-10-06T02:23:15.920160+0000","last_peered":"2023-10-06T02:23:15.920160+0000","last_clean":"2023-10-06T02:23:15.920160+0000","last_became_active":"2023-10-06T02:23:15.917809+0000","last_became_peered":"2023-10-06T02:23:15.917809+0000","last_unstale":"2023-10-06T02:23:15.920160+0000","last_undegraded":"2023-10-06T02:23:15.920160+0000","last_fullsized":"2023-10-06T02:23:15.920160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:14.877714+0000","last_clean_scrub_stamp":"2023-10-06T02:23:14.877714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:58.461395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":664552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.3639999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.7869999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.678000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.7270000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3460000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":73385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":74184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":72921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.217}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:23:27.872 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T02:23:27.872 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T02:23:27.872 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T02:23:27.872 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T02:23:28.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.023+0000 7f210d9ea700 1 Processor -- start 2023-10-06T02:23:28.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.023+0000 7f210d9ea700 1 -- start start 2023-10-06T02:23:28.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.024+0000 7f210d9ea700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f21080b17a0 0x7f2108159040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.024+0000 7f210d9ea700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f210815d1f0 con 0x7f21080a8920 2023-10-06T02:23:28.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.024+0000 7f210d9ea700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f210815dd70 con 0x7f21080a8cf0 2023-10-06T02:23:28.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.024+0000 7f210d9ea700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21080b4150 con 0x7f21080b17a0 2023-10-06T02:23:28.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.024+0000 7f2106ffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f21080a8920 0x7f21080b1090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34476/0 (socket says 172.21.15.37:34476) 2023-10-06T02:23:28.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.024+0000 7f2106ffd700 1 -- 172.21.15.37:0/1745299966 learned_addr learned my addr 172.21.15.37:0/1745299966 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:28.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f2105ffb700 1 -- 172.21.15.37:0/1745299966 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807619287 0 0) 0x7f210815d1f0 con 0x7f21080a8920 2023-10-06T02:23:28.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f2105ffb700 1 -- 172.21.15.37:0/1745299966 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20f4003570 con 0x7f21080a8920 2023-10-06T02:23:28.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f21067fc700 1 --2- 172.21.15.37:0/1745299966 >> v2:172.21.15.191:3300/0 conn(0x7f21080b17a0 0x7f2108159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f2105ffb700 1 -- 172.21.15.37:0/1745299966 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3591023966 0 0) 0x7f20f4003570 con 0x7f21080a8920 2023-10-06T02:23:28.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f2105ffb700 1 -- 172.21.15.37:0/1745299966 >> v2:172.21.15.191:3300/0 conn(0x7f21080b17a0 msgr2=0x7f2108159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:28.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f2105ffb700 1 --2- 172.21.15.37:0/1745299966 >> v2:172.21.15.191:3300/0 conn(0x7f21080b17a0 0x7f2108159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f2105ffb700 1 -- 172.21.15.37:0/1745299966 >> v1:172.21.15.191:6789/0 conn(0x7f21080a8cf0 legacy=0x7f2108159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f2105ffb700 1 -- 172.21.15.37:0/1745299966 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210815d440 con 0x7f21080a8920 2023-10-06T02:23:28.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f2105ffb700 1 -- 172.21.15.37:0/1745299966 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f2100001970 con 0x7f21080a8920 2023-10-06T02:23:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f2105ffb700 1 -- 172.21.15.37:0/1745299966 >> v1:172.21.15.37:6789/0 conn(0x7f21080a8920 legacy=0x7f21080b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f2105ffb700 1 --2- 172.21.15.37:0/1745299966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f20f4003a60 0x7f20f4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f2105ffb700 1 --2- 172.21.15.37:0/1745299966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20f4004810 0x7f20f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f2105ffb700 1 --2- 172.21.15.37:0/1745299966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f40051c0 0x7f20f400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f2105ffb700 1 -- 172.21.15.37:0/1745299966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f400c0a0 con 0x7f20f40051c0 2023-10-06T02:23:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f2105ffb700 1 -- 172.21.15.37:0/1745299966 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f400c210 con 0x7f20f4004810 2023-10-06T02:23:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f2105ffb700 1 -- 172.21.15.37:0/1745299966 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f400c3d0 con 0x7f20f4003a60 2023-10-06T02:23:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f21077fe700 1 --2- 172.21.15.37:0/1745299966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f40051c0 0x7f20f400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f21067fc700 1 --2- 172.21.15.37:0/1745299966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20f4004810 0x7f20f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f2106ffd700 1 --2- 172.21.15.37:0/1745299966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f20f4003a60 0x7f20f4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f21067fc700 1 -- 172.21.15.37:0/1745299966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f20f4003a60 msgr2=0x7f20f4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f21067fc700 1 --2- 172.21.15.37:0/1745299966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f20f4003a60 0x7f20f4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f21067fc700 1 -- 172.21.15.37:0/1745299966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f40051c0 msgr2=0x7f20f400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:28.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f21067fc700 1 --2- 172.21.15.37:0/1745299966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f40051c0 0x7f20f400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f21067fc700 1 -- 172.21.15.37:0/1745299966 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f4003570 con 0x7f20f4004810 2023-10-06T02:23:28.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f21077fe700 1 --2- 172.21.15.37:0/1745299966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f40051c0 0x7f20f400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:28.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.025+0000 7f21077fe700 1 -- 172.21.15.37:0/1745299966 reap_dead start 2023-10-06T02:23:28.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.026+0000 7f21067fc700 1 --2- 172.21.15.37:0/1745299966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20f4004810 0x7f20f4004c80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009c00 tx=0x7f20f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a1a01c5fa6e8a50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:28.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.026+0000 7f2105ffb700 1 -- 172.21.15.37:0/1745299966 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f000e710 con 0x7f20f4004810 2023-10-06T02:23:28.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.026+0000 7f2105ffb700 1 -- 172.21.15.37:0/1745299966 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f000e870 con 0x7f20f4004810 2023-10-06T02:23:28.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.026+0000 7f2105ffb700 1 -- 172.21.15.37:0/1745299966 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f000ec30 con 0x7f20f4004810 2023-10-06T02:23:28.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.026+0000 7f210d9ea700 1 -- 172.21.15.37:0/1745299966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20f4004810 msgr2=0x7f20f4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.026+0000 7f210d9ea700 1 --2- 172.21.15.37:0/1745299966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20f4004810 0x7f20f4004c80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009c00 tx=0x7f20f00091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.026+0000 7f210d9ea700 1 -- 172.21.15.37:0/1745299966 shutdown_connections 2023-10-06T02:23:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.026+0000 7f210d9ea700 1 --2- 172.21.15.37:0/1745299966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20f4004810 0x7f20f4004c80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.026+0000 7f210d9ea700 1 -- 172.21.15.37:0/1745299966 >> 172.21.15.37:0/1745299966 conn(0x7f2108067b30 msgr2=0x7f2108067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.026+0000 7f210d9ea700 1 -- 172.21.15.37:0/1745299966 shutdown_connections 2023-10-06T02:23:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.026+0000 7f210d9ea700 1 -- 172.21.15.37:0/1745299966 wait complete. 2023-10-06T02:23:28.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.028+0000 7f210d9ea700 1 Processor -- start 2023-10-06T02:23:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.028+0000 7f210d9ea700 1 -- start start 2023-10-06T02:23:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.028+0000 7f210d9ea700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f4004810 0x7f2108140cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.028+0000 7f210d9ea700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f210815be90 0x7f2108154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.028+0000 7f210d9ea700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21081511e0 0x7f2108154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.028+0000 7f210d9ea700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210815c6e0 con 0x7f20f4004810 2023-10-06T02:23:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.028+0000 7f210d9ea700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210816d800 con 0x7f21081511e0 2023-10-06T02:23:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.028+0000 7f210d9ea700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f210815c400 con 0x7f210815be90 2023-10-06T02:23:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.028+0000 7f2106ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f4004810 0x7f2108140cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.029+0000 7f2106ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f4004810 0x7f2108140cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42260/0 (socket says 172.21.15.37:42260) 2023-10-06T02:23:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.029+0000 7f2106ffd700 1 -- 172.21.15.37:0/3870475724 learned_addr learned my addr 172.21.15.37:0/3870475724 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.029+0000 7f21077fe700 1 --2- 172.21.15.37:0/3870475724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21081511e0 0x7f2108154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.029+0000 7f21067fc700 1 --2- 172.21.15.37:0/3870475724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f210815be90 0x7f2108154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.029+0000 7f2106ffd700 1 -- 172.21.15.37:0/3870475724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f210815be90 msgr2=0x7f2108154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.029+0000 7f2106ffd700 1 --2- 172.21.15.37:0/3870475724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f210815be90 0x7f2108154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.029+0000 7f2106ffd700 1 -- 172.21.15.37:0/3870475724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21081511e0 msgr2=0x7f2108154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.029+0000 7f2106ffd700 1 --2- 172.21.15.37:0/3870475724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21081511e0 0x7f2108154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.029+0000 7f2106ffd700 1 -- 172.21.15.37:0/3870475724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210816d1b0 con 0x7f20f4004810 2023-10-06T02:23:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.029+0000 7f21067fc700 1 --2- 172.21.15.37:0/3870475724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f210815be90 0x7f2108154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.029+0000 7f2106ffd700 1 --2- 172.21.15.37:0/3870475724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f4004810 0x7f2108140cd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f210000ffd0 tx=0x7f2100009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.029+0000 7f20feffd700 1 -- 172.21.15.37:0/3870475724 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2100005e50 con 0x7f20f4004810 2023-10-06T02:23:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.029+0000 7f20feffd700 1 -- 172.21.15.37:0/3870475724 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210000dad0 con 0x7f20f4004810 2023-10-06T02:23:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.029+0000 7f20feffd700 1 -- 172.21.15.37:0/3870475724 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210000de90 con 0x7f20f4004810 2023-10-06T02:23:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.029+0000 7f210d9ea700 1 -- 172.21.15.37:0/3870475724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f210816d490 con 0x7f20f4004810 2023-10-06T02:23:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.029+0000 7f210d9ea700 1 -- 172.21.15.37:0/3870475724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2108151960 con 0x7f20f4004810 2023-10-06T02:23:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.030+0000 7f210d9ea700 1 -- 172.21.15.37:0/3870475724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f210816cff0 con 0x7f20f4004810 2023-10-06T02:23:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.031+0000 7f20feffd700 1 -- 172.21.15.37:0/3870475724 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21000072e0 con 0x7f20f4004810 2023-10-06T02:23:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.031+0000 7f20feffd700 1 --2- 172.21.15.37:0/3870475724 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f20e8066f30 0x7f20e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.031+0000 7f20feffd700 1 -- 172.21.15.37:0/3870475724 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2100084dc0 con 0x7f20f4004810 2023-10-06T02:23:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.031+0000 7f21067fc700 1 --2- 172.21.15.37:0/3870475724 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f20e8066f30 0x7f20e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.032+0000 7f21067fc700 1 --2- 172.21.15.37:0/3870475724 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f20e8066f30 0x7f20e80693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f210806fe10 tx=0x7f20f001a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.035+0000 7f20feffd700 1 -- 172.21.15.37:0/3870475724 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2100051ed0 con 0x7f20f4004810 2023-10-06T02:23:28.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.271+0000 7f210d9ea700 1 -- 172.21.15.37:0/3870475724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f21080ad980 con 0x7f20f4004810 2023-10-06T02:23:28.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.271+0000 7f20feffd700 1 -- 172.21.15.37:0/3870475724 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f21000554f0 con 0x7f20f4004810 2023-10-06T02:23:28.324 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:28.324 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T02:23:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.273+0000 7f210d9ea700 1 -- 172.21.15.37:0/3870475724 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f20e8066f30 msgr2=0x7f20e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.273+0000 7f210d9ea700 1 --2- 172.21.15.37:0/3870475724 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f20e8066f30 0x7f20e80693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f210806fe10 tx=0x7f20f001a000 comp rx=0 tx=0).stop 2023-10-06T02:23:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.273+0000 7f210d9ea700 1 -- 172.21.15.37:0/3870475724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f4004810 msgr2=0x7f2108140cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.273+0000 7f210d9ea700 1 --2- 172.21.15.37:0/3870475724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f4004810 0x7f2108140cd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f210000ffd0 tx=0x7f2100009040 comp rx=0 tx=0).stop 2023-10-06T02:23:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.273+0000 7f210d9ea700 1 -- 172.21.15.37:0/3870475724 shutdown_connections 2023-10-06T02:23:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.273+0000 7f210d9ea700 1 --2- 172.21.15.37:0/3870475724 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f20e8066f30 0x7f20e80693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.273+0000 7f210d9ea700 1 --2- 172.21.15.37:0/3870475724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21081511e0 0x7f2108154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.273+0000 7f210d9ea700 1 --2- 172.21.15.37:0/3870475724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20f4004810 0x7f2108140cd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.273+0000 7f210d9ea700 1 --2- 172.21.15.37:0/3870475724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f210815be90 0x7f2108154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.273+0000 7f210d9ea700 1 -- 172.21.15.37:0/3870475724 >> 172.21.15.37:0/3870475724 conn(0x7f2108067b30 msgr2=0x7f21080af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:28.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.273+0000 7f210d9ea700 1 -- 172.21.15.37:0/3870475724 shutdown_connections 2023-10-06T02:23:28.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.273+0000 7f210d9ea700 1 -- 172.21.15.37:0/3870475724 wait complete. 2023-10-06T02:23:28.327 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T02:23:28.327 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:28.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.446+0000 7f9dd5375700 1 Processor -- start 2023-10-06T02:23:28.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.446+0000 7f9dd5375700 1 -- start start 2023-10-06T02:23:28.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.447+0000 7f9dd5375700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9dd01596d0 0x7f9dd00b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.447+0000 7f9dd5375700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd00c5300 con 0x7f9dd00b3840 2023-10-06T02:23:28.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.447+0000 7f9dd5375700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd00c6160 con 0x7f9dd0159aa0 2023-10-06T02:23:28.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.447+0000 7f9dd5375700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd00c5550 con 0x7f9dd01596d0 2023-10-06T02:23:28.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.447+0000 7f9dc7fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9dd00b3840 0x7f9dd00c65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34488/0 (socket says 172.21.15.37:34488) 2023-10-06T02:23:28.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.447+0000 7f9dc7fff700 1 -- 172.21.15.37:0/4197353040 learned_addr learned my addr 172.21.15.37:0/4197353040 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:28.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.447+0000 7f9dceffd700 1 --2- 172.21.15.37:0/4197353040 >> v2:172.21.15.191:3300/0 conn(0x7f9dd01596d0 0x7f9dd00b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.447+0000 7f9dce7fc700 1 -- 172.21.15.37:0/4197353040 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163289482 0 0) 0x7f9dd00c5300 con 0x7f9dd00b3840 2023-10-06T02:23:28.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.447+0000 7f9dce7fc700 1 -- 172.21.15.37:0/4197353040 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dbc003570 con 0x7f9dd00b3840 2023-10-06T02:23:28.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.448+0000 7f9dce7fc700 1 -- 172.21.15.37:0/4197353040 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4053566732 0 0) 0x7f9dbc003570 con 0x7f9dd00b3840 2023-10-06T02:23:28.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.448+0000 7f9dceffd700 1 -- 172.21.15.37:0/4197353040 >> v1:172.21.15.191:6789/0 conn(0x7f9dd0159aa0 legacy=0x7f9dd00cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.448+0000 7f9dceffd700 1 -- 172.21.15.37:0/4197353040 >> v1:172.21.15.37:6789/0 conn(0x7f9dd00b3840 legacy=0x7f9dd00c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.448+0000 7f9dceffd700 1 -- 172.21.15.37:0/4197353040 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd00c5830 con 0x7f9dd01596d0 2023-10-06T02:23:28.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.448+0000 7f9dceffd700 1 --2- 172.21.15.37:0/4197353040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dd01596d0 0x7f9dd00b3300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00098e0 tx=0x7f9dc00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=968ed3969b94a6d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:28.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.448+0000 7f9dce7fc700 1 -- 172.21.15.37:0/4197353040 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db8001470 con 0x7f9dd01596d0 2023-10-06T02:23:28.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.448+0000 7f9dce7fc700 1 -- 172.21.15.37:0/4197353040 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc0011420 con 0x7f9dd01596d0 2023-10-06T02:23:28.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.448+0000 7f9dce7fc700 1 -- 172.21.15.37:0/4197353040 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc00117a0 con 0x7f9dd01596d0 2023-10-06T02:23:28.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.449+0000 7f9dd5375700 1 -- 172.21.15.37:0/4197353040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dd01596d0 msgr2=0x7f9dd00b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.449+0000 7f9dd5375700 1 --2- 172.21.15.37:0/4197353040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dd01596d0 0x7f9dd00b3300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00098e0 tx=0x7f9dc00091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.449+0000 7f9dd5375700 1 -- 172.21.15.37:0/4197353040 shutdown_connections 2023-10-06T02:23:28.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.449+0000 7f9dd5375700 1 --2- 172.21.15.37:0/4197353040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dd01596d0 0x7f9dd00b3300 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.449+0000 7f9dd5375700 1 -- 172.21.15.37:0/4197353040 >> 172.21.15.37:0/4197353040 conn(0x7f9dd006c890 msgr2=0x7f9dd00d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:28.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.449+0000 7f9dd5375700 1 -- 172.21.15.37:0/4197353040 shutdown_connections 2023-10-06T02:23:28.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.449+0000 7f9dd5375700 1 -- 172.21.15.37:0/4197353040 wait complete. 2023-10-06T02:23:28.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.450+0000 7f9dd5375700 1 Processor -- start 2023-10-06T02:23:28.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.450+0000 7f9dd5375700 1 -- start start 2023-10-06T02:23:28.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.450+0000 7f9dd5375700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd00b3840 0x7f9dd0144f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.450+0000 7f9dd5375700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dd01596d0 0x7f9dd00cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.450+0000 7f9dd5375700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dd0159aa0 0x7f9dd00cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.450+0000 7f9dd5375700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd009a310 con 0x7f9dd00b3840 2023-10-06T02:23:28.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.450+0000 7f9dd5375700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd009d230 con 0x7f9dd01596d0 2023-10-06T02:23:28.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.450+0000 7f9dd5375700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd009d510 con 0x7f9dd0159aa0 2023-10-06T02:23:28.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.451+0000 7f9dceffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd00b3840 0x7f9dd0144f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.451+0000 7f9dceffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd00b3840 0x7f9dd0144f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42268/0 (socket says 172.21.15.37:42268) 2023-10-06T02:23:28.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.451+0000 7f9dceffd700 1 -- 172.21.15.37:0/1763991083 learned_addr learned my addr 172.21.15.37:0/1763991083 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:28.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.451+0000 7f9dc7fff700 1 --2- 172.21.15.37:0/1763991083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dd01596d0 0x7f9dd00cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.451+0000 7f9dcf7fe700 1 --2- 172.21.15.37:0/1763991083 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dd0159aa0 0x7f9dd00cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.451+0000 7f9dceffd700 1 -- 172.21.15.37:0/1763991083 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dd0159aa0 msgr2=0x7f9dd00cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.451+0000 7f9dceffd700 1 --2- 172.21.15.37:0/1763991083 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dd0159aa0 0x7f9dd00cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.451+0000 7f9dceffd700 1 -- 172.21.15.37:0/1763991083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dd01596d0 msgr2=0x7f9dd00cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.451+0000 7f9dceffd700 1 --2- 172.21.15.37:0/1763991083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dd01596d0 0x7f9dd00cf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.451+0000 7f9dceffd700 1 -- 172.21.15.37:0/1763991083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc0009420 con 0x7f9dd00b3840 2023-10-06T02:23:28.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.451+0000 7f9dcf7fe700 1 --2- 172.21.15.37:0/1763991083 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dd0159aa0 0x7f9dd00cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:28.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.451+0000 7f9dceffd700 1 --2- 172.21.15.37:0/1763991083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd00b3840 0x7f9dd0144f50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0088950 tx=0x7f9dc0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:28.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.451+0000 7f9dc6ffd700 1 -- 172.21.15.37:0/1763991083 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0010b70 con 0x7f9dd00b3840 2023-10-06T02:23:28.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.451+0000 7f9dc6ffd700 1 -- 172.21.15.37:0/1763991083 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc0010cd0 con 0x7f9dd00b3840 2023-10-06T02:23:28.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.451+0000 7f9dd5375700 1 -- 172.21.15.37:0/1763991083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd009d7f0 con 0x7f9dd00b3840 2023-10-06T02:23:28.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.451+0000 7f9dc6ffd700 1 -- 172.21.15.37:0/1763991083 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc001d640 con 0x7f9dd00b3840 2023-10-06T02:23:28.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.451+0000 7f9dd5375700 1 -- 172.21.15.37:0/1763991083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd015a4d0 con 0x7f9dd00b3840 2023-10-06T02:23:28.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.452+0000 7f9dd5375700 1 -- 172.21.15.37:0/1763991083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd006fbf0 con 0x7f9dd00b3840 2023-10-06T02:23:28.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.452+0000 7f9dc6ffd700 1 -- 172.21.15.37:0/1763991083 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9dc001d9b0 con 0x7f9dd00b3840 2023-10-06T02:23:28.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.453+0000 7f9dc6ffd700 1 --2- 172.21.15.37:0/1763991083 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9db0066f30 0x7f9db00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.453+0000 7f9dc6ffd700 1 -- 172.21.15.37:0/1763991083 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9dc0086140 con 0x7f9dd00b3840 2023-10-06T02:23:28.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.453+0000 7f9dc7fff700 1 --2- 172.21.15.37:0/1763991083 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9db0066f30 0x7f9db00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.454+0000 7f9dc7fff700 1 --2- 172.21.15.37:0/1763991083 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9db0066f30 0x7f9db00693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9db8001ed0 tx=0x7f9db8000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:28.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.457+0000 7f9dc6ffd700 1 -- 172.21.15.37:0/1763991083 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9dc0053250 con 0x7f9dd00b3840 2023-10-06T02:23:28.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.652+0000 7f9dd5375700 1 -- 172.21.15.37:0/1763991083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9dd015cfb0 con 0x7f9dd00b3840 2023-10-06T02:23:28.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.653+0000 7f9dc6ffd700 1 -- 172.21.15.37:0/1763991083 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f9dc0056870 con 0x7f9dd00b3840 2023-10-06T02:23:28.654 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:28.654 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:23:16.897625+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:13.004596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:14.268809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:28.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.655+0000 7f9dd5375700 1 -- 172.21.15.37:0/1763991083 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9db0066f30 msgr2=0x7f9db00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.655+0000 7f9dd5375700 1 --2- 172.21.15.37:0/1763991083 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9db0066f30 0x7f9db00693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9db8001ed0 tx=0x7f9db8000bc0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.655+0000 7f9dd5375700 1 -- 172.21.15.37:0/1763991083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd00b3840 msgr2=0x7f9dd0144f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.655+0000 7f9dd5375700 1 --2- 172.21.15.37:0/1763991083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd00b3840 0x7f9dd0144f50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0088950 tx=0x7f9dc0017000 comp rx=0 tx=0).stop 2023-10-06T02:23:28.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.655+0000 7f9dd5375700 1 -- 172.21.15.37:0/1763991083 shutdown_connections 2023-10-06T02:23:28.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.655+0000 7f9dd5375700 1 --2- 172.21.15.37:0/1763991083 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dd0159aa0 0x7f9dd00cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.655+0000 7f9dd5375700 1 --2- 172.21.15.37:0/1763991083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd00b3840 0x7f9dd0144f50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.655+0000 7f9dd5375700 1 --2- 172.21.15.37:0/1763991083 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9db0066f30 0x7f9db00693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.655+0000 7f9dd5375700 1 --2- 172.21.15.37:0/1763991083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dd01596d0 0x7f9dd00cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.655+0000 7f9dd5375700 1 -- 172.21.15.37:0/1763991083 >> 172.21.15.37:0/1763991083 conn(0x7f9dd006c890 msgr2=0x7f9dd00d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:28.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.655+0000 7f9dd5375700 1 -- 172.21.15.37:0/1763991083 shutdown_connections 2023-10-06T02:23:28.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.655+0000 7f9dd5375700 1 -- 172.21.15.37:0/1763991083 wait complete. 2023-10-06T02:23:28.668 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:23:08.066048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:23:08.561964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:23:13.004596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:23:14.268809+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:23:28.668 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:23:28.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.789+0000 7f52527b7700 1 Processor -- start 2023-10-06T02:23:28.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.789+0000 7f52527b7700 1 -- start start 2023-10-06T02:23:28.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.790+0000 7f52527b7700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f524c0b2a90 0x7f524c159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.790+0000 7f52527b7700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524c0b07a0 con 0x7f524c0ccb30 2023-10-06T02:23:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.790+0000 7f52527b7700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524c0cd8a0 con 0x7f524c1593c0 2023-10-06T02:23:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.790+0000 7f52527b7700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524c0cd6a0 con 0x7f524c0b2a90 2023-10-06T02:23:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.790+0000 7f5250d54700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f524c0ccb30 0x7f524c0ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34500/0 (socket says 172.21.15.37:34500) 2023-10-06T02:23:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.790+0000 7f5250d54700 1 -- 172.21.15.37:0/3722646890 learned_addr learned my addr 172.21.15.37:0/3722646890 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.790+0000 7f524affd700 1 -- 172.21.15.37:0/3722646890 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408521809 0 0) 0x7f524c0b07a0 con 0x7f524c0ccb30 2023-10-06T02:23:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.790+0000 7f524affd700 1 -- 172.21.15.37:0/3722646890 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5238003570 con 0x7f524c0ccb30 2023-10-06T02:23:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.790+0000 7f524b7fe700 1 --2- 172.21.15.37:0/3722646890 >> v2:172.21.15.191:3300/0 conn(0x7f524c0b2a90 0x7f524c159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f524affd700 1 -- 172.21.15.37:0/3722646890 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3469661749 0 0) 0x7f5238003570 con 0x7f524c0ccb30 2023-10-06T02:23:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f524affd700 1 -- 172.21.15.37:0/3722646890 >> v2:172.21.15.191:3300/0 conn(0x7f524c0b2a90 msgr2=0x7f524c159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:28.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f524affd700 1 --2- 172.21.15.37:0/3722646890 >> v2:172.21.15.191:3300/0 conn(0x7f524c0b2a90 0x7f524c159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f524affd700 1 -- 172.21.15.37:0/3722646890 >> v1:172.21.15.191:6789/0 conn(0x7f524c1593c0 legacy=0x7f524c0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f524affd700 1 -- 172.21.15.37:0/3722646890 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c0afe70 con 0x7f524c0ccb30 2023-10-06T02:23:28.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f524affd700 1 -- 172.21.15.37:0/3722646890 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f52440017f0 con 0x7f524c0ccb30 2023-10-06T02:23:28.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f524affd700 1 -- 172.21.15.37:0/3722646890 >> v1:172.21.15.37:6789/0 conn(0x7f524c0ccb30 legacy=0x7f524c0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f524affd700 1 --2- 172.21.15.37:0/3722646890 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5238003a60 0x7f5238003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f524affd700 1 --2- 172.21.15.37:0/3722646890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5238004810 0x7f5238004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f524affd700 1 --2- 172.21.15.37:0/3722646890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52380051c0 0x7f523800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f524affd700 1 -- 172.21.15.37:0/3722646890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c0cd6a0 con 0x7f52380051c0 2023-10-06T02:23:28.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f524affd700 1 -- 172.21.15.37:0/3722646890 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523800c0d0 con 0x7f5238004810 2023-10-06T02:23:28.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f524affd700 1 -- 172.21.15.37:0/3722646890 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523800c290 con 0x7f5238003a60 2023-10-06T02:23:28.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f5250d54700 1 --2- 172.21.15.37:0/3722646890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52380051c0 0x7f523800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f524bfff700 1 --2- 172.21.15.37:0/3722646890 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5238003a60 0x7f5238003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f524b7fe700 1 --2- 172.21.15.37:0/3722646890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5238004810 0x7f5238004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f5250d54700 1 -- 172.21.15.37:0/3722646890 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5238003a60 msgr2=0x7f5238003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:28.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f5250d54700 1 --2- 172.21.15.37:0/3722646890 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5238003a60 0x7f5238003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f5250d54700 1 -- 172.21.15.37:0/3722646890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5238004810 msgr2=0x7f5238004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:28.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f5250d54700 1 --2- 172.21.15.37:0/3722646890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5238004810 0x7f5238004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f5250d54700 1 -- 172.21.15.37:0/3722646890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5238003570 con 0x7f52380051c0 2023-10-06T02:23:28.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f5250d54700 1 -- 172.21.15.37:0/3722646890 reap_dead start 2023-10-06T02:23:28.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.791+0000 7f5250d54700 1 --2- 172.21.15.37:0/3722646890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52380051c0 0x7f523800ba60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f524400a930 tx=0x7f52440021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfa4d53abeec1d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:28.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.792+0000 7f524affd700 1 -- 172.21.15.37:0/3722646890 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52440070d0 con 0x7f52380051c0 2023-10-06T02:23:28.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.792+0000 7f524affd700 1 -- 172.21.15.37:0/3722646890 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5244007230 con 0x7f52380051c0 2023-10-06T02:23:28.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.792+0000 7f524affd700 1 -- 172.21.15.37:0/3722646890 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52440075d0 con 0x7f52380051c0 2023-10-06T02:23:28.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.792+0000 7f52527b7700 1 -- 172.21.15.37:0/3722646890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52380051c0 msgr2=0x7f523800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.792+0000 7f52527b7700 1 --2- 172.21.15.37:0/3722646890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52380051c0 0x7f523800ba60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f524400a930 tx=0x7f52440021d0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.792+0000 7f52527b7700 1 -- 172.21.15.37:0/3722646890 shutdown_connections 2023-10-06T02:23:28.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.792+0000 7f52527b7700 1 --2- 172.21.15.37:0/3722646890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52380051c0 0x7f523800ba60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.792+0000 7f52527b7700 1 -- 172.21.15.37:0/3722646890 >> 172.21.15.37:0/3722646890 conn(0x7f524c06c0b0 msgr2=0x7f524c06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:28.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.792+0000 7f52527b7700 1 -- 172.21.15.37:0/3722646890 shutdown_connections 2023-10-06T02:23:28.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.792+0000 7f52527b7700 1 -- 172.21.15.37:0/3722646890 wait complete. 2023-10-06T02:23:28.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.793+0000 7f52527b7700 1 Processor -- start 2023-10-06T02:23:28.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.793+0000 7f52527b7700 1 -- start start 2023-10-06T02:23:28.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.794+0000 7f52527b7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52380051c0 0x7f524c0c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.794+0000 7f52527b7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f524c0b5b00 0x7f524c151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.794+0000 7f52527b7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f524c0b5f70 0x7f524c151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.794+0000 7f52527b7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c0c8fc0 con 0x7f52380051c0 2023-10-06T02:23:28.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.794+0000 7f52527b7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c0c83b0 con 0x7f524c0b5f70 2023-10-06T02:23:28.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.794+0000 7f52527b7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524c0c8690 con 0x7f524c0b5b00 2023-10-06T02:23:28.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.794+0000 7f524bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52380051c0 0x7f524c0c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.794+0000 7f524bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52380051c0 0x7f524c0c9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42286/0 (socket says 172.21.15.37:42286) 2023-10-06T02:23:28.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.794+0000 7f524bfff700 1 -- 172.21.15.37:0/1556087218 learned_addr learned my addr 172.21.15.37:0/1556087218 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:28.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.794+0000 7f524b7fe700 1 --2- 172.21.15.37:0/1556087218 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f524c0b5b00 0x7f524c151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.794+0000 7f5250d54700 1 --2- 172.21.15.37:0/1556087218 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f524c0b5f70 0x7f524c151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.794+0000 7f524bfff700 1 -- 172.21.15.37:0/1556087218 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f524c0b5b00 msgr2=0x7f524c151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.794+0000 7f524bfff700 1 --2- 172.21.15.37:0/1556087218 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f524c0b5b00 0x7f524c151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.794+0000 7f524bfff700 1 -- 172.21.15.37:0/1556087218 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f524c0b5f70 msgr2=0x7f524c151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.794+0000 7f524bfff700 1 --2- 172.21.15.37:0/1556087218 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f524c0b5f70 0x7f524c151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:28.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.794+0000 7f524bfff700 1 -- 172.21.15.37:0/1556087218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c0c8970 con 0x7f52380051c0 2023-10-06T02:23:28.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.794+0000 7f524b7fe700 1 --2- 172.21.15.37:0/1556087218 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f524c0b5b00 0x7f524c151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:28.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.794+0000 7f5250d54700 1 --2- 172.21.15.37:0/1556087218 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f524c0b5f70 0x7f524c151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:28.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.795+0000 7f524bfff700 1 --2- 172.21.15.37:0/1556087218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52380051c0 0x7f524c0c9450 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f523c002950 tx=0x7f523c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:28.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.795+0000 7f5243fff700 1 -- 172.21.15.37:0/1556087218 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c002e90 con 0x7f52380051c0 2023-10-06T02:23:28.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.795+0000 7f5243fff700 1 -- 172.21.15.37:0/1556087218 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c00f8d0 con 0x7f52380051c0 2023-10-06T02:23:28.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.795+0000 7f52527b7700 1 -- 172.21.15.37:0/1556087218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524c0c8c50 con 0x7f52380051c0 2023-10-06T02:23:28.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.795+0000 7f5243fff700 1 -- 172.21.15.37:0/1556087218 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c00fc90 con 0x7f52380051c0 2023-10-06T02:23:28.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.795+0000 7f52527b7700 1 -- 172.21.15.37:0/1556087218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524c0c7680 con 0x7f52380051c0 2023-10-06T02:23:28.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.796+0000 7f52527b7700 1 -- 172.21.15.37:0/1556087218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524c0c8130 con 0x7f52380051c0 2023-10-06T02:23:28.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.796+0000 7f5243fff700 1 -- 172.21.15.37:0/1556087218 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f523c006820 con 0x7f52380051c0 2023-10-06T02:23:28.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.796+0000 7f5243fff700 1 --2- 172.21.15.37:0/1556087218 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f522c066f30 0x7f522c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:28.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.796+0000 7f5243fff700 1 -- 172.21.15.37:0/1556087218 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f523c084850 con 0x7f52380051c0 2023-10-06T02:23:28.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.797+0000 7f524b7fe700 1 --2- 172.21.15.37:0/1556087218 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f522c066f30 0x7f522c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:28.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.797+0000 7f524b7fe700 1 --2- 172.21.15.37:0/1556087218 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f522c066f30 0x7f522c0693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f524c16d320 tx=0x7f5234008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:28.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.801+0000 7f5243fff700 1 -- 172.21.15.37:0/1556087218 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f523c051960 con 0x7f52380051c0 2023-10-06T02:23:28.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.995+0000 7f52527b7700 1 -- 172.21.15.37:0/1556087218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f524c0b0150 con 0x7f52380051c0 2023-10-06T02:23:28.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.996+0000 7f5243fff700 1 -- 172.21.15.37:0/1556087218 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f523c054f80 con 0x7f52380051c0 2023-10-06T02:23:28.996 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T02:23:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.998+0000 7f52527b7700 1 -- 172.21.15.37:0/1556087218 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f522c066f30 msgr2=0x7f522c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.998+0000 7f52527b7700 1 --2- 172.21.15.37:0/1556087218 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f522c066f30 0x7f522c0693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f524c16d320 tx=0x7f5234008040 comp rx=0 tx=0).stop 2023-10-06T02:23:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.998+0000 7f52527b7700 1 -- 172.21.15.37:0/1556087218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52380051c0 msgr2=0x7f524c0c9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.998+0000 7f52527b7700 1 --2- 172.21.15.37:0/1556087218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52380051c0 0x7f524c0c9450 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f523c002950 tx=0x7f523c007d30 comp rx=0 tx=0).stop 2023-10-06T02:23:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.998+0000 7f52527b7700 1 -- 172.21.15.37:0/1556087218 shutdown_connections 2023-10-06T02:23:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.998+0000 7f52527b7700 1 --2- 172.21.15.37:0/1556087218 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f522c066f30 0x7f522c0693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.998+0000 7f52527b7700 1 --2- 172.21.15.37:0/1556087218 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f524c0b5f70 0x7f524c151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.998+0000 7f52527b7700 1 --2- 172.21.15.37:0/1556087218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52380051c0 0x7f524c0c9450 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.998+0000 7f52527b7700 1 --2- 172.21.15.37:0/1556087218 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f524c0b5b00 0x7f524c151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.998+0000 7f52527b7700 1 -- 172.21.15.37:0/1556087218 >> 172.21.15.37:0/1556087218 conn(0x7f524c06c0b0 msgr2=0x7f524c06c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:29.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.998+0000 7f52527b7700 1 -- 172.21.15.37:0/1556087218 shutdown_connections 2023-10-06T02:23:29.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:28.998+0000 7f52527b7700 1 -- 172.21.15.37:0/1556087218 wait complete. 2023-10-06T02:23:29.011 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:23:29.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.132+0000 7ffa8f627700 1 Processor -- start 2023-10-06T02:23:29.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.132+0000 7ffa8f627700 1 -- start start 2023-10-06T02:23:29.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.132+0000 7ffa8f627700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa880b2a90 0x7ffa88159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.132+0000 7ffa8f627700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffa880ccb30 0x7ffa880ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.133+0000 7ffa8f627700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa880b07a0 con 0x7ffa881593c0 2023-10-06T02:23:29.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.133+0000 7ffa8f627700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa880cd8a0 con 0x7ffa880ccb30 2023-10-06T02:23:29.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.133+0000 7ffa8f627700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880afe70 con 0x7ffa880b2a90 2023-10-06T02:23:29.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.133+0000 7ffa8d3c3700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ffa881593c0 0x7ffa880b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34510/0 (socket says 172.21.15.37:34510) 2023-10-06T02:23:29.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.133+0000 7ffa8d3c3700 1 -- 172.21.15.37:0/1280935093 learned_addr learned my addr 172.21.15.37:0/1280935093 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:29.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.133+0000 7ffa8dbc4700 1 --2- 172.21.15.37:0/1280935093 >> v2:172.21.15.37:3300/0 conn(0x7ffa880ccb30 0x7ffa880ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.133+0000 7ffa8cbc2700 1 --2- 172.21.15.37:0/1280935093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa880b2a90 0x7ffa88159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.133+0000 7ffa87fff700 1 -- 172.21.15.37:0/1280935093 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112179104 0 0) 0x7ffa880b07a0 con 0x7ffa881593c0 2023-10-06T02:23:29.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.133+0000 7ffa87fff700 1 -- 172.21.15.37:0/1280935093 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa70003570 con 0x7ffa881593c0 2023-10-06T02:23:29.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.133+0000 7ffa8dbc4700 1 -- 172.21.15.37:0/1280935093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa880b2a90 msgr2=0x7ffa88159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:29.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.133+0000 7ffa8dbc4700 1 --2- 172.21.15.37:0/1280935093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa880b2a90 0x7ffa88159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.133+0000 7ffa8dbc4700 1 -- 172.21.15.37:0/1280935093 >> v1:172.21.15.37:6789/0 conn(0x7ffa881593c0 legacy=0x7ffa880b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.133+0000 7ffa8dbc4700 1 -- 172.21.15.37:0/1280935093 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa880b0150 con 0x7ffa880ccb30 2023-10-06T02:23:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.133+0000 7ffa8cbc2700 1 --2- 172.21.15.37:0/1280935093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa880b2a90 0x7ffa88159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.133+0000 7ffa8dbc4700 1 --2- 172.21.15.37:0/1280935093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa880ccb30 0x7ffa880ccfb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009e60 tx=0x7ffa78009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2815173c623156 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.133+0000 7ffa87fff700 1 -- 172.21.15.37:0/1280935093 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7800e070 con 0x7ffa880ccb30 2023-10-06T02:23:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.133+0000 7ffa87fff700 1 -- 172.21.15.37:0/1280935093 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7800bab0 con 0x7ffa880ccb30 2023-10-06T02:23:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.133+0000 7ffa87fff700 1 -- 172.21.15.37:0/1280935093 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7800be70 con 0x7ffa880ccb30 2023-10-06T02:23:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.134+0000 7ffa8f627700 1 -- 172.21.15.37:0/1280935093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa880ccb30 msgr2=0x7ffa880ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.134+0000 7ffa8f627700 1 --2- 172.21.15.37:0/1280935093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa880ccb30 0x7ffa880ccfb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009e60 tx=0x7ffa78009780 comp rx=0 tx=0).stop 2023-10-06T02:23:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.134+0000 7ffa8f627700 1 -- 172.21.15.37:0/1280935093 shutdown_connections 2023-10-06T02:23:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.134+0000 7ffa8f627700 1 --2- 172.21.15.37:0/1280935093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa880ccb30 0x7ffa880ccfb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.134+0000 7ffa8f627700 1 --2- 172.21.15.37:0/1280935093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa880b2a90 0x7ffa88159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.134+0000 7ffa8f627700 1 -- 172.21.15.37:0/1280935093 >> 172.21.15.37:0/1280935093 conn(0x7ffa8806c0b0 msgr2=0x7ffa8806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:29.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.134+0000 7ffa8f627700 1 -- 172.21.15.37:0/1280935093 shutdown_connections 2023-10-06T02:23:29.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.134+0000 7ffa8f627700 1 -- 172.21.15.37:0/1280935093 wait complete. 2023-10-06T02:23:29.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.135+0000 7ffa8f627700 1 Processor -- start 2023-10-06T02:23:29.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.135+0000 7ffa8f627700 1 -- start start 2023-10-06T02:23:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.136+0000 7ffa8f627700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa880b2a90 0x7ffa88159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.136+0000 7ffa8f627700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa880ccb30 0x7ffa880b5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.136+0000 7ffa8f627700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffa881593c0 0x7ffa880b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.136+0000 7ffa8f627700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880c4900 con 0x7ffa880ccb30 2023-10-06T02:23:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.136+0000 7ffa8f627700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880c4b50 con 0x7ffa881593c0 2023-10-06T02:23:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.136+0000 7ffa8f627700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880c4e30 con 0x7ffa880b2a90 2023-10-06T02:23:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.136+0000 7ffa8cbc2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa880ccb30 0x7ffa880b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.136+0000 7ffa8cbc2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa880ccb30 0x7ffa880b5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42302/0 (socket says 172.21.15.37:42302) 2023-10-06T02:23:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.136+0000 7ffa8cbc2700 1 -- 172.21.15.37:0/742022841 learned_addr learned my addr 172.21.15.37:0/742022841 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.136+0000 7ffa8d3c3700 1 --2- 172.21.15.37:0/742022841 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa880b2a90 0x7ffa88159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.136+0000 7ffa8dbc4700 1 --2- 172.21.15.37:0/742022841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffa881593c0 0x7ffa880b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.136+0000 7ffa8cbc2700 1 -- 172.21.15.37:0/742022841 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa880b2a90 msgr2=0x7ffa88159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.136+0000 7ffa8cbc2700 1 --2- 172.21.15.37:0/742022841 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa880b2a90 0x7ffa88159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.136+0000 7ffa8cbc2700 1 -- 172.21.15.37:0/742022841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffa881593c0 msgr2=0x7ffa880b5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.136+0000 7ffa8cbc2700 1 --2- 172.21.15.37:0/742022841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffa881593c0 0x7ffa880b5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.136+0000 7ffa8cbc2700 1 -- 172.21.15.37:0/742022841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c009420 con 0x7ffa880ccb30 2023-10-06T02:23:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.136+0000 7ffa8dbc4700 1 --2- 172.21.15.37:0/742022841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffa881593c0 0x7ffa880b5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.137+0000 7ffa8cbc2700 1 --2- 172.21.15.37:0/742022841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa880ccb30 0x7ffa880b5930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00ec80 tx=0x7ffa7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.137+0000 7ffa857fa700 1 -- 172.21.15.37:0/742022841 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c00c9d0 con 0x7ffa880ccb30 2023-10-06T02:23:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.137+0000 7ffa857fa700 1 -- 172.21.15.37:0/742022841 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c00cb30 con 0x7ffa880ccb30 2023-10-06T02:23:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.137+0000 7ffa8f627700 1 -- 172.21.15.37:0/742022841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa78009a20 con 0x7ffa880ccb30 2023-10-06T02:23:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.137+0000 7ffa857fa700 1 -- 172.21.15.37:0/742022841 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c00ceb0 con 0x7ffa880ccb30 2023-10-06T02:23:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.137+0000 7ffa8f627700 1 -- 172.21.15.37:0/742022841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa880c53f0 con 0x7ffa880ccb30 2023-10-06T02:23:29.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.138+0000 7ffa8f627700 1 -- 172.21.15.37:0/742022841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa88088bb0 con 0x7ffa880ccb30 2023-10-06T02:23:29.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.138+0000 7ffa857fa700 1 -- 172.21.15.37:0/742022841 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa7c013680 con 0x7ffa880ccb30 2023-10-06T02:23:29.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.138+0000 7ffa857fa700 1 --2- 172.21.15.37:0/742022841 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ffa74066f30 0x7ffa740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.139+0000 7ffa857fa700 1 -- 172.21.15.37:0/742022841 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffa7c084ae0 con 0x7ffa880ccb30 2023-10-06T02:23:29.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.139+0000 7ffa8d3c3700 1 --2- 172.21.15.37:0/742022841 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ffa74066f30 0x7ffa740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.139+0000 7ffa8d3c3700 1 --2- 172.21.15.37:0/742022841 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ffa74066f30 0x7ffa740693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffa800058d0 tx=0x7ffa80009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:29.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.143+0000 7ffa857fa700 1 -- 172.21.15.37:0/742022841 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa7c051bf0 con 0x7ffa880ccb30 2023-10-06T02:23:29.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.335+0000 7ffa8f627700 1 -- 172.21.15.37:0/742022841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa880b0430 con 0x7ffa880ccb30 2023-10-06T02:23:29.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.336+0000 7ffa857fa700 1 -- 172.21.15.37:0/742022841 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa7c055210 con 0x7ffa880ccb30 2023-10-06T02:23:29.336 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T02:23:29.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.338+0000 7ffa8f627700 1 -- 172.21.15.37:0/742022841 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ffa74066f30 msgr2=0x7ffa740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.338+0000 7ffa8f627700 1 --2- 172.21.15.37:0/742022841 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ffa74066f30 0x7ffa740693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffa800058d0 tx=0x7ffa80009040 comp rx=0 tx=0).stop 2023-10-06T02:23:29.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.338+0000 7ffa8f627700 1 -- 172.21.15.37:0/742022841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa880ccb30 msgr2=0x7ffa880b5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.338+0000 7ffa8f627700 1 --2- 172.21.15.37:0/742022841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa880ccb30 0x7ffa880b5930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00ec80 tx=0x7ffa7c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.338+0000 7ffa8f627700 1 -- 172.21.15.37:0/742022841 shutdown_connections 2023-10-06T02:23:29.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.338+0000 7ffa8f627700 1 --2- 172.21.15.37:0/742022841 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ffa74066f30 0x7ffa740693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.338+0000 7ffa8f627700 1 --2- 172.21.15.37:0/742022841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffa881593c0 0x7ffa880b5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.338+0000 7ffa8f627700 1 --2- 172.21.15.37:0/742022841 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa880b2a90 0x7ffa88159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.338+0000 7ffa8f627700 1 --2- 172.21.15.37:0/742022841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa880ccb30 0x7ffa880b5930 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.338+0000 7ffa8f627700 1 -- 172.21.15.37:0/742022841 >> 172.21.15.37:0/742022841 conn(0x7ffa8806c0b0 msgr2=0x7ffa880b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:29.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.338+0000 7ffa8f627700 1 -- 172.21.15.37:0/742022841 shutdown_connections 2023-10-06T02:23:29.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.338+0000 7ffa8f627700 1 -- 172.21.15.37:0/742022841 wait complete. 2023-10-06T02:23:29.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:23:29.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.472+0000 7fa86ed52700 1 Processor -- start 2023-10-06T02:23:29.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.472+0000 7fa86ed52700 1 -- start start 2023-10-06T02:23:29.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.473+0000 7fa86ed52700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa8681593c0 0x7fa868159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.473+0000 7fa86ed52700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8680b2380 0x7fa8680b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.473+0000 7fa86ed52700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8680b07a0 con 0x7fa8680ccb30 2023-10-06T02:23:29.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.473+0000 7fa86ed52700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8680cd6c0 con 0x7fa8681593c0 2023-10-06T02:23:29.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.473+0000 7fa86ed52700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8680cd8a0 con 0x7fa8680b2380 2023-10-06T02:23:29.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.473+0000 7fa867fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8680b2380 0x7fa8680b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.473+0000 7fa86caee700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa8681593c0 0x7fa868159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.473+0000 7fa867fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8680b2380 0x7fa8680b27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:55488/0 (socket says 172.21.15.37:55488) 2023-10-06T02:23:29.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.473+0000 7fa867fff700 1 -- 172.21.15.37:0/738789303 learned_addr learned my addr 172.21.15.37:0/738789303 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:29.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.473+0000 7fa86d2ef700 1 --1- 172.21.15.37:0/738789303 >> v1:172.21.15.191:6789/0 conn(0x7fa8680ccb30 0x7fa8680ccfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:57810/0 (socket says 172.21.15.37:57810) 2023-10-06T02:23:29.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.473+0000 7fa867fff700 1 -- 172.21.15.37:0/738789303 >> v2:172.21.15.191:3300/0 conn(0x7fa8681593c0 msgr2=0x7fa868159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:29.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.473+0000 7fa867fff700 1 --2- 172.21.15.37:0/738789303 >> v2:172.21.15.191:3300/0 conn(0x7fa8681593c0 0x7fa868159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.473+0000 7fa867fff700 1 -- 172.21.15.37:0/738789303 >> v1:172.21.15.191:6789/0 conn(0x7fa8680ccb30 legacy=0x7fa8680ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.474+0000 7fa867fff700 1 -- 172.21.15.37:0/738789303 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8680afe70 con 0x7fa8680b2380 2023-10-06T02:23:29.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.474+0000 7fa867fff700 1 --2- 172.21.15.37:0/738789303 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8680b2380 0x7fa8680b27f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa858009f20 tx=0x7fa858009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e878741cd63fe654 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:29.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.474+0000 7fa8677fe700 1 -- 172.21.15.37:0/738789303 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85800e070 con 0x7fa8680b2380 2023-10-06T02:23:29.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.474+0000 7fa8677fe700 1 -- 172.21.15.37:0/738789303 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85800b9d0 con 0x7fa8680b2380 2023-10-06T02:23:29.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.474+0000 7fa8677fe700 1 -- 172.21.15.37:0/738789303 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8580092e0 con 0x7fa8680b2380 2023-10-06T02:23:29.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.474+0000 7fa86ed52700 1 -- 172.21.15.37:0/738789303 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8680b2380 msgr2=0x7fa8680b27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.474+0000 7fa86ed52700 1 --2- 172.21.15.37:0/738789303 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8680b2380 0x7fa8680b27f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa858009f20 tx=0x7fa858009840 comp rx=0 tx=0).stop 2023-10-06T02:23:29.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.474+0000 7fa86ed52700 1 -- 172.21.15.37:0/738789303 shutdown_connections 2023-10-06T02:23:29.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.474+0000 7fa86ed52700 1 --2- 172.21.15.37:0/738789303 >> v2:172.21.15.191:3300/0 conn(0x7fa8681593c0 0x7fa868159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.474+0000 7fa86ed52700 1 --2- 172.21.15.37:0/738789303 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8680b2380 0x7fa8680b27f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.474+0000 7fa86ed52700 1 -- 172.21.15.37:0/738789303 >> 172.21.15.37:0/738789303 conn(0x7fa86806c0b0 msgr2=0x7fa86806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:29.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.475+0000 7fa86ed52700 1 -- 172.21.15.37:0/738789303 shutdown_connections 2023-10-06T02:23:29.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.475+0000 7fa86ed52700 1 -- 172.21.15.37:0/738789303 wait complete. 2023-10-06T02:23:29.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.476+0000 7fa86ed52700 1 Processor -- start 2023-10-06T02:23:29.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.476+0000 7fa86ed52700 1 -- start start 2023-10-06T02:23:29.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.476+0000 7fa86ed52700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8680b2380 0x7fa8680c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa86ed52700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8680ccb30 0x7fa868153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa86ed52700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8681593c0 0x7fa868155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa86ed52700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa868169a30 con 0x7fa8680b2380 2023-10-06T02:23:29.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa86ed52700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8680c7840 con 0x7fa8680ccb30 2023-10-06T02:23:29.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa86ed52700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8680c7b20 con 0x7fa8681593c0 2023-10-06T02:23:29.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa86caee700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8680b2380 0x7fa8680c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa86caee700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8680b2380 0x7fa8680c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42312/0 (socket says 172.21.15.37:42312) 2023-10-06T02:23:29.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa867fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8680ccb30 0x7fa868153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa86caee700 1 -- 172.21.15.37:0/276839577 learned_addr learned my addr 172.21.15.37:0/276839577 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:29.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa86d2ef700 1 --2- 172.21.15.37:0/276839577 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8681593c0 0x7fa868155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa867fff700 1 -- 172.21.15.37:0/276839577 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8681593c0 msgr2=0x7fa868155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa867fff700 1 --2- 172.21.15.37:0/276839577 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8681593c0 0x7fa868155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa867fff700 1 -- 172.21.15.37:0/276839577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8680b2380 msgr2=0x7fa8680c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa867fff700 1 --2- 172.21.15.37:0/276839577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8680b2380 0x7fa8680c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa867fff700 1 -- 172.21.15.37:0/276839577 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa858009ae0 con 0x7fa8680ccb30 2023-10-06T02:23:29.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa86caee700 1 --2- 172.21.15.37:0/276839577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8680b2380 0x7fa8680c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:29.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa867fff700 1 --2- 172.21.15.37:0/276839577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8680ccb30 0x7fa868153710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa8680cc940 tx=0x7fa858018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:29.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa864ff9700 1 -- 172.21.15.37:0/276839577 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858008970 con 0x7fa8680ccb30 2023-10-06T02:23:29.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa864ff9700 1 -- 172.21.15.37:0/276839577 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa858008af0 con 0x7fa8680ccb30 2023-10-06T02:23:29.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa86ed52700 1 -- 172.21.15.37:0/276839577 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8680ca070 con 0x7fa8680ccb30 2023-10-06T02:23:29.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.477+0000 7fa864ff9700 1 -- 172.21.15.37:0/276839577 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858026460 con 0x7fa8680ccb30 2023-10-06T02:23:29.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.478+0000 7fa86ed52700 1 -- 172.21.15.37:0/276839577 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa868156690 con 0x7fa8680ccb30 2023-10-06T02:23:29.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.478+0000 7fa86ed52700 1 -- 172.21.15.37:0/276839577 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa868088bb0 con 0x7fa8680ccb30 2023-10-06T02:23:29.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.479+0000 7fa864ff9700 1 -- 172.21.15.37:0/276839577 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa858003040 con 0x7fa8680ccb30 2023-10-06T02:23:29.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.479+0000 7fa864ff9700 1 --2- 172.21.15.37:0/276839577 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa848066f30 0x7fa8480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.479+0000 7fa864ff9700 1 -- 172.21.15.37:0/276839577 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa8580865a0 con 0x7fa8680ccb30 2023-10-06T02:23:29.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.480+0000 7fa86caee700 1 --2- 172.21.15.37:0/276839577 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa848066f30 0x7fa8480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.480+0000 7fa86caee700 1 --2- 172.21.15.37:0/276839577 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa848066f30 0x7fa8480693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa860009fd0 tx=0x7fa8600091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:29.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.484+0000 7fa864ff9700 1 -- 172.21.15.37:0/276839577 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa858053730 con 0x7fa8680ccb30 2023-10-06T02:23:29.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.676+0000 7fa86ed52700 1 -- 172.21.15.37:0/276839577 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa86804bb80 con 0x7fa8680ccb30 2023-10-06T02:23:29.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.677+0000 7fa864ff9700 1 -- 172.21.15.37:0/276839577 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa858056d50 con 0x7fa8680ccb30 2023-10-06T02:23:29.678 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T02:23:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.679+0000 7fa86ed52700 1 -- 172.21.15.37:0/276839577 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa848066f30 msgr2=0x7fa8480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.679+0000 7fa86ed52700 1 --2- 172.21.15.37:0/276839577 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa848066f30 0x7fa8480693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa860009fd0 tx=0x7fa8600091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.679+0000 7fa86ed52700 1 -- 172.21.15.37:0/276839577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8680ccb30 msgr2=0x7fa868153710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.679+0000 7fa86ed52700 1 --2- 172.21.15.37:0/276839577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8680ccb30 0x7fa868153710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa8680cc940 tx=0x7fa858018000 comp rx=0 tx=0).stop 2023-10-06T02:23:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.679+0000 7fa86ed52700 1 -- 172.21.15.37:0/276839577 shutdown_connections 2023-10-06T02:23:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.679+0000 7fa86ed52700 1 --2- 172.21.15.37:0/276839577 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8681593c0 0x7fa868155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.679+0000 7fa86ed52700 1 --2- 172.21.15.37:0/276839577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8680b2380 0x7fa8680c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.679+0000 7fa86ed52700 1 --2- 172.21.15.37:0/276839577 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa848066f30 0x7fa8480693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.679+0000 7fa86ed52700 1 --2- 172.21.15.37:0/276839577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8680ccb30 0x7fa868153710 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.679+0000 7fa86ed52700 1 -- 172.21.15.37:0/276839577 >> 172.21.15.37:0/276839577 conn(0x7fa86806c0b0 msgr2=0x7fa8680b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.679+0000 7fa86ed52700 1 -- 172.21.15.37:0/276839577 shutdown_connections 2023-10-06T02:23:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.679+0000 7fa86ed52700 1 -- 172.21.15.37:0/276839577 wait complete. 2023-10-06T02:23:29.692 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:23:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.813+0000 7ff110cfc700 1 Processor -- start 2023-10-06T02:23:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.813+0000 7ff110cfc700 1 -- start start 2023-10-06T02:23:29.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.814+0000 7ff110cfc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff10c156fa0 0x7ff10c15d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.814+0000 7ff110cfc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff10c0d0b10 0x7ff10c0cba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.814+0000 7ff110cfc700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10c0cb580 con 0x7ff10c15a5e0 2023-10-06T02:23:29.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.814+0000 7ff110cfc700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10c15d790 con 0x7ff10c156fa0 2023-10-06T02:23:29.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.814+0000 7ff110cfc700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c15da70 con 0x7ff10c0d0b10 2023-10-06T02:23:29.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.814+0000 7ff109d9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff10c15a5e0 0x7ff10c0d0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34524/0 (socket says 172.21.15.37:34524) 2023-10-06T02:23:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.814+0000 7ff10a59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff10c156fa0 0x7ff10c15d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.814+0000 7ff109d9b700 1 -- 172.21.15.37:0/3207546537 learned_addr learned my addr 172.21.15.37:0/3207546537 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.814+0000 7ff10ad9d700 1 --2- 172.21.15.37:0/3207546537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff10c0d0b10 0x7ff10c0cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.814+0000 7ff10959a700 1 -- 172.21.15.37:0/3207546537 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000810133 0 0) 0x7ff10c0cb580 con 0x7ff10c15a5e0 2023-10-06T02:23:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.814+0000 7ff10959a700 1 -- 172.21.15.37:0/3207546537 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0f8003570 con 0x7ff10c15a5e0 2023-10-06T02:23:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.815+0000 7ff10a59c700 1 -- 172.21.15.37:0/3207546537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff10c0d0b10 msgr2=0x7ff10c0cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.815+0000 7ff10a59c700 1 --2- 172.21.15.37:0/3207546537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff10c0d0b10 0x7ff10c0cba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.815+0000 7ff10a59c700 1 -- 172.21.15.37:0/3207546537 >> v1:172.21.15.37:6789/0 conn(0x7ff10c15a5e0 legacy=0x7ff10c0d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.815+0000 7ff10a59c700 1 -- 172.21.15.37:0/3207546537 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c15dd50 con 0x7ff10c156fa0 2023-10-06T02:23:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.815+0000 7ff10ad9d700 1 --2- 172.21.15.37:0/3207546537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff10c0d0b10 0x7ff10c0cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.815+0000 7ff10a59c700 1 --2- 172.21.15.37:0/3207546537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff10c156fa0 0x7ff10c15d1b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff104009e60 tx=0x7ff104009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242ba81dcba6596d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.815+0000 7ff10959a700 1 -- 172.21.15.37:0/3207546537 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10400e070 con 0x7ff10c156fa0 2023-10-06T02:23:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.815+0000 7ff10959a700 1 -- 172.21.15.37:0/3207546537 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10400bb60 con 0x7ff10c156fa0 2023-10-06T02:23:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.815+0000 7ff10959a700 1 -- 172.21.15.37:0/3207546537 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104012430 con 0x7ff10c156fa0 2023-10-06T02:23:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.815+0000 7ff110cfc700 1 -- 172.21.15.37:0/3207546537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff10c156fa0 msgr2=0x7ff10c15d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.815+0000 7ff110cfc700 1 --2- 172.21.15.37:0/3207546537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff10c156fa0 0x7ff10c15d1b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff104009e60 tx=0x7ff104009780 comp rx=0 tx=0).stop 2023-10-06T02:23:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.815+0000 7ff110cfc700 1 -- 172.21.15.37:0/3207546537 shutdown_connections 2023-10-06T02:23:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.815+0000 7ff110cfc700 1 --2- 172.21.15.37:0/3207546537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff10c0d0b10 0x7ff10c0cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.815+0000 7ff110cfc700 1 --2- 172.21.15.37:0/3207546537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff10c156fa0 0x7ff10c15d1b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.815+0000 7ff110cfc700 1 -- 172.21.15.37:0/3207546537 >> 172.21.15.37:0/3207546537 conn(0x7ff10c06c0b0 msgr2=0x7ff10c06c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.815+0000 7ff110cfc700 1 -- 172.21.15.37:0/3207546537 shutdown_connections 2023-10-06T02:23:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.815+0000 7ff110cfc700 1 -- 172.21.15.37:0/3207546537 wait complete. 2023-10-06T02:23:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.816+0000 7ff110cfc700 1 Processor -- start 2023-10-06T02:23:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.817+0000 7ff110cfc700 1 -- start start 2023-10-06T02:23:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.817+0000 7ff110cfc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff10c0d0b10 0x7ff10c0b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.817+0000 7ff110cfc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff10c156fa0 0x7ff10c147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.817+0000 7ff110cfc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff10c15a5e0 0x7ff10c0b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.817+0000 7ff110cfc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c158380 con 0x7ff10c15a5e0 2023-10-06T02:23:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.817+0000 7ff110cfc700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c0b6340 con 0x7ff10c156fa0 2023-10-06T02:23:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.817+0000 7ff110cfc700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c157800 con 0x7ff10c0d0b10 2023-10-06T02:23:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.817+0000 7ff10ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff10c15a5e0 0x7ff10c0b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.817+0000 7ff10ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff10c15a5e0 0x7ff10c0b23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42318/0 (socket says 172.21.15.37:42318) 2023-10-06T02:23:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.817+0000 7ff10ad9d700 1 -- 172.21.15.37:0/3126227058 learned_addr learned my addr 172.21.15.37:0/3126227058 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.818+0000 7ff10ad9d700 1 -- 172.21.15.37:0/3126227058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff10c0d0b10 msgr2=0x7ff10c0b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.818+0000 7ff10a59c700 1 --2- 172.21.15.37:0/3126227058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff10c0d0b10 0x7ff10c0b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.818+0000 7ff109d9b700 1 --2- 172.21.15.37:0/3126227058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff10c156fa0 0x7ff10c147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.818+0000 7ff10ad9d700 1 --2- 172.21.15.37:0/3126227058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff10c0d0b10 0x7ff10c0b5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.818+0000 7ff10ad9d700 1 -- 172.21.15.37:0/3126227058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff10c156fa0 msgr2=0x7ff10c147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.818+0000 7ff10ad9d700 1 --2- 172.21.15.37:0/3126227058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff10c156fa0 0x7ff10c147eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.818+0000 7ff10ad9d700 1 -- 172.21.15.37:0/3126227058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff104009a20 con 0x7ff10c15a5e0 2023-10-06T02:23:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.818+0000 7ff10a59c700 1 --2- 172.21.15.37:0/3126227058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff10c0d0b10 0x7ff10c0b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.818+0000 7ff109d9b700 1 --2- 172.21.15.37:0/3126227058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff10c156fa0 0x7ff10c147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.818+0000 7ff10ad9d700 1 --2- 172.21.15.37:0/3126227058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff10c15a5e0 0x7ff10c0b23c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00e870 tx=0x7ff0fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.818+0000 7ff1027fc700 1 -- 172.21.15.37:0/3126227058 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc00c430 con 0x7ff10c15a5e0 2023-10-06T02:23:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.818+0000 7ff1027fc700 1 -- 172.21.15.37:0/3126227058 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0fc00c590 con 0x7ff10c15a5e0 2023-10-06T02:23:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.818+0000 7ff110cfc700 1 -- 172.21.15.37:0/3126227058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10c157ae0 con 0x7ff10c15a5e0 2023-10-06T02:23:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.818+0000 7ff1027fc700 1 -- 172.21.15.37:0/3126227058 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc00c910 con 0x7ff10c15a5e0 2023-10-06T02:23:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.818+0000 7ff110cfc700 1 -- 172.21.15.37:0/3126227058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10c1580a0 con 0x7ff10c15a5e0 2023-10-06T02:23:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.819+0000 7ff110cfc700 1 -- 172.21.15.37:0/3126227058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff10c04c3c0 con 0x7ff10c15a5e0 2023-10-06T02:23:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.819+0000 7ff1027fc700 1 -- 172.21.15.37:0/3126227058 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0fc00cd40 con 0x7ff10c15a5e0 2023-10-06T02:23:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.820+0000 7ff1027fc700 1 --2- 172.21.15.37:0/3126227058 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff0ec066f30 0x7ff0ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:29.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.820+0000 7ff1027fc700 1 -- 172.21.15.37:0/3126227058 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff0fc084430 con 0x7ff10c15a5e0 2023-10-06T02:23:29.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.820+0000 7ff10a59c700 1 --2- 172.21.15.37:0/3126227058 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff0ec066f30 0x7ff0ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:29.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.820+0000 7ff10a59c700 1 --2- 172.21.15.37:0/3126227058 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff0ec066f30 0x7ff0ec0693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff1040097c0 tx=0x7ff104019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:29.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:29.824+0000 7ff1027fc700 1 -- 172.21.15.37:0/3126227058 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0fc051540 con 0x7ff10c15a5e0 2023-10-06T02:23:30.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.015+0000 7ff110cfc700 1 -- 172.21.15.37:0/3126227058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff10c1585c0 con 0x7ff10c15a5e0 2023-10-06T02:23:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.015+0000 7ff1027fc700 1 -- 172.21.15.37:0/3126227058 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff0fc054b60 con 0x7ff10c15a5e0 2023-10-06T02:23:30.016 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T02:23:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.017+0000 7ff110cfc700 1 -- 172.21.15.37:0/3126227058 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff0ec066f30 msgr2=0x7ff0ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.017+0000 7ff110cfc700 1 --2- 172.21.15.37:0/3126227058 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff0ec066f30 0x7ff0ec0693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff1040097c0 tx=0x7ff104019000 comp rx=0 tx=0).stop 2023-10-06T02:23:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.017+0000 7ff110cfc700 1 -- 172.21.15.37:0/3126227058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff10c15a5e0 msgr2=0x7ff10c0b23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.017+0000 7ff110cfc700 1 --2- 172.21.15.37:0/3126227058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff10c15a5e0 0x7ff10c0b23c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00e870 tx=0x7ff0fc008040 comp rx=0 tx=0).stop 2023-10-06T02:23:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.017+0000 7ff110cfc700 1 -- 172.21.15.37:0/3126227058 shutdown_connections 2023-10-06T02:23:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.017+0000 7ff110cfc700 1 --2- 172.21.15.37:0/3126227058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff10c15a5e0 0x7ff10c0b23c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.017+0000 7ff110cfc700 1 --2- 172.21.15.37:0/3126227058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff10c0d0b10 0x7ff10c0b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.017+0000 7ff110cfc700 1 --2- 172.21.15.37:0/3126227058 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff0ec066f30 0x7ff0ec0693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.017+0000 7ff110cfc700 1 --2- 172.21.15.37:0/3126227058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff10c156fa0 0x7ff10c147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.017+0000 7ff110cfc700 1 -- 172.21.15.37:0/3126227058 >> 172.21.15.37:0/3126227058 conn(0x7ff10c06c0b0 msgr2=0x7ff10c0c6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.017+0000 7ff110cfc700 1 -- 172.21.15.37:0/3126227058 shutdown_connections 2023-10-06T02:23:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.017+0000 7ff110cfc700 1 -- 172.21.15.37:0/3126227058 wait complete. 2023-10-06T02:23:30.029 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:23:30.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.148+0000 7f7f2f663700 1 Processor -- start 2023-10-06T02:23:30.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.148+0000 7f7f2f663700 1 -- start start 2023-10-06T02:23:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.149+0000 7f7f2f663700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f7f28159760 0x7f7f2815d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.149+0000 7f7f2f663700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f2815d8d0 0x7f7f2815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.149+0000 7f7f2f663700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f280cb650 con 0x7f7f280c5390 2023-10-06T02:23:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.149+0000 7f7f2f663700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f280cc2d0 con 0x7f7f2815d8d0 2023-10-06T02:23:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.149+0000 7f7f2f663700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f280cb930 con 0x7f7f28159760 2023-10-06T02:23:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.149+0000 7f7f2cbfe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f2815d8d0 0x7f7f2815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.149+0000 7f7f2dc00700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7f280c5390 0x7f7f280c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34526/0 (socket says 172.21.15.37:34526) 2023-10-06T02:23:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.149+0000 7f7f2dc00700 1 -- 172.21.15.37:0/3383972082 learned_addr learned my addr 172.21.15.37:0/3383972082 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.149+0000 7f7f2d3ff700 1 --2- 172.21.15.37:0/3383972082 >> v2:172.21.15.191:3300/0 conn(0x7f7f28159760 0x7f7f2815d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.149+0000 7f7f2cbfe700 1 -- 172.21.15.37:0/3383972082 >> v2:172.21.15.191:3300/0 conn(0x7f7f28159760 msgr2=0x7f7f2815d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.149+0000 7f7f2cbfe700 1 --2- 172.21.15.37:0/3383972082 >> v2:172.21.15.191:3300/0 conn(0x7f7f28159760 0x7f7f2815d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.149+0000 7f7f2cbfe700 1 -- 172.21.15.37:0/3383972082 >> v1:172.21.15.37:6789/0 conn(0x7f7f280c5390 legacy=0x7f7f280c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.149+0000 7f7f2cbfe700 1 -- 172.21.15.37:0/3383972082 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f280cbc10 con 0x7f7f2815d8d0 2023-10-06T02:23:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.149+0000 7f7f1ffff700 1 -- 172.21.15.37:0/3383972082 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962656307 0 0) 0x7f7f280cb650 con 0x7f7f280c5390 2023-10-06T02:23:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.150+0000 7f7f2cbfe700 1 --2- 172.21.15.37:0/3383972082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2815d8d0 0x7f7f2815dd50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7f280897f0 tx=0x7f7f180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ab496b7617f0a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.150+0000 7f7f1ffff700 1 -- 172.21.15.37:0/3383972082 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1800b740 con 0x7f7f2815d8d0 2023-10-06T02:23:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.150+0000 7f7f1ffff700 1 -- 172.21.15.37:0/3383972082 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1800b8a0 con 0x7f7f2815d8d0 2023-10-06T02:23:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.150+0000 7f7f1ffff700 1 -- 172.21.15.37:0/3383972082 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1800bc40 con 0x7f7f2815d8d0 2023-10-06T02:23:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.150+0000 7f7f2f663700 1 -- 172.21.15.37:0/3383972082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2815d8d0 msgr2=0x7f7f2815dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.150+0000 7f7f2f663700 1 --2- 172.21.15.37:0/3383972082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2815d8d0 0x7f7f2815dd50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7f280897f0 tx=0x7f7f180091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.150+0000 7f7f2f663700 1 -- 172.21.15.37:0/3383972082 shutdown_connections 2023-10-06T02:23:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.150+0000 7f7f2f663700 1 --2- 172.21.15.37:0/3383972082 >> v2:172.21.15.191:3300/0 conn(0x7f7f28159760 0x7f7f2815d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.150+0000 7f7f2f663700 1 --2- 172.21.15.37:0/3383972082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2815d8d0 0x7f7f2815dd50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.150+0000 7f7f2f663700 1 -- 172.21.15.37:0/3383972082 >> 172.21.15.37:0/3383972082 conn(0x7f7f2806c890 msgr2=0x7f7f280d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.151+0000 7f7f2f663700 1 -- 172.21.15.37:0/3383972082 shutdown_connections 2023-10-06T02:23:30.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.151+0000 7f7f2f663700 1 -- 172.21.15.37:0/3383972082 wait complete. 2023-10-06T02:23:30.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.152+0000 7f7f2f663700 1 Processor -- start 2023-10-06T02:23:30.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.152+0000 7f7f2f663700 1 -- start start 2023-10-06T02:23:30.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.152+0000 7f7f2f663700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f280c5390 0x7f7f2816d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:30.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.153+0000 7f7f2f663700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f28159760 0x7f7f2816d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:30.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.153+0000 7f7f2f663700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2815d8d0 0x7f7f2815b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:30.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.153+0000 7f7f2f663700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2816acc0 con 0x7f7f2815d8d0 2023-10-06T02:23:30.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.153+0000 7f7f2f663700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2816b520 con 0x7f7f28159760 2023-10-06T02:23:30.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.153+0000 7f7f2f663700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2815c510 con 0x7f7f280c5390 2023-10-06T02:23:30.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.153+0000 7f7f2dc00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2815d8d0 0x7f7f2815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:30.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.153+0000 7f7f2dc00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2815d8d0 0x7f7f2815b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42336/0 (socket says 172.21.15.37:42336) 2023-10-06T02:23:30.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.153+0000 7f7f2dc00700 1 -- 172.21.15.37:0/111221266 learned_addr learned my addr 172.21.15.37:0/111221266 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:30.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.153+0000 7f7f2d3ff700 1 --2- 172.21.15.37:0/111221266 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f280c5390 0x7f7f2816d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:30.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.153+0000 7f7f2cbfe700 1 --2- 172.21.15.37:0/111221266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f28159760 0x7f7f2816d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:30.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.153+0000 7f7f2dc00700 1 -- 172.21.15.37:0/111221266 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f280c5390 msgr2=0x7f7f2816d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.153+0000 7f7f2dc00700 1 --2- 172.21.15.37:0/111221266 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f280c5390 0x7f7f2816d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.153+0000 7f7f2dc00700 1 -- 172.21.15.37:0/111221266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f28159760 msgr2=0x7f7f2816d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.153+0000 7f7f2dc00700 1 --2- 172.21.15.37:0/111221266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f28159760 0x7f7f2816d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.153+0000 7f7f2dc00700 1 -- 172.21.15.37:0/111221266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f18009420 con 0x7f7f2815d8d0 2023-10-06T02:23:30.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.153+0000 7f7f2dc00700 1 --2- 172.21.15.37:0/111221266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2815d8d0 0x7f7f2815b770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000cc90 tx=0x7f7f20001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:30.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.153+0000 7f7f1d7fa700 1 -- 172.21.15.37:0/111221266 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2000a8b0 con 0x7f7f2815d8d0 2023-10-06T02:23:30.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.153+0000 7f7f1d7fa700 1 -- 172.21.15.37:0/111221266 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2000aa10 con 0x7f7f2815d8d0 2023-10-06T02:23:30.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.153+0000 7f7f2f663700 1 -- 172.21.15.37:0/111221266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2816aed0 con 0x7f7f2815d8d0 2023-10-06T02:23:30.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.153+0000 7f7f1d7fa700 1 -- 172.21.15.37:0/111221266 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2000add0 con 0x7f7f2815d8d0 2023-10-06T02:23:30.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.154+0000 7f7f2f663700 1 -- 172.21.15.37:0/111221266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f28141b30 con 0x7f7f2815d8d0 2023-10-06T02:23:30.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.154+0000 7f7f2f663700 1 -- 172.21.15.37:0/111221266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2816b6b0 con 0x7f7f2815d8d0 2023-10-06T02:23:30.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.155+0000 7f7f1d7fa700 1 -- 172.21.15.37:0/111221266 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f20007300 con 0x7f7f2815d8d0 2023-10-06T02:23:30.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.155+0000 7f7f1d7fa700 1 --2- 172.21.15.37:0/111221266 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7f0c066f30 0x7f7f0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:30.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.155+0000 7f7f1d7fa700 1 -- 172.21.15.37:0/111221266 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7f200849b0 con 0x7f7f2815d8d0 2023-10-06T02:23:30.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.155+0000 7f7f2d3ff700 1 --2- 172.21.15.37:0/111221266 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7f0c066f30 0x7f7f0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:30.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.156+0000 7f7f2d3ff700 1 --2- 172.21.15.37:0/111221266 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7f0c066f30 0x7f7f0c0693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7f24006fd0 tx=0x7f7f24008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:30.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.159+0000 7f7f1d7fa700 1 -- 172.21.15.37:0/111221266 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f20051b40 con 0x7f7f2815d8d0 2023-10-06T02:23:30.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.396+0000 7f7f2f663700 1 -- 172.21.15.37:0/111221266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f2806fbf0 con 0x7f7f2815d8d0 2023-10-06T02:23:30.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.396+0000 7f7f1d7fa700 1 -- 172.21.15.37:0/111221266 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f7f20055160 con 0x7f7f2815d8d0 2023-10-06T02:23:30.397 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:30.397 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/651376696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":651376696},{"type":"v1","addr":"172.21.15.191:6837","nonce":651376696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1345849362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1345849362},{"type":"v1","addr":"172.21.15.37:6834","nonce":1345849362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/434738958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":434738958},{"type":"v1","addr":"172.21.15.37:6835","nonce":434738958}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:15.298562+0000","modified":"2023-10-06T02:23:18.911651+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6835/1723334905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1723334905},{"type":"v1","addr":"172.21.15.191:6835","nonce":1723334905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:23:30.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.398+0000 7f7f2f663700 1 -- 172.21.15.37:0/111221266 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7f0c066f30 msgr2=0x7f7f0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.398+0000 7f7f2f663700 1 --2- 172.21.15.37:0/111221266 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7f0c066f30 0x7f7f0c0693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7f24006fd0 tx=0x7f7f24008040 comp rx=0 tx=0).stop 2023-10-06T02:23:30.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.398+0000 7f7f2f663700 1 -- 172.21.15.37:0/111221266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2815d8d0 msgr2=0x7f7f2815b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.398+0000 7f7f2f663700 1 --2- 172.21.15.37:0/111221266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2815d8d0 0x7f7f2815b770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000cc90 tx=0x7f7f20001a80 comp rx=0 tx=0).stop 2023-10-06T02:23:30.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.399+0000 7f7f2f663700 1 -- 172.21.15.37:0/111221266 shutdown_connections 2023-10-06T02:23:30.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.399+0000 7f7f2f663700 1 --2- 172.21.15.37:0/111221266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2815d8d0 0x7f7f2815b770 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.399+0000 7f7f2f663700 1 --2- 172.21.15.37:0/111221266 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f280c5390 0x7f7f2816d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.399+0000 7f7f2f663700 1 --2- 172.21.15.37:0/111221266 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7f0c066f30 0x7f7f0c0693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.399+0000 7f7f2f663700 1 --2- 172.21.15.37:0/111221266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f28159760 0x7f7f2816d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.399+0000 7f7f2f663700 1 -- 172.21.15.37:0/111221266 >> 172.21.15.37:0/111221266 conn(0x7f7f2806c890 msgr2=0x7f7f28154110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:30.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.399+0000 7f7f2f663700 1 -- 172.21.15.37:0/111221266 shutdown_connections 2023-10-06T02:23:30.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.399+0000 7f7f2f663700 1 -- 172.21.15.37:0/111221266 wait complete. 2023-10-06T02:23:30.400 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-10-06T02:23:30.411 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:30.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.529+0000 7f9b38f67700 1 Processor -- start 2023-10-06T02:23:30.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.529+0000 7f9b38f67700 1 -- start start 2023-10-06T02:23:30.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.530+0000 7f9b38f67700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9b341596d0 0x7f9b340b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:30.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.530+0000 7f9b38f67700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b340c5300 con 0x7f9b340b3840 2023-10-06T02:23:30.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.530+0000 7f9b38f67700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b340c6160 con 0x7f9b34159aa0 2023-10-06T02:23:30.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.530+0000 7f9b38f67700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b340c5550 con 0x7f9b341596d0 2023-10-06T02:23:30.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.530+0000 7f9b31d9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9b340b3840 0x7f9b340c65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34538/0 (socket says 172.21.15.37:34538) 2023-10-06T02:23:30.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.530+0000 7f9b3259c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9b341596d0 0x7f9b340b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:30.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.530+0000 7f9b31d9b700 1 -- 172.21.15.37:0/1717704226 learned_addr learned my addr 172.21.15.37:0/1717704226 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:30.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.531+0000 7f9b3259c700 1 -- 172.21.15.37:0/1717704226 >> v1:172.21.15.191:6789/0 conn(0x7f9b34159aa0 legacy=0x7f9b340cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.531+0000 7f9b3259c700 1 -- 172.21.15.37:0/1717704226 >> v1:172.21.15.37:6789/0 conn(0x7f9b340b3840 legacy=0x7f9b340c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.531+0000 7f9b3259c700 1 -- 172.21.15.37:0/1717704226 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b340c5830 con 0x7f9b341596d0 2023-10-06T02:23:30.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.531+0000 7f9b3259c700 1 --2- 172.21.15.37:0/1717704226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b341596d0 0x7f9b340b3300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0098e0 tx=0x7f9b2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5d77b267464607 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:30.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.531+0000 7f9b3159a700 1 -- 172.21.15.37:0/1717704226 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c009e80 con 0x7f9b341596d0 2023-10-06T02:23:30.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.531+0000 7f9b3159a700 1 -- 172.21.15.37:0/1717704226 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c00b860 con 0x7f9b341596d0 2023-10-06T02:23:30.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.531+0000 7f9b3159a700 1 -- 172.21.15.37:0/1717704226 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c00bbe0 con 0x7f9b341596d0 2023-10-06T02:23:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.531+0000 7f9b38f67700 1 -- 172.21.15.37:0/1717704226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b341596d0 msgr2=0x7f9b340b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.531+0000 7f9b38f67700 1 --2- 172.21.15.37:0/1717704226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b341596d0 0x7f9b340b3300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0098e0 tx=0x7f9b2c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.532+0000 7f9b38f67700 1 -- 172.21.15.37:0/1717704226 shutdown_connections 2023-10-06T02:23:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.532+0000 7f9b38f67700 1 --2- 172.21.15.37:0/1717704226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b341596d0 0x7f9b340b3300 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.532+0000 7f9b38f67700 1 -- 172.21.15.37:0/1717704226 >> 172.21.15.37:0/1717704226 conn(0x7f9b3406c890 msgr2=0x7f9b340d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.532+0000 7f9b38f67700 1 -- 172.21.15.37:0/1717704226 shutdown_connections 2023-10-06T02:23:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.532+0000 7f9b38f67700 1 -- 172.21.15.37:0/1717704226 wait complete. 2023-10-06T02:23:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.533+0000 7f9b38f67700 1 Processor -- start 2023-10-06T02:23:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.533+0000 7f9b38f67700 1 -- start start 2023-10-06T02:23:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.533+0000 7f9b38f67700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b340b3840 0x7f9b3414c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.533+0000 7f9b38f67700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b341596d0 0x7f9b3415a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.533+0000 7f9b38f67700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b34159aa0 0x7f9b3415c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.533+0000 7f9b38f67700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b341507c0 con 0x7f9b34159aa0 2023-10-06T02:23:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.533+0000 7f9b38f67700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3415b9b0 con 0x7f9b340b3840 2023-10-06T02:23:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.533+0000 7f9b38f67700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b34150a80 con 0x7f9b341596d0 2023-10-06T02:23:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.533+0000 7f9b32d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b34159aa0 0x7f9b3415c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.534+0000 7f9b32d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b34159aa0 0x7f9b3415c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42344/0 (socket says 172.21.15.37:42344) 2023-10-06T02:23:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.534+0000 7f9b32d9d700 1 -- 172.21.15.37:0/1312734263 learned_addr learned my addr 172.21.15.37:0/1312734263 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.534+0000 7f9b3259c700 1 --2- 172.21.15.37:0/1312734263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b340b3840 0x7f9b3414c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.534+0000 7f9b31d9b700 1 --2- 172.21.15.37:0/1312734263 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b341596d0 0x7f9b3415a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.534+0000 7f9b32d9d700 1 -- 172.21.15.37:0/1312734263 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b341596d0 msgr2=0x7f9b3415a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.534+0000 7f9b32d9d700 1 --2- 172.21.15.37:0/1312734263 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b341596d0 0x7f9b3415a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.534+0000 7f9b32d9d700 1 -- 172.21.15.37:0/1312734263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b340b3840 msgr2=0x7f9b3414c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.534+0000 7f9b32d9d700 1 --2- 172.21.15.37:0/1312734263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b340b3840 0x7f9b3414c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.534+0000 7f9b32d9d700 1 -- 172.21.15.37:0/1312734263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c009420 con 0x7f9b34159aa0 2023-10-06T02:23:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.534+0000 7f9b32d9d700 1 --2- 172.21.15.37:0/1312734263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b34159aa0 0x7f9b3415c510 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400c870 tx=0x7f9b24001610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.534+0000 7f9b2a7fc700 1 -- 172.21.15.37:0/1312734263 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b24012630 con 0x7f9b34159aa0 2023-10-06T02:23:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.534+0000 7f9b2a7fc700 1 -- 172.21.15.37:0/1312734263 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b240127b0 con 0x7f9b34159aa0 2023-10-06T02:23:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.534+0000 7f9b38f67700 1 -- 172.21.15.37:0/1312734263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3415b110 con 0x7f9b34159aa0 2023-10-06T02:23:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.534+0000 7f9b2a7fc700 1 -- 172.21.15.37:0/1312734263 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b24012b70 con 0x7f9b34159aa0 2023-10-06T02:23:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.534+0000 7f9b38f67700 1 -- 172.21.15.37:0/1312734263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3415b6d0 con 0x7f9b34159aa0 2023-10-06T02:23:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.535+0000 7f9b38f67700 1 -- 172.21.15.37:0/1312734263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3406fbf0 con 0x7f9b34159aa0 2023-10-06T02:23:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.535+0000 7f9b2a7fc700 1 -- 172.21.15.37:0/1312734263 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b24003030 con 0x7f9b34159aa0 2023-10-06T02:23:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.536+0000 7f9b2a7fc700 1 --2- 172.21.15.37:0/1312734263 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9b14066f30 0x7f9b140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.536+0000 7f9b2a7fc700 1 -- 172.21.15.37:0/1312734263 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9b24084490 con 0x7f9b34159aa0 2023-10-06T02:23:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.536+0000 7f9b3259c700 1 --2- 172.21.15.37:0/1312734263 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9b14066f30 0x7f9b140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.536+0000 7f9b3259c700 1 --2- 172.21.15.37:0/1312734263 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9b14066f30 0x7f9b140693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0093f0 tx=0x7f9b2c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.540+0000 7f9b2a7fc700 1 -- 172.21.15.37:0/1312734263 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b240515a0 con 0x7f9b34159aa0 2023-10-06T02:23:30.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.737+0000 7f9b38f67700 1 -- 172.21.15.37:0/1312734263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b340c73d0 con 0x7f9b34159aa0 2023-10-06T02:23:30.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.738+0000 7f9b2a7fc700 1 -- 172.21.15.37:0/1312734263 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f9b24054bc0 con 0x7f9b34159aa0 2023-10-06T02:23:30.738 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:30.739 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:23:16.897625+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:13.004596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:14.268809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:30.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.740+0000 7f9b38f67700 1 -- 172.21.15.37:0/1312734263 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9b14066f30 msgr2=0x7f9b140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.740+0000 7f9b38f67700 1 --2- 172.21.15.37:0/1312734263 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9b14066f30 0x7f9b140693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0093f0 tx=0x7f9b2c017000 comp rx=0 tx=0).stop 2023-10-06T02:23:30.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.740+0000 7f9b38f67700 1 -- 172.21.15.37:0/1312734263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b34159aa0 msgr2=0x7f9b3415c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.740+0000 7f9b38f67700 1 --2- 172.21.15.37:0/1312734263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b34159aa0 0x7f9b3415c510 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400c870 tx=0x7f9b24001610 comp rx=0 tx=0).stop 2023-10-06T02:23:30.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.740+0000 7f9b38f67700 1 -- 172.21.15.37:0/1312734263 shutdown_connections 2023-10-06T02:23:30.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.740+0000 7f9b38f67700 1 --2- 172.21.15.37:0/1312734263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b34159aa0 0x7f9b3415c510 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.740+0000 7f9b38f67700 1 --2- 172.21.15.37:0/1312734263 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9b14066f30 0x7f9b140693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.740+0000 7f9b38f67700 1 --2- 172.21.15.37:0/1312734263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b340b3840 0x7f9b3414c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.740+0000 7f9b38f67700 1 --2- 172.21.15.37:0/1312734263 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b341596d0 0x7f9b3415a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.740+0000 7f9b38f67700 1 -- 172.21.15.37:0/1312734263 >> 172.21.15.37:0/1312734263 conn(0x7f9b3406c890 msgr2=0x7f9b340cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:30.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.740+0000 7f9b38f67700 1 -- 172.21.15.37:0/1312734263 shutdown_connections 2023-10-06T02:23:30.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.740+0000 7f9b38f67700 1 -- 172.21.15.37:0/1312734263 wait complete. 2023-10-06T02:23:30.752 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:23:08.066048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:23:08.561964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:23:13.004596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:23:14.268809+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:23:30.753 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:23:30.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.875+0000 7fb244bbd700 1 Processor -- start 2023-10-06T02:23:30.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.875+0000 7fb244bbd700 1 -- start start 2023-10-06T02:23:30.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.876+0000 7fb244bbd700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb2400c8ed0 0x7fb2400cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.876+0000 7fb244bbd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2401575d0 0x7fb2400b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.876+0000 7fb244bbd700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2401587b0 con 0x7fb240157200 2023-10-06T02:23:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.876+0000 7fb244bbd700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb240157ba0 con 0x7fb2400c8ed0 2023-10-06T02:23:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.876+0000 7fb244bbd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb240157e80 con 0x7fb2401575d0 2023-10-06T02:23:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.876+0000 7fb23f7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb240157200 0x7fb2400c87c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34554/0 (socket says 172.21.15.37:34554) 2023-10-06T02:23:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.876+0000 7fb23f7fe700 1 -- 172.21.15.37:0/3777773341 learned_addr learned my addr 172.21.15.37:0/3777773341 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.876+0000 7fb23ffff700 1 --2- 172.21.15.37:0/3777773341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2401575d0 0x7fb2400b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.876+0000 7fb23effd700 1 --2- 172.21.15.37:0/3777773341 >> v2:172.21.15.191:3300/0 conn(0x7fb2400c8ed0 0x7fb2400cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.876+0000 7fb23e7fc700 1 -- 172.21.15.37:0/3777773341 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3742871034 0 0) 0x7fb2401587b0 con 0x7fb240157200 2023-10-06T02:23:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.876+0000 7fb23e7fc700 1 -- 172.21.15.37:0/3777773341 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb228003570 con 0x7fb240157200 2023-10-06T02:23:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23e7fc700 1 -- 172.21.15.37:0/3777773341 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1628940000 0 0) 0x7fb228003570 con 0x7fb240157200 2023-10-06T02:23:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23e7fc700 1 -- 172.21.15.37:0/3777773341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2401575d0 msgr2=0x7fb2400b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23e7fc700 1 --2- 172.21.15.37:0/3777773341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2401575d0 0x7fb2400b00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23e7fc700 1 -- 172.21.15.37:0/3777773341 >> v2:172.21.15.191:3300/0 conn(0x7fb2400c8ed0 msgr2=0x7fb2400cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23e7fc700 1 --2- 172.21.15.37:0/3777773341 >> v2:172.21.15.191:3300/0 conn(0x7fb2400c8ed0 0x7fb2400cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23e7fc700 1 -- 172.21.15.37:0/3777773341 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb240158160 con 0x7fb240157200 2023-10-06T02:23:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23e7fc700 1 -- 172.21.15.37:0/3777773341 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7fb230001470 con 0x7fb240157200 2023-10-06T02:23:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23e7fc700 1 -- 172.21.15.37:0/3777773341 >> v1:172.21.15.37:6789/0 conn(0x7fb240157200 legacy=0x7fb2400c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23e7fc700 1 --2- 172.21.15.37:0/3777773341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2401575d0 0x7fb228003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23e7fc700 1 --2- 172.21.15.37:0/3777773341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb228003fe0 0x7fb228004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23e7fc700 1 --2- 172.21.15.37:0/3777773341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb228004d50 0x7fb2280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23e7fc700 1 -- 172.21.15.37:0/3777773341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb240157ba0 con 0x7fb228003fe0 2023-10-06T02:23:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23e7fc700 1 -- 172.21.15.37:0/3777773341 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb240157e80 con 0x7fb228004d50 2023-10-06T02:23:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23e7fc700 1 -- 172.21.15.37:0/3777773341 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22800ba90 con 0x7fb2401575d0 2023-10-06T02:23:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23effd700 1 --2- 172.21.15.37:0/3777773341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb228003fe0 0x7fb228004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23f7fe700 1 --2- 172.21.15.37:0/3777773341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2401575d0 0x7fb228003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23ffff700 1 --2- 172.21.15.37:0/3777773341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb228004d50 0x7fb2280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23effd700 1 -- 172.21.15.37:0/3777773341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2401575d0 msgr2=0x7fb228003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23effd700 1 --2- 172.21.15.37:0/3777773341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2401575d0 0x7fb228003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23effd700 1 -- 172.21.15.37:0/3777773341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb228004d50 msgr2=0x7fb2280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23effd700 1 --2- 172.21.15.37:0/3777773341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb228004d50 0x7fb2280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23effd700 1 -- 172.21.15.37:0/3777773341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb228003570 con 0x7fb228003fe0 2023-10-06T02:23:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23effd700 1 --2- 172.21.15.37:0/3777773341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb228003fe0 0x7fb228004810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb24015c0c0 tx=0x7fb2340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f34a1d9f40abf45 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23e7fc700 1 -- 172.21.15.37:0/3777773341 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23400e680 con 0x7fb228003fe0 2023-10-06T02:23:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23e7fc700 1 -- 172.21.15.37:0/3777773341 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23400e7e0 con 0x7fb228003fe0 2023-10-06T02:23:30.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.877+0000 7fb23e7fc700 1 -- 172.21.15.37:0/3777773341 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23400eba0 con 0x7fb228003fe0 2023-10-06T02:23:30.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.878+0000 7fb244bbd700 1 -- 172.21.15.37:0/3777773341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb228003fe0 msgr2=0x7fb228004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.878+0000 7fb244bbd700 1 --2- 172.21.15.37:0/3777773341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb228003fe0 0x7fb228004810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb24015c0c0 tx=0x7fb2340091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.878+0000 7fb23ffff700 1 -- 172.21.15.37:0/3777773341 reap_dead start 2023-10-06T02:23:30.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.878+0000 7fb244bbd700 1 -- 172.21.15.37:0/3777773341 shutdown_connections 2023-10-06T02:23:30.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.878+0000 7fb244bbd700 1 -- 172.21.15.37:0/3777773341 >> 172.21.15.37:0/3777773341 conn(0x7fb24006c0b0 msgr2=0x7fb24006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:30.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.878+0000 7fb244bbd700 1 -- 172.21.15.37:0/3777773341 shutdown_connections 2023-10-06T02:23:30.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.878+0000 7fb244bbd700 1 -- 172.21.15.37:0/3777773341 wait complete. 2023-10-06T02:23:30.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.879+0000 7fb244bbd700 1 Processor -- start 2023-10-06T02:23:30.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.879+0000 7fb244bbd700 1 -- start start 2023-10-06T02:23:30.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.880+0000 7fb244bbd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb228003fe0 0x7fb2400c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.880+0000 7fb244bbd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2400c85d0 0x7fb240154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.880+0000 7fb244bbd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2400c7430 0x7fb2400c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.880+0000 7fb244bbd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb240156a50 con 0x7fb228003fe0 2023-10-06T02:23:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.880+0000 7fb244bbd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2400c6fa0 con 0x7fb2400c7430 2023-10-06T02:23:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.880+0000 7fb244bbd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2400c6390 con 0x7fb2400c85d0 2023-10-06T02:23:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.880+0000 7fb23f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb228003fe0 0x7fb2400c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.880+0000 7fb23f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb228003fe0 0x7fb2400c5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42364/0 (socket says 172.21.15.37:42364) 2023-10-06T02:23:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.880+0000 7fb23f7fe700 1 -- 172.21.15.37:0/573362646 learned_addr learned my addr 172.21.15.37:0/573362646 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.880+0000 7fb23effd700 1 --2- 172.21.15.37:0/573362646 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2400c85d0 0x7fb240154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.880+0000 7fb23ffff700 1 --2- 172.21.15.37:0/573362646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2400c7430 0x7fb2400c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.881+0000 7fb23f7fe700 1 -- 172.21.15.37:0/573362646 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2400c85d0 msgr2=0x7fb240154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.881+0000 7fb23f7fe700 1 --2- 172.21.15.37:0/573362646 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2400c85d0 0x7fb240154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.881+0000 7fb23f7fe700 1 -- 172.21.15.37:0/573362646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2400c7430 msgr2=0x7fb2400c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.881+0000 7fb23f7fe700 1 --2- 172.21.15.37:0/573362646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2400c7430 0x7fb2400c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.881+0000 7fb23f7fe700 1 -- 172.21.15.37:0/573362646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2400c6670 con 0x7fb228003fe0 2023-10-06T02:23:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.881+0000 7fb23f7fe700 1 --2- 172.21.15.37:0/573362646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb228003fe0 0x7fb2400c5d00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb230007390 tx=0x7fb230001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.881+0000 7fb2277fe700 1 -- 172.21.15.37:0/573362646 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb230018030 con 0x7fb228003fe0 2023-10-06T02:23:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.881+0000 7fb2277fe700 1 -- 172.21.15.37:0/573362646 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23000f8c0 con 0x7fb228003fe0 2023-10-06T02:23:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.881+0000 7fb2277fe700 1 -- 172.21.15.37:0/573362646 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23000fc80 con 0x7fb228003fe0 2023-10-06T02:23:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.881+0000 7fb244bbd700 1 -- 172.21.15.37:0/573362646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2400c6950 con 0x7fb228003fe0 2023-10-06T02:23:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.881+0000 7fb244bbd700 1 -- 172.21.15.37:0/573362646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2401501b0 con 0x7fb228003fe0 2023-10-06T02:23:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.882+0000 7fb244bbd700 1 -- 172.21.15.37:0/573362646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb240064160 con 0x7fb228003fe0 2023-10-06T02:23:30.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.882+0000 7fb2277fe700 1 -- 172.21.15.37:0/573362646 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb23001b070 con 0x7fb228003fe0 2023-10-06T02:23:30.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.883+0000 7fb2277fe700 1 --2- 172.21.15.37:0/573362646 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb22c066f30 0x7fb22c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:30.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.883+0000 7fb2277fe700 1 -- 172.21.15.37:0/573362646 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb230019070 con 0x7fb228003fe0 2023-10-06T02:23:30.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.883+0000 7fb23effd700 1 --2- 172.21.15.37:0/573362646 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb22c066f30 0x7fb22c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:30.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.883+0000 7fb23effd700 1 --2- 172.21.15.37:0/573362646 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb22c066f30 0x7fb22c0693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb2340091e0 tx=0x7fb23401a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:30.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:30.887+0000 7fb2277fe700 1 -- 172.21.15.37:0/573362646 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2300516e0 con 0x7fb228003fe0 2023-10-06T02:23:31.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.082+0000 7fb244bbd700 1 -- 172.21.15.37:0/573362646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb240064b00 con 0x7fb228003fe0 2023-10-06T02:23:31.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.082+0000 7fb2277fe700 1 -- 172.21.15.37:0/573362646 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb230054d00 con 0x7fb228003fe0 2023-10-06T02:23:31.083 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T02:23:31.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.084+0000 7fb244bbd700 1 -- 172.21.15.37:0/573362646 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb22c066f30 msgr2=0x7fb22c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.084+0000 7fb244bbd700 1 --2- 172.21.15.37:0/573362646 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb22c066f30 0x7fb22c0693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb2340091e0 tx=0x7fb23401a000 comp rx=0 tx=0).stop 2023-10-06T02:23:31.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.084+0000 7fb244bbd700 1 -- 172.21.15.37:0/573362646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb228003fe0 msgr2=0x7fb2400c5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.084+0000 7fb244bbd700 1 --2- 172.21.15.37:0/573362646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb228003fe0 0x7fb2400c5d00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb230007390 tx=0x7fb230001e90 comp rx=0 tx=0).stop 2023-10-06T02:23:31.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.084+0000 7fb244bbd700 1 -- 172.21.15.37:0/573362646 shutdown_connections 2023-10-06T02:23:31.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.084+0000 7fb244bbd700 1 --2- 172.21.15.37:0/573362646 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb22c066f30 0x7fb22c0693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.084+0000 7fb244bbd700 1 --2- 172.21.15.37:0/573362646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2400c7430 0x7fb2400c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.084+0000 7fb244bbd700 1 --2- 172.21.15.37:0/573362646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb228003fe0 0x7fb2400c5d00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.084+0000 7fb244bbd700 1 --2- 172.21.15.37:0/573362646 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2400c85d0 0x7fb240154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.084+0000 7fb244bbd700 1 -- 172.21.15.37:0/573362646 >> 172.21.15.37:0/573362646 conn(0x7fb24006c0b0 msgr2=0x7fb240150bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:31.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.084+0000 7fb244bbd700 1 -- 172.21.15.37:0/573362646 shutdown_connections 2023-10-06T02:23:31.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.084+0000 7fb244bbd700 1 -- 172.21.15.37:0/573362646 wait complete. 2023-10-06T02:23:31.096 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:23:31.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.218+0000 7f8bd7554700 1 Processor -- start 2023-10-06T02:23:31.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.218+0000 7f8bd7554700 1 -- start start 2023-10-06T02:23:31.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.219+0000 7f8bd7554700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8bd00cb170 0x7f8bd00cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.219+0000 7f8bd7554700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8bd00ccdd0 0x7f8bd0163250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.219+0000 7f8bd7554700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd00b2da0 con 0x7f8bd00b29d0 2023-10-06T02:23:31.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.219+0000 7f8bd7554700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd0099bd0 con 0x7f8bd00ccdd0 2023-10-06T02:23:31.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.219+0000 7f8bd7554700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd0159a70 con 0x7f8bd00cb170 2023-10-06T02:23:31.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.219+0000 7f8bd6d53700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8bd00ccdd0 0x7f8bd0163250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.219+0000 7f8bd6d53700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8bd00ccdd0 0x7f8bd0163250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42370/0 (socket says 172.21.15.37:42370) 2023-10-06T02:23:31.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.219+0000 7f8bd6d53700 1 -- 172.21.15.37:0/714937759 learned_addr learned my addr 172.21.15.37:0/714937759 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:31.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.219+0000 7f8bd5d51700 1 --2- 172.21.15.37:0/714937759 >> v2:172.21.15.191:3300/0 conn(0x7f8bd00cb170 0x7f8bd00cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.219+0000 7f8bd6d53700 1 -- 172.21.15.37:0/714937759 >> v2:172.21.15.191:3300/0 conn(0x7f8bd00cb170 msgr2=0x7f8bd00cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:31.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.219+0000 7f8bd6d53700 1 --2- 172.21.15.37:0/714937759 >> v2:172.21.15.191:3300/0 conn(0x7f8bd00cb170 0x7f8bd00cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.219+0000 7f8bd6d53700 1 -- 172.21.15.37:0/714937759 >> v1:172.21.15.191:6789/0 conn(0x7f8bd00b29d0 legacy=0x7f8bd00ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.219+0000 7f8bd6d53700 1 -- 172.21.15.37:0/714937759 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd00cb5e0 con 0x7f8bd00ccdd0 2023-10-06T02:23:31.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.219+0000 7f8bd6d53700 1 --2- 172.21.15.37:0/714937759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd00ccdd0 0x7f8bd0163250 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8bd008ab30 tx=0x7f8bc0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb9978c903669af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:31.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.220+0000 7f8bd5550700 1 -- 172.21.15.37:0/714937759 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc000e070 con 0x7f8bd00ccdd0 2023-10-06T02:23:31.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.220+0000 7f8bd5550700 1 -- 172.21.15.37:0/714937759 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc000ba50 con 0x7f8bd00ccdd0 2023-10-06T02:23:31.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.220+0000 7f8bd5550700 1 -- 172.21.15.37:0/714937759 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc00092e0 con 0x7f8bd00ccdd0 2023-10-06T02:23:31.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.220+0000 7f8bd7554700 1 -- 172.21.15.37:0/714937759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd00ccdd0 msgr2=0x7f8bd0163250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.220+0000 7f8bd7554700 1 --2- 172.21.15.37:0/714937759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd00ccdd0 0x7f8bd0163250 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8bd008ab30 tx=0x7f8bc0009840 comp rx=0 tx=0).stop 2023-10-06T02:23:31.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.220+0000 7f8bd7554700 1 -- 172.21.15.37:0/714937759 shutdown_connections 2023-10-06T02:23:31.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.220+0000 7f8bd7554700 1 --2- 172.21.15.37:0/714937759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd00ccdd0 0x7f8bd0163250 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.220+0000 7f8bd7554700 1 --2- 172.21.15.37:0/714937759 >> v2:172.21.15.191:3300/0 conn(0x7f8bd00cb170 0x7f8bd00cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.220+0000 7f8bd7554700 1 -- 172.21.15.37:0/714937759 >> 172.21.15.37:0/714937759 conn(0x7f8bd0099610 msgr2=0x7f8bd006c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:31.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.220+0000 7f8bd7554700 1 -- 172.21.15.37:0/714937759 shutdown_connections 2023-10-06T02:23:31.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.220+0000 7f8bd7554700 1 -- 172.21.15.37:0/714937759 wait complete. 2023-10-06T02:23:31.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.221+0000 7f8bd7554700 1 Processor -- start 2023-10-06T02:23:31.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.221+0000 7f8bd7554700 1 -- start start 2023-10-06T02:23:31.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.222+0000 7f8bd7554700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd00b29d0 0x7f8bd0157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.222+0000 7f8bd7554700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bd00cb170 0x7f8bd016a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.222+0000 7f8bd7554700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8bd00ccdd0 0x7f8bd015e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.222+0000 7f8bd7554700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd0157750 con 0x7f8bd00b29d0 2023-10-06T02:23:31.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.222+0000 7f8bd7554700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd016a4c0 con 0x7f8bd00cb170 2023-10-06T02:23:31.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.222+0000 7f8bd7554700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd0169ee0 con 0x7f8bd00ccdd0 2023-10-06T02:23:31.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.222+0000 7f8bd6552700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd00b29d0 0x7f8bd0157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.222+0000 7f8bd6552700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd00b29d0 0x7f8bd0157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42374/0 (socket says 172.21.15.37:42374) 2023-10-06T02:23:31.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.222+0000 7f8bd6552700 1 -- 172.21.15.37:0/2587627785 learned_addr learned my addr 172.21.15.37:0/2587627785 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:31.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.222+0000 7f8bd5d51700 1 --2- 172.21.15.37:0/2587627785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bd00cb170 0x7f8bd016a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.222+0000 7f8bd6d53700 1 --2- 172.21.15.37:0/2587627785 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8bd00ccdd0 0x7f8bd015e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.222+0000 7f8bd6552700 1 -- 172.21.15.37:0/2587627785 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8bd00ccdd0 msgr2=0x7f8bd015e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.222+0000 7f8bd6552700 1 --2- 172.21.15.37:0/2587627785 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8bd00ccdd0 0x7f8bd015e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.222+0000 7f8bd6552700 1 -- 172.21.15.37:0/2587627785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bd00cb170 msgr2=0x7f8bd016a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.222+0000 7f8bd6552700 1 --2- 172.21.15.37:0/2587627785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bd00cb170 0x7f8bd016a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.222+0000 7f8bd6552700 1 -- 172.21.15.37:0/2587627785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc0009ae0 con 0x7f8bd00b29d0 2023-10-06T02:23:31.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.222+0000 7f8bd5d51700 1 --2- 172.21.15.37:0/2587627785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bd00cb170 0x7f8bd016a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:31.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.222+0000 7f8bd6d53700 1 --2- 172.21.15.37:0/2587627785 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8bd00ccdd0 0x7f8bd015e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:31.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.223+0000 7f8bd6552700 1 --2- 172.21.15.37:0/2587627785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd00b29d0 0x7f8bd0157210 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8bc800c510 tx=0x7f8bc800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:31.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.223+0000 7f8bce7fc700 1 -- 172.21.15.37:0/2587627785 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8011590 con 0x7f8bd00b29d0 2023-10-06T02:23:31.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.223+0000 7f8bce7fc700 1 -- 172.21.15.37:0/2587627785 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc8011710 con 0x7f8bd00b29d0 2023-10-06T02:23:31.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.223+0000 7f8bd7554700 1 -- 172.21.15.37:0/2587627785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd015ebe0 con 0x7f8bd00b29d0 2023-10-06T02:23:31.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.223+0000 7f8bce7fc700 1 -- 172.21.15.37:0/2587627785 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8011ad0 con 0x7f8bd00b29d0 2023-10-06T02:23:31.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.223+0000 7f8bd7554700 1 -- 172.21.15.37:0/2587627785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd016a150 con 0x7f8bd00b29d0 2023-10-06T02:23:31.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.224+0000 7f8bd7554700 1 -- 172.21.15.37:0/2587627785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd00884f0 con 0x7f8bd00b29d0 2023-10-06T02:23:31.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.224+0000 7f8bce7fc700 1 -- 172.21.15.37:0/2587627785 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8bc801b3b0 con 0x7f8bd00b29d0 2023-10-06T02:23:31.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.224+0000 7f8bce7fc700 1 --2- 172.21.15.37:0/2587627785 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8bbc066f30 0x7f8bbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.224+0000 7f8bce7fc700 1 -- 172.21.15.37:0/2587627785 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8bc8083a10 con 0x7f8bd00b29d0 2023-10-06T02:23:31.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.225+0000 7f8bd5d51700 1 --2- 172.21.15.37:0/2587627785 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8bbc066f30 0x7f8bbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.225+0000 7f8bd5d51700 1 --2- 172.21.15.37:0/2587627785 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8bbc066f30 0x7f8bbc0693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0070df0 tx=0x7f8bc4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:31.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.229+0000 7f8bce7fc700 1 -- 172.21.15.37:0/2587627785 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8bc8050a80 con 0x7f8bd00b29d0 2023-10-06T02:23:31.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.422+0000 7f8bd7554700 1 -- 172.21.15.37:0/2587627785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8bd00b2da0 con 0x7f8bd00b29d0 2023-10-06T02:23:31.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.422+0000 7f8bce7fc700 1 -- 172.21.15.37:0/2587627785 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8bd00b2da0 con 0x7f8bd00b29d0 2023-10-06T02:23:31.423 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T02:23:31.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.424+0000 7f8bd7554700 1 -- 172.21.15.37:0/2587627785 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8bbc066f30 msgr2=0x7f8bbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.424+0000 7f8bd7554700 1 --2- 172.21.15.37:0/2587627785 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8bbc066f30 0x7f8bbc0693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0070df0 tx=0x7f8bc4008040 comp rx=0 tx=0).stop 2023-10-06T02:23:31.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.424+0000 7f8bd7554700 1 -- 172.21.15.37:0/2587627785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd00b29d0 msgr2=0x7f8bd0157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.424+0000 7f8bd7554700 1 --2- 172.21.15.37:0/2587627785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd00b29d0 0x7f8bd0157210 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8bc800c510 tx=0x7f8bc800c8d0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.424+0000 7f8bd7554700 1 -- 172.21.15.37:0/2587627785 shutdown_connections 2023-10-06T02:23:31.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.424+0000 7f8bd7554700 1 --2- 172.21.15.37:0/2587627785 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8bd00ccdd0 0x7f8bd015e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.424+0000 7f8bd7554700 1 --2- 172.21.15.37:0/2587627785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd00b29d0 0x7f8bd0157210 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.424+0000 7f8bd7554700 1 --2- 172.21.15.37:0/2587627785 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8bbc066f30 0x7f8bbc0693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.424+0000 7f8bd7554700 1 --2- 172.21.15.37:0/2587627785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bd00cb170 0x7f8bd016a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.424+0000 7f8bd7554700 1 -- 172.21.15.37:0/2587627785 >> 172.21.15.37:0/2587627785 conn(0x7f8bd0099610 msgr2=0x7f8bd006d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:31.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.424+0000 7f8bd7554700 1 -- 172.21.15.37:0/2587627785 shutdown_connections 2023-10-06T02:23:31.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.424+0000 7f8bd7554700 1 -- 172.21.15.37:0/2587627785 wait complete. 2023-10-06T02:23:31.437 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:23:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.559+0000 7fdac3a55700 1 Processor -- start 2023-10-06T02:23:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.559+0000 7fdac3a55700 1 -- start start 2023-10-06T02:23:31.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.560+0000 7fdac3a55700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdabc1593c0 0x7fdabc159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.560+0000 7fdac3a55700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdabc0ccb30 0x7fdabc0ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.560+0000 7fdac3a55700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdabc0b07a0 con 0x7fdabc0b2380 2023-10-06T02:23:31.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.560+0000 7fdac3a55700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdabc0cd8a0 con 0x7fdabc1593c0 2023-10-06T02:23:31.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.560+0000 7fdac3a55700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc0afe70 con 0x7fdabc0ccb30 2023-10-06T02:23:31.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.560+0000 7fdac17f1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdabc1593c0 0x7fdabc159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.560+0000 7fdac0ff0700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdabc0b2380 0x7fdabc0b2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34558/0 (socket says 172.21.15.37:34558) 2023-10-06T02:23:31.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.560+0000 7fdac0ff0700 1 -- 172.21.15.37:0/3847598870 learned_addr learned my addr 172.21.15.37:0/3847598870 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:31.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.560+0000 7fdac1ff2700 1 --2- 172.21.15.37:0/3847598870 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdabc0ccb30 0x7fdabc0ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.560+0000 7fdac17f1700 1 -- 172.21.15.37:0/3847598870 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdabc0ccb30 msgr2=0x7fdabc0ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:31.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.560+0000 7fdac17f1700 1 --2- 172.21.15.37:0/3847598870 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdabc0ccb30 0x7fdabc0ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.560+0000 7fdac17f1700 1 -- 172.21.15.37:0/3847598870 >> v1:172.21.15.37:6789/0 conn(0x7fdabc0b2380 legacy=0x7fdabc0b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.560+0000 7fdac17f1700 1 -- 172.21.15.37:0/3847598870 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc0b0150 con 0x7fdabc1593c0 2023-10-06T02:23:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.560+0000 7fdabbfff700 1 -- 172.21.15.37:0/3847598870 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284767065 0 0) 0x7fdabc0b07a0 con 0x7fdabc0b2380 2023-10-06T02:23:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.560+0000 7fdac17f1700 1 --2- 172.21.15.37:0/3847598870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc1593c0 0x7fdabc159790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0098e0 tx=0x7fdaac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1254dad2ba61de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.560+0000 7fdabbfff700 1 -- 172.21.15.37:0/3847598870 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac00b640 con 0x7fdabc1593c0 2023-10-06T02:23:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.561+0000 7fdabbfff700 1 -- 172.21.15.37:0/3847598870 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaac00b7a0 con 0x7fdabc1593c0 2023-10-06T02:23:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.561+0000 7fdabbfff700 1 -- 172.21.15.37:0/3847598870 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac00bb40 con 0x7fdabc1593c0 2023-10-06T02:23:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.561+0000 7fdac3a55700 1 -- 172.21.15.37:0/3847598870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc1593c0 msgr2=0x7fdabc159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.561+0000 7fdac3a55700 1 --2- 172.21.15.37:0/3847598870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc1593c0 0x7fdabc159790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0098e0 tx=0x7fdaac0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.561+0000 7fdac3a55700 1 -- 172.21.15.37:0/3847598870 shutdown_connections 2023-10-06T02:23:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.561+0000 7fdac3a55700 1 --2- 172.21.15.37:0/3847598870 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdabc0ccb30 0x7fdabc0ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.561+0000 7fdac3a55700 1 --2- 172.21.15.37:0/3847598870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc1593c0 0x7fdabc159790 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.561+0000 7fdac3a55700 1 -- 172.21.15.37:0/3847598870 >> 172.21.15.37:0/3847598870 conn(0x7fdabc06c0b0 msgr2=0x7fdabc06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:31.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.561+0000 7fdac3a55700 1 -- 172.21.15.37:0/3847598870 shutdown_connections 2023-10-06T02:23:31.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.561+0000 7fdac3a55700 1 -- 172.21.15.37:0/3847598870 wait complete. 2023-10-06T02:23:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.562+0000 7fdac3a55700 1 Processor -- start 2023-10-06T02:23:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.562+0000 7fdac3a55700 1 -- start start 2023-10-06T02:23:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.563+0000 7fdac3a55700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdabc0b2380 0x7fdabc0c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.563+0000 7fdac3a55700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc0ccb30 0x7fdabc157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.563+0000 7fdac3a55700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdabc1593c0 0x7fdabc0b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.563+0000 7fdac3a55700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc15bc00 con 0x7fdabc0ccb30 2023-10-06T02:23:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.563+0000 7fdac3a55700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc15ad10 con 0x7fdabc0b2380 2023-10-06T02:23:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.563+0000 7fdac3a55700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc15aff0 con 0x7fdabc1593c0 2023-10-06T02:23:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.563+0000 7fdac0ff0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc0ccb30 0x7fdabc157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.563+0000 7fdac0ff0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc0ccb30 0x7fdabc157be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42384/0 (socket says 172.21.15.37:42384) 2023-10-06T02:23:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.563+0000 7fdac0ff0700 1 -- 172.21.15.37:0/569343571 learned_addr learned my addr 172.21.15.37:0/569343571 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.563+0000 7fdac17f1700 1 --2- 172.21.15.37:0/569343571 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdabc0b2380 0x7fdabc0c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.563+0000 7fdac1ff2700 1 --2- 172.21.15.37:0/569343571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdabc1593c0 0x7fdabc0b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.563+0000 7fdac0ff0700 1 -- 172.21.15.37:0/569343571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdabc1593c0 msgr2=0x7fdabc0b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.563+0000 7fdac0ff0700 1 --2- 172.21.15.37:0/569343571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdabc1593c0 0x7fdabc0b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.563+0000 7fdac0ff0700 1 -- 172.21.15.37:0/569343571 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdabc0b2380 msgr2=0x7fdabc0c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.563+0000 7fdac0ff0700 1 --2- 172.21.15.37:0/569343571 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdabc0b2380 0x7fdabc0c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.563+0000 7fdac0ff0700 1 -- 172.21.15.37:0/569343571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac009420 con 0x7fdabc0ccb30 2023-10-06T02:23:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.563+0000 7fdac17f1700 1 --2- 172.21.15.37:0/569343571 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdabc0b2380 0x7fdabc0c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.563+0000 7fdac1ff2700 1 --2- 172.21.15.37:0/569343571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdabc1593c0 0x7fdabc0b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.564+0000 7fdac0ff0700 1 --2- 172.21.15.37:0/569343571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc0ccb30 0x7fdabc157be0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdab000c7e0 tx=0x7fdab0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.564+0000 7fdab97fa700 1 -- 172.21.15.37:0/569343571 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab0005b30 con 0x7fdabc0ccb30 2023-10-06T02:23:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.564+0000 7fdab97fa700 1 -- 172.21.15.37:0/569343571 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab0005c90 con 0x7fdabc0ccb30 2023-10-06T02:23:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.564+0000 7fdac3a55700 1 -- 172.21.15.37:0/569343571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdabc15b2d0 con 0x7fdabc0ccb30 2023-10-06T02:23:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.564+0000 7fdab97fa700 1 -- 172.21.15.37:0/569343571 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab0007300 con 0x7fdabc0ccb30 2023-10-06T02:23:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.564+0000 7fdac3a55700 1 -- 172.21.15.37:0/569343571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdabc15b890 con 0x7fdabc0ccb30 2023-10-06T02:23:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.565+0000 7fdac3a55700 1 -- 172.21.15.37:0/569343571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdabc088bb0 con 0x7fdabc0ccb30 2023-10-06T02:23:31.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.565+0000 7fdab97fa700 1 -- 172.21.15.37:0/569343571 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdab001b400 con 0x7fdabc0ccb30 2023-10-06T02:23:31.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.566+0000 7fdab97fa700 1 --2- 172.21.15.37:0/569343571 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdaa8066f30 0x7fdaa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.566+0000 7fdab97fa700 1 -- 172.21.15.37:0/569343571 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdab0084140 con 0x7fdabc0ccb30 2023-10-06T02:23:31.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.566+0000 7fdac17f1700 1 --2- 172.21.15.37:0/569343571 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdaa8066f30 0x7fdaa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.566+0000 7fdac17f1700 1 --2- 172.21.15.37:0/569343571 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdaa8066f30 0x7fdaa80693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0091e0 tx=0x7fdaac017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:31.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.570+0000 7fdab97fa700 1 -- 172.21.15.37:0/569343571 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdab00512d0 con 0x7fdabc0ccb30 2023-10-06T02:23:31.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.764+0000 7fdac3a55700 1 -- 172.21.15.37:0/569343571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdabc15bd40 con 0x7fdabc0ccb30 2023-10-06T02:23:31.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.764+0000 7fdab97fa700 1 -- 172.21.15.37:0/569343571 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdabc15bd40 con 0x7fdabc0ccb30 2023-10-06T02:23:31.765 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T02:23:31.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.766+0000 7fdac3a55700 1 -- 172.21.15.37:0/569343571 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdaa8066f30 msgr2=0x7fdaa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.766+0000 7fdac3a55700 1 --2- 172.21.15.37:0/569343571 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdaa8066f30 0x7fdaa80693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0091e0 tx=0x7fdaac017000 comp rx=0 tx=0).stop 2023-10-06T02:23:31.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.766+0000 7fdac3a55700 1 -- 172.21.15.37:0/569343571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc0ccb30 msgr2=0x7fdabc157be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.766+0000 7fdac3a55700 1 --2- 172.21.15.37:0/569343571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc0ccb30 0x7fdabc157be0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdab000c7e0 tx=0x7fdab0007df0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.766+0000 7fdac3a55700 1 -- 172.21.15.37:0/569343571 shutdown_connections 2023-10-06T02:23:31.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.766+0000 7fdac3a55700 1 --2- 172.21.15.37:0/569343571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdabc1593c0 0x7fdabc0b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.766+0000 7fdac3a55700 1 --2- 172.21.15.37:0/569343571 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdaa8066f30 0x7fdaa80693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.766+0000 7fdac3a55700 1 --2- 172.21.15.37:0/569343571 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdabc0b2380 0x7fdabc0c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.766+0000 7fdac3a55700 1 --2- 172.21.15.37:0/569343571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc0ccb30 0x7fdabc157be0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.766+0000 7fdac3a55700 1 -- 172.21.15.37:0/569343571 >> 172.21.15.37:0/569343571 conn(0x7fdabc06c0b0 msgr2=0x7fdabc0b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:31.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.766+0000 7fdac3a55700 1 -- 172.21.15.37:0/569343571 shutdown_connections 2023-10-06T02:23:31.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.766+0000 7fdac3a55700 1 -- 172.21.15.37:0/569343571 wait complete. 2023-10-06T02:23:31.778 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:23:31.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.900+0000 7fedf135e700 1 Processor -- start 2023-10-06T02:23:31.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.900+0000 7fedf135e700 1 -- start start 2023-10-06T02:23:31.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.900+0000 7fedf135e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fedec0b2a90 0x7fedec159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.900+0000 7fedf135e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedec0ccb30 0x7fedec0ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.900+0000 7fedf135e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedec0b07a0 con 0x7fedec1593c0 2023-10-06T02:23:31.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.900+0000 7fedf135e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedec0cd8a0 con 0x7fedec0b2a90 2023-10-06T02:23:31.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.900+0000 7fedf135e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedec0afe70 con 0x7fedec0ccb30 2023-10-06T02:23:31.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.901+0000 7fedea7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fedec0b2a90 0x7fedec159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.901+0000 7fedeaffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fedec1593c0 0x7fedec0b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34564/0 (socket says 172.21.15.37:34564) 2023-10-06T02:23:31.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.901+0000 7fedeaffd700 1 -- 172.21.15.37:0/4445217 learned_addr learned my addr 172.21.15.37:0/4445217 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:31.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.901+0000 7fedeb7fe700 1 --2- 172.21.15.37:0/4445217 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedec0ccb30 0x7fedec0ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.901+0000 7fedea7fc700 1 -- 172.21.15.37:0/4445217 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedec0ccb30 msgr2=0x7fedec0ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:31.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.901+0000 7fedea7fc700 1 --2- 172.21.15.37:0/4445217 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedec0ccb30 0x7fedec0ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.901+0000 7fedea7fc700 1 -- 172.21.15.37:0/4445217 >> v1:172.21.15.37:6789/0 conn(0x7fedec1593c0 legacy=0x7fedec0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.901+0000 7fedea7fc700 1 -- 172.21.15.37:0/4445217 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec0b0150 con 0x7fedec0b2a90 2023-10-06T02:23:31.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.901+0000 7fede9ffb700 1 -- 172.21.15.37:0/4445217 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381426914 0 0) 0x7fedec0b07a0 con 0x7fedec1593c0 2023-10-06T02:23:31.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.901+0000 7fedea7fc700 1 --2- 172.21.15.37:0/4445217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedec0b2a90 0x7fedec159790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fedd40098e0 tx=0x7fedd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d809f26909ef3b71 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:31.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.901+0000 7fede9ffb700 1 -- 172.21.15.37:0/4445217 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd4009e80 con 0x7fedec0b2a90 2023-10-06T02:23:31.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.901+0000 7fede9ffb700 1 -- 172.21.15.37:0/4445217 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd400b860 con 0x7fedec0b2a90 2023-10-06T02:23:31.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.901+0000 7fede9ffb700 1 -- 172.21.15.37:0/4445217 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd400bbe0 con 0x7fedec0b2a90 2023-10-06T02:23:31.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.902+0000 7fedf135e700 1 -- 172.21.15.37:0/4445217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedec0b2a90 msgr2=0x7fedec159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.902+0000 7fedf135e700 1 --2- 172.21.15.37:0/4445217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedec0b2a90 0x7fedec159790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fedd40098e0 tx=0x7fedd40091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.902+0000 7fedf135e700 1 -- 172.21.15.37:0/4445217 shutdown_connections 2023-10-06T02:23:31.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.902+0000 7fedf135e700 1 --2- 172.21.15.37:0/4445217 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedec0ccb30 0x7fedec0ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.902+0000 7fedf135e700 1 --2- 172.21.15.37:0/4445217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedec0b2a90 0x7fedec159790 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.902+0000 7fedf135e700 1 -- 172.21.15.37:0/4445217 >> 172.21.15.37:0/4445217 conn(0x7fedec06c0b0 msgr2=0x7fedec06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:31.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.902+0000 7fedf135e700 1 -- 172.21.15.37:0/4445217 shutdown_connections 2023-10-06T02:23:31.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.902+0000 7fedf135e700 1 -- 172.21.15.37:0/4445217 wait complete. 2023-10-06T02:23:31.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.903+0000 7fedf135e700 1 Processor -- start 2023-10-06T02:23:31.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.903+0000 7fedf135e700 1 -- start start 2023-10-06T02:23:31.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.904+0000 7fedf135e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedec0b2a90 0x7fedec1691e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.904+0000 7fedf135e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fedec0ccb30 0x7fedec153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.904+0000 7fedf135e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedec1593c0 0x7fedec0c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.904+0000 7fedf135e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec0c7530 con 0x7fedec0b2a90 2023-10-06T02:23:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.904+0000 7fedf135e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec0c7780 con 0x7fedec0ccb30 2023-10-06T02:23:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.904+0000 7fedf135e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedec0c7a60 con 0x7fedec1593c0 2023-10-06T02:23:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.904+0000 7fedeaffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedec0b2a90 0x7fedec1691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.904+0000 7fedeaffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedec0b2a90 0x7fedec1691e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42406/0 (socket says 172.21.15.37:42406) 2023-10-06T02:23:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.904+0000 7fedeaffd700 1 -- 172.21.15.37:0/2244200576 learned_addr learned my addr 172.21.15.37:0/2244200576 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.904+0000 7fedea7fc700 1 --2- 172.21.15.37:0/2244200576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fedec0ccb30 0x7fedec153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.904+0000 7fedeb7fe700 1 --2- 172.21.15.37:0/2244200576 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedec1593c0 0x7fedec0c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.904+0000 7fedeaffd700 1 -- 172.21.15.37:0/2244200576 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedec1593c0 msgr2=0x7fedec0c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.904+0000 7fedeaffd700 1 --2- 172.21.15.37:0/2244200576 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedec1593c0 0x7fedec0c9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.904+0000 7fedeaffd700 1 -- 172.21.15.37:0/2244200576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fedec0ccb30 msgr2=0x7fedec153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.904+0000 7fedeaffd700 1 --2- 172.21.15.37:0/2244200576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fedec0ccb30 0x7fedec153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.904+0000 7fedeaffd700 1 -- 172.21.15.37:0/2244200576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd4009420 con 0x7fedec0b2a90 2023-10-06T02:23:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.905+0000 7fedeaffd700 1 --2- 172.21.15.37:0/2244200576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedec0b2a90 0x7fedec1691e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fede400c5b0 tx=0x7fede4001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.905+0000 7fede2ffd700 1 -- 172.21.15.37:0/2244200576 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4005b30 con 0x7fedec0b2a90 2023-10-06T02:23:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.905+0000 7fede2ffd700 1 -- 172.21.15.37:0/2244200576 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede4005c90 con 0x7fedec0b2a90 2023-10-06T02:23:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.905+0000 7fedf135e700 1 -- 172.21.15.37:0/2244200576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedec0c7d40 con 0x7fedec0b2a90 2023-10-06T02:23:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.905+0000 7fede2ffd700 1 -- 172.21.15.37:0/2244200576 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4007300 con 0x7fedec0b2a90 2023-10-06T02:23:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.905+0000 7fedf135e700 1 -- 172.21.15.37:0/2244200576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedec169720 con 0x7fedec0b2a90 2023-10-06T02:23:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.906+0000 7fedf135e700 1 -- 172.21.15.37:0/2244200576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedec0c8260 con 0x7fedec0b2a90 2023-10-06T02:23:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.906+0000 7fede2ffd700 1 -- 172.21.15.37:0/2244200576 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fede401b3b0 con 0x7fedec0b2a90 2023-10-06T02:23:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.907+0000 7fede2ffd700 1 --2- 172.21.15.37:0/2244200576 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fedcc066f30 0x7fedcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.907+0000 7fede2ffd700 1 -- 172.21.15.37:0/2244200576 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fede4083ac0 con 0x7fedec0b2a90 2023-10-06T02:23:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.907+0000 7fedea7fc700 1 --2- 172.21.15.37:0/2244200576 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fedcc066f30 0x7fedcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:31.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.908+0000 7fedea7fc700 1 --2- 172.21.15.37:0/2244200576 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fedcc066f30 0x7fedcc0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fedd40091e0 tx=0x7fedd4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:31.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:31.912+0000 7fede2ffd700 1 -- 172.21.15.37:0/2244200576 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fedec0c8260 con 0x7fedec0b2a90 2023-10-06T02:23:32.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.104+0000 7fedf135e700 1 -- 172.21.15.37:0/2244200576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fedec0b0430 con 0x7fedec0b2a90 2023-10-06T02:23:32.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.104+0000 7fede2ffd700 1 -- 172.21.15.37:0/2244200576 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fede40170a0 con 0x7fedec0b2a90 2023-10-06T02:23:32.105 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T02:23:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.106+0000 7fedf135e700 1 -- 172.21.15.37:0/2244200576 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fedcc066f30 msgr2=0x7fedcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.106+0000 7fedf135e700 1 --2- 172.21.15.37:0/2244200576 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fedcc066f30 0x7fedcc0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fedd40091e0 tx=0x7fedd4017000 comp rx=0 tx=0).stop 2023-10-06T02:23:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.106+0000 7fedf135e700 1 -- 172.21.15.37:0/2244200576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedec0b2a90 msgr2=0x7fedec1691e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.106+0000 7fedf135e700 1 --2- 172.21.15.37:0/2244200576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedec0b2a90 0x7fedec1691e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fede400c5b0 tx=0x7fede4001070 comp rx=0 tx=0).stop 2023-10-06T02:23:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.106+0000 7fedf135e700 1 -- 172.21.15.37:0/2244200576 shutdown_connections 2023-10-06T02:23:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.106+0000 7fedf135e700 1 --2- 172.21.15.37:0/2244200576 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedec1593c0 0x7fedec0c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.106+0000 7fedf135e700 1 --2- 172.21.15.37:0/2244200576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedec0b2a90 0x7fedec1691e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.106+0000 7fedf135e700 1 --2- 172.21.15.37:0/2244200576 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fedcc066f30 0x7fedcc0693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.106+0000 7fedf135e700 1 --2- 172.21.15.37:0/2244200576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fedec0ccb30 0x7fedec153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.106+0000 7fedf135e700 1 -- 172.21.15.37:0/2244200576 >> 172.21.15.37:0/2244200576 conn(0x7fedec06c0b0 msgr2=0x7fedec0d0500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.106+0000 7fedf135e700 1 -- 172.21.15.37:0/2244200576 shutdown_connections 2023-10-06T02:23:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.107+0000 7fedf135e700 1 -- 172.21.15.37:0/2244200576 wait complete. 2023-10-06T02:23:32.119 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:23:32.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.237+0000 7fad1b0f5700 1 Processor -- start 2023-10-06T02:23:32.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.237+0000 7fad1b0f5700 1 -- start start 2023-10-06T02:23:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.238+0000 7fad1b0f5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad14150ab0 0x7fad1406a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.238+0000 7fad1b0f5700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad14157920 con 0x7fad1406a9e0 2023-10-06T02:23:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.238+0000 7fad1b0f5700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad1415a0a0 con 0x7fad14157300 2023-10-06T02:23:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.238+0000 7fad1b0f5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1406ae80 con 0x7fad14150ab0 2023-10-06T02:23:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.238+0000 7fad13fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fad1406a9e0 0x7fad14156bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34572/0 (socket says 172.21.15.37:34572) 2023-10-06T02:23:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.238+0000 7fad13fff700 1 -- 172.21.15.37:0/1729708708 learned_addr learned my addr 172.21.15.37:0/1729708708 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.238+0000 7fad18e91700 1 --2- 172.21.15.37:0/1729708708 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad14150ab0 0x7fad1406a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.238+0000 7fad137fe700 1 -- 172.21.15.37:0/1729708708 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010029656 0 0) 0x7fad14157920 con 0x7fad1406a9e0 2023-10-06T02:23:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.238+0000 7fad137fe700 1 -- 172.21.15.37:0/1729708708 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad00003570 con 0x7fad1406a9e0 2023-10-06T02:23:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.238+0000 7fad137fe700 1 -- 172.21.15.37:0/1729708708 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168504907 0 0) 0x7fad1415a0a0 con 0x7fad14157300 2023-10-06T02:23:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.238+0000 7fad137fe700 1 -- 172.21.15.37:0/1729708708 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad14157920 con 0x7fad14157300 2023-10-06T02:23:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.238+0000 7fad18e91700 1 -- 172.21.15.37:0/1729708708 >> v1:172.21.15.191:6789/0 conn(0x7fad14157300 legacy=0x7fad140ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.238+0000 7fad137fe700 1 -- 172.21.15.37:0/1729708708 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3501684293 0 0) 0x7fad00003570 con 0x7fad1406a9e0 2023-10-06T02:23:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.239+0000 7fad18e91700 1 -- 172.21.15.37:0/1729708708 >> v1:172.21.15.37:6789/0 conn(0x7fad1406a9e0 legacy=0x7fad14156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.239+0000 7fad18e91700 1 -- 172.21.15.37:0/1729708708 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1415a380 con 0x7fad14150ab0 2023-10-06T02:23:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.239+0000 7fad18e91700 1 --2- 172.21.15.37:0/1729708708 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad14150ab0 0x7fad1406a4a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009910 tx=0x7fad0c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b643f2c9f4e4548a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.239+0000 7fad137fe700 1 -- 172.21.15.37:0/1729708708 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad040017f0 con 0x7fad14150ab0 2023-10-06T02:23:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.239+0000 7fad137fe700 1 -- 172.21.15.37:0/1729708708 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c011420 con 0x7fad14150ab0 2023-10-06T02:23:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.239+0000 7fad137fe700 1 -- 172.21.15.37:0/1729708708 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c0117c0 con 0x7fad14150ab0 2023-10-06T02:23:32.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.239+0000 7fad1b0f5700 1 -- 172.21.15.37:0/1729708708 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad14150ab0 msgr2=0x7fad1406a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.239+0000 7fad1b0f5700 1 --2- 172.21.15.37:0/1729708708 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad14150ab0 0x7fad1406a4a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009910 tx=0x7fad0c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.239+0000 7fad1b0f5700 1 -- 172.21.15.37:0/1729708708 shutdown_connections 2023-10-06T02:23:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.239+0000 7fad1b0f5700 1 --2- 172.21.15.37:0/1729708708 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad14150ab0 0x7fad1406a4a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.239+0000 7fad1b0f5700 1 -- 172.21.15.37:0/1729708708 >> 172.21.15.37:0/1729708708 conn(0x7fad140cc120 msgr2=0x7fad140cc520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.240+0000 7fad1b0f5700 1 -- 172.21.15.37:0/1729708708 shutdown_connections 2023-10-06T02:23:32.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.240+0000 7fad1b0f5700 1 -- 172.21.15.37:0/1729708708 wait complete. 2023-10-06T02:23:32.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.241+0000 7fad1b0f5700 1 Processor -- start 2023-10-06T02:23:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.241+0000 7fad1b0f5700 1 -- start start 2023-10-06T02:23:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.241+0000 7fad1b0f5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad1406a9e0 0x7fad14147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.241+0000 7fad1b0f5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad14150ab0 0x7fad1414e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.241+0000 7fad1b0f5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad14157300 0x7fad140980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.242+0000 7fad1b0f5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1416a010 con 0x7fad14150ab0 2023-10-06T02:23:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.242+0000 7fad1b0f5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad140a91f0 con 0x7fad14157300 2023-10-06T02:23:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.242+0000 7fad1b0f5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad140a94d0 con 0x7fad1406a9e0 2023-10-06T02:23:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.242+0000 7fad13fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad14150ab0 0x7fad1414e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.242+0000 7fad13fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad14150ab0 0x7fad1414e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42410/0 (socket says 172.21.15.37:42410) 2023-10-06T02:23:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.242+0000 7fad13fff700 1 -- 172.21.15.37:0/1768233773 learned_addr learned my addr 172.21.15.37:0/1768233773 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:32.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.242+0000 7fad18e91700 1 --2- 172.21.15.37:0/1768233773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad1406a9e0 0x7fad14147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.242+0000 7fad19692700 1 --2- 172.21.15.37:0/1768233773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad14157300 0x7fad140980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.242+0000 7fad13fff700 1 -- 172.21.15.37:0/1768233773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad1406a9e0 msgr2=0x7fad14147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.242+0000 7fad13fff700 1 --2- 172.21.15.37:0/1768233773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad1406a9e0 0x7fad14147f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.242+0000 7fad13fff700 1 -- 172.21.15.37:0/1768233773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad14157300 msgr2=0x7fad140980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.242+0000 7fad13fff700 1 --2- 172.21.15.37:0/1768233773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad14157300 0x7fad140980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.242+0000 7fad13fff700 1 -- 172.21.15.37:0/1768233773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c009420 con 0x7fad14150ab0 2023-10-06T02:23:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.242+0000 7fad13fff700 1 --2- 172.21.15.37:0/1768233773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad14150ab0 0x7fad1414e090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fad0400cca0 tx=0x7fad04007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.242+0000 7fad10ff9700 1 -- 172.21.15.37:0/1768233773 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad04004dc0 con 0x7fad14150ab0 2023-10-06T02:23:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.242+0000 7fad10ff9700 1 -- 172.21.15.37:0/1768233773 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0400a5f0 con 0x7fad14150ab0 2023-10-06T02:23:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.242+0000 7fad1b0f5700 1 -- 172.21.15.37:0/1768233773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad140a97b0 con 0x7fad14150ab0 2023-10-06T02:23:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.242+0000 7fad10ff9700 1 -- 172.21.15.37:0/1768233773 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0400a9b0 con 0x7fad14150ab0 2023-10-06T02:23:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.242+0000 7fad1b0f5700 1 -- 172.21.15.37:0/1768233773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad14148460 con 0x7fad14150ab0 2023-10-06T02:23:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.243+0000 7fad1b0f5700 1 -- 172.21.15.37:0/1768233773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1416a180 con 0x7fad14150ab0 2023-10-06T02:23:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.244+0000 7fad10ff9700 1 -- 172.21.15.37:0/1768233773 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad04007150 con 0x7fad14150ab0 2023-10-06T02:23:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.244+0000 7fad10ff9700 1 --2- 172.21.15.37:0/1768233773 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7facf4066f30 0x7facf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.244+0000 7fad10ff9700 1 -- 172.21.15.37:0/1768233773 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fad04083ff0 con 0x7fad14150ab0 2023-10-06T02:23:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.244+0000 7fad18e91700 1 --2- 172.21.15.37:0/1768233773 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7facf4066f30 0x7facf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.245+0000 7fad18e91700 1 --2- 172.21.15.37:0/1768233773 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7facf4066f30 0x7facf40693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0030c0 tx=0x7fad0c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:32.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.248+0000 7fad10ff9700 1 -- 172.21.15.37:0/1768233773 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad04051180 con 0x7fad14150ab0 2023-10-06T02:23:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.483+0000 7fad1b0f5700 1 -- 172.21.15.37:0/1768233773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad141599f0 con 0x7fad14150ab0 2023-10-06T02:23:32.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.483+0000 7fad10ff9700 1 -- 172.21.15.37:0/1768233773 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4591 (secure 0 0 0) 0x7fad040547a0 con 0x7fad14150ab0 2023-10-06T02:23:32.484 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:32.484 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/651376696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":651376696},{"type":"v1","addr":"172.21.15.191:6837","nonce":651376696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1345849362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1345849362},{"type":"v1","addr":"172.21.15.37:6834","nonce":1345849362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/434738958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":434738958},{"type":"v1","addr":"172.21.15.37:6835","nonce":434738958}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:15.298562+0000","modified":"2023-10-06T02:23:18.911651+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6835/1723334905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1723334905},{"type":"v1","addr":"172.21.15.191:6835","nonce":1723334905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:23:32.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.485+0000 7fad1b0f5700 1 -- 172.21.15.37:0/1768233773 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7facf4066f30 msgr2=0x7facf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.485+0000 7fad1b0f5700 1 --2- 172.21.15.37:0/1768233773 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7facf4066f30 0x7facf40693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0030c0 tx=0x7fad0c016000 comp rx=0 tx=0).stop 2023-10-06T02:23:32.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.485+0000 7fad1b0f5700 1 -- 172.21.15.37:0/1768233773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad14150ab0 msgr2=0x7fad1414e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.485+0000 7fad1b0f5700 1 --2- 172.21.15.37:0/1768233773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad14150ab0 0x7fad1414e090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fad0400cca0 tx=0x7fad04007da0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.485+0000 7fad1b0f5700 1 -- 172.21.15.37:0/1768233773 shutdown_connections 2023-10-06T02:23:32.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.485+0000 7fad1b0f5700 1 --2- 172.21.15.37:0/1768233773 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7facf4066f30 0x7facf40693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.485+0000 7fad1b0f5700 1 --2- 172.21.15.37:0/1768233773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad14157300 0x7fad140980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.485+0000 7fad1b0f5700 1 --2- 172.21.15.37:0/1768233773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad1406a9e0 0x7fad14147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.485+0000 7fad1b0f5700 1 --2- 172.21.15.37:0/1768233773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad14150ab0 0x7fad1414e090 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.485+0000 7fad1b0f5700 1 -- 172.21.15.37:0/1768233773 >> 172.21.15.37:0/1768233773 conn(0x7fad140cc120 msgr2=0x7fad1406f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:32.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.486+0000 7fad1b0f5700 1 -- 172.21.15.37:0/1768233773 shutdown_connections 2023-10-06T02:23:32.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.486+0000 7fad1b0f5700 1 -- 172.21.15.37:0/1768233773 wait complete. 2023-10-06T02:23:32.487 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-10-06T02:23:32.498 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:32.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.616+0000 7f8d12c8e700 1 Processor -- start 2023-10-06T02:23:32.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.616+0000 7f8d12c8e700 1 -- start start 2023-10-06T02:23:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.617+0000 7f8d12c8e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8d0c159370 0x7f8d0c159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.617+0000 7f8d12c8e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8d0c0b2270 0x7f8d0c15db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.617+0000 7f8d12c8e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8d0c0aff10 0x7f8d0c0b0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.617+0000 7f8d12c8e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0c0b5c00 con 0x7f8d0c0b2270 2023-10-06T02:23:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.617+0000 7f8d12c8e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0c0b08d0 con 0x7f8d0c159370 2023-10-06T02:23:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.617+0000 7f8d12c8e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c0cb200 con 0x7f8d0c0aff10 2023-10-06T02:23:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.617+0000 7f8d1148b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8d0c0b2270 0x7f8d0c15db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.617+0000 7f8d1148b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8d0c0b2270 0x7f8d0c15db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42422/0 (socket says 172.21.15.37:42422) 2023-10-06T02:23:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.617+0000 7f8d1148b700 1 -- 172.21.15.37:0/3348310683 learned_addr learned my addr 172.21.15.37:0/3348310683 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.617+0000 7f8d11c8c700 1 --2- 172.21.15.37:0/3348310683 >> v2:172.21.15.191:3300/0 conn(0x7f8d0c159370 0x7f8d0c159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.617+0000 7f8d1248d700 1 --2- 172.21.15.37:0/3348310683 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8d0c0aff10 0x7f8d0c0b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.618+0000 7f8d1148b700 1 -- 172.21.15.37:0/3348310683 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8d0c0aff10 msgr2=0x7f8d0c0b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.618+0000 7f8d1148b700 1 --2- 172.21.15.37:0/3348310683 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8d0c0aff10 0x7f8d0c0b0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.618+0000 7f8d1148b700 1 -- 172.21.15.37:0/3348310683 >> v2:172.21.15.191:3300/0 conn(0x7f8d0c159370 msgr2=0x7f8d0c159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.618+0000 7f8d1148b700 1 --2- 172.21.15.37:0/3348310683 >> v2:172.21.15.191:3300/0 conn(0x7f8d0c159370 0x7f8d0c159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.618+0000 7f8d1148b700 1 -- 172.21.15.37:0/3348310683 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c0cb7c0 con 0x7f8d0c0b2270 2023-10-06T02:23:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.618+0000 7f8d1248d700 1 --2- 172.21.15.37:0/3348310683 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8d0c0aff10 0x7f8d0c0b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.618+0000 7f8d1148b700 1 --2- 172.21.15.37:0/3348310683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d0c0b2270 0x7f8d0c15db90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0d13a0 tx=0x7f8d00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24332b66a63d6e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.618+0000 7f8d10c8a700 1 -- 172.21.15.37:0/3348310683 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00009e70 con 0x7f8d0c0b2270 2023-10-06T02:23:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.618+0000 7f8d10c8a700 1 -- 172.21.15.37:0/3348310683 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0000b860 con 0x7f8d0c0b2270 2023-10-06T02:23:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.618+0000 7f8d10c8a700 1 -- 172.21.15.37:0/3348310683 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0000bc00 con 0x7f8d0c0b2270 2023-10-06T02:23:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.618+0000 7f8d12c8e700 1 -- 172.21.15.37:0/3348310683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d0c0b2270 msgr2=0x7f8d0c15db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.618+0000 7f8d12c8e700 1 --2- 172.21.15.37:0/3348310683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d0c0b2270 0x7f8d0c15db90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0d13a0 tx=0x7f8d00009250 comp rx=0 tx=0).stop 2023-10-06T02:23:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.618+0000 7f8d12c8e700 1 -- 172.21.15.37:0/3348310683 shutdown_connections 2023-10-06T02:23:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.618+0000 7f8d12c8e700 1 --2- 172.21.15.37:0/3348310683 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8d0c0aff10 0x7f8d0c0b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.618+0000 7f8d12c8e700 1 --2- 172.21.15.37:0/3348310683 >> v2:172.21.15.191:3300/0 conn(0x7f8d0c159370 0x7f8d0c159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.618+0000 7f8d12c8e700 1 --2- 172.21.15.37:0/3348310683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d0c0b2270 0x7f8d0c15db90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.618+0000 7f8d12c8e700 1 -- 172.21.15.37:0/3348310683 >> 172.21.15.37:0/3348310683 conn(0x7f8d0c06c0b0 msgr2=0x7f8d0c06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.618+0000 7f8d12c8e700 1 -- 172.21.15.37:0/3348310683 shutdown_connections 2023-10-06T02:23:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.618+0000 7f8d12c8e700 1 -- 172.21.15.37:0/3348310683 wait complete. 2023-10-06T02:23:32.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.619+0000 7f8d12c8e700 1 Processor -- start 2023-10-06T02:23:32.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.620+0000 7f8d12c8e700 1 -- start start 2023-10-06T02:23:32.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.620+0000 7f8d12c8e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d0c0aff10 0x7f8d0c169a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.620+0000 7f8d12c8e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d0c0b2270 0x7f8d0c159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.620+0000 7f8d12c8e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8d0c159370 0x7f8d0c159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.620+0000 7f8d12c8e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c169fc0 con 0x7f8d0c0b2270 2023-10-06T02:23:32.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.620+0000 7f8d12c8e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c15a3b0 con 0x7f8d0c0aff10 2023-10-06T02:23:32.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.620+0000 7f8d12c8e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c15a650 con 0x7f8d0c159370 2023-10-06T02:23:32.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.620+0000 7f8d1148b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d0c0b2270 0x7f8d0c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.620+0000 7f8d1148b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d0c0b2270 0x7f8d0c159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42436/0 (socket says 172.21.15.37:42436) 2023-10-06T02:23:32.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.620+0000 7f8d1148b700 1 -- 172.21.15.37:0/3991768931 learned_addr learned my addr 172.21.15.37:0/3991768931 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:32.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.620+0000 7f8d11c8c700 1 --2- 172.21.15.37:0/3991768931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d0c0aff10 0x7f8d0c169a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.620+0000 7f8d1248d700 1 --2- 172.21.15.37:0/3991768931 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8d0c159370 0x7f8d0c159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.621+0000 7f8d1148b700 1 -- 172.21.15.37:0/3991768931 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8d0c159370 msgr2=0x7f8d0c159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.621+0000 7f8d1148b700 1 --2- 172.21.15.37:0/3991768931 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8d0c159370 0x7f8d0c159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.621+0000 7f8d1148b700 1 -- 172.21.15.37:0/3991768931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d0c0aff10 msgr2=0x7f8d0c169a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.621+0000 7f8d1148b700 1 --2- 172.21.15.37:0/3991768931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d0c0aff10 0x7f8d0c169a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.621+0000 7f8d1148b700 1 -- 172.21.15.37:0/3991768931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d000094f0 con 0x7f8d0c0b2270 2023-10-06T02:23:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.621+0000 7f8d1148b700 1 --2- 172.21.15.37:0/3991768931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d0c0b2270 0x7f8d0c159900 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009290 tx=0x7f8d00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.621+0000 7f8d09ffb700 1 -- 172.21.15.37:0/3991768931 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0000bbe0 con 0x7f8d0c0b2270 2023-10-06T02:23:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.621+0000 7f8d09ffb700 1 -- 172.21.15.37:0/3991768931 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d00000c90 con 0x7f8d0c0b2270 2023-10-06T02:23:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.621+0000 7f8d12c8e700 1 -- 172.21.15.37:0/3991768931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d0c15a990 con 0x7f8d0c0b2270 2023-10-06T02:23:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.621+0000 7f8d09ffb700 1 -- 172.21.15.37:0/3991768931 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0001a680 con 0x7f8d0c0b2270 2023-10-06T02:23:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.621+0000 7f8d12c8e700 1 -- 172.21.15.37:0/3991768931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d0c15b1d0 con 0x7f8d0c0b2270 2023-10-06T02:23:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.622+0000 7f8d12c8e700 1 -- 172.21.15.37:0/3991768931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0c15ab20 con 0x7f8d0c0b2270 2023-10-06T02:23:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.622+0000 7f8d09ffb700 1 -- 172.21.15.37:0/3991768931 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d0001aa30 con 0x7f8d0c0b2270 2023-10-06T02:23:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.623+0000 7f8d09ffb700 1 --2- 172.21.15.37:0/3991768931 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8cf8066f30 0x7f8cf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.623+0000 7f8d09ffb700 1 -- 172.21.15.37:0/3991768931 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8d00085bb0 con 0x7f8d0c0b2270 2023-10-06T02:23:32.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.623+0000 7f8d11c8c700 1 --2- 172.21.15.37:0/3991768931 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8cf8066f30 0x7f8cf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.624+0000 7f8d11c8c700 1 --2- 172.21.15.37:0/3991768931 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8cf8066f30 0x7f8cf80693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400f570 tx=0x7f8d0400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:32.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.627+0000 7f8d09ffb700 1 -- 172.21.15.37:0/3991768931 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d00052cc0 con 0x7f8d0c0b2270 2023-10-06T02:23:32.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.823+0000 7f8d12c8e700 1 -- 172.21.15.37:0/3991768931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d0c0645f0 con 0x7f8d0c0b2270 2023-10-06T02:23:32.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.824+0000 7f8d09ffb700 1 -- 172.21.15.37:0/3991768931 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f8d000562e0 con 0x7f8d0c0b2270 2023-10-06T02:23:32.825 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:32.825 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:23:16.897625+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:13.004596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:14.268809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.826+0000 7f8d12c8e700 1 -- 172.21.15.37:0/3991768931 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8cf8066f30 msgr2=0x7f8cf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.826+0000 7f8d12c8e700 1 --2- 172.21.15.37:0/3991768931 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8cf8066f30 0x7f8cf80693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400f570 tx=0x7f8d0400b040 comp rx=0 tx=0).stop 2023-10-06T02:23:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.826+0000 7f8d12c8e700 1 -- 172.21.15.37:0/3991768931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d0c0b2270 msgr2=0x7f8d0c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.826+0000 7f8d12c8e700 1 --2- 172.21.15.37:0/3991768931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d0c0b2270 0x7f8d0c159900 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009290 tx=0x7f8d00017000 comp rx=0 tx=0).stop 2023-10-06T02:23:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.826+0000 7f8d12c8e700 1 -- 172.21.15.37:0/3991768931 shutdown_connections 2023-10-06T02:23:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.826+0000 7f8d12c8e700 1 --2- 172.21.15.37:0/3991768931 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8d0c159370 0x7f8d0c159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.826+0000 7f8d12c8e700 1 --2- 172.21.15.37:0/3991768931 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8cf8066f30 0x7f8cf80693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.826+0000 7f8d12c8e700 1 --2- 172.21.15.37:0/3991768931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d0c0aff10 0x7f8d0c169a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.826+0000 7f8d12c8e700 1 --2- 172.21.15.37:0/3991768931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d0c0b2270 0x7f8d0c159900 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.826+0000 7f8d12c8e700 1 -- 172.21.15.37:0/3991768931 >> 172.21.15.37:0/3991768931 conn(0x7f8d0c06c0b0 msgr2=0x7f8d0c1566e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.826+0000 7f8d12c8e700 1 -- 172.21.15.37:0/3991768931 shutdown_connections 2023-10-06T02:23:32.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.826+0000 7f8d12c8e700 1 -- 172.21.15.37:0/3991768931 wait complete. 2023-10-06T02:23:32.839 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:23:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.957+0000 7f6bbbf99700 1 Processor -- start 2023-10-06T02:23:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.957+0000 7f6bbbf99700 1 -- start start 2023-10-06T02:23:32.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.958+0000 7f6bbbf99700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6bb41596d0 0x7f6bb40b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.958+0000 7f6bbbf99700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6bb40b3840 0x7f6bb40c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.958+0000 7f6bbbf99700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bb4159aa0 0x7f6bb40c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.958+0000 7f6bbbf99700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb40c5300 con 0x7f6bb41596d0 2023-10-06T02:23:32.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.958+0000 7f6bbbf99700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb40c6160 con 0x7f6bb40b3840 2023-10-06T02:23:32.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.958+0000 7f6bbbf99700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40c5550 con 0x7f6bb4159aa0 2023-10-06T02:23:32.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.958+0000 7f6bb9d35700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6bb41596d0 0x7f6bb40b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.958+0000 7f6bb9d35700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6bb41596d0 0x7f6bb40b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42440/0 (socket says 172.21.15.37:42440) 2023-10-06T02:23:32.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.958+0000 7f6bb9d35700 1 -- 172.21.15.37:0/3369402032 learned_addr learned my addr 172.21.15.37:0/3369402032 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:32.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.958+0000 7f6bba536700 1 --2- 172.21.15.37:0/3369402032 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bb4159aa0 0x7f6bb40c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.958+0000 7f6bb9534700 1 --2- 172.21.15.37:0/3369402032 >> v2:172.21.15.191:3300/0 conn(0x7f6bb40b3840 0x7f6bb40c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.958+0000 7f6bb9d35700 1 -- 172.21.15.37:0/3369402032 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bb4159aa0 msgr2=0x7f6bb40c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:32.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.958+0000 7f6bb9d35700 1 --2- 172.21.15.37:0/3369402032 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bb4159aa0 0x7f6bb40c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.958+0000 7f6bb9d35700 1 -- 172.21.15.37:0/3369402032 >> v2:172.21.15.191:3300/0 conn(0x7f6bb40b3840 msgr2=0x7f6bb40c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:32.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.958+0000 7f6bb9d35700 1 --2- 172.21.15.37:0/3369402032 >> v2:172.21.15.191:3300/0 conn(0x7f6bb40b3840 0x7f6bb40c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.959+0000 7f6bb9d35700 1 -- 172.21.15.37:0/3369402032 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb40c5830 con 0x7f6bb41596d0 2023-10-06T02:23:32.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.959+0000 7f6bb9d35700 1 --2- 172.21.15.37:0/3369402032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb41596d0 0x7f6bb40b3300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6bb406d5f0 tx=0x7f6ba4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f287d481a067be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:32.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.959+0000 7f6bb8d33700 1 -- 172.21.15.37:0/3369402032 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba400e070 con 0x7f6bb41596d0 2023-10-06T02:23:32.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.959+0000 7f6bb8d33700 1 -- 172.21.15.37:0/3369402032 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba400ba50 con 0x7f6bb41596d0 2023-10-06T02:23:32.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.959+0000 7f6bb8d33700 1 -- 172.21.15.37:0/3369402032 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40092e0 con 0x7f6bb41596d0 2023-10-06T02:23:32.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.959+0000 7f6bbbf99700 1 -- 172.21.15.37:0/3369402032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb41596d0 msgr2=0x7f6bb40b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.959+0000 7f6bbbf99700 1 --2- 172.21.15.37:0/3369402032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb41596d0 0x7f6bb40b3300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6bb406d5f0 tx=0x7f6ba4009840 comp rx=0 tx=0).stop 2023-10-06T02:23:32.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.959+0000 7f6bbbf99700 1 -- 172.21.15.37:0/3369402032 shutdown_connections 2023-10-06T02:23:32.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.959+0000 7f6bbbf99700 1 --2- 172.21.15.37:0/3369402032 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bb4159aa0 0x7f6bb40c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.959+0000 7f6bbbf99700 1 --2- 172.21.15.37:0/3369402032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb41596d0 0x7f6bb40b3300 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.959+0000 7f6bbbf99700 1 --2- 172.21.15.37:0/3369402032 >> v2:172.21.15.191:3300/0 conn(0x7f6bb40b3840 0x7f6bb40c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.959+0000 7f6bbbf99700 1 -- 172.21.15.37:0/3369402032 >> 172.21.15.37:0/3369402032 conn(0x7f6bb406c890 msgr2=0x7f6bb40d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:32.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.959+0000 7f6bbbf99700 1 -- 172.21.15.37:0/3369402032 shutdown_connections 2023-10-06T02:23:32.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.959+0000 7f6bbbf99700 1 -- 172.21.15.37:0/3369402032 wait complete. 2023-10-06T02:23:32.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.960+0000 7f6bbbf99700 1 Processor -- start 2023-10-06T02:23:32.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.961+0000 7f6bbbf99700 1 -- start start 2023-10-06T02:23:32.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.961+0000 7f6bbbf99700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6bb40b3840 0x7f6bb409ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.961+0000 7f6bbbf99700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bb41596d0 0x7f6bb41532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.961+0000 7f6bbbf99700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb4159aa0 0x7f6bb40cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.961+0000 7f6bbbf99700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb4159ef0 con 0x7f6bb4159aa0 2023-10-06T02:23:32.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.961+0000 7f6bbbf99700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb415a4b0 con 0x7f6bb40b3840 2023-10-06T02:23:32.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.961+0000 7f6bbbf99700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40cb820 con 0x7f6bb41596d0 2023-10-06T02:23:32.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.961+0000 7f6bba536700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb4159aa0 0x7f6bb40cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.961+0000 7f6bba536700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb4159aa0 0x7f6bb40cb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42446/0 (socket says 172.21.15.37:42446) 2023-10-06T02:23:32.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.961+0000 7f6bba536700 1 -- 172.21.15.37:0/3136029919 learned_addr learned my addr 172.21.15.37:0/3136029919 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:32.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.961+0000 7f6bb9d35700 1 --2- 172.21.15.37:0/3136029919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6bb40b3840 0x7f6bb409ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.962+0000 7f6bb9534700 1 --2- 172.21.15.37:0/3136029919 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bb41596d0 0x7f6bb41532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.962+0000 7f6bba536700 1 -- 172.21.15.37:0/3136029919 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bb41596d0 msgr2=0x7f6bb41532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.962+0000 7f6bba536700 1 --2- 172.21.15.37:0/3136029919 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bb41596d0 0x7f6bb41532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.962+0000 7f6bba536700 1 -- 172.21.15.37:0/3136029919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6bb40b3840 msgr2=0x7f6bb409ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:32.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.962+0000 7f6bba536700 1 --2- 172.21.15.37:0/3136029919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6bb40b3840 0x7f6bb409ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:32.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.962+0000 7f6bba536700 1 -- 172.21.15.37:0/3136029919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba4009ae0 con 0x7f6bb4159aa0 2023-10-06T02:23:32.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.962+0000 7f6bba536700 1 --2- 172.21.15.37:0/3136029919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb4159aa0 0x7f6bb40cb2e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00d8f0 tx=0x7f6bac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:32.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.962+0000 7f6bb1ffb700 1 -- 172.21.15.37:0/3136029919 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac0125f0 con 0x7f6bb4159aa0 2023-10-06T02:23:32.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.962+0000 7f6bb1ffb700 1 -- 172.21.15.37:0/3136029919 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac012750 con 0x7f6bb4159aa0 2023-10-06T02:23:32.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.962+0000 7f6bbbf99700 1 -- 172.21.15.37:0/3136029919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb409b4f0 con 0x7f6bb4159aa0 2023-10-06T02:23:32.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.962+0000 7f6bb1ffb700 1 -- 172.21.15.37:0/3136029919 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac012b10 con 0x7f6bb4159aa0 2023-10-06T02:23:32.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.962+0000 7f6bbbf99700 1 -- 172.21.15.37:0/3136029919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb415a140 con 0x7f6bb4159aa0 2023-10-06T02:23:32.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.963+0000 7f6bbbf99700 1 -- 172.21.15.37:0/3136029919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb406eb50 con 0x7f6bb4159aa0 2023-10-06T02:23:32.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.963+0000 7f6bb1ffb700 1 -- 172.21.15.37:0/3136029919 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6bac013480 con 0x7f6bb4159aa0 2023-10-06T02:23:32.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.964+0000 7f6bb1ffb700 1 --2- 172.21.15.37:0/3136029919 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ba0066f30 0x7f6ba00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:32.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.964+0000 7f6bb1ffb700 1 -- 172.21.15.37:0/3136029919 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6bac0848e0 con 0x7f6bb4159aa0 2023-10-06T02:23:32.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.964+0000 7f6bb9d35700 1 --2- 172.21.15.37:0/3136029919 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ba0066f30 0x7f6ba00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:32.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.965+0000 7f6bb9d35700 1 --2- 172.21.15.37:0/3136029919 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ba0066f30 0x7f6ba00693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009880 tx=0x7f6ba4018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:32.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:32.968+0000 7f6bb1ffb700 1 -- 172.21.15.37:0/3136029919 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bac0519f0 con 0x7f6bb4159aa0 2023-10-06T02:23:33.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.208+0000 7f6bbbf99700 1 -- 172.21.15.37:0/3136029919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bb406fbf0 con 0x7f6bb4159aa0 2023-10-06T02:23:33.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.208+0000 7f6bb1ffb700 1 -- 172.21.15.37:0/3136029919 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f6bac055010 con 0x7f6bb4159aa0 2023-10-06T02:23:33.209 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:33.209 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/651376696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":651376696},{"type":"v1","addr":"172.21.15.191:6837","nonce":651376696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1345849362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1345849362},{"type":"v1","addr":"172.21.15.37:6834","nonce":1345849362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/434738958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":434738958},{"type":"v1","addr":"172.21.15.37:6835","nonce":434738958}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:15.298562+0000","modified":"2023-10-06T02:23:18.911651+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6835/1723334905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1723334905},{"type":"v1","addr":"172.21.15.191:6835","nonce":1723334905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:23:33.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.211+0000 7f6bbbf99700 1 -- 172.21.15.37:0/3136029919 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ba0066f30 msgr2=0x7f6ba00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:33.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.211+0000 7f6bbbf99700 1 --2- 172.21.15.37:0/3136029919 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ba0066f30 0x7f6ba00693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009880 tx=0x7f6ba4018000 comp rx=0 tx=0).stop 2023-10-06T02:23:33.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.211+0000 7f6bbbf99700 1 -- 172.21.15.37:0/3136029919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb4159aa0 msgr2=0x7f6bb40cb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:33.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.211+0000 7f6bbbf99700 1 --2- 172.21.15.37:0/3136029919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb4159aa0 0x7f6bb40cb2e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00d8f0 tx=0x7f6bac008040 comp rx=0 tx=0).stop 2023-10-06T02:23:33.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.211+0000 7f6bbbf99700 1 -- 172.21.15.37:0/3136029919 shutdown_connections 2023-10-06T02:23:33.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.211+0000 7f6bbbf99700 1 --2- 172.21.15.37:0/3136029919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb4159aa0 0x7f6bb40cb2e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.211+0000 7f6bbbf99700 1 --2- 172.21.15.37:0/3136029919 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ba0066f30 0x7f6ba00693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.211+0000 7f6bbbf99700 1 --2- 172.21.15.37:0/3136029919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6bb40b3840 0x7f6bb409ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.211+0000 7f6bbbf99700 1 --2- 172.21.15.37:0/3136029919 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bb41596d0 0x7f6bb41532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.211+0000 7f6bbbf99700 1 -- 172.21.15.37:0/3136029919 >> 172.21.15.37:0/3136029919 conn(0x7f6bb406c890 msgr2=0x7f6bb41553b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:33.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.211+0000 7f6bbbf99700 1 -- 172.21.15.37:0/3136029919 shutdown_connections 2023-10-06T02:23:33.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.211+0000 7f6bbbf99700 1 -- 172.21.15.37:0/3136029919 wait complete. 2023-10-06T02:23:33.213 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-10-06T02:23:33.626 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:23:15.298562+0000', 'modified': '2023-10-06T02:23:18.911651+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.191:6835/1723334905', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6834', 'nonce': 1723334905}, {'type': 'v1', 'addr': '172.21.15.191:6835', 'nonce': 1723334905}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:23:33.626 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:23:33.626 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T02:23:33.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.749+0000 7fdad7ef3700 1 Processor -- start 2023-10-06T02:23:33.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.750+0000 7fdad7ef3700 1 -- start start 2023-10-06T02:23:33.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.750+0000 7fdad7ef3700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fdad006de80 0x7fdad00b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.750+0000 7fdad7ef3700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad00cc250 con 0x7fdad00cb080 2023-10-06T02:23:33.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.750+0000 7fdad7ef3700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad00cb640 con 0x7fdad006dab0 2023-10-06T02:23:33.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.750+0000 7fdad7ef3700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad00b0e00 con 0x7fdad006de80 2023-10-06T02:23:33.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad548e700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdad00cb080 0x7fdad00b01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34582/0 (socket says 172.21.15.37:34582) 2023-10-06T02:23:33.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad548e700 1 -- 172.21.15.37:0/3239999251 learned_addr learned my addr 172.21.15.37:0/3239999251 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad4c8d700 1 -- 172.21.15.37:0/3239999251 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084671935 0 0) 0x7fdad00cc250 con 0x7fdad00cb080 2023-10-06T02:23:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad6490700 1 --2- 172.21.15.37:0/3239999251 >> v2:172.21.15.191:3300/0 conn(0x7fdad006de80 0x7fdad00b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad4c8d700 1 -- 172.21.15.37:0/3239999251 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdab8003570 con 0x7fdad00cb080 2023-10-06T02:23:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad4c8d700 1 -- 172.21.15.37:0/3239999251 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3478898226 0 0) 0x7fdab8003570 con 0x7fdad00cb080 2023-10-06T02:23:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad4c8d700 1 -- 172.21.15.37:0/3239999251 >> v2:172.21.15.191:3300/0 conn(0x7fdad006de80 msgr2=0x7fdad00b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad4c8d700 1 --2- 172.21.15.37:0/3239999251 >> v2:172.21.15.191:3300/0 conn(0x7fdad006de80 0x7fdad00b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad4c8d700 1 -- 172.21.15.37:0/3239999251 >> v1:172.21.15.191:6789/0 conn(0x7fdad006dab0 legacy=0x7fdad00cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad4c8d700 1 -- 172.21.15.37:0/3239999251 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad00cb920 con 0x7fdad00cb080 2023-10-06T02:23:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad4c8d700 1 -- 172.21.15.37:0/3239999251 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7fdac4001470 con 0x7fdad00cb080 2023-10-06T02:23:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad4c8d700 1 -- 172.21.15.37:0/3239999251 >> v1:172.21.15.37:6789/0 conn(0x7fdad00cb080 legacy=0x7fdad00b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad4c8d700 1 --2- 172.21.15.37:0/3239999251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdab8003a60 0x7fdab8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad4c8d700 1 --2- 172.21.15.37:0/3239999251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdab8004810 0x7fdab8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad4c8d700 1 --2- 172.21.15.37:0/3239999251 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdab80051c0 0x7fdab800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad4c8d700 1 -- 172.21.15.37:0/3239999251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad00b0e00 con 0x7fdab8004810 2023-10-06T02:23:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad4c8d700 1 -- 172.21.15.37:0/3239999251 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab800c050 con 0x7fdab8003a60 2023-10-06T02:23:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad4c8d700 1 -- 172.21.15.37:0/3239999251 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab800c210 con 0x7fdab80051c0 2023-10-06T02:23:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad548e700 1 --2- 172.21.15.37:0/3239999251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdab8004810 0x7fdab8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad5c8f700 1 --2- 172.21.15.37:0/3239999251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdab8003a60 0x7fdab8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.751+0000 7fdad6490700 1 --2- 172.21.15.37:0/3239999251 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdab80051c0 0x7fdab800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.752+0000 7fdad548e700 1 -- 172.21.15.37:0/3239999251 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdab80051c0 msgr2=0x7fdab800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:33.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.752+0000 7fdad548e700 1 --2- 172.21.15.37:0/3239999251 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdab80051c0 0x7fdab800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.752+0000 7fdad548e700 1 -- 172.21.15.37:0/3239999251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdab8003a60 msgr2=0x7fdab8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:33.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.752+0000 7fdad548e700 1 --2- 172.21.15.37:0/3239999251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdab8003a60 0x7fdab8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.752+0000 7fdad548e700 1 -- 172.21.15.37:0/3239999251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab8003570 con 0x7fdab8004810 2023-10-06T02:23:33.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.752+0000 7fdad6490700 1 -- 172.21.15.37:0/3239999251 reap_dead start 2023-10-06T02:23:33.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.752+0000 7fdad548e700 1 --2- 172.21.15.37:0/3239999251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdab8004810 0x7fdab8004c80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c3c0 tx=0x7fdac4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee324a8296b338b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:33.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.752+0000 7fdad4c8d700 1 -- 172.21.15.37:0/3239999251 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac400cc90 con 0x7fdab8004810 2023-10-06T02:23:33.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.752+0000 7fdad4c8d700 1 -- 172.21.15.37:0/3239999251 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac400cdf0 con 0x7fdab8004810 2023-10-06T02:23:33.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.752+0000 7fdad4c8d700 1 -- 172.21.15.37:0/3239999251 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4005b70 con 0x7fdab8004810 2023-10-06T02:23:33.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.752+0000 7fdad7ef3700 1 -- 172.21.15.37:0/3239999251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdab8004810 msgr2=0x7fdab8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:33.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.752+0000 7fdad7ef3700 1 --2- 172.21.15.37:0/3239999251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdab8004810 0x7fdab8004c80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c3c0 tx=0x7fdac4001e70 comp rx=0 tx=0).stop 2023-10-06T02:23:33.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.752+0000 7fdad7ef3700 1 -- 172.21.15.37:0/3239999251 shutdown_connections 2023-10-06T02:23:33.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.752+0000 7fdad7ef3700 1 --2- 172.21.15.37:0/3239999251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdab8004810 0x7fdab8004c80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.752+0000 7fdad7ef3700 1 -- 172.21.15.37:0/3239999251 >> 172.21.15.37:0/3239999251 conn(0x7fdad00d0510 msgr2=0x7fdad00d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:33.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.752+0000 7fdad7ef3700 1 -- 172.21.15.37:0/3239999251 shutdown_connections 2023-10-06T02:23:33.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.753+0000 7fdad7ef3700 1 -- 172.21.15.37:0/3239999251 wait complete. 2023-10-06T02:23:33.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.754+0000 7fdad7ef3700 1 Processor -- start 2023-10-06T02:23:33.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.754+0000 7fdad7ef3700 1 -- start start 2023-10-06T02:23:33.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.754+0000 7fdad7ef3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdab8004810 0x7fdad016a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.754+0000 7fdad7ef3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdad016a8d0 0x7fdad0167340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.754+0000 7fdad7ef3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdad0168e50 0x7fdad00b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.754+0000 7fdad7ef3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad00a7160 con 0x7fdab8004810 2023-10-06T02:23:33.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.754+0000 7fdad7ef3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad016a6c0 con 0x7fdad016a8d0 2023-10-06T02:23:33.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.754+0000 7fdad7ef3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad0167880 con 0x7fdad0168e50 2023-10-06T02:23:33.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.754+0000 7fdad5c8f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdab8004810 0x7fdad016a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.754+0000 7fdad5c8f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdab8004810 0x7fdad016a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42466/0 (socket says 172.21.15.37:42466) 2023-10-06T02:23:33.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.754+0000 7fdad5c8f700 1 -- 172.21.15.37:0/1351715340 learned_addr learned my addr 172.21.15.37:0/1351715340 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:33.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.754+0000 7fdad548e700 1 --2- 172.21.15.37:0/1351715340 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdad016a8d0 0x7fdad0167340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.755+0000 7fdad6490700 1 --2- 172.21.15.37:0/1351715340 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdad0168e50 0x7fdad00b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.755+0000 7fdad5c8f700 1 -- 172.21.15.37:0/1351715340 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdad0168e50 msgr2=0x7fdad00b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:33.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.755+0000 7fdad5c8f700 1 --2- 172.21.15.37:0/1351715340 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdad0168e50 0x7fdad00b2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.755+0000 7fdad5c8f700 1 -- 172.21.15.37:0/1351715340 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdad016a8d0 msgr2=0x7fdad0167340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:33.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.755+0000 7fdad5c8f700 1 --2- 172.21.15.37:0/1351715340 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdad016a8d0 0x7fdad0167340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.755+0000 7fdad5c8f700 1 -- 172.21.15.37:0/1351715340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad016add0 con 0x7fdab8004810 2023-10-06T02:23:33.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.755+0000 7fdad5c8f700 1 --2- 172.21.15.37:0/1351715340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdab8004810 0x7fdad016a180 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdac8002b30 tx=0x7fdac8007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:33.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.755+0000 7fdacdffb700 1 -- 172.21.15.37:0/1351715340 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac800f870 con 0x7fdab8004810 2023-10-06T02:23:33.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.755+0000 7fdacdffb700 1 -- 172.21.15.37:0/1351715340 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac800f9f0 con 0x7fdab8004810 2023-10-06T02:23:33.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.755+0000 7fdad7ef3700 1 -- 172.21.15.37:0/1351715340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad016b0b0 con 0x7fdab8004810 2023-10-06T02:23:33.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.755+0000 7fdacdffb700 1 -- 172.21.15.37:0/1351715340 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac800fdb0 con 0x7fdab8004810 2023-10-06T02:23:33.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.755+0000 7fdad7ef3700 1 -- 172.21.15.37:0/1351715340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad016b670 con 0x7fdab8004810 2023-10-06T02:23:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.757+0000 7fdacdffb700 1 -- 172.21.15.37:0/1351715340 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdac8013600 con 0x7fdab8004810 2023-10-06T02:23:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.757+0000 7fdacdffb700 1 --2- 172.21.15.37:0/1351715340 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdabc066f30 0x7fdabc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.758+0000 7fdacdffb700 1 -- 172.21.15.37:0/1351715340 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdac8084cb0 con 0x7fdab8004810 2023-10-06T02:23:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.758+0000 7fdad548e700 1 --2- 172.21.15.37:0/1351715340 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdabc066f30 0x7fdabc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.758+0000 7fdad548e700 1 --2- 172.21.15.37:0/1351715340 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdabc066f30 0x7fdabc0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdac4007cf0 tx=0x7fdac4015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.759+0000 7fdae11ebb80 1 Processor -- start 2023-10-06T02:23:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.759+0000 7fdae11ebb80 1 -- start start 2023-10-06T02:23:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.760+0000 7fdae11ebb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5606c9736840 0x5606c9736c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.760+0000 7fdae11ebb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606c9737cc0 0x5606c97866c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.760+0000 7fdae11ebb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9786c00 0x5606c9787050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.760+0000 7fdae11ebb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c968da70 con 0x5606c9786c00 2023-10-06T02:23:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.760+0000 7fdae11ebb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c968b270 con 0x5606c9737cc0 2023-10-06T02:23:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.760+0000 7fdae11ebb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606c9687060 con 0x5606c9736840 2023-10-06T02:23:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.760+0000 7fdad6490700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9786c00 0x5606c9787050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.760+0000 7fdad6490700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9786c00 0x5606c9787050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42482/0 (socket says 172.21.15.37:42482) 2023-10-06T02:23:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.760+0000 7fdad6490700 1 -- 172.21.15.37:0/3886985571 learned_addr learned my addr 172.21.15.37:0/3886985571 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.760+0000 7fdad5c8f700 1 --2- 172.21.15.37:0/3886985571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5606c9736840 0x5606c9736c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.760+0000 7fdad548e700 1 --2- 172.21.15.37:0/3886985571 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606c9737cc0 0x5606c97866c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.760+0000 7fdad6490700 1 -- 172.21.15.37:0/3886985571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5606c9736840 msgr2=0x5606c9736c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.760+0000 7fdad6490700 1 --2- 172.21.15.37:0/3886985571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5606c9736840 0x5606c9736c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.760+0000 7fdad6490700 1 -- 172.21.15.37:0/3886985571 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606c9737cc0 msgr2=0x5606c97866c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.760+0000 7fdad6490700 1 --2- 172.21.15.37:0/3886985571 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606c9737cc0 0x5606c97866c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.760+0000 7fdad6490700 1 -- 172.21.15.37:0/3886985571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606c9521270 con 0x5606c9786c00 2023-10-06T02:23:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.760+0000 7fdad6490700 1 --2- 172.21.15.37:0/3886985571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9786c00 0x5606c9787050 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdad00b6510 tx=0x7fdac000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb09fda9adb41e30 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:33.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.760+0000 7fdab6ffd700 1 -- 172.21.15.37:0/3886985571 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac000e030 con 0x5606c9786c00 2023-10-06T02:23:33.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.760+0000 7fdab6ffd700 1 -- 172.21.15.37:0/3886985571 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac000f040 con 0x5606c9786c00 2023-10-06T02:23:33.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.761+0000 7fdab6ffd700 1 -- 172.21.15.37:0/3886985571 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac0017680 con 0x5606c9786c00 2023-10-06T02:23:33.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.761+0000 7fdae11ebb80 1 -- 172.21.15.37:0/3886985571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9786c00 msgr2=0x5606c9787050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:33.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.761+0000 7fdae11ebb80 1 --2- 172.21.15.37:0/3886985571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9786c00 0x5606c9787050 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdad00b6510 tx=0x7fdac000b040 comp rx=0 tx=0).stop 2023-10-06T02:23:33.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.761+0000 7fdae11ebb80 1 -- 172.21.15.37:0/3886985571 shutdown_connections 2023-10-06T02:23:33.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.761+0000 7fdae11ebb80 1 --2- 172.21.15.37:0/3886985571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9786c00 0x5606c9787050 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.761+0000 7fdae11ebb80 1 --2- 172.21.15.37:0/3886985571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5606c9736840 0x5606c9736c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.761+0000 7fdae11ebb80 1 --2- 172.21.15.37:0/3886985571 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606c9737cc0 0x5606c97866c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.761+0000 7fdae11ebb80 1 -- 172.21.15.37:0/3886985571 >> 172.21.15.37:0/3886985571 conn(0x5606c9738160 msgr2=0x5606c9738530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:33.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.761+0000 7fdae11ebb80 1 -- 172.21.15.37:0/3886985571 shutdown_connections 2023-10-06T02:23:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.761+0000 7fdae11ebb80 1 -- 172.21.15.37:0/3886985571 wait complete. 2023-10-06T02:23:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.762+0000 7fdae11ebb80 1 -- start start 2023-10-06T02:23:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.762+0000 7fdae11ebb80 1 Processor -- start 2023-10-06T02:23:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdae11ebb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 0x5606c975e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdae11ebb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606c9737cc0 0x5606c975e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdae11ebb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5606c9786c00 0x5606c97786c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdae11ebb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c9632890 con 0x5606c9736840 2023-10-06T02:23:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdae11ebb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c964dea0 con 0x5606c9737cc0 2023-10-06T02:23:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdae11ebb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606c9509e30 con 0x5606c9786c00 2023-10-06T02:23:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdae11ebb80 10 client.0 _ll_register_callbacks cb 0x5606c96f9e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:23:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdad5c8f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 0x5606c975e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdad5c8f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 0x5606c975e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42492/0 (socket says 172.21.15.37:42492) 2023-10-06T02:23:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdad5c8f700 1 -- 172.21.15.37:0/974233772 learned_addr learned my addr 172.21.15.37:0/974233772 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdad548e700 1 --2- 172.21.15.37:0/974233772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606c9737cc0 0x5606c975e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdad6490700 1 --2- 172.21.15.37:0/974233772 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5606c9786c00 0x5606c97786c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdad5c8f700 1 -- 172.21.15.37:0/974233772 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5606c9786c00 msgr2=0x5606c97786c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdad5c8f700 1 --2- 172.21.15.37:0/974233772 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5606c9786c00 0x5606c97786c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdad5c8f700 1 -- 172.21.15.37:0/974233772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606c9737cc0 msgr2=0x5606c975e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdad5c8f700 1 --2- 172.21.15.37:0/974233772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606c9737cc0 0x5606c975e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdad5c8f700 1 -- 172.21.15.37:0/974233772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606c94c3fe0 con 0x5606c9736840 2023-10-06T02:23:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdad5c8f700 1 --2- 172.21.15.37:0/974233772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 0x5606c975e170 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdac800a040 tx=0x7fdac8082f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8ec49b05e39781 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdaaffff700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:23:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdaaffff700 1 -- 172.21.15.37:0/974233772 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac805c980 con 0x5606c9736840 2023-10-06T02:23:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdaaffff700 1 -- 172.21.15.37:0/974233772 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdac8054ed0 con 0x5606c9736840 2023-10-06T02:23:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdae11ebb80 1 -- 172.21.15.37:0/974233772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5606c972b940 con 0x5606c9736840 2023-10-06T02:23:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdaaffff700 1 -- 172.21.15.37:0/974233772 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdac805c4f0 con 0x5606c9736840 2023-10-06T02:23:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdae11ebb80 10 client.4674 fetch_fsmap learned FSMap version 7 2023-10-06T02:23:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.763+0000 7fdae11ebb80 1 -- 172.21.15.37:0/974233772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5606c9655780 con 0x5606c9736840 2023-10-06T02:23:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.764+0000 7fdaaffff700 1 -- 172.21.15.37:0/974233772 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5606c972b940 con 0x5606c9736840 2023-10-06T02:23:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.764+0000 7fdaaffff700 1 -- 172.21.15.37:0/974233772 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdac80517d0 con 0x5606c9736840 2023-10-06T02:23:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.764+0000 7fdae11ebb80 10 client.4674 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T02:23:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.764+0000 7fdae11ebb80 10 client.4674 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T02:23:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.764+0000 7fdae11ebb80 20 client.4674 populate_metadata read hostname 'smithi037' 2023-10-06T02:23:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.764+0000 7fdae11ebb80 1 --2- 172.21.15.37:0/974233772 >> [v2:172.21.15.191:6834/1723334905,v1:172.21.15.191:6835/1723334905] conn(0x5606c9766bd0 0x5606c9776120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.764+0000 7fdae11ebb80 4 client.4674 mds_command: new command op to 4288 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:23:33.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.764+0000 7fdae11ebb80 1 -- 172.21.15.37:0/974233772 --> [v2:172.21.15.191:6834/1723334905,v1:172.21.15.191:6835/1723334905] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5606c9708870 con 0x5606c9766bd0 2023-10-06T02:23:33.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.764+0000 7fdad548e700 1 --2- 172.21.15.37:0/974233772 >> [v2:172.21.15.191:6834/1723334905,v1:172.21.15.191:6835/1723334905] conn(0x5606c9766bd0 0x5606c9776120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.764+0000 7fdaaffff700 10 client.4674 ms_handle_connect on v2:172.21.15.191:6834/1723334905 2023-10-06T02:23:33.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.764+0000 7fdad548e700 1 --2- 172.21.15.37:0/974233772 >> [v2:172.21.15.191:6834/1723334905,v1:172.21.15.191:6835/1723334905] conn(0x5606c9766bd0 0x5606c9776120 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21e9e19d7c0f761d server_cookie=cfb2effe1a8bbef5 in_seq=0 out_seq=0 2023-10-06T02:23:33.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.765+0000 7fdaaffff700 1 -- 172.21.15.37:0/974233772 <== mds.0 v2:172.21.15.191:6834/1723334905 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5606c9708870 con 0x5606c9766bd0 2023-10-06T02:23:33.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.765+0000 7fdaaffff700 10 client.4674 handle_command_reply: tid=0 2023-10-06T02:23:33.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.765+0000 7fdae11ebb80 1 client.4674 shutdown 2023-10-06T02:23:33.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.765+0000 7fdae11ebb80 1 -- 172.21.15.37:0/974233772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 msgr2=0x5606c975e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:33.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.765+0000 7fdae11ebb80 1 --2- 172.21.15.37:0/974233772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 0x5606c975e170 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdac800a040 tx=0x7fdac8082f30 comp rx=0 tx=0).stop 2023-10-06T02:23:33.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.765+0000 7fdae11ebb80 1 -- 172.21.15.37:0/974233772 shutdown_connections 2023-10-06T02:23:33.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.765+0000 7fdae11ebb80 1 --2- 172.21.15.37:0/974233772 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5606c9786c00 0x5606c97786c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.765+0000 7fdae11ebb80 1 --2- 172.21.15.37:0/974233772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 0x5606c975e170 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.765+0000 7fdae11ebb80 1 --2- 172.21.15.37:0/974233772 >> [v2:172.21.15.191:6834/1723334905,v1:172.21.15.191:6835/1723334905] conn(0x5606c9766bd0 0x5606c9776120 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.765+0000 7fdae11ebb80 1 --2- 172.21.15.37:0/974233772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606c9737cc0 0x5606c975e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.765+0000 7fdae11ebb80 1 -- 172.21.15.37:0/974233772 >> 172.21.15.37:0/974233772 conn(0x5606c9738160 msgr2=0x5606c9731a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.765+0000 7fdaaffff700 0 client.4674 ms_handle_reset on v2:172.21.15.191:6834/1723334905 2023-10-06T02:23:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.765+0000 7fdae11ebb80 1 -- 172.21.15.37:0/974233772 shutdown_connections 2023-10-06T02:23:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.765+0000 7fdae11ebb80 1 -- 172.21.15.37:0/974233772 wait complete. 2023-10-06T02:23:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.765+0000 7fdae11ebb80 20 client.4674 trim_cache size 0 max 16384 2023-10-06T02:23:33.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.782+0000 7fdae11ebb80 1 Processor -- start 2023-10-06T02:23:33.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.783+0000 7fdae11ebb80 1 -- start start 2023-10-06T02:23:33.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.783+0000 7fdae11ebb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5606c9738160 0x5606c977ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.783+0000 7fdae11ebb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 0x5606c97778b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.783+0000 7fdae11ebb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606c9737cc0 0x5606c975e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.783+0000 7fdae11ebb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c9736f00 con 0x5606c9736840 2023-10-06T02:23:33.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.783+0000 7fdae11ebb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c97375a0 con 0x5606c9737cc0 2023-10-06T02:23:33.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.783+0000 7fdae11ebb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606c97371b0 con 0x5606c9738160 2023-10-06T02:23:33.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.783+0000 7fdad548e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 0x5606c97778b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.783+0000 7fdad548e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 0x5606c97778b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42500/0 (socket says 172.21.15.37:42500) 2023-10-06T02:23:33.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.783+0000 7fdad548e700 1 -- 172.21.15.37:0/778405607 learned_addr learned my addr 172.21.15.37:0/778405607 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:33.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.784+0000 7fdad548e700 1 -- 172.21.15.37:0/778405607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5606c9738160 msgr2=0x5606c977ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:33.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.784+0000 7fdad5c8f700 1 --2- 172.21.15.37:0/778405607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5606c9738160 0x5606c977ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.784+0000 7fdad6490700 1 --2- 172.21.15.37:0/778405607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606c9737cc0 0x5606c975e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.784+0000 7fdad548e700 1 --2- 172.21.15.37:0/778405607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5606c9738160 0x5606c977ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.784+0000 7fdad548e700 1 -- 172.21.15.37:0/778405607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606c9737cc0 msgr2=0x5606c975e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:33.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.784+0000 7fdad548e700 1 --2- 172.21.15.37:0/778405607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606c9737cc0 0x5606c975e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.784+0000 7fdad548e700 1 -- 172.21.15.37:0/778405607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606c963c470 con 0x5606c9736840 2023-10-06T02:23:33.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.784+0000 7fdad548e700 1 --2- 172.21.15.37:0/778405607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 0x5606c97778b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdac4011000 tx=0x7fdac4034250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd371c32659425 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:33.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.784+0000 7fdab77fe700 1 -- 172.21.15.37:0/778405607 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4033070 con 0x5606c9736840 2023-10-06T02:23:33.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.784+0000 7fdab77fe700 1 -- 172.21.15.37:0/778405607 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac4005910 con 0x5606c9736840 2023-10-06T02:23:33.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.784+0000 7fdab77fe700 1 -- 172.21.15.37:0/778405607 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4025040 con 0x5606c9736840 2023-10-06T02:23:33.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.784+0000 7fdae11ebb80 1 -- 172.21.15.37:0/778405607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 msgr2=0x5606c97778b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:33.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.784+0000 7fdae11ebb80 1 --2- 172.21.15.37:0/778405607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 0x5606c97778b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdac4011000 tx=0x7fdac4034250 comp rx=0 tx=0).stop 2023-10-06T02:23:33.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.784+0000 7fdae11ebb80 1 -- 172.21.15.37:0/778405607 shutdown_connections 2023-10-06T02:23:33.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.784+0000 7fdae11ebb80 1 --2- 172.21.15.37:0/778405607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606c9737cc0 0x5606c975e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.784+0000 7fdae11ebb80 1 --2- 172.21.15.37:0/778405607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5606c9738160 0x5606c977ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.784+0000 7fdae11ebb80 1 --2- 172.21.15.37:0/778405607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 0x5606c97778b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.784+0000 7fdae11ebb80 1 -- 172.21.15.37:0/778405607 >> 172.21.15.37:0/778405607 conn(0x5606c9734d70 msgr2=0x5606c978d640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:33.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.784+0000 7fdae11ebb80 1 -- 172.21.15.37:0/778405607 shutdown_connections 2023-10-06T02:23:33.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.784+0000 7fdae11ebb80 1 -- 172.21.15.37:0/778405607 wait complete. 2023-10-06T02:23:33.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.785+0000 7fdae11ebb80 1 -- start start 2023-10-06T02:23:33.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.785+0000 7fdae11ebb80 1 Processor -- start 2023-10-06T02:23:33.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.786+0000 7fdae11ebb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 0x5606c97d5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.786+0000 7fdae11ebb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5606c9737cc0 0x5606c9777a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.786+0000 7fdae11ebb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606c9738160 0x5606c9774b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.786+0000 7fdae11ebb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c9785c20 con 0x5606c9736840 2023-10-06T02:23:33.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.786+0000 7fdae11ebb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c97812a0 con 0x5606c9738160 2023-10-06T02:23:33.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.786+0000 7fdae11ebb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606c9782100 con 0x5606c9737cc0 2023-10-06T02:23:33.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.786+0000 7fdae11ebb80 10 client.0 _ll_register_callbacks cb 0x5606c96f9e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:23:33.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.786+0000 7fdad5c8f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 0x5606c97d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.786+0000 7fdad5c8f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 0x5606c97d5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42510/0 (socket says 172.21.15.37:42510) 2023-10-06T02:23:33.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.786+0000 7fdad5c8f700 1 -- 172.21.15.37:0/352180593 learned_addr learned my addr 172.21.15.37:0/352180593 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:33.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.786+0000 7fdad6490700 1 --2- 172.21.15.37:0/352180593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606c9738160 0x5606c9774b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.786+0000 7fdad548e700 1 --2- 172.21.15.37:0/352180593 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5606c9737cc0 0x5606c9777a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.786+0000 7fdad5c8f700 1 -- 172.21.15.37:0/352180593 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5606c9737cc0 msgr2=0x5606c9777a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:33.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.786+0000 7fdad5c8f700 1 --2- 172.21.15.37:0/352180593 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5606c9737cc0 0x5606c9777a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.786+0000 7fdad5c8f700 1 -- 172.21.15.37:0/352180593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606c9738160 msgr2=0x5606c9774b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:33.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.786+0000 7fdad5c8f700 1 --2- 172.21.15.37:0/352180593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606c9738160 0x5606c9774b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.786+0000 7fdad5c8f700 1 -- 172.21.15.37:0/352180593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab8003570 con 0x5606c9736840 2023-10-06T02:23:33.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.786+0000 7fdad5c8f700 1 --2- 172.21.15.37:0/352180593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 0x5606c97d5c20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdac8058d20 tx=0x7fdac806b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ccd9f58ac259c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:33.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.786+0000 7fdaaffff700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:23:33.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.787+0000 7fdaaffff700 1 -- 172.21.15.37:0/352180593 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac805c980 con 0x5606c9736840 2023-10-06T02:23:33.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.787+0000 7fdaaffff700 1 -- 172.21.15.37:0/352180593 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdac8054ed0 con 0x5606c9736840 2023-10-06T02:23:33.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.787+0000 7fdae11ebb80 1 -- 172.21.15.37:0/352180593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdac000f040 con 0x5606c9736840 2023-10-06T02:23:33.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.787+0000 7fdaaffff700 1 -- 172.21.15.37:0/352180593 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdac8055520 con 0x5606c9736840 2023-10-06T02:23:33.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.787+0000 7fdae11ebb80 10 client.4680 fetch_fsmap learned FSMap version 7 2023-10-06T02:23:33.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.787+0000 7fdae11ebb80 1 -- 172.21.15.37:0/352180593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5606c94ebf80 con 0x5606c9736840 2023-10-06T02:23:33.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.787+0000 7fdaaffff700 1 -- 172.21.15.37:0/352180593 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac000f040 con 0x5606c9736840 2023-10-06T02:23:33.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.787+0000 7fdaaffff700 1 -- 172.21.15.37:0/352180593 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdac805cbd0 con 0x5606c9736840 2023-10-06T02:23:33.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.787+0000 7fdae11ebb80 10 client.4680 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T02:23:33.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.787+0000 7fdae11ebb80 10 client.4680 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T02:23:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.787+0000 7fdae11ebb80 20 client.4680 populate_metadata read hostname 'smithi037' 2023-10-06T02:23:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.787+0000 7fdae11ebb80 1 --2- 172.21.15.37:0/352180593 >> [v2:172.21.15.191:6834/1723334905,v1:172.21.15.191:6835/1723334905] conn(0x5606c9786c00 0x5606c9776170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.787+0000 7fdae11ebb80 4 client.4680 mds_command: new command op to 4288 tid=0[{"prefix": "status"}] 2023-10-06T02:23:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.787+0000 7fdae11ebb80 1 -- 172.21.15.37:0/352180593 --> [v2:172.21.15.191:6834/1723334905,v1:172.21.15.191:6835/1723334905] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5606c9629e00 con 0x5606c9786c00 2023-10-06T02:23:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.787+0000 7fdad548e700 1 --2- 172.21.15.37:0/352180593 >> [v2:172.21.15.191:6834/1723334905,v1:172.21.15.191:6835/1723334905] conn(0x5606c9786c00 0x5606c9776170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.788+0000 7fdaaffff700 10 client.4680 ms_handle_connect on v2:172.21.15.191:6834/1723334905 2023-10-06T02:23:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.788+0000 7fdad548e700 1 --2- 172.21.15.37:0/352180593 >> [v2:172.21.15.191:6834/1723334905,v1:172.21.15.191:6835/1723334905] conn(0x5606c9786c00 0x5606c9776170 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aec9284b75c74a8 server_cookie=bf0948e0f8fe8f2 in_seq=0 out_seq=0 2023-10-06T02:23:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.788+0000 7fdaaffff700 1 -- 172.21.15.37:0/352180593 <== mds.0 v2:172.21.15.191:6834/1723334905 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5606c9629e00 con 0x5606c9786c00 2023-10-06T02:23:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.788+0000 7fdaaffff700 10 client.4680 handle_command_reply: tid=0 2023-10-06T02:23:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.788+0000 7fdae11ebb80 1 client.4680 shutdown 2023-10-06T02:23:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.788+0000 7fdae11ebb80 1 -- 172.21.15.37:0/352180593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 msgr2=0x5606c97d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.788+0000 7fdae11ebb80 1 --2- 172.21.15.37:0/352180593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 0x5606c97d5c20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdac8058d20 tx=0x7fdac806b000 comp rx=0 tx=0).stop 2023-10-06T02:23:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.788+0000 7fdae11ebb80 1 -- 172.21.15.37:0/352180593 shutdown_connections 2023-10-06T02:23:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.788+0000 7fdae11ebb80 1 --2- 172.21.15.37:0/352180593 >> [v2:172.21.15.191:6834/1723334905,v1:172.21.15.191:6835/1723334905] conn(0x5606c9786c00 0x5606c9776170 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.788+0000 7fdae11ebb80 1 --2- 172.21.15.37:0/352180593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5606c9738160 0x5606c9774b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.788+0000 7fdaaffff700 0 client.4680 ms_handle_reset on v2:172.21.15.191:6834/1723334905 2023-10-06T02:23:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.788+0000 7fdae11ebb80 1 --2- 172.21.15.37:0/352180593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606c9736840 0x5606c97d5c20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.788+0000 7fdae11ebb80 1 --2- 172.21.15.37:0/352180593 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5606c9737cc0 0x5606c9777a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.788+0000 7fdae11ebb80 1 -- 172.21.15.37:0/352180593 >> 172.21.15.37:0/352180593 conn(0x5606c9734d70 msgr2=0x5606c97d88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.788+0000 7fdae11ebb80 1 -- 172.21.15.37:0/352180593 shutdown_connections 2023-10-06T02:23:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.788+0000 7fdae11ebb80 1 -- 172.21.15.37:0/352180593 wait complete. 2023-10-06T02:23:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.788+0000 7fdae11ebb80 20 client.4680 trim_cache size 0 max 16384 2023-10-06T02:23:33.797 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:23:33.797 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "d1f292a2-fd8c-430a-be88-f44de408e77c", 2023-10-06T02:23:33.797 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-10-06T02:23:33.797 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4288, 2023-10-06T02:23:33.797 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-10-06T02:23:33.797 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-10-06T02:23:33.797 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-10-06T02:23:33.797 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 17.903358690000001, 2023-10-06T02:23:33.797 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 7, 2023-10-06T02:23:33.798 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 20, 2023-10-06T02:23:33.798 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 20, 2023-10-06T02:23:33.798 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 23.854003738999999 2023-10-06T02:23:33.798 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:23:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.789+0000 7fdad7ef3700 1 -- 172.21.15.37:0/1351715340 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdabc066f30 msgr2=0x7fdabc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.789+0000 7fdad7ef3700 1 --2- 172.21.15.37:0/1351715340 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdabc066f30 0x7fdabc0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdac4007cf0 tx=0x7fdac4015000 comp rx=0 tx=0).stop 2023-10-06T02:23:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.789+0000 7fdad7ef3700 1 -- 172.21.15.37:0/1351715340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdab8004810 msgr2=0x7fdad016a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.789+0000 7fdad7ef3700 1 --2- 172.21.15.37:0/1351715340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdab8004810 0x7fdad016a180 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdac8002b30 tx=0x7fdac8007d10 comp rx=0 tx=0).stop 2023-10-06T02:23:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.789+0000 7fdad7ef3700 1 -- 172.21.15.37:0/1351715340 shutdown_connections 2023-10-06T02:23:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.789+0000 7fdad7ef3700 1 --2- 172.21.15.37:0/1351715340 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdad0168e50 0x7fdad00b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.789+0000 7fdad7ef3700 1 --2- 172.21.15.37:0/1351715340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdab8004810 0x7fdad016a180 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.789+0000 7fdad7ef3700 1 --2- 172.21.15.37:0/1351715340 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdabc066f30 0x7fdabc0693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.789+0000 7fdad7ef3700 1 --2- 172.21.15.37:0/1351715340 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdad016a8d0 0x7fdad0167340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:33.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.789+0000 7fdad7ef3700 1 -- 172.21.15.37:0/1351715340 >> 172.21.15.37:0/1351715340 conn(0x7fdad00d0510 msgr2=0x7fdad015bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:33.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.789+0000 7fdad7ef3700 1 -- 172.21.15.37:0/1351715340 shutdown_connections 2023-10-06T02:23:33.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:33.789+0000 7fdad7ef3700 1 -- 172.21.15.37:0/1351715340 wait complete. 2023-10-06T02:23:33.801 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-06T02:23:33.823 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-06T02:23:33.823 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T02:23:33.823 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-06T02:23:33.823 INFO:tasks.ceph_fuse:client.2 config is {} 2023-10-06T02:23:33.823 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-06T02:23:33.823 INFO:tasks.ceph_fuse:client.3 config is {} 2023-10-06T02:23:33.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:33.824 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T02:23:33.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:33.839 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-10-06T02:23:33.906 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2023-10-06T02:23:33.907 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:23:33.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:33.907 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2023-10-06T02:23:33.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:33.926 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link delete ceph-brx 2023-10-06T02:23:33.996 INFO:teuthology.orchestra.run.smithi191.stderr:Cannot find device "ceph-brx" 2023-10-06T02:23:33.997 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:23:33.998 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-06T02:23:33.998 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:23:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.117+0000 7f13ff424700 1 Processor -- start 2023-10-06T02:23:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.117+0000 7f13ff424700 1 -- start start 2023-10-06T02:23:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.118+0000 7f13ff424700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13f80c63a0 0x7f13f815daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.118+0000 7f13ff424700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13f815dfe0 0x7f13f80cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.118+0000 7f13ff424700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f80cb650 con 0x7f13f8159760 2023-10-06T02:23:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.118+0000 7f13ff424700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f80cc2d0 con 0x7f13f80c63a0 2023-10-06T02:23:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.118+0000 7f13ff424700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f80cb930 con 0x7f13f815dfe0 2023-10-06T02:23:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.118+0000 7f13fc9bf700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13f80c63a0 0x7f13f815daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.118+0000 7f13fc9bf700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13f80c63a0 0x7f13f815daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42524/0 (socket says 172.21.15.37:42524) 2023-10-06T02:23:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.118+0000 7f13fc9bf700 1 -- 172.21.15.37:0/3904595579 learned_addr learned my addr 172.21.15.37:0/3904595579 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.118+0000 7f13fc9bf700 1 -- 172.21.15.37:0/3904595579 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13f815dfe0 msgr2=0x7f13f80cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.118+0000 7f13fc9bf700 1 --2- 172.21.15.37:0/3904595579 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13f815dfe0 0x7f13f80cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.118+0000 7f13fc9bf700 1 -- 172.21.15.37:0/3904595579 >> v1:172.21.15.191:6789/0 conn(0x7f13f8159760 legacy=0x7f13f815d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.118+0000 7f13fc9bf700 1 -- 172.21.15.37:0/3904595579 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f80cbc10 con 0x7f13f80c63a0 2023-10-06T02:23:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.118+0000 7f13fc9bf700 1 --2- 172.21.15.37:0/3904595579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f80c63a0 0x7f13f815daa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f13f40099b0 tx=0x7f13f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134330bff35eace9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.118+0000 7f13effff700 1 -- 172.21.15.37:0/3904595579 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f400b8b0 con 0x7f13f80c63a0 2023-10-06T02:23:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.119+0000 7f13effff700 1 -- 172.21.15.37:0/3904595579 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f400ba10 con 0x7f13f80c63a0 2023-10-06T02:23:34.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.119+0000 7f13effff700 1 -- 172.21.15.37:0/3904595579 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f400bdb0 con 0x7f13f80c63a0 2023-10-06T02:23:34.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.119+0000 7f13ff424700 1 -- 172.21.15.37:0/3904595579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f80c63a0 msgr2=0x7f13f815daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.119+0000 7f13ff424700 1 --2- 172.21.15.37:0/3904595579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f80c63a0 0x7f13f815daa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f13f40099b0 tx=0x7f13f4009250 comp rx=0 tx=0).stop 2023-10-06T02:23:34.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.119+0000 7f13ff424700 1 -- 172.21.15.37:0/3904595579 shutdown_connections 2023-10-06T02:23:34.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.119+0000 7f13ff424700 1 --2- 172.21.15.37:0/3904595579 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13f815dfe0 0x7f13f80cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.119+0000 7f13ff424700 1 --2- 172.21.15.37:0/3904595579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f80c63a0 0x7f13f815daa0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.119+0000 7f13ff424700 1 -- 172.21.15.37:0/3904595579 >> 172.21.15.37:0/3904595579 conn(0x7f13f806c890 msgr2=0x7f13f80d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:34.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.119+0000 7f13ff424700 1 -- 172.21.15.37:0/3904595579 shutdown_connections 2023-10-06T02:23:34.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.119+0000 7f13ff424700 1 -- 172.21.15.37:0/3904595579 wait complete. 2023-10-06T02:23:34.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.120+0000 7f13ff424700 1 Processor -- start 2023-10-06T02:23:34.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.120+0000 7f13ff424700 1 -- start start 2023-10-06T02:23:34.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.121+0000 7f13ff424700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13f80c63a0 0x7f13f8155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.121+0000 7f13ff424700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13f8159760 0x7f13f81423c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.121+0000 7f13ff424700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f815dfe0 0x7f13f815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.121+0000 7f13ff424700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f80b4780 con 0x7f13f815dfe0 2023-10-06T02:23:34.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.121+0000 7f13ff424700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f80b5300 con 0x7f13f8159760 2023-10-06T02:23:34.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.121+0000 7f13ff424700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f80b5790 con 0x7f13f80c63a0 2023-10-06T02:23:34.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.121+0000 7f13fd9c1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f815dfe0 0x7f13f815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.121+0000 7f13fd9c1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f815dfe0 0x7f13f815a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42532/0 (socket says 172.21.15.37:42532) 2023-10-06T02:23:34.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.121+0000 7f13fd9c1700 1 -- 172.21.15.37:0/906049474 learned_addr learned my addr 172.21.15.37:0/906049474 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:34.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.121+0000 7f13fc9bf700 1 --2- 172.21.15.37:0/906049474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13f8159760 0x7f13f81423c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.121+0000 7f13fd1c0700 1 --2- 172.21.15.37:0/906049474 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13f80c63a0 0x7f13f8155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.122+0000 7f13fd9c1700 1 -- 172.21.15.37:0/906049474 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13f80c63a0 msgr2=0x7f13f8155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.122+0000 7f13fd9c1700 1 --2- 172.21.15.37:0/906049474 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13f80c63a0 0x7f13f8155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.122+0000 7f13fd9c1700 1 -- 172.21.15.37:0/906049474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13f8159760 msgr2=0x7f13f81423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.122+0000 7f13fd9c1700 1 --2- 172.21.15.37:0/906049474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13f8159760 0x7f13f81423c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.122+0000 7f13fd9c1700 1 -- 172.21.15.37:0/906049474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f40094f0 con 0x7f13f815dfe0 2023-10-06T02:23:34.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.122+0000 7f13fc9bf700 1 --2- 172.21.15.37:0/906049474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13f8159760 0x7f13f81423c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:34.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.122+0000 7f13fd9c1700 1 --2- 172.21.15.37:0/906049474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f815dfe0 0x7f13f815a1e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f13f000bc30 tx=0x7f13f0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:34.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.122+0000 7f13ed7fa700 1 -- 172.21.15.37:0/906049474 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f00092e0 con 0x7f13f815dfe0 2023-10-06T02:23:34.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.122+0000 7f13ed7fa700 1 -- 172.21.15.37:0/906049474 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f000c7a0 con 0x7f13f815dfe0 2023-10-06T02:23:34.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.122+0000 7f13ff424700 1 -- 172.21.15.37:0/906049474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f80b49d0 con 0x7f13f815dfe0 2023-10-06T02:23:34.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.122+0000 7f13ed7fa700 1 -- 172.21.15.37:0/906049474 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f000cb80 con 0x7f13f815dfe0 2023-10-06T02:23:34.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.122+0000 7f13ff424700 1 -- 172.21.15.37:0/906049474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f80b4f90 con 0x7f13f815dfe0 2023-10-06T02:23:34.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.123+0000 7f13ff424700 1 -- 172.21.15.37:0/906049474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f80ca110 con 0x7f13f815dfe0 2023-10-06T02:23:34.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.124+0000 7f13ed7fa700 1 -- 172.21.15.37:0/906049474 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13f0012070 con 0x7f13f815dfe0 2023-10-06T02:23:34.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.124+0000 7f13ed7fa700 1 --2- 172.21.15.37:0/906049474 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f13dc066f30 0x7f13dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:34.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.124+0000 7f13ed7fa700 1 -- 172.21.15.37:0/906049474 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f13f0084470 con 0x7f13f815dfe0 2023-10-06T02:23:34.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.124+0000 7f13fd1c0700 1 --2- 172.21.15.37:0/906049474 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f13dc066f30 0x7f13dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:34.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.125+0000 7f13fd1c0700 1 --2- 172.21.15.37:0/906049474 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f13dc066f30 0x7f13dc0693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f13e800a8c0 tx=0x7f13e8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:34.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.128+0000 7f13ed7fa700 1 -- 172.21.15.37:0/906049474 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13f004d5a0 con 0x7f13f815dfe0 2023-10-06T02:23:34.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.368+0000 7f13ff424700 1 -- 172.21.15.37:0/906049474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f13f80b5470 con 0x7f13f815dfe0 2023-10-06T02:23:34.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.368+0000 7f13ed7fa700 1 -- 172.21.15.37:0/906049474 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f13f0055090 con 0x7f13f815dfe0 2023-10-06T02:23:34.370 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:23:34.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.371+0000 7f13ff424700 1 -- 172.21.15.37:0/906049474 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f13dc066f30 msgr2=0x7f13dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.371+0000 7f13ff424700 1 --2- 172.21.15.37:0/906049474 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f13dc066f30 0x7f13dc0693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f13e800a8c0 tx=0x7f13e8008040 comp rx=0 tx=0).stop 2023-10-06T02:23:34.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.371+0000 7f13ff424700 1 -- 172.21.15.37:0/906049474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f815dfe0 msgr2=0x7f13f815a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:34.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.371+0000 7f13ff424700 1 --2- 172.21.15.37:0/906049474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f815dfe0 0x7f13f815a1e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f13f000bc30 tx=0x7f13f0009840 comp rx=0 tx=0).stop 2023-10-06T02:23:34.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.371+0000 7f13ff424700 1 -- 172.21.15.37:0/906049474 shutdown_connections 2023-10-06T02:23:34.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.371+0000 7f13ff424700 1 --2- 172.21.15.37:0/906049474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f815dfe0 0x7f13f815a1e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.371+0000 7f13ff424700 1 --2- 172.21.15.37:0/906049474 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13f80c63a0 0x7f13f8155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.371+0000 7f13ff424700 1 --2- 172.21.15.37:0/906049474 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f13dc066f30 0x7f13dc0693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.371+0000 7f13ff424700 1 --2- 172.21.15.37:0/906049474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13f8159760 0x7f13f81423c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:34.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.371+0000 7f13ff424700 1 -- 172.21.15.37:0/906049474 >> 172.21.15.37:0/906049474 conn(0x7f13f806c890 msgr2=0x7f13f8153b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:34.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.371+0000 7f13ff424700 1 -- 172.21.15.37:0/906049474 shutdown_connections 2023-10-06T02:23:34.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:34.371+0000 7f13ff424700 1 -- 172.21.15.37:0/906049474 wait complete. 2023-10-06T02:23:34.383 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:23:34.383 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:23:34.383 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-10-06T02:23:34.383 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:23:34.383 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:23:34.383 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:23:34.383 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:23:34.383 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:23:34.383 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:23:34.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:34.385 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-10-06T02:23:34.400 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:23:34.400 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:23:34.400 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:23:34.400 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:34.400 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T02:23:34.400 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:34.400 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:23:34.400 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:34.400 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-10-06T02:23:34.400 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42467sec preferred_lft 42467sec 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:34.401 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-10-06T02:23:34.402 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T02:23:34.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:34.402 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T02:23:34.402 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T02:23:34.402 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2023-10-06T02:23:34.402 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2023-10-06T02:23:34.402 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2023-10-06T02:23:34.402 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T02:23:34.403 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T02:23:34.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:34.559 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:23:34.603 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T02:23:34.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:34.605 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-10-06T02:23:34.631 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-10-06T02:23:34.631 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:23:34.631 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:23:34.631 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:23:34.631 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:23:34.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:34.632 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T02:23:34.632 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T02:23:34.632 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:23:34.632 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:23:34.632 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:23:34.632 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T02:23:34.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:34.903 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T02:23:34.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:34.919 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2023-10-06T02:23:34.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:34.974 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T02:23:34.974 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T02:23:34.974 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:23:34.974 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T02:23:34.975 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T02:23:35.065 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T02:23:35.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:35.065 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T02:23:35.065 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T02:23:35.065 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T02:23:35.066 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T02:23:35.066 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T02:23:35.066 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T02:23:35.066 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T02:23:35.066 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T02:23:35.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:35.245 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T02:23:35.245 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T02:23:35.245 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-10-06T02:23:35.245 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T02:23:35.245 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T02:23:35.338 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:23:35.339 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:23:35.339 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:23:35.354 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:23:35.354 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:23:35.355 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:23:35.409 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T02:23:35.476 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:23:35.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:23:35.540 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:23:35.541 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:23:35.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:35.542 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T02:23:35.597 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:23:35.597 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:23:35.639 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T02:23:35.664 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:23:35.664 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:23:35.728 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:23:35.729 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:23:35.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:35.730 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T02:23:35.746 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-10-06T02:23:35.746+0000 7f83e373e540 -1 init, newargv = 0x560e6bd0efa0 newargc=15 2023-10-06T02:23:35.746 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[99841]: starting ceph client 2023-10-06T02:23:35.751 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[99841]: starting fuse 2023-10-06T02:23:35.761 INFO:teuthology.orchestra.run.smithi037.stdout:46 2023-10-06T02:23:35.762 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T02:23:35.762 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:23:35.762 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-10-06T02:23:35.762 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-10-06T02:23:35.762 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:23:35.762 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-10-06T02:23:35.762 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:23:35.762 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-10-06T02:23:35.763 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:23:35.763 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-10-06T02:23:35.763 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:23:35.763 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:23:35.763 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-10-06T02:23:35.763 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-10-06T02:23:35.763 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-10-06T02:23:35.763 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-10-06T02:23:35.763 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:23:35.763 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-10-06T02:23:35.763 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:23:35.763 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:23:35.763 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:23:35.764 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-10-06T02:23:35.764 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-10-06T02:23:35.764 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-10-06T02:23:35.764 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:23:35.764 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:23:35.764 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-10-06T02:23:35.764 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:23:35.885 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.99841.asok 2023-10-06T02:23:36.067 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.99841.asok 2023-10-06T02:23:36.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:36.068 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.99841.asok status 2023-10-06T02:23:36.222 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:23:36.222 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-10-06T02:23:36.222 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:23:36.222 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:23:36.222 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-10-06T02:23:36.223 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-10-06T02:23:36.223 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:23:36.223 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "99841", 2023-10-06T02:23:36.223 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-10-06T02:23:36.223 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:23:36.224 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-10-06T02:23:36.224 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-10-06T02:23:36.224 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4692, 2023-10-06T02:23:36.224 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-10-06T02:23:36.224 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-10-06T02:23:36.225 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-10-06T02:23:36.225 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 4692 2023-10-06T02:23:36.225 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:23:36.225 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T02:23:36.225 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T02:23:36.225 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:23:36.225 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2449403560 2023-10-06T02:23:36.225 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:23:36.225 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:23:36.226 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T02:23:36.226 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T02:23:36.226 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:23:36.226 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2449403560 2023-10-06T02:23:36.226 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:23:36.226 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.4692 192.168.0.1:0/2449403560", 2023-10-06T02:23:36.226 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/2449403560", 2023-10-06T02:23:36.226 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-10-06T02:23:36.226 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 7, 2023-10-06T02:23:36.226 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 20, 2023-10-06T02:23:36.226 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:23:36.227 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-10-06T02:23:36.227 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-10-06T02:23:36.227 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:23:36.232 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:23:36.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.353+0000 7f3ef1063700 1 Processor -- start 2023-10-06T02:23:36.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.353+0000 7f3ef1063700 1 -- start start 2023-10-06T02:23:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.354+0000 7f3ef1063700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f3eec0b0620 0x7f3eec159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.354+0000 7f3ef1063700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eec0cb200 con 0x7f3eec0b2270 2023-10-06T02:23:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.354+0000 7f3ef1063700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eec0cb7c0 con 0x7f3eec159370 2023-10-06T02:23:36.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.354+0000 7f3ef1063700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eec0b5c00 con 0x7f3eec0b0620 2023-10-06T02:23:36.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.354+0000 7f3ef0862700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3eec0b2270 0x7f3eec0cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38286/0 (socket says 172.21.15.37:38286) 2023-10-06T02:23:36.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.354+0000 7f3ef0862700 1 -- 172.21.15.37:0/164732601 learned_addr learned my addr 172.21.15.37:0/164732601 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:36.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.354+0000 7f3eeb7fe700 1 --2- 172.21.15.37:0/164732601 >> v2:172.21.15.191:3300/0 conn(0x7f3eec0b0620 0x7f3eec159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:36.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.354+0000 7f3eeaffd700 1 -- 172.21.15.37:0/164732601 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288792255 0 0) 0x7f3eec0cb200 con 0x7f3eec0b2270 2023-10-06T02:23:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.354+0000 7f3eeaffd700 1 -- 172.21.15.37:0/164732601 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed8003570 con 0x7f3eec0b2270 2023-10-06T02:23:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.355+0000 7f3eeb7fe700 1 -- 172.21.15.37:0/164732601 >> v1:172.21.15.191:6789/0 conn(0x7f3eec159370 legacy=0x7f3eec0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.355+0000 7f3eeaffd700 1 -- 172.21.15.37:0/164732601 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3959963114 0 0) 0x7f3ed8003570 con 0x7f3eec0b2270 2023-10-06T02:23:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.355+0000 7f3eeb7fe700 1 -- 172.21.15.37:0/164732601 >> v1:172.21.15.37:6789/0 conn(0x7f3eec0b2270 legacy=0x7f3eec0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.355+0000 7f3eeb7fe700 1 -- 172.21.15.37:0/164732601 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec0b2750 con 0x7f3eec0b0620 2023-10-06T02:23:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.355+0000 7f3eeb7fe700 1 --2- 172.21.15.37:0/164732601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3eec0b0620 0x7f3eec159740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40098e0 tx=0x7f3ed40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f02edd95e8f397dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.355+0000 7f3eeaffd700 1 -- 172.21.15.37:0/164732601 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee40017f0 con 0x7f3eec0b0620 2023-10-06T02:23:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.355+0000 7f3eeaffd700 1 -- 172.21.15.37:0/164732601 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed4011420 con 0x7f3eec0b0620 2023-10-06T02:23:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.355+0000 7f3eeaffd700 1 -- 172.21.15.37:0/164732601 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed40117c0 con 0x7f3eec0b0620 2023-10-06T02:23:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.356+0000 7f3ef1063700 1 -- 172.21.15.37:0/164732601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3eec0b0620 msgr2=0x7f3eec159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.356+0000 7f3ef1063700 1 --2- 172.21.15.37:0/164732601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3eec0b0620 0x7f3eec159740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40098e0 tx=0x7f3ed40091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.356+0000 7f3ef1063700 1 -- 172.21.15.37:0/164732601 shutdown_connections 2023-10-06T02:23:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.356+0000 7f3ef1063700 1 --2- 172.21.15.37:0/164732601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3eec0b0620 0x7f3eec159740 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.356+0000 7f3ef1063700 1 -- 172.21.15.37:0/164732601 >> 172.21.15.37:0/164732601 conn(0x7f3eec06c0b0 msgr2=0x7f3eec06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.356+0000 7f3ef1063700 1 -- 172.21.15.37:0/164732601 shutdown_connections 2023-10-06T02:23:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.356+0000 7f3ef1063700 1 -- 172.21.15.37:0/164732601 wait complete. 2023-10-06T02:23:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.357+0000 7f3ef1063700 1 Processor -- start 2023-10-06T02:23:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.357+0000 7f3ef1063700 1 -- start start 2023-10-06T02:23:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.358+0000 7f3ef1063700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3eec0b0620 0x7f3eec151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.358+0000 7f3ef1063700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec0b2270 0x7f3eec15ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.358+0000 7f3ef1063700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3eec159370 0x7f3eec169c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.358+0000 7f3ef1063700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0ce070 con 0x7f3eec0b2270 2023-10-06T02:23:36.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.358+0000 7f3ef1063700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0ce350 con 0x7f3eec0b0620 2023-10-06T02:23:36.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.358+0000 7f3ef1063700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec16a6d0 con 0x7f3eec159370 2023-10-06T02:23:36.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.358+0000 7f3eeb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec0b2270 0x7f3eec15ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:36.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.358+0000 7f3eeb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec0b2270 0x7f3eec15ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56580/0 (socket says 172.21.15.37:56580) 2023-10-06T02:23:36.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.358+0000 7f3eeb7fe700 1 -- 172.21.15.37:0/1022537965 learned_addr learned my addr 172.21.15.37:0/1022537965 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:36.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.358+0000 7f3eebfff700 1 --2- 172.21.15.37:0/1022537965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3eec0b0620 0x7f3eec151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:36.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.358+0000 7f3ef0862700 1 --2- 172.21.15.37:0/1022537965 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3eec159370 0x7f3eec169c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:36.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.358+0000 7f3eeb7fe700 1 -- 172.21.15.37:0/1022537965 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3eec159370 msgr2=0x7f3eec169c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:36.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.358+0000 7f3eeb7fe700 1 --2- 172.21.15.37:0/1022537965 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3eec159370 0x7f3eec169c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:36.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.358+0000 7f3eeb7fe700 1 -- 172.21.15.37:0/1022537965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3eec0b0620 msgr2=0x7f3eec151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:36.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.358+0000 7f3eeb7fe700 1 --2- 172.21.15.37:0/1022537965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3eec0b0620 0x7f3eec151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:36.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.358+0000 7f3eeb7fe700 1 -- 172.21.15.37:0/1022537965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed4009420 con 0x7f3eec0b2270 2023-10-06T02:23:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.358+0000 7f3eebfff700 1 --2- 172.21.15.37:0/1022537965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3eec0b0620 0x7f3eec151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.358+0000 7f3eeb7fe700 1 --2- 172.21.15.37:0/1022537965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec0b2270 0x7f3eec15ab80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40030c0 tx=0x7f3ed4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.358+0000 7f3ee3fff700 1 -- 172.21.15.37:0/1022537965 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4010cf0 con 0x7f3eec0b2270 2023-10-06T02:23:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.358+0000 7f3ee3fff700 1 -- 172.21.15.37:0/1022537965 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed4010e70 con 0x7f3eec0b2270 2023-10-06T02:23:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.359+0000 7f3ef1063700 1 -- 172.21.15.37:0/1022537965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eec16a9b0 con 0x7f3eec0b2270 2023-10-06T02:23:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.359+0000 7f3ee3fff700 1 -- 172.21.15.37:0/1022537965 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed401d660 con 0x7f3eec0b2270 2023-10-06T02:23:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.359+0000 7f3ef1063700 1 -- 172.21.15.37:0/1022537965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eec0cfec0 con 0x7f3eec0b2270 2023-10-06T02:23:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.359+0000 7f3ef1063700 1 -- 172.21.15.37:0/1022537965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eec0ce500 con 0x7f3eec0b2270 2023-10-06T02:23:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.360+0000 7f3ee3fff700 1 -- 172.21.15.37:0/1022537965 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ed401d9d0 con 0x7f3eec0b2270 2023-10-06T02:23:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.360+0000 7f3ee3fff700 1 --2- 172.21.15.37:0/1022537965 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3ecc066f30 0x7f3ecc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.360+0000 7f3ee3fff700 1 -- 172.21.15.37:0/1022537965 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3ed4086560 con 0x7f3eec0b2270 2023-10-06T02:23:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.361+0000 7f3eebfff700 1 --2- 172.21.15.37:0/1022537965 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3ecc066f30 0x7f3ecc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.361+0000 7f3eebfff700 1 --2- 172.21.15.37:0/1022537965 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3ecc066f30 0x7f3ecc0693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3edc007fd0 tx=0x7f3edc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.365+0000 7f3ee3fff700 1 -- 172.21.15.37:0/1022537965 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3eec0ce500 con 0x7f3eec0b2270 2023-10-06T02:23:36.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.602+0000 7f3ef1063700 1 -- 172.21.15.37:0/1022537965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3eec0645f0 con 0x7f3eec0b2270 2023-10-06T02:23:36.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.603+0000 7f3ee3fff700 1 -- 172.21.15.37:0/1022537965 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3ed4053670 con 0x7f3eec0b2270 2023-10-06T02:23:36.603 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:23:36.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.604+0000 7f3ef1063700 1 -- 172.21.15.37:0/1022537965 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3ecc066f30 msgr2=0x7f3ecc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:36.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.604+0000 7f3ef1063700 1 --2- 172.21.15.37:0/1022537965 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3ecc066f30 0x7f3ecc0693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3edc007fd0 tx=0x7f3edc009040 comp rx=0 tx=0).stop 2023-10-06T02:23:36.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.604+0000 7f3ef1063700 1 -- 172.21.15.37:0/1022537965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec0b2270 msgr2=0x7f3eec15ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:36.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.604+0000 7f3ef1063700 1 --2- 172.21.15.37:0/1022537965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec0b2270 0x7f3eec15ab80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40030c0 tx=0x7f3ed4017000 comp rx=0 tx=0).stop 2023-10-06T02:23:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.604+0000 7f3ef1063700 1 -- 172.21.15.37:0/1022537965 shutdown_connections 2023-10-06T02:23:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.604+0000 7f3ef1063700 1 --2- 172.21.15.37:0/1022537965 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3eec159370 0x7f3eec169c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.604+0000 7f3ef1063700 1 --2- 172.21.15.37:0/1022537965 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3ecc066f30 0x7f3ecc0693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.604+0000 7f3ef1063700 1 --2- 172.21.15.37:0/1022537965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3eec0b0620 0x7f3eec151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.604+0000 7f3ef1063700 1 --2- 172.21.15.37:0/1022537965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec0b2270 0x7f3eec15ab80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.604+0000 7f3ef1063700 1 -- 172.21.15.37:0/1022537965 >> 172.21.15.37:0/1022537965 conn(0x7f3eec06c0b0 msgr2=0x7f3eec0c9300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.605+0000 7f3ef1063700 1 -- 172.21.15.37:0/1022537965 shutdown_connections 2023-10-06T02:23:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:36.605+0000 7f3ef1063700 1 -- 172.21.15.37:0/1022537965 wait complete. 2023-10-06T02:23:36.617 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:23:36.617 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:23:36.617 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-10-06T02:23:36.617 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T02:23:36.617 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T02:23:36.617 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:23:36.617 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:23:36.617 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:23:36.617 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T02:23:36.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:36.618 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-10-06T02:23:36.633 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:23:36.633 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:23:36.633 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:23:36.633 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:36.633 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T02:23:36.633 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:36.633 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:23:36.633 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:36.633 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-10-06T02:23:36.633 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:23:36.634 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:36.634 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-10-06T02:23:36.634 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:23:36.634 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42465sec preferred_lft 42465sec 2023-10-06T02:23:36.634 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-10-06T02:23:36.634 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:36.634 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:23:36.634 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:36.634 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-10-06T02:23:36.634 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:23:36.635 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:36.635 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-10-06T02:23:36.635 INFO:teuthology.orchestra.run.smithi037.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:23:36.635 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 36:fb:a9:50:59:76 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:36.635 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:23:36.635 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:36.635 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::a0fb:38ff:fe90:57e1/64 scope link 2023-10-06T02:23:36.635 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:36.635 INFO:teuthology.orchestra.run.smithi037.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:23:36.635 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 36:fb:a9:50:59:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:23:36.635 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::34fb:a9ff:fe50:5976/64 scope link 2023-10-06T02:23:36.636 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:36.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:36.636 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:23:36.697 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T02:23:36.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:36.699 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-10-06T02:23:36.756 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-10-06T02:23:36.756 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:23:36.756 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:23:36.756 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:23:36.757 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:23:36.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:36.757 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T02:23:36.757 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T02:23:36.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:23:36.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:23:36.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:23:36.758 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T02:23:36.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:36.858 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T02:23:36.873 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:23:36.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:36.873 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2023-10-06T02:23:36.927 INFO:teuthology.orchestra.run.smithi037.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T02:23:36.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:36.928 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T02:23:36.928 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T02:23:36.928 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:23:36.928 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T02:23:36.928 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T02:23:37.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:37.020 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T02:23:37.056 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:23:37.056 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:23:37.056 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:23:37.056 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:37.056 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T02:23:37.056 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:37.056 INFO:teuthology.orchestra.run.smithi037.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:23:37.056 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 1a:f2:61:2d:25:ce brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T02:23:37.057 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T02:23:37.057 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:37.057 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::18f2:61ff:fe2d:25ce/64 scope link 2023-10-06T02:23:37.057 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:37.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:37.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T02:23:37.138 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:23:37.138 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:23:37.138 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:23:37.138 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:37.138 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T02:23:37.138 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:37.138 INFO:teuthology.orchestra.run.smithi037.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:23:37.139 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 1a:f2:61:2d:25:ce brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T02:23:37.139 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T02:23:37.139 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:37.139 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::18f2:61ff:fe2d:25ce/64 scope link 2023-10-06T02:23:37.139 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:37.149 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T02:23:37.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:37.150 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T02:23:37.150 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T02:23:37.150 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T02:23:37.150 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T02:23:37.150 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T02:23:37.150 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T02:23:37.150 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T02:23:37.150 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T02:23:37.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:37.372 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T02:23:37.373 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T02:23:37.373 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.1 up 2023-10-06T02:23:37.373 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T02:23:37.373 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T02:23:37.466 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-10-06T02:23:37.466 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:23:37.466 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T02:23:37.481 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T02:23:37.482 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:23:37.482 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T02:23:37.536 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T02:23:37.602 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:23:37.602 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:23:37.667 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:23:37.668 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:23:37.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:37.668 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T02:23:37.724 INFO:teuthology.orchestra.run.smithi037.stdout:46 2023-10-06T02:23:37.724 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2023-10-06T02:23:37.725 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-10-06T02:23:37.767 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T02:23:37.792 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:23:37.792 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:23:37.850 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi037.stderr:2023-10-06T02:23:37.849+0000 7fea87996540 -1 init, newargv = 0x563a62fadb90 newargc=15 2023-10-06T02:23:37.850 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi037.stderr:ceph-fuse[100370]: starting ceph client 2023-10-06T02:23:37.855 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi037.stderr:ceph-fuse[100370]: starting fuse 2023-10-06T02:23:37.858 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:23:37.859 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:23:37.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:37.859 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T02:23:37.915 INFO:teuthology.orchestra.run.smithi037.stdout:46 2023-10-06T02:23:37.915 INFO:teuthology.orchestra.run.smithi037.stdout:48 2023-10-06T02:23:37.915 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2023-10-06T02:23:37.915 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:23:37.915 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-10-06T02:23:37.916 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-10-06T02:23:37.916 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:23:37.916 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-10-06T02:23:37.916 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:23:37.916 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-10-06T02:23:37.916 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-10-06T02:23:37.916 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-10-06T02:23:37.916 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-10-06T02:23:37.916 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:23:37.916 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-10-06T02:23:37.916 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-10-06T02:23:37.916 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-10-06T02:23:37.916 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-10-06T02:23:37.917 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:23:37.917 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-10-06T02:23:37.917 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:23:37.917 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:23:37.917 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:23:37.917 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-10-06T02:23:37.917 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-10-06T02:23:37.917 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-10-06T02:23:37.917 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:23:37.917 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:23:37.917 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.2")) 2023-10-06T02:23:37.917 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:23:38.037 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.2.100370.asok 2023-10-06T02:23:38.220 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.100370.asok 2023-10-06T02:23:38.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:38.220 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.100370.asok status 2023-10-06T02:23:38.375 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:23:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-10-06T02:23:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:23:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:23:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "2", 2023-10-06T02:23:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-10-06T02:23:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-10-06T02:23:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "100370", 2023-10-06T02:23:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-10-06T02:23:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:23:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-10-06T02:23:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-10-06T02:23:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4704, 2023-10-06T02:23:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-10-06T02:23:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-10-06T02:23:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-10-06T02:23:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 4704 2023-10-06T02:23:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:23:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T02:23:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T02:23:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.2:0", 2023-10-06T02:23:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1194611738 2023-10-06T02:23:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:23:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:23:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T02:23:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T02:23:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.2:0", 2023-10-06T02:23:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1194611738 2023-10-06T02:23:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:23:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.4704 192.168.0.2:0/1194611738", 2023-10-06T02:23:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.2:0/1194611738", 2023-10-06T02:23:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-10-06T02:23:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 7, 2023-10-06T02:23:38.378 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 20, 2023-10-06T02:23:38.378 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:23:38.378 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-10-06T02:23:38.378 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-10-06T02:23:38.378 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:23:38.384 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:23:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.502+0000 7fcc11876700 1 Processor -- start 2023-10-06T02:23:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.502+0000 7fcc11876700 1 -- start start 2023-10-06T02:23:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.503+0000 7fcc11876700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc0c0c63a0 0x7fcc0c15daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.503+0000 7fcc11876700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fcc0c15dfe0 0x7fcc0c0cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.503+0000 7fcc11876700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0c0cb650 con 0x7fcc0c159760 2023-10-06T02:23:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.503+0000 7fcc11876700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0c0cc2d0 con 0x7fcc0c15dfe0 2023-10-06T02:23:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.503+0000 7fcc11876700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0cb930 con 0x7fcc0c0c63a0 2023-10-06T02:23:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.503+0000 7fcc0affd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcc0c159760 0x7fcc0c15d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38288/0 (socket says 172.21.15.37:38288) 2023-10-06T02:23:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.503+0000 7fcc0affd700 1 -- 172.21.15.37:0/3117858625 learned_addr learned my addr 172.21.15.37:0/3117858625 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.504+0000 7fcc0a7fc700 1 --2- 172.21.15.37:0/3117858625 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc0c0c63a0 0x7fcc0c15daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.504+0000 7fcc0b7fe700 1 --2- 172.21.15.37:0/3117858625 >> v2:172.21.15.191:3300/0 conn(0x7fcc0c15dfe0 0x7fcc0c0cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.504+0000 7fcc09ffb700 1 -- 172.21.15.37:0/3117858625 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925153610 0 0) 0x7fcc0c0cb650 con 0x7fcc0c159760 2023-10-06T02:23:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.504+0000 7fcc09ffb700 1 -- 172.21.15.37:0/3117858625 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbf4003570 con 0x7fcc0c159760 2023-10-06T02:23:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.504+0000 7fcc0a7fc700 1 -- 172.21.15.37:0/3117858625 >> v2:172.21.15.191:3300/0 conn(0x7fcc0c15dfe0 msgr2=0x7fcc0c0cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:38.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.504+0000 7fcc0a7fc700 1 --2- 172.21.15.37:0/3117858625 >> v2:172.21.15.191:3300/0 conn(0x7fcc0c15dfe0 0x7fcc0c0cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:38.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.504+0000 7fcc0a7fc700 1 -- 172.21.15.37:0/3117858625 >> v1:172.21.15.37:6789/0 conn(0x7fcc0c159760 legacy=0x7fcc0c15d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:38.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.504+0000 7fcc0a7fc700 1 -- 172.21.15.37:0/3117858625 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c0cbc10 con 0x7fcc0c0c63a0 2023-10-06T02:23:38.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.504+0000 7fcc0a7fc700 1 --2- 172.21.15.37:0/3117858625 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc0c0c63a0 0x7fcc0c15daa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcc000098e0 tx=0x7fcc000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29cd01537cf0cad0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:38.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.504+0000 7fcc09ffb700 1 -- 172.21.15.37:0/3117858625 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00011630 con 0x7fcc0c0c63a0 2023-10-06T02:23:38.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.504+0000 7fcc09ffb700 1 -- 172.21.15.37:0/3117858625 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc00011790 con 0x7fcc0c0c63a0 2023-10-06T02:23:38.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.504+0000 7fcc09ffb700 1 -- 172.21.15.37:0/3117858625 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00011b30 con 0x7fcc0c0c63a0 2023-10-06T02:23:38.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.505+0000 7fcc11876700 1 -- 172.21.15.37:0/3117858625 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc0c0c63a0 msgr2=0x7fcc0c15daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:38.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.505+0000 7fcc11876700 1 --2- 172.21.15.37:0/3117858625 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc0c0c63a0 0x7fcc0c15daa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcc000098e0 tx=0x7fcc000091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:38.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.505+0000 7fcc11876700 1 -- 172.21.15.37:0/3117858625 shutdown_connections 2023-10-06T02:23:38.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.505+0000 7fcc11876700 1 --2- 172.21.15.37:0/3117858625 >> v2:172.21.15.191:3300/0 conn(0x7fcc0c15dfe0 0x7fcc0c0cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:38.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.505+0000 7fcc11876700 1 --2- 172.21.15.37:0/3117858625 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc0c0c63a0 0x7fcc0c15daa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:38.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.505+0000 7fcc11876700 1 -- 172.21.15.37:0/3117858625 >> 172.21.15.37:0/3117858625 conn(0x7fcc0c06c890 msgr2=0x7fcc0c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:38.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.505+0000 7fcc11876700 1 -- 172.21.15.37:0/3117858625 shutdown_connections 2023-10-06T02:23:38.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.505+0000 7fcc11876700 1 -- 172.21.15.37:0/3117858625 wait complete. 2023-10-06T02:23:38.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.506+0000 7fcc11876700 1 Processor -- start 2023-10-06T02:23:38.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.506+0000 7fcc11876700 1 -- start start 2023-10-06T02:23:38.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.507+0000 7fcc11876700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc0c0c63a0 0x7fcc0c1523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.507+0000 7fcc11876700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc0c159760 0x7fcc0c0b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.507+0000 7fcc11876700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc0c15dfe0 0x7fcc0c0b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.507+0000 7fcc11876700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0b47d0 con 0x7fcc0c159760 2023-10-06T02:23:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.507+0000 7fcc11876700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c152900 con 0x7fcc0c15dfe0 2023-10-06T02:23:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.507+0000 7fcc11876700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0b3b50 con 0x7fcc0c0c63a0 2023-10-06T02:23:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.507+0000 7fcc0a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc0c159760 0x7fcc0c0b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.507+0000 7fcc0a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc0c159760 0x7fcc0c0b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56582/0 (socket says 172.21.15.37:56582) 2023-10-06T02:23:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.507+0000 7fcc0a7fc700 1 -- 172.21.15.37:0/3366413520 learned_addr learned my addr 172.21.15.37:0/3366413520 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.507+0000 7fcc0affd700 1 --2- 172.21.15.37:0/3366413520 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc0c0c63a0 0x7fcc0c1523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.507+0000 7fcc0b7fe700 1 --2- 172.21.15.37:0/3366413520 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc0c15dfe0 0x7fcc0c0b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.507+0000 7fcc0a7fc700 1 -- 172.21.15.37:0/3366413520 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc0c0c63a0 msgr2=0x7fcc0c1523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.507+0000 7fcc0a7fc700 1 --2- 172.21.15.37:0/3366413520 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc0c0c63a0 0x7fcc0c1523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.507+0000 7fcc0a7fc700 1 -- 172.21.15.37:0/3366413520 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc0c15dfe0 msgr2=0x7fcc0c0b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.507+0000 7fcc0a7fc700 1 --2- 172.21.15.37:0/3366413520 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc0c15dfe0 0x7fcc0c0b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.507+0000 7fcc0a7fc700 1 -- 172.21.15.37:0/3366413520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc00009420 con 0x7fcc0c159760 2023-10-06T02:23:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.508+0000 7fcc0a7fc700 1 --2- 172.21.15.37:0/3366413520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc0c159760 0x7fcc0c0b3300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c0cba70 tx=0x7fcc00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.508+0000 7fcbf2ffd700 1 -- 172.21.15.37:0/3366413520 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0001f070 con 0x7fcc0c159760 2023-10-06T02:23:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.508+0000 7fcbf2ffd700 1 -- 172.21.15.37:0/3366413520 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc00000bc0 con 0x7fcc0c159760 2023-10-06T02:23:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.508+0000 7fcc11876700 1 -- 172.21.15.37:0/3366413520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0c0b3e30 con 0x7fcc0c159760 2023-10-06T02:23:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.508+0000 7fcbf2ffd700 1 -- 172.21.15.37:0/3366413520 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00011b30 con 0x7fcc0c159760 2023-10-06T02:23:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.508+0000 7fcc11876700 1 -- 172.21.15.37:0/3366413520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0c0b43f0 con 0x7fcc0c159760 2023-10-06T02:23:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.509+0000 7fcc11876700 1 -- 172.21.15.37:0/3366413520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc0c06fbf0 con 0x7fcc0c159760 2023-10-06T02:23:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.509+0000 7fcbf2ffd700 1 -- 172.21.15.37:0/3366413520 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc00023070 con 0x7fcc0c159760 2023-10-06T02:23:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.510+0000 7fcbf2ffd700 1 --2- 172.21.15.37:0/3366413520 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcbf8066f30 0x7fcbf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.510+0000 7fcbf2ffd700 1 -- 172.21.15.37:0/3366413520 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcc00085920 con 0x7fcc0c159760 2023-10-06T02:23:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.510+0000 7fcc0affd700 1 --2- 172.21.15.37:0/3366413520 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcbf8066f30 0x7fcbf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:38.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.510+0000 7fcc0affd700 1 --2- 172.21.15.37:0/3366413520 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcbf8066f30 0x7fcbf80693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc007fd0 tx=0x7fcbfc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:38.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.514+0000 7fcbf2ffd700 1 -- 172.21.15.37:0/3366413520 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc00052a30 con 0x7fcc0c159760 2023-10-06T02:23:38.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.754+0000 7fcc11876700 1 -- 172.21.15.37:0/3366413520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcc0c04bb80 con 0x7fcc0c159760 2023-10-06T02:23:38.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.754+0000 7fcbf2ffd700 1 -- 172.21.15.37:0/3366413520 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcc0002a020 con 0x7fcc0c159760 2023-10-06T02:23:38.755 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:23:38.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.756+0000 7fcc11876700 1 -- 172.21.15.37:0/3366413520 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcbf8066f30 msgr2=0x7fcbf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:38.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.756+0000 7fcc11876700 1 --2- 172.21.15.37:0/3366413520 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcbf8066f30 0x7fcbf80693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc007fd0 tx=0x7fcbfc009040 comp rx=0 tx=0).stop 2023-10-06T02:23:38.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.756+0000 7fcc11876700 1 -- 172.21.15.37:0/3366413520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc0c159760 msgr2=0x7fcc0c0b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:38.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.756+0000 7fcc11876700 1 --2- 172.21.15.37:0/3366413520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc0c159760 0x7fcc0c0b3300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c0cba70 tx=0x7fcc00017000 comp rx=0 tx=0).stop 2023-10-06T02:23:38.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.756+0000 7fcc11876700 1 -- 172.21.15.37:0/3366413520 shutdown_connections 2023-10-06T02:23:38.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.756+0000 7fcc11876700 1 --2- 172.21.15.37:0/3366413520 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcbf8066f30 0x7fcbf80693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:38.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.756+0000 7fcc11876700 1 --2- 172.21.15.37:0/3366413520 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc0c15dfe0 0x7fcc0c0b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:38.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.756+0000 7fcc11876700 1 --2- 172.21.15.37:0/3366413520 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc0c0c63a0 0x7fcc0c1523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:38.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.756+0000 7fcc11876700 1 --2- 172.21.15.37:0/3366413520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc0c159760 0x7fcc0c0b3300 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:38.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.756+0000 7fcc11876700 1 -- 172.21.15.37:0/3366413520 >> 172.21.15.37:0/3366413520 conn(0x7fcc0c06c890 msgr2=0x7fcc0c0c9620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:38.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.756+0000 7fcc11876700 1 -- 172.21.15.37:0/3366413520 shutdown_connections 2023-10-06T02:23:38.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:38.756+0000 7fcc11876700 1 -- 172.21.15.37:0/3366413520 wait complete. 2023-10-06T02:23:38.769 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:23:38.769 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:23:38.769 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi191.front.sepia.ceph.com 2023-10-06T02:23:38.769 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T02:23:38.769 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T02:23:38.769 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:23:38.769 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:23:38.770 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:23:38.770 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:23:38.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:38.770 DEBUG:teuthology.orchestra.run.smithi191:> ip addr 2023-10-06T02:23:38.788 INFO:teuthology.orchestra.run.smithi191.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:23:38.788 INFO:teuthology.orchestra.run.smithi191.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:23:38.789 INFO:teuthology.orchestra.run.smithi191.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:23:38.789 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:38.789 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 ::1/128 scope host 2023-10-06T02:23:38.789 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:38.789 INFO:teuthology.orchestra.run.smithi191.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:23:38.789 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:38.789 INFO:teuthology.orchestra.run.smithi191.stdout: altname enp7s0f0 2023-10-06T02:23:38.789 INFO:teuthology.orchestra.run.smithi191.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:23:38.789 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:38.789 INFO:teuthology.orchestra.run.smithi191.stdout: altname enp7s0f1 2023-10-06T02:23:38.789 INFO:teuthology.orchestra.run.smithi191.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:23:38.789 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:38.790 INFO:teuthology.orchestra.run.smithi191.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:23:38.790 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:11 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:38.790 INFO:teuthology.orchestra.run.smithi191.stdout: inet 172.21.15.191/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:23:38.790 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft 42474sec preferred_lft 42474sec 2023-10-06T02:23:38.790 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::ec4:7aff:fe88:7211/64 scope link 2023-10-06T02:23:38.790 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:38.790 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T02:23:38.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:38.790 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-10-06T02:23:38.791 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-10-06T02:23:38.791 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link add name ceph-brx type bridge 2023-10-06T02:23:38.791 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip addr flush dev ceph-brx 2023-10-06T02:23:38.791 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set ceph-brx up 2023-10-06T02:23:38.791 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T02:23:38.791 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-10-06T02:23:38.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:38.965 DEBUG:teuthology.orchestra.run.smithi191:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:23:39.007 INFO:teuthology.orchestra.run.smithi191.stdout:1 2023-10-06T02:23:39.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:39.009 DEBUG:teuthology.orchestra.run.smithi191:> route 2023-10-06T02:23:39.143 INFO:teuthology.orchestra.run.smithi191.stdout:Kernel IP routing table 2023-10-06T02:23:39.143 INFO:teuthology.orchestra.run.smithi191.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:23:39.143 INFO:teuthology.orchestra.run.smithi191.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:23:39.143 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:23:39.143 INFO:teuthology.orchestra.run.smithi191.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:23:39.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:39.144 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-10-06T02:23:39.144 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-10-06T02:23:39.144 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:23:39.144 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:23:39.144 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:23:39.144 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-10-06T02:23:39.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:39.365 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2023-10-06T02:23:39.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:39.379 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list-id 2023-10-06T02:23:39.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:39.434 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-10-06T02:23:39.434 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-10-06T02:23:39.434 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:23:39.434 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T02:23:39.434 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-10-06T02:23:39.523 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T02:23:39.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:39.523 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-10-06T02:23:39.523 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-10-06T02:23:39.523 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T02:23:39.523 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T02:23:39.524 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T02:23:39.524 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T02:23:39.524 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T02:23:39.524 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-10-06T02:23:39.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:39.713 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-10-06T02:23:39.713 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-10-06T02:23:39.713 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set brx.0 up 2023-10-06T02:23:39.713 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T02:23:39.713 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-10-06T02:23:39.805 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-06T02:23:39.805 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:23:39.805 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T02:23:39.819 INFO:teuthology.orchestra.run.smithi191.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:23:39.820 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:23:39.820 DEBUG:teuthology.orchestra.run.smithi191:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:23:39.874 DEBUG:teuthology.orchestra.run.smithi191:> sudo modprobe fuse 2023-10-06T02:23:39.938 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:23:39.938 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:23:40.002 INFO:teuthology.orchestra.run.smithi191.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:23:40.003 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:23:40.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:40.004 DEBUG:teuthology.orchestra.run.smithi191:> ls /sys/fs/fuse/connections 2023-10-06T02:23:40.058 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:23:40.059 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-06T02:23:40.101 DEBUG:teuthology.orchestra.run.smithi191:> sudo modprobe fuse 2023-10-06T02:23:40.125 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:23:40.125 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:23:40.189 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi191.stderr:2023-10-06T02:23:40.188+0000 7fa036f78540 -1 init, newargv = 0x55985ab77ad0 newargc=15 2023-10-06T02:23:40.189 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi191.stderr:ceph-fuse[97264]: starting ceph client 2023-10-06T02:23:40.189 INFO:teuthology.orchestra.run.smithi191.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:23:40.190 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:23:40.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:40.191 DEBUG:teuthology.orchestra.run.smithi191:> ls /sys/fs/fuse/connections 2023-10-06T02:23:40.193 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi191.stderr:ceph-fuse[97264]: starting fuse 2023-10-06T02:23:40.206 INFO:teuthology.orchestra.run.smithi191.stdout:46 2023-10-06T02:23:40.206 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T02:23:40.207 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:23:40.207 DEBUG:teuthology.orchestra.run.smithi191:> import glob 2023-10-06T02:23:40.207 DEBUG:teuthology.orchestra.run.smithi191:> import re 2023-10-06T02:23:40.207 DEBUG:teuthology.orchestra.run.smithi191:> import os 2023-10-06T02:23:40.207 DEBUG:teuthology.orchestra.run.smithi191:> import subprocess 2023-10-06T02:23:40.207 DEBUG:teuthology.orchestra.run.smithi191:> 2023-10-06T02:23:40.207 DEBUG:teuthology.orchestra.run.smithi191:> def _find_admin_socket(client_name): 2023-10-06T02:23:40.207 DEBUG:teuthology.orchestra.run.smithi191:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-06T02:23:40.207 DEBUG:teuthology.orchestra.run.smithi191:> files = glob.glob(asok_path) 2023-10-06T02:23:40.208 DEBUG:teuthology.orchestra.run.smithi191:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-06T02:23:40.208 DEBUG:teuthology.orchestra.run.smithi191:> 2023-10-06T02:23:40.208 DEBUG:teuthology.orchestra.run.smithi191:> # Given a non-glob path, it better be there 2023-10-06T02:23:40.208 DEBUG:teuthology.orchestra.run.smithi191:> if "*" not in asok_path: 2023-10-06T02:23:40.208 DEBUG:teuthology.orchestra.run.smithi191:> assert(len(files) == 1) 2023-10-06T02:23:40.208 DEBUG:teuthology.orchestra.run.smithi191:> return files[0] 2023-10-06T02:23:40.208 DEBUG:teuthology.orchestra.run.smithi191:> 2023-10-06T02:23:40.208 DEBUG:teuthology.orchestra.run.smithi191:> for f in files: 2023-10-06T02:23:40.208 DEBUG:teuthology.orchestra.run.smithi191:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:23:40.208 DEBUG:teuthology.orchestra.run.smithi191:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:23:40.208 DEBUG:teuthology.orchestra.run.smithi191:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:23:40.209 DEBUG:teuthology.orchestra.run.smithi191:> contents = proc_f.read() 2023-10-06T02:23:40.209 DEBUG:teuthology.orchestra.run.smithi191:> if mountpoint in contents: 2023-10-06T02:23:40.209 DEBUG:teuthology.orchestra.run.smithi191:> return f 2023-10-06T02:23:40.209 DEBUG:teuthology.orchestra.run.smithi191:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:23:40.209 DEBUG:teuthology.orchestra.run.smithi191:> 2023-10-06T02:23:40.209 DEBUG:teuthology.orchestra.run.smithi191:> print(_find_admin_socket("client.1")) 2023-10-06T02:23:40.209 DEBUG:teuthology.orchestra.run.smithi191:> ' 2023-10-06T02:23:40.326 INFO:teuthology.orchestra.run.smithi191.stdout:/var/run/ceph/ceph-client.1.97264.asok 2023-10-06T02:23:40.509 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.97264.asok 2023-10-06T02:23:40.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:40.509 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.97264.asok status 2023-10-06T02:23:40.659 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2023-10-06T02:23:40.659 INFO:teuthology.orchestra.run.smithi191.stdout: "metadata": { 2023-10-06T02:23:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:23:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:23:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "entity_id": "1", 2023-10-06T02:23:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "hostname": "smithi191", 2023-10-06T02:23:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-06T02:23:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "pid": "97264", 2023-10-06T02:23:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "root": "/" 2023-10-06T02:23:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-06T02:23:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "dentry_count": 0, 2023-10-06T02:23:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "dentry_pinned_count": 0, 2023-10-06T02:23:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "id": 4672, 2023-10-06T02:23:40.660 INFO:teuthology.orchestra.run.smithi191.stdout: "inst": { 2023-10-06T02:23:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: "name": { 2023-10-06T02:23:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: "type": "client", 2023-10-06T02:23:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: "num": 4672 2023-10-06T02:23:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-06T02:23:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: "addr": { 2023-10-06T02:23:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: "type": "v1", 2023-10-06T02:23:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:23:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: "nonce": 3050429541 2023-10-06T02:23:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-06T02:23:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-06T02:23:40.661 INFO:teuthology.orchestra.run.smithi191.stdout: "addr": { 2023-10-06T02:23:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: "type": "v1", 2023-10-06T02:23:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:23:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: "nonce": 3050429541 2023-10-06T02:23:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-06T02:23:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: "inst_str": "client.4672 192.168.0.1:0/3050429541", 2023-10-06T02:23:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: "addr_str": "192.168.0.1:0/3050429541", 2023-10-06T02:23:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: "inode_count": 1, 2023-10-06T02:23:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_epoch": 7, 2023-10-06T02:23:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_epoch": 20, 2023-10-06T02:23:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:23:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: "blocklisted": false, 2023-10-06T02:23:40.662 INFO:teuthology.orchestra.run.smithi191.stdout: "fs_name": "cephfs" 2023-10-06T02:23:40.663 INFO:teuthology.orchestra.run.smithi191.stdout:} 2023-10-06T02:23:40.670 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:23:40.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.801+0000 7f0632e1a700 1 Processor -- start 2023-10-06T02:23:40.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.801+0000 7f0632e1a700 1 -- start start 2023-10-06T02:23:40.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.802+0000 7f0632e1a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c0cf9f0 0x7f062c0cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:40.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.802+0000 7f0632e1a700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f062c0c5300 con 0x7f062c159aa0 2023-10-06T02:23:40.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.802+0000 7f0632e1a700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f062c0c6160 con 0x7f062c1596d0 2023-10-06T02:23:40.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.802+0000 7f0632e1a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062c0d03b0 con 0x7f062c0cf9f0 2023-10-06T02:23:40.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.802+0000 7f062bfff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f062c159aa0 0x7f062c0c65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38296/0 (socket says 172.21.15.37:38296) 2023-10-06T02:23:40.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.802+0000 7f062bfff700 1 -- 172.21.15.37:0/3042220452 learned_addr learned my addr 172.21.15.37:0/3042220452 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:40.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.802+0000 7f06313b7700 1 --2- 172.21.15.37:0/3042220452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c0cf9f0 0x7f062c0cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:40.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.802+0000 7f062b7fe700 1 -- 172.21.15.37:0/3042220452 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3540817533 0 0) 0x7f062c0c5300 con 0x7f062c159aa0 2023-10-06T02:23:40.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.802+0000 7f062b7fe700 1 -- 172.21.15.37:0/3042220452 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0618003570 con 0x7f062c159aa0 2023-10-06T02:23:40.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.802+0000 7f062b7fe700 1 -- 172.21.15.37:0/3042220452 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45496997 0 0) 0x7f062c0c6160 con 0x7f062c1596d0 2023-10-06T02:23:40.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.802+0000 7f062b7fe700 1 -- 172.21.15.37:0/3042220452 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f062c0c5300 con 0x7f062c1596d0 2023-10-06T02:23:40.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.802+0000 7f062b7fe700 1 -- 172.21.15.37:0/3042220452 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 134732746 0 0) 0x7f0618003570 con 0x7f062c159aa0 2023-10-06T02:23:40.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.802+0000 7f06313b7700 1 -- 172.21.15.37:0/3042220452 >> v1:172.21.15.191:6789/0 conn(0x7f062c1596d0 legacy=0x7f062c0b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:40.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.802+0000 7f06313b7700 1 -- 172.21.15.37:0/3042220452 >> v1:172.21.15.37:6789/0 conn(0x7f062c159aa0 legacy=0x7f062c0c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:40.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.802+0000 7f06313b7700 1 -- 172.21.15.37:0/3042220452 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c0c5550 con 0x7f062c0cf9f0 2023-10-06T02:23:40.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.803+0000 7f06313b7700 1 --2- 172.21.15.37:0/3042220452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c0cf9f0 0x7f062c0cfe70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0614009910 tx=0x7f06140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e73c42752d70d425 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:40.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.803+0000 7f062b7fe700 1 -- 172.21.15.37:0/3042220452 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c0017f0 con 0x7f062c0cf9f0 2023-10-06T02:23:40.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.803+0000 7f062b7fe700 1 -- 172.21.15.37:0/3042220452 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0614011420 con 0x7f062c0cf9f0 2023-10-06T02:23:40.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.803+0000 7f062b7fe700 1 -- 172.21.15.37:0/3042220452 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140117c0 con 0x7f062c0cf9f0 2023-10-06T02:23:40.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.803+0000 7f0632e1a700 1 -- 172.21.15.37:0/3042220452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c0cf9f0 msgr2=0x7f062c0cfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:40.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.803+0000 7f0632e1a700 1 --2- 172.21.15.37:0/3042220452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c0cf9f0 0x7f062c0cfe70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0614009910 tx=0x7f06140091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:40.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.803+0000 7f0632e1a700 1 -- 172.21.15.37:0/3042220452 shutdown_connections 2023-10-06T02:23:40.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.803+0000 7f0632e1a700 1 --2- 172.21.15.37:0/3042220452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c0cf9f0 0x7f062c0cfe70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:40.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.803+0000 7f0632e1a700 1 -- 172.21.15.37:0/3042220452 >> 172.21.15.37:0/3042220452 conn(0x7f062c06c890 msgr2=0x7f062c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:40.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.803+0000 7f0632e1a700 1 -- 172.21.15.37:0/3042220452 shutdown_connections 2023-10-06T02:23:40.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.803+0000 7f0632e1a700 1 -- 172.21.15.37:0/3042220452 wait complete. 2023-10-06T02:23:40.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.804+0000 7f0632e1a700 1 Processor -- start 2023-10-06T02:23:40.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.805+0000 7f0632e1a700 1 -- start start 2023-10-06T02:23:40.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.805+0000 7f0632e1a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f062c0cf9f0 0x7f062c154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:40.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.805+0000 7f0632e1a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f062c1596d0 0x7f062c0b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:40.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.805+0000 7f0632e1a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c159aa0 0x7f062c15af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:40.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.805+0000 7f0632e1a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c154890 con 0x7f062c1596d0 2023-10-06T02:23:40.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.805+0000 7f0632e1a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c0b4370 con 0x7f062c0cf9f0 2023-10-06T02:23:40.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.805+0000 7f0632e1a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062c0b4610 con 0x7f062c159aa0 2023-10-06T02:23:40.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.805+0000 7f062bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f062c1596d0 0x7f062c0b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:40.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.806+0000 7f062bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f062c1596d0 0x7f062c0b53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56584/0 (socket says 172.21.15.37:56584) 2023-10-06T02:23:40.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.806+0000 7f062bfff700 1 -- 172.21.15.37:0/2669977386 learned_addr learned my addr 172.21.15.37:0/2669977386 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:40.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.806+0000 7f06313b7700 1 --2- 172.21.15.37:0/2669977386 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c159aa0 0x7f062c15af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:40.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.806+0000 7f0630bb6700 1 --2- 172.21.15.37:0/2669977386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f062c0cf9f0 0x7f062c154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:40.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.806+0000 7f062bfff700 1 -- 172.21.15.37:0/2669977386 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c159aa0 msgr2=0x7f062c15af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:40.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.806+0000 7f062bfff700 1 --2- 172.21.15.37:0/2669977386 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c159aa0 0x7f062c15af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:40.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.806+0000 7f062bfff700 1 -- 172.21.15.37:0/2669977386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f062c0cf9f0 msgr2=0x7f062c154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:40.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.806+0000 7f062bfff700 1 --2- 172.21.15.37:0/2669977386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f062c0cf9f0 0x7f062c154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:40.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.806+0000 7f062bfff700 1 -- 172.21.15.37:0/2669977386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0614009420 con 0x7f062c1596d0 2023-10-06T02:23:40.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.806+0000 7f062bfff700 1 --2- 172.21.15.37:0/2669977386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f062c1596d0 0x7f062c0b53d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f061c00cc90 tx=0x7f061c007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:40.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.806+0000 7f0628ff9700 1 -- 172.21.15.37:0/2669977386 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c004dc0 con 0x7f062c1596d0 2023-10-06T02:23:40.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.806+0000 7f0628ff9700 1 -- 172.21.15.37:0/2669977386 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c00a660 con 0x7f062c1596d0 2023-10-06T02:23:40.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.806+0000 7f0628ff9700 1 -- 172.21.15.37:0/2669977386 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c00aa20 con 0x7f062c1596d0 2023-10-06T02:23:40.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.806+0000 7f0632e1a700 1 -- 172.21.15.37:0/2669977386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062c0b48f0 con 0x7f062c1596d0 2023-10-06T02:23:40.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.806+0000 7f0632e1a700 1 -- 172.21.15.37:0/2669977386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062c0b4eb0 con 0x7f062c1596d0 2023-10-06T02:23:40.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.807+0000 7f0632e1a700 1 -- 172.21.15.37:0/2669977386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062c0b50a0 con 0x7f062c1596d0 2023-10-06T02:23:40.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.808+0000 7f0628ff9700 1 -- 172.21.15.37:0/2669977386 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f061c007150 con 0x7f062c1596d0 2023-10-06T02:23:40.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.808+0000 7f0628ff9700 1 --2- 172.21.15.37:0/2669977386 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f060c066f30 0x7f060c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:40.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.808+0000 7f0628ff9700 1 -- 172.21.15.37:0/2669977386 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f061c083e00 con 0x7f062c1596d0 2023-10-06T02:23:40.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.808+0000 7f0630bb6700 1 --2- 172.21.15.37:0/2669977386 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f060c066f30 0x7f060c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:40.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.809+0000 7f0630bb6700 1 --2- 172.21.15.37:0/2669977386 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f060c066f30 0x7f060c0693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0624007fd0 tx=0x7f0624007d10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:40.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:40.813+0000 7f0628ff9700 1 -- 172.21.15.37:0/2669977386 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f061c050e70 con 0x7f062c1596d0 2023-10-06T02:23:41.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:41.050+0000 7f0632e1a700 1 -- 172.21.15.37:0/2669977386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f062c06fbf0 con 0x7f062c1596d0 2023-10-06T02:23:41.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:41.050+0000 7f0628ff9700 1 -- 172.21.15.37:0/2669977386 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f061c018020 con 0x7f062c1596d0 2023-10-06T02:23:41.052 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:23:41.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:41.052+0000 7f0632e1a700 1 -- 172.21.15.37:0/2669977386 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f060c066f30 msgr2=0x7f060c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:41.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:41.052+0000 7f0632e1a700 1 --2- 172.21.15.37:0/2669977386 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f060c066f30 0x7f060c0693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0624007fd0 tx=0x7f0624007d10 comp rx=0 tx=0).stop 2023-10-06T02:23:41.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:41.052+0000 7f0632e1a700 1 -- 172.21.15.37:0/2669977386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f062c1596d0 msgr2=0x7f062c0b53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:41.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:41.052+0000 7f0632e1a700 1 --2- 172.21.15.37:0/2669977386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f062c1596d0 0x7f062c0b53d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f061c00cc90 tx=0x7f061c007da0 comp rx=0 tx=0).stop 2023-10-06T02:23:41.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:41.052+0000 7f0632e1a700 1 -- 172.21.15.37:0/2669977386 shutdown_connections 2023-10-06T02:23:41.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:41.052+0000 7f0632e1a700 1 --2- 172.21.15.37:0/2669977386 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c159aa0 0x7f062c15af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:41.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:41.052+0000 7f0632e1a700 1 --2- 172.21.15.37:0/2669977386 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f060c066f30 0x7f060c0693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:41.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:41.052+0000 7f0632e1a700 1 --2- 172.21.15.37:0/2669977386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f062c0cf9f0 0x7f062c154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:41.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:41.052+0000 7f0632e1a700 1 --2- 172.21.15.37:0/2669977386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f062c1596d0 0x7f062c0b53d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:41.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:41.052+0000 7f0632e1a700 1 -- 172.21.15.37:0/2669977386 >> 172.21.15.37:0/2669977386 conn(0x7f062c06c890 msgr2=0x7f062c06e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:41.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:41.052+0000 7f0632e1a700 1 -- 172.21.15.37:0/2669977386 shutdown_connections 2023-10-06T02:23:41.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:41.052+0000 7f0632e1a700 1 -- 172.21.15.37:0/2669977386 wait complete. 2023-10-06T02:23:41.065 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:23:41.065 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:23:41.065 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi191.front.sepia.ceph.com 2023-10-06T02:23:41.066 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T02:23:41.066 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T02:23:41.066 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:23:41.066 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:23:41.066 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:23:41.066 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T02:23:41.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:41.067 DEBUG:teuthology.orchestra.run.smithi191:> ip addr 2023-10-06T02:23:41.082 INFO:teuthology.orchestra.run.smithi191.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:23:41.083 INFO:teuthology.orchestra.run.smithi191.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:23:41.083 INFO:teuthology.orchestra.run.smithi191.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:23:41.083 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:41.083 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 ::1/128 scope host 2023-10-06T02:23:41.083 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:41.083 INFO:teuthology.orchestra.run.smithi191.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:23:41.083 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f6 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:41.083 INFO:teuthology.orchestra.run.smithi191.stdout: altname enp7s0f0 2023-10-06T02:23:41.083 INFO:teuthology.orchestra.run.smithi191.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:23:41.084 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f7 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:41.084 INFO:teuthology.orchestra.run.smithi191.stdout: altname enp7s0f1 2023-10-06T02:23:41.084 INFO:teuthology.orchestra.run.smithi191.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:23:41.084 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:10 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:41.084 INFO:teuthology.orchestra.run.smithi191.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:23:41.084 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:11 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:41.084 INFO:teuthology.orchestra.run.smithi191.stdout: inet 172.21.15.191/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:23:41.084 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft 42471sec preferred_lft 42471sec 2023-10-06T02:23:41.084 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::ec4:7aff:fe88:7211/64 scope link 2023-10-06T02:23:41.084 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:41.085 INFO:teuthology.orchestra.run.smithi191.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:23:41.085 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 92:64:84:57:14:81 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:23:41.085 INFO:teuthology.orchestra.run.smithi191.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:23:41.085 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:41.085 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::9850:5bff:fe74:5f29/64 scope link 2023-10-06T02:23:41.085 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:41.085 INFO:teuthology.orchestra.run.smithi191.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:23:41.085 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 92:64:84:57:14:81 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:23:41.085 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::9064:84ff:fe57:1481/64 scope link tentative 2023-10-06T02:23:41.085 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:41.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:41.086 DEBUG:teuthology.orchestra.run.smithi191:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:23:41.146 INFO:teuthology.orchestra.run.smithi191.stdout:1 2023-10-06T02:23:41.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:41.148 DEBUG:teuthology.orchestra.run.smithi191:> route 2023-10-06T02:23:41.204 INFO:teuthology.orchestra.run.smithi191.stdout:Kernel IP routing table 2023-10-06T02:23:41.204 INFO:teuthology.orchestra.run.smithi191.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:23:41.204 INFO:teuthology.orchestra.run.smithi191.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:23:41.204 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:23:41.204 INFO:teuthology.orchestra.run.smithi191.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:23:41.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:41.205 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-10-06T02:23:41.205 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-10-06T02:23:41.205 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:23:41.205 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:23:41.205 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:23:41.205 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-10-06T02:23:41.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:41.303 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2023-10-06T02:23:41.317 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T02:23:41.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:41.318 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list-id 2023-10-06T02:23:41.372 INFO:teuthology.orchestra.run.smithi191.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T02:23:41.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:41.372 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-10-06T02:23:41.372 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-10-06T02:23:41.372 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T02:23:41.372 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T02:23:41.373 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-10-06T02:23:41.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:41.460 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T02:23:41.490 INFO:teuthology.orchestra.run.smithi191.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:23:41.490 INFO:teuthology.orchestra.run.smithi191.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:23:41.490 INFO:teuthology.orchestra.run.smithi191.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:23:41.490 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:41.490 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 ::1/128 scope host 2023-10-06T02:23:41.490 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:41.490 INFO:teuthology.orchestra.run.smithi191.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:23:41.490 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether be:65:97:18:dc:42 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T02:23:41.490 INFO:teuthology.orchestra.run.smithi191.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T02:23:41.490 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:41.491 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::bc65:97ff:fe18:dc42/64 scope link 2023-10-06T02:23:41.491 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:41.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:41.508 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T02:23:41.584 INFO:teuthology.orchestra.run.smithi191.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:23:41.584 INFO:teuthology.orchestra.run.smithi191.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:23:41.584 INFO:teuthology.orchestra.run.smithi191.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:23:41.584 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:41.584 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 ::1/128 scope host 2023-10-06T02:23:41.584 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:41.584 INFO:teuthology.orchestra.run.smithi191.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:23:41.584 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether be:65:97:18:dc:42 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T02:23:41.584 INFO:teuthology.orchestra.run.smithi191.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T02:23:41.585 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:41.585 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::bc65:97ff:fe18:dc42/64 scope link 2023-10-06T02:23:41.585 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:23:41.598 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T02:23:41.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:41.599 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-10-06T02:23:41.599 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-10-06T02:23:41.599 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T02:23:41.599 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T02:23:41.599 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T02:23:41.599 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T02:23:41.599 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T02:23:41.599 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-10-06T02:23:41.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:41.837 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-10-06T02:23:41.837 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-10-06T02:23:41.837 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set brx.1 up 2023-10-06T02:23:41.837 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T02:23:41.837 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-10-06T02:23:41.928 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-10-06T02:23:41.928 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:23:41.928 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T02:23:41.943 INFO:teuthology.orchestra.run.smithi191.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T02:23:41.943 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:23:41.943 DEBUG:teuthology.orchestra.run.smithi191:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T02:23:41.997 DEBUG:teuthology.orchestra.run.smithi191:> sudo modprobe fuse 2023-10-06T02:23:42.062 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:23:42.062 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:23:42.125 INFO:teuthology.orchestra.run.smithi191.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:23:42.127 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:23:42.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:42.127 DEBUG:teuthology.orchestra.run.smithi191:> ls /sys/fs/fuse/connections 2023-10-06T02:23:42.181 INFO:teuthology.orchestra.run.smithi191.stdout:46 2023-10-06T02:23:42.181 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2023-10-06T02:23:42.182 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-10-06T02:23:42.224 DEBUG:teuthology.orchestra.run.smithi191:> sudo modprobe fuse 2023-10-06T02:23:42.247 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:23:42.247 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:23:42.305 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi191.stderr:2023-10-06T02:23:42.305+0000 7f3e64205540 -1 init, newargv = 0x563d31deaab0 newargc=15 2023-10-06T02:23:42.305 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi191.stderr:ceph-fuse[97761]: starting ceph client 2023-10-06T02:23:42.309 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi191.stderr:ceph-fuse[97761]: starting fuse 2023-10-06T02:23:42.314 INFO:teuthology.orchestra.run.smithi191.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:23:42.315 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:23:42.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:42.316 DEBUG:teuthology.orchestra.run.smithi191:> ls /sys/fs/fuse/connections 2023-10-06T02:23:42.370 INFO:teuthology.orchestra.run.smithi191.stdout:46 2023-10-06T02:23:42.370 INFO:teuthology.orchestra.run.smithi191.stdout:48 2023-10-06T02:23:42.370 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2023-10-06T02:23:42.371 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:23:42.371 DEBUG:teuthology.orchestra.run.smithi191:> import glob 2023-10-06T02:23:42.371 DEBUG:teuthology.orchestra.run.smithi191:> import re 2023-10-06T02:23:42.371 DEBUG:teuthology.orchestra.run.smithi191:> import os 2023-10-06T02:23:42.371 DEBUG:teuthology.orchestra.run.smithi191:> import subprocess 2023-10-06T02:23:42.371 DEBUG:teuthology.orchestra.run.smithi191:> 2023-10-06T02:23:42.371 DEBUG:teuthology.orchestra.run.smithi191:> def _find_admin_socket(client_name): 2023-10-06T02:23:42.371 DEBUG:teuthology.orchestra.run.smithi191:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-10-06T02:23:42.371 DEBUG:teuthology.orchestra.run.smithi191:> files = glob.glob(asok_path) 2023-10-06T02:23:42.371 DEBUG:teuthology.orchestra.run.smithi191:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-10-06T02:23:42.371 DEBUG:teuthology.orchestra.run.smithi191:> 2023-10-06T02:23:42.371 DEBUG:teuthology.orchestra.run.smithi191:> # Given a non-glob path, it better be there 2023-10-06T02:23:42.371 DEBUG:teuthology.orchestra.run.smithi191:> if "*" not in asok_path: 2023-10-06T02:23:42.372 DEBUG:teuthology.orchestra.run.smithi191:> assert(len(files) == 1) 2023-10-06T02:23:42.372 DEBUG:teuthology.orchestra.run.smithi191:> return files[0] 2023-10-06T02:23:42.372 DEBUG:teuthology.orchestra.run.smithi191:> 2023-10-06T02:23:42.372 DEBUG:teuthology.orchestra.run.smithi191:> for f in files: 2023-10-06T02:23:42.372 DEBUG:teuthology.orchestra.run.smithi191:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:23:42.372 DEBUG:teuthology.orchestra.run.smithi191:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:23:42.372 DEBUG:teuthology.orchestra.run.smithi191:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:23:42.372 DEBUG:teuthology.orchestra.run.smithi191:> contents = proc_f.read() 2023-10-06T02:23:42.372 DEBUG:teuthology.orchestra.run.smithi191:> if mountpoint in contents: 2023-10-06T02:23:42.372 DEBUG:teuthology.orchestra.run.smithi191:> return f 2023-10-06T02:23:42.373 DEBUG:teuthology.orchestra.run.smithi191:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:23:42.373 DEBUG:teuthology.orchestra.run.smithi191:> 2023-10-06T02:23:42.373 DEBUG:teuthology.orchestra.run.smithi191:> print(_find_admin_socket("client.3")) 2023-10-06T02:23:42.373 DEBUG:teuthology.orchestra.run.smithi191:> ' 2023-10-06T02:23:42.489 INFO:teuthology.orchestra.run.smithi191.stdout:/var/run/ceph/ceph-client.3.97761.asok 2023-10-06T02:23:42.672 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.97761.asok 2023-10-06T02:23:42.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:42.672 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.97761.asok status 2023-10-06T02:23:42.822 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2023-10-06T02:23:42.822 INFO:teuthology.orchestra.run.smithi191.stdout: "metadata": { 2023-10-06T02:23:42.822 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:23:42.822 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:23:42.822 INFO:teuthology.orchestra.run.smithi191.stdout: "entity_id": "3", 2023-10-06T02:23:42.822 INFO:teuthology.orchestra.run.smithi191.stdout: "hostname": "smithi191", 2023-10-06T02:23:42.822 INFO:teuthology.orchestra.run.smithi191.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-10-06T02:23:42.822 INFO:teuthology.orchestra.run.smithi191.stdout: "pid": "97761", 2023-10-06T02:23:42.822 INFO:teuthology.orchestra.run.smithi191.stdout: "root": "/" 2023-10-06T02:23:42.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-06T02:23:42.823 INFO:teuthology.orchestra.run.smithi191.stdout: "dentry_count": 0, 2023-10-06T02:23:42.823 INFO:teuthology.orchestra.run.smithi191.stdout: "dentry_pinned_count": 0, 2023-10-06T02:23:42.823 INFO:teuthology.orchestra.run.smithi191.stdout: "id": 4535, 2023-10-06T02:23:42.823 INFO:teuthology.orchestra.run.smithi191.stdout: "inst": { 2023-10-06T02:23:42.823 INFO:teuthology.orchestra.run.smithi191.stdout: "name": { 2023-10-06T02:23:42.823 INFO:teuthology.orchestra.run.smithi191.stdout: "type": "client", 2023-10-06T02:23:42.823 INFO:teuthology.orchestra.run.smithi191.stdout: "num": 4535 2023-10-06T02:23:42.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-06T02:23:42.823 INFO:teuthology.orchestra.run.smithi191.stdout: "addr": { 2023-10-06T02:23:42.823 INFO:teuthology.orchestra.run.smithi191.stdout: "type": "v1", 2023-10-06T02:23:42.823 INFO:teuthology.orchestra.run.smithi191.stdout: "addr": "192.168.0.2:0", 2023-10-06T02:23:42.824 INFO:teuthology.orchestra.run.smithi191.stdout: "nonce": 502297956 2023-10-06T02:23:42.824 INFO:teuthology.orchestra.run.smithi191.stdout: } 2023-10-06T02:23:42.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-06T02:23:42.824 INFO:teuthology.orchestra.run.smithi191.stdout: "addr": { 2023-10-06T02:23:42.824 INFO:teuthology.orchestra.run.smithi191.stdout: "type": "v1", 2023-10-06T02:23:42.824 INFO:teuthology.orchestra.run.smithi191.stdout: "addr": "192.168.0.2:0", 2023-10-06T02:23:42.824 INFO:teuthology.orchestra.run.smithi191.stdout: "nonce": 502297956 2023-10-06T02:23:42.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2023-10-06T02:23:42.824 INFO:teuthology.orchestra.run.smithi191.stdout: "inst_str": "client.4535 192.168.0.2:0/502297956", 2023-10-06T02:23:42.824 INFO:teuthology.orchestra.run.smithi191.stdout: "addr_str": "192.168.0.2:0/502297956", 2023-10-06T02:23:42.824 INFO:teuthology.orchestra.run.smithi191.stdout: "inode_count": 1, 2023-10-06T02:23:42.824 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_epoch": 7, 2023-10-06T02:23:42.825 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_epoch": 20, 2023-10-06T02:23:42.825 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:23:42.825 INFO:teuthology.orchestra.run.smithi191.stdout: "blocklisted": false, 2023-10-06T02:23:42.825 INFO:teuthology.orchestra.run.smithi191.stdout: "fs_name": "cephfs" 2023-10-06T02:23:42.825 INFO:teuthology.orchestra.run.smithi191.stdout:} 2023-10-06T02:23:42.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:42.831 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-10-06T02:23:42.832 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:23:42.850 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-10-06T02:23:42.851 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:23:42.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:42.851 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:23:42.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:42.924 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-10-06T02:23:42.925 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.2 2023-10-06T02:23:42.983 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-10-06T02:23:42.983 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-10-06T02:23:42.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:42.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T02:23:43.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:43.055 DEBUG:teuthology.orchestra.run.smithi191:> stat --file-system '--printf=%T 2023-10-06T02:23:43.055 DEBUG:teuthology.orchestra.run.smithi191:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-06T02:23:43.070 INFO:teuthology.orchestra.run.smithi191.stdout:fuseblk 2023-10-06T02:23:43.070 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-06T02:23:43.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:43.071 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:23:43.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:43.135 DEBUG:teuthology.orchestra.run.smithi191:> stat --file-system '--printf=%T 2023-10-06T02:23:43.135 DEBUG:teuthology.orchestra.run.smithi191:> ' -- /home/ubuntu/cephtest/mnt.3 2023-10-06T02:23:43.189 INFO:teuthology.orchestra.run.smithi191.stdout:fuseblk 2023-10-06T02:23:43.190 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-10-06T02:23:43.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:23:43.190 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T02:23:43.254 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T02:23:43.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:43.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.402+0000 7f9cdfbb5700 1 Processor -- start 2023-10-06T02:23:43.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.402+0000 7f9cdfbb5700 1 -- start start 2023-10-06T02:23:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.403+0000 7f9cdfbb5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9cd80c63a0 0x7f9cd815daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.403+0000 7f9cdfbb5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd815dfe0 0x7f9cd80cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.403+0000 7f9cdfbb5700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd80cb650 con 0x7f9cd8159760 2023-10-06T02:23:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.403+0000 7f9cdfbb5700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd80cc2d0 con 0x7f9cd80c63a0 2023-10-06T02:23:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.403+0000 7f9cdfbb5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd80cb930 con 0x7f9cd815dfe0 2023-10-06T02:23:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.403+0000 7f9cdd150700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9cd80c63a0 0x7f9cd815daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.403+0000 7f9cdd150700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9cd80c63a0 0x7f9cd815daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56598/0 (socket says 172.21.15.37:56598) 2023-10-06T02:23:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.403+0000 7f9cdd150700 1 -- 172.21.15.37:0/4194754367 learned_addr learned my addr 172.21.15.37:0/4194754367 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.403+0000 7f9cde152700 1 --2- 172.21.15.37:0/4194754367 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd815dfe0 0x7f9cd80cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.403+0000 7f9cdd150700 1 -- 172.21.15.37:0/4194754367 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd815dfe0 msgr2=0x7f9cd80cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.403+0000 7f9cdd150700 1 --2- 172.21.15.37:0/4194754367 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd815dfe0 0x7f9cd80cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.403+0000 7f9cdd150700 1 -- 172.21.15.37:0/4194754367 >> v1:172.21.15.191:6789/0 conn(0x7f9cd8159760 legacy=0x7f9cd815d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.403+0000 7f9cdc94f700 1 -- 172.21.15.37:0/4194754367 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759543124 0 0) 0x7f9cd80cb650 con 0x7f9cd8159760 2023-10-06T02:23:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.403+0000 7f9cdd150700 1 -- 172.21.15.37:0/4194754367 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd80cbc10 con 0x7f9cd80c63a0 2023-10-06T02:23:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.404+0000 7f9cdd150700 1 --2- 172.21.15.37:0/4194754367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd80c63a0 0x7f9cd815daa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0099b0 tx=0x7f9ccc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fbf50d873c0fdd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.404+0000 7f9cdc94f700 1 -- 172.21.15.37:0/4194754367 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc009ea0 con 0x7f9cd80c63a0 2023-10-06T02:23:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.404+0000 7f9cdc94f700 1 -- 172.21.15.37:0/4194754367 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ccc00b8f0 con 0x7f9cd80c63a0 2023-10-06T02:23:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.404+0000 7f9cdc94f700 1 -- 172.21.15.37:0/4194754367 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc00bc90 con 0x7f9cd80c63a0 2023-10-06T02:23:43.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.404+0000 7f9cdfbb5700 1 -- 172.21.15.37:0/4194754367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd80c63a0 msgr2=0x7f9cd815daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.404+0000 7f9cdfbb5700 1 --2- 172.21.15.37:0/4194754367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd80c63a0 0x7f9cd815daa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0099b0 tx=0x7f9ccc009250 comp rx=0 tx=0).stop 2023-10-06T02:23:43.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.404+0000 7f9cdfbb5700 1 -- 172.21.15.37:0/4194754367 shutdown_connections 2023-10-06T02:23:43.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.404+0000 7f9cdfbb5700 1 --2- 172.21.15.37:0/4194754367 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd815dfe0 0x7f9cd80cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.404+0000 7f9cdfbb5700 1 --2- 172.21.15.37:0/4194754367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd80c63a0 0x7f9cd815daa0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.404+0000 7f9cdfbb5700 1 -- 172.21.15.37:0/4194754367 >> 172.21.15.37:0/4194754367 conn(0x7f9cd806c890 msgr2=0x7f9cd80d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:43.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.404+0000 7f9cdfbb5700 1 -- 172.21.15.37:0/4194754367 shutdown_connections 2023-10-06T02:23:43.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.404+0000 7f9cdfbb5700 1 -- 172.21.15.37:0/4194754367 wait complete. 2023-10-06T02:23:43.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.405+0000 7f9cdfbb5700 1 Processor -- start 2023-10-06T02:23:43.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.406+0000 7f9cdfbb5700 1 -- start start 2023-10-06T02:23:43.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.406+0000 7f9cdfbb5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cd80c63a0 0x7f9cd816a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.406+0000 7f9cdfbb5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd8159760 0x7f9cd80b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.406+0000 7f9cdfbb5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd815dfe0 0x7f9cd814e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.406+0000 7f9cdfbb5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd814eb10 con 0x7f9cd815dfe0 2023-10-06T02:23:43.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.406+0000 7f9cdfbb5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd816a730 con 0x7f9cd80c63a0 2023-10-06T02:23:43.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.406+0000 7f9cdfbb5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd816aa10 con 0x7f9cd8159760 2023-10-06T02:23:43.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.406+0000 7f9cde152700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd815dfe0 0x7f9cd814e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.406+0000 7f9cde152700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd815dfe0 0x7f9cd814e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56608/0 (socket says 172.21.15.37:56608) 2023-10-06T02:23:43.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.406+0000 7f9cde152700 1 -- 172.21.15.37:0/1584228885 learned_addr learned my addr 172.21.15.37:0/1584228885 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:43.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.407+0000 7f9cdd951700 1 --2- 172.21.15.37:0/1584228885 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cd80c63a0 0x7f9cd816a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.407+0000 7f9cdd150700 1 --2- 172.21.15.37:0/1584228885 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd8159760 0x7f9cd80b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.407+0000 7f9cde152700 1 -- 172.21.15.37:0/1584228885 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd8159760 msgr2=0x7f9cd80b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.407+0000 7f9cde152700 1 --2- 172.21.15.37:0/1584228885 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd8159760 0x7f9cd80b5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.407+0000 7f9cde152700 1 -- 172.21.15.37:0/1584228885 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cd80c63a0 msgr2=0x7f9cd816a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.407+0000 7f9cde152700 1 --2- 172.21.15.37:0/1584228885 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cd80c63a0 0x7f9cd816a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.407+0000 7f9cde152700 1 -- 172.21.15.37:0/1584228885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ccc0094f0 con 0x7f9cd815dfe0 2023-10-06T02:23:43.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.407+0000 7f9cdd951700 1 --2- 172.21.15.37:0/1584228885 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cd80c63a0 0x7f9cd816a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:43.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.407+0000 7f9cdd150700 1 --2- 172.21.15.37:0/1584228885 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd8159760 0x7f9cd80b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:43.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.407+0000 7f9cde152700 1 --2- 172.21.15.37:0/1584228885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd815dfe0 0x7f9cd814e5d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000ea50 tx=0x7f9cd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:43.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.407+0000 7f9cd5ffb700 1 -- 172.21.15.37:0/1584228885 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd000c920 con 0x7f9cd815dfe0 2023-10-06T02:23:43.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.407+0000 7f9cd5ffb700 1 -- 172.21.15.37:0/1584228885 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd000caa0 con 0x7f9cd815dfe0 2023-10-06T02:23:43.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.407+0000 7f9cd5ffb700 1 -- 172.21.15.37:0/1584228885 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd000ce60 con 0x7f9cd815dfe0 2023-10-06T02:23:43.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.407+0000 7f9cdfbb5700 1 -- 172.21.15.37:0/1584228885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd816acf0 con 0x7f9cd815dfe0 2023-10-06T02:23:43.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.407+0000 7f9cdfbb5700 1 -- 172.21.15.37:0/1584228885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd80b33a0 con 0x7f9cd815dfe0 2023-10-06T02:23:43.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.408+0000 7f9cdfbb5700 1 -- 172.21.15.37:0/1584228885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd806dbd0 con 0x7f9cd815dfe0 2023-10-06T02:23:43.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.409+0000 7f9cd5ffb700 1 -- 172.21.15.37:0/1584228885 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9cd0013680 con 0x7f9cd815dfe0 2023-10-06T02:23:43.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.409+0000 7f9cd5ffb700 1 --2- 172.21.15.37:0/1584228885 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9cc4066f30 0x7f9cc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.409+0000 7f9cd5ffb700 1 -- 172.21.15.37:0/1584228885 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9cd0084ab0 con 0x7f9cd815dfe0 2023-10-06T02:23:43.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.409+0000 7f9cdd951700 1 --2- 172.21.15.37:0/1584228885 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9cc4066f30 0x7f9cc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.410+0000 7f9cdd951700 1 --2- 172.21.15.37:0/1584228885 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9cc4066f30 0x7f9cc40693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8007e90 tx=0x7f9cc8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:43.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.413+0000 7f9cd5ffb700 1 -- 172.21.15.37:0/1584228885 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9cd0051bc0 con 0x7f9cd815dfe0 2023-10-06T02:23:43.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.606+0000 7f9cdfbb5700 1 -- 172.21.15.37:0/1584228885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cd80b3590 con 0x7f9cd815dfe0 2023-10-06T02:23:43.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.607+0000 7f9cd5ffb700 1 -- 172.21.15.37:0/1584228885 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f9cd00551e0 con 0x7f9cd815dfe0 2023-10-06T02:23:43.609 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:43.609 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:23:16.897625+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:13.004596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:14.268809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:43.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.610+0000 7f9cdfbb5700 1 -- 172.21.15.37:0/1584228885 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9cc4066f30 msgr2=0x7f9cc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.610+0000 7f9cdfbb5700 1 --2- 172.21.15.37:0/1584228885 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9cc4066f30 0x7f9cc40693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8007e90 tx=0x7f9cc8009040 comp rx=0 tx=0).stop 2023-10-06T02:23:43.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.610+0000 7f9cdfbb5700 1 -- 172.21.15.37:0/1584228885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd815dfe0 msgr2=0x7f9cd814e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.610+0000 7f9cdfbb5700 1 --2- 172.21.15.37:0/1584228885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd815dfe0 0x7f9cd814e5d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000ea50 tx=0x7f9cd00091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.610+0000 7f9cdfbb5700 1 -- 172.21.15.37:0/1584228885 shutdown_connections 2023-10-06T02:23:43.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.610+0000 7f9cdfbb5700 1 --2- 172.21.15.37:0/1584228885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd815dfe0 0x7f9cd814e5d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.610+0000 7f9cdfbb5700 1 --2- 172.21.15.37:0/1584228885 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9cc4066f30 0x7f9cc40693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.610+0000 7f9cdfbb5700 1 --2- 172.21.15.37:0/1584228885 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cd80c63a0 0x7f9cd816a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.610+0000 7f9cdfbb5700 1 --2- 172.21.15.37:0/1584228885 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd8159760 0x7f9cd80b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.610+0000 7f9cdfbb5700 1 -- 172.21.15.37:0/1584228885 >> 172.21.15.37:0/1584228885 conn(0x7f9cd806c890 msgr2=0x7f9cd80c9990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:43.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.610+0000 7f9cdfbb5700 1 -- 172.21.15.37:0/1584228885 shutdown_connections 2023-10-06T02:23:43.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.610+0000 7f9cdfbb5700 1 -- 172.21.15.37:0/1584228885 wait complete. 2023-10-06T02:23:43.623 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:23:08.066048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:23:08.561964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:23:13.004596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:23:14.268809+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:23:43.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:23:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.745+0000 7f9e221d2700 1 Processor -- start 2023-10-06T02:23:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.745+0000 7f9e221d2700 1 -- start start 2023-10-06T02:23:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.745+0000 7f9e221d2700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9e1c1593c0 0x7f9e1c159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.745+0000 7f9e221d2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e1c0b2380 0x7f9e1c0b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.745+0000 7f9e221d2700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9e1c0ccb30 0x7f9e1c0ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.745+0000 7f9e221d2700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e1c0b07a0 con 0x7f9e1c0ccb30 2023-10-06T02:23:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.745+0000 7f9e221d2700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e1c0cd8a0 con 0x7f9e1c1593c0 2023-10-06T02:23:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.745+0000 7f9e221d2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c0afe70 con 0x7f9e1c0b2380 2023-10-06T02:23:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.746+0000 7f9e1bfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9e1c0ccb30 0x7f9e1c0ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.746+0000 7f9e1bfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9e1c0ccb30 0x7f9e1c0ccfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56616/0 (socket says 172.21.15.37:56616) 2023-10-06T02:23:43.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.746+0000 7f9e1bfff700 1 -- 172.21.15.37:0/1483844004 learned_addr learned my addr 172.21.15.37:0/1483844004 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:43.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.746+0000 7f9e1b7fe700 1 --2- 172.21.15.37:0/1483844004 >> v2:172.21.15.191:3300/0 conn(0x7f9e1c1593c0 0x7f9e1c159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.746+0000 7f9e1affd700 1 --2- 172.21.15.37:0/1483844004 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e1c0b2380 0x7f9e1c0b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.746+0000 7f9e1bfff700 1 -- 172.21.15.37:0/1483844004 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e1c0b2380 msgr2=0x7f9e1c0b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:43.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.746+0000 7f9e1bfff700 1 --2- 172.21.15.37:0/1483844004 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e1c0b2380 0x7f9e1c0b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.746+0000 7f9e1bfff700 1 -- 172.21.15.37:0/1483844004 >> v2:172.21.15.191:3300/0 conn(0x7f9e1c1593c0 msgr2=0x7f9e1c159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:43.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.746+0000 7f9e1bfff700 1 --2- 172.21.15.37:0/1483844004 >> v2:172.21.15.191:3300/0 conn(0x7f9e1c1593c0 0x7f9e1c159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.746+0000 7f9e1bfff700 1 -- 172.21.15.37:0/1483844004 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1c0b0150 con 0x7f9e1c0ccb30 2023-10-06T02:23:43.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.746+0000 7f9e1b7fe700 1 --2- 172.21.15.37:0/1483844004 >> v2:172.21.15.191:3300/0 conn(0x7f9e1c1593c0 0x7f9e1c159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:43.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.746+0000 7f9e1bfff700 1 --2- 172.21.15.37:0/1483844004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e1c0ccb30 0x7f9e1c0ccfb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c06d520 tx=0x7f9e14009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68649209a3cec692 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:43.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.746+0000 7f9e1a7fc700 1 -- 172.21.15.37:0/1483844004 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1400e070 con 0x7f9e1c0ccb30 2023-10-06T02:23:43.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.746+0000 7f9e1a7fc700 1 -- 172.21.15.37:0/1483844004 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1400ba50 con 0x7f9e1c0ccb30 2023-10-06T02:23:43.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.746+0000 7f9e1a7fc700 1 -- 172.21.15.37:0/1483844004 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e140092e0 con 0x7f9e1c0ccb30 2023-10-06T02:23:43.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.747+0000 7f9e221d2700 1 -- 172.21.15.37:0/1483844004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e1c0ccb30 msgr2=0x7f9e1c0ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.747+0000 7f9e221d2700 1 --2- 172.21.15.37:0/1483844004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e1c0ccb30 0x7f9e1c0ccfb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c06d520 tx=0x7f9e14009840 comp rx=0 tx=0).stop 2023-10-06T02:23:43.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.747+0000 7f9e221d2700 1 -- 172.21.15.37:0/1483844004 shutdown_connections 2023-10-06T02:23:43.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.747+0000 7f9e221d2700 1 --2- 172.21.15.37:0/1483844004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e1c0ccb30 0x7f9e1c0ccfb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.747+0000 7f9e221d2700 1 --2- 172.21.15.37:0/1483844004 >> v2:172.21.15.191:3300/0 conn(0x7f9e1c1593c0 0x7f9e1c159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.747+0000 7f9e221d2700 1 --2- 172.21.15.37:0/1483844004 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e1c0b2380 0x7f9e1c0b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.747+0000 7f9e221d2700 1 -- 172.21.15.37:0/1483844004 >> 172.21.15.37:0/1483844004 conn(0x7f9e1c06c0b0 msgr2=0x7f9e1c06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:43.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.747+0000 7f9e221d2700 1 -- 172.21.15.37:0/1483844004 shutdown_connections 2023-10-06T02:23:43.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.747+0000 7f9e221d2700 1 -- 172.21.15.37:0/1483844004 wait complete. 2023-10-06T02:23:43.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.748+0000 7f9e221d2700 1 Processor -- start 2023-10-06T02:23:43.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.748+0000 7f9e221d2700 1 -- start start 2023-10-06T02:23:43.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.749+0000 7f9e221d2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e1c0b2380 0x7f9e1c148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.749+0000 7f9e221d2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e1c0ccb30 0x7f9e1c0c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.749+0000 7f9e221d2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e1c1593c0 0x7f9e1c15e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.749+0000 7f9e221d2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c15c8f0 con 0x7f9e1c1593c0 2023-10-06T02:23:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.749+0000 7f9e221d2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c0c8840 con 0x7f9e1c0b2380 2023-10-06T02:23:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.749+0000 7f9e221d2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c0c8b20 con 0x7f9e1c0ccb30 2023-10-06T02:23:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.749+0000 7f9e1bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e1c1593c0 0x7f9e1c15e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.749+0000 7f9e1bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e1c1593c0 0x7f9e1c15e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56630/0 (socket says 172.21.15.37:56630) 2023-10-06T02:23:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.749+0000 7f9e1bfff700 1 -- 172.21.15.37:0/324514127 learned_addr learned my addr 172.21.15.37:0/324514127 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.749+0000 7f9e1b7fe700 1 --2- 172.21.15.37:0/324514127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e1c0b2380 0x7f9e1c148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.749+0000 7f9e1affd700 1 --2- 172.21.15.37:0/324514127 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e1c0ccb30 0x7f9e1c0c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.749+0000 7f9e1bfff700 1 -- 172.21.15.37:0/324514127 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e1c0ccb30 msgr2=0x7f9e1c0c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.749+0000 7f9e1bfff700 1 --2- 172.21.15.37:0/324514127 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e1c0ccb30 0x7f9e1c0c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.749+0000 7f9e1bfff700 1 -- 172.21.15.37:0/324514127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e1c0b2380 msgr2=0x7f9e1c148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.749+0000 7f9e1bfff700 1 --2- 172.21.15.37:0/324514127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e1c0b2380 0x7f9e1c148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.749+0000 7f9e1bfff700 1 -- 172.21.15.37:0/324514127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e14009ae0 con 0x7f9e1c1593c0 2023-10-06T02:23:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.749+0000 7f9e1bfff700 1 --2- 172.21.15.37:0/324514127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e1c1593c0 0x7f9e1c15e500 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c0894a0 tx=0x7f9e14018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.750+0000 7f9e037fe700 1 -- 172.21.15.37:0/324514127 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e140032f0 con 0x7f9e1c1593c0 2023-10-06T02:23:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.750+0000 7f9e037fe700 1 -- 172.21.15.37:0/324514127 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e14008ce0 con 0x7f9e1c1593c0 2023-10-06T02:23:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.750+0000 7f9e221d2700 1 -- 172.21.15.37:0/324514127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e1c15c580 con 0x7f9e1c1593c0 2023-10-06T02:23:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.750+0000 7f9e037fe700 1 -- 172.21.15.37:0/324514127 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e140266b0 con 0x7f9e1c1593c0 2023-10-06T02:23:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.750+0000 7f9e221d2700 1 -- 172.21.15.37:0/324514127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e1c0c8430 con 0x7f9e1c1593c0 2023-10-06T02:23:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.751+0000 7f9e221d2700 1 -- 172.21.15.37:0/324514127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e1c15caa0 con 0x7f9e1c1593c0 2023-10-06T02:23:43.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.751+0000 7f9e037fe700 1 -- 172.21.15.37:0/324514127 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e14003040 con 0x7f9e1c1593c0 2023-10-06T02:23:43.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.751+0000 7f9e037fe700 1 --2- 172.21.15.37:0/324514127 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9e08066f30 0x7f9e080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:43.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.751+0000 7f9e037fe700 1 -- 172.21.15.37:0/324514127 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9e140864e0 con 0x7f9e1c1593c0 2023-10-06T02:23:43.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.752+0000 7f9e1b7fe700 1 --2- 172.21.15.37:0/324514127 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9e08066f30 0x7f9e080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:43.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.752+0000 7f9e1b7fe700 1 --2- 172.21.15.37:0/324514127 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9e08066f30 0x7f9e080693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c0d01e0 tx=0x7f9e0c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:43.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.756+0000 7f9e037fe700 1 -- 172.21.15.37:0/324514127 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e1c15caa0 con 0x7f9e1c1593c0 2023-10-06T02:23:43.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.948+0000 7f9e221d2700 1 -- 172.21.15.37:0/324514127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9e1c15c3d0 con 0x7f9e1c1593c0 2023-10-06T02:23:43.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.948+0000 7f9e037fe700 1 -- 172.21.15.37:0/324514127 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9e140535f0 con 0x7f9e1c1593c0 2023-10-06T02:23:43.950 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T02:23:43.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.950+0000 7f9e221d2700 1 -- 172.21.15.37:0/324514127 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9e08066f30 msgr2=0x7f9e080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.950+0000 7f9e221d2700 1 --2- 172.21.15.37:0/324514127 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9e08066f30 0x7f9e080693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c0d01e0 tx=0x7f9e0c008040 comp rx=0 tx=0).stop 2023-10-06T02:23:43.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.950+0000 7f9e221d2700 1 -- 172.21.15.37:0/324514127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e1c1593c0 msgr2=0x7f9e1c15e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:43.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.950+0000 7f9e221d2700 1 --2- 172.21.15.37:0/324514127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e1c1593c0 0x7f9e1c15e500 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c0894a0 tx=0x7f9e14018000 comp rx=0 tx=0).stop 2023-10-06T02:23:43.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.950+0000 7f9e221d2700 1 -- 172.21.15.37:0/324514127 shutdown_connections 2023-10-06T02:23:43.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.950+0000 7f9e221d2700 1 --2- 172.21.15.37:0/324514127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e1c1593c0 0x7f9e1c15e500 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.950+0000 7f9e221d2700 1 --2- 172.21.15.37:0/324514127 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9e08066f30 0x7f9e080693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.950+0000 7f9e221d2700 1 --2- 172.21.15.37:0/324514127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e1c0b2380 0x7f9e1c148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.950+0000 7f9e221d2700 1 --2- 172.21.15.37:0/324514127 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e1c0ccb30 0x7f9e1c0c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:43.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.950+0000 7f9e221d2700 1 -- 172.21.15.37:0/324514127 >> 172.21.15.37:0/324514127 conn(0x7f9e1c06c0b0 msgr2=0x7f9e1c0cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:43.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.950+0000 7f9e221d2700 1 -- 172.21.15.37:0/324514127 shutdown_connections 2023-10-06T02:23:43.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:43.950+0000 7f9e221d2700 1 -- 172.21.15.37:0/324514127 wait complete. 2023-10-06T02:23:43.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:23:44.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.084+0000 7ff8e2f64700 1 Processor -- start 2023-10-06T02:23:44.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.084+0000 7ff8e2f64700 1 -- start start 2023-10-06T02:23:44.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.085+0000 7ff8e2f64700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff8dc1593c0 0x7ff8dc159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.085+0000 7ff8e2f64700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff8dc0b2380 0x7ff8dc0b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.085+0000 7ff8e2f64700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc0b07a0 con 0x7ff8dc0ccb30 2023-10-06T02:23:44.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.085+0000 7ff8e2f64700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8dc0cd6c0 con 0x7ff8dc0b2380 2023-10-06T02:23:44.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.085+0000 7ff8e2f64700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc0cd8a0 con 0x7ff8dc1593c0 2023-10-06T02:23:44.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.085+0000 7ff8dbfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff8dc0b2380 0x7ff8dc0b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.085+0000 7ff8e1501700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff8dc0ccb30 0x7ff8dc0ccfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38312/0 (socket says 172.21.15.37:38312) 2023-10-06T02:23:44.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.085+0000 7ff8dbfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff8dc0b2380 0x7ff8dc0b27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56632/0 (socket says 172.21.15.37:56632) 2023-10-06T02:23:44.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.085+0000 7ff8e1501700 1 -- 172.21.15.37:0/392925981 learned_addr learned my addr 172.21.15.37:0/392925981 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:44.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.085+0000 7ff8e0d00700 1 --2- 172.21.15.37:0/392925981 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff8dc1593c0 0x7ff8dc159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.086+0000 7ff8dbfff700 1 -- 172.21.15.37:0/392925981 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff8dc1593c0 msgr2=0x7ff8dc159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:44.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.086+0000 7ff8dbfff700 1 --2- 172.21.15.37:0/392925981 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff8dc1593c0 0x7ff8dc159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.086+0000 7ff8dbfff700 1 -- 172.21.15.37:0/392925981 >> v1:172.21.15.37:6789/0 conn(0x7ff8dc0ccb30 legacy=0x7ff8dc0ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.086+0000 7ff8dbfff700 1 -- 172.21.15.37:0/392925981 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc0afe70 con 0x7ff8dc0b2380 2023-10-06T02:23:44.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.086+0000 7ff8db7fe700 1 -- 172.21.15.37:0/392925981 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774173923 0 0) 0x7ff8dc0b07a0 con 0x7ff8dc0ccb30 2023-10-06T02:23:44.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.086+0000 7ff8dbfff700 1 --2- 172.21.15.37:0/392925981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc0b2380 0x7ff8dc0b27f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40098e0 tx=0x7ff8c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12251f6cbdd030c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:44.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.086+0000 7ff8db7fe700 1 -- 172.21.15.37:0/392925981 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c400b640 con 0x7ff8dc0b2380 2023-10-06T02:23:44.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.086+0000 7ff8db7fe700 1 -- 172.21.15.37:0/392925981 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c400b7a0 con 0x7ff8dc0b2380 2023-10-06T02:23:44.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.086+0000 7ff8db7fe700 1 -- 172.21.15.37:0/392925981 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c400bb40 con 0x7ff8dc0b2380 2023-10-06T02:23:44.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.086+0000 7ff8e2f64700 1 -- 172.21.15.37:0/392925981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc0b2380 msgr2=0x7ff8dc0b27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.086+0000 7ff8e2f64700 1 --2- 172.21.15.37:0/392925981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc0b2380 0x7ff8dc0b27f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40098e0 tx=0x7ff8c40091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.087+0000 7ff8e2f64700 1 -- 172.21.15.37:0/392925981 shutdown_connections 2023-10-06T02:23:44.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.087+0000 7ff8e2f64700 1 --2- 172.21.15.37:0/392925981 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff8dc1593c0 0x7ff8dc159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.087+0000 7ff8e2f64700 1 --2- 172.21.15.37:0/392925981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc0b2380 0x7ff8dc0b27f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.087+0000 7ff8e2f64700 1 -- 172.21.15.37:0/392925981 >> 172.21.15.37:0/392925981 conn(0x7ff8dc06c0b0 msgr2=0x7ff8dc06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:44.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.087+0000 7ff8e2f64700 1 -- 172.21.15.37:0/392925981 shutdown_connections 2023-10-06T02:23:44.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.087+0000 7ff8e2f64700 1 -- 172.21.15.37:0/392925981 wait complete. 2023-10-06T02:23:44.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.088+0000 7ff8e2f64700 1 Processor -- start 2023-10-06T02:23:44.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.088+0000 7ff8e2f64700 1 -- start start 2023-10-06T02:23:44.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.088+0000 7ff8e2f64700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc0b2380 0x7ff8dc0c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8e2f64700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8dc0ccb30 0x7ff8dc14a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8e2f64700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff8dc1593c0 0x7ff8dc0cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8e2f64700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc169c80 con 0x7ff8dc0b2380 2023-10-06T02:23:44.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8e2f64700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc169f40 con 0x7ff8dc0ccb30 2023-10-06T02:23:44.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8e2f64700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc16a220 con 0x7ff8dc1593c0 2023-10-06T02:23:44.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8e0d00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc0b2380 0x7ff8dc0c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8e0d00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc0b2380 0x7ff8dc0c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56646/0 (socket says 172.21.15.37:56646) 2023-10-06T02:23:44.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8e0d00700 1 -- 172.21.15.37:0/2063933354 learned_addr learned my addr 172.21.15.37:0/2063933354 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:44.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8e1501700 1 --2- 172.21.15.37:0/2063933354 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff8dc1593c0 0x7ff8dc0cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8dbfff700 1 --2- 172.21.15.37:0/2063933354 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8dc0ccb30 0x7ff8dc14a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8e0d00700 1 -- 172.21.15.37:0/2063933354 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff8dc1593c0 msgr2=0x7ff8dc0cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8e0d00700 1 --2- 172.21.15.37:0/2063933354 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff8dc1593c0 0x7ff8dc0cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8e0d00700 1 -- 172.21.15.37:0/2063933354 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8dc0ccb30 msgr2=0x7ff8dc14a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8e0d00700 1 --2- 172.21.15.37:0/2063933354 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8dc0ccb30 0x7ff8dc14a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8e0d00700 1 -- 172.21.15.37:0/2063933354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c4009420 con 0x7ff8dc0b2380 2023-10-06T02:23:44.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8e0d00700 1 --2- 172.21.15.37:0/2063933354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc0b2380 0x7ff8dc0c7530 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009e50 tx=0x7ff8d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:44.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8d8ff9700 1 -- 172.21.15.37:0/2063933354 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d400caa0 con 0x7ff8dc0b2380 2023-10-06T02:23:44.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8d8ff9700 1 -- 172.21.15.37:0/2063933354 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d400f040 con 0x7ff8dc0b2380 2023-10-06T02:23:44.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8e2f64700 1 -- 172.21.15.37:0/2063933354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8dc16a500 con 0x7ff8dc0b2380 2023-10-06T02:23:44.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8d8ff9700 1 -- 172.21.15.37:0/2063933354 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d400ce30 con 0x7ff8dc0b2380 2023-10-06T02:23:44.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.089+0000 7ff8e2f64700 1 -- 172.21.15.37:0/2063933354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8dc16aac0 con 0x7ff8dc0b2380 2023-10-06T02:23:44.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.090+0000 7ff8e2f64700 1 -- 172.21.15.37:0/2063933354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8dc088bb0 con 0x7ff8dc0b2380 2023-10-06T02:23:44.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.091+0000 7ff8d8ff9700 1 -- 172.21.15.37:0/2063933354 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff8d4014690 con 0x7ff8dc0b2380 2023-10-06T02:23:44.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.091+0000 7ff8d8ff9700 1 --2- 172.21.15.37:0/2063933354 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff8bc066f30 0x7ff8bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.091+0000 7ff8d8ff9700 1 -- 172.21.15.37:0/2063933354 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff8d4084f40 con 0x7ff8dc0b2380 2023-10-06T02:23:44.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.091+0000 7ff8dbfff700 1 --2- 172.21.15.37:0/2063933354 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff8bc066f30 0x7ff8bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.092+0000 7ff8dbfff700 1 --2- 172.21.15.37:0/2063933354 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff8bc066f30 0x7ff8bc0693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40093f0 tx=0x7ff8c4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:44.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.095+0000 7ff8d8ff9700 1 -- 172.21.15.37:0/2063933354 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8d4052050 con 0x7ff8dc0b2380 2023-10-06T02:23:44.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.289+0000 7ff8e2f64700 1 -- 172.21.15.37:0/2063933354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff8dc0b0150 con 0x7ff8dc0b2380 2023-10-06T02:23:44.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.289+0000 7ff8d8ff9700 1 -- 172.21.15.37:0/2063933354 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff8d4055670 con 0x7ff8dc0b2380 2023-10-06T02:23:44.291 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T02:23:44.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.291+0000 7ff8e2f64700 1 -- 172.21.15.37:0/2063933354 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff8bc066f30 msgr2=0x7ff8bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.291+0000 7ff8e2f64700 1 --2- 172.21.15.37:0/2063933354 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff8bc066f30 0x7ff8bc0693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40093f0 tx=0x7ff8c4017000 comp rx=0 tx=0).stop 2023-10-06T02:23:44.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.291+0000 7ff8e2f64700 1 -- 172.21.15.37:0/2063933354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc0b2380 msgr2=0x7ff8dc0c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.291+0000 7ff8e2f64700 1 --2- 172.21.15.37:0/2063933354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc0b2380 0x7ff8dc0c7530 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009e50 tx=0x7ff8d400b040 comp rx=0 tx=0).stop 2023-10-06T02:23:44.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.291+0000 7ff8e2f64700 1 -- 172.21.15.37:0/2063933354 shutdown_connections 2023-10-06T02:23:44.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.291+0000 7ff8e2f64700 1 --2- 172.21.15.37:0/2063933354 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff8dc1593c0 0x7ff8dc0cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.291+0000 7ff8e2f64700 1 --2- 172.21.15.37:0/2063933354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc0b2380 0x7ff8dc0c7530 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.291+0000 7ff8e2f64700 1 --2- 172.21.15.37:0/2063933354 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff8bc066f30 0x7ff8bc0693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.291+0000 7ff8e2f64700 1 --2- 172.21.15.37:0/2063933354 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8dc0ccb30 0x7ff8dc14a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.291+0000 7ff8e2f64700 1 -- 172.21.15.37:0/2063933354 >> 172.21.15.37:0/2063933354 conn(0x7ff8dc06c0b0 msgr2=0x7ff8dc158860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:44.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.291+0000 7ff8e2f64700 1 -- 172.21.15.37:0/2063933354 shutdown_connections 2023-10-06T02:23:44.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.291+0000 7ff8e2f64700 1 -- 172.21.15.37:0/2063933354 wait complete. 2023-10-06T02:23:44.305 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:23:44.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.425+0000 7f6cf13e1700 1 Processor -- start 2023-10-06T02:23:44.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.425+0000 7f6cf13e1700 1 -- start start 2023-10-06T02:23:44.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.426+0000 7f6cf13e1700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6cec0b29d0 0x7f6cec0ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.426+0000 7f6cf13e1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0cb170 0x7f6cec0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.426+0000 7f6cf13e1700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cec0b2da0 con 0x7f6cec0cf340 2023-10-06T02:23:44.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.426+0000 7f6cf13e1700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cec099bd0 con 0x7f6cec0b29d0 2023-10-06T02:23:44.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.426+0000 7f6cf13e1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec159a70 con 0x7f6cec0cb170 2023-10-06T02:23:44.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.426+0000 7f6cf0be0700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6cec0cf340 0x7f6cec0c5170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38320/0 (socket says 172.21.15.37:38320) 2023-10-06T02:23:44.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.426+0000 7f6cf0be0700 1 -- 172.21.15.37:0/371430792 learned_addr learned my addr 172.21.15.37:0/371430792 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:44.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.426+0000 7f6cebfff700 1 --2- 172.21.15.37:0/371430792 >> v2:172.21.15.191:3300/0 conn(0x7f6cec0b29d0 0x7f6cec0ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.426+0000 7f6ceb7fe700 1 --2- 172.21.15.37:0/371430792 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0cb170 0x7f6cec0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.426+0000 7f6ceaffd700 1 -- 172.21.15.37:0/371430792 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059635288 0 0) 0x7f6ce4001490 con 0x7f6cec0cf340 2023-10-06T02:23:44.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.427+0000 7f6ceaffd700 1 -- 172.21.15.37:0/371430792 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cd8003570 con 0x7f6cec0cf340 2023-10-06T02:23:44.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.427+0000 7f6cebfff700 1 -- 172.21.15.37:0/371430792 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0cb170 msgr2=0x7f6cec0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:44.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.427+0000 7f6cebfff700 1 --2- 172.21.15.37:0/371430792 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0cb170 0x7f6cec0cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.427+0000 7f6cebfff700 1 -- 172.21.15.37:0/371430792 >> v1:172.21.15.37:6789/0 conn(0x7f6cec0cf340 legacy=0x7f6cec0c5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.427+0000 7f6cebfff700 1 -- 172.21.15.37:0/371430792 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec0cb5e0 con 0x7f6cec0b29d0 2023-10-06T02:23:44.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.427+0000 7f6ceb7fe700 1 --2- 172.21.15.37:0/371430792 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0cb170 0x7f6cec0cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:44.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.427+0000 7f6cebfff700 1 --2- 172.21.15.37:0/371430792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cec0b29d0 0x7f6cec0ce8c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc0098e0 tx=0x7f6cdc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc0b0cc702be5499 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:44.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.427+0000 7f6ceaffd700 1 -- 172.21.15.37:0/371430792 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc011630 con 0x7f6cec0b29d0 2023-10-06T02:23:44.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.427+0000 7f6ceaffd700 1 -- 172.21.15.37:0/371430792 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cdc011790 con 0x7f6cec0b29d0 2023-10-06T02:23:44.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.427+0000 7f6ceaffd700 1 -- 172.21.15.37:0/371430792 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc011b30 con 0x7f6cec0b29d0 2023-10-06T02:23:44.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.428+0000 7f6cf13e1700 1 -- 172.21.15.37:0/371430792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cec0b29d0 msgr2=0x7f6cec0ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.428+0000 7f6cf13e1700 1 --2- 172.21.15.37:0/371430792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cec0b29d0 0x7f6cec0ce8c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc0098e0 tx=0x7f6cdc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.428+0000 7f6cf13e1700 1 -- 172.21.15.37:0/371430792 shutdown_connections 2023-10-06T02:23:44.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.428+0000 7f6cf13e1700 1 --2- 172.21.15.37:0/371430792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cec0b29d0 0x7f6cec0ce8c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.428+0000 7f6cf13e1700 1 --2- 172.21.15.37:0/371430792 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0cb170 0x7f6cec0cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.428+0000 7f6cf13e1700 1 -- 172.21.15.37:0/371430792 >> 172.21.15.37:0/371430792 conn(0x7f6cec099610 msgr2=0x7f6cec06c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:44.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.428+0000 7f6cf13e1700 1 -- 172.21.15.37:0/371430792 shutdown_connections 2023-10-06T02:23:44.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.428+0000 7f6cf13e1700 1 -- 172.21.15.37:0/371430792 wait complete. 2023-10-06T02:23:44.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.429+0000 7f6cf13e1700 1 Processor -- start 2023-10-06T02:23:44.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.429+0000 7f6cf13e1700 1 -- start start 2023-10-06T02:23:44.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.430+0000 7f6cf13e1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0b29d0 0x7f6cec15ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.430+0000 7f6cf13e1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cec0cb170 0x7f6cec0cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.430+0000 7f6cf13e1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cec0cf340 0x7f6cec16d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.430+0000 7f6cf13e1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec149640 con 0x7f6cec0cf340 2023-10-06T02:23:44.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.430+0000 7f6cf13e1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec0b3ac0 con 0x7f6cec0cb170 2023-10-06T02:23:44.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.430+0000 7f6cf13e1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec14ce00 con 0x7f6cec0b29d0 2023-10-06T02:23:44.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.430+0000 7f6cf0be0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cec0cf340 0x7f6cec16d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.430+0000 7f6cf0be0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cec0cf340 0x7f6cec16d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56654/0 (socket says 172.21.15.37:56654) 2023-10-06T02:23:44.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.430+0000 7f6cf0be0700 1 -- 172.21.15.37:0/3139338645 learned_addr learned my addr 172.21.15.37:0/3139338645 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:44.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.430+0000 7f6ceb7fe700 1 --2- 172.21.15.37:0/3139338645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cec0cb170 0x7f6cec0cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.430+0000 7f6cebfff700 1 --2- 172.21.15.37:0/3139338645 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0b29d0 0x7f6cec15ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.430+0000 7f6cf0be0700 1 -- 172.21.15.37:0/3139338645 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0b29d0 msgr2=0x7f6cec15ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.430+0000 7f6cf0be0700 1 --2- 172.21.15.37:0/3139338645 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0b29d0 0x7f6cec15ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.430+0000 7f6cf0be0700 1 -- 172.21.15.37:0/3139338645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cec0cb170 msgr2=0x7f6cec0cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.430+0000 7f6cf0be0700 1 --2- 172.21.15.37:0/3139338645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cec0cb170 0x7f6cec0cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.430+0000 7f6cf0be0700 1 -- 172.21.15.37:0/3139338645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd4009420 con 0x7f6cec0cf340 2023-10-06T02:23:44.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.430+0000 7f6cf0be0700 1 --2- 172.21.15.37:0/3139338645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cec0cf340 0x7f6cec16d3a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400cc40 tx=0x7f6ce4001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:44.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.430+0000 7f6ce3fff700 1 -- 172.21.15.37:0/3139338645 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce400a960 con 0x7f6cec0cf340 2023-10-06T02:23:44.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.431+0000 7f6ce3fff700 1 -- 172.21.15.37:0/3139338645 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce400aac0 con 0x7f6cec0cf340 2023-10-06T02:23:44.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.431+0000 7f6cf13e1700 1 -- 172.21.15.37:0/3139338645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cdc009420 con 0x7f6cec0cf340 2023-10-06T02:23:44.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.431+0000 7f6ce3fff700 1 -- 172.21.15.37:0/3139338645 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce400ae40 con 0x7f6cec0cf340 2023-10-06T02:23:44.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.431+0000 7f6cf13e1700 1 -- 172.21.15.37:0/3139338645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cec14d660 con 0x7f6cec0cf340 2023-10-06T02:23:44.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.432+0000 7f6cf13e1700 1 -- 172.21.15.37:0/3139338645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cec0891a0 con 0x7f6cec0cf340 2023-10-06T02:23:44.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.432+0000 7f6ce3fff700 1 -- 172.21.15.37:0/3139338645 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ce4007300 con 0x7f6cec0cf340 2023-10-06T02:23:44.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.432+0000 7f6ce3fff700 1 --2- 172.21.15.37:0/3139338645 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ccc066f30 0x7f6ccc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.433+0000 7f6ce3fff700 1 -- 172.21.15.37:0/3139338645 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6ce4084980 con 0x7f6cec0cf340 2023-10-06T02:23:44.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.433+0000 7f6cebfff700 1 --2- 172.21.15.37:0/3139338645 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ccc066f30 0x7f6ccc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.433+0000 7f6cebfff700 1 --2- 172.21.15.37:0/3139338645 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ccc066f30 0x7f6ccc0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc0091e0 tx=0x7f6cdc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:44.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.437+0000 7f6ce3fff700 1 -- 172.21.15.37:0/3139338645 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ce4051b10 con 0x7f6cec0cf340 2023-10-06T02:23:44.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.630+0000 7f6cf13e1700 1 -- 172.21.15.37:0/3139338645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6cec0b2da0 con 0x7f6cec0cf340 2023-10-06T02:23:44.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.630+0000 7f6ce3fff700 1 -- 172.21.15.37:0/3139338645 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6cec0b2da0 con 0x7f6cec0cf340 2023-10-06T02:23:44.632 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T02:23:44.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.632+0000 7f6cf13e1700 1 -- 172.21.15.37:0/3139338645 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ccc066f30 msgr2=0x7f6ccc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.632+0000 7f6cf13e1700 1 --2- 172.21.15.37:0/3139338645 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ccc066f30 0x7f6ccc0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc0091e0 tx=0x7f6cdc017000 comp rx=0 tx=0).stop 2023-10-06T02:23:44.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.632+0000 7f6cf13e1700 1 -- 172.21.15.37:0/3139338645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cec0cf340 msgr2=0x7f6cec16d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.632+0000 7f6cf13e1700 1 --2- 172.21.15.37:0/3139338645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cec0cf340 0x7f6cec16d3a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400cc40 tx=0x7f6ce4001a30 comp rx=0 tx=0).stop 2023-10-06T02:23:44.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.633+0000 7f6cf13e1700 1 -- 172.21.15.37:0/3139338645 shutdown_connections 2023-10-06T02:23:44.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.633+0000 7f6cf13e1700 1 --2- 172.21.15.37:0/3139338645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cec0cf340 0x7f6cec16d3a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.633+0000 7f6cf13e1700 1 --2- 172.21.15.37:0/3139338645 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0b29d0 0x7f6cec15ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.633+0000 7f6cf13e1700 1 --2- 172.21.15.37:0/3139338645 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ccc066f30 0x7f6ccc0693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.633+0000 7f6cf13e1700 1 --2- 172.21.15.37:0/3139338645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cec0cb170 0x7f6cec0cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.633+0000 7f6cf13e1700 1 -- 172.21.15.37:0/3139338645 >> 172.21.15.37:0/3139338645 conn(0x7f6cec099610 msgr2=0x7f6cec15fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:44.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.633+0000 7f6cf13e1700 1 -- 172.21.15.37:0/3139338645 shutdown_connections 2023-10-06T02:23:44.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.633+0000 7f6cf13e1700 1 -- 172.21.15.37:0/3139338645 wait complete. 2023-10-06T02:23:44.646 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:23:44.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.767+0000 7fbef00b6700 1 Processor -- start 2023-10-06T02:23:44.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.767+0000 7fbef00b6700 1 -- start start 2023-10-06T02:23:44.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.768+0000 7fbef00b6700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbee81593c0 0x7fbee8159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.768+0000 7fbef00b6700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee80b07a0 con 0x7fbee80b2380 2023-10-06T02:23:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.768+0000 7fbef00b6700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee80cd8a0 con 0x7fbee80ccb30 2023-10-06T02:23:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.768+0000 7fbef00b6700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee80cd6a0 con 0x7fbee81593c0 2023-10-06T02:23:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.768+0000 7fbeede52700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbee81593c0 0x7fbee8159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.768+0000 7fbeed651700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbee80b2380 0x7fbee80b2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38334/0 (socket says 172.21.15.37:38334) 2023-10-06T02:23:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.768+0000 7fbeede52700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbee81593c0 0x7fbee8159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56658/0 (socket says 172.21.15.37:56658) 2023-10-06T02:23:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.768+0000 7fbeed651700 1 -- 172.21.15.37:0/218175638 learned_addr learned my addr 172.21.15.37:0/218175638 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.768+0000 7fbeede52700 1 -- 172.21.15.37:0/218175638 >> v1:172.21.15.191:6789/0 conn(0x7fbee80ccb30 legacy=0x7fbee80ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.768+0000 7fbeede52700 1 -- 172.21.15.37:0/218175638 >> v1:172.21.15.37:6789/0 conn(0x7fbee80b2380 legacy=0x7fbee80b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.768+0000 7fbeede52700 1 -- 172.21.15.37:0/218175638 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee80afe70 con 0x7fbee81593c0 2023-10-06T02:23:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.768+0000 7fbeece50700 1 -- 172.21.15.37:0/218175638 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153091871 0 0) 0x7fbee80b07a0 con 0x7fbee80b2380 2023-10-06T02:23:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.768+0000 7fbeede52700 1 --2- 172.21.15.37:0/218175638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbee81593c0 0x7fbee8159790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbee40098e0 tx=0x7fbee40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36bc754a427fc27b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.768+0000 7fbeece50700 1 -- 172.21.15.37:0/218175638 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4009e80 con 0x7fbee81593c0 2023-10-06T02:23:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.768+0000 7fbeece50700 1 -- 172.21.15.37:0/218175638 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee400b820 con 0x7fbee81593c0 2023-10-06T02:23:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.768+0000 7fbeece50700 1 -- 172.21.15.37:0/218175638 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee400bba0 con 0x7fbee81593c0 2023-10-06T02:23:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.769+0000 7fbef00b6700 1 -- 172.21.15.37:0/218175638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbee81593c0 msgr2=0x7fbee8159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.769+0000 7fbef00b6700 1 --2- 172.21.15.37:0/218175638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbee81593c0 0x7fbee8159790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbee40098e0 tx=0x7fbee40091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.769+0000 7fbef00b6700 1 -- 172.21.15.37:0/218175638 shutdown_connections 2023-10-06T02:23:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.769+0000 7fbef00b6700 1 --2- 172.21.15.37:0/218175638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbee81593c0 0x7fbee8159790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.769+0000 7fbef00b6700 1 -- 172.21.15.37:0/218175638 >> 172.21.15.37:0/218175638 conn(0x7fbee806c0b0 msgr2=0x7fbee806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.769+0000 7fbef00b6700 1 -- 172.21.15.37:0/218175638 shutdown_connections 2023-10-06T02:23:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.769+0000 7fbef00b6700 1 -- 172.21.15.37:0/218175638 wait complete. 2023-10-06T02:23:44.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.770+0000 7fbef00b6700 1 Processor -- start 2023-10-06T02:23:44.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.770+0000 7fbef00b6700 1 -- start start 2023-10-06T02:23:44.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.771+0000 7fbef00b6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbee80b2380 0x7fbee8146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.771+0000 7fbef00b6700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbee80ccb30 0x7fbee80c6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.771+0000 7fbef00b6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbee81593c0 0x7fbee816a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.771+0000 7fbef00b6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee8147200 con 0x7fbee80b2380 2023-10-06T02:23:44.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.771+0000 7fbef00b6700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee80c61a0 con 0x7fbee80ccb30 2023-10-06T02:23:44.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.771+0000 7fbef00b6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee80c55d0 con 0x7fbee81593c0 2023-10-06T02:23:44.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.771+0000 7fbeede52700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbee80b2380 0x7fbee8146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.771+0000 7fbeede52700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbee80b2380 0x7fbee8146cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56670/0 (socket says 172.21.15.37:56670) 2023-10-06T02:23:44.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.771+0000 7fbeede52700 1 -- 172.21.15.37:0/2151614129 learned_addr learned my addr 172.21.15.37:0/2151614129 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:44.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.771+0000 7fbeed651700 1 --2- 172.21.15.37:0/2151614129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbee80ccb30 0x7fbee80c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.771+0000 7fbeee653700 1 --2- 172.21.15.37:0/2151614129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbee81593c0 0x7fbee816a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.771+0000 7fbeede52700 1 -- 172.21.15.37:0/2151614129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbee81593c0 msgr2=0x7fbee816a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.771+0000 7fbeede52700 1 --2- 172.21.15.37:0/2151614129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbee81593c0 0x7fbee816a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.771+0000 7fbeede52700 1 -- 172.21.15.37:0/2151614129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbee80ccb30 msgr2=0x7fbee80c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.771+0000 7fbeede52700 1 --2- 172.21.15.37:0/2151614129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbee80ccb30 0x7fbee80c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.771+0000 7fbeede52700 1 -- 172.21.15.37:0/2151614129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee4009420 con 0x7fbee80b2380 2023-10-06T02:23:44.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.771+0000 7fbeede52700 1 --2- 172.21.15.37:0/2151614129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbee80b2380 0x7fbee8146cc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbee80894a0 tx=0x7fbee4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:44.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.771+0000 7fbeddffb700 1 -- 172.21.15.37:0/2151614129 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee400bae0 con 0x7fbee80b2380 2023-10-06T02:23:44.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.772+0000 7fbeddffb700 1 -- 172.21.15.37:0/2151614129 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee4020070 con 0x7fbee80b2380 2023-10-06T02:23:44.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.772+0000 7fbef00b6700 1 -- 172.21.15.37:0/2151614129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee80c5870 con 0x7fbee80b2380 2023-10-06T02:23:44.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.772+0000 7fbeddffb700 1 -- 172.21.15.37:0/2151614129 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee401b6a0 con 0x7fbee80b2380 2023-10-06T02:23:44.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.772+0000 7fbef00b6700 1 -- 172.21.15.37:0/2151614129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee80c5e30 con 0x7fbee80b2380 2023-10-06T02:23:44.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.773+0000 7fbef00b6700 1 -- 172.21.15.37:0/2151614129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee80c6480 con 0x7fbee80b2380 2023-10-06T02:23:44.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.773+0000 7fbeddffb700 1 -- 172.21.15.37:0/2151614129 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbee4022030 con 0x7fbee80b2380 2023-10-06T02:23:44.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.774+0000 7fbeddffb700 1 --2- 172.21.15.37:0/2151614129 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbecc066f30 0x7fbecc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:44.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.774+0000 7fbeddffb700 1 -- 172.21.15.37:0/2151614129 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbee40866d0 con 0x7fbee80b2380 2023-10-06T02:23:44.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.774+0000 7fbeed651700 1 --2- 172.21.15.37:0/2151614129 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbecc066f30 0x7fbecc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:44.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.774+0000 7fbeed651700 1 --2- 172.21.15.37:0/2151614129 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbecc066f30 0x7fbecc0693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbee80c5480 tx=0x7fbed8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:44.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.778+0000 7fbeddffb700 1 -- 172.21.15.37:0/2151614129 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbee4053740 con 0x7fbee80b2380 2023-10-06T02:23:44.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.969+0000 7fbef00b6700 1 -- 172.21.15.37:0/2151614129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbee80c6480 con 0x7fbee80b2380 2023-10-06T02:23:44.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.970+0000 7fbeddffb700 1 -- 172.21.15.37:0/2151614129 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbee4056d60 con 0x7fbee80b2380 2023-10-06T02:23:44.971 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T02:23:44.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.971+0000 7fbef00b6700 1 -- 172.21.15.37:0/2151614129 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbecc066f30 msgr2=0x7fbecc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.971+0000 7fbef00b6700 1 --2- 172.21.15.37:0/2151614129 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbecc066f30 0x7fbecc0693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbee80c5480 tx=0x7fbed8009040 comp rx=0 tx=0).stop 2023-10-06T02:23:44.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.971+0000 7fbef00b6700 1 -- 172.21.15.37:0/2151614129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbee80b2380 msgr2=0x7fbee8146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:44.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.971+0000 7fbef00b6700 1 --2- 172.21.15.37:0/2151614129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbee80b2380 0x7fbee8146cc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbee80894a0 tx=0x7fbee4016000 comp rx=0 tx=0).stop 2023-10-06T02:23:44.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.972+0000 7fbef00b6700 1 -- 172.21.15.37:0/2151614129 shutdown_connections 2023-10-06T02:23:44.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.972+0000 7fbef00b6700 1 --2- 172.21.15.37:0/2151614129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbee81593c0 0x7fbee816a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.972+0000 7fbef00b6700 1 --2- 172.21.15.37:0/2151614129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbee80b2380 0x7fbee8146cc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.972+0000 7fbef00b6700 1 --2- 172.21.15.37:0/2151614129 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbecc066f30 0x7fbecc0693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.972+0000 7fbef00b6700 1 --2- 172.21.15.37:0/2151614129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbee80ccb30 0x7fbee80c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:44.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.972+0000 7fbef00b6700 1 -- 172.21.15.37:0/2151614129 >> 172.21.15.37:0/2151614129 conn(0x7fbee806c0b0 msgr2=0x7fbee80ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:44.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.972+0000 7fbef00b6700 1 -- 172.21.15.37:0/2151614129 shutdown_connections 2023-10-06T02:23:44.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:44.972+0000 7fbef00b6700 1 -- 172.21.15.37:0/2151614129 wait complete. 2023-10-06T02:23:44.985 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:45.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.102+0000 7f232078d700 1 Processor -- start 2023-10-06T02:23:45.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.102+0000 7f232078d700 1 -- start start 2023-10-06T02:23:45.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.103+0000 7f232078d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f23180c63a0 0x7f231815daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.103+0000 7f232078d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f231815dfe0 0x7f23180cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.103+0000 7f232078d700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23180cb650 con 0x7f2318159760 2023-10-06T02:23:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.103+0000 7f232078d700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23180cc2d0 con 0x7f23180c63a0 2023-10-06T02:23:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.103+0000 7f232078d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23180cb930 con 0x7f231815dfe0 2023-10-06T02:23:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.103+0000 7f231dd28700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f23180c63a0 0x7f231815daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.103+0000 7f231dd28700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f23180c63a0 0x7f231815daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56686/0 (socket says 172.21.15.37:56686) 2023-10-06T02:23:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.103+0000 7f231dd28700 1 -- 172.21.15.37:0/1767982551 learned_addr learned my addr 172.21.15.37:0/1767982551 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.103+0000 7f231ed2a700 1 --2- 172.21.15.37:0/1767982551 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f231815dfe0 0x7f23180cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.103+0000 7f231dd28700 1 -- 172.21.15.37:0/1767982551 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f231815dfe0 msgr2=0x7f23180cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.103+0000 7f231dd28700 1 --2- 172.21.15.37:0/1767982551 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f231815dfe0 0x7f23180cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.103+0000 7f231dd28700 1 -- 172.21.15.37:0/1767982551 >> v1:172.21.15.191:6789/0 conn(0x7f2318159760 legacy=0x7f231815d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.103+0000 7f231dd28700 1 -- 172.21.15.37:0/1767982551 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23180cbc10 con 0x7f23180c63a0 2023-10-06T02:23:45.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.103+0000 7f231d527700 1 -- 172.21.15.37:0/1767982551 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544897646 0 0) 0x7f23180cb650 con 0x7f2318159760 2023-10-06T02:23:45.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.103+0000 7f231dd28700 1 --2- 172.21.15.37:0/1767982551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23180c63a0 0x7f231815daa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f23080099b0 tx=0x7f2308009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85da27d0537146f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:45.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.103+0000 7f231d527700 1 -- 172.21.15.37:0/1767982551 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308009ea0 con 0x7f23180c63a0 2023-10-06T02:23:45.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.104+0000 7f231d527700 1 -- 172.21.15.37:0/1767982551 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230800b8f0 con 0x7f23180c63a0 2023-10-06T02:23:45.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.104+0000 7f231d527700 1 -- 172.21.15.37:0/1767982551 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230800bc90 con 0x7f23180c63a0 2023-10-06T02:23:45.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.104+0000 7f232078d700 1 -- 172.21.15.37:0/1767982551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23180c63a0 msgr2=0x7f231815daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.104+0000 7f232078d700 1 --2- 172.21.15.37:0/1767982551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23180c63a0 0x7f231815daa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f23080099b0 tx=0x7f2308009250 comp rx=0 tx=0).stop 2023-10-06T02:23:45.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.104+0000 7f232078d700 1 -- 172.21.15.37:0/1767982551 shutdown_connections 2023-10-06T02:23:45.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.104+0000 7f232078d700 1 --2- 172.21.15.37:0/1767982551 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f231815dfe0 0x7f23180cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.104+0000 7f232078d700 1 --2- 172.21.15.37:0/1767982551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23180c63a0 0x7f231815daa0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.104+0000 7f232078d700 1 -- 172.21.15.37:0/1767982551 >> 172.21.15.37:0/1767982551 conn(0x7f231806c890 msgr2=0x7f23180d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:45.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.104+0000 7f232078d700 1 -- 172.21.15.37:0/1767982551 shutdown_connections 2023-10-06T02:23:45.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.104+0000 7f232078d700 1 -- 172.21.15.37:0/1767982551 wait complete. 2023-10-06T02:23:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.105+0000 7f232078d700 1 Processor -- start 2023-10-06T02:23:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.105+0000 7f232078d700 1 -- start start 2023-10-06T02:23:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.106+0000 7f232078d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23180c63a0 0x7f231814def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.106+0000 7f232078d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2318159760 0x7f2318169c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.106+0000 7f232078d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f231815dfe0 0x7f23180b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.106+0000 7f232078d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231814b690 con 0x7f23180c63a0 2023-10-06T02:23:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.106+0000 7f232078d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231814aa80 con 0x7f2318159760 2023-10-06T02:23:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.106+0000 7f232078d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231814ad60 con 0x7f231815dfe0 2023-10-06T02:23:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.106+0000 7f231e529700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23180c63a0 0x7f231814def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.106+0000 7f231e529700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23180c63a0 0x7f231814def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56696/0 (socket says 172.21.15.37:56696) 2023-10-06T02:23:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.106+0000 7f231e529700 1 -- 172.21.15.37:0/1753926776 learned_addr learned my addr 172.21.15.37:0/1753926776 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.106+0000 7f231e529700 1 -- 172.21.15.37:0/1753926776 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f231815dfe0 msgr2=0x7f23180b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.106+0000 7f231ed2a700 1 --2- 172.21.15.37:0/1753926776 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f231815dfe0 0x7f23180b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.106+0000 7f231dd28700 1 --2- 172.21.15.37:0/1753926776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2318159760 0x7f2318169c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.106+0000 7f231e529700 1 --2- 172.21.15.37:0/1753926776 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f231815dfe0 0x7f23180b4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.106+0000 7f231e529700 1 -- 172.21.15.37:0/1753926776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2318159760 msgr2=0x7f2318169c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.106+0000 7f231e529700 1 --2- 172.21.15.37:0/1753926776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2318159760 0x7f2318169c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.106+0000 7f231e529700 1 -- 172.21.15.37:0/1753926776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23080094f0 con 0x7f23180c63a0 2023-10-06T02:23:45.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.106+0000 7f231e529700 1 --2- 172.21.15.37:0/1753926776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23180c63a0 0x7f231814def0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f231400c7e0 tx=0x7f2314007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:45.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.107+0000 7f230e7fc700 1 -- 172.21.15.37:0/1753926776 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314012700 con 0x7f23180c63a0 2023-10-06T02:23:45.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.107+0000 7f230e7fc700 1 -- 172.21.15.37:0/1753926776 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2314012880 con 0x7f23180c63a0 2023-10-06T02:23:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.107+0000 7f232078d700 1 -- 172.21.15.37:0/1753926776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231814b040 con 0x7f23180c63a0 2023-10-06T02:23:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.107+0000 7f230e7fc700 1 -- 172.21.15.37:0/1753926776 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314012c40 con 0x7f23180c63a0 2023-10-06T02:23:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.107+0000 7f232078d700 1 -- 172.21.15.37:0/1753926776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231816e800 con 0x7f23180c63a0 2023-10-06T02:23:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.108+0000 7f232078d700 1 -- 172.21.15.37:0/1753926776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f231806fbf0 con 0x7f23180c63a0 2023-10-06T02:23:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.108+0000 7f230e7fc700 1 -- 172.21.15.37:0/1753926776 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f231401b400 con 0x7f23180c63a0 2023-10-06T02:23:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.108+0000 7f230e7fc700 1 --2- 172.21.15.37:0/1753926776 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f22fc066f30 0x7f22fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.108+0000 7f230e7fc700 1 -- 172.21.15.37:0/1753926776 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2314084260 con 0x7f23180c63a0 2023-10-06T02:23:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.109+0000 7f231dd28700 1 --2- 172.21.15.37:0/1753926776 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f22fc066f30 0x7f22fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.109+0000 7f231dd28700 1 --2- 172.21.15.37:0/1753926776 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f22fc066f30 0x7f22fc0693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f23080099b0 tx=0x7f2308017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.113+0000 7f230e7fc700 1 -- 172.21.15.37:0/1753926776 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2314051370 con 0x7f23180c63a0 2023-10-06T02:23:45.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.307+0000 7f232078d700 1 -- 172.21.15.37:0/1753926776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23180717b0 con 0x7f23180c63a0 2023-10-06T02:23:45.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.307+0000 7f230e7fc700 1 -- 172.21.15.37:0/1753926776 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f2314054990 con 0x7f23180c63a0 2023-10-06T02:23:45.309 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:45.309 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:23:16.897625+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:13.004596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:14.268809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:45.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.309+0000 7f232078d700 1 -- 172.21.15.37:0/1753926776 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f22fc066f30 msgr2=0x7f22fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.309+0000 7f232078d700 1 --2- 172.21.15.37:0/1753926776 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f22fc066f30 0x7f22fc0693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f23080099b0 tx=0x7f2308017000 comp rx=0 tx=0).stop 2023-10-06T02:23:45.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.309+0000 7f232078d700 1 -- 172.21.15.37:0/1753926776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23180c63a0 msgr2=0x7f231814def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.309+0000 7f232078d700 1 --2- 172.21.15.37:0/1753926776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23180c63a0 0x7f231814def0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f231400c7e0 tx=0x7f2314007df0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.309+0000 7f232078d700 1 -- 172.21.15.37:0/1753926776 shutdown_connections 2023-10-06T02:23:45.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.309+0000 7f232078d700 1 --2- 172.21.15.37:0/1753926776 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f231815dfe0 0x7f23180b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.309+0000 7f232078d700 1 --2- 172.21.15.37:0/1753926776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23180c63a0 0x7f231814def0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.309+0000 7f232078d700 1 --2- 172.21.15.37:0/1753926776 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f22fc066f30 0x7f22fc0693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.309+0000 7f232078d700 1 --2- 172.21.15.37:0/1753926776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2318159760 0x7f2318169c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.309+0000 7f232078d700 1 -- 172.21.15.37:0/1753926776 >> 172.21.15.37:0/1753926776 conn(0x7f231806c890 msgr2=0x7f231806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:45.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.309+0000 7f232078d700 1 -- 172.21.15.37:0/1753926776 shutdown_connections 2023-10-06T02:23:45.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.309+0000 7f232078d700 1 -- 172.21.15.37:0/1753926776 wait complete. 2023-10-06T02:23:45.323 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:23:08.066048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:23:08.561964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:23:13.004596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:23:14.268809+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:23:45.323 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:23:45.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.443+0000 7fee3ef99700 1 Processor -- start 2023-10-06T02:23:45.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.443+0000 7fee3ef99700 1 -- start start 2023-10-06T02:23:45.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.444+0000 7fee3ef99700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fee380cb170 0x7fee380cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.444+0000 7fee3ef99700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee380ccdd0 0x7fee38163250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.444+0000 7fee3ef99700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee380b2da0 con 0x7fee380b29d0 2023-10-06T02:23:45.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.444+0000 7fee3ef99700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee38099bd0 con 0x7fee380cb170 2023-10-06T02:23:45.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.444+0000 7fee3ef99700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee38159a70 con 0x7fee380ccdd0 2023-10-06T02:23:45.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.444+0000 7fee3df97700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fee380b29d0 0x7fee380ce8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45880/0 (socket says 172.21.15.37:45880) 2023-10-06T02:23:45.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.444+0000 7fee3df97700 1 -- 172.21.15.37:0/3267947639 learned_addr learned my addr 172.21.15.37:0/3267947639 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:45.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.444+0000 7fee3d796700 1 --2- 172.21.15.37:0/3267947639 >> v2:172.21.15.191:3300/0 conn(0x7fee380cb170 0x7fee380cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.444+0000 7fee3e798700 1 --2- 172.21.15.37:0/3267947639 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee380ccdd0 0x7fee38163250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.444+0000 7fee3cf95700 1 -- 172.21.15.37:0/3267947639 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1584578471 0 0) 0x7fee30001110 con 0x7fee380b29d0 2023-10-06T02:23:45.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.444+0000 7fee3cf95700 1 -- 172.21.15.37:0/3267947639 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee20003570 con 0x7fee380b29d0 2023-10-06T02:23:45.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.445+0000 7fee3cf95700 1 -- 172.21.15.37:0/3267947639 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1665323323 0 0) 0x7fee20003570 con 0x7fee380b29d0 2023-10-06T02:23:45.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.445+0000 7fee3d796700 1 -- 172.21.15.37:0/3267947639 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee380ccdd0 msgr2=0x7fee38163250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:45.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.445+0000 7fee3d796700 1 --2- 172.21.15.37:0/3267947639 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee380ccdd0 0x7fee38163250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.445+0000 7fee3d796700 1 -- 172.21.15.37:0/3267947639 >> v1:172.21.15.37:6789/0 conn(0x7fee380b29d0 legacy=0x7fee380ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.445+0000 7fee3d796700 1 -- 172.21.15.37:0/3267947639 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee380cb5e0 con 0x7fee380cb170 2023-10-06T02:23:45.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.445+0000 7fee3e798700 1 --2- 172.21.15.37:0/3267947639 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee380ccdd0 0x7fee38163250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:45.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.445+0000 7fee3d796700 1 --2- 172.21.15.37:0/3267947639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee380cb170 0x7fee380cefd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0098e0 tx=0x7fee2c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20685313c0aba2ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:45.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.445+0000 7fee3cf95700 1 -- 172.21.15.37:0/3267947639 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee30001600 con 0x7fee380cb170 2023-10-06T02:23:45.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.445+0000 7fee3cf95700 1 -- 172.21.15.37:0/3267947639 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2c011420 con 0x7fee380cb170 2023-10-06T02:23:45.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.445+0000 7fee3cf95700 1 -- 172.21.15.37:0/3267947639 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c0117c0 con 0x7fee380cb170 2023-10-06T02:23:45.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.446+0000 7fee3ef99700 1 -- 172.21.15.37:0/3267947639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee380cb170 msgr2=0x7fee380cefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.446+0000 7fee3ef99700 1 --2- 172.21.15.37:0/3267947639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee380cb170 0x7fee380cefd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0098e0 tx=0x7fee2c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.446+0000 7fee3ef99700 1 -- 172.21.15.37:0/3267947639 shutdown_connections 2023-10-06T02:23:45.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.446+0000 7fee3ef99700 1 --2- 172.21.15.37:0/3267947639 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee380ccdd0 0x7fee38163250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.446+0000 7fee3ef99700 1 --2- 172.21.15.37:0/3267947639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee380cb170 0x7fee380cefd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.446+0000 7fee3ef99700 1 -- 172.21.15.37:0/3267947639 >> 172.21.15.37:0/3267947639 conn(0x7fee38099610 msgr2=0x7fee3806c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:45.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.446+0000 7fee3ef99700 1 -- 172.21.15.37:0/3267947639 shutdown_connections 2023-10-06T02:23:45.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.446+0000 7fee3ef99700 1 -- 172.21.15.37:0/3267947639 wait complete. 2023-10-06T02:23:45.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.447+0000 7fee3ef99700 1 Processor -- start 2023-10-06T02:23:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.447+0000 7fee3ef99700 1 -- start start 2023-10-06T02:23:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.447+0000 7fee3ef99700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee380b29d0 0x7fee380b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.448+0000 7fee3ef99700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee380cb170 0x7fee380d0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.448+0000 7fee3ef99700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee380ccdd0 0x7fee380d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.448+0000 7fee3ef99700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee380b3ea0 con 0x7fee380b29d0 2023-10-06T02:23:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.448+0000 7fee3ef99700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee380b5fc0 con 0x7fee380cb170 2023-10-06T02:23:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.448+0000 7fee3ef99700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee38155020 con 0x7fee380ccdd0 2023-10-06T02:23:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.448+0000 7fee3df97700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee380b29d0 0x7fee380b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.448+0000 7fee3df97700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee380b29d0 0x7fee380b5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43554/0 (socket says 172.21.15.37:43554) 2023-10-06T02:23:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.448+0000 7fee3df97700 1 -- 172.21.15.37:0/2993282712 learned_addr learned my addr 172.21.15.37:0/2993282712 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.448+0000 7fee3d796700 1 --2- 172.21.15.37:0/2993282712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee380cb170 0x7fee380d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.448+0000 7fee3e798700 1 --2- 172.21.15.37:0/2993282712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee380ccdd0 0x7fee380d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.448+0000 7fee3df97700 1 -- 172.21.15.37:0/2993282712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee380ccdd0 msgr2=0x7fee380d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.448+0000 7fee3df97700 1 --2- 172.21.15.37:0/2993282712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee380ccdd0 0x7fee380d08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.448+0000 7fee3df97700 1 -- 172.21.15.37:0/2993282712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee380cb170 msgr2=0x7fee380d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.448+0000 7fee3df97700 1 --2- 172.21.15.37:0/2993282712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee380cb170 0x7fee380d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.448+0000 7fee3df97700 1 -- 172.21.15.37:0/2993282712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee28009a20 con 0x7fee380b29d0 2023-10-06T02:23:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.448+0000 7fee3df97700 1 --2- 172.21.15.37:0/2993282712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee380b29d0 0x7fee380b5a80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fee3000cb90 tx=0x7fee30000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.448+0000 7fee35ffb700 1 -- 172.21.15.37:0/2993282712 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee30007e90 con 0x7fee380b29d0 2023-10-06T02:23:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.448+0000 7fee35ffb700 1 -- 172.21.15.37:0/2993282712 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee30007360 con 0x7fee380b29d0 2023-10-06T02:23:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.448+0000 7fee3ef99700 1 -- 172.21.15.37:0/2993282712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2c009420 con 0x7fee380b29d0 2023-10-06T02:23:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.448+0000 7fee35ffb700 1 -- 172.21.15.37:0/2993282712 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee30004830 con 0x7fee380b29d0 2023-10-06T02:23:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.449+0000 7fee3ef99700 1 -- 172.21.15.37:0/2993282712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee381555e0 con 0x7fee380b29d0 2023-10-06T02:23:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.450+0000 7fee3ef99700 1 -- 172.21.15.37:0/2993282712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee380884f0 con 0x7fee380b29d0 2023-10-06T02:23:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.450+0000 7fee35ffb700 1 -- 172.21.15.37:0/2993282712 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee30004c20 con 0x7fee380b29d0 2023-10-06T02:23:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.450+0000 7fee35ffb700 1 --2- 172.21.15.37:0/2993282712 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fee24066f30 0x7fee240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.450+0000 7fee35ffb700 1 -- 172.21.15.37:0/2993282712 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fee30083c80 con 0x7fee380b29d0 2023-10-06T02:23:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.450+0000 7fee3d796700 1 --2- 172.21.15.37:0/2993282712 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fee24066f30 0x7fee240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.451+0000 7fee3d796700 1 --2- 172.21.15.37:0/2993282712 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fee24066f30 0x7fee240693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0098e0 tx=0x7fee2c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.454+0000 7fee35ffb700 1 -- 172.21.15.37:0/2993282712 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee30050ed0 con 0x7fee380b29d0 2023-10-06T02:23:45.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.648+0000 7fee3ef99700 1 -- 172.21.15.37:0/2993282712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fee380b2da0 con 0x7fee380b29d0 2023-10-06T02:23:45.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.648+0000 7fee35ffb700 1 -- 172.21.15.37:0/2993282712 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fee380b2da0 con 0x7fee380b29d0 2023-10-06T02:23:45.650 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T02:23:45.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.650+0000 7fee3ef99700 1 -- 172.21.15.37:0/2993282712 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fee24066f30 msgr2=0x7fee240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.650+0000 7fee3ef99700 1 --2- 172.21.15.37:0/2993282712 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fee24066f30 0x7fee240693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0098e0 tx=0x7fee2c016000 comp rx=0 tx=0).stop 2023-10-06T02:23:45.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.650+0000 7fee3ef99700 1 -- 172.21.15.37:0/2993282712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee380b29d0 msgr2=0x7fee380b5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.650+0000 7fee3ef99700 1 --2- 172.21.15.37:0/2993282712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee380b29d0 0x7fee380b5a80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fee3000cb90 tx=0x7fee30000ed0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.650+0000 7fee3ef99700 1 -- 172.21.15.37:0/2993282712 shutdown_connections 2023-10-06T02:23:45.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.650+0000 7fee3ef99700 1 --2- 172.21.15.37:0/2993282712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee380ccdd0 0x7fee380d08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.650+0000 7fee3ef99700 1 --2- 172.21.15.37:0/2993282712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee380b29d0 0x7fee380b5a80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.650+0000 7fee3ef99700 1 --2- 172.21.15.37:0/2993282712 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fee24066f30 0x7fee240693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.650+0000 7fee3ef99700 1 --2- 172.21.15.37:0/2993282712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee380cb170 0x7fee380d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.650+0000 7fee3ef99700 1 -- 172.21.15.37:0/2993282712 >> 172.21.15.37:0/2993282712 conn(0x7fee38099610 msgr2=0x7fee3815d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:45.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.650+0000 7fee3ef99700 1 -- 172.21.15.37:0/2993282712 shutdown_connections 2023-10-06T02:23:45.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.650+0000 7fee3ef99700 1 -- 172.21.15.37:0/2993282712 wait complete. 2023-10-06T02:23:45.663 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:23:45.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.784+0000 7f6748667700 1 Processor -- start 2023-10-06T02:23:45.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.785+0000 7f6748667700 1 -- start start 2023-10-06T02:23:45.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.786+0000 7f6748667700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f674014e2a0 0x7f67400ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.786+0000 7f6748667700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f674014e670 0x7f67400b3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.786+0000 7f6748667700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67400b4110 con 0x7f67400b3cb0 2023-10-06T02:23:45.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.786+0000 7f6748667700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67401587a0 con 0x7f674014e670 2023-10-06T02:23:45.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.786+0000 7f6748667700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6740157b90 con 0x7f674014e2a0 2023-10-06T02:23:45.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.786+0000 7f6745c02700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f674014e670 0x7f67400b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.786+0000 7f6745c02700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f674014e670 0x7f67400b3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43562/0 (socket says 172.21.15.37:43562) 2023-10-06T02:23:45.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.786+0000 7f6745c02700 1 -- 172.21.15.37:0/3708139231 learned_addr learned my addr 172.21.15.37:0/3708139231 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:45.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.786+0000 7f6746403700 1 --2- 172.21.15.37:0/3708139231 >> v2:172.21.15.191:3300/0 conn(0x7f674014e2a0 0x7f67400ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.786+0000 7f6745c02700 1 -- 172.21.15.37:0/3708139231 >> v2:172.21.15.191:3300/0 conn(0x7f674014e2a0 msgr2=0x7f67400ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:45.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.786+0000 7f6745c02700 1 --2- 172.21.15.37:0/3708139231 >> v2:172.21.15.191:3300/0 conn(0x7f674014e2a0 0x7f67400ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.786+0000 7f6745c02700 1 -- 172.21.15.37:0/3708139231 >> v1:172.21.15.191:6789/0 conn(0x7f67400b3cb0 legacy=0x7f6740067990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.786+0000 7f6745c02700 1 -- 172.21.15.37:0/3708139231 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6740157e70 con 0x7f674014e670 2023-10-06T02:23:45.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.786+0000 7f6745c02700 1 --2- 172.21.15.37:0/3708139231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f674014e670 0x7f67400b3770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f67340099b0 tx=0x7f6734009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da9e60423d13b4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:45.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.786+0000 7f6745401700 1 -- 172.21.15.37:0/3708139231 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673400b820 con 0x7f674014e670 2023-10-06T02:23:45.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.787+0000 7f6745401700 1 -- 172.21.15.37:0/3708139231 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673400b980 con 0x7f674014e670 2023-10-06T02:23:45.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.787+0000 7f6745401700 1 -- 172.21.15.37:0/3708139231 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673400bd20 con 0x7f674014e670 2023-10-06T02:23:45.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.787+0000 7f6748667700 1 -- 172.21.15.37:0/3708139231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f674014e670 msgr2=0x7f67400b3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.787+0000 7f6748667700 1 --2- 172.21.15.37:0/3708139231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f674014e670 0x7f67400b3770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f67340099b0 tx=0x7f6734009250 comp rx=0 tx=0).stop 2023-10-06T02:23:45.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.787+0000 7f6748667700 1 -- 172.21.15.37:0/3708139231 shutdown_connections 2023-10-06T02:23:45.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.787+0000 7f6748667700 1 --2- 172.21.15.37:0/3708139231 >> v2:172.21.15.191:3300/0 conn(0x7f674014e2a0 0x7f67400ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.787+0000 7f6748667700 1 --2- 172.21.15.37:0/3708139231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f674014e670 0x7f67400b3770 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.787+0000 7f6748667700 1 -- 172.21.15.37:0/3708139231 >> 172.21.15.37:0/3708139231 conn(0x7f674006c0b0 msgr2=0x7f674006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:45.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.788+0000 7f6748667700 1 -- 172.21.15.37:0/3708139231 shutdown_connections 2023-10-06T02:23:45.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.788+0000 7f6748667700 1 -- 172.21.15.37:0/3708139231 wait complete. 2023-10-06T02:23:45.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.789+0000 7f6748667700 1 Processor -- start 2023-10-06T02:23:45.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.789+0000 7f6748667700 1 -- start start 2023-10-06T02:23:45.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.789+0000 7f6748667700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67400b3cb0 0x7f674016b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.789+0000 7f6748667700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f674014e2a0 0x7f67401476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.789+0000 7f6748667700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f674014e670 0x7f674015ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.789+0000 7f6748667700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6740148220 con 0x7f67400b3cb0 2023-10-06T02:23:45.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.789+0000 7f6748667700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674014ef80 con 0x7f674014e670 2023-10-06T02:23:45.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.789+0000 7f6748667700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674014f260 con 0x7f674014e2a0 2023-10-06T02:23:45.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.790+0000 7f6746403700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67400b3cb0 0x7f674016b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.790+0000 7f6746403700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67400b3cb0 0x7f674016b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43578/0 (socket says 172.21.15.37:43578) 2023-10-06T02:23:45.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.790+0000 7f6746403700 1 -- 172.21.15.37:0/2875384333 learned_addr learned my addr 172.21.15.37:0/2875384333 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:45.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.790+0000 7f6745c02700 1 --2- 172.21.15.37:0/2875384333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f674014e2a0 0x7f67401476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.790+0000 7f6746c04700 1 --2- 172.21.15.37:0/2875384333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f674014e670 0x7f674015ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.790+0000 7f6746403700 1 -- 172.21.15.37:0/2875384333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f674014e2a0 msgr2=0x7f67401476f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.790+0000 7f6746403700 1 --2- 172.21.15.37:0/2875384333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f674014e2a0 0x7f67401476f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.790+0000 7f6746403700 1 -- 172.21.15.37:0/2875384333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f674014e670 msgr2=0x7f674015ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.790+0000 7f6746403700 1 --2- 172.21.15.37:0/2875384333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f674014e670 0x7f674015ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.790+0000 7f6746403700 1 -- 172.21.15.37:0/2875384333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67340094f0 con 0x7f67400b3cb0 2023-10-06T02:23:45.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.790+0000 7f6746c04700 1 --2- 172.21.15.37:0/2875384333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f674014e670 0x7f674015ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:45.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.790+0000 7f6746403700 1 --2- 172.21.15.37:0/2875384333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67400b3cb0 0x7f674016b920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f673800d890 tx=0x7f6738008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:45.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.790+0000 7f673e7fc700 1 -- 172.21.15.37:0/2875384333 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673800b600 con 0x7f67400b3cb0 2023-10-06T02:23:45.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.790+0000 7f673e7fc700 1 -- 172.21.15.37:0/2875384333 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673800b760 con 0x7f67400b3cb0 2023-10-06T02:23:45.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.790+0000 7f6748667700 1 -- 172.21.15.37:0/2875384333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f674014f540 con 0x7f67400b3cb0 2023-10-06T02:23:45.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.790+0000 7f673e7fc700 1 -- 172.21.15.37:0/2875384333 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673800bae0 con 0x7f67400b3cb0 2023-10-06T02:23:45.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.790+0000 7f6748667700 1 -- 172.21.15.37:0/2875384333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6740147c30 con 0x7f67400b3cb0 2023-10-06T02:23:45.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.791+0000 7f6748667700 1 -- 172.21.15.37:0/2875384333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f674006a980 con 0x7f67400b3cb0 2023-10-06T02:23:45.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.792+0000 7f673e7fc700 1 -- 172.21.15.37:0/2875384333 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f673801e460 con 0x7f67400b3cb0 2023-10-06T02:23:45.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.792+0000 7f673e7fc700 1 --2- 172.21.15.37:0/2875384333 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f672c066f30 0x7f672c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:45.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.792+0000 7f673e7fc700 1 -- 172.21.15.37:0/2875384333 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6738084d40 con 0x7f67400b3cb0 2023-10-06T02:23:45.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.792+0000 7f6745c02700 1 --2- 172.21.15.37:0/2875384333 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f672c066f30 0x7f672c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:45.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.793+0000 7f6745c02700 1 --2- 172.21.15.37:0/2875384333 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f672c066f30 0x7f672c0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f67340099b0 tx=0x7f6734017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:45.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.796+0000 7f673e7fc700 1 -- 172.21.15.37:0/2875384333 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6738051e50 con 0x7f67400b3cb0 2023-10-06T02:23:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.991+0000 7f6748667700 1 -- 172.21.15.37:0/2875384333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67401505d0 con 0x7f67400b3cb0 2023-10-06T02:23:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.991+0000 7f673e7fc700 1 -- 172.21.15.37:0/2875384333 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6738055470 con 0x7f67400b3cb0 2023-10-06T02:23:45.993 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T02:23:45.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.993+0000 7f6748667700 1 -- 172.21.15.37:0/2875384333 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f672c066f30 msgr2=0x7f672c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.993+0000 7f6748667700 1 --2- 172.21.15.37:0/2875384333 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f672c066f30 0x7f672c0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f67340099b0 tx=0x7f6734017000 comp rx=0 tx=0).stop 2023-10-06T02:23:45.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.993+0000 7f6748667700 1 -- 172.21.15.37:0/2875384333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67400b3cb0 msgr2=0x7f674016b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:45.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.993+0000 7f6748667700 1 --2- 172.21.15.37:0/2875384333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67400b3cb0 0x7f674016b920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f673800d890 tx=0x7f6738008040 comp rx=0 tx=0).stop 2023-10-06T02:23:45.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.993+0000 7f6748667700 1 -- 172.21.15.37:0/2875384333 shutdown_connections 2023-10-06T02:23:45.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.993+0000 7f6748667700 1 --2- 172.21.15.37:0/2875384333 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f672c066f30 0x7f672c0693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.993+0000 7f6748667700 1 --2- 172.21.15.37:0/2875384333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f674014e670 0x7f674015ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.993+0000 7f6748667700 1 --2- 172.21.15.37:0/2875384333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67400b3cb0 0x7f674016b920 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.993+0000 7f6748667700 1 --2- 172.21.15.37:0/2875384333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f674014e2a0 0x7f67401476f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:45.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.994+0000 7f6748667700 1 -- 172.21.15.37:0/2875384333 >> 172.21.15.37:0/2875384333 conn(0x7f674006c0b0 msgr2=0x7f67400ae450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:45.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.994+0000 7f6748667700 1 -- 172.21.15.37:0/2875384333 shutdown_connections 2023-10-06T02:23:45.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:45.994+0000 7f6748667700 1 -- 172.21.15.37:0/2875384333 wait complete. 2023-10-06T02:23:46.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:23:46.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.128+0000 7f6440a9a700 1 Processor -- start 2023-10-06T02:23:46.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.128+0000 7f6440a9a700 1 -- start start 2023-10-06T02:23:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.128+0000 7f6440a9a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f643c1593c0 0x7f643c159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.128+0000 7f6440a9a700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643c0b07a0 con 0x7f643c0ccb30 2023-10-06T02:23:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f6440a9a700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643c0cd8a0 con 0x7f643c0b2380 2023-10-06T02:23:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f6440a9a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643c0cd6c0 con 0x7f643c1593c0 2023-10-06T02:23:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643ad9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f643c0ccb30 0x7f643c0ccfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45888/0 (socket says 172.21.15.37:45888) 2023-10-06T02:23:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643ad9d700 1 -- 172.21.15.37:0/2187757134 learned_addr learned my addr 172.21.15.37:0/2187757134 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643a59c700 1 --2- 172.21.15.37:0/2187757134 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f643c1593c0 0x7f643c159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643959a700 1 -- 172.21.15.37:0/2187757134 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360627015 0 0) 0x7f643c0b07a0 con 0x7f643c0ccb30 2023-10-06T02:23:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643959a700 1 -- 172.21.15.37:0/2187757134 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6428003570 con 0x7f643c0ccb30 2023-10-06T02:23:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643959a700 1 -- 172.21.15.37:0/2187757134 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225978196 0 0) 0x7f643c0cd8a0 con 0x7f643c0b2380 2023-10-06T02:23:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643959a700 1 -- 172.21.15.37:0/2187757134 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f643c0b07a0 con 0x7f643c0b2380 2023-10-06T02:23:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643959a700 1 -- 172.21.15.37:0/2187757134 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2524867215 0 0) 0x7f6428003570 con 0x7f643c0ccb30 2023-10-06T02:23:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643959a700 1 -- 172.21.15.37:0/2187757134 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f643c1593c0 msgr2=0x7f643c159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643959a700 1 --2- 172.21.15.37:0/2187757134 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f643c1593c0 0x7f643c159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643959a700 1 -- 172.21.15.37:0/2187757134 >> v1:172.21.15.191:6789/0 conn(0x7f643c0b2380 legacy=0x7f643c0b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643959a700 1 -- 172.21.15.37:0/2187757134 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c0afe70 con 0x7f643c0ccb30 2023-10-06T02:23:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643959a700 1 -- 172.21.15.37:0/2187757134 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f642c0017f0 con 0x7f643c0ccb30 2023-10-06T02:23:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643a59c700 1 --2- 172.21.15.37:0/2187757134 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f643c1593c0 0x7f643c159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643959a700 1 -- 172.21.15.37:0/2187757134 >> v1:172.21.15.37:6789/0 conn(0x7f643c0ccb30 legacy=0x7f643c0ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643959a700 1 --2- 172.21.15.37:0/2187757134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6428003c20 0x7f6428004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643959a700 1 --2- 172.21.15.37:0/2187757134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6428004810 0x7f6428004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643959a700 1 --2- 172.21.15.37:0/2187757134 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f643c1593c0 0x7f64280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643959a700 1 -- 172.21.15.37:0/2187757134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c0cd6c0 con 0x7f6428003c20 2023-10-06T02:23:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643959a700 1 -- 172.21.15.37:0/2187757134 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642800bb10 con 0x7f6428004810 2023-10-06T02:23:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643959a700 1 -- 172.21.15.37:0/2187757134 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642800bcd0 con 0x7f643c1593c0 2023-10-06T02:23:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.129+0000 7f643a59c700 1 --2- 172.21.15.37:0/2187757134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6428003c20 0x7f6428004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.130+0000 7f6439d9b700 1 --2- 172.21.15.37:0/2187757134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6428004810 0x7f6428004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.130+0000 7f643ad9d700 1 --2- 172.21.15.37:0/2187757134 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f643c1593c0 0x7f64280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.130+0000 7f643a59c700 1 -- 172.21.15.37:0/2187757134 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f643c1593c0 msgr2=0x7f64280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.130+0000 7f643a59c700 1 --2- 172.21.15.37:0/2187757134 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f643c1593c0 0x7f64280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.130+0000 7f643a59c700 1 -- 172.21.15.37:0/2187757134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6428004810 msgr2=0x7f6428004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.130+0000 7f643a59c700 1 --2- 172.21.15.37:0/2187757134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6428004810 0x7f6428004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.130+0000 7f643a59c700 1 -- 172.21.15.37:0/2187757134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6434009420 con 0x7f6428003c20 2023-10-06T02:23:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.130+0000 7f643a59c700 1 --2- 172.21.15.37:0/2187757134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6428003c20 0x7f6428004010 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6434009df0 tx=0x7f64340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a79e20645e568a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.130+0000 7f643959a700 1 -- 172.21.15.37:0/2187757134 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6434009740 con 0x7f6428003c20 2023-10-06T02:23:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.130+0000 7f643959a700 1 -- 172.21.15.37:0/2187757134 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643400e920 con 0x7f6428003c20 2023-10-06T02:23:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.130+0000 7f643959a700 1 -- 172.21.15.37:0/2187757134 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643400ece0 con 0x7f6428003c20 2023-10-06T02:23:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.130+0000 7f6440a9a700 1 -- 172.21.15.37:0/2187757134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6428003c20 msgr2=0x7f6428004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.130+0000 7f6440a9a700 1 --2- 172.21.15.37:0/2187757134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6428003c20 0x7f6428004010 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6434009df0 tx=0x7f64340091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.130+0000 7f643ad9d700 1 -- 172.21.15.37:0/2187757134 reap_dead start 2023-10-06T02:23:46.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.131+0000 7f6440a9a700 1 -- 172.21.15.37:0/2187757134 shutdown_connections 2023-10-06T02:23:46.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.131+0000 7f6440a9a700 1 -- 172.21.15.37:0/2187757134 >> 172.21.15.37:0/2187757134 conn(0x7f643c06c0b0 msgr2=0x7f643c06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:46.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.131+0000 7f6440a9a700 1 -- 172.21.15.37:0/2187757134 shutdown_connections 2023-10-06T02:23:46.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.131+0000 7f6440a9a700 1 -- 172.21.15.37:0/2187757134 wait complete. 2023-10-06T02:23:46.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.132+0000 7f6440a9a700 1 Processor -- start 2023-10-06T02:23:46.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.132+0000 7f6440a9a700 1 -- start start 2023-10-06T02:23:46.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.132+0000 7f6440a9a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6428003c20 0x7f643c0c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.132+0000 7f6440a9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643c16a7a0 0x7f643c1558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.132+0000 7f6440a9a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f643c0b3d20 0x7f643c0c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.132+0000 7f6440a9a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c0c9690 con 0x7f643c16a7a0 2023-10-06T02:23:46.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.132+0000 7f6440a9a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c0c8a80 con 0x7f643c0b3d20 2023-10-06T02:23:46.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.132+0000 7f6440a9a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643c0c8d60 con 0x7f6428003c20 2023-10-06T02:23:46.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.133+0000 7f6439d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643c16a7a0 0x7f643c1558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.133+0000 7f6439d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643c16a7a0 0x7f643c1558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43596/0 (socket says 172.21.15.37:43596) 2023-10-06T02:23:46.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.133+0000 7f6439d9b700 1 -- 172.21.15.37:0/1164103581 learned_addr learned my addr 172.21.15.37:0/1164103581 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:46.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.133+0000 7f6439d9b700 1 -- 172.21.15.37:0/1164103581 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6428003c20 msgr2=0x7f643c0c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.133+0000 7f643ad9d700 1 --2- 172.21.15.37:0/1164103581 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f643c0b3d20 0x7f643c0c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.133+0000 7f643a59c700 1 --2- 172.21.15.37:0/1164103581 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6428003c20 0x7f643c0c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.133+0000 7f6439d9b700 1 --2- 172.21.15.37:0/1164103581 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6428003c20 0x7f643c0c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.133+0000 7f6439d9b700 1 -- 172.21.15.37:0/1164103581 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f643c0b3d20 msgr2=0x7f643c0c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.133+0000 7f6439d9b700 1 --2- 172.21.15.37:0/1164103581 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f643c0b3d20 0x7f643c0c9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.133+0000 7f6439d9b700 1 -- 172.21.15.37:0/1164103581 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c0c9040 con 0x7f643c16a7a0 2023-10-06T02:23:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.133+0000 7f6439d9b700 1 --2- 172.21.15.37:0/1164103581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643c16a7a0 0x7f643c1558e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6424002c00 tx=0x7f6424007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.133+0000 7f64327fc700 1 -- 172.21.15.37:0/1164103581 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642400fa50 con 0x7f643c16a7a0 2023-10-06T02:23:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.133+0000 7f64327fc700 1 -- 172.21.15.37:0/1164103581 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642400fbd0 con 0x7f643c16a7a0 2023-10-06T02:23:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.133+0000 7f6440a9a700 1 -- 172.21.15.37:0/1164103581 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643c0c9320 con 0x7f643c16a7a0 2023-10-06T02:23:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.133+0000 7f64327fc700 1 -- 172.21.15.37:0/1164103581 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64240133f0 con 0x7f643c16a7a0 2023-10-06T02:23:46.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.133+0000 7f6440a9a700 1 -- 172.21.15.37:0/1164103581 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643c16ac10 con 0x7f643c16a7a0 2023-10-06T02:23:46.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.134+0000 7f6440a9a700 1 -- 172.21.15.37:0/1164103581 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f643c0c9840 con 0x7f643c16a7a0 2023-10-06T02:23:46.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.134+0000 7f64327fc700 1 -- 172.21.15.37:0/1164103581 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6424013760 con 0x7f643c16a7a0 2023-10-06T02:23:46.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.135+0000 7f64327fc700 1 --2- 172.21.15.37:0/1164103581 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f641c066f30 0x7f641c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.135+0000 7f64327fc700 1 -- 172.21.15.37:0/1164103581 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6424084ea0 con 0x7f643c16a7a0 2023-10-06T02:23:46.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.135+0000 7f643a59c700 1 --2- 172.21.15.37:0/1164103581 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f641c066f30 0x7f641c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.136+0000 7f643a59c700 1 --2- 172.21.15.37:0/1164103581 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f641c066f30 0x7f641c0693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f64340093f0 tx=0x7f643401a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:46.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.139+0000 7f64327fc700 1 -- 172.21.15.37:0/1164103581 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f643c0c9840 con 0x7f643c16a7a0 2023-10-06T02:23:46.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.329+0000 7f6440a9a700 1 -- 172.21.15.37:0/1164103581 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f643c0c97d0 con 0x7f643c16a7a0 2023-10-06T02:23:46.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.330+0000 7f64327fc700 1 -- 172.21.15.37:0/1164103581 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6424051fb0 con 0x7f643c16a7a0 2023-10-06T02:23:46.331 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T02:23:46.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.332+0000 7f6440a9a700 1 -- 172.21.15.37:0/1164103581 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f641c066f30 msgr2=0x7f641c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:46.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.332+0000 7f6440a9a700 1 --2- 172.21.15.37:0/1164103581 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f641c066f30 0x7f641c0693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f64340093f0 tx=0x7f643401a000 comp rx=0 tx=0).stop 2023-10-06T02:23:46.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.332+0000 7f6440a9a700 1 -- 172.21.15.37:0/1164103581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643c16a7a0 msgr2=0x7f643c1558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.332+0000 7f6440a9a700 1 --2- 172.21.15.37:0/1164103581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643c16a7a0 0x7f643c1558e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6424002c00 tx=0x7f6424007d30 comp rx=0 tx=0).stop 2023-10-06T02:23:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.332+0000 7f6440a9a700 1 -- 172.21.15.37:0/1164103581 shutdown_connections 2023-10-06T02:23:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.332+0000 7f6440a9a700 1 --2- 172.21.15.37:0/1164103581 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f641c066f30 0x7f641c0693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.332+0000 7f6440a9a700 1 --2- 172.21.15.37:0/1164103581 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f643c0b3d20 0x7f643c0c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.332+0000 7f6440a9a700 1 --2- 172.21.15.37:0/1164103581 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6428003c20 0x7f643c0c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.332+0000 7f6440a9a700 1 --2- 172.21.15.37:0/1164103581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643c16a7a0 0x7f643c1558e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.332+0000 7f6440a9a700 1 -- 172.21.15.37:0/1164103581 >> 172.21.15.37:0/1164103581 conn(0x7f643c06c0b0 msgr2=0x7f643c0b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.332+0000 7f6440a9a700 1 -- 172.21.15.37:0/1164103581 shutdown_connections 2023-10-06T02:23:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.332+0000 7f6440a9a700 1 -- 172.21.15.37:0/1164103581 wait complete. 2023-10-06T02:23:46.345 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:23:46.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.467+0000 7fe392a67700 1 Processor -- start 2023-10-06T02:23:46.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.467+0000 7fe392a67700 1 -- start start 2023-10-06T02:23:46.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.468+0000 7fe392a67700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe38c155f90 0x7fe38c06acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.468+0000 7fe392a67700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe38c156360 0x7fe38c06e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.468+0000 7fe392a67700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38c06b470 con 0x7fe38c0c7530 2023-10-06T02:23:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.468+0000 7fe392a67700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe38c06cb10 con 0x7fe38c156360 2023-10-06T02:23:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.468+0000 7fe392a67700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe38c06b1f0 con 0x7fe38c155f90 2023-10-06T02:23:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.468+0000 7fe392266700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe38c156360 0x7fe38c06e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.468+0000 7fe392266700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe38c156360 0x7fe38c06e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43604/0 (socket says 172.21.15.37:43604) 2023-10-06T02:23:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.468+0000 7fe392266700 1 -- 172.21.15.37:0/3208053093 learned_addr learned my addr 172.21.15.37:0/3208053093 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.468+0000 7fe391a65700 1 --2- 172.21.15.37:0/3208053093 >> v2:172.21.15.191:3300/0 conn(0x7fe38c155f90 0x7fe38c06acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.468+0000 7fe392266700 1 -- 172.21.15.37:0/3208053093 >> v2:172.21.15.191:3300/0 conn(0x7fe38c155f90 msgr2=0x7fe38c06acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.468+0000 7fe392266700 1 --2- 172.21.15.37:0/3208053093 >> v2:172.21.15.191:3300/0 conn(0x7fe38c155f90 0x7fe38c06acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.468+0000 7fe392266700 1 -- 172.21.15.37:0/3208053093 >> v1:172.21.15.191:6789/0 conn(0x7fe38c0c7530 legacy=0x7fe38c06cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.468+0000 7fe392266700 1 -- 172.21.15.37:0/3208053093 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c06d6b0 con 0x7fe38c156360 2023-10-06T02:23:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.468+0000 7fe392266700 1 --2- 172.21.15.37:0/3208053093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe38c156360 0x7fe38c06e350 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0697b0 tx=0x7fe37c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ebfb0b8bad98abc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:46.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.468+0000 7fe390a63700 1 -- 172.21.15.37:0/3208053093 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37c009e70 con 0x7fe38c156360 2023-10-06T02:23:46.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.468+0000 7fe390a63700 1 -- 172.21.15.37:0/3208053093 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37c00b860 con 0x7fe38c156360 2023-10-06T02:23:46.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.468+0000 7fe390a63700 1 -- 172.21.15.37:0/3208053093 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37c00bc00 con 0x7fe38c156360 2023-10-06T02:23:46.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.469+0000 7fe392a67700 1 -- 172.21.15.37:0/3208053093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe38c156360 msgr2=0x7fe38c06e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:46.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.469+0000 7fe392a67700 1 --2- 172.21.15.37:0/3208053093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe38c156360 0x7fe38c06e350 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0697b0 tx=0x7fe37c009250 comp rx=0 tx=0).stop 2023-10-06T02:23:46.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.469+0000 7fe392a67700 1 -- 172.21.15.37:0/3208053093 shutdown_connections 2023-10-06T02:23:46.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.469+0000 7fe392a67700 1 --2- 172.21.15.37:0/3208053093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe38c156360 0x7fe38c06e350 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.469+0000 7fe392a67700 1 --2- 172.21.15.37:0/3208053093 >> v2:172.21.15.191:3300/0 conn(0x7fe38c155f90 0x7fe38c06acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.469+0000 7fe392a67700 1 -- 172.21.15.37:0/3208053093 >> 172.21.15.37:0/3208053093 conn(0x7fe38c0cc820 msgr2=0x7fe38c0ccc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:46.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.469+0000 7fe392a67700 1 -- 172.21.15.37:0/3208053093 shutdown_connections 2023-10-06T02:23:46.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.469+0000 7fe392a67700 1 -- 172.21.15.37:0/3208053093 wait complete. 2023-10-06T02:23:46.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.470+0000 7fe392a67700 1 Processor -- start 2023-10-06T02:23:46.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.470+0000 7fe392a67700 1 -- start start 2023-10-06T02:23:46.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.471+0000 7fe392a67700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe38c0c7530 0x7fe38c14ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.471+0000 7fe392a67700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe38c155f90 0x7fe38c154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.471+0000 7fe392a67700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe38c156360 0x7fe38c16da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.471+0000 7fe392a67700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c16b130 con 0x7fe38c156360 2023-10-06T02:23:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.471+0000 7fe392a67700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c16ab50 con 0x7fe38c155f90 2023-10-06T02:23:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.471+0000 7fe392a67700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c154de0 con 0x7fe38c0c7530 2023-10-06T02:23:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.471+0000 7fe392266700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe38c156360 0x7fe38c16da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.471+0000 7fe392266700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe38c156360 0x7fe38c16da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43608/0 (socket says 172.21.15.37:43608) 2023-10-06T02:23:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.471+0000 7fe392266700 1 -- 172.21.15.37:0/3052446071 learned_addr learned my addr 172.21.15.37:0/3052446071 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.471+0000 7fe391264700 1 --2- 172.21.15.37:0/3052446071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe38c155f90 0x7fe38c154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.471+0000 7fe391a65700 1 --2- 172.21.15.37:0/3052446071 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe38c0c7530 0x7fe38c14ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.471+0000 7fe392266700 1 -- 172.21.15.37:0/3052446071 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe38c0c7530 msgr2=0x7fe38c14ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.471+0000 7fe392266700 1 --2- 172.21.15.37:0/3052446071 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe38c0c7530 0x7fe38c14ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.471+0000 7fe392266700 1 -- 172.21.15.37:0/3052446071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe38c155f90 msgr2=0x7fe38c154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.471+0000 7fe392266700 1 --2- 172.21.15.37:0/3052446071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe38c155f90 0x7fe38c154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.471+0000 7fe392266700 1 -- 172.21.15.37:0/3052446071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c0094f0 con 0x7fe38c156360 2023-10-06T02:23:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.471+0000 7fe391a65700 1 --2- 172.21.15.37:0/3052446071 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe38c0c7530 0x7fe38c14ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.471+0000 7fe391264700 1 --2- 172.21.15.37:0/3052446071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe38c155f90 0x7fe38c154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.472+0000 7fe392266700 1 --2- 172.21.15.37:0/3052446071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe38c156360 0x7fe38c16da20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe37c009290 tx=0x7fe37c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.472+0000 7fe389ffb700 1 -- 172.21.15.37:0/3052446071 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37c011630 con 0x7fe38c156360 2023-10-06T02:23:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.472+0000 7fe389ffb700 1 -- 172.21.15.37:0/3052446071 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37c011790 con 0x7fe38c156360 2023-10-06T02:23:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.472+0000 7fe392a67700 1 -- 172.21.15.37:0/3052446071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38c1550c0 con 0x7fe38c156360 2023-10-06T02:23:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.472+0000 7fe389ffb700 1 -- 172.21.15.37:0/3052446071 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37c011b50 con 0x7fe38c156360 2023-10-06T02:23:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.472+0000 7fe392a67700 1 -- 172.21.15.37:0/3052446071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38c0c5b40 con 0x7fe38c156360 2023-10-06T02:23:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.473+0000 7fe392a67700 1 -- 172.21.15.37:0/3052446071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38c16b2e0 con 0x7fe38c156360 2023-10-06T02:23:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.473+0000 7fe389ffb700 1 -- 172.21.15.37:0/3052446071 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe37c0253f0 con 0x7fe38c156360 2023-10-06T02:23:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.474+0000 7fe389ffb700 1 --2- 172.21.15.37:0/3052446071 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe378066f30 0x7fe3780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.474+0000 7fe389ffb700 1 -- 172.21.15.37:0/3052446071 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe37c086020 con 0x7fe38c156360 2023-10-06T02:23:46.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.474+0000 7fe391a65700 1 --2- 172.21.15.37:0/3052446071 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe378066f30 0x7fe3780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.475+0000 7fe391a65700 1 --2- 172.21.15.37:0/3052446071 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe378066f30 0x7fe3780693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe384009fd0 tx=0x7fe384009740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:46.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.478+0000 7fe389ffb700 1 -- 172.21.15.37:0/3052446071 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe38c16b2e0 con 0x7fe38c156360 2023-10-06T02:23:46.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.672+0000 7fe392a67700 1 -- 172.21.15.37:0/3052446071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe38c064b00 con 0x7fe38c156360 2023-10-06T02:23:46.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.673+0000 7fe389ffb700 1 -- 172.21.15.37:0/3052446071 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe37c053130 con 0x7fe38c156360 2023-10-06T02:23:46.674 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T02:23:46.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.675+0000 7fe392a67700 1 -- 172.21.15.37:0/3052446071 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe378066f30 msgr2=0x7fe3780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:46.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.675+0000 7fe392a67700 1 --2- 172.21.15.37:0/3052446071 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe378066f30 0x7fe3780693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe384009fd0 tx=0x7fe384009740 comp rx=0 tx=0).stop 2023-10-06T02:23:46.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.675+0000 7fe392a67700 1 -- 172.21.15.37:0/3052446071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe38c156360 msgr2=0x7fe38c16da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:46.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.675+0000 7fe392a67700 1 --2- 172.21.15.37:0/3052446071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe38c156360 0x7fe38c16da20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe37c009290 tx=0x7fe37c017000 comp rx=0 tx=0).stop 2023-10-06T02:23:46.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.675+0000 7fe392a67700 1 -- 172.21.15.37:0/3052446071 shutdown_connections 2023-10-06T02:23:46.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.675+0000 7fe392a67700 1 --2- 172.21.15.37:0/3052446071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe38c156360 0x7fe38c16da20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.675+0000 7fe392a67700 1 --2- 172.21.15.37:0/3052446071 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe38c0c7530 0x7fe38c14ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.675+0000 7fe392a67700 1 --2- 172.21.15.37:0/3052446071 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe378066f30 0x7fe3780693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.675+0000 7fe392a67700 1 --2- 172.21.15.37:0/3052446071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe38c155f90 0x7fe38c154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.675+0000 7fe392a67700 1 -- 172.21.15.37:0/3052446071 >> 172.21.15.37:0/3052446071 conn(0x7fe38c0cc820 msgr2=0x7fe38c14f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:46.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.675+0000 7fe392a67700 1 -- 172.21.15.37:0/3052446071 shutdown_connections 2023-10-06T02:23:46.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.675+0000 7fe392a67700 1 -- 172.21.15.37:0/3052446071 wait complete. 2023-10-06T02:23:46.688 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:46.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.806+0000 7ff71ec99700 1 Processor -- start 2023-10-06T02:23:46.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.806+0000 7ff71ec99700 1 -- start start 2023-10-06T02:23:46.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.806+0000 7ff71ec99700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71806d890 0x7ff71806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.806+0000 7ff71ec99700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff7180cb590 0x7ff7180cba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.806+0000 7ff71ec99700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff71806e240 con 0x7ff7181595a0 2023-10-06T02:23:46.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.806+0000 7ff71ec99700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71815e180 con 0x7ff7180cb590 2023-10-06T02:23:46.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.806+0000 7ff71ec99700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71815d570 con 0x7ff71806d890 2023-10-06T02:23:46.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.807+0000 7ff71d236700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff7180cb590 0x7ff7180cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.807+0000 7ff717fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71806d890 0x7ff71806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.807+0000 7ff71d236700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff7180cb590 0x7ff7180cba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:48712/0 (socket says 172.21.15.37:48712) 2023-10-06T02:23:46.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.807+0000 7ff71d236700 1 -- 172.21.15.37:0/4181594652 learned_addr learned my addr 172.21.15.37:0/4181594652 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:46.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.807+0000 7ff717fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71806d890 0x7ff71806dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:36146/0 (socket says 172.21.15.37:36146) 2023-10-06T02:23:46.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.807+0000 7ff71ca35700 1 --1- 172.21.15.37:0/4181594652 >> v1:172.21.15.191:6789/0 conn(0x7ff7181595a0 0x7ff7180b0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:58326/0 (socket says 172.21.15.37:58326) 2023-10-06T02:23:46.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.807+0000 7ff71d236700 1 -- 172.21.15.37:0/4181594652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71806d890 msgr2=0x7ff71806dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:46.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.807+0000 7ff71d236700 1 --2- 172.21.15.37:0/4181594652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71806d890 0x7ff71806dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.807+0000 7ff71d236700 1 -- 172.21.15.37:0/4181594652 >> v1:172.21.15.191:6789/0 conn(0x7ff7181595a0 legacy=0x7ff7180b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:46.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.807+0000 7ff71d236700 1 -- 172.21.15.37:0/4181594652 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71815d850 con 0x7ff7180cb590 2023-10-06T02:23:46.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.807+0000 7ff71d236700 1 --2- 172.21.15.37:0/4181594652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7180cb590 0x7ff7180cba10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff7000099b0 tx=0x7ff700009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e610b77b0ec7bf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:46.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.807+0000 7ff7177fe700 1 -- 172.21.15.37:0/4181594652 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff700009ea0 con 0x7ff7180cb590 2023-10-06T02:23:46.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.807+0000 7ff7177fe700 1 -- 172.21.15.37:0/4181594652 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70000b860 con 0x7ff7180cb590 2023-10-06T02:23:46.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.807+0000 7ff7177fe700 1 -- 172.21.15.37:0/4181594652 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70000bc20 con 0x7ff7180cb590 2023-10-06T02:23:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.808+0000 7ff71ec99700 1 -- 172.21.15.37:0/4181594652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7180cb590 msgr2=0x7ff7180cba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.808+0000 7ff71ec99700 1 --2- 172.21.15.37:0/4181594652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7180cb590 0x7ff7180cba10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff7000099b0 tx=0x7ff700009250 comp rx=0 tx=0).stop 2023-10-06T02:23:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.808+0000 7ff71ec99700 1 -- 172.21.15.37:0/4181594652 shutdown_connections 2023-10-06T02:23:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.808+0000 7ff71ec99700 1 --2- 172.21.15.37:0/4181594652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7180cb590 0x7ff7180cba10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.808+0000 7ff71ec99700 1 --2- 172.21.15.37:0/4181594652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71806d890 0x7ff71806dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.808+0000 7ff71ec99700 1 -- 172.21.15.37:0/4181594652 >> 172.21.15.37:0/4181594652 conn(0x7ff7180d04d0 msgr2=0x7ff7180d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.808+0000 7ff71ec99700 1 -- 172.21.15.37:0/4181594652 shutdown_connections 2023-10-06T02:23:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.808+0000 7ff71ec99700 1 -- 172.21.15.37:0/4181594652 wait complete. 2023-10-06T02:23:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.809+0000 7ff71ec99700 1 Processor -- start 2023-10-06T02:23:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.809+0000 7ff71ec99700 1 -- start start 2023-10-06T02:23:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.810+0000 7ff71ec99700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71806d890 0x7ff718159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.810+0000 7ff71ec99700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7180cb590 0x7ff718155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.810+0000 7ff71ec99700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7181595a0 0x7ff7180b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.810+0000 7ff71ec99700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71815a330 con 0x7ff7180cb590 2023-10-06T02:23:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.810+0000 7ff71ec99700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71815ab40 con 0x7ff7181595a0 2023-10-06T02:23:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.810+0000 7ff71ec99700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff718159eb0 con 0x7ff71806d890 2023-10-06T02:23:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.810+0000 7ff717fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7180cb590 0x7ff718155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.810+0000 7ff717fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7180cb590 0x7ff718155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43612/0 (socket says 172.21.15.37:43612) 2023-10-06T02:23:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.810+0000 7ff717fff700 1 -- 172.21.15.37:0/576911318 learned_addr learned my addr 172.21.15.37:0/576911318 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.810+0000 7ff71d236700 1 --2- 172.21.15.37:0/576911318 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7181595a0 0x7ff7180b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.810+0000 7ff71ca35700 1 --2- 172.21.15.37:0/576911318 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71806d890 0x7ff718159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.810+0000 7ff717fff700 1 -- 172.21.15.37:0/576911318 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71806d890 msgr2=0x7ff718159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.810+0000 7ff717fff700 1 --2- 172.21.15.37:0/576911318 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71806d890 0x7ff718159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.810+0000 7ff717fff700 1 -- 172.21.15.37:0/576911318 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7181595a0 msgr2=0x7ff7180b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.810+0000 7ff717fff700 1 --2- 172.21.15.37:0/576911318 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7181595a0 0x7ff7180b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.810+0000 7ff717fff700 1 -- 172.21.15.37:0/576911318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7000094f0 con 0x7ff7180cb590 2023-10-06T02:23:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.810+0000 7ff71ca35700 1 --2- 172.21.15.37:0/576911318 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71806d890 0x7ff718159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.811+0000 7ff717fff700 1 --2- 172.21.15.37:0/576911318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7180cb590 0x7ff718155930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff708009f20 tx=0x7ff70800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.811+0000 7ff714ff9700 1 -- 172.21.15.37:0/576911318 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70800cbd0 con 0x7ff7180cb590 2023-10-06T02:23:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.811+0000 7ff714ff9700 1 -- 172.21.15.37:0/576911318 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70800f040 con 0x7ff7180cb590 2023-10-06T02:23:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.811+0000 7ff71ec99700 1 -- 172.21.15.37:0/576911318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7180b0bb0 con 0x7ff7180cb590 2023-10-06T02:23:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.811+0000 7ff714ff9700 1 -- 172.21.15.37:0/576911318 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff708014480 con 0x7ff7180cb590 2023-10-06T02:23:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.811+0000 7ff71ec99700 1 -- 172.21.15.37:0/576911318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71815a580 con 0x7ff7180cb590 2023-10-06T02:23:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.812+0000 7ff71ec99700 1 -- 172.21.15.37:0/576911318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff718088b20 con 0x7ff7180cb590 2023-10-06T02:23:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.812+0000 7ff714ff9700 1 -- 172.21.15.37:0/576911318 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7080147f0 con 0x7ff7180cb590 2023-10-06T02:23:46.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.813+0000 7ff714ff9700 1 --2- 172.21.15.37:0/576911318 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff6f8066f30 0x7ff6f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:46.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.813+0000 7ff714ff9700 1 -- 172.21.15.37:0/576911318 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff708085040 con 0x7ff7180cb590 2023-10-06T02:23:46.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.813+0000 7ff71ca35700 1 --2- 172.21.15.37:0/576911318 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff6f8066f30 0x7ff6f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:46.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.813+0000 7ff71ca35700 1 --2- 172.21.15.37:0/576911318 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff6f8066f30 0x7ff6f80693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff710007fd0 tx=0x7ff710007e10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:46.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:46.817+0000 7ff714ff9700 1 -- 172.21.15.37:0/576911318 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff708052150 con 0x7ff7180cb590 2023-10-06T02:23:47.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.012+0000 7ff71ec99700 1 -- 172.21.15.37:0/576911318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff71815db30 con 0x7ff7180cb590 2023-10-06T02:23:47.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.013+0000 7ff714ff9700 1 -- 172.21.15.37:0/576911318 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7ff708055770 con 0x7ff7180cb590 2023-10-06T02:23:47.015 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:47.015 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:23:16.897625+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:13.004596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:14.268809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:47.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.016+0000 7ff71ec99700 1 -- 172.21.15.37:0/576911318 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff6f8066f30 msgr2=0x7ff6f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.016+0000 7ff71ec99700 1 --2- 172.21.15.37:0/576911318 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff6f8066f30 0x7ff6f80693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff710007fd0 tx=0x7ff710007e10 comp rx=0 tx=0).stop 2023-10-06T02:23:47.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.016+0000 7ff71ec99700 1 -- 172.21.15.37:0/576911318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7180cb590 msgr2=0x7ff718155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.016+0000 7ff71ec99700 1 --2- 172.21.15.37:0/576911318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7180cb590 0x7ff718155930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff708009f20 tx=0x7ff70800b040 comp rx=0 tx=0).stop 2023-10-06T02:23:47.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.016+0000 7ff71ec99700 1 -- 172.21.15.37:0/576911318 shutdown_connections 2023-10-06T02:23:47.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.016+0000 7ff71ec99700 1 --2- 172.21.15.37:0/576911318 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff6f8066f30 0x7ff6f80693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.016+0000 7ff71ec99700 1 --2- 172.21.15.37:0/576911318 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7181595a0 0x7ff7180b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.016+0000 7ff71ec99700 1 --2- 172.21.15.37:0/576911318 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71806d890 0x7ff718159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.016+0000 7ff71ec99700 1 --2- 172.21.15.37:0/576911318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7180cb590 0x7ff718155930 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.016+0000 7ff71ec99700 1 -- 172.21.15.37:0/576911318 >> 172.21.15.37:0/576911318 conn(0x7ff7180d04d0 msgr2=0x7ff718156860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:47.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.016+0000 7ff71ec99700 1 -- 172.21.15.37:0/576911318 shutdown_connections 2023-10-06T02:23:47.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.016+0000 7ff71ec99700 1 -- 172.21.15.37:0/576911318 wait complete. 2023-10-06T02:23:47.029 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:23:08.066048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:23:08.561964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:23:13.004596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:23:14.268809+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:23:47.030 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:23:47.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.149+0000 7f8399fb1700 1 Processor -- start 2023-10-06T02:23:47.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.149+0000 7f8399fb1700 1 -- start start 2023-10-06T02:23:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.150+0000 7f8399fb1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8394159790 0x7f83940cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.150+0000 7f8399fb1700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83940b07a0 con 0x7f83940b2a90 2023-10-06T02:23:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.150+0000 7f8399fb1700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83940cd8a0 con 0x7f83941593c0 2023-10-06T02:23:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.150+0000 7f8399fb1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83940afe70 con 0x7f8394159790 2023-10-06T02:23:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.150+0000 7f8392ffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f83940b2a90 0x7f83940ccb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45894/0 (socket says 172.21.15.37:45894) 2023-10-06T02:23:47.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.150+0000 7f8392ffd700 1 -- 172.21.15.37:0/1098381093 learned_addr learned my addr 172.21.15.37:0/1098381093 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:47.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f8393fff700 1 --2- 172.21.15.37:0/1098381093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8394159790 0x7f83940cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f83927fc700 1 -- 172.21.15.37:0/1098381093 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414330681 0 0) 0x7f83940b07a0 con 0x7f83940b2a90 2023-10-06T02:23:47.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f83927fc700 1 -- 172.21.15.37:0/1098381093 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f837c003570 con 0x7f83940b2a90 2023-10-06T02:23:47.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f83927fc700 1 -- 172.21.15.37:0/1098381093 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 446941560 0 0) 0x7f837c003570 con 0x7f83940b2a90 2023-10-06T02:23:47.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f83927fc700 1 -- 172.21.15.37:0/1098381093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8394159790 msgr2=0x7f83940cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:47.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f83927fc700 1 --2- 172.21.15.37:0/1098381093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8394159790 0x7f83940cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f83927fc700 1 -- 172.21.15.37:0/1098381093 >> v1:172.21.15.191:6789/0 conn(0x7f83941593c0 legacy=0x7f83940b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f83927fc700 1 -- 172.21.15.37:0/1098381093 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83940b0150 con 0x7f83940b2a90 2023-10-06T02:23:47.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f83927fc700 1 -- 172.21.15.37:0/1098381093 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f8388001470 con 0x7f83940b2a90 2023-10-06T02:23:47.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f83927fc700 1 -- 172.21.15.37:0/1098381093 >> v1:172.21.15.37:6789/0 conn(0x7f83940b2a90 legacy=0x7f83940ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f83927fc700 1 --2- 172.21.15.37:0/1098381093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f837c003a90 0x7f837c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f83927fc700 1 --2- 172.21.15.37:0/1098381093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f837c004810 0x7f837c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f83927fc700 1 --2- 172.21.15.37:0/1098381093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8394159790 0x7f837c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f83927fc700 1 -- 172.21.15.37:0/1098381093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83940afe70 con 0x7f837c003a90 2023-10-06T02:23:47.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f83927fc700 1 -- 172.21.15.37:0/1098381093 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c00bb10 con 0x7f837c004810 2023-10-06T02:23:47.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f83927fc700 1 -- 172.21.15.37:0/1098381093 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837c00bcd0 con 0x7f8394159790 2023-10-06T02:23:47.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f83937fe700 1 --2- 172.21.15.37:0/1098381093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f837c003a90 0x7f837c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f8393fff700 1 --2- 172.21.15.37:0/1098381093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8394159790 0x7f837c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f8392ffd700 1 --2- 172.21.15.37:0/1098381093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f837c004810 0x7f837c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f83937fe700 1 -- 172.21.15.37:0/1098381093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8394159790 msgr2=0x7f837c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:47.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f83937fe700 1 --2- 172.21.15.37:0/1098381093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8394159790 0x7f837c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f83937fe700 1 -- 172.21.15.37:0/1098381093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f837c004810 msgr2=0x7f837c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:47.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.151+0000 7f83937fe700 1 --2- 172.21.15.37:0/1098381093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f837c004810 0x7f837c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.152+0000 7f83937fe700 1 -- 172.21.15.37:0/1098381093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c003570 con 0x7f837c003a90 2023-10-06T02:23:47.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.152+0000 7f8392ffd700 1 --2- 172.21.15.37:0/1098381093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f837c004810 0x7f837c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:47.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.152+0000 7f83937fe700 1 --2- 172.21.15.37:0/1098381093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f837c003a90 0x7f837c003e60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f83840019a0 tx=0x7f8384007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95cb059f3092a3cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:47.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.152+0000 7f83927fc700 1 -- 172.21.15.37:0/1098381093 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838400c5d0 con 0x7f837c003a90 2023-10-06T02:23:47.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.152+0000 7f83927fc700 1 -- 172.21.15.37:0/1098381093 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838400c730 con 0x7f837c003a90 2023-10-06T02:23:47.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.152+0000 7f83927fc700 1 -- 172.21.15.37:0/1098381093 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838400cad0 con 0x7f837c003a90 2023-10-06T02:23:47.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.152+0000 7f8399fb1700 1 -- 172.21.15.37:0/1098381093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f837c003a90 msgr2=0x7f837c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.152+0000 7f8399fb1700 1 --2- 172.21.15.37:0/1098381093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f837c003a90 0x7f837c003e60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f83840019a0 tx=0x7f8384007d10 comp rx=0 tx=0).stop 2023-10-06T02:23:47.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.152+0000 7f8393fff700 1 -- 172.21.15.37:0/1098381093 reap_dead start 2023-10-06T02:23:47.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.152+0000 7f8399fb1700 1 -- 172.21.15.37:0/1098381093 shutdown_connections 2023-10-06T02:23:47.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.152+0000 7f8399fb1700 1 -- 172.21.15.37:0/1098381093 >> 172.21.15.37:0/1098381093 conn(0x7f839406c0b0 msgr2=0x7f839406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:47.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.152+0000 7f8399fb1700 1 -- 172.21.15.37:0/1098381093 shutdown_connections 2023-10-06T02:23:47.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.152+0000 7f8399fb1700 1 -- 172.21.15.37:0/1098381093 wait complete. 2023-10-06T02:23:47.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.154+0000 7f8399fb1700 1 Processor -- start 2023-10-06T02:23:47.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.154+0000 7f8399fb1700 1 -- start start 2023-10-06T02:23:47.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.154+0000 7f8399fb1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f837c003a90 0x7f83941559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.154+0000 7f8399fb1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83940c7530 0x7f83940c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.154+0000 7f8399fb1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f839415f800 0x7f839415fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.154+0000 7f8399fb1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83941601b0 con 0x7f83940c7530 2023-10-06T02:23:47.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.154+0000 7f8399fb1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83940c8c00 con 0x7f837c003a90 2023-10-06T02:23:47.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.154+0000 7f8399fb1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83940c7ff0 con 0x7f839415f800 2023-10-06T02:23:47.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.155+0000 7f8392ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83940c7530 0x7f83940c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.155+0000 7f8392ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83940c7530 0x7f83940c79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43632/0 (socket says 172.21.15.37:43632) 2023-10-06T02:23:47.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.155+0000 7f8392ffd700 1 -- 172.21.15.37:0/767809615 learned_addr learned my addr 172.21.15.37:0/767809615 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:47.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.155+0000 7f8393fff700 1 --2- 172.21.15.37:0/767809615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f839415f800 0x7f839415fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.155+0000 7f83937fe700 1 --2- 172.21.15.37:0/767809615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f837c003a90 0x7f83941559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.155+0000 7f8392ffd700 1 -- 172.21.15.37:0/767809615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f839415f800 msgr2=0x7f839415fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.155+0000 7f8392ffd700 1 --2- 172.21.15.37:0/767809615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f839415f800 0x7f839415fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.155+0000 7f8392ffd700 1 -- 172.21.15.37:0/767809615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f837c003a90 msgr2=0x7f83941559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.155+0000 7f8392ffd700 1 --2- 172.21.15.37:0/767809615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f837c003a90 0x7f83941559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.155+0000 7f8392ffd700 1 -- 172.21.15.37:0/767809615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83940c82d0 con 0x7f83940c7530 2023-10-06T02:23:47.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.155+0000 7f8393fff700 1 --2- 172.21.15.37:0/767809615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f839415f800 0x7f839415fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:47.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.155+0000 7f8392ffd700 1 --2- 172.21.15.37:0/767809615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83940c7530 0x7f83940c79a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8388001ed0 tx=0x7f83880010f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:47.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.155+0000 7f837b7fe700 1 -- 172.21.15.37:0/767809615 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838800c7b0 con 0x7f83940c7530 2023-10-06T02:23:47.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.155+0000 7f837b7fe700 1 -- 172.21.15.37:0/767809615 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838800c910 con 0x7f83940c7530 2023-10-06T02:23:47.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.155+0000 7f8399fb1700 1 -- 172.21.15.37:0/767809615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83940c85b0 con 0x7f83940c7530 2023-10-06T02:23:47.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.155+0000 7f837b7fe700 1 -- 172.21.15.37:0/767809615 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838800ccb0 con 0x7f83940c7530 2023-10-06T02:23:47.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.155+0000 7f8399fb1700 1 -- 172.21.15.37:0/767809615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83940c97f0 con 0x7f83940c7530 2023-10-06T02:23:47.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.156+0000 7f8399fb1700 1 -- 172.21.15.37:0/767809615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8394088bb0 con 0x7f83940c7530 2023-10-06T02:23:47.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.156+0000 7f837b7fe700 1 -- 172.21.15.37:0/767809615 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8388013630 con 0x7f83940c7530 2023-10-06T02:23:47.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.157+0000 7f837b7fe700 1 --2- 172.21.15.37:0/767809615 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8380066f30 0x7f83800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.157+0000 7f837b7fe700 1 -- 172.21.15.37:0/767809615 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8388084720 con 0x7f83940c7530 2023-10-06T02:23:47.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.157+0000 7f83937fe700 1 --2- 172.21.15.37:0/767809615 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8380066f30 0x7f83800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.158+0000 7f83937fe700 1 --2- 172.21.15.37:0/767809615 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8380066f30 0x7f83800693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8384000fd0 tx=0x7f8384015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:47.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.161+0000 7f837b7fe700 1 -- 172.21.15.37:0/767809615 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83880552c0 con 0x7f83940c7530 2023-10-06T02:23:47.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.355+0000 7f8399fb1700 1 -- 172.21.15.37:0/767809615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f83940b0430 con 0x7f83940c7530 2023-10-06T02:23:47.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.356+0000 7f837b7fe700 1 -- 172.21.15.37:0/767809615 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8388054e50 con 0x7f83940c7530 2023-10-06T02:23:47.357 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T02:23:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.358+0000 7f8399fb1700 1 -- 172.21.15.37:0/767809615 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8380066f30 msgr2=0x7f83800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.358+0000 7f8399fb1700 1 --2- 172.21.15.37:0/767809615 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8380066f30 0x7f83800693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8384000fd0 tx=0x7f8384015000 comp rx=0 tx=0).stop 2023-10-06T02:23:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.358+0000 7f8399fb1700 1 -- 172.21.15.37:0/767809615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83940c7530 msgr2=0x7f83940c79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.358+0000 7f8399fb1700 1 --2- 172.21.15.37:0/767809615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83940c7530 0x7f83940c79a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8388001ed0 tx=0x7f83880010f0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.358+0000 7f8399fb1700 1 -- 172.21.15.37:0/767809615 shutdown_connections 2023-10-06T02:23:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.358+0000 7f8399fb1700 1 --2- 172.21.15.37:0/767809615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f839415f800 0x7f839415fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.358+0000 7f8399fb1700 1 --2- 172.21.15.37:0/767809615 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8380066f30 0x7f83800693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.358+0000 7f8399fb1700 1 --2- 172.21.15.37:0/767809615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f837c003a90 0x7f83941559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.358+0000 7f8399fb1700 1 --2- 172.21.15.37:0/767809615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83940c7530 0x7f83940c79a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.358+0000 7f8399fb1700 1 -- 172.21.15.37:0/767809615 >> 172.21.15.37:0/767809615 conn(0x7f839406c0b0 msgr2=0x7f839406c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:47.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.358+0000 7f8399fb1700 1 -- 172.21.15.37:0/767809615 shutdown_connections 2023-10-06T02:23:47.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.358+0000 7f8399fb1700 1 -- 172.21.15.37:0/767809615 wait complete. 2023-10-06T02:23:47.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:23:47.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.492+0000 7fa104216700 1 Processor -- start 2023-10-06T02:23:47.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.492+0000 7fa104216700 1 -- start start 2023-10-06T02:23:47.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.493+0000 7fa104216700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa0fc159790 0x7fa0fc0cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.493+0000 7fa104216700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0fc0b07a0 con 0x7fa0fc1593c0 2023-10-06T02:23:47.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.493+0000 7fa104216700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0fc0cd8a0 con 0x7fa0fc0b2a90 2023-10-06T02:23:47.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.493+0000 7fa104216700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0fc159bd0 con 0x7fa0fc159790 2023-10-06T02:23:47.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.493+0000 7fa1027b3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa0fc159790 0x7fa0fc0cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.493+0000 7fa101fb2700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa0fc1593c0 0x7fa0fc0b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45908/0 (socket says 172.21.15.37:45908) 2023-10-06T02:23:47.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.493+0000 7fa101fb2700 1 -- 172.21.15.37:0/3297714732 learned_addr learned my addr 172.21.15.37:0/3297714732 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:47.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.494+0000 7fa1027b3700 1 -- 172.21.15.37:0/3297714732 >> v1:172.21.15.191:6789/0 conn(0x7fa0fc0b2a90 legacy=0x7fa0fc0ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:47.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.494+0000 7fa1027b3700 1 -- 172.21.15.37:0/3297714732 >> v1:172.21.15.37:6789/0 conn(0x7fa0fc1593c0 legacy=0x7fa0fc0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.494+0000 7fa1027b3700 1 -- 172.21.15.37:0/3297714732 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0fc0afe70 con 0x7fa0fc159790 2023-10-06T02:23:47.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.494+0000 7fa100fb0700 1 -- 172.21.15.37:0/3297714732 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418189769 0 0) 0x7fa0fc0b07a0 con 0x7fa0fc1593c0 2023-10-06T02:23:47.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.494+0000 7fa1027b3700 1 --2- 172.21.15.37:0/3297714732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0fc159790 0x7fa0fc0cd240 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec009e60 tx=0x7fa0ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848713966e14007d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:47.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.494+0000 7fa100fb0700 1 -- 172.21.15.37:0/3297714732 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec00e070 con 0x7fa0fc159790 2023-10-06T02:23:47.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.494+0000 7fa100fb0700 1 -- 172.21.15.37:0/3297714732 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ec00bc30 con 0x7fa0fc159790 2023-10-06T02:23:47.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.494+0000 7fa100fb0700 1 -- 172.21.15.37:0/3297714732 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec012430 con 0x7fa0fc159790 2023-10-06T02:23:47.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.494+0000 7fa104216700 1 -- 172.21.15.37:0/3297714732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0fc159790 msgr2=0x7fa0fc0cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.494+0000 7fa104216700 1 --2- 172.21.15.37:0/3297714732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0fc159790 0x7fa0fc0cd240 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec009e60 tx=0x7fa0ec009780 comp rx=0 tx=0).stop 2023-10-06T02:23:47.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.494+0000 7fa104216700 1 -- 172.21.15.37:0/3297714732 shutdown_connections 2023-10-06T02:23:47.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.494+0000 7fa104216700 1 --2- 172.21.15.37:0/3297714732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0fc159790 0x7fa0fc0cd240 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.494+0000 7fa104216700 1 -- 172.21.15.37:0/3297714732 >> 172.21.15.37:0/3297714732 conn(0x7fa0fc06c0b0 msgr2=0x7fa0fc06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:47.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.495+0000 7fa104216700 1 -- 172.21.15.37:0/3297714732 shutdown_connections 2023-10-06T02:23:47.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.495+0000 7fa104216700 1 -- 172.21.15.37:0/3297714732 wait complete. 2023-10-06T02:23:47.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.496+0000 7fa104216700 1 Processor -- start 2023-10-06T02:23:47.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.496+0000 7fa104216700 1 -- start start 2023-10-06T02:23:47.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.496+0000 7fa104216700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0fc0b2a90 0x7fa0fc0b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.496+0000 7fa104216700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0fc1593c0 0x7fa0fc159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.496+0000 7fa104216700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0fc159790 0x7fa0fc156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.496+0000 7fa104216700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc15b3b0 con 0x7fa0fc0b2a90 2023-10-06T02:23:47.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.496+0000 7fa104216700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc15a250 con 0x7fa0fc159790 2023-10-06T02:23:47.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.496+0000 7fa104216700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc15a4f0 con 0x7fa0fc1593c0 2023-10-06T02:23:47.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.496+0000 7fa101fb2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0fc0b2a90 0x7fa0fc0b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.497+0000 7fa101fb2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0fc0b2a90 0x7fa0fc0b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43652/0 (socket says 172.21.15.37:43652) 2023-10-06T02:23:47.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.497+0000 7fa101fb2700 1 -- 172.21.15.37:0/3345234845 learned_addr learned my addr 172.21.15.37:0/3345234845 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:47.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.497+0000 7fa1017b1700 1 --2- 172.21.15.37:0/3345234845 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0fc1593c0 0x7fa0fc159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.497+0000 7fa1027b3700 1 --2- 172.21.15.37:0/3345234845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0fc159790 0x7fa0fc156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.497+0000 7fa101fb2700 1 -- 172.21.15.37:0/3345234845 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0fc1593c0 msgr2=0x7fa0fc159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.497+0000 7fa101fb2700 1 --2- 172.21.15.37:0/3345234845 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0fc1593c0 0x7fa0fc159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.497+0000 7fa101fb2700 1 -- 172.21.15.37:0/3345234845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0fc159790 msgr2=0x7fa0fc156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.497+0000 7fa101fb2700 1 --2- 172.21.15.37:0/3345234845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0fc159790 0x7fa0fc156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.497+0000 7fa101fb2700 1 -- 172.21.15.37:0/3345234845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ec009a20 con 0x7fa0fc0b2a90 2023-10-06T02:23:47.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.497+0000 7fa101fb2700 1 --2- 172.21.15.37:0/3345234845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0fc0b2a90 0x7fa0fc0b4330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400c7e0 tx=0x7fa0f4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:47.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.497+0000 7fa0f9ffb700 1 -- 172.21.15.37:0/3345234845 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4005b30 con 0x7fa0fc0b2a90 2023-10-06T02:23:47.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.497+0000 7fa0f9ffb700 1 -- 172.21.15.37:0/3345234845 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f4005c90 con 0x7fa0fc0b2a90 2023-10-06T02:23:47.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.497+0000 7fa104216700 1 -- 172.21.15.37:0/3345234845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0fc15a7d0 con 0x7fa0fc0b2a90 2023-10-06T02:23:47.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.497+0000 7fa0f9ffb700 1 -- 172.21.15.37:0/3345234845 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4007300 con 0x7fa0fc0b2a90 2023-10-06T02:23:47.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.497+0000 7fa104216700 1 -- 172.21.15.37:0/3345234845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0fc156f90 con 0x7fa0fc0b2a90 2023-10-06T02:23:47.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.498+0000 7fa104216700 1 -- 172.21.15.37:0/3345234845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0fc15acf0 con 0x7fa0fc0b2a90 2023-10-06T02:23:47.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.499+0000 7fa0f9ffb700 1 -- 172.21.15.37:0/3345234845 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa0f401b400 con 0x7fa0fc0b2a90 2023-10-06T02:23:47.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.499+0000 7fa0f9ffb700 1 --2- 172.21.15.37:0/3345234845 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa0e8066f30 0x7fa0e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.499+0000 7fa0f9ffb700 1 -- 172.21.15.37:0/3345234845 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa0f4084230 con 0x7fa0fc0b2a90 2023-10-06T02:23:47.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.499+0000 7fa1017b1700 1 --2- 172.21.15.37:0/3345234845 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa0e8066f30 0x7fa0e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.500+0000 7fa1017b1700 1 --2- 172.21.15.37:0/3345234845 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa0e8066f30 0x7fa0e80693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0b5b90 tx=0x7fa0f0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:47.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.503+0000 7fa0f9ffb700 1 -- 172.21.15.37:0/3345234845 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0f40513a0 con 0x7fa0fc0b2a90 2023-10-06T02:23:47.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.696+0000 7fa104216700 1 -- 172.21.15.37:0/3345234845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa0fc0b0150 con 0x7fa0fc0b2a90 2023-10-06T02:23:47.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.696+0000 7fa0f9ffb700 1 -- 172.21.15.37:0/3345234845 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa0f40549c0 con 0x7fa0fc0b2a90 2023-10-06T02:23:47.697 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T02:23:47.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.698+0000 7fa104216700 1 -- 172.21.15.37:0/3345234845 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa0e8066f30 msgr2=0x7fa0e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.698+0000 7fa104216700 1 --2- 172.21.15.37:0/3345234845 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa0e8066f30 0x7fa0e80693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0b5b90 tx=0x7fa0f0009040 comp rx=0 tx=0).stop 2023-10-06T02:23:47.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.698+0000 7fa104216700 1 -- 172.21.15.37:0/3345234845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0fc0b2a90 msgr2=0x7fa0fc0b4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.698+0000 7fa104216700 1 --2- 172.21.15.37:0/3345234845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0fc0b2a90 0x7fa0fc0b4330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400c7e0 tx=0x7fa0f4007df0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.699+0000 7fa104216700 1 -- 172.21.15.37:0/3345234845 shutdown_connections 2023-10-06T02:23:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.699+0000 7fa104216700 1 --2- 172.21.15.37:0/3345234845 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa0e8066f30 0x7fa0e80693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.699+0000 7fa104216700 1 --2- 172.21.15.37:0/3345234845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0fc159790 0x7fa0fc156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.699+0000 7fa104216700 1 --2- 172.21.15.37:0/3345234845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0fc0b2a90 0x7fa0fc0b4330 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.699+0000 7fa104216700 1 --2- 172.21.15.37:0/3345234845 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0fc1593c0 0x7fa0fc159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.699+0000 7fa104216700 1 -- 172.21.15.37:0/3345234845 >> 172.21.15.37:0/3345234845 conn(0x7fa0fc06c0b0 msgr2=0x7fa0fc0d0500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.699+0000 7fa104216700 1 -- 172.21.15.37:0/3345234845 shutdown_connections 2023-10-06T02:23:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.699+0000 7fa104216700 1 -- 172.21.15.37:0/3345234845 wait complete. 2023-10-06T02:23:47.712 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:23:47.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.832+0000 7f8ebd61b700 1 Processor -- start 2023-10-06T02:23:47.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.832+0000 7f8ebd61b700 1 -- start start 2023-10-06T02:23:47.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.833+0000 7f8ebd61b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8eb81593c0 0x7f8eb8159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.833+0000 7f8ebd61b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8eb80b2380 0x7f8eb80b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.833+0000 7f8ebd61b700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb80b07a0 con 0x7f8eb80ccb30 2023-10-06T02:23:47.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.833+0000 7f8ebd61b700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb80cd6c0 con 0x7f8eb81593c0 2023-10-06T02:23:47.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.833+0000 7f8ebd61b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb80cd8a0 con 0x7f8eb80b2380 2023-10-06T02:23:47.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.833+0000 7f8eb6ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8eb81593c0 0x7f8eb8159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.833+0000 7f8eb77fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8eb80ccb30 0x7f8eb80ccfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45922/0 (socket says 172.21.15.37:45922) 2023-10-06T02:23:47.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.833+0000 7f8eb77fe700 1 -- 172.21.15.37:0/821727033 learned_addr learned my addr 172.21.15.37:0/821727033 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:47.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.834+0000 7f8eb67fc700 1 --2- 172.21.15.37:0/821727033 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8eb80b2380 0x7f8eb80b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.834+0000 7f8eb6ffd700 1 -- 172.21.15.37:0/821727033 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8eb80b2380 msgr2=0x7f8eb80b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:47.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.834+0000 7f8eb6ffd700 1 --2- 172.21.15.37:0/821727033 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8eb80b2380 0x7f8eb80b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.834+0000 7f8eb6ffd700 1 -- 172.21.15.37:0/821727033 >> v1:172.21.15.37:6789/0 conn(0x7f8eb80ccb30 legacy=0x7f8eb80ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.834+0000 7f8eb5ffb700 1 -- 172.21.15.37:0/821727033 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527108808 0 0) 0x7f8eb80b07a0 con 0x7f8eb80ccb30 2023-10-06T02:23:47.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.834+0000 7f8eb6ffd700 1 -- 172.21.15.37:0/821727033 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb80afe70 con 0x7f8eb81593c0 2023-10-06T02:23:47.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.834+0000 7f8eb6ffd700 1 --2- 172.21.15.37:0/821727033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8eb81593c0 0x7f8eb8159790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00098e0 tx=0x7f8eb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36ac569ffe61a76 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:47.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.834+0000 7f8eb5ffb700 1 -- 172.21.15.37:0/821727033 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0009e80 con 0x7f8eb81593c0 2023-10-06T02:23:47.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.834+0000 7f8eb5ffb700 1 -- 172.21.15.37:0/821727033 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb000b860 con 0x7f8eb81593c0 2023-10-06T02:23:47.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.834+0000 7f8eb5ffb700 1 -- 172.21.15.37:0/821727033 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb000bbe0 con 0x7f8eb81593c0 2023-10-06T02:23:47.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.834+0000 7f8ebd61b700 1 -- 172.21.15.37:0/821727033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8eb81593c0 msgr2=0x7f8eb8159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.834+0000 7f8ebd61b700 1 --2- 172.21.15.37:0/821727033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8eb81593c0 0x7f8eb8159790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00098e0 tx=0x7f8eb00091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.835+0000 7f8ebd61b700 1 -- 172.21.15.37:0/821727033 shutdown_connections 2023-10-06T02:23:47.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.835+0000 7f8ebd61b700 1 --2- 172.21.15.37:0/821727033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8eb81593c0 0x7f8eb8159790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.835+0000 7f8ebd61b700 1 --2- 172.21.15.37:0/821727033 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8eb80b2380 0x7f8eb80b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.835+0000 7f8ebd61b700 1 -- 172.21.15.37:0/821727033 >> 172.21.15.37:0/821727033 conn(0x7f8eb806c0b0 msgr2=0x7f8eb806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:47.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.835+0000 7f8ebd61b700 1 -- 172.21.15.37:0/821727033 shutdown_connections 2023-10-06T02:23:47.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.835+0000 7f8ebd61b700 1 -- 172.21.15.37:0/821727033 wait complete. 2023-10-06T02:23:47.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.836+0000 7f8ebd61b700 1 Processor -- start 2023-10-06T02:23:47.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.836+0000 7f8ebd61b700 1 -- start start 2023-10-06T02:23:47.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8ebd61b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8eb80b2380 0x7f8eb80d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8ebd61b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8eb80ccb30 0x7f8eb816a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8ebd61b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8eb81593c0 0x7f8eb80c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8ebd61b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb816abb0 con 0x7f8eb80ccb30 2023-10-06T02:23:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8ebd61b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb81600d0 con 0x7f8eb80b2380 2023-10-06T02:23:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8ebd61b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb815f4c0 con 0x7f8eb81593c0 2023-10-06T02:23:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8eb67fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8eb80ccb30 0x7f8eb816a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8eb67fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8eb80ccb30 0x7f8eb816a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43670/0 (socket says 172.21.15.37:43670) 2023-10-06T02:23:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8eb67fc700 1 -- 172.21.15.37:0/1510678538 learned_addr learned my addr 172.21.15.37:0/1510678538 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8eb6ffd700 1 --2- 172.21.15.37:0/1510678538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8eb80b2380 0x7f8eb80d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8eb77fe700 1 --2- 172.21.15.37:0/1510678538 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8eb81593c0 0x7f8eb80c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8eb67fc700 1 -- 172.21.15.37:0/1510678538 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8eb81593c0 msgr2=0x7f8eb80c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8eb67fc700 1 --2- 172.21.15.37:0/1510678538 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8eb81593c0 0x7f8eb80c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8eb67fc700 1 -- 172.21.15.37:0/1510678538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8eb80b2380 msgr2=0x7f8eb80d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:47.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8eb67fc700 1 --2- 172.21.15.37:0/1510678538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8eb80b2380 0x7f8eb80d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:47.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8eb67fc700 1 -- 172.21.15.37:0/1510678538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb0009420 con 0x7f8eb80ccb30 2023-10-06T02:23:47.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8eb67fc700 1 --2- 172.21.15.37:0/1510678538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8eb80ccb30 0x7f8eb816a670 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000d890 tx=0x7f8ea0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:47.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8eaeffd700 1 -- 172.21.15.37:0/1510678538 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea00125f0 con 0x7f8eb80ccb30 2023-10-06T02:23:47.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8eaeffd700 1 -- 172.21.15.37:0/1510678538 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea0012750 con 0x7f8eb80ccb30 2023-10-06T02:23:47.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8ebd61b700 1 -- 172.21.15.37:0/1510678538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb815f7a0 con 0x7f8eb80ccb30 2023-10-06T02:23:47.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8eaeffd700 1 -- 172.21.15.37:0/1510678538 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0012af0 con 0x7f8eb80ccb30 2023-10-06T02:23:47.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.837+0000 7f8ebd61b700 1 -- 172.21.15.37:0/1510678538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb815fd60 con 0x7f8eb80ccb30 2023-10-06T02:23:47.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.839+0000 7f8ebd61b700 1 -- 172.21.15.37:0/1510678538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb815d100 con 0x7f8eb80ccb30 2023-10-06T02:23:47.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.839+0000 7f8eaeffd700 1 -- 172.21.15.37:0/1510678538 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ea001e460 con 0x7f8eb80ccb30 2023-10-06T02:23:47.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.839+0000 7f8eaeffd700 1 --2- 172.21.15.37:0/1510678538 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8e98066f30 0x7f8e980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:47.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.839+0000 7f8eaeffd700 1 -- 172.21.15.37:0/1510678538 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8ea0084c00 con 0x7f8eb80ccb30 2023-10-06T02:23:47.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.839+0000 7f8eb6ffd700 1 --2- 172.21.15.37:0/1510678538 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8e98066f30 0x7f8e980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:47.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.840+0000 7f8eb6ffd700 1 --2- 172.21.15.37:0/1510678538 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8e98066f30 0x7f8e980693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00091e0 tx=0x7f8eb0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:47.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:47.843+0000 7f8eaeffd700 1 -- 172.21.15.37:0/1510678538 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ea008b080 con 0x7f8eb80ccb30 2023-10-06T02:23:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.037+0000 7f8ebd61b700 1 -- 172.21.15.37:0/1510678538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8eb80b0150 con 0x7f8eb80ccb30 2023-10-06T02:23:48.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.038+0000 7f8eaeffd700 1 -- 172.21.15.37:0/1510678538 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ea0051d10 con 0x7f8eb80ccb30 2023-10-06T02:23:48.039 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T02:23:48.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.040+0000 7f8ebd61b700 1 -- 172.21.15.37:0/1510678538 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8e98066f30 msgr2=0x7f8e980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.040+0000 7f8ebd61b700 1 --2- 172.21.15.37:0/1510678538 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8e98066f30 0x7f8e980693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00091e0 tx=0x7f8eb0017000 comp rx=0 tx=0).stop 2023-10-06T02:23:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.040+0000 7f8ebd61b700 1 -- 172.21.15.37:0/1510678538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8eb80ccb30 msgr2=0x7f8eb816a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.040+0000 7f8ebd61b700 1 --2- 172.21.15.37:0/1510678538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8eb80ccb30 0x7f8eb816a670 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000d890 tx=0x7f8ea0008040 comp rx=0 tx=0).stop 2023-10-06T02:23:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.040+0000 7f8ebd61b700 1 -- 172.21.15.37:0/1510678538 shutdown_connections 2023-10-06T02:23:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.040+0000 7f8ebd61b700 1 --2- 172.21.15.37:0/1510678538 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8eb81593c0 0x7f8eb80c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.040+0000 7f8ebd61b700 1 --2- 172.21.15.37:0/1510678538 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8e98066f30 0x7f8e980693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.040+0000 7f8ebd61b700 1 --2- 172.21.15.37:0/1510678538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8eb80b2380 0x7f8eb80d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.040+0000 7f8ebd61b700 1 --2- 172.21.15.37:0/1510678538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8eb80ccb30 0x7f8eb816a670 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.040+0000 7f8ebd61b700 1 -- 172.21.15.37:0/1510678538 >> 172.21.15.37:0/1510678538 conn(0x7f8eb806c0b0 msgr2=0x7f8eb8158860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.040+0000 7f8ebd61b700 1 -- 172.21.15.37:0/1510678538 shutdown_connections 2023-10-06T02:23:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.040+0000 7f8ebd61b700 1 -- 172.21.15.37:0/1510678538 wait complete. 2023-10-06T02:23:48.053 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:23:48.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.172+0000 7fee77edf700 1 Processor -- start 2023-10-06T02:23:48.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.173+0000 7fee77edf700 1 -- start start 2023-10-06T02:23:48.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.173+0000 7fee77edf700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fee7006c7c0 0x7fee700c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.173+0000 7fee77edf700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee700c7f30 con 0x7fee701576c0 2023-10-06T02:23:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.173+0000 7fee77edf700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee700c8210 con 0x7fee701572f0 2023-10-06T02:23:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.173+0000 7fee77edf700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee700c9c60 con 0x7fee7006c7c0 2023-10-06T02:23:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.174+0000 7fee7647c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fee701576c0 0x7fee700acaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45930/0 (socket says 172.21.15.37:45930) 2023-10-06T02:23:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.174+0000 7fee7647c700 1 -- 172.21.15.37:0/1579617365 learned_addr learned my addr 172.21.15.37:0/1579617365 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.174+0000 7fee7547a700 1 --2- 172.21.15.37:0/1579617365 >> v2:172.21.15.191:3300/0 conn(0x7fee7006c7c0 0x7fee700c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.174+0000 7fee74c79700 1 -- 172.21.15.37:0/1579617365 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491371483 0 0) 0x7fee700c7f30 con 0x7fee701576c0 2023-10-06T02:23:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.174+0000 7fee74c79700 1 -- 172.21.15.37:0/1579617365 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee58003570 con 0x7fee701576c0 2023-10-06T02:23:48.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.174+0000 7fee74c79700 1 -- 172.21.15.37:0/1579617365 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 104182675 0 0) 0x7fee58003570 con 0x7fee701576c0 2023-10-06T02:23:48.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.174+0000 7fee7547a700 1 -- 172.21.15.37:0/1579617365 >> v1:172.21.15.191:6789/0 conn(0x7fee701572f0 legacy=0x7fee7006c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.174+0000 7fee7547a700 1 -- 172.21.15.37:0/1579617365 >> v1:172.21.15.37:6789/0 conn(0x7fee701576c0 legacy=0x7fee700acaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.174+0000 7fee7547a700 1 -- 172.21.15.37:0/1579617365 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee700c9f40 con 0x7fee7006c7c0 2023-10-06T02:23:48.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.174+0000 7fee7547a700 1 --2- 172.21.15.37:0/1579617365 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee7006c7c0 0x7fee700c78a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fee640098e0 tx=0x7fee640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94e08def718cf9fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:48.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.174+0000 7fee74c79700 1 -- 172.21.15.37:0/1579617365 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee600017f0 con 0x7fee7006c7c0 2023-10-06T02:23:48.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.174+0000 7fee74c79700 1 -- 172.21.15.37:0/1579617365 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee64011420 con 0x7fee7006c7c0 2023-10-06T02:23:48.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.175+0000 7fee74c79700 1 -- 172.21.15.37:0/1579617365 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee640117c0 con 0x7fee7006c7c0 2023-10-06T02:23:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.175+0000 7fee77edf700 1 -- 172.21.15.37:0/1579617365 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee7006c7c0 msgr2=0x7fee700c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.175+0000 7fee77edf700 1 --2- 172.21.15.37:0/1579617365 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee7006c7c0 0x7fee700c78a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fee640098e0 tx=0x7fee640091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.175+0000 7fee77edf700 1 -- 172.21.15.37:0/1579617365 shutdown_connections 2023-10-06T02:23:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.175+0000 7fee77edf700 1 --2- 172.21.15.37:0/1579617365 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee7006c7c0 0x7fee700c78a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.175+0000 7fee77edf700 1 -- 172.21.15.37:0/1579617365 >> 172.21.15.37:0/1579617365 conn(0x7fee700680f0 msgr2=0x7fee7006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.175+0000 7fee77edf700 1 -- 172.21.15.37:0/1579617365 shutdown_connections 2023-10-06T02:23:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.175+0000 7fee77edf700 1 -- 172.21.15.37:0/1579617365 wait complete. 2023-10-06T02:23:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.176+0000 7fee77edf700 1 Processor -- start 2023-10-06T02:23:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.176+0000 7fee77edf700 1 -- start start 2023-10-06T02:23:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.177+0000 7fee77edf700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee7006c7c0 0x7fee70152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.177+0000 7fee77edf700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee701572f0 0x7fee70153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.177+0000 7fee77edf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee701576c0 0x7fee70153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.177+0000 7fee77edf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7015bd40 con 0x7fee701576c0 2023-10-06T02:23:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.177+0000 7fee77edf700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee701698d0 con 0x7fee7006c7c0 2023-10-06T02:23:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.177+0000 7fee77edf700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee70169b40 con 0x7fee701572f0 2023-10-06T02:23:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.177+0000 7fee7647c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee701576c0 0x7fee70153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.177+0000 7fee7647c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee701576c0 0x7fee70153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43686/0 (socket says 172.21.15.37:43686) 2023-10-06T02:23:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.177+0000 7fee7647c700 1 -- 172.21.15.37:0/3252329111 learned_addr learned my addr 172.21.15.37:0/3252329111 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.177+0000 7fee7547a700 1 --2- 172.21.15.37:0/3252329111 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee701572f0 0x7fee70153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.177+0000 7fee75c7b700 1 --2- 172.21.15.37:0/3252329111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee7006c7c0 0x7fee70152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.177+0000 7fee7647c700 1 -- 172.21.15.37:0/3252329111 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee701572f0 msgr2=0x7fee70153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.177+0000 7fee7647c700 1 --2- 172.21.15.37:0/3252329111 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee701572f0 0x7fee70153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.177+0000 7fee7647c700 1 -- 172.21.15.37:0/3252329111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee7006c7c0 msgr2=0x7fee70152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.177+0000 7fee7647c700 1 --2- 172.21.15.37:0/3252329111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee7006c7c0 0x7fee70152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.177+0000 7fee7647c700 1 -- 172.21.15.37:0/3252329111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee64009420 con 0x7fee701576c0 2023-10-06T02:23:48.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.177+0000 7fee75c7b700 1 --2- 172.21.15.37:0/3252329111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee7006c7c0 0x7fee70152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:48.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.177+0000 7fee7547a700 1 --2- 172.21.15.37:0/3252329111 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee701572f0 0x7fee70153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:48.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.178+0000 7fee7647c700 1 --2- 172.21.15.37:0/3252329111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee701576c0 0x7fee70153eb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fee6000cc90 tx=0x7fee600018e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:48.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.178+0000 7fee6dffb700 1 -- 172.21.15.37:0/3252329111 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6000ce40 con 0x7fee701576c0 2023-10-06T02:23:48.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.178+0000 7fee6dffb700 1 -- 172.21.15.37:0/3252329111 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee60004dc0 con 0x7fee701576c0 2023-10-06T02:23:48.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.178+0000 7fee77edf700 1 -- 172.21.15.37:0/3252329111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee70169e20 con 0x7fee701576c0 2023-10-06T02:23:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.178+0000 7fee6dffb700 1 -- 172.21.15.37:0/3252329111 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6000ab70 con 0x7fee701576c0 2023-10-06T02:23:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.178+0000 7fee77edf700 1 -- 172.21.15.37:0/3252329111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7016a3e0 con 0x7fee701576c0 2023-10-06T02:23:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.179+0000 7fee77edf700 1 -- 172.21.15.37:0/3252329111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee70070c30 con 0x7fee701576c0 2023-10-06T02:23:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.179+0000 7fee6dffb700 1 -- 172.21.15.37:0/3252329111 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee60007150 con 0x7fee701576c0 2023-10-06T02:23:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.180+0000 7fee6dffb700 1 --2- 172.21.15.37:0/3252329111 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fee5c066f30 0x7fee5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.180+0000 7fee6dffb700 1 -- 172.21.15.37:0/3252329111 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fee60083e50 con 0x7fee701576c0 2023-10-06T02:23:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.180+0000 7fee75c7b700 1 --2- 172.21.15.37:0/3252329111 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fee5c066f30 0x7fee5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.180+0000 7fee75c7b700 1 --2- 172.21.15.37:0/3252329111 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fee5c066f30 0x7fee5c0693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fee68001960 tx=0x7fee68009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.184+0000 7fee6dffb700 1 -- 172.21.15.37:0/3252329111 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee60050f40 con 0x7fee701576c0 2023-10-06T02:23:48.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.374+0000 7fee77edf700 1 -- 172.21.15.37:0/3252329111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee700ca220 con 0x7fee701576c0 2023-10-06T02:23:48.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.375+0000 7fee6dffb700 1 -- 172.21.15.37:0/3252329111 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fee600180a0 con 0x7fee701576c0 2023-10-06T02:23:48.376 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T02:23:48.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.376+0000 7fee77edf700 1 -- 172.21.15.37:0/3252329111 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fee5c066f30 msgr2=0x7fee5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.376+0000 7fee77edf700 1 --2- 172.21.15.37:0/3252329111 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fee5c066f30 0x7fee5c0693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fee68001960 tx=0x7fee68009040 comp rx=0 tx=0).stop 2023-10-06T02:23:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.376+0000 7fee77edf700 1 -- 172.21.15.37:0/3252329111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee701576c0 msgr2=0x7fee70153eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.376+0000 7fee77edf700 1 --2- 172.21.15.37:0/3252329111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee701576c0 0x7fee70153eb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fee6000cc90 tx=0x7fee600018e0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.376+0000 7fee77edf700 1 -- 172.21.15.37:0/3252329111 shutdown_connections 2023-10-06T02:23:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.376+0000 7fee77edf700 1 --2- 172.21.15.37:0/3252329111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee701576c0 0x7fee70153eb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.377+0000 7fee77edf700 1 --2- 172.21.15.37:0/3252329111 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fee5c066f30 0x7fee5c0693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.377+0000 7fee77edf700 1 --2- 172.21.15.37:0/3252329111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee7006c7c0 0x7fee70152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.377+0000 7fee77edf700 1 --2- 172.21.15.37:0/3252329111 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee701572f0 0x7fee70153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.377+0000 7fee77edf700 1 -- 172.21.15.37:0/3252329111 >> 172.21.15.37:0/3252329111 conn(0x7fee700680f0 msgr2=0x7fee70154fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:48.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.377+0000 7fee77edf700 1 -- 172.21.15.37:0/3252329111 shutdown_connections 2023-10-06T02:23:48.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.377+0000 7fee77edf700 1 -- 172.21.15.37:0/3252329111 wait complete. 2023-10-06T02:23:48.390 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:48.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.506+0000 7fb5c0dc1700 1 Processor -- start 2023-10-06T02:23:48.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.506+0000 7fb5c0dc1700 1 -- start start 2023-10-06T02:23:48.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.507+0000 7fb5c0dc1700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb5bc159760 0x7fb5bc15d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.507+0000 7fb5c0dc1700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5bc15e1d0 con 0x7fb5bc15d8d0 2023-10-06T02:23:48.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.507+0000 7fb5c0dc1700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5bc0cb650 con 0x7fb5bc15dd50 2023-10-06T02:23:48.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.507+0000 7fb5c0dc1700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5bc0cc2d0 con 0x7fb5bc159760 2023-10-06T02:23:48.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.508+0000 7fb5b9d9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb5bc15d8d0 0x7fb5bc0c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45934/0 (socket says 172.21.15.37:45934) 2023-10-06T02:23:48.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.508+0000 7fb5b9d9b700 1 -- 172.21.15.37:0/2439761505 learned_addr learned my addr 172.21.15.37:0/2439761505 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:48.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.508+0000 7fb5ba59c700 1 --2- 172.21.15.37:0/2439761505 >> v2:172.21.15.191:3300/0 conn(0x7fb5bc159760 0x7fb5bc15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.508+0000 7fb5b959a700 1 -- 172.21.15.37:0/2439761505 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476477594 0 0) 0x7fb5bc15e1d0 con 0x7fb5bc15d8d0 2023-10-06T02:23:48.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.508+0000 7fb5b959a700 1 -- 172.21.15.37:0/2439761505 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5a8003570 con 0x7fb5bc15d8d0 2023-10-06T02:23:48.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.508+0000 7fb5b959a700 1 -- 172.21.15.37:0/2439761505 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321282359 0 0) 0x7fb5bc0cb650 con 0x7fb5bc15dd50 2023-10-06T02:23:48.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.508+0000 7fb5b959a700 1 -- 172.21.15.37:0/2439761505 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5bc15e1d0 con 0x7fb5bc15dd50 2023-10-06T02:23:48.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.508+0000 7fb5ba59c700 1 -- 172.21.15.37:0/2439761505 >> v1:172.21.15.191:6789/0 conn(0x7fb5bc15dd50 legacy=0x7fb5bc0cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.508+0000 7fb5ba59c700 1 -- 172.21.15.37:0/2439761505 >> v1:172.21.15.37:6789/0 conn(0x7fb5bc15d8d0 legacy=0x7fb5bc0c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.508+0000 7fb5ba59c700 1 -- 172.21.15.37:0/2439761505 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc0cb930 con 0x7fb5bc159760 2023-10-06T02:23:48.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.508+0000 7fb5ba59c700 1 --2- 172.21.15.37:0/2439761505 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5bc159760 0x7fb5bc15d390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40098e0 tx=0x7fb5b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56fb60fe474da4e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:48.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.508+0000 7fb5b959a700 1 -- 172.21.15.37:0/2439761505 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4011630 con 0x7fb5bc159760 2023-10-06T02:23:48.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.508+0000 7fb5b959a700 1 -- 172.21.15.37:0/2439761505 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b4011790 con 0x7fb5bc159760 2023-10-06T02:23:48.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.508+0000 7fb5b959a700 1 -- 172.21.15.37:0/2439761505 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4011b30 con 0x7fb5bc159760 2023-10-06T02:23:48.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.509+0000 7fb5c0dc1700 1 -- 172.21.15.37:0/2439761505 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5bc159760 msgr2=0x7fb5bc15d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.509+0000 7fb5c0dc1700 1 --2- 172.21.15.37:0/2439761505 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5bc159760 0x7fb5bc15d390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40098e0 tx=0x7fb5b40091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.509+0000 7fb5c0dc1700 1 -- 172.21.15.37:0/2439761505 shutdown_connections 2023-10-06T02:23:48.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.509+0000 7fb5c0dc1700 1 --2- 172.21.15.37:0/2439761505 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5bc159760 0x7fb5bc15d390 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.509+0000 7fb5c0dc1700 1 -- 172.21.15.37:0/2439761505 >> 172.21.15.37:0/2439761505 conn(0x7fb5bc06c890 msgr2=0x7fb5bc0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:48.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.509+0000 7fb5c0dc1700 1 -- 172.21.15.37:0/2439761505 shutdown_connections 2023-10-06T02:23:48.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.509+0000 7fb5c0dc1700 1 -- 172.21.15.37:0/2439761505 wait complete. 2023-10-06T02:23:48.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.510+0000 7fb5c0dc1700 1 Processor -- start 2023-10-06T02:23:48.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.510+0000 7fb5c0dc1700 1 -- start start 2023-10-06T02:23:48.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.511+0000 7fb5c0dc1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5bc159760 0x7fb5bc152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.511+0000 7fb5c0dc1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5bc15d8d0 0x7fb5bc15c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.511+0000 7fb5c0dc1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5bc15dd50 0x7fb5bc0ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.511+0000 7fb5c0dc1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc153440 con 0x7fb5bc15dd50 2023-10-06T02:23:48.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.511+0000 7fb5c0dc1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc15bd60 con 0x7fb5bc15d8d0 2023-10-06T02:23:48.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.511+0000 7fb5c0dc1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc15b150 con 0x7fb5bc159760 2023-10-06T02:23:48.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.511+0000 7fb5bad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5bc15dd50 0x7fb5bc0ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.511+0000 7fb5bad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5bc15dd50 0x7fb5bc0ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43688/0 (socket says 172.21.15.37:43688) 2023-10-06T02:23:48.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.511+0000 7fb5bad9d700 1 -- 172.21.15.37:0/3716186817 learned_addr learned my addr 172.21.15.37:0/3716186817 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:48.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.511+0000 7fb5ba59c700 1 --2- 172.21.15.37:0/3716186817 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5bc159760 0x7fb5bc152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.511+0000 7fb5b9d9b700 1 --2- 172.21.15.37:0/3716186817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5bc15d8d0 0x7fb5bc15c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.511+0000 7fb5bad9d700 1 -- 172.21.15.37:0/3716186817 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5bc159760 msgr2=0x7fb5bc152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.511+0000 7fb5bad9d700 1 --2- 172.21.15.37:0/3716186817 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5bc159760 0x7fb5bc152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.511+0000 7fb5bad9d700 1 -- 172.21.15.37:0/3716186817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5bc15d8d0 msgr2=0x7fb5bc15c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.511+0000 7fb5bad9d700 1 --2- 172.21.15.37:0/3716186817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5bc15d8d0 0x7fb5bc15c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.511+0000 7fb5bad9d700 1 -- 172.21.15.37:0/3716186817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b4009420 con 0x7fb5bc15dd50 2023-10-06T02:23:48.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.511+0000 7fb5b9d9b700 1 --2- 172.21.15.37:0/3716186817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5bc15d8d0 0x7fb5bc15c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:48.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.511+0000 7fb5ba59c700 1 --2- 172.21.15.37:0/3716186817 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5bc159760 0x7fb5bc152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:48.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.512+0000 7fb5bad9d700 1 --2- 172.21.15.37:0/3716186817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5bc15dd50 0x7fb5bc0ccee0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00c910 tx=0x7fb5ac0027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:48.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.512+0000 7fb5b27fc700 1 -- 172.21.15.37:0/3716186817 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac00a7e0 con 0x7fb5bc15dd50 2023-10-06T02:23:48.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.512+0000 7fb5b27fc700 1 -- 172.21.15.37:0/3716186817 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ac00a960 con 0x7fb5bc15dd50 2023-10-06T02:23:48.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.512+0000 7fb5b27fc700 1 -- 172.21.15.37:0/3716186817 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac00ad20 con 0x7fb5bc15dd50 2023-10-06T02:23:48.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.512+0000 7fb5c0dc1700 1 -- 172.21.15.37:0/3716186817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5bc15b430 con 0x7fb5bc15dd50 2023-10-06T02:23:48.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.512+0000 7fb5c0dc1700 1 -- 172.21.15.37:0/3716186817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5bc15b9f0 con 0x7fb5bc15dd50 2023-10-06T02:23:48.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.513+0000 7fb5c0dc1700 1 -- 172.21.15.37:0/3716186817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5bc15bed0 con 0x7fb5bc15dd50 2023-10-06T02:23:48.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.513+0000 7fb5b27fc700 1 -- 172.21.15.37:0/3716186817 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5ac012630 con 0x7fb5bc15dd50 2023-10-06T02:23:48.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.513+0000 7fb5b27fc700 1 --2- 172.21.15.37:0/3716186817 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb59c066f30 0x7fb59c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.514+0000 7fb5b27fc700 1 -- 172.21.15.37:0/3716186817 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb5ac084af0 con 0x7fb5bc15dd50 2023-10-06T02:23:48.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.514+0000 7fb5ba59c700 1 --2- 172.21.15.37:0/3716186817 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb59c066f30 0x7fb59c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.514+0000 7fb5ba59c700 1 --2- 172.21.15.37:0/3716186817 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb59c066f30 0x7fb59c0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc16d470 tx=0x7fb5b4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:48.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.518+0000 7fb5b27fc700 1 -- 172.21.15.37:0/3716186817 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5ac051c00 con 0x7fb5bc15dd50 2023-10-06T02:23:48.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.713+0000 7fb5c0dc1700 1 -- 172.21.15.37:0/3716186817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5bc06fbf0 con 0x7fb5bc15dd50 2023-10-06T02:23:48.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.714+0000 7fb5b27fc700 1 -- 172.21.15.37:0/3716186817 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fb5ac055220 con 0x7fb5bc15dd50 2023-10-06T02:23:48.715 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:48.715 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:23:16.897625+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:13.004596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:14.268809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:48.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.716+0000 7fb5c0dc1700 1 -- 172.21.15.37:0/3716186817 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb59c066f30 msgr2=0x7fb59c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.716+0000 7fb5c0dc1700 1 --2- 172.21.15.37:0/3716186817 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb59c066f30 0x7fb59c0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc16d470 tx=0x7fb5b4017000 comp rx=0 tx=0).stop 2023-10-06T02:23:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.716+0000 7fb5c0dc1700 1 -- 172.21.15.37:0/3716186817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5bc15dd50 msgr2=0x7fb5bc0ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.716+0000 7fb5c0dc1700 1 --2- 172.21.15.37:0/3716186817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5bc15dd50 0x7fb5bc0ccee0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00c910 tx=0x7fb5ac0027a0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.716+0000 7fb5c0dc1700 1 -- 172.21.15.37:0/3716186817 shutdown_connections 2023-10-06T02:23:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.716+0000 7fb5c0dc1700 1 --2- 172.21.15.37:0/3716186817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5bc15dd50 0x7fb5bc0ccee0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.716+0000 7fb5c0dc1700 1 --2- 172.21.15.37:0/3716186817 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5bc159760 0x7fb5bc152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.716+0000 7fb5c0dc1700 1 --2- 172.21.15.37:0/3716186817 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb59c066f30 0x7fb59c0693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.716+0000 7fb5c0dc1700 1 --2- 172.21.15.37:0/3716186817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5bc15d8d0 0x7fb5bc15c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.716+0000 7fb5c0dc1700 1 -- 172.21.15.37:0/3716186817 >> 172.21.15.37:0/3716186817 conn(0x7fb5bc06c890 msgr2=0x7fb5bc0cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.716+0000 7fb5c0dc1700 1 -- 172.21.15.37:0/3716186817 shutdown_connections 2023-10-06T02:23:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.716+0000 7fb5c0dc1700 1 -- 172.21.15.37:0/3716186817 wait complete. 2023-10-06T02:23:48.729 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:23:08.066048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:23:08.561964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:23:13.004596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:23:14.268809+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:23:48.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:23:48.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.851+0000 7f5cfd89e700 1 Processor -- start 2023-10-06T02:23:48.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.851+0000 7f5cfd89e700 1 -- start start 2023-10-06T02:23:48.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.852+0000 7f5cfd89e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5cf814e670 0x7f5cf80b3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.852+0000 7f5cfd89e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf80b3cb0 0x7f5cf80cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.852+0000 7f5cfd89e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf80b4110 con 0x7f5cf814e2a0 2023-10-06T02:23:48.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.852+0000 7f5cfd89e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf81587a0 con 0x7f5cf814e670 2023-10-06T02:23:48.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.852+0000 7f5cfd89e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf8157b90 con 0x7f5cf80b3cb0 2023-10-06T02:23:48.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.852+0000 7f5cf67fc700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5cf814e670 0x7f5cf80b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.852+0000 7f5cf77fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf80b3cb0 0x7f5cf80cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.852+0000 7f5cf67fc700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5cf814e670 0x7f5cf80b3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:48840/0 (socket says 172.21.15.37:48840) 2023-10-06T02:23:48.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.852+0000 7f5cf6ffd700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f5cf814e2a0 0x7f5cf80ce910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:58366/0 (socket says 172.21.15.37:58366) 2023-10-06T02:23:48.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.852+0000 7f5cf67fc700 1 -- 172.21.15.37:0/2874087566 learned_addr learned my addr 172.21.15.37:0/2874087566 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:48.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.852+0000 7f5cf77fe700 1 --2- 172.21.15.37:0/2874087566 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf80b3cb0 0x7f5cf80cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:36252/0 (socket says 172.21.15.37:36252) 2023-10-06T02:23:48.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.852+0000 7f5cf67fc700 1 -- 172.21.15.37:0/2874087566 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf80b3cb0 msgr2=0x7f5cf80cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:48.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.852+0000 7f5cf67fc700 1 --2- 172.21.15.37:0/2874087566 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf80b3cb0 0x7f5cf80cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.852+0000 7f5cf67fc700 1 -- 172.21.15.37:0/2874087566 >> v1:172.21.15.191:6789/0 conn(0x7f5cf814e2a0 legacy=0x7f5cf80ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.852+0000 7f5cf67fc700 1 -- 172.21.15.37:0/2874087566 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf8157e70 con 0x7f5cf814e670 2023-10-06T02:23:48.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.852+0000 7f5cf77fe700 1 --2- 172.21.15.37:0/2874087566 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf80b3cb0 0x7f5cf80cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:48.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.853+0000 7f5cf67fc700 1 --2- 172.21.15.37:0/2874087566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf814e670 0x7f5cf80b3770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00099b0 tx=0x7f5ce0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce8ee453d42860a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:48.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.853+0000 7f5cf5ffb700 1 -- 172.21.15.37:0/2874087566 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0009ea0 con 0x7f5cf814e670 2023-10-06T02:23:48.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.853+0000 7f5cf5ffb700 1 -- 172.21.15.37:0/2874087566 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce000b860 con 0x7f5cf814e670 2023-10-06T02:23:48.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.853+0000 7f5cf5ffb700 1 -- 172.21.15.37:0/2874087566 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce000bc00 con 0x7f5cf814e670 2023-10-06T02:23:48.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.853+0000 7f5cfd89e700 1 -- 172.21.15.37:0/2874087566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf814e670 msgr2=0x7f5cf80b3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.853+0000 7f5cfd89e700 1 --2- 172.21.15.37:0/2874087566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf814e670 0x7f5cf80b3770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00099b0 tx=0x7f5ce0009250 comp rx=0 tx=0).stop 2023-10-06T02:23:48.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.853+0000 7f5cfd89e700 1 -- 172.21.15.37:0/2874087566 shutdown_connections 2023-10-06T02:23:48.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.853+0000 7f5cfd89e700 1 --2- 172.21.15.37:0/2874087566 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf80b3cb0 0x7f5cf80cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.853+0000 7f5cfd89e700 1 --2- 172.21.15.37:0/2874087566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf814e670 0x7f5cf80b3770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.853+0000 7f5cfd89e700 1 -- 172.21.15.37:0/2874087566 >> 172.21.15.37:0/2874087566 conn(0x7f5cf806c0b0 msgr2=0x7f5cf806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:48.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.853+0000 7f5cfd89e700 1 -- 172.21.15.37:0/2874087566 shutdown_connections 2023-10-06T02:23:48.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.853+0000 7f5cfd89e700 1 -- 172.21.15.37:0/2874087566 wait complete. 2023-10-06T02:23:48.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.855+0000 7f5cfd89e700 1 Processor -- start 2023-10-06T02:23:48.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.855+0000 7f5cfd89e700 1 -- start start 2023-10-06T02:23:48.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.855+0000 7f5cfd89e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf80b3cb0 0x7f5cf816b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.855+0000 7f5cfd89e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf814e2a0 0x7f5cf814c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.855+0000 7f5cfd89e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf814e670 0x7f5cf8147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.855+0000 7f5cfd89e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf814af00 con 0x7f5cf814e670 2023-10-06T02:23:48.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.855+0000 7f5cfd89e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf814bd60 con 0x7f5cf814e2a0 2023-10-06T02:23:48.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.855+0000 7f5cfd89e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf816be20 con 0x7f5cf80b3cb0 2023-10-06T02:23:48.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.855+0000 7f5cf77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf814e670 0x7f5cf8147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.855+0000 7f5cf77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf814e670 0x7f5cf8147cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43702/0 (socket says 172.21.15.37:43702) 2023-10-06T02:23:48.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.855+0000 7f5cf77fe700 1 -- 172.21.15.37:0/2174349282 learned_addr learned my addr 172.21.15.37:0/2174349282 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:48.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.856+0000 7f5cf67fc700 1 --2- 172.21.15.37:0/2174349282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf814e2a0 0x7f5cf814c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.856+0000 7f5cf6ffd700 1 --2- 172.21.15.37:0/2174349282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf80b3cb0 0x7f5cf816b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.856+0000 7f5cf77fe700 1 -- 172.21.15.37:0/2174349282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf80b3cb0 msgr2=0x7f5cf816b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.856+0000 7f5cf77fe700 1 --2- 172.21.15.37:0/2174349282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf80b3cb0 0x7f5cf816b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.856+0000 7f5cf77fe700 1 -- 172.21.15.37:0/2174349282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf814e2a0 msgr2=0x7f5cf814c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:48.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.856+0000 7f5cf77fe700 1 --2- 172.21.15.37:0/2174349282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf814e2a0 0x7f5cf814c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:48.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.856+0000 7f5cf77fe700 1 -- 172.21.15.37:0/2174349282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf0009420 con 0x7f5cf814e670 2023-10-06T02:23:48.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.856+0000 7f5cf67fc700 1 --2- 172.21.15.37:0/2174349282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf814e2a0 0x7f5cf814c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:48.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.856+0000 7f5cf77fe700 1 --2- 172.21.15.37:0/2174349282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf814e670 0x7f5cf8147cf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000ecb0 tx=0x7f5cf00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:48.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.856+0000 7f5ceeffd700 1 -- 172.21.15.37:0/2174349282 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf000ca60 con 0x7f5cf814e670 2023-10-06T02:23:48.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.856+0000 7f5ceeffd700 1 -- 172.21.15.37:0/2174349282 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf000cbc0 con 0x7f5cf814e670 2023-10-06T02:23:48.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.856+0000 7f5cfd89e700 1 -- 172.21.15.37:0/2174349282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce00094f0 con 0x7f5cf814e670 2023-10-06T02:23:48.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.856+0000 7f5ceeffd700 1 -- 172.21.15.37:0/2174349282 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0013470 con 0x7f5cf814e670 2023-10-06T02:23:48.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.856+0000 7f5cfd89e700 1 -- 172.21.15.37:0/2174349282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf814b1d0 con 0x7f5cf814e670 2023-10-06T02:23:48.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.857+0000 7f5cfd89e700 1 -- 172.21.15.37:0/2174349282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf80cef80 con 0x7f5cf814e670 2023-10-06T02:23:48.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.858+0000 7f5ceeffd700 1 -- 172.21.15.37:0/2174349282 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5cf0013860 con 0x7f5cf814e670 2023-10-06T02:23:48.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.858+0000 7f5ceeffd700 1 --2- 172.21.15.37:0/2174349282 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5cd8066f60 0x7f5cd8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:48.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.858+0000 7f5ceeffd700 1 -- 172.21.15.37:0/2174349282 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5cf0084830 con 0x7f5cf814e670 2023-10-06T02:23:48.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.859+0000 7f5cf6ffd700 1 --2- 172.21.15.37:0/2174349282 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5cd8066f60 0x7f5cd8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:48.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.859+0000 7f5cf6ffd700 1 --2- 172.21.15.37:0/2174349282 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5cd8066f60 0x7f5cd8069410 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8001f80 tx=0x7f5ce8005cd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:48.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:48.862+0000 7f5ceeffd700 1 -- 172.21.15.37:0/2174349282 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5cf0051940 con 0x7f5cf814e670 2023-10-06T02:23:49.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.056+0000 7f5cfd89e700 1 -- 172.21.15.37:0/2174349282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5cf814bea0 con 0x7f5cf814e670 2023-10-06T02:23:49.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.056+0000 7f5ceeffd700 1 -- 172.21.15.37:0/2174349282 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5cf00170a0 con 0x7f5cf814e670 2023-10-06T02:23:49.058 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T02:23:49.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.058+0000 7f5cfd89e700 1 -- 172.21.15.37:0/2174349282 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5cd8066f60 msgr2=0x7f5cd8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:49.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.058+0000 7f5cfd89e700 1 --2- 172.21.15.37:0/2174349282 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5cd8066f60 0x7f5cd8069410 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8001f80 tx=0x7f5ce8005cd0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.058+0000 7f5cfd89e700 1 -- 172.21.15.37:0/2174349282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf814e670 msgr2=0x7f5cf8147cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:49.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.058+0000 7f5cfd89e700 1 --2- 172.21.15.37:0/2174349282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf814e670 0x7f5cf8147cf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000ecb0 tx=0x7f5cf00091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.058+0000 7f5cfd89e700 1 -- 172.21.15.37:0/2174349282 shutdown_connections 2023-10-06T02:23:49.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.058+0000 7f5cfd89e700 1 --2- 172.21.15.37:0/2174349282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf814e670 0x7f5cf8147cf0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.058+0000 7f5cfd89e700 1 --2- 172.21.15.37:0/2174349282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf80b3cb0 0x7f5cf816b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.058+0000 7f5cfd89e700 1 --2- 172.21.15.37:0/2174349282 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5cd8066f60 0x7f5cd8069410 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.058+0000 7f5cfd89e700 1 --2- 172.21.15.37:0/2174349282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf814e2a0 0x7f5cf814c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.058+0000 7f5cfd89e700 1 -- 172.21.15.37:0/2174349282 >> 172.21.15.37:0/2174349282 conn(0x7f5cf806c0b0 msgr2=0x7f5cf80ae810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:49.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.058+0000 7f5cfd89e700 1 -- 172.21.15.37:0/2174349282 shutdown_connections 2023-10-06T02:23:49.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.058+0000 7f5cfd89e700 1 -- 172.21.15.37:0/2174349282 wait complete. 2023-10-06T02:23:49.072 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:23:49.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.191+0000 7fdc59e75700 1 Processor -- start 2023-10-06T02:23:49.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.191+0000 7fdc59e75700 1 -- start start 2023-10-06T02:23:49.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.192+0000 7fdc59e75700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc54154af0 0x7fdc54154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:49.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.192+0000 7fdc59e75700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdc5406ea60 0x7fdc5406c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:49.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.192+0000 7fdc59e75700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc540af290 con 0x7fdc540b21d0 2023-10-06T02:23:49.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.192+0000 7fdc59e75700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc540b1d40 con 0x7fdc5406ea60 2023-10-06T02:23:49.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.192+0000 7fdc59e75700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc540b1730 con 0x7fdc54154af0 2023-10-06T02:23:49.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.192+0000 7fdc59674700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdc5406ea60 0x7fdc5406c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:49.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.192+0000 7fdc53fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdc540b21d0 0x7fdc5406e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45950/0 (socket says 172.21.15.37:45950) 2023-10-06T02:23:49.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.192+0000 7fdc53fff700 1 -- 172.21.15.37:0/3978032301 learned_addr learned my addr 172.21.15.37:0/3978032301 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:49.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.193+0000 7fdc58e73700 1 --2- 172.21.15.37:0/3978032301 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc54154af0 0x7fdc54154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:49.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.193+0000 7fdc59674700 1 -- 172.21.15.37:0/3978032301 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc54154af0 msgr2=0x7fdc54154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:49.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.193+0000 7fdc59674700 1 --2- 172.21.15.37:0/3978032301 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc54154af0 0x7fdc54154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.193+0000 7fdc59674700 1 -- 172.21.15.37:0/3978032301 >> v1:172.21.15.37:6789/0 conn(0x7fdc540b21d0 legacy=0x7fdc5406e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:49.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.193+0000 7fdc59674700 1 -- 172.21.15.37:0/3978032301 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc54158470 con 0x7fdc5406ea60 2023-10-06T02:23:49.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.193+0000 7fdc58e73700 1 --2- 172.21.15.37:0/3978032301 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc54154af0 0x7fdc54154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:49.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.193+0000 7fdc59674700 1 --2- 172.21.15.37:0/3978032301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc5406ea60 0x7fdc5406c0b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0098e0 tx=0x7fdc3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6f831e9c57947e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:49.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.193+0000 7fdc537fe700 1 -- 172.21.15.37:0/3978032301 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c009e80 con 0x7fdc5406ea60 2023-10-06T02:23:49.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.193+0000 7fdc537fe700 1 -- 172.21.15.37:0/3978032301 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c00b860 con 0x7fdc5406ea60 2023-10-06T02:23:49.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.193+0000 7fdc537fe700 1 -- 172.21.15.37:0/3978032301 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c00bbe0 con 0x7fdc5406ea60 2023-10-06T02:23:49.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.194+0000 7fdc59e75700 1 -- 172.21.15.37:0/3978032301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc5406ea60 msgr2=0x7fdc5406c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:49.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.194+0000 7fdc59e75700 1 --2- 172.21.15.37:0/3978032301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc5406ea60 0x7fdc5406c0b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0098e0 tx=0x7fdc3c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.194+0000 7fdc59e75700 1 -- 172.21.15.37:0/3978032301 shutdown_connections 2023-10-06T02:23:49.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.194+0000 7fdc59e75700 1 --2- 172.21.15.37:0/3978032301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc5406ea60 0x7fdc5406c0b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.194+0000 7fdc59e75700 1 --2- 172.21.15.37:0/3978032301 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc54154af0 0x7fdc54154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.194+0000 7fdc59e75700 1 -- 172.21.15.37:0/3978032301 >> 172.21.15.37:0/3978032301 conn(0x7fdc540cc820 msgr2=0x7fdc540ccc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:49.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.194+0000 7fdc59e75700 1 -- 172.21.15.37:0/3978032301 shutdown_connections 2023-10-06T02:23:49.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.194+0000 7fdc59e75700 1 -- 172.21.15.37:0/3978032301 wait complete. 2023-10-06T02:23:49.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.195+0000 7fdc59e75700 1 Processor -- start 2023-10-06T02:23:49.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.195+0000 7fdc59e75700 1 -- start start 2023-10-06T02:23:49.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.196+0000 7fdc59e75700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc5406ea60 0x7fdc5416c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:49.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.196+0000 7fdc59e75700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc540b21d0 0x7fdc540c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:49.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.196+0000 7fdc59e75700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc54154af0 0x7fdc54153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:49.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.196+0000 7fdc59e75700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5416c990 con 0x7fdc5406ea60 2023-10-06T02:23:49.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.196+0000 7fdc59e75700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc540c8d30 con 0x7fdc54154af0 2023-10-06T02:23:49.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.196+0000 7fdc59e75700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc540c81b0 con 0x7fdc540b21d0 2023-10-06T02:23:49.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.196+0000 7fdc58e73700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc5406ea60 0x7fdc5416c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:49.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.196+0000 7fdc58e73700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc5406ea60 0x7fdc5416c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43716/0 (socket says 172.21.15.37:43716) 2023-10-06T02:23:49.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.196+0000 7fdc58e73700 1 -- 172.21.15.37:0/499372488 learned_addr learned my addr 172.21.15.37:0/499372488 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:49.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.196+0000 7fdc59674700 1 --2- 172.21.15.37:0/499372488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc54154af0 0x7fdc54153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:49.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.196+0000 7fdc53fff700 1 --2- 172.21.15.37:0/499372488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc540b21d0 0x7fdc540c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:49.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.196+0000 7fdc58e73700 1 -- 172.21.15.37:0/499372488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc540b21d0 msgr2=0x7fdc540c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:49.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.196+0000 7fdc58e73700 1 --2- 172.21.15.37:0/499372488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc540b21d0 0x7fdc540c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.196+0000 7fdc58e73700 1 -- 172.21.15.37:0/499372488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc54154af0 msgr2=0x7fdc54153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:49.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.196+0000 7fdc58e73700 1 --2- 172.21.15.37:0/499372488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc54154af0 0x7fdc54153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.196+0000 7fdc58e73700 1 -- 172.21.15.37:0/499372488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3c009420 con 0x7fdc5406ea60 2023-10-06T02:23:49.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.196+0000 7fdc58e73700 1 --2- 172.21.15.37:0/499372488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc5406ea60 0x7fdc5416c450 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00c850 tx=0x7fdc4c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:49.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.196+0000 7fdc50ff9700 1 -- 172.21.15.37:0/499372488 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c011600 con 0x7fdc5406ea60 2023-10-06T02:23:49.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.197+0000 7fdc50ff9700 1 -- 172.21.15.37:0/499372488 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c011760 con 0x7fdc5406ea60 2023-10-06T02:23:49.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.197+0000 7fdc59e75700 1 -- 172.21.15.37:0/499372488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc540c8490 con 0x7fdc5406ea60 2023-10-06T02:23:49.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.197+0000 7fdc50ff9700 1 -- 172.21.15.37:0/499372488 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c011b00 con 0x7fdc5406ea60 2023-10-06T02:23:49.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.197+0000 7fdc59e75700 1 -- 172.21.15.37:0/499372488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc540c8a50 con 0x7fdc5406ea60 2023-10-06T02:23:49.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.198+0000 7fdc59e75700 1 -- 172.21.15.37:0/499372488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc54064b00 con 0x7fdc5406ea60 2023-10-06T02:23:49.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.198+0000 7fdc50ff9700 1 -- 172.21.15.37:0/499372488 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc4c0073b0 con 0x7fdc5406ea60 2023-10-06T02:23:49.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.198+0000 7fdc50ff9700 1 --2- 172.21.15.37:0/499372488 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdc34066f30 0x7fdc340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:49.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.198+0000 7fdc50ff9700 1 -- 172.21.15.37:0/499372488 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdc4c084690 con 0x7fdc5406ea60 2023-10-06T02:23:49.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.199+0000 7fdc53fff700 1 --2- 172.21.15.37:0/499372488 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdc34066f30 0x7fdc340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:49.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.199+0000 7fdc53fff700 1 --2- 172.21.15.37:0/499372488 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdc34066f30 0x7fdc340693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdc5406adb0 tx=0x7fdc44009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:49.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.203+0000 7fdc50ff9700 1 -- 172.21.15.37:0/499372488 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc4c055230 con 0x7fdc5406ea60 2023-10-06T02:23:49.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.394+0000 7fdc59e75700 1 -- 172.21.15.37:0/499372488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdc540b19d0 con 0x7fdc5406ea60 2023-10-06T02:23:49.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.395+0000 7fdc50ff9700 1 -- 172.21.15.37:0/499372488 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdc4c054dc0 con 0x7fdc5406ea60 2023-10-06T02:23:49.396 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T02:23:49.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.397+0000 7fdc59e75700 1 -- 172.21.15.37:0/499372488 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdc34066f30 msgr2=0x7fdc340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:49.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.397+0000 7fdc59e75700 1 --2- 172.21.15.37:0/499372488 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdc34066f30 0x7fdc340693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdc5406adb0 tx=0x7fdc44009040 comp rx=0 tx=0).stop 2023-10-06T02:23:49.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.397+0000 7fdc59e75700 1 -- 172.21.15.37:0/499372488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc5406ea60 msgr2=0x7fdc5416c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:49.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.397+0000 7fdc59e75700 1 --2- 172.21.15.37:0/499372488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc5406ea60 0x7fdc5416c450 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00c850 tx=0x7fdc4c008040 comp rx=0 tx=0).stop 2023-10-06T02:23:49.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.397+0000 7fdc59e75700 1 -- 172.21.15.37:0/499372488 shutdown_connections 2023-10-06T02:23:49.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.397+0000 7fdc59e75700 1 --2- 172.21.15.37:0/499372488 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdc34066f30 0x7fdc340693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.397+0000 7fdc59e75700 1 --2- 172.21.15.37:0/499372488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc54154af0 0x7fdc54153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.397+0000 7fdc59e75700 1 --2- 172.21.15.37:0/499372488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc5406ea60 0x7fdc5416c450 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.397+0000 7fdc59e75700 1 --2- 172.21.15.37:0/499372488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc540b21d0 0x7fdc540c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.397+0000 7fdc59e75700 1 -- 172.21.15.37:0/499372488 >> 172.21.15.37:0/499372488 conn(0x7fdc540cc820 msgr2=0x7fdc54153300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:49.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.397+0000 7fdc59e75700 1 -- 172.21.15.37:0/499372488 shutdown_connections 2023-10-06T02:23:49.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.397+0000 7fdc59e75700 1 -- 172.21.15.37:0/499372488 wait complete. 2023-10-06T02:23:49.410 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:23:49.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.530+0000 7f0a76583700 1 Processor -- start 2023-10-06T02:23:49.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.530+0000 7f0a76583700 1 -- start start 2023-10-06T02:23:49.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.531+0000 7f0a76583700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a700b2a90 0x7f0a70159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:49.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.531+0000 7f0a76583700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a700ccb30 0x7f0a700ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:49.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.531+0000 7f0a76583700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a700b07a0 con 0x7f0a701593c0 2023-10-06T02:23:49.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.531+0000 7f0a76583700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a700cd8a0 con 0x7f0a700b2a90 2023-10-06T02:23:49.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.531+0000 7f0a76583700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a700afe70 con 0x7f0a700ccb30 2023-10-06T02:23:49.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.531+0000 7f0a6ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0a701593c0 0x7f0a700b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45962/0 (socket says 172.21.15.37:45962) 2023-10-06T02:23:49.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.531+0000 7f0a6ffff700 1 -- 172.21.15.37:0/1184854403 learned_addr learned my addr 172.21.15.37:0/1184854403 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:49.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.531+0000 7f0a6f7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a700b2a90 0x7f0a70159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:49.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.531+0000 7f0a74b20700 1 --2- 172.21.15.37:0/1184854403 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a700ccb30 0x7f0a700ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:49.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.531+0000 7f0a6f7fe700 1 -- 172.21.15.37:0/1184854403 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a700ccb30 msgr2=0x7f0a700ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:49.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.531+0000 7f0a6f7fe700 1 --2- 172.21.15.37:0/1184854403 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a700ccb30 0x7f0a700ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.531+0000 7f0a6f7fe700 1 -- 172.21.15.37:0/1184854403 >> v1:172.21.15.37:6789/0 conn(0x7f0a701593c0 legacy=0x7f0a700b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:49.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.531+0000 7f0a6f7fe700 1 -- 172.21.15.37:0/1184854403 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a700b0150 con 0x7f0a700b2a90 2023-10-06T02:23:49.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.531+0000 7f0a6effd700 1 -- 172.21.15.37:0/1184854403 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903975101 0 0) 0x7f0a700b07a0 con 0x7f0a701593c0 2023-10-06T02:23:49.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.531+0000 7f0a74b20700 1 --2- 172.21.15.37:0/1184854403 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a700ccb30 0x7f0a700ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:49.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.532+0000 7f0a6f7fe700 1 --2- 172.21.15.37:0/1184854403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a700b2a90 0x7f0a70159790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0a640098e0 tx=0x7f0a640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e70b3de58a616d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:49.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.532+0000 7f0a6effd700 1 -- 172.21.15.37:0/1184854403 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a64009e80 con 0x7f0a700b2a90 2023-10-06T02:23:49.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.532+0000 7f0a6effd700 1 -- 172.21.15.37:0/1184854403 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6400b860 con 0x7f0a700b2a90 2023-10-06T02:23:49.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.532+0000 7f0a6effd700 1 -- 172.21.15.37:0/1184854403 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6400bbe0 con 0x7f0a700b2a90 2023-10-06T02:23:49.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.532+0000 7f0a76583700 1 -- 172.21.15.37:0/1184854403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a700b2a90 msgr2=0x7f0a70159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:49.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.532+0000 7f0a76583700 1 --2- 172.21.15.37:0/1184854403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a700b2a90 0x7f0a70159790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0a640098e0 tx=0x7f0a640091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.532+0000 7f0a76583700 1 -- 172.21.15.37:0/1184854403 shutdown_connections 2023-10-06T02:23:49.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.532+0000 7f0a76583700 1 --2- 172.21.15.37:0/1184854403 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a700ccb30 0x7f0a700ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.532+0000 7f0a76583700 1 --2- 172.21.15.37:0/1184854403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a700b2a90 0x7f0a70159790 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.532+0000 7f0a76583700 1 -- 172.21.15.37:0/1184854403 >> 172.21.15.37:0/1184854403 conn(0x7f0a7006c0b0 msgr2=0x7f0a7006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:49.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.532+0000 7f0a76583700 1 -- 172.21.15.37:0/1184854403 shutdown_connections 2023-10-06T02:23:49.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.532+0000 7f0a76583700 1 -- 172.21.15.37:0/1184854403 wait complete. 2023-10-06T02:23:49.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.533+0000 7f0a76583700 1 Processor -- start 2023-10-06T02:23:49.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.534+0000 7f0a76583700 1 -- start start 2023-10-06T02:23:49.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.534+0000 7f0a76583700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a700b2a90 0x7f0a7015c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:49.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.534+0000 7f0a76583700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a700ccb30 0x7f0a700ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:49.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.534+0000 7f0a76583700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a701593c0 0x7f0a7014b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:49.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.534+0000 7f0a76583700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7016d4c0 con 0x7f0a700b2a90 2023-10-06T02:23:49.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.534+0000 7f0a76583700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7016d7a0 con 0x7f0a701593c0 2023-10-06T02:23:49.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.534+0000 7f0a76583700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7016da80 con 0x7f0a700ccb30 2023-10-06T02:23:49.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.534+0000 7f0a6ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a700b2a90 0x7f0a7015c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:49.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.534+0000 7f0a6ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a700b2a90 0x7f0a7015c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43738/0 (socket says 172.21.15.37:43738) 2023-10-06T02:23:49.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.534+0000 7f0a6ffff700 1 -- 172.21.15.37:0/809527305 learned_addr learned my addr 172.21.15.37:0/809527305 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:49.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.535+0000 7f0a6f7fe700 1 --2- 172.21.15.37:0/809527305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a700ccb30 0x7f0a700ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:49.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.535+0000 7f0a74b20700 1 --2- 172.21.15.37:0/809527305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a701593c0 0x7f0a7014b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:49.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.535+0000 7f0a6ffff700 1 -- 172.21.15.37:0/809527305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a700ccb30 msgr2=0x7f0a700ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:49.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.535+0000 7f0a6ffff700 1 --2- 172.21.15.37:0/809527305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a700ccb30 0x7f0a700ca1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.535+0000 7f0a6ffff700 1 -- 172.21.15.37:0/809527305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a701593c0 msgr2=0x7f0a7014b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:49.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.535+0000 7f0a6ffff700 1 --2- 172.21.15.37:0/809527305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a701593c0 0x7f0a7014b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.535+0000 7f0a6ffff700 1 -- 172.21.15.37:0/809527305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a64009420 con 0x7f0a700b2a90 2023-10-06T02:23:49.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.535+0000 7f0a6ffff700 1 --2- 172.21.15.37:0/809527305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a700b2a90 0x7f0a7015c520 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000c5b0 tx=0x7f0a60001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:49.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.535+0000 7f0a57fff700 1 -- 172.21.15.37:0/809527305 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a60005b30 con 0x7f0a700b2a90 2023-10-06T02:23:49.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.535+0000 7f0a57fff700 1 -- 172.21.15.37:0/809527305 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a60005c90 con 0x7f0a700b2a90 2023-10-06T02:23:49.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.535+0000 7f0a76583700 1 -- 172.21.15.37:0/809527305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a7016dd60 con 0x7f0a700b2a90 2023-10-06T02:23:49.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.535+0000 7f0a57fff700 1 -- 172.21.15.37:0/809527305 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a60007300 con 0x7f0a700b2a90 2023-10-06T02:23:49.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.535+0000 7f0a76583700 1 -- 172.21.15.37:0/809527305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a70157ea0 con 0x7f0a700b2a90 2023-10-06T02:23:49.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.536+0000 7f0a76583700 1 -- 172.21.15.37:0/809527305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a70088bb0 con 0x7f0a700b2a90 2023-10-06T02:23:49.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.537+0000 7f0a57fff700 1 -- 172.21.15.37:0/809527305 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a6001b3b0 con 0x7f0a700b2a90 2023-10-06T02:23:49.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.537+0000 7f0a57fff700 1 --2- 172.21.15.37:0/809527305 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0a5c066f30 0x7f0a5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:49.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.537+0000 7f0a57fff700 1 -- 172.21.15.37:0/809527305 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0a60083bc0 con 0x7f0a700b2a90 2023-10-06T02:23:49.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.537+0000 7f0a6f7fe700 1 --2- 172.21.15.37:0/809527305 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0a5c066f30 0x7f0a5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:49.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.538+0000 7f0a6f7fe700 1 --2- 172.21.15.37:0/809527305 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0a5c066f30 0x7f0a5c0693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0a640091e0 tx=0x7f0a64017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:49.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.541+0000 7f0a57fff700 1 -- 172.21.15.37:0/809527305 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a60050cd0 con 0x7f0a700b2a90 2023-10-06T02:23:49.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.733+0000 7f0a76583700 1 -- 172.21.15.37:0/809527305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a700b0430 con 0x7f0a700b2a90 2023-10-06T02:23:49.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.733+0000 7f0a57fff700 1 -- 172.21.15.37:0/809527305 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a60017020 con 0x7f0a700b2a90 2023-10-06T02:23:49.735 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T02:23:49.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.735+0000 7f0a76583700 1 -- 172.21.15.37:0/809527305 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0a5c066f30 msgr2=0x7f0a5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.735+0000 7f0a76583700 1 --2- 172.21.15.37:0/809527305 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0a5c066f30 0x7f0a5c0693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0a640091e0 tx=0x7f0a64017000 comp rx=0 tx=0).stop 2023-10-06T02:23:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.735+0000 7f0a76583700 1 -- 172.21.15.37:0/809527305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a700b2a90 msgr2=0x7f0a7015c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.735+0000 7f0a76583700 1 --2- 172.21.15.37:0/809527305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a700b2a90 0x7f0a7015c520 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000c5b0 tx=0x7f0a60001070 comp rx=0 tx=0).stop 2023-10-06T02:23:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.735+0000 7f0a76583700 1 -- 172.21.15.37:0/809527305 shutdown_connections 2023-10-06T02:23:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.735+0000 7f0a76583700 1 --2- 172.21.15.37:0/809527305 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0a5c066f30 0x7f0a5c0693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.735+0000 7f0a76583700 1 --2- 172.21.15.37:0/809527305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a701593c0 0x7f0a7014b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.735+0000 7f0a76583700 1 --2- 172.21.15.37:0/809527305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a700b2a90 0x7f0a7015c520 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.735+0000 7f0a76583700 1 --2- 172.21.15.37:0/809527305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a700ccb30 0x7f0a700ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.735+0000 7f0a76583700 1 -- 172.21.15.37:0/809527305 >> 172.21.15.37:0/809527305 conn(0x7f0a7006c0b0 msgr2=0x7f0a700b5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.735+0000 7f0a76583700 1 -- 172.21.15.37:0/809527305 shutdown_connections 2023-10-06T02:23:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.735+0000 7f0a76583700 1 -- 172.21.15.37:0/809527305 wait complete. 2023-10-06T02:23:49.748 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:23:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.868+0000 7f958d6f4700 1 Processor -- start 2023-10-06T02:23:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.868+0000 7f958d6f4700 1 -- start start 2023-10-06T02:23:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.869+0000 7f958d6f4700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9588150380 0x7f95880b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.869+0000 7f958d6f4700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9588150750 0x7f95880b1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.869+0000 7f958d6f4700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f958815e070 con 0x7f95880b1ad0 2023-10-06T02:23:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.869+0000 7f958d6f4700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f958815d1c0 con 0x7f9588150750 2023-10-06T02:23:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.869+0000 7f958d6f4700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95880b1ec0 con 0x7f9588150380 2023-10-06T02:23:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.869+0000 7f95867fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9588150750 0x7f95880b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.869+0000 7f95877fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f95880b1ad0 0x7f9588067990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45964/0 (socket says 172.21.15.37:45964) 2023-10-06T02:23:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.869+0000 7f95877fe700 1 -- 172.21.15.37:0/31418320 learned_addr learned my addr 172.21.15.37:0/31418320 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.869+0000 7f9586ffd700 1 --2- 172.21.15.37:0/31418320 >> v2:172.21.15.191:3300/0 conn(0x7f9588150380 0x7f95880b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.870+0000 7f95867fc700 1 -- 172.21.15.37:0/31418320 >> v2:172.21.15.191:3300/0 conn(0x7f9588150380 msgr2=0x7f95880b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.870+0000 7f95867fc700 1 --2- 172.21.15.37:0/31418320 >> v2:172.21.15.191:3300/0 conn(0x7f9588150380 0x7f95880b3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.870+0000 7f95867fc700 1 -- 172.21.15.37:0/31418320 >> v1:172.21.15.37:6789/0 conn(0x7f95880b1ad0 legacy=0x7f9588067990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.870+0000 7f95867fc700 1 -- 172.21.15.37:0/31418320 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958815d460 con 0x7f9588150750 2023-10-06T02:23:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.870+0000 7f9585ffb700 1 -- 172.21.15.37:0/31418320 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682724923 0 0) 0x7f958815e070 con 0x7f95880b1ad0 2023-10-06T02:23:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.870+0000 7f95867fc700 1 --2- 172.21.15.37:0/31418320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9588150750 0x7f95880b1590 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f95880b1560 tx=0x7f95700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e7c2be03a7d8cb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.870+0000 7f9585ffb700 1 -- 172.21.15.37:0/31418320 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957000b6b0 con 0x7f9588150750 2023-10-06T02:23:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.870+0000 7f9585ffb700 1 -- 172.21.15.37:0/31418320 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957000b810 con 0x7f9588150750 2023-10-06T02:23:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.870+0000 7f9585ffb700 1 -- 172.21.15.37:0/31418320 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957000bbb0 con 0x7f9588150750 2023-10-06T02:23:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.870+0000 7f958d6f4700 1 -- 172.21.15.37:0/31418320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9588150750 msgr2=0x7f95880b1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.870+0000 7f958d6f4700 1 --2- 172.21.15.37:0/31418320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9588150750 0x7f95880b1590 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f95880b1560 tx=0x7f95700091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.870+0000 7f958d6f4700 1 -- 172.21.15.37:0/31418320 shutdown_connections 2023-10-06T02:23:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.870+0000 7f958d6f4700 1 --2- 172.21.15.37:0/31418320 >> v2:172.21.15.191:3300/0 conn(0x7f9588150380 0x7f95880b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.870+0000 7f958d6f4700 1 --2- 172.21.15.37:0/31418320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9588150750 0x7f95880b1590 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.871+0000 7f958d6f4700 1 -- 172.21.15.37:0/31418320 >> 172.21.15.37:0/31418320 conn(0x7f958806c0b0 msgr2=0x7f958806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:49.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.871+0000 7f958d6f4700 1 -- 172.21.15.37:0/31418320 shutdown_connections 2023-10-06T02:23:49.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.871+0000 7f958d6f4700 1 -- 172.21.15.37:0/31418320 wait complete. 2023-10-06T02:23:49.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.872+0000 7f958d6f4700 1 Processor -- start 2023-10-06T02:23:49.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.872+0000 7f958d6f4700 1 -- start start 2023-10-06T02:23:49.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.872+0000 7f958d6f4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95880b1ad0 0x7f958814d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:49.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.872+0000 7f958d6f4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9588150380 0x7f95880cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:49.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.872+0000 7f958d6f4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9588150750 0x7f958814bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:49.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.873+0000 7f958d6f4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95880c8680 con 0x7f9588150380 2023-10-06T02:23:49.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.873+0000 7f958d6f4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95880c7a70 con 0x7f95880b1ad0 2023-10-06T02:23:49.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.873+0000 7f958d6f4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95880c7d50 con 0x7f9588150750 2023-10-06T02:23:49.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.873+0000 7f95867fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9588150380 0x7f95880cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:49.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.873+0000 7f95867fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9588150380 0x7f95880cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43758/0 (socket says 172.21.15.37:43758) 2023-10-06T02:23:49.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.873+0000 7f95867fc700 1 -- 172.21.15.37:0/489523507 learned_addr learned my addr 172.21.15.37:0/489523507 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.873+0000 7f9586ffd700 1 --2- 172.21.15.37:0/489523507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95880b1ad0 0x7f958814d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.873+0000 7f95877fe700 1 --2- 172.21.15.37:0/489523507 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9588150750 0x7f958814bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.873+0000 7f95867fc700 1 -- 172.21.15.37:0/489523507 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9588150750 msgr2=0x7f958814bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.873+0000 7f95867fc700 1 --2- 172.21.15.37:0/489523507 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9588150750 0x7f958814bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.873+0000 7f95867fc700 1 -- 172.21.15.37:0/489523507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95880b1ad0 msgr2=0x7f958814d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.873+0000 7f95867fc700 1 --2- 172.21.15.37:0/489523507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95880b1ad0 0x7f958814d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.873+0000 7f95867fc700 1 -- 172.21.15.37:0/489523507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9570009420 con 0x7f9588150380 2023-10-06T02:23:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.873+0000 7f95867fc700 1 --2- 172.21.15.37:0/489523507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9588150380 0x7f95880cb170 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f95880659c0 tx=0x7f9570017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.873+0000 7f957effd700 1 -- 172.21.15.37:0/489523507 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957000b980 con 0x7f9588150380 2023-10-06T02:23:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.873+0000 7f957effd700 1 -- 172.21.15.37:0/489523507 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957000bb00 con 0x7f9588150380 2023-10-06T02:23:49.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.873+0000 7f957effd700 1 -- 172.21.15.37:0/489523507 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9570025670 con 0x7f9588150380 2023-10-06T02:23:49.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.873+0000 7f958d6f4700 1 -- 172.21.15.37:0/489523507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95880c8030 con 0x7f9588150380 2023-10-06T02:23:49.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.873+0000 7f958d6f4700 1 -- 172.21.15.37:0/489523507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958814d610 con 0x7f9588150380 2023-10-06T02:23:49.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.874+0000 7f958d6f4700 1 -- 172.21.15.37:0/489523507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9588070d20 con 0x7f9588150380 2023-10-06T02:23:49.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.875+0000 7f957effd700 1 -- 172.21.15.37:0/489523507 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9570023070 con 0x7f9588150380 2023-10-06T02:23:49.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.875+0000 7f957effd700 1 --2- 172.21.15.37:0/489523507 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9568066f30 0x7f95680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:49.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.875+0000 7f957effd700 1 -- 172.21.15.37:0/489523507 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9570085cc0 con 0x7f9588150380 2023-10-06T02:23:49.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.875+0000 7f9586ffd700 1 --2- 172.21.15.37:0/489523507 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9568066f30 0x7f95680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:49.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.876+0000 7f9586ffd700 1 --2- 172.21.15.37:0/489523507 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9568066f30 0x7f95680693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f95800075a0 tx=0x7f95800097a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:49.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:49.879+0000 7f957effd700 1 -- 172.21.15.37:0/489523507 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9570052dd0 con 0x7f9588150380 2023-10-06T02:23:50.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.071+0000 7f958d6f4700 1 -- 172.21.15.37:0/489523507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f958815d740 con 0x7f9588150380 2023-10-06T02:23:50.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.072+0000 7f957effd700 1 -- 172.21.15.37:0/489523507 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f95700150a0 con 0x7f9588150380 2023-10-06T02:23:50.073 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T02:23:50.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.073+0000 7f958d6f4700 1 -- 172.21.15.37:0/489523507 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9568066f30 msgr2=0x7f95680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:50.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.074+0000 7f958d6f4700 1 --2- 172.21.15.37:0/489523507 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9568066f30 0x7f95680693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f95800075a0 tx=0x7f95800097a0 comp rx=0 tx=0).stop 2023-10-06T02:23:50.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.074+0000 7f958d6f4700 1 -- 172.21.15.37:0/489523507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9588150380 msgr2=0x7f95880cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:50.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.074+0000 7f958d6f4700 1 --2- 172.21.15.37:0/489523507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9588150380 0x7f95880cb170 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f95880659c0 tx=0x7f9570017000 comp rx=0 tx=0).stop 2023-10-06T02:23:50.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.074+0000 7f958d6f4700 1 -- 172.21.15.37:0/489523507 shutdown_connections 2023-10-06T02:23:50.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.074+0000 7f958d6f4700 1 --2- 172.21.15.37:0/489523507 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9588150750 0x7f958814bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:50.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.074+0000 7f958d6f4700 1 --2- 172.21.15.37:0/489523507 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9568066f30 0x7f95680693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:50.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.074+0000 7f958d6f4700 1 --2- 172.21.15.37:0/489523507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95880b1ad0 0x7f958814d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:50.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.074+0000 7f958d6f4700 1 --2- 172.21.15.37:0/489523507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9588150380 0x7f95880cb170 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:50.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.074+0000 7f958d6f4700 1 -- 172.21.15.37:0/489523507 >> 172.21.15.37:0/489523507 conn(0x7f958806c0b0 msgr2=0x7f958815c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:50.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.074+0000 7f958d6f4700 1 -- 172.21.15.37:0/489523507 shutdown_connections 2023-10-06T02:23:50.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.074+0000 7f958d6f4700 1 -- 172.21.15.37:0/489523507 wait complete. 2023-10-06T02:23:50.102 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-10-06T02:23:50.102 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2023-10-06T02:23:50.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.220+0000 7f9625722700 1 Processor -- start 2023-10-06T02:23:50.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.220+0000 7f9625722700 1 -- start start 2023-10-06T02:23:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.221+0000 7f9625722700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9620159760 0x7f962015d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.221+0000 7f9625722700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f962015dd50 0x7f96200cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.221+0000 7f9625722700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f962015e1d0 con 0x7f962015d8d0 2023-10-06T02:23:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.221+0000 7f9625722700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96200cc2d0 con 0x7f9620159760 2023-10-06T02:23:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.221+0000 7f9625722700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96200cb650 con 0x7f962015dd50 2023-10-06T02:23:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.221+0000 7f961effd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9620159760 0x7f962015d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.221+0000 7f961e7fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f962015d8d0 0x7f96200c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45980/0 (socket says 172.21.15.37:45980) 2023-10-06T02:23:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.221+0000 7f961e7fc700 1 -- 172.21.15.37:0/3113194678 learned_addr learned my addr 172.21.15.37:0/3113194678 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.221+0000 7f961f7fe700 1 --2- 172.21.15.37:0/3113194678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f962015dd50 0x7f96200cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.221+0000 7f961effd700 1 -- 172.21.15.37:0/3113194678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f962015dd50 msgr2=0x7f96200cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.221+0000 7f961effd700 1 --2- 172.21.15.37:0/3113194678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f962015dd50 0x7f96200cfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.221+0000 7f961effd700 1 -- 172.21.15.37:0/3113194678 >> v1:172.21.15.37:6789/0 conn(0x7f962015d8d0 legacy=0x7f96200c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.221+0000 7f961dffb700 1 -- 172.21.15.37:0/3113194678 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924437391 0 0) 0x7f962015e1d0 con 0x7f962015d8d0 2023-10-06T02:23:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.221+0000 7f961effd700 1 -- 172.21.15.37:0/3113194678 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96200cb930 con 0x7f9620159760 2023-10-06T02:23:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.222+0000 7f961effd700 1 --2- 172.21.15.37:0/3113194678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9620159760 0x7f962015d390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f96180098e0 tx=0x7f96180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49fd69b4108c47 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.222+0000 7f961dffb700 1 -- 172.21.15.37:0/3113194678 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9618009e80 con 0x7f9620159760 2023-10-06T02:23:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.222+0000 7f961dffb700 1 -- 172.21.15.37:0/3113194678 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961800b8f0 con 0x7f9620159760 2023-10-06T02:23:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.222+0000 7f961dffb700 1 -- 172.21.15.37:0/3113194678 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961800bc70 con 0x7f9620159760 2023-10-06T02:23:50.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.222+0000 7f9625722700 1 -- 172.21.15.37:0/3113194678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9620159760 msgr2=0x7f962015d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:50.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.222+0000 7f9625722700 1 --2- 172.21.15.37:0/3113194678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9620159760 0x7f962015d390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f96180098e0 tx=0x7f96180091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:50.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.222+0000 7f9625722700 1 -- 172.21.15.37:0/3113194678 shutdown_connections 2023-10-06T02:23:50.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.222+0000 7f9625722700 1 --2- 172.21.15.37:0/3113194678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f962015dd50 0x7f96200cfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:50.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.222+0000 7f9625722700 1 --2- 172.21.15.37:0/3113194678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9620159760 0x7f962015d390 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:50.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.222+0000 7f9625722700 1 -- 172.21.15.37:0/3113194678 >> 172.21.15.37:0/3113194678 conn(0x7f962006c890 msgr2=0x7f96200d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:50.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.222+0000 7f9625722700 1 -- 172.21.15.37:0/3113194678 shutdown_connections 2023-10-06T02:23:50.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.222+0000 7f9625722700 1 -- 172.21.15.37:0/3113194678 wait complete. 2023-10-06T02:23:50.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.223+0000 7f9625722700 1 Processor -- start 2023-10-06T02:23:50.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.224+0000 7f9625722700 1 -- start start 2023-10-06T02:23:50.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.224+0000 7f9625722700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9620159760 0x7f962016a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:50.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.224+0000 7f9625722700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f962015d8d0 0x7f9620167a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:50.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.224+0000 7f9625722700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f962015dd50 0x7f962015bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:50.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.224+0000 7f9625722700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9620167f90 con 0x7f9620159760 2023-10-06T02:23:50.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.224+0000 7f9625722700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962015af20 con 0x7f962015dd50 2023-10-06T02:23:50.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.224+0000 7f9625722700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962015b3b0 con 0x7f962015d8d0 2023-10-06T02:23:50.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.224+0000 7f961effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9620159760 0x7f962016a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:50.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.224+0000 7f961effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9620159760 0x7f962016a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43776/0 (socket says 172.21.15.37:43776) 2023-10-06T02:23:50.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.224+0000 7f961effd700 1 -- 172.21.15.37:0/3562221950 learned_addr learned my addr 172.21.15.37:0/3562221950 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:50.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.225+0000 7f961effd700 1 -- 172.21.15.37:0/3562221950 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f962015d8d0 msgr2=0x7f9620167a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:50.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.225+0000 7f961effd700 1 --2- 172.21.15.37:0/3562221950 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f962015d8d0 0x7f9620167a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:50.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.225+0000 7f961effd700 1 -- 172.21.15.37:0/3562221950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f962015dd50 msgr2=0x7f962015bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:50.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.225+0000 7f961effd700 1 --2- 172.21.15.37:0/3562221950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f962015dd50 0x7f962015bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:50.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.225+0000 7f961effd700 1 -- 172.21.15.37:0/3562221950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9618009420 con 0x7f9620159760 2023-10-06T02:23:50.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.225+0000 7f961effd700 1 --2- 172.21.15.37:0/3562221950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9620159760 0x7f962016a500 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9618009e80 tx=0x7f9618017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:50.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.225+0000 7f9616ffd700 1 -- 172.21.15.37:0/3562221950 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961800bc70 con 0x7f9620159760 2023-10-06T02:23:50.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.225+0000 7f9616ffd700 1 -- 172.21.15.37:0/3562221950 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9618011420 con 0x7f9620159760 2023-10-06T02:23:50.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.225+0000 7f9625722700 1 -- 172.21.15.37:0/3562221950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f962015a310 con 0x7f9620159760 2023-10-06T02:23:50.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.225+0000 7f9616ffd700 1 -- 172.21.15.37:0/3562221950 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96180117e0 con 0x7f9620159760 2023-10-06T02:23:50.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.225+0000 7f9625722700 1 -- 172.21.15.37:0/3562221950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962015a8d0 con 0x7f9620159760 2023-10-06T02:23:50.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.226+0000 7f9625722700 1 -- 172.21.15.37:0/3562221950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962015b200 con 0x7f9620159760 2023-10-06T02:23:50.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.226+0000 7f9616ffd700 1 -- 172.21.15.37:0/3562221950 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9618011bd0 con 0x7f9620159760 2023-10-06T02:23:50.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.227+0000 7f9616ffd700 1 --2- 172.21.15.37:0/3562221950 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9600066f30 0x7f96000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:50.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.227+0000 7f9616ffd700 1 -- 172.21.15.37:0/3562221950 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9618085d00 con 0x7f9620159760 2023-10-06T02:23:50.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.227+0000 7f961e7fc700 1 --2- 172.21.15.37:0/3562221950 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9600066f30 0x7f96000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:50.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.227+0000 7f961e7fc700 1 --2- 172.21.15.37:0/3562221950 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9600066f30 0x7f96000693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f96080011e0 tx=0x7f96080079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.231+0000 7f9616ffd700 1 -- 172.21.15.37:0/3562221950 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9618052df0 con 0x7f9620159760 2023-10-06T02:23:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.501+0000 7f9625722700 1 -- 172.21.15.37:0/3562221950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f96200895e0 con 0x7f9620159760 2023-10-06T02:23:50.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.688+0000 7f9616ffd700 1 -- 172.21.15.37:0/3562221950 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v50) v1 ==== 145+0+0 (secure 0 0 0) 0x7f9618056410 con 0x7f9620159760 2023-10-06T02:23:50.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.690+0000 7f9625722700 1 -- 172.21.15.37:0/3562221950 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9600066f30 msgr2=0x7f96000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:50.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.690+0000 7f9625722700 1 --2- 172.21.15.37:0/3562221950 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9600066f30 0x7f96000693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f96080011e0 tx=0x7f96080079d0 comp rx=0 tx=0).stop 2023-10-06T02:23:50.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.690+0000 7f9625722700 1 -- 172.21.15.37:0/3562221950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9620159760 msgr2=0x7f962016a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:50.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.690+0000 7f9625722700 1 --2- 172.21.15.37:0/3562221950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9620159760 0x7f962016a500 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9618009e80 tx=0x7f9618017000 comp rx=0 tx=0).stop 2023-10-06T02:23:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.690+0000 7f9625722700 1 -- 172.21.15.37:0/3562221950 shutdown_connections 2023-10-06T02:23:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.690+0000 7f9625722700 1 --2- 172.21.15.37:0/3562221950 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9600066f30 0x7f96000693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.690+0000 7f9625722700 1 --2- 172.21.15.37:0/3562221950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f962015dd50 0x7f962015bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.690+0000 7f9625722700 1 --2- 172.21.15.37:0/3562221950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9620159760 0x7f962016a500 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.690+0000 7f9625722700 1 --2- 172.21.15.37:0/3562221950 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f962015d8d0 0x7f9620167a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.690+0000 7f9625722700 1 -- 172.21.15.37:0/3562221950 >> 172.21.15.37:0/3562221950 conn(0x7f962006c890 msgr2=0x7f96201530f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.690+0000 7f9625722700 1 -- 172.21.15.37:0/3562221950 shutdown_connections 2023-10-06T02:23:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.690+0000 7f9625722700 1 -- 172.21.15.37:0/3562221950 wait complete. 2023-10-06T02:23:50.703 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:23:50.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.824+0000 7f415d464700 1 Processor -- start 2023-10-06T02:23:50.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.824+0000 7f415d464700 1 -- start start 2023-10-06T02:23:50.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.824+0000 7f415d464700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41580b2a90 0x7f4158159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:50.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.824+0000 7f415d464700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41580b07a0 con 0x7f41580ccb30 2023-10-06T02:23:50.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.824+0000 7f415d464700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41580cd8a0 con 0x7f41581593c0 2023-10-06T02:23:50.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.824+0000 7f415d464700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41580cd6a0 con 0x7f41580b2a90 2023-10-06T02:23:50.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.824+0000 7f41567fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41580b2a90 0x7f4158159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.824+0000 7f41577fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f41580ccb30 0x7f41580ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45992/0 (socket says 172.21.15.37:45992) 2023-10-06T02:23:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.825+0000 7f41577fe700 1 -- 172.21.15.37:0/2721588481 learned_addr learned my addr 172.21.15.37:0/2721588481 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.825+0000 7f41567fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41580b2a90 0x7f4158159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43782/0 (socket says 172.21.15.37:43782) 2023-10-06T02:23:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.825+0000 7f41567fc700 1 -- 172.21.15.37:0/2721588481 >> v1:172.21.15.191:6789/0 conn(0x7f41581593c0 legacy=0x7f41580b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.825+0000 7f41567fc700 1 -- 172.21.15.37:0/2721588481 >> v1:172.21.15.37:6789/0 conn(0x7f41580ccb30 legacy=0x7f41580ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.825+0000 7f41567fc700 1 -- 172.21.15.37:0/2721588481 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41580afe70 con 0x7f41580b2a90 2023-10-06T02:23:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.825+0000 7f4155ffb700 1 -- 172.21.15.37:0/2721588481 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699505601 0 0) 0x7f41580b07a0 con 0x7f41580ccb30 2023-10-06T02:23:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.825+0000 7f41567fc700 1 --2- 172.21.15.37:0/2721588481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41580b2a90 0x7f4158159790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f41400098e0 tx=0x7f41400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c05027de9f6fba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.825+0000 7f4155ffb700 1 -- 172.21.15.37:0/2721588481 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140009e80 con 0x7f41580b2a90 2023-10-06T02:23:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.825+0000 7f4155ffb700 1 -- 172.21.15.37:0/2721588481 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414000b820 con 0x7f41580b2a90 2023-10-06T02:23:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.825+0000 7f4155ffb700 1 -- 172.21.15.37:0/2721588481 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414000bba0 con 0x7f41580b2a90 2023-10-06T02:23:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.826+0000 7f415d464700 1 -- 172.21.15.37:0/2721588481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41580b2a90 msgr2=0x7f4158159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:50.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.826+0000 7f415d464700 1 --2- 172.21.15.37:0/2721588481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41580b2a90 0x7f4158159790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f41400098e0 tx=0x7f41400091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:50.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.826+0000 7f415d464700 1 -- 172.21.15.37:0/2721588481 shutdown_connections 2023-10-06T02:23:50.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.826+0000 7f415d464700 1 --2- 172.21.15.37:0/2721588481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41580b2a90 0x7f4158159790 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:50.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.826+0000 7f415d464700 1 -- 172.21.15.37:0/2721588481 >> 172.21.15.37:0/2721588481 conn(0x7f415806c0b0 msgr2=0x7f415806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:50.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.826+0000 7f415d464700 1 -- 172.21.15.37:0/2721588481 shutdown_connections 2023-10-06T02:23:50.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.826+0000 7f415d464700 1 -- 172.21.15.37:0/2721588481 wait complete. 2023-10-06T02:23:50.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.827+0000 7f415d464700 1 Processor -- start 2023-10-06T02:23:50.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.827+0000 7f415d464700 1 -- start start 2023-10-06T02:23:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f415d464700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41580b2a90 0x7f41580c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f415d464700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41580ccb30 0x7f41580c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f415d464700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41581593c0 0x7f4158147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f415d464700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415816bc30 con 0x7f41580ccb30 2023-10-06T02:23:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f415d464700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415816bf10 con 0x7f41581593c0 2023-10-06T02:23:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f415d464700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415816c1f0 con 0x7f41580b2a90 2023-10-06T02:23:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f41567fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41580ccb30 0x7f41580c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f41567fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41580ccb30 0x7f41580c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43790/0 (socket says 172.21.15.37:43790) 2023-10-06T02:23:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f41567fc700 1 -- 172.21.15.37:0/2573863476 learned_addr learned my addr 172.21.15.37:0/2573863476 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f41577fe700 1 --2- 172.21.15.37:0/2573863476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41581593c0 0x7f4158147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f4156ffd700 1 --2- 172.21.15.37:0/2573863476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41580b2a90 0x7f41580c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f41567fc700 1 -- 172.21.15.37:0/2573863476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41580b2a90 msgr2=0x7f41580c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f41567fc700 1 --2- 172.21.15.37:0/2573863476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41580b2a90 0x7f41580c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f41567fc700 1 -- 172.21.15.37:0/2573863476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41581593c0 msgr2=0x7f4158147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f41567fc700 1 --2- 172.21.15.37:0/2573863476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41581593c0 0x7f4158147800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f41567fc700 1 -- 172.21.15.37:0/2573863476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4140009420 con 0x7f41580ccb30 2023-10-06T02:23:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f4156ffd700 1 --2- 172.21.15.37:0/2573863476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41580b2a90 0x7f41580c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f41567fc700 1 --2- 172.21.15.37:0/2573863476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41580ccb30 0x7f41580c9e10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f41400030c0 tx=0x7f4140016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f414effd700 1 -- 172.21.15.37:0/2573863476 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414000ba60 con 0x7f41580ccb30 2023-10-06T02:23:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f414effd700 1 -- 172.21.15.37:0/2573863476 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4140020070 con 0x7f41580ccb30 2023-10-06T02:23:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f415d464700 1 -- 172.21.15.37:0/2573863476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415816c4d0 con 0x7f41580ccb30 2023-10-06T02:23:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.828+0000 7f414effd700 1 -- 172.21.15.37:0/2573863476 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414001b6a0 con 0x7f41580ccb30 2023-10-06T02:23:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.829+0000 7f415d464700 1 -- 172.21.15.37:0/2573863476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41580c4ff0 con 0x7f41580ccb30 2023-10-06T02:23:50.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.830+0000 7f415d464700 1 -- 172.21.15.37:0/2573863476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4158088bb0 con 0x7f41580ccb30 2023-10-06T02:23:50.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.830+0000 7f414effd700 1 -- 172.21.15.37:0/2573863476 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4140022030 con 0x7f41580ccb30 2023-10-06T02:23:50.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.830+0000 7f414effd700 1 --2- 172.21.15.37:0/2573863476 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4138066f30 0x7f41380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:50.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.830+0000 7f414effd700 1 -- 172.21.15.37:0/2573863476 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4140086660 con 0x7f41580ccb30 2023-10-06T02:23:50.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.831+0000 7f4156ffd700 1 --2- 172.21.15.37:0/2573863476 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4138066f30 0x7f41380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:50.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.831+0000 7f4156ffd700 1 --2- 172.21.15.37:0/2573863476 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4138066f30 0x7f41380693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f41580ca820 tx=0x7f4150008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:50.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:50.835+0000 7f414effd700 1 -- 172.21.15.37:0/2573863476 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4140053770 con 0x7f41580ccb30 2023-10-06T02:23:51.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.031+0000 7f415d464700 1 -- 172.21.15.37:0/2573863476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4158088bb0 con 0x7f41580ccb30 2023-10-06T02:23:51.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.034+0000 7f414effd700 1 -- 172.21.15.37:0/2573863476 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4140056d90 con 0x7f41580ccb30 2023-10-06T02:23:51.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.037+0000 7f415d464700 1 -- 172.21.15.37:0/2573863476 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4138066f30 msgr2=0x7f41380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:51.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.037+0000 7f415d464700 1 --2- 172.21.15.37:0/2573863476 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4138066f30 0x7f41380693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f41580ca820 tx=0x7f4150008040 comp rx=0 tx=0).stop 2023-10-06T02:23:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.037+0000 7f415d464700 1 -- 172.21.15.37:0/2573863476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41580ccb30 msgr2=0x7f41580c9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.037+0000 7f415d464700 1 --2- 172.21.15.37:0/2573863476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41580ccb30 0x7f41580c9e10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f41400030c0 tx=0x7f4140016000 comp rx=0 tx=0).stop 2023-10-06T02:23:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.037+0000 7f415d464700 1 -- 172.21.15.37:0/2573863476 shutdown_connections 2023-10-06T02:23:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.037+0000 7f415d464700 1 --2- 172.21.15.37:0/2573863476 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4138066f30 0x7f41380693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.037+0000 7f415d464700 1 --2- 172.21.15.37:0/2573863476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41581593c0 0x7f4158147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.037+0000 7f415d464700 1 --2- 172.21.15.37:0/2573863476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41580b2a90 0x7f41580c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.037+0000 7f415d464700 1 --2- 172.21.15.37:0/2573863476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41580ccb30 0x7f41580c9e10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.037+0000 7f415d464700 1 -- 172.21.15.37:0/2573863476 >> 172.21.15.37:0/2573863476 conn(0x7f415806c0b0 msgr2=0x7f41580cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.037+0000 7f415d464700 1 -- 172.21.15.37:0/2573863476 shutdown_connections 2023-10-06T02:23:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.037+0000 7f415d464700 1 -- 172.21.15.37:0/2573863476 wait complete. 2023-10-06T02:23:51.050 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:23:51.050 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:23:51.085 DEBUG:teuthology.orchestra.run.smithi191:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:23:51.099 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:23:51.126 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:23:51.127 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-10-06T02:23:51.127 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:23:51.127 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:23:51.137 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:23:51.212 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:23:51.212 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:23:51.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:51.213 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:23:51.267 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi191.front.sepia.ceph.com... 2023-10-06T02:23:51.267 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:23:51.269 DEBUG:teuthology.orchestra.run.smithi191:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-06T02:23:51.305 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:23:51.305 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:23:51.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:51.306 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:23:51.361 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-10-06T02:23:51.361 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:23:51.361 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-10-06T02:23:51.398 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:23:51.398 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:23:51.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:51.399 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T02:23:51.453 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi191.front.sepia.ceph.com... 2023-10-06T02:23:51.453 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:23:51.454 DEBUG:teuthology.orchestra.run.smithi191:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-10-06T02:23:51.491 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:23:51.491 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:23:51.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:23:51.492 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T02:23:51.546 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:23:51.547 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:23:51.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.664+0000 7fd6bfe70700 1 Processor -- start 2023-10-06T02:23:51.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.665+0000 7fd6bfe70700 1 -- start start 2023-10-06T02:23:51.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.665+0000 7fd6bfe70700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6b8156f50 0x7fd6b815a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:51.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.665+0000 7fd6bfe70700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6b80cefd0 0x7fd6b80cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:51.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.665+0000 7fd6bfe70700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b815d710 con 0x7fd6b8157320 2023-10-06T02:23:51.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.665+0000 7fd6bfe70700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b80cb320 con 0x7fd6b8156f50 2023-10-06T02:23:51.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.665+0000 7fd6bfe70700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b815d9f0 con 0x7fd6b80cefd0 2023-10-06T02:23:51.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.666+0000 7fd6bdc0c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6b8156f50 0x7fd6b815a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:51.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.666+0000 7fd6bdc0c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6b8156f50 0x7fd6b815a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43806/0 (socket says 172.21.15.37:43806) 2023-10-06T02:23:51.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.666+0000 7fd6bdc0c700 1 -- 172.21.15.37:0/2437673491 learned_addr learned my addr 172.21.15.37:0/2437673491 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:51.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.666+0000 7fd6be40d700 1 --2- 172.21.15.37:0/2437673491 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6b80cefd0 0x7fd6b80cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:51.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.666+0000 7fd6bdc0c700 1 -- 172.21.15.37:0/2437673491 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6b80cefd0 msgr2=0x7fd6b80cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:51.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.666+0000 7fd6bdc0c700 1 --2- 172.21.15.37:0/2437673491 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6b80cefd0 0x7fd6b80cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:51.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.666+0000 7fd6bdc0c700 1 -- 172.21.15.37:0/2437673491 >> v1:172.21.15.191:6789/0 conn(0x7fd6b8157320 legacy=0x7fd6b80ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:51.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.666+0000 7fd6bdc0c700 1 -- 172.21.15.37:0/2437673491 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b815dcd0 con 0x7fd6b8156f50 2023-10-06T02:23:51.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.666+0000 7fd6bdc0c700 1 --2- 172.21.15.37:0/2437673491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b8156f50 0x7fd6b815a5a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd6b00099b0 tx=0x7fd6b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353733baa1706c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:51.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.666+0000 7fd6bcc0a700 1 -- 172.21.15.37:0/2437673491 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0009ea0 con 0x7fd6b8156f50 2023-10-06T02:23:51.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.666+0000 7fd6bcc0a700 1 -- 172.21.15.37:0/2437673491 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b000b860 con 0x7fd6b8156f50 2023-10-06T02:23:51.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.666+0000 7fd6bcc0a700 1 -- 172.21.15.37:0/2437673491 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b000bc00 con 0x7fd6b8156f50 2023-10-06T02:23:51.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.667+0000 7fd6bfe70700 1 -- 172.21.15.37:0/2437673491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b8156f50 msgr2=0x7fd6b815a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:51.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.667+0000 7fd6bfe70700 1 --2- 172.21.15.37:0/2437673491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b8156f50 0x7fd6b815a5a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd6b00099b0 tx=0x7fd6b0009250 comp rx=0 tx=0).stop 2023-10-06T02:23:51.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.667+0000 7fd6bfe70700 1 -- 172.21.15.37:0/2437673491 shutdown_connections 2023-10-06T02:23:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.667+0000 7fd6bfe70700 1 --2- 172.21.15.37:0/2437673491 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6b80cefd0 0x7fd6b80cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.667+0000 7fd6bfe70700 1 --2- 172.21.15.37:0/2437673491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b8156f50 0x7fd6b815a5a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.667+0000 7fd6bfe70700 1 -- 172.21.15.37:0/2437673491 >> 172.21.15.37:0/2437673491 conn(0x7fd6b80d04f0 msgr2=0x7fd6b80d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.667+0000 7fd6bfe70700 1 -- 172.21.15.37:0/2437673491 shutdown_connections 2023-10-06T02:23:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.667+0000 7fd6bfe70700 1 -- 172.21.15.37:0/2437673491 wait complete. 2023-10-06T02:23:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.668+0000 7fd6bfe70700 1 Processor -- start 2023-10-06T02:23:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.668+0000 7fd6bfe70700 1 -- start start 2023-10-06T02:23:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.669+0000 7fd6bfe70700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b80cefd0 0x7fd6b816cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.669+0000 7fd6bfe70700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6b8156f50 0x7fd6b80b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.669+0000 7fd6bfe70700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6b8157320 0x7fd6b816b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.669+0000 7fd6bfe70700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b80b3b90 con 0x7fd6b80cefd0 2023-10-06T02:23:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.669+0000 7fd6bfe70700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b80b38f0 con 0x7fd6b8156f50 2023-10-06T02:23:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.669+0000 7fd6bfe70700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b8152810 con 0x7fd6b8157320 2023-10-06T02:23:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.669+0000 7fd6bdc0c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b80cefd0 0x7fd6b816cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.669+0000 7fd6bdc0c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b80cefd0 0x7fd6b816cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43812/0 (socket says 172.21.15.37:43812) 2023-10-06T02:23:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.669+0000 7fd6bdc0c700 1 -- 172.21.15.37:0/2280919232 learned_addr learned my addr 172.21.15.37:0/2280919232 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.669+0000 7fd6be40d700 1 --2- 172.21.15.37:0/2280919232 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6b8157320 0x7fd6b816b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.669+0000 7fd6bd40b700 1 --2- 172.21.15.37:0/2280919232 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6b8156f50 0x7fd6b80b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:51.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.669+0000 7fd6bdc0c700 1 -- 172.21.15.37:0/2280919232 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6b8157320 msgr2=0x7fd6b816b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:51.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.669+0000 7fd6bdc0c700 1 --2- 172.21.15.37:0/2280919232 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6b8157320 0x7fd6b816b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:51.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.669+0000 7fd6bdc0c700 1 -- 172.21.15.37:0/2280919232 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6b8156f50 msgr2=0x7fd6b80b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:51.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.669+0000 7fd6bdc0c700 1 --2- 172.21.15.37:0/2280919232 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6b8156f50 0x7fd6b80b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:51.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.669+0000 7fd6bdc0c700 1 -- 172.21.15.37:0/2280919232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b00094f0 con 0x7fd6b80cefd0 2023-10-06T02:23:51.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.669+0000 7fd6bdc0c700 1 --2- 172.21.15.37:0/2280919232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b80cefd0 0x7fd6b816cfe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd6b806d190 tx=0x7fd6b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:51.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.669+0000 7fd6b5ffb700 1 -- 172.21.15.37:0/2280919232 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0000d10 con 0x7fd6b80cefd0 2023-10-06T02:23:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.670+0000 7fd6b5ffb700 1 -- 172.21.15.37:0/2280919232 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b000bbe0 con 0x7fd6b80cefd0 2023-10-06T02:23:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.670+0000 7fd6bfe70700 1 -- 172.21.15.37:0/2280919232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b8152af0 con 0x7fd6b80cefd0 2023-10-06T02:23:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.670+0000 7fd6b5ffb700 1 -- 172.21.15.37:0/2280919232 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0011670 con 0x7fd6b80cefd0 2023-10-06T02:23:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.670+0000 7fd6bfe70700 1 -- 172.21.15.37:0/2280919232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b81530b0 con 0x7fd6b80cefd0 2023-10-06T02:23:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.671+0000 7fd6bfe70700 1 -- 172.21.15.37:0/2280919232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b81532a0 con 0x7fd6b80cefd0 2023-10-06T02:23:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.671+0000 7fd6b5ffb700 1 -- 172.21.15.37:0/2280919232 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6b0011aa0 con 0x7fd6b80cefd0 2023-10-06T02:23:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.671+0000 7fd6b5ffb700 1 --2- 172.21.15.37:0/2280919232 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd6a4066f30 0x7fd6a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.672+0000 7fd6b5ffb700 1 -- 172.21.15.37:0/2280919232 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd6b0085ea0 con 0x7fd6b80cefd0 2023-10-06T02:23:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.672+0000 7fd6bd40b700 1 --2- 172.21.15.37:0/2280919232 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd6a4066f30 0x7fd6a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.672+0000 7fd6bd40b700 1 --2- 172.21.15.37:0/2280919232 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd6a4066f30 0x7fd6a40693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd6b814b8c0 tx=0x7fd6ac007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.676+0000 7fd6b5ffb700 1 -- 172.21.15.37:0/2280919232 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6b0052fb0 con 0x7fd6b80cefd0 2023-10-06T02:23:51.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.914+0000 7fd6bfe70700 1 -- 172.21.15.37:0/2280919232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6b815dfb0 con 0x7fd6b80cefd0 2023-10-06T02:23:51.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.914+0000 7fd6b5ffb700 1 -- 172.21.15.37:0/2280919232 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4591 (secure 0 0 0) 0x7fd6b00565d0 con 0x7fd6b80cefd0 2023-10-06T02:23:51.916 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:51.916 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/651376696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":651376696},{"type":"v1","addr":"172.21.15.191:6837","nonce":651376696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1345849362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1345849362},{"type":"v1","addr":"172.21.15.37:6834","nonce":1345849362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/434738958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":434738958},{"type":"v1","addr":"172.21.15.37:6835","nonce":434738958}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:15.298562+0000","modified":"2023-10-06T02:23:18.911651+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6835/1723334905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1723334905},{"type":"v1","addr":"172.21.15.191:6835","nonce":1723334905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:23:51.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.916+0000 7fd6bfe70700 1 -- 172.21.15.37:0/2280919232 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd6a4066f30 msgr2=0x7fd6a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:51.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.916+0000 7fd6bfe70700 1 --2- 172.21.15.37:0/2280919232 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd6a4066f30 0x7fd6a40693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd6b814b8c0 tx=0x7fd6ac007ec0 comp rx=0 tx=0).stop 2023-10-06T02:23:51.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.916+0000 7fd6bfe70700 1 -- 172.21.15.37:0/2280919232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b80cefd0 msgr2=0x7fd6b816cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:51.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.916+0000 7fd6bfe70700 1 --2- 172.21.15.37:0/2280919232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b80cefd0 0x7fd6b816cfe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd6b806d190 tx=0x7fd6b0017000 comp rx=0 tx=0).stop 2023-10-06T02:23:51.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.916+0000 7fd6bfe70700 1 -- 172.21.15.37:0/2280919232 shutdown_connections 2023-10-06T02:23:51.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.916+0000 7fd6bfe70700 1 --2- 172.21.15.37:0/2280919232 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6b8157320 0x7fd6b816b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:51.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.916+0000 7fd6bfe70700 1 --2- 172.21.15.37:0/2280919232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b80cefd0 0x7fd6b816cfe0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:51.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.916+0000 7fd6bfe70700 1 --2- 172.21.15.37:0/2280919232 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd6a4066f30 0x7fd6a40693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:51.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.916+0000 7fd6bfe70700 1 --2- 172.21.15.37:0/2280919232 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6b8156f50 0x7fd6b80b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:51.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.916+0000 7fd6bfe70700 1 -- 172.21.15.37:0/2280919232 >> 172.21.15.37:0/2280919232 conn(0x7fd6b80d04f0 msgr2=0x7fd6b8155190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:51.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.916+0000 7fd6bfe70700 1 -- 172.21.15.37:0/2280919232 shutdown_connections 2023-10-06T02:23:51.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:51.917+0000 7fd6bfe70700 1 -- 172.21.15.37:0/2280919232 wait complete. 2023-10-06T02:23:51.919 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-10-06T02:23:51.930 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:52.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.047+0000 7f31b0f4d700 1 Processor -- start 2023-10-06T02:23:52.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.047+0000 7f31b0f4d700 1 -- start start 2023-10-06T02:23:52.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.048+0000 7f31b0f4d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31ac159760 0x7f31ac15d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:52.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.048+0000 7f31b0f4d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31ac15dd20 0x7f31ac0cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:52.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.048+0000 7f31b0f4d700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31ac15e1a0 con 0x7f31ac15d8d0 2023-10-06T02:23:52.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.048+0000 7f31b0f4d700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ac0cc2d0 con 0x7f31ac15dd20 2023-10-06T02:23:52.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.048+0000 7f31b0f4d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac0cb650 con 0x7f31ac159760 2023-10-06T02:23:52.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.048+0000 7f31aad9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31ac15dd20 0x7f31ac0cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:52.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.048+0000 7f31aad9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31ac15dd20 0x7f31ac0cfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43818/0 (socket says 172.21.15.37:43818) 2023-10-06T02:23:52.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.048+0000 7f31aad9d700 1 -- 172.21.15.37:0/3612045721 learned_addr learned my addr 172.21.15.37:0/3612045721 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:52.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.048+0000 7f31aa59c700 1 --2- 172.21.15.37:0/3612045721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31ac159760 0x7f31ac15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:52.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.049+0000 7f31aad9d700 1 -- 172.21.15.37:0/3612045721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31ac159760 msgr2=0x7f31ac15d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:52.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.049+0000 7f31aad9d700 1 --2- 172.21.15.37:0/3612045721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31ac159760 0x7f31ac15d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.049+0000 7f31aad9d700 1 -- 172.21.15.37:0/3612045721 >> v1:172.21.15.191:6789/0 conn(0x7f31ac15d8d0 legacy=0x7f31ac0c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:52.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.049+0000 7f31aad9d700 1 -- 172.21.15.37:0/3612045721 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac0cb930 con 0x7f31ac15dd20 2023-10-06T02:23:52.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.049+0000 7f31aad9d700 1 --2- 172.21.15.37:0/3612045721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31ac15dd20 0x7f31ac0cfc00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f31a4009f20 tx=0x7f31a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd581e4b731316e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:52.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.049+0000 7f31a959a700 1 -- 172.21.15.37:0/3612045721 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a400e070 con 0x7f31ac15dd20 2023-10-06T02:23:52.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.049+0000 7f31a959a700 1 -- 172.21.15.37:0/3612045721 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a400bad0 con 0x7f31ac15dd20 2023-10-06T02:23:52.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.049+0000 7f31a959a700 1 -- 172.21.15.37:0/3612045721 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a40092e0 con 0x7f31ac15dd20 2023-10-06T02:23:52.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.049+0000 7f31b0f4d700 1 -- 172.21.15.37:0/3612045721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31ac15dd20 msgr2=0x7f31ac0cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:52.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.049+0000 7f31b0f4d700 1 --2- 172.21.15.37:0/3612045721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31ac15dd20 0x7f31ac0cfc00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f31a4009f20 tx=0x7f31a4009840 comp rx=0 tx=0).stop 2023-10-06T02:23:52.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.049+0000 7f31b0f4d700 1 -- 172.21.15.37:0/3612045721 shutdown_connections 2023-10-06T02:23:52.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.049+0000 7f31b0f4d700 1 --2- 172.21.15.37:0/3612045721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31ac15dd20 0x7f31ac0cfc00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.049+0000 7f31b0f4d700 1 --2- 172.21.15.37:0/3612045721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31ac159760 0x7f31ac15d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.049+0000 7f31b0f4d700 1 -- 172.21.15.37:0/3612045721 >> 172.21.15.37:0/3612045721 conn(0x7f31ac06c890 msgr2=0x7f31ac0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:52.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.050+0000 7f31b0f4d700 1 -- 172.21.15.37:0/3612045721 shutdown_connections 2023-10-06T02:23:52.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.050+0000 7f31b0f4d700 1 -- 172.21.15.37:0/3612045721 wait complete. 2023-10-06T02:23:52.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.051+0000 7f31b0f4d700 1 Processor -- start 2023-10-06T02:23:52.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.051+0000 7f31b0f4d700 1 -- start start 2023-10-06T02:23:52.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.051+0000 7f31b0f4d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31ac159760 0x7f31ac153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:52.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.051+0000 7f31b0f4d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31ac15d8d0 0x7f31ac0b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:52.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.051+0000 7f31b0f4d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31ac15dd20 0x7f31ac15bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:52.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.051+0000 7f31b0f4d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac154ef0 con 0x7f31ac15dd20 2023-10-06T02:23:52.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.051+0000 7f31b0f4d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac0b62c0 con 0x7f31ac15d8d0 2023-10-06T02:23:52.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.051+0000 7f31b0f4d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac0c8a80 con 0x7f31ac159760 2023-10-06T02:23:52.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.051+0000 7f31aad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31ac15dd20 0x7f31ac15bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:52.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.051+0000 7f31aad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31ac15dd20 0x7f31ac15bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43828/0 (socket says 172.21.15.37:43828) 2023-10-06T02:23:52.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.051+0000 7f31aad9d700 1 -- 172.21.15.37:0/1572242005 learned_addr learned my addr 172.21.15.37:0/1572242005 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:52.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.052+0000 7f31aa59c700 1 --2- 172.21.15.37:0/1572242005 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31ac159760 0x7f31ac153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:52.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.052+0000 7f31a9d9b700 1 --2- 172.21.15.37:0/1572242005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31ac15d8d0 0x7f31ac0b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:52.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.052+0000 7f31aad9d700 1 -- 172.21.15.37:0/1572242005 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31ac159760 msgr2=0x7f31ac153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:52.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.052+0000 7f31aad9d700 1 --2- 172.21.15.37:0/1572242005 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31ac159760 0x7f31ac153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.052+0000 7f31aad9d700 1 -- 172.21.15.37:0/1572242005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31ac15d8d0 msgr2=0x7f31ac0b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:52.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.052+0000 7f31aad9d700 1 --2- 172.21.15.37:0/1572242005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31ac15d8d0 0x7f31ac0b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.052+0000 7f31aad9d700 1 -- 172.21.15.37:0/1572242005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a4009ae0 con 0x7f31ac15dd20 2023-10-06T02:23:52.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.052+0000 7f31a9d9b700 1 --2- 172.21.15.37:0/1572242005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31ac15d8d0 0x7f31ac0b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:52.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.052+0000 7f31aad9d700 1 --2- 172.21.15.37:0/1572242005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31ac15dd20 0x7f31ac15bfa0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f31ac088880 tx=0x7f31a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:52.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.052+0000 7f31a27fc700 1 -- 172.21.15.37:0/1572242005 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a4012d30 con 0x7f31ac15dd20 2023-10-06T02:23:52.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.052+0000 7f31a27fc700 1 -- 172.21.15.37:0/1572242005 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a4012e90 con 0x7f31ac15dd20 2023-10-06T02:23:52.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.052+0000 7f31b0f4d700 1 -- 172.21.15.37:0/1572242005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ac0b5d00 con 0x7f31ac15dd20 2023-10-06T02:23:52.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.052+0000 7f31a27fc700 1 -- 172.21.15.37:0/1572242005 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a401e650 con 0x7f31ac15dd20 2023-10-06T02:23:52.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.052+0000 7f31b0f4d700 1 -- 172.21.15.37:0/1572242005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ac0c8710 con 0x7f31ac15dd20 2023-10-06T02:23:52.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.053+0000 7f31b0f4d700 1 -- 172.21.15.37:0/1572242005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ac0c8bf0 con 0x7f31ac15dd20 2023-10-06T02:23:52.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.053+0000 7f31a27fc700 1 -- 172.21.15.37:0/1572242005 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31a4019030 con 0x7f31ac15dd20 2023-10-06T02:23:52.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.054+0000 7f31a27fc700 1 --2- 172.21.15.37:0/1572242005 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f318c066f30 0x7f318c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:52.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.054+0000 7f31a27fc700 1 -- 172.21.15.37:0/1572242005 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f31a40863c0 con 0x7f31ac15dd20 2023-10-06T02:23:52.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.054+0000 7f31aa59c700 1 --2- 172.21.15.37:0/1572242005 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f318c066f30 0x7f318c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:52.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.055+0000 7f31aa59c700 1 --2- 172.21.15.37:0/1572242005 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f318c066f30 0x7f318c0693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f319c006fd0 tx=0x7f319c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:52.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.058+0000 7f31a27fc700 1 -- 172.21.15.37:0/1572242005 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31a40534d0 con 0x7f31ac15dd20 2023-10-06T02:23:52.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.252+0000 7f31b0f4d700 1 -- 172.21.15.37:0/1572242005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31ac06fbf0 con 0x7f31ac15dd20 2023-10-06T02:23:52.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.253+0000 7f31a27fc700 1 -- 172.21.15.37:0/1572242005 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f31a4056af0 con 0x7f31ac15dd20 2023-10-06T02:23:52.255 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:52.255 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:23:16.897625+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:13.004596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:14.268809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:52.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.255+0000 7f31b0f4d700 1 -- 172.21.15.37:0/1572242005 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f318c066f30 msgr2=0x7f318c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:52.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.255+0000 7f31b0f4d700 1 --2- 172.21.15.37:0/1572242005 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f318c066f30 0x7f318c0693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f319c006fd0 tx=0x7f319c008040 comp rx=0 tx=0).stop 2023-10-06T02:23:52.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.255+0000 7f31b0f4d700 1 -- 172.21.15.37:0/1572242005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31ac15dd20 msgr2=0x7f31ac15bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:52.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.255+0000 7f31b0f4d700 1 --2- 172.21.15.37:0/1572242005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31ac15dd20 0x7f31ac15bfa0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f31ac088880 tx=0x7f31a4017000 comp rx=0 tx=0).stop 2023-10-06T02:23:52.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.255+0000 7f31b0f4d700 1 -- 172.21.15.37:0/1572242005 shutdown_connections 2023-10-06T02:23:52.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.255+0000 7f31b0f4d700 1 --2- 172.21.15.37:0/1572242005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31ac15dd20 0x7f31ac15bfa0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.255+0000 7f31b0f4d700 1 --2- 172.21.15.37:0/1572242005 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31ac159760 0x7f31ac153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.255+0000 7f31b0f4d700 1 --2- 172.21.15.37:0/1572242005 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f318c066f30 0x7f318c0693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.255+0000 7f31b0f4d700 1 --2- 172.21.15.37:0/1572242005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31ac15d8d0 0x7f31ac0b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.256+0000 7f31b0f4d700 1 -- 172.21.15.37:0/1572242005 >> 172.21.15.37:0/1572242005 conn(0x7f31ac06c890 msgr2=0x7f31ac0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:52.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.256+0000 7f31b0f4d700 1 -- 172.21.15.37:0/1572242005 shutdown_connections 2023-10-06T02:23:52.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.256+0000 7f31b0f4d700 1 -- 172.21.15.37:0/1572242005 wait complete. 2023-10-06T02:23:52.269 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:23:08.066048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:23:08.561964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:23:13.004596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:23:14.268809+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:23:52.269 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:23:52.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.390+0000 7ff375251700 1 Processor -- start 2023-10-06T02:23:52.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.390+0000 7ff375251700 1 -- start start 2023-10-06T02:23:52.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.390+0000 7ff375251700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3701593c0 0x7ff370159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:52.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.390+0000 7ff375251700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff3700b2380 0x7ff3700b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:52.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.390+0000 7ff375251700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3700b07a0 con 0x7ff3700ccb30 2023-10-06T02:23:52.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.390+0000 7ff375251700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3700cd6c0 con 0x7ff3700b2380 2023-10-06T02:23:52.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.390+0000 7ff375251700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3700cd8a0 con 0x7ff3701593c0 2023-10-06T02:23:52.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.391+0000 7ff36e59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff3700b2380 0x7ff3700b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:52.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.391+0000 7ff36e59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff3700b2380 0x7ff3700b27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43840/0 (socket says 172.21.15.37:43840) 2023-10-06T02:23:52.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.391+0000 7ff36e59c700 1 -- 172.21.15.37:0/3526489725 learned_addr learned my addr 172.21.15.37:0/3526489725 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:52.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.391+0000 7ff36ed9d700 1 --2- 172.21.15.37:0/3526489725 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3701593c0 0x7ff370159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:52.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.391+0000 7ff36e59c700 1 -- 172.21.15.37:0/3526489725 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3701593c0 msgr2=0x7ff370159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:52.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.391+0000 7ff36e59c700 1 --2- 172.21.15.37:0/3526489725 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3701593c0 0x7ff370159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.391+0000 7ff36e59c700 1 -- 172.21.15.37:0/3526489725 >> v1:172.21.15.191:6789/0 conn(0x7ff3700ccb30 legacy=0x7ff3700ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:52.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.391+0000 7ff36e59c700 1 -- 172.21.15.37:0/3526489725 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3700afe70 con 0x7ff3700b2380 2023-10-06T02:23:52.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.391+0000 7ff36e59c700 1 --2- 172.21.15.37:0/3526489725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3700b2380 0x7ff3700b27f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff3580099b0 tx=0x7ff358009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2bb709b54d18819 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:52.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.391+0000 7ff36dd9b700 1 -- 172.21.15.37:0/3526489725 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35800b860 con 0x7ff3700b2380 2023-10-06T02:23:52.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.391+0000 7ff36dd9b700 1 -- 172.21.15.37:0/3526489725 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35800b9c0 con 0x7ff3700b2380 2023-10-06T02:23:52.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.391+0000 7ff36dd9b700 1 -- 172.21.15.37:0/3526489725 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35800bd60 con 0x7ff3700b2380 2023-10-06T02:23:52.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.392+0000 7ff375251700 1 -- 172.21.15.37:0/3526489725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3700b2380 msgr2=0x7ff3700b27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:52.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.392+0000 7ff375251700 1 --2- 172.21.15.37:0/3526489725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3700b2380 0x7ff3700b27f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff3580099b0 tx=0x7ff358009250 comp rx=0 tx=0).stop 2023-10-06T02:23:52.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.392+0000 7ff375251700 1 -- 172.21.15.37:0/3526489725 shutdown_connections 2023-10-06T02:23:52.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.392+0000 7ff375251700 1 --2- 172.21.15.37:0/3526489725 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3701593c0 0x7ff370159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.392+0000 7ff375251700 1 --2- 172.21.15.37:0/3526489725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3700b2380 0x7ff3700b27f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.392+0000 7ff375251700 1 -- 172.21.15.37:0/3526489725 >> 172.21.15.37:0/3526489725 conn(0x7ff37006c0b0 msgr2=0x7ff37006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:52.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.392+0000 7ff375251700 1 -- 172.21.15.37:0/3526489725 shutdown_connections 2023-10-06T02:23:52.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.392+0000 7ff375251700 1 -- 172.21.15.37:0/3526489725 wait complete. 2023-10-06T02:23:52.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.393+0000 7ff375251700 1 Processor -- start 2023-10-06T02:23:52.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.393+0000 7ff375251700 1 -- start start 2023-10-06T02:23:52.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.394+0000 7ff375251700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3700b2380 0x7ff37014a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:52.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.394+0000 7ff375251700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3700ccb30 0x7ff3700c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:52.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.394+0000 7ff375251700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3701593c0 0x7ff3700c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:52.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.394+0000 7ff375251700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37016b000 con 0x7ff3700ccb30 2023-10-06T02:23:52.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.394+0000 7ff375251700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37016abe0 con 0x7ff3701593c0 2023-10-06T02:23:52.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.394+0000 7ff375251700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff370169fd0 con 0x7ff3700b2380 2023-10-06T02:23:52.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.394+0000 7ff36e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3700ccb30 0x7ff3700c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.394+0000 7ff36e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3700ccb30 0x7ff3700c6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43844/0 (socket says 172.21.15.37:43844) 2023-10-06T02:23:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.394+0000 7ff36e59c700 1 -- 172.21.15.37:0/2786627635 learned_addr learned my addr 172.21.15.37:0/2786627635 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.394+0000 7ff36ed9d700 1 --2- 172.21.15.37:0/2786627635 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3700b2380 0x7ff37014a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.394+0000 7ff36f59e700 1 --2- 172.21.15.37:0/2786627635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3701593c0 0x7ff3700c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.394+0000 7ff36e59c700 1 -- 172.21.15.37:0/2786627635 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3700b2380 msgr2=0x7ff37014a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.394+0000 7ff36e59c700 1 --2- 172.21.15.37:0/2786627635 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3700b2380 0x7ff37014a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.394+0000 7ff36e59c700 1 -- 172.21.15.37:0/2786627635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3701593c0 msgr2=0x7ff3700c6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.394+0000 7ff36e59c700 1 --2- 172.21.15.37:0/2786627635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3701593c0 0x7ff3700c6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.394+0000 7ff36e59c700 1 -- 172.21.15.37:0/2786627635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3580094f0 con 0x7ff3700ccb30 2023-10-06T02:23:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.395+0000 7ff36e59c700 1 --2- 172.21.15.37:0/2786627635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3700ccb30 0x7ff3700c6110 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff3700894a0 tx=0x7ff358017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.395+0000 7ff366ffd700 1 -- 172.21.15.37:0/2786627635 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358011e40 con 0x7ff3700ccb30 2023-10-06T02:23:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.395+0000 7ff366ffd700 1 -- 172.21.15.37:0/2786627635 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35801a420 con 0x7ff3700ccb30 2023-10-06T02:23:52.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.395+0000 7ff375251700 1 -- 172.21.15.37:0/2786627635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff37016a2b0 con 0x7ff3700ccb30 2023-10-06T02:23:52.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.395+0000 7ff366ffd700 1 -- 172.21.15.37:0/2786627635 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35801a7e0 con 0x7ff3700ccb30 2023-10-06T02:23:52.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.395+0000 7ff375251700 1 -- 172.21.15.37:0/2786627635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37016a870 con 0x7ff3700ccb30 2023-10-06T02:23:52.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.396+0000 7ff375251700 1 -- 172.21.15.37:0/2786627635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff370064850 con 0x7ff3700ccb30 2023-10-06T02:23:52.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.396+0000 7ff366ffd700 1 -- 172.21.15.37:0/2786627635 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff35801ab50 con 0x7ff3700ccb30 2023-10-06T02:23:52.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.396+0000 7ff366ffd700 1 --2- 172.21.15.37:0/2786627635 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff350066f30 0x7ff3500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:52.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.397+0000 7ff366ffd700 1 -- 172.21.15.37:0/2786627635 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff358085f70 con 0x7ff3700ccb30 2023-10-06T02:23:52.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.397+0000 7ff36ed9d700 1 --2- 172.21.15.37:0/2786627635 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff350066f30 0x7ff3500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:52.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.397+0000 7ff36ed9d700 1 --2- 172.21.15.37:0/2786627635 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff350066f30 0x7ff3500693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff360006fd0 tx=0x7ff360008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:52.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.401+0000 7ff366ffd700 1 -- 172.21.15.37:0/2786627635 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3580b75a0 con 0x7ff3700ccb30 2023-10-06T02:23:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.591+0000 7ff375251700 1 -- 172.21.15.37:0/2786627635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff37016ad50 con 0x7ff3700ccb30 2023-10-06T02:23:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.592+0000 7ff366ffd700 1 -- 172.21.15.37:0/2786627635 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff358053080 con 0x7ff3700ccb30 2023-10-06T02:23:52.593 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T02:23:52.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.594+0000 7ff375251700 1 -- 172.21.15.37:0/2786627635 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff350066f30 msgr2=0x7ff3500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:52.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.594+0000 7ff375251700 1 --2- 172.21.15.37:0/2786627635 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff350066f30 0x7ff3500693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff360006fd0 tx=0x7ff360008040 comp rx=0 tx=0).stop 2023-10-06T02:23:52.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.594+0000 7ff375251700 1 -- 172.21.15.37:0/2786627635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3700ccb30 msgr2=0x7ff3700c6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:52.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.594+0000 7ff375251700 1 --2- 172.21.15.37:0/2786627635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3700ccb30 0x7ff3700c6110 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff3700894a0 tx=0x7ff358017000 comp rx=0 tx=0).stop 2023-10-06T02:23:52.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.594+0000 7ff375251700 1 -- 172.21.15.37:0/2786627635 shutdown_connections 2023-10-06T02:23:52.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.594+0000 7ff375251700 1 --2- 172.21.15.37:0/2786627635 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff350066f30 0x7ff3500693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.594+0000 7ff375251700 1 --2- 172.21.15.37:0/2786627635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3701593c0 0x7ff3700c6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.594+0000 7ff375251700 1 --2- 172.21.15.37:0/2786627635 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3700b2380 0x7ff37014a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.594+0000 7ff375251700 1 --2- 172.21.15.37:0/2786627635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3700ccb30 0x7ff3700c6110 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.594+0000 7ff375251700 1 -- 172.21.15.37:0/2786627635 >> 172.21.15.37:0/2786627635 conn(0x7ff37006c0b0 msgr2=0x7ff3700cf980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:52.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.594+0000 7ff375251700 1 -- 172.21.15.37:0/2786627635 shutdown_connections 2023-10-06T02:23:52.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.594+0000 7ff375251700 1 -- 172.21.15.37:0/2786627635 wait complete. 2023-10-06T02:23:52.607 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:23:52.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.728+0000 7f5cee2b6700 1 Processor -- start 2023-10-06T02:23:52.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.728+0000 7f5cee2b6700 1 -- start start 2023-10-06T02:23:52.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.729+0000 7f5cee2b6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ce8150380 0x7f5ce80b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:52.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.729+0000 7f5cee2b6700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5ce80b1ca0 0x7f5ce806d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:52.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.729+0000 7f5cee2b6700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce815e070 con 0x7f5ce8150750 2023-10-06T02:23:52.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.729+0000 7f5cee2b6700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce815d1c0 con 0x7f5ce80b1ca0 2023-10-06T02:23:52.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.729+0000 7f5cee2b6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce815d460 con 0x7f5ce8150380 2023-10-06T02:23:52.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.729+0000 7f5ce77fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5ce8150750 0x7f5ce80b1590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46000/0 (socket says 172.21.15.37:46000) 2023-10-06T02:23:52.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.729+0000 7f5ce77fe700 1 -- 172.21.15.37:0/3774160334 learned_addr learned my addr 172.21.15.37:0/3774160334 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:52.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.730+0000 7f5cec853700 1 --2- 172.21.15.37:0/3774160334 >> v2:172.21.15.191:3300/0 conn(0x7f5ce80b1ca0 0x7f5ce806d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:52.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.730+0000 7f5ce7fff700 1 --2- 172.21.15.37:0/3774160334 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ce8150380 0x7f5ce80b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:52.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.730+0000 7f5ce6ffd700 1 -- 172.21.15.37:0/3774160334 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722818438 0 0) 0x7f5ce815e070 con 0x7f5ce8150750 2023-10-06T02:23:52.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.730+0000 7f5ce6ffd700 1 -- 172.21.15.37:0/3774160334 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cd4003570 con 0x7f5ce8150750 2023-10-06T02:23:52.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.730+0000 7f5ce6ffd700 1 -- 172.21.15.37:0/3774160334 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 751392963 0 0) 0x7f5cd4003570 con 0x7f5ce8150750 2023-10-06T02:23:52.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.730+0000 7f5ce7fff700 1 -- 172.21.15.37:0/3774160334 >> v2:172.21.15.191:3300/0 conn(0x7f5ce80b1ca0 msgr2=0x7f5ce806d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:52.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.730+0000 7f5ce7fff700 1 --2- 172.21.15.37:0/3774160334 >> v2:172.21.15.191:3300/0 conn(0x7f5ce80b1ca0 0x7f5ce806d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.730+0000 7f5ce7fff700 1 -- 172.21.15.37:0/3774160334 >> v1:172.21.15.37:6789/0 conn(0x7f5ce8150750 legacy=0x7f5ce80b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:52.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.730+0000 7f5ce7fff700 1 -- 172.21.15.37:0/3774160334 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce815d740 con 0x7f5ce8150380 2023-10-06T02:23:52.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.730+0000 7f5cec853700 1 --2- 172.21.15.37:0/3774160334 >> v2:172.21.15.191:3300/0 conn(0x7f5ce80b1ca0 0x7f5ce806d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:52.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.730+0000 7f5ce7fff700 1 --2- 172.21.15.37:0/3774160334 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ce8150380 0x7f5ce80b3c90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80098e0 tx=0x7f5cd80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85e8f284e9723cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:52.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.730+0000 7f5ce6ffd700 1 -- 172.21.15.37:0/3774160334 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0001470 con 0x7f5ce8150380 2023-10-06T02:23:52.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.730+0000 7f5ce6ffd700 1 -- 172.21.15.37:0/3774160334 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd8011420 con 0x7f5ce8150380 2023-10-06T02:23:52.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.730+0000 7f5ce6ffd700 1 -- 172.21.15.37:0/3774160334 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd80117c0 con 0x7f5ce8150380 2023-10-06T02:23:52.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.731+0000 7f5cee2b6700 1 -- 172.21.15.37:0/3774160334 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ce8150380 msgr2=0x7f5ce80b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:52.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.731+0000 7f5cee2b6700 1 --2- 172.21.15.37:0/3774160334 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ce8150380 0x7f5ce80b3c90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80098e0 tx=0x7f5cd80091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.731+0000 7f5cee2b6700 1 -- 172.21.15.37:0/3774160334 shutdown_connections 2023-10-06T02:23:52.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.731+0000 7f5cee2b6700 1 --2- 172.21.15.37:0/3774160334 >> v2:172.21.15.191:3300/0 conn(0x7f5ce80b1ca0 0x7f5ce806d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.731+0000 7f5cee2b6700 1 --2- 172.21.15.37:0/3774160334 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ce8150380 0x7f5ce80b3c90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.731+0000 7f5cee2b6700 1 -- 172.21.15.37:0/3774160334 >> 172.21.15.37:0/3774160334 conn(0x7f5ce806c0b0 msgr2=0x7f5ce806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.731+0000 7f5cee2b6700 1 -- 172.21.15.37:0/3774160334 shutdown_connections 2023-10-06T02:23:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.731+0000 7f5cee2b6700 1 -- 172.21.15.37:0/3774160334 wait complete. 2023-10-06T02:23:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.732+0000 7f5cee2b6700 1 Processor -- start 2023-10-06T02:23:52.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.732+0000 7f5cee2b6700 1 -- start start 2023-10-06T02:23:52.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.733+0000 7f5cee2b6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ce80b1ca0 0x7f5ce80cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:52.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.733+0000 7f5cee2b6700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ce8150380 0x7f5ce816c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:52.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.733+0000 7f5cee2b6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce8150750 0x7f5ce80cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.733+0000 7f5cee2b6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce816cf30 con 0x7f5ce8150750 2023-10-06T02:23:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.733+0000 7f5cee2b6700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce80cd8d0 con 0x7f5ce8150380 2023-10-06T02:23:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.733+0000 7f5cee2b6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce80cdba0 con 0x7f5ce80b1ca0 2023-10-06T02:23:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.733+0000 7f5cec853700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce8150750 0x7f5ce80cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:52.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.733+0000 7f5cec853700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce8150750 0x7f5ce80cd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43846/0 (socket says 172.21.15.37:43846) 2023-10-06T02:23:52.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.733+0000 7f5cec853700 1 -- 172.21.15.37:0/147338525 learned_addr learned my addr 172.21.15.37:0/147338525 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:52.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.733+0000 7f5ce77fe700 1 --2- 172.21.15.37:0/147338525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ce8150380 0x7f5ce816c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:52.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.733+0000 7f5ce7fff700 1 --2- 172.21.15.37:0/147338525 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ce80b1ca0 0x7f5ce80cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:52.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.733+0000 7f5cec853700 1 -- 172.21.15.37:0/147338525 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ce80b1ca0 msgr2=0x7f5ce80cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:52.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.733+0000 7f5cec853700 1 --2- 172.21.15.37:0/147338525 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ce80b1ca0 0x7f5ce80cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.733+0000 7f5cec853700 1 -- 172.21.15.37:0/147338525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ce8150380 msgr2=0x7f5ce816c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:52.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.733+0000 7f5cec853700 1 --2- 172.21.15.37:0/147338525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ce8150380 0x7f5ce816c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.733+0000 7f5cec853700 1 -- 172.21.15.37:0/147338525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce0009a20 con 0x7f5ce8150750 2023-10-06T02:23:52.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.733+0000 7f5ce77fe700 1 --2- 172.21.15.37:0/147338525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ce8150380 0x7f5ce816c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:52.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.733+0000 7f5ce7fff700 1 --2- 172.21.15.37:0/147338525 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ce80b1ca0 0x7f5ce80cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:52.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.734+0000 7f5cec853700 1 --2- 172.21.15.37:0/147338525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce8150750 0x7f5ce80cd390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000ef90 tx=0x7f5ce000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:52.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.734+0000 7f5cdffff700 1 -- 172.21.15.37:0/147338525 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce000cd30 con 0x7f5ce8150750 2023-10-06T02:23:52.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.734+0000 7f5cdffff700 1 -- 172.21.15.37:0/147338525 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce000f040 con 0x7f5ce8150750 2023-10-06T02:23:52.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.734+0000 7f5cdffff700 1 -- 172.21.15.37:0/147338525 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce00146b0 con 0x7f5ce8150750 2023-10-06T02:23:52.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.734+0000 7f5cee2b6700 1 -- 172.21.15.37:0/147338525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd8009420 con 0x7f5ce8150750 2023-10-06T02:23:52.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.734+0000 7f5cee2b6700 1 -- 172.21.15.37:0/147338525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce80ce160 con 0x7f5ce8150750 2023-10-06T02:23:52.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.735+0000 7f5cee2b6700 1 -- 172.21.15.37:0/147338525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce806a980 con 0x7f5ce8150750 2023-10-06T02:23:52.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.735+0000 7f5cdffff700 1 -- 172.21.15.37:0/147338525 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ce0014ae0 con 0x7f5ce8150750 2023-10-06T02:23:52.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.735+0000 7f5cdffff700 1 --2- 172.21.15.37:0/147338525 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5cc8066f30 0x7f5cc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:52.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.736+0000 7f5cdffff700 1 -- 172.21.15.37:0/147338525 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5ce0085580 con 0x7f5ce8150750 2023-10-06T02:23:52.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.736+0000 7f5ce7fff700 1 --2- 172.21.15.37:0/147338525 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5cc8066f30 0x7f5cc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:52.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.736+0000 7f5ce7fff700 1 --2- 172.21.15.37:0/147338525 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5cc8066f30 0x7f5cc80693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80030c0 tx=0x7f5cd8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:52.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.740+0000 7f5cdffff700 1 -- 172.21.15.37:0/147338525 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ce0052690 con 0x7f5ce8150750 2023-10-06T02:23:52.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.931+0000 7f5cee2b6700 1 -- 172.21.15.37:0/147338525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ce815da20 con 0x7f5ce8150750 2023-10-06T02:23:52.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.932+0000 7f5cdffff700 1 -- 172.21.15.37:0/147338525 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ce0055cb0 con 0x7f5ce8150750 2023-10-06T02:23:52.933 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T02:23:52.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.934+0000 7f5cee2b6700 1 -- 172.21.15.37:0/147338525 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5cc8066f30 msgr2=0x7f5cc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:52.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.934+0000 7f5cee2b6700 1 --2- 172.21.15.37:0/147338525 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5cc8066f30 0x7f5cc80693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80030c0 tx=0x7f5cd8016000 comp rx=0 tx=0).stop 2023-10-06T02:23:52.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.934+0000 7f5cee2b6700 1 -- 172.21.15.37:0/147338525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce8150750 msgr2=0x7f5ce80cd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:52.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.934+0000 7f5cee2b6700 1 --2- 172.21.15.37:0/147338525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce8150750 0x7f5ce80cd390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000ef90 tx=0x7f5ce000b040 comp rx=0 tx=0).stop 2023-10-06T02:23:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.934+0000 7f5cee2b6700 1 -- 172.21.15.37:0/147338525 shutdown_connections 2023-10-06T02:23:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.934+0000 7f5cee2b6700 1 --2- 172.21.15.37:0/147338525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce8150750 0x7f5ce80cd390 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.934+0000 7f5cee2b6700 1 --2- 172.21.15.37:0/147338525 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ce80b1ca0 0x7f5ce80cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.934+0000 7f5cee2b6700 1 --2- 172.21.15.37:0/147338525 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5cc8066f30 0x7f5cc80693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.934+0000 7f5cee2b6700 1 --2- 172.21.15.37:0/147338525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ce8150380 0x7f5ce816c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.934+0000 7f5cee2b6700 1 -- 172.21.15.37:0/147338525 >> 172.21.15.37:0/147338525 conn(0x7f5ce806c0b0 msgr2=0x7f5ce8149e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.934+0000 7f5cee2b6700 1 -- 172.21.15.37:0/147338525 shutdown_connections 2023-10-06T02:23:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:52.934+0000 7f5cee2b6700 1 -- 172.21.15.37:0/147338525 wait complete. 2023-10-06T02:23:52.947 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:23:53.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.067+0000 7fef05843700 1 Processor -- start 2023-10-06T02:23:53.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.067+0000 7fef05843700 1 -- start start 2023-10-06T02:23:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.068+0000 7fef05843700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef000b2a90 0x7fef00159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.068+0000 7fef05843700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef000ccb30 0x7fef000ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.068+0000 7fef05843700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef000b07a0 con 0x7fef001593c0 2023-10-06T02:23:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.068+0000 7fef05843700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef000cd8a0 con 0x7fef000ccb30 2023-10-06T02:23:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.068+0000 7fef05843700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef000afe70 con 0x7fef000b2a90 2023-10-06T02:23:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.068+0000 7feeff7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef000ccb30 0x7fef000ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.068+0000 7feefeffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fef001593c0 0x7fef000b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46002/0 (socket says 172.21.15.37:46002) 2023-10-06T02:23:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.068+0000 7feefeffd700 1 -- 172.21.15.37:0/3546099980 learned_addr learned my addr 172.21.15.37:0/3546099980 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.069+0000 7feefe7fc700 1 --2- 172.21.15.37:0/3546099980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef000b2a90 0x7fef00159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.069+0000 7feefdffb700 1 -- 172.21.15.37:0/3546099980 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757439699 0 0) 0x7fef000b07a0 con 0x7fef001593c0 2023-10-06T02:23:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.069+0000 7feefdffb700 1 -- 172.21.15.37:0/3546099980 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeec003570 con 0x7fef001593c0 2023-10-06T02:23:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.069+0000 7feeff7fe700 1 -- 172.21.15.37:0/3546099980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef000b2a90 msgr2=0x7fef00159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.069+0000 7feeff7fe700 1 --2- 172.21.15.37:0/3546099980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef000b2a90 0x7fef00159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.069+0000 7feeff7fe700 1 -- 172.21.15.37:0/3546099980 >> v1:172.21.15.37:6789/0 conn(0x7fef001593c0 legacy=0x7fef000b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.069+0000 7feeff7fe700 1 -- 172.21.15.37:0/3546099980 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef000b0150 con 0x7fef000ccb30 2023-10-06T02:23:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.069+0000 7feeff7fe700 1 --2- 172.21.15.37:0/3546099980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef000ccb30 0x7fef000ccfb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7feef0009e60 tx=0x7feef0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4197d3d6a74b4962 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.069+0000 7feefdffb700 1 -- 172.21.15.37:0/3546099980 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef000e070 con 0x7fef000ccb30 2023-10-06T02:23:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.069+0000 7feefdffb700 1 -- 172.21.15.37:0/3546099980 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef000bab0 con 0x7fef000ccb30 2023-10-06T02:23:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.069+0000 7feefdffb700 1 -- 172.21.15.37:0/3546099980 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef000be70 con 0x7fef000ccb30 2023-10-06T02:23:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.070+0000 7fef05843700 1 -- 172.21.15.37:0/3546099980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef000ccb30 msgr2=0x7fef000ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.070+0000 7fef05843700 1 --2- 172.21.15.37:0/3546099980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef000ccb30 0x7fef000ccfb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7feef0009e60 tx=0x7feef0009780 comp rx=0 tx=0).stop 2023-10-06T02:23:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.070+0000 7fef05843700 1 -- 172.21.15.37:0/3546099980 shutdown_connections 2023-10-06T02:23:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.070+0000 7fef05843700 1 --2- 172.21.15.37:0/3546099980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef000ccb30 0x7fef000ccfb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.070+0000 7fef05843700 1 --2- 172.21.15.37:0/3546099980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef000b2a90 0x7fef00159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.070+0000 7fef05843700 1 -- 172.21.15.37:0/3546099980 >> 172.21.15.37:0/3546099980 conn(0x7fef0006c0b0 msgr2=0x7fef0006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.070+0000 7fef05843700 1 -- 172.21.15.37:0/3546099980 shutdown_connections 2023-10-06T02:23:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.070+0000 7fef05843700 1 -- 172.21.15.37:0/3546099980 wait complete. 2023-10-06T02:23:53.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.071+0000 7fef05843700 1 Processor -- start 2023-10-06T02:23:53.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.071+0000 7fef05843700 1 -- start start 2023-10-06T02:23:53.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.072+0000 7fef05843700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef000b2a90 0x7fef00159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:53.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.072+0000 7fef05843700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef000ccb30 0x7fef000b5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:53.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.072+0000 7fef05843700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef001593c0 0x7fef000b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:53.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.072+0000 7fef05843700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef000c4900 con 0x7fef001593c0 2023-10-06T02:23:53.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.072+0000 7fef05843700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef000c4b50 con 0x7fef000b2a90 2023-10-06T02:23:53.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.072+0000 7fef05843700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef000c4e30 con 0x7fef000ccb30 2023-10-06T02:23:53.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.072+0000 7feeff7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef001593c0 0x7fef000b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:53.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.072+0000 7feeff7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef001593c0 0x7fef000b5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43860/0 (socket says 172.21.15.37:43860) 2023-10-06T02:23:53.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.072+0000 7feeff7fe700 1 -- 172.21.15.37:0/1935483197 learned_addr learned my addr 172.21.15.37:0/1935483197 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:53.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.072+0000 7feefe7fc700 1 --2- 172.21.15.37:0/1935483197 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef000ccb30 0x7fef000b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:53.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.072+0000 7feefeffd700 1 --2- 172.21.15.37:0/1935483197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef000b2a90 0x7fef00159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:53.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.072+0000 7feeff7fe700 1 -- 172.21.15.37:0/1935483197 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef000ccb30 msgr2=0x7fef000b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:53.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.072+0000 7feeff7fe700 1 --2- 172.21.15.37:0/1935483197 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef000ccb30 0x7fef000b5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.072+0000 7feeff7fe700 1 -- 172.21.15.37:0/1935483197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef000b2a90 msgr2=0x7fef00159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:53.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.072+0000 7feeff7fe700 1 --2- 172.21.15.37:0/1935483197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef000b2a90 0x7fef00159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.072+0000 7feeff7fe700 1 -- 172.21.15.37:0/1935483197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef0009a20 con 0x7fef001593c0 2023-10-06T02:23:53.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.072+0000 7feefeffd700 1 --2- 172.21.15.37:0/1935483197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef000b2a90 0x7fef00159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:53.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.072+0000 7feeff7fe700 1 --2- 172.21.15.37:0/1935483197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef001593c0 0x7fef000b5e70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fef000894a0 tx=0x7feef0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:53.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.072+0000 7feef6ffd700 1 -- 172.21.15.37:0/1935483197 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0027470 con 0x7fef001593c0 2023-10-06T02:23:53.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.072+0000 7feef6ffd700 1 -- 172.21.15.37:0/1935483197 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef00275f0 con 0x7fef001593c0 2023-10-06T02:23:53.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.073+0000 7fef05843700 1 -- 172.21.15.37:0/1935483197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef000c5110 con 0x7fef001593c0 2023-10-06T02:23:53.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.073+0000 7feef6ffd700 1 -- 172.21.15.37:0/1935483197 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef00279b0 con 0x7fef001593c0 2023-10-06T02:23:53.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.073+0000 7fef05843700 1 -- 172.21.15.37:0/1935483197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef000c56d0 con 0x7fef001593c0 2023-10-06T02:23:53.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.073+0000 7fef05843700 1 -- 172.21.15.37:0/1935483197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef00088bb0 con 0x7fef001593c0 2023-10-06T02:23:53.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.074+0000 7feef6ffd700 1 -- 172.21.15.37:0/1935483197 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feef0024070 con 0x7fef001593c0 2023-10-06T02:23:53.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.074+0000 7feef6ffd700 1 --2- 172.21.15.37:0/1935483197 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7feee0066f30 0x7feee00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:53.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.074+0000 7feef6ffd700 1 -- 172.21.15.37:0/1935483197 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7feef0087000 con 0x7fef001593c0 2023-10-06T02:23:53.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.075+0000 7feefeffd700 1 --2- 172.21.15.37:0/1935483197 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7feee0066f30 0x7feee00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:53.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.075+0000 7feefeffd700 1 --2- 172.21.15.37:0/1935483197 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7feee0066f30 0x7feee00693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7feef8007fd0 tx=0x7feef8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:53.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.079+0000 7feef6ffd700 1 -- 172.21.15.37:0/1935483197 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feef00541c0 con 0x7fef001593c0 2023-10-06T02:23:53.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.270+0000 7fef05843700 1 -- 172.21.15.37:0/1935483197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fef000b0430 con 0x7fef001593c0 2023-10-06T02:23:53.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.271+0000 7feef6ffd700 1 -- 172.21.15.37:0/1935483197 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7feef00577e0 con 0x7fef001593c0 2023-10-06T02:23:53.272 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T02:23:53.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.273+0000 7fef05843700 1 -- 172.21.15.37:0/1935483197 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7feee0066f30 msgr2=0x7feee00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:53.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.273+0000 7fef05843700 1 --2- 172.21.15.37:0/1935483197 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7feee0066f30 0x7feee00693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7feef8007fd0 tx=0x7feef8009040 comp rx=0 tx=0).stop 2023-10-06T02:23:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.273+0000 7fef05843700 1 -- 172.21.15.37:0/1935483197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef001593c0 msgr2=0x7fef000b5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.273+0000 7fef05843700 1 --2- 172.21.15.37:0/1935483197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef001593c0 0x7fef000b5e70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fef000894a0 tx=0x7feef0019000 comp rx=0 tx=0).stop 2023-10-06T02:23:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.273+0000 7fef05843700 1 -- 172.21.15.37:0/1935483197 shutdown_connections 2023-10-06T02:23:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.273+0000 7fef05843700 1 --2- 172.21.15.37:0/1935483197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef001593c0 0x7fef000b5e70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.273+0000 7fef05843700 1 --2- 172.21.15.37:0/1935483197 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7feee0066f30 0x7feee00693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.273+0000 7fef05843700 1 --2- 172.21.15.37:0/1935483197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef000b2a90 0x7fef00159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.273+0000 7fef05843700 1 --2- 172.21.15.37:0/1935483197 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef000ccb30 0x7fef000b5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.273+0000 7fef05843700 1 -- 172.21.15.37:0/1935483197 >> 172.21.15.37:0/1935483197 conn(0x7fef0006c0b0 msgr2=0x7fef000b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.273+0000 7fef05843700 1 -- 172.21.15.37:0/1935483197 shutdown_connections 2023-10-06T02:23:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.273+0000 7fef05843700 1 -- 172.21.15.37:0/1935483197 wait complete. 2023-10-06T02:23:53.286 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:23:53.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.407+0000 7f5f89bed700 1 Processor -- start 2023-10-06T02:23:53.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.407+0000 7f5f89bed700 1 -- start start 2023-10-06T02:23:53.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.407+0000 7f5f89bed700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5f84159790 0x7f5f840cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:53.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.407+0000 7f5f89bed700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f840b07a0 con 0x7f5f841593c0 2023-10-06T02:23:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.407+0000 7f5f89bed700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f840cd8a0 con 0x7f5f840b2a90 2023-10-06T02:23:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.407+0000 7f5f89bed700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f84159bd0 con 0x7f5f84159790 2023-10-06T02:23:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.408+0000 7f5f837fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5f841593c0 0x7f5f840b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46004/0 (socket says 172.21.15.37:46004) 2023-10-06T02:23:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.408+0000 7f5f837fe700 1 -- 172.21.15.37:0/1762981039 learned_addr learned my addr 172.21.15.37:0/1762981039 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.408+0000 7f5f83fff700 1 --2- 172.21.15.37:0/1762981039 >> v2:172.21.15.37:3300/0 conn(0x7f5f84159790 0x7f5f840cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.408+0000 7f5f827fc700 1 -- 172.21.15.37:0/1762981039 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2087734040 0 0) 0x7f5f840b07a0 con 0x7f5f841593c0 2023-10-06T02:23:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.408+0000 7f5f827fc700 1 -- 172.21.15.37:0/1762981039 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f6c003570 con 0x7f5f841593c0 2023-10-06T02:23:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.408+0000 7f5f83fff700 1 -- 172.21.15.37:0/1762981039 >> v1:172.21.15.191:6789/0 conn(0x7f5f840b2a90 legacy=0x7f5f840ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.408+0000 7f5f83fff700 1 -- 172.21.15.37:0/1762981039 >> v1:172.21.15.37:6789/0 conn(0x7f5f841593c0 legacy=0x7f5f840b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.408+0000 7f5f83fff700 1 -- 172.21.15.37:0/1762981039 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f840afe70 con 0x7f5f84159790 2023-10-06T02:23:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.408+0000 7f5f83fff700 1 --2- 172.21.15.37:0/1762981039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f84159790 0x7f5f840cd240 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009e60 tx=0x7f5f7c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c906e59ca380d36e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.408+0000 7f5f827fc700 1 -- 172.21.15.37:0/1762981039 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c00e070 con 0x7f5f84159790 2023-10-06T02:23:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.408+0000 7f5f827fc700 1 -- 172.21.15.37:0/1762981039 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c00bb60 con 0x7f5f84159790 2023-10-06T02:23:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.408+0000 7f5f827fc700 1 -- 172.21.15.37:0/1762981039 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c012430 con 0x7f5f84159790 2023-10-06T02:23:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.409+0000 7f5f89bed700 1 -- 172.21.15.37:0/1762981039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f84159790 msgr2=0x7f5f840cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.409+0000 7f5f89bed700 1 --2- 172.21.15.37:0/1762981039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f84159790 0x7f5f840cd240 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009e60 tx=0x7f5f7c009780 comp rx=0 tx=0).stop 2023-10-06T02:23:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.409+0000 7f5f89bed700 1 -- 172.21.15.37:0/1762981039 shutdown_connections 2023-10-06T02:23:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.409+0000 7f5f89bed700 1 --2- 172.21.15.37:0/1762981039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f84159790 0x7f5f840cd240 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.409+0000 7f5f89bed700 1 -- 172.21.15.37:0/1762981039 >> 172.21.15.37:0/1762981039 conn(0x7f5f8406c0b0 msgr2=0x7f5f8406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.409+0000 7f5f89bed700 1 -- 172.21.15.37:0/1762981039 shutdown_connections 2023-10-06T02:23:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.409+0000 7f5f89bed700 1 -- 172.21.15.37:0/1762981039 wait complete. 2023-10-06T02:23:53.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.410+0000 7f5f89bed700 1 Processor -- start 2023-10-06T02:23:53.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.410+0000 7f5f89bed700 1 -- start start 2023-10-06T02:23:53.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.411+0000 7f5f89bed700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f840b2a90 0x7f5f8416ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:53.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.411+0000 7f5f89bed700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f841593c0 0x7f5f8416b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:53.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.411+0000 7f5f89bed700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f84159790 0x7f5f8415c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:53.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.411+0000 7f5f89bed700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8415a6e0 con 0x7f5f84159790 2023-10-06T02:23:53.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.411+0000 7f5f89bed700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8416b040 con 0x7f5f840b2a90 2023-10-06T02:23:53.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.411+0000 7f5f89bed700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8416b2a0 con 0x7f5f841593c0 2023-10-06T02:23:53.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.411+0000 7f5f83fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f84159790 0x7f5f8415c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:53.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.411+0000 7f5f83fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f84159790 0x7f5f8415c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43870/0 (socket says 172.21.15.37:43870) 2023-10-06T02:23:53.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.411+0000 7f5f83fff700 1 -- 172.21.15.37:0/1568765746 learned_addr learned my addr 172.21.15.37:0/1568765746 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:53.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.411+0000 7f5f837fe700 1 --2- 172.21.15.37:0/1568765746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f840b2a90 0x7f5f8416ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:53.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.411+0000 7f5f82ffd700 1 --2- 172.21.15.37:0/1568765746 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f841593c0 0x7f5f8416b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:53.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.411+0000 7f5f83fff700 1 -- 172.21.15.37:0/1568765746 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f841593c0 msgr2=0x7f5f8416b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:53.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.411+0000 7f5f83fff700 1 --2- 172.21.15.37:0/1568765746 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f841593c0 0x7f5f8416b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.411+0000 7f5f83fff700 1 -- 172.21.15.37:0/1568765746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f840b2a90 msgr2=0x7f5f8416ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:53.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.411+0000 7f5f83fff700 1 --2- 172.21.15.37:0/1568765746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f840b2a90 0x7f5f8416ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.411+0000 7f5f83fff700 1 -- 172.21.15.37:0/1568765746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c009a20 con 0x7f5f84159790 2023-10-06T02:23:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.412+0000 7f5f83fff700 1 --2- 172.21.15.37:0/1568765746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f84159790 0x7f5f8415c340 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5f840894a0 tx=0x7f5f7c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.412+0000 7f5f6b7fe700 1 -- 172.21.15.37:0/1568765746 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c012e50 con 0x7f5f84159790 2023-10-06T02:23:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.412+0000 7f5f6b7fe700 1 -- 172.21.15.37:0/1568765746 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c01e630 con 0x7f5f84159790 2023-10-06T02:23:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.412+0000 7f5f89bed700 1 -- 172.21.15.37:0/1568765746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f84159db0 con 0x7f5f84159790 2023-10-06T02:23:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.412+0000 7f5f6b7fe700 1 -- 172.21.15.37:0/1568765746 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c01e9f0 con 0x7f5f84159790 2023-10-06T02:23:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.412+0000 7f5f89bed700 1 -- 172.21.15.37:0/1568765746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8415a370 con 0x7f5f84159790 2023-10-06T02:23:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.413+0000 7f5f89bed700 1 -- 172.21.15.37:0/1568765746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8415a890 con 0x7f5f84159790 2023-10-06T02:23:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.413+0000 7f5f6b7fe700 1 -- 172.21.15.37:0/1568765746 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f7c024070 con 0x7f5f84159790 2023-10-06T02:23:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.414+0000 7f5f6b7fe700 1 --2- 172.21.15.37:0/1568765746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5f70066f30 0x7f5f700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.414+0000 7f5f6b7fe700 1 -- 172.21.15.37:0/1568765746 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5f7c086f10 con 0x7f5f84159790 2023-10-06T02:23:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.414+0000 7f5f837fe700 1 --2- 172.21.15.37:0/1568765746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5f70066f30 0x7f5f700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.414+0000 7f5f837fe700 1 --2- 172.21.15.37:0/1568765746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5f70066f30 0x7f5f700693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5f740058d0 tx=0x7f5f74009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:53.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.418+0000 7f5f6b7fe700 1 -- 172.21.15.37:0/1568765746 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f8415a890 con 0x7f5f84159790 2023-10-06T02:23:53.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.610+0000 7f5f89bed700 1 -- 172.21.15.37:0/1568765746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f8415cf50 con 0x7f5f84159790 2023-10-06T02:23:53.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.611+0000 7f5f6b7fe700 1 -- 172.21.15.37:0/1568765746 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f7c054020 con 0x7f5f84159790 2023-10-06T02:23:53.613 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T02:23:53.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.613+0000 7f5f89bed700 1 -- 172.21.15.37:0/1568765746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5f70066f30 msgr2=0x7f5f700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:53.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.613+0000 7f5f89bed700 1 --2- 172.21.15.37:0/1568765746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5f70066f30 0x7f5f700693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5f740058d0 tx=0x7f5f74009040 comp rx=0 tx=0).stop 2023-10-06T02:23:53.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.613+0000 7f5f89bed700 1 -- 172.21.15.37:0/1568765746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f84159790 msgr2=0x7f5f8415c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:53.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.613+0000 7f5f89bed700 1 --2- 172.21.15.37:0/1568765746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f84159790 0x7f5f8415c340 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5f840894a0 tx=0x7f5f7c019000 comp rx=0 tx=0).stop 2023-10-06T02:23:53.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.613+0000 7f5f89bed700 1 -- 172.21.15.37:0/1568765746 shutdown_connections 2023-10-06T02:23:53.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.613+0000 7f5f89bed700 1 --2- 172.21.15.37:0/1568765746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f84159790 0x7f5f8415c340 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.613+0000 7f5f89bed700 1 --2- 172.21.15.37:0/1568765746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5f70066f30 0x7f5f700693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.613+0000 7f5f89bed700 1 --2- 172.21.15.37:0/1568765746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f840b2a90 0x7f5f8416ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.613+0000 7f5f89bed700 1 --2- 172.21.15.37:0/1568765746 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f841593c0 0x7f5f8416b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.613+0000 7f5f89bed700 1 -- 172.21.15.37:0/1568765746 >> 172.21.15.37:0/1568765746 conn(0x7f5f8406c0b0 msgr2=0x7f5f8406d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:53.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.613+0000 7f5f89bed700 1 -- 172.21.15.37:0/1568765746 shutdown_connections 2023-10-06T02:23:53.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.613+0000 7f5f89bed700 1 -- 172.21.15.37:0/1568765746 wait complete. 2023-10-06T02:23:53.626 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:23:53.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.744+0000 7f22d27bb700 1 Processor -- start 2023-10-06T02:23:53.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.744+0000 7f22d27bb700 1 -- start start 2023-10-06T02:23:53.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.745+0000 7f22d27bb700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22cc0b3fb0 0x7f22cc067a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.745+0000 7f22d27bb700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f22cc15be40 0x7f22cc067f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.745+0000 7f22d27bb700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc158db0 con 0x7f22cc0b3be0 2023-10-06T02:23:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.745+0000 7f22d27bb700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc1582f0 con 0x7f22cc15be40 2023-10-06T02:23:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.745+0000 7f22d27bb700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0cc2f0 con 0x7f22cc0b3fb0 2023-10-06T02:23:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.745+0000 7f22cbfff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f22cc0b3be0 0x7f22cc157be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46006/0 (socket says 172.21.15.37:46006) 2023-10-06T02:23:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.745+0000 7f22cbfff700 1 -- 172.21.15.37:0/2874012210 learned_addr learned my addr 172.21.15.37:0/2874012210 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.745+0000 7f22cb7fe700 1 --2- 172.21.15.37:0/2874012210 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22cc0b3fb0 0x7f22cc067a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.745+0000 7f22d0d58700 1 --2- 172.21.15.37:0/2874012210 >> v2:172.21.15.191:3300/0 conn(0x7f22cc15be40 0x7f22cc067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.745+0000 7f22caffd700 1 -- 172.21.15.37:0/2874012210 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3553491569 0 0) 0x7f22cc158db0 con 0x7f22cc0b3be0 2023-10-06T02:23:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22caffd700 1 -- 172.21.15.37:0/2874012210 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22b8003570 con 0x7f22cc0b3be0 2023-10-06T02:23:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22caffd700 1 -- 172.21.15.37:0/2874012210 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1884288976 0 0) 0x7f22b8003570 con 0x7f22cc0b3be0 2023-10-06T02:23:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22caffd700 1 -- 172.21.15.37:0/2874012210 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22cc0b3fb0 msgr2=0x7f22cc067a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22caffd700 1 --2- 172.21.15.37:0/2874012210 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22cc0b3fb0 0x7f22cc067a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22caffd700 1 -- 172.21.15.37:0/2874012210 >> v2:172.21.15.191:3300/0 conn(0x7f22cc15be40 msgr2=0x7f22cc067f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22caffd700 1 --2- 172.21.15.37:0/2874012210 >> v2:172.21.15.191:3300/0 conn(0x7f22cc15be40 0x7f22cc067f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22caffd700 1 -- 172.21.15.37:0/2874012210 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc0cd790 con 0x7f22cc0b3be0 2023-10-06T02:23:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22caffd700 1 -- 172.21.15.37:0/2874012210 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f22b40015f0 con 0x7f22cc0b3be0 2023-10-06T02:23:53.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22caffd700 1 -- 172.21.15.37:0/2874012210 >> v1:172.21.15.37:6789/0 conn(0x7f22cc0b3be0 legacy=0x7f22cc157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:53.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22caffd700 1 --2- 172.21.15.37:0/2874012210 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22b8003a60 0x7f22b8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:53.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22caffd700 1 --2- 172.21.15.37:0/2874012210 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22cc0b3fb0 0x7f22b8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:53.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22caffd700 1 --2- 172.21.15.37:0/2874012210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b8004d50 0x7f22b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:53.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22caffd700 1 -- 172.21.15.37:0/2874012210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc1582f0 con 0x7f22b8004d50 2023-10-06T02:23:53.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22caffd700 1 -- 172.21.15.37:0/2874012210 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0cc2f0 con 0x7f22b8003a60 2023-10-06T02:23:53.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22caffd700 1 -- 172.21.15.37:0/2874012210 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b800ba60 con 0x7f22cc0b3fb0 2023-10-06T02:23:53.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22d0d58700 1 --2- 172.21.15.37:0/2874012210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b8004d50 0x7f22b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:53.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22cbfff700 1 --2- 172.21.15.37:0/2874012210 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22b8003a60 0x7f22b8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:53.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22cb7fe700 1 --2- 172.21.15.37:0/2874012210 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22cc0b3fb0 0x7f22b8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:53.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22d0d58700 1 -- 172.21.15.37:0/2874012210 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22cc0b3fb0 msgr2=0x7f22b8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:53.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22d0d58700 1 --2- 172.21.15.37:0/2874012210 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22cc0b3fb0 0x7f22b8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22d0d58700 1 -- 172.21.15.37:0/2874012210 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22b8003a60 msgr2=0x7f22b8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:53.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22d0d58700 1 --2- 172.21.15.37:0/2874012210 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22b8003a60 0x7f22b8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.746+0000 7f22d0d58700 1 -- 172.21.15.37:0/2874012210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b8003570 con 0x7f22b8004d50 2023-10-06T02:23:53.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.747+0000 7f22d0d58700 1 --2- 172.21.15.37:0/2874012210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b8004d50 0x7f22b80051c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f22c400e210 tx=0x7f22c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685d57a7eed801dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:53.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.747+0000 7f22caffd700 1 -- 172.21.15.37:0/2874012210 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c400ea60 con 0x7f22b8004d50 2023-10-06T02:23:53.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.747+0000 7f22caffd700 1 -- 172.21.15.37:0/2874012210 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c400f040 con 0x7f22b8004d50 2023-10-06T02:23:53.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.747+0000 7f22caffd700 1 -- 172.21.15.37:0/2874012210 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c400ee10 con 0x7f22b8004d50 2023-10-06T02:23:53.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.747+0000 7f22d27bb700 1 -- 172.21.15.37:0/2874012210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b8004d50 msgr2=0x7f22b80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:53.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.747+0000 7f22d27bb700 1 --2- 172.21.15.37:0/2874012210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b8004d50 0x7f22b80051c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f22c400e210 tx=0x7f22c400b040 comp rx=0 tx=0).stop 2023-10-06T02:23:53.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.747+0000 7f22d0d58700 1 -- 172.21.15.37:0/2874012210 reap_dead start 2023-10-06T02:23:53.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.747+0000 7f22d27bb700 1 -- 172.21.15.37:0/2874012210 shutdown_connections 2023-10-06T02:23:53.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.747+0000 7f22d27bb700 1 -- 172.21.15.37:0/2874012210 >> 172.21.15.37:0/2874012210 conn(0x7f22cc0ce330 msgr2=0x7f22cc0ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:53.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.747+0000 7f22d27bb700 1 -- 172.21.15.37:0/2874012210 shutdown_connections 2023-10-06T02:23:53.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.747+0000 7f22d27bb700 1 -- 172.21.15.37:0/2874012210 wait complete. 2023-10-06T02:23:53.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.748+0000 7f22d27bb700 1 Processor -- start 2023-10-06T02:23:53.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.748+0000 7f22d27bb700 1 -- start start 2023-10-06T02:23:53.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.749+0000 7f22d27bb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b8004d50 0x7f22cc0ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:53.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.749+0000 7f22d27bb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22cc16aaf0 0x7f22cc155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:53.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.749+0000 7f22d27bb700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22cc0a5490 0x7f22cc0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:53.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.749+0000 7f22d27bb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0b2d70 con 0x7f22b8004d50 2023-10-06T02:23:53.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.749+0000 7f22d27bb700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0a5e40 con 0x7f22cc16aaf0 2023-10-06T02:23:53.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.749+0000 7f22d27bb700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc155680 con 0x7f22cc0a5490 2023-10-06T02:23:53.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.749+0000 7f22cbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b8004d50 0x7f22cc0ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:53.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.749+0000 7f22cbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b8004d50 0x7f22cc0ad1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43890/0 (socket says 172.21.15.37:43890) 2023-10-06T02:23:53.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.749+0000 7f22cbfff700 1 -- 172.21.15.37:0/3328821999 learned_addr learned my addr 172.21.15.37:0/3328821999 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:53.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.749+0000 7f22cb7fe700 1 --2- 172.21.15.37:0/3328821999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22cc16aaf0 0x7f22cc155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:53.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.749+0000 7f22d0d58700 1 --2- 172.21.15.37:0/3328821999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22cc0a5490 0x7f22cc0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:53.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.749+0000 7f22cbfff700 1 -- 172.21.15.37:0/3328821999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22cc0a5490 msgr2=0x7f22cc0a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:53.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.749+0000 7f22cbfff700 1 --2- 172.21.15.37:0/3328821999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22cc0a5490 0x7f22cc0a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.749+0000 7f22cbfff700 1 -- 172.21.15.37:0/3328821999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22cc16aaf0 msgr2=0x7f22cc155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:53.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.750+0000 7f22cbfff700 1 --2- 172.21.15.37:0/3328821999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22cc16aaf0 0x7f22cc155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:53.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.750+0000 7f22cbfff700 1 -- 172.21.15.37:0/3328821999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc167e80 con 0x7f22b8004d50 2023-10-06T02:23:53.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.750+0000 7f22cb7fe700 1 --2- 172.21.15.37:0/3328821999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22cc16aaf0 0x7f22cc155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:53.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.750+0000 7f22cbfff700 1 --2- 172.21.15.37:0/3328821999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b8004d50 0x7f22cc0ad1c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f22b400fc60 tx=0x7f22b4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:53.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.750+0000 7f22c3fff700 1 -- 172.21.15.37:0/3328821999 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b400fee0 con 0x7f22b8004d50 2023-10-06T02:23:53.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.750+0000 7f22c3fff700 1 -- 172.21.15.37:0/3328821999 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b400db80 con 0x7f22b8004d50 2023-10-06T02:23:53.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.750+0000 7f22d27bb700 1 -- 172.21.15.37:0/3328821999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22cc16af60 con 0x7f22b8004d50 2023-10-06T02:23:53.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.750+0000 7f22c3fff700 1 -- 172.21.15.37:0/3328821999 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b40070d0 con 0x7f22b8004d50 2023-10-06T02:23:53.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.750+0000 7f22d27bb700 1 -- 172.21.15.37:0/3328821999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc0b2a90 con 0x7f22b8004d50 2023-10-06T02:23:53.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.751+0000 7f22d27bb700 1 -- 172.21.15.37:0/3328821999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc167ce0 con 0x7f22b8004d50 2023-10-06T02:23:53.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.751+0000 7f22c3fff700 1 -- 172.21.15.37:0/3328821999 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f22b40074c0 con 0x7f22b8004d50 2023-10-06T02:23:53.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.752+0000 7f22c3fff700 1 --2- 172.21.15.37:0/3328821999 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f22ac066f30 0x7f22ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:53.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.752+0000 7f22c3fff700 1 -- 172.21.15.37:0/3328821999 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f22b4084ac0 con 0x7f22b8004d50 2023-10-06T02:23:53.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.752+0000 7f22cb7fe700 1 --2- 172.21.15.37:0/3328821999 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f22ac066f30 0x7f22ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:53.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.752+0000 7f22cb7fe700 1 --2- 172.21.15.37:0/3328821999 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f22ac066f30 0x7f22ac0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f22cc156d70 tx=0x7f22bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:53.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.756+0000 7f22c3fff700 1 -- 172.21.15.37:0/3328821999 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22cc167ce0 con 0x7f22b8004d50 2023-10-06T02:23:53.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.995+0000 7f22d27bb700 1 -- 172.21.15.37:0/3328821999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22cc167ce0 con 0x7f22b8004d50 2023-10-06T02:23:53.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.996+0000 7f22c3fff700 1 -- 172.21.15.37:0/3328821999 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f22cc167ce0 con 0x7f22b8004d50 2023-10-06T02:23:53.998 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:53.998 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/651376696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":651376696},{"type":"v1","addr":"172.21.15.191:6837","nonce":651376696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1345849362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1345849362},{"type":"v1","addr":"172.21.15.37:6834","nonce":1345849362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/434738958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":434738958},{"type":"v1","addr":"172.21.15.37:6835","nonce":434738958}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:15.298562+0000","modified":"2023-10-06T02:23:18.911651+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6835/1723334905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1723334905},{"type":"v1","addr":"172.21.15.191:6835","nonce":1723334905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:23:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.998+0000 7f22d27bb700 1 -- 172.21.15.37:0/3328821999 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f22ac066f30 msgr2=0x7f22ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.998+0000 7f22d27bb700 1 --2- 172.21.15.37:0/3328821999 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f22ac066f30 0x7f22ac0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f22cc156d70 tx=0x7f22bc008040 comp rx=0 tx=0).stop 2023-10-06T02:23:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.998+0000 7f22d27bb700 1 -- 172.21.15.37:0/3328821999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b8004d50 msgr2=0x7f22cc0ad1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.998+0000 7f22d27bb700 1 --2- 172.21.15.37:0/3328821999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b8004d50 0x7f22cc0ad1c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f22b400fc60 tx=0x7f22b4009040 comp rx=0 tx=0).stop 2023-10-06T02:23:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.998+0000 7f22d27bb700 1 -- 172.21.15.37:0/3328821999 shutdown_connections 2023-10-06T02:23:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.998+0000 7f22d27bb700 1 --2- 172.21.15.37:0/3328821999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22cc0a5490 0x7f22cc0a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.998+0000 7f22d27bb700 1 --2- 172.21.15.37:0/3328821999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b8004d50 0x7f22cc0ad1c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.998+0000 7f22d27bb700 1 --2- 172.21.15.37:0/3328821999 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f22ac066f30 0x7f22ac0693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.998+0000 7f22d27bb700 1 --2- 172.21.15.37:0/3328821999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22cc16aaf0 0x7f22cc155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.998+0000 7f22d27bb700 1 -- 172.21.15.37:0/3328821999 >> 172.21.15.37:0/3328821999 conn(0x7f22cc0ce330 msgr2=0x7f22cc068f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.998+0000 7f22d27bb700 1 -- 172.21.15.37:0/3328821999 shutdown_connections 2023-10-06T02:23:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:53.998+0000 7f22d27bb700 1 -- 172.21.15.37:0/3328821999 wait complete. 2023-10-06T02:23:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-10-06T02:23:54.012 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:54.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.130+0000 7f0a2cc27700 1 Processor -- start 2023-10-06T02:23:54.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.130+0000 7f0a2cc27700 1 -- start start 2023-10-06T02:23:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.131+0000 7f0a2cc27700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a28159760 0x7f0a2815d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.131+0000 7f0a2cc27700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0a2815dd20 0x7f0a280cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.131+0000 7f0a2cc27700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2815e1a0 con 0x7f0a2815d8d0 2023-10-06T02:23:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.131+0000 7f0a2cc27700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a280cc2d0 con 0x7f0a2815dd20 2023-10-06T02:23:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.131+0000 7f0a2cc27700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a280cb650 con 0x7f0a28159760 2023-10-06T02:23:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.131+0000 7f0a25d9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0a2815d8d0 0x7f0a280c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46016/0 (socket says 172.21.15.37:46016) 2023-10-06T02:23:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.131+0000 7f0a25d9b700 1 -- 172.21.15.37:0/968020250 learned_addr learned my addr 172.21.15.37:0/968020250 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.131+0000 7f0a2659c700 1 --2- 172.21.15.37:0/968020250 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a28159760 0x7f0a2815d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.131+0000 7f0a26d9d700 1 --2- 172.21.15.37:0/968020250 >> v2:172.21.15.191:3300/0 conn(0x7f0a2815dd20 0x7f0a280cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.131+0000 7f0a2559a700 1 -- 172.21.15.37:0/968020250 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265023302 0 0) 0x7f0a2815e1a0 con 0x7f0a2815d8d0 2023-10-06T02:23:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.131+0000 7f0a2559a700 1 -- 172.21.15.37:0/968020250 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a14003570 con 0x7f0a2815d8d0 2023-10-06T02:23:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.131+0000 7f0a26d9d700 1 -- 172.21.15.37:0/968020250 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a28159760 msgr2=0x7f0a2815d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.131+0000 7f0a26d9d700 1 --2- 172.21.15.37:0/968020250 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a28159760 0x7f0a2815d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.131+0000 7f0a26d9d700 1 -- 172.21.15.37:0/968020250 >> v1:172.21.15.37:6789/0 conn(0x7f0a2815d8d0 legacy=0x7f0a280c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.131+0000 7f0a26d9d700 1 -- 172.21.15.37:0/968020250 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a280cb930 con 0x7f0a2815dd20 2023-10-06T02:23:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.131+0000 7f0a2659c700 1 --2- 172.21.15.37:0/968020250 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a28159760 0x7f0a2815d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.132+0000 7f0a26d9d700 1 --2- 172.21.15.37:0/968020250 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a2815dd20 0x7f0a280cfc00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009e60 tx=0x7f0a18009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71f5429971fd974 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.132+0000 7f0a2559a700 1 -- 172.21.15.37:0/968020250 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1800e070 con 0x7f0a2815dd20 2023-10-06T02:23:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.132+0000 7f0a2559a700 1 -- 172.21.15.37:0/968020250 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1800bb40 con 0x7f0a2815dd20 2023-10-06T02:23:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.132+0000 7f0a2559a700 1 -- 172.21.15.37:0/968020250 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18012430 con 0x7f0a2815dd20 2023-10-06T02:23:54.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.132+0000 7f0a2cc27700 1 -- 172.21.15.37:0/968020250 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a2815dd20 msgr2=0x7f0a280cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.132+0000 7f0a2cc27700 1 --2- 172.21.15.37:0/968020250 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a2815dd20 0x7f0a280cfc00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009e60 tx=0x7f0a18009780 comp rx=0 tx=0).stop 2023-10-06T02:23:54.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.132+0000 7f0a2cc27700 1 -- 172.21.15.37:0/968020250 shutdown_connections 2023-10-06T02:23:54.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.132+0000 7f0a2cc27700 1 --2- 172.21.15.37:0/968020250 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a2815dd20 0x7f0a280cfc00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.132+0000 7f0a2cc27700 1 --2- 172.21.15.37:0/968020250 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a28159760 0x7f0a2815d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.132+0000 7f0a2cc27700 1 -- 172.21.15.37:0/968020250 >> 172.21.15.37:0/968020250 conn(0x7f0a2806c890 msgr2=0x7f0a280d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:54.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.132+0000 7f0a2cc27700 1 -- 172.21.15.37:0/968020250 shutdown_connections 2023-10-06T02:23:54.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.132+0000 7f0a2cc27700 1 -- 172.21.15.37:0/968020250 wait complete. 2023-10-06T02:23:54.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.133+0000 7f0a2cc27700 1 Processor -- start 2023-10-06T02:23:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.133+0000 7f0a2cc27700 1 -- start start 2023-10-06T02:23:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.134+0000 7f0a2cc27700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a28159760 0x7f0a280b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.134+0000 7f0a2cc27700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a2815d8d0 0x7f0a280b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.134+0000 7f0a2cc27700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a2815dd20 0x7f0a281522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.134+0000 7f0a2cc27700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a280b46c0 con 0x7f0a2815d8d0 2023-10-06T02:23:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.134+0000 7f0a2cc27700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a280b5d20 con 0x7f0a28159760 2023-10-06T02:23:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.134+0000 7f0a2cc27700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a280b5110 con 0x7f0a2815dd20 2023-10-06T02:23:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.134+0000 7f0a25d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a2815d8d0 0x7f0a280b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.134+0000 7f0a25d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a2815d8d0 0x7f0a280b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43904/0 (socket says 172.21.15.37:43904) 2023-10-06T02:23:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.134+0000 7f0a25d9b700 1 -- 172.21.15.37:0/722657006 learned_addr learned my addr 172.21.15.37:0/722657006 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.134+0000 7f0a2659c700 1 --2- 172.21.15.37:0/722657006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a28159760 0x7f0a280b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.134+0000 7f0a26d9d700 1 --2- 172.21.15.37:0/722657006 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a2815dd20 0x7f0a281522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.135+0000 7f0a25d9b700 1 -- 172.21.15.37:0/722657006 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a2815dd20 msgr2=0x7f0a281522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.135+0000 7f0a25d9b700 1 --2- 172.21.15.37:0/722657006 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a2815dd20 0x7f0a281522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.135+0000 7f0a25d9b700 1 -- 172.21.15.37:0/722657006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a28159760 msgr2=0x7f0a280b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.135+0000 7f0a25d9b700 1 --2- 172.21.15.37:0/722657006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a28159760 0x7f0a280b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.135+0000 7f0a25d9b700 1 -- 172.21.15.37:0/722657006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a20009420 con 0x7f0a2815d8d0 2023-10-06T02:23:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.135+0000 7f0a25d9b700 1 --2- 172.21.15.37:0/722657006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a2815d8d0 0x7f0a280b4180 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000c7c0 tx=0x7f0a10007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:54.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.135+0000 7f0a1e7fc700 1 -- 172.21.15.37:0/722657006 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a10005b30 con 0x7f0a2815d8d0 2023-10-06T02:23:54.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.135+0000 7f0a1e7fc700 1 -- 172.21.15.37:0/722657006 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a10005c90 con 0x7f0a2815d8d0 2023-10-06T02:23:54.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.135+0000 7f0a2cc27700 1 -- 172.21.15.37:0/722657006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a18009a20 con 0x7f0a2815d8d0 2023-10-06T02:23:54.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.135+0000 7f0a1e7fc700 1 -- 172.21.15.37:0/722657006 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a10007320 con 0x7f0a2815d8d0 2023-10-06T02:23:54.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.135+0000 7f0a2cc27700 1 -- 172.21.15.37:0/722657006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a280b56d0 con 0x7f0a2815d8d0 2023-10-06T02:23:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.136+0000 7f0a2cc27700 1 -- 172.21.15.37:0/722657006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2806fbf0 con 0x7f0a2815d8d0 2023-10-06T02:23:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.136+0000 7f0a1e7fc700 1 -- 172.21.15.37:0/722657006 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a1001b3b0 con 0x7f0a2815d8d0 2023-10-06T02:23:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.137+0000 7f0a1e7fc700 1 --2- 172.21.15.37:0/722657006 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0a08066f30 0x7f0a080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.137+0000 7f0a1e7fc700 1 -- 172.21.15.37:0/722657006 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0a10083c00 con 0x7f0a2815d8d0 2023-10-06T02:23:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.137+0000 7f0a2659c700 1 --2- 172.21.15.37:0/722657006 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0a08066f30 0x7f0a080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.138+0000 7f0a2659c700 1 --2- 172.21.15.37:0/722657006 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0a08066f30 0x7f0a080693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009ea0 tx=0x7f0a200091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.141+0000 7f0a1e7fc700 1 -- 172.21.15.37:0/722657006 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a1008a080 con 0x7f0a2815d8d0 2023-10-06T02:23:54.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.336+0000 7f0a2cc27700 1 -- 172.21.15.37:0/722657006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a280b5e60 con 0x7f0a2815d8d0 2023-10-06T02:23:54.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.337+0000 7f0a1e7fc700 1 -- 172.21.15.37:0/722657006 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f0a10017020 con 0x7f0a2815d8d0 2023-10-06T02:23:54.338 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:54.338 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:23:16.897625+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:13.004596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:14.268809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.339+0000 7f0a2cc27700 1 -- 172.21.15.37:0/722657006 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0a08066f30 msgr2=0x7f0a080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.339+0000 7f0a2cc27700 1 --2- 172.21.15.37:0/722657006 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0a08066f30 0x7f0a080693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009ea0 tx=0x7f0a200091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.339+0000 7f0a2cc27700 1 -- 172.21.15.37:0/722657006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a2815d8d0 msgr2=0x7f0a280b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.339+0000 7f0a2cc27700 1 --2- 172.21.15.37:0/722657006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a2815d8d0 0x7f0a280b4180 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000c7c0 tx=0x7f0a10007e00 comp rx=0 tx=0).stop 2023-10-06T02:23:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.339+0000 7f0a2cc27700 1 -- 172.21.15.37:0/722657006 shutdown_connections 2023-10-06T02:23:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.339+0000 7f0a2cc27700 1 --2- 172.21.15.37:0/722657006 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a2815dd20 0x7f0a281522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.339+0000 7f0a2cc27700 1 --2- 172.21.15.37:0/722657006 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0a08066f30 0x7f0a080693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.339+0000 7f0a2cc27700 1 --2- 172.21.15.37:0/722657006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a28159760 0x7f0a280b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.339+0000 7f0a2cc27700 1 --2- 172.21.15.37:0/722657006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a2815d8d0 0x7f0a280b4180 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.339+0000 7f0a2cc27700 1 -- 172.21.15.37:0/722657006 >> 172.21.15.37:0/722657006 conn(0x7f0a2806c890 msgr2=0x7f0a28152d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.339+0000 7f0a2cc27700 1 -- 172.21.15.37:0/722657006 shutdown_connections 2023-10-06T02:23:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.339+0000 7f0a2cc27700 1 -- 172.21.15.37:0/722657006 wait complete. 2023-10-06T02:23:54.352 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:23:54.353 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:23:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.471+0000 7f2fce2c4700 1 Processor -- start 2023-10-06T02:23:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.471+0000 7f2fce2c4700 1 -- start start 2023-10-06T02:23:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.472+0000 7f2fce2c4700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2fc81596d0 0x7f2fc80b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.472+0000 7f2fce2c4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2fc8159aa0 0x7f2fc80cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.472+0000 7f2fce2c4700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc80c5300 con 0x7f2fc80b3840 2023-10-06T02:23:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.472+0000 7f2fce2c4700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc80c6160 con 0x7f2fc81596d0 2023-10-06T02:23:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.472+0000 7f2fce2c4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80c5550 con 0x7f2fc8159aa0 2023-10-06T02:23:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.472+0000 7f2fc77fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2fc80b3840 0x7f2fc80c65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46020/0 (socket says 172.21.15.37:46020) 2023-10-06T02:23:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.472+0000 7f2fc77fe700 1 -- 172.21.15.37:0/735314290 learned_addr learned my addr 172.21.15.37:0/735314290 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.472+0000 7f2fcc861700 1 --2- 172.21.15.37:0/735314290 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2fc8159aa0 0x7f2fc80cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.472+0000 7f2fc7fff700 1 --2- 172.21.15.37:0/735314290 >> v2:172.21.15.191:3300/0 conn(0x7f2fc81596d0 0x7f2fc80b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.472+0000 7f2fc6ffd700 1 -- 172.21.15.37:0/735314290 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988338228 0 0) 0x7f2fc80c5300 con 0x7f2fc80b3840 2023-10-06T02:23:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.472+0000 7f2fc6ffd700 1 -- 172.21.15.37:0/735314290 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fb4003570 con 0x7f2fc80b3840 2023-10-06T02:23:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.472+0000 7f2fc6ffd700 1 -- 172.21.15.37:0/735314290 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2894916186 0 0) 0x7f2fb4003570 con 0x7f2fc80b3840 2023-10-06T02:23:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.472+0000 7f2fcc861700 1 -- 172.21.15.37:0/735314290 >> v2:172.21.15.191:3300/0 conn(0x7f2fc81596d0 msgr2=0x7f2fc80b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.472+0000 7f2fcc861700 1 --2- 172.21.15.37:0/735314290 >> v2:172.21.15.191:3300/0 conn(0x7f2fc81596d0 0x7f2fc80b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.472+0000 7f2fcc861700 1 -- 172.21.15.37:0/735314290 >> v1:172.21.15.37:6789/0 conn(0x7f2fc80b3840 legacy=0x7f2fc80c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.472+0000 7f2fcc861700 1 -- 172.21.15.37:0/735314290 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc80c5830 con 0x7f2fc8159aa0 2023-10-06T02:23:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.472+0000 7f2fc7fff700 1 --2- 172.21.15.37:0/735314290 >> v2:172.21.15.191:3300/0 conn(0x7f2fc81596d0 0x7f2fc80b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.472+0000 7f2fcc861700 1 --2- 172.21.15.37:0/735314290 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2fc8159aa0 0x7f2fc80cf9f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0009e60 tx=0x7f2fc0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cdd1e063e48c31c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.473+0000 7f2fc6ffd700 1 -- 172.21.15.37:0/735314290 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000e070 con 0x7f2fc8159aa0 2023-10-06T02:23:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.473+0000 7f2fc6ffd700 1 -- 172.21.15.37:0/735314290 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc000b7a0 con 0x7f2fc8159aa0 2023-10-06T02:23:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.473+0000 7f2fc6ffd700 1 -- 172.21.15.37:0/735314290 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0001470 con 0x7f2fc8159aa0 2023-10-06T02:23:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.473+0000 7f2fce2c4700 1 -- 172.21.15.37:0/735314290 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2fc8159aa0 msgr2=0x7f2fc80cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.473+0000 7f2fce2c4700 1 --2- 172.21.15.37:0/735314290 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2fc8159aa0 0x7f2fc80cf9f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0009e60 tx=0x7f2fc0009780 comp rx=0 tx=0).stop 2023-10-06T02:23:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.473+0000 7f2fce2c4700 1 -- 172.21.15.37:0/735314290 shutdown_connections 2023-10-06T02:23:54.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.473+0000 7f2fce2c4700 1 --2- 172.21.15.37:0/735314290 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2fc8159aa0 0x7f2fc80cf9f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.473+0000 7f2fce2c4700 1 --2- 172.21.15.37:0/735314290 >> v2:172.21.15.191:3300/0 conn(0x7f2fc81596d0 0x7f2fc80b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.473+0000 7f2fce2c4700 1 -- 172.21.15.37:0/735314290 >> 172.21.15.37:0/735314290 conn(0x7f2fc806c890 msgr2=0x7f2fc80d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:54.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.473+0000 7f2fce2c4700 1 -- 172.21.15.37:0/735314290 shutdown_connections 2023-10-06T02:23:54.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.473+0000 7f2fce2c4700 1 -- 172.21.15.37:0/735314290 wait complete. 2023-10-06T02:23:54.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.474+0000 7f2fce2c4700 1 Processor -- start 2023-10-06T02:23:54.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.474+0000 7f2fce2c4700 1 -- start start 2023-10-06T02:23:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.475+0000 7f2fce2c4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fc80b3840 0x7f2fc8143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.475+0000 7f2fce2c4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2fc81596d0 0x7f2fc815d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.475+0000 7f2fce2c4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2fc8159aa0 0x7f2fc815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.475+0000 7f2fce2c4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc8169880 con 0x7f2fc80b3840 2023-10-06T02:23:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.475+0000 7f2fce2c4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc815a410 con 0x7f2fc81596d0 2023-10-06T02:23:54.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.475+0000 7f2fce2c4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc815a6f0 con 0x7f2fc8159aa0 2023-10-06T02:23:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.475+0000 7f2fc7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fc80b3840 0x7f2fc8143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.475+0000 7f2fc7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fc80b3840 0x7f2fc8143120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43914/0 (socket says 172.21.15.37:43914) 2023-10-06T02:23:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.475+0000 7f2fc7fff700 1 -- 172.21.15.37:0/401993719 learned_addr learned my addr 172.21.15.37:0/401993719 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.476+0000 7f2fc77fe700 1 --2- 172.21.15.37:0/401993719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2fc81596d0 0x7f2fc815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.476+0000 7f2fc7fff700 1 -- 172.21.15.37:0/401993719 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2fc8159aa0 msgr2=0x7f2fc815ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.476+0000 7f2fc7fff700 1 --2- 172.21.15.37:0/401993719 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2fc8159aa0 0x7f2fc815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.476+0000 7f2fc7fff700 1 -- 172.21.15.37:0/401993719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2fc81596d0 msgr2=0x7f2fc815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.476+0000 7f2fc7fff700 1 --2- 172.21.15.37:0/401993719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2fc81596d0 0x7f2fc815d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.476+0000 7f2fc7fff700 1 -- 172.21.15.37:0/401993719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb8009420 con 0x7f2fc80b3840 2023-10-06T02:23:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.476+0000 7f2fc7fff700 1 --2- 172.21.15.37:0/401993719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fc80b3840 0x7f2fc8143120 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800ec80 tx=0x7f2fb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.476+0000 7f2fbffff700 1 -- 172.21.15.37:0/401993719 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb800c9d0 con 0x7f2fc80b3840 2023-10-06T02:23:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.476+0000 7f2fbffff700 1 -- 172.21.15.37:0/401993719 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb800cb30 con 0x7f2fc80b3840 2023-10-06T02:23:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.476+0000 7f2fbffff700 1 -- 172.21.15.37:0/401993719 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb800ceb0 con 0x7f2fc80b3840 2023-10-06T02:23:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.476+0000 7f2fce2c4700 1 -- 172.21.15.37:0/401993719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc0009a20 con 0x7f2fc80b3840 2023-10-06T02:23:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.476+0000 7f2fce2c4700 1 -- 172.21.15.37:0/401993719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc815acb0 con 0x7f2fc80b3840 2023-10-06T02:23:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.477+0000 7f2fce2c4700 1 -- 172.21.15.37:0/401993719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc806fbf0 con 0x7f2fc80b3840 2023-10-06T02:23:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.477+0000 7f2fbffff700 1 -- 172.21.15.37:0/401993719 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fb8013680 con 0x7f2fc80b3840 2023-10-06T02:23:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.478+0000 7f2fbffff700 1 --2- 172.21.15.37:0/401993719 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2fa8066f30 0x7f2fa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.478+0000 7f2fbffff700 1 -- 172.21.15.37:0/401993719 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2fb8084b80 con 0x7f2fc80b3840 2023-10-06T02:23:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.478+0000 7f2fc77fe700 1 --2- 172.21.15.37:0/401993719 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2fa8066f30 0x7f2fa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.478+0000 7f2fc77fe700 1 --2- 172.21.15.37:0/401993719 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2fa8066f30 0x7f2fa80693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00011e0 tx=0x7f2fb0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:54.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.482+0000 7f2fbffff700 1 -- 172.21.15.37:0/401993719 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fb8051bf0 con 0x7f2fc80b3840 2023-10-06T02:23:54.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.723+0000 7f2fce2c4700 1 -- 172.21.15.37:0/401993719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fc80d13e0 con 0x7f2fc80b3840 2023-10-06T02:23:54.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.723+0000 7f2fbffff700 1 -- 172.21.15.37:0/401993719 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f2fb8055210 con 0x7f2fc80b3840 2023-10-06T02:23:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:54.725 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/651376696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":651376696},{"type":"v1","addr":"172.21.15.191:6837","nonce":651376696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1345849362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1345849362},{"type":"v1","addr":"172.21.15.37:6834","nonce":1345849362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/434738958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":434738958},{"type":"v1","addr":"172.21.15.37:6835","nonce":434738958}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:15.298562+0000","modified":"2023-10-06T02:23:18.911651+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6835/1723334905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1723334905},{"type":"v1","addr":"172.21.15.191:6835","nonce":1723334905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:23:54.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.725+0000 7f2fce2c4700 1 -- 172.21.15.37:0/401993719 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2fa8066f30 msgr2=0x7f2fa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.725+0000 7f2fce2c4700 1 --2- 172.21.15.37:0/401993719 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2fa8066f30 0x7f2fa80693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00011e0 tx=0x7f2fb0009040 comp rx=0 tx=0).stop 2023-10-06T02:23:54.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.725+0000 7f2fce2c4700 1 -- 172.21.15.37:0/401993719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fc80b3840 msgr2=0x7f2fc8143120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.725+0000 7f2fce2c4700 1 --2- 172.21.15.37:0/401993719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fc80b3840 0x7f2fc8143120 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800ec80 tx=0x7f2fb80091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.726+0000 7f2fce2c4700 1 -- 172.21.15.37:0/401993719 shutdown_connections 2023-10-06T02:23:54.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.726+0000 7f2fce2c4700 1 --2- 172.21.15.37:0/401993719 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2fc8159aa0 0x7f2fc815ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.726+0000 7f2fce2c4700 1 --2- 172.21.15.37:0/401993719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fc80b3840 0x7f2fc8143120 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.726+0000 7f2fce2c4700 1 --2- 172.21.15.37:0/401993719 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2fa8066f30 0x7f2fa80693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.726+0000 7f2fce2c4700 1 --2- 172.21.15.37:0/401993719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2fc81596d0 0x7f2fc815d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.726+0000 7f2fce2c4700 1 -- 172.21.15.37:0/401993719 >> 172.21.15.37:0/401993719 conn(0x7f2fc806c890 msgr2=0x7f2fc806e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:54.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.726+0000 7f2fce2c4700 1 -- 172.21.15.37:0/401993719 shutdown_connections 2023-10-06T02:23:54.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.726+0000 7f2fce2c4700 1 -- 172.21.15.37:0/401993719 wait complete. 2023-10-06T02:23:54.729 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-10-06T02:23:54.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:23:54.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.857+0000 7f8289891700 1 Processor -- start 2023-10-06T02:23:54.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.857+0000 7f8289891700 1 -- start start 2023-10-06T02:23:54.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.858+0000 7f8289891700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f82840b0620 0x7f8284159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.858+0000 7f8289891700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82840b2270 0x7f828415db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.858+0000 7f8289891700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82840cb200 con 0x7f8284159370 2023-10-06T02:23:54.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.858+0000 7f8289891700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82840b5c00 con 0x7f82840b0620 2023-10-06T02:23:54.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.858+0000 7f8289891700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82840cb7c0 con 0x7f82840b2270 2023-10-06T02:23:54.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.858+0000 7f8283fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f82840b0620 0x7f8284159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.858+0000 7f8283fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f82840b0620 0x7f8284159740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43922/0 (socket says 172.21.15.37:43922) 2023-10-06T02:23:54.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.858+0000 7f8283fff700 1 -- 172.21.15.37:0/2215568918 learned_addr learned my addr 172.21.15.37:0/2215568918 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:54.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.858+0000 7f8289090700 1 --2- 172.21.15.37:0/2215568918 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82840b2270 0x7f828415db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.858+0000 7f8283fff700 1 -- 172.21.15.37:0/2215568918 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82840b2270 msgr2=0x7f828415db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:54.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.858+0000 7f8283fff700 1 --2- 172.21.15.37:0/2215568918 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82840b2270 0x7f828415db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.858+0000 7f8283fff700 1 -- 172.21.15.37:0/2215568918 >> v1:172.21.15.191:6789/0 conn(0x7f8284159370 legacy=0x7f82840aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.858+0000 7f8283fff700 1 -- 172.21.15.37:0/2215568918 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828415e0d0 con 0x7f82840b0620 2023-10-06T02:23:54.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.859+0000 7f8283fff700 1 --2- 172.21.15.37:0/2215568918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82840b0620 0x7f8284159740 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f82780099b0 tx=0x7f8278009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f5ec7cc91c1046 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:54.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.859+0000 7f82837fe700 1 -- 172.21.15.37:0/2215568918 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827800b860 con 0x7f82840b0620 2023-10-06T02:23:54.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.859+0000 7f82837fe700 1 -- 172.21.15.37:0/2215568918 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827800b9c0 con 0x7f82840b0620 2023-10-06T02:23:54.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.859+0000 7f82837fe700 1 -- 172.21.15.37:0/2215568918 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827800bd60 con 0x7f82840b0620 2023-10-06T02:23:54.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.859+0000 7f8289891700 1 -- 172.21.15.37:0/2215568918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82840b0620 msgr2=0x7f8284159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.859+0000 7f8289891700 1 --2- 172.21.15.37:0/2215568918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82840b0620 0x7f8284159740 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f82780099b0 tx=0x7f8278009250 comp rx=0 tx=0).stop 2023-10-06T02:23:54.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.859+0000 7f8289891700 1 -- 172.21.15.37:0/2215568918 shutdown_connections 2023-10-06T02:23:54.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.859+0000 7f8289891700 1 --2- 172.21.15.37:0/2215568918 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82840b2270 0x7f828415db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.859+0000 7f8289891700 1 --2- 172.21.15.37:0/2215568918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82840b0620 0x7f8284159740 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.859+0000 7f8289891700 1 -- 172.21.15.37:0/2215568918 >> 172.21.15.37:0/2215568918 conn(0x7f828406c0b0 msgr2=0x7f828406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:54.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.859+0000 7f8289891700 1 -- 172.21.15.37:0/2215568918 shutdown_connections 2023-10-06T02:23:54.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.859+0000 7f8289891700 1 -- 172.21.15.37:0/2215568918 wait complete. 2023-10-06T02:23:54.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.860+0000 7f8289891700 1 Processor -- start 2023-10-06T02:23:54.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.861+0000 7f8289891700 1 -- start start 2023-10-06T02:23:54.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.861+0000 7f8289891700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82840b0620 0x7f8284156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.861+0000 7f8289891700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82840b2270 0x7f82840c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.861+0000 7f8289891700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8284159370 0x7f828415b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.861+0000 7f8289891700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82840d08a0 con 0x7f82840b0620 2023-10-06T02:23:54.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.861+0000 7f8289891700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82840d0d30 con 0x7f8284159370 2023-10-06T02:23:54.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.861+0000 7f8289891700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82840cfc90 con 0x7f82840b2270 2023-10-06T02:23:54.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.861+0000 7f828888f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82840b0620 0x7f8284156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.862+0000 7f828888f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82840b0620 0x7f8284156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43930/0 (socket says 172.21.15.37:43930) 2023-10-06T02:23:54.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.862+0000 7f828888f700 1 -- 172.21.15.37:0/3906342793 learned_addr learned my addr 172.21.15.37:0/3906342793 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:54.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.862+0000 7f8283fff700 1 --2- 172.21.15.37:0/3906342793 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82840b2270 0x7f82840c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.862+0000 7f8289090700 1 --2- 172.21.15.37:0/3906342793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8284159370 0x7f828415b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.862+0000 7f828888f700 1 -- 172.21.15.37:0/3906342793 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82840b2270 msgr2=0x7f82840c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.862+0000 7f828888f700 1 --2- 172.21.15.37:0/3906342793 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82840b2270 0x7f82840c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.862+0000 7f828888f700 1 -- 172.21.15.37:0/3906342793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8284159370 msgr2=0x7f828415b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:54.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.862+0000 7f828888f700 1 --2- 172.21.15.37:0/3906342793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8284159370 0x7f828415b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:54.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.862+0000 7f828888f700 1 -- 172.21.15.37:0/3906342793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82780094f0 con 0x7f82840b0620 2023-10-06T02:23:54.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.862+0000 7f8289090700 1 --2- 172.21.15.37:0/3906342793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8284159370 0x7f828415b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:54.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.862+0000 7f828888f700 1 --2- 172.21.15.37:0/3906342793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82840b0620 0x7f8284156e00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f827c00c8e0 tx=0x7f827c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:54.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.862+0000 7f8280ff9700 1 -- 172.21.15.37:0/3906342793 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c012630 con 0x7f82840b0620 2023-10-06T02:23:54.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.862+0000 7f8280ff9700 1 -- 172.21.15.37:0/3906342793 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c0127b0 con 0x7f82840b0620 2023-10-06T02:23:54.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.862+0000 7f8289891700 1 -- 172.21.15.37:0/3906342793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82840cff70 con 0x7f82840b0620 2023-10-06T02:23:54.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.862+0000 7f8280ff9700 1 -- 172.21.15.37:0/3906342793 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c012b70 con 0x7f82840b0620 2023-10-06T02:23:54.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.862+0000 7f8289891700 1 -- 172.21.15.37:0/3906342793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82840d0530 con 0x7f82840b0620 2023-10-06T02:23:54.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.863+0000 7f8289891700 1 -- 172.21.15.37:0/3906342793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8284064b00 con 0x7f82840b0620 2023-10-06T02:23:54.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.864+0000 7f8280ff9700 1 -- 172.21.15.37:0/3906342793 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f827c003030 con 0x7f82840b0620 2023-10-06T02:23:54.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.864+0000 7f8280ff9700 1 --2- 172.21.15.37:0/3906342793 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8270066f30 0x7f82700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:54.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.864+0000 7f8280ff9700 1 -- 172.21.15.37:0/3906342793 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f827c0846a0 con 0x7f82840b0620 2023-10-06T02:23:54.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.864+0000 7f8283fff700 1 --2- 172.21.15.37:0/3906342793 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8270066f30 0x7f82700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:54.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.865+0000 7f8283fff700 1 --2- 172.21.15.37:0/3906342793 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8270066f30 0x7f82700693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f82780099b0 tx=0x7f8278017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:54.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:54.868+0000 7f8280ff9700 1 -- 172.21.15.37:0/3906342793 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f827c055240 con 0x7f82840b0620 2023-10-06T02:23:55.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.107+0000 7f8289891700 1 -- 172.21.15.37:0/3906342793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82840b2750 con 0x7f82840b0620 2023-10-06T02:23:55.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.107+0000 7f8280ff9700 1 -- 172.21.15.37:0/3906342793 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f827c054dd0 con 0x7f82840b0620 2023-10-06T02:23:55.108 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:55.109 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/651376696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":651376696},{"type":"v1","addr":"172.21.15.191:6837","nonce":651376696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1345849362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1345849362},{"type":"v1","addr":"172.21.15.37:6834","nonce":1345849362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/434738958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":434738958},{"type":"v1","addr":"172.21.15.37:6835","nonce":434738958}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:23:15.298562+0000","modified":"2023-10-06T02:23:18.911651+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6835/1723334905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1723334905},{"type":"v1","addr":"172.21.15.191:6835","nonce":1723334905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:23:55.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.109+0000 7f8289891700 1 -- 172.21.15.37:0/3906342793 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8270066f30 msgr2=0x7f82700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:55.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.109+0000 7f8289891700 1 --2- 172.21.15.37:0/3906342793 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8270066f30 0x7f82700693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f82780099b0 tx=0x7f8278017000 comp rx=0 tx=0).stop 2023-10-06T02:23:55.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.109+0000 7f8289891700 1 -- 172.21.15.37:0/3906342793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82840b0620 msgr2=0x7f8284156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:55.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.109+0000 7f8289891700 1 --2- 172.21.15.37:0/3906342793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82840b0620 0x7f8284156e00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f827c00c8e0 tx=0x7f827c001710 comp rx=0 tx=0).stop 2023-10-06T02:23:55.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.109+0000 7f8289891700 1 -- 172.21.15.37:0/3906342793 shutdown_connections 2023-10-06T02:23:55.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.109+0000 7f8289891700 1 --2- 172.21.15.37:0/3906342793 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8270066f30 0x7f82700693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.109+0000 7f8289891700 1 --2- 172.21.15.37:0/3906342793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8284159370 0x7f828415b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.109+0000 7f8289891700 1 --2- 172.21.15.37:0/3906342793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82840b0620 0x7f8284156e00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.109+0000 7f8289891700 1 --2- 172.21.15.37:0/3906342793 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82840b2270 0x7f82840c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.109+0000 7f8289891700 1 -- 172.21.15.37:0/3906342793 >> 172.21.15.37:0/3906342793 conn(0x7f828406c0b0 msgr2=0x7f8284157cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:55.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.109+0000 7f8289891700 1 -- 172.21.15.37:0/3906342793 shutdown_connections 2023-10-06T02:23:55.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.109+0000 7f8289891700 1 -- 172.21.15.37:0/3906342793 wait complete. 2023-10-06T02:23:55.112 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-10-06T02:23:55.122 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:23:55.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.239+0000 7f14b7ad5700 1 Processor -- start 2023-10-06T02:23:55.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.240+0000 7f14b7ad5700 1 -- start start 2023-10-06T02:23:55.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.240+0000 7f14b7ad5700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f14b0150ab0 0x7f14b006a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:55.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.240+0000 7f14b7ad5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14b006a9e0 0x7f14b0156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:55.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.240+0000 7f14b7ad5700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b00ac0a0 con 0x7f14b0157130 2023-10-06T02:23:55.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.240+0000 7f14b7ad5700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b006ae60 con 0x7f14b0150ab0 2023-10-06T02:23:55.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.240+0000 7f14b7ad5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b0157920 con 0x7f14b006a9e0 2023-10-06T02:23:55.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.241+0000 7f14b6072700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f14b0157130 0x7f14b00a9e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40056/0 (socket says 172.21.15.37:40056) 2023-10-06T02:23:55.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.241+0000 7f14b6072700 1 -- 172.21.15.37:0/4094599511 learned_addr learned my addr 172.21.15.37:0/4094599511 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:55.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.241+0000 7f14b5070700 1 --2- 172.21.15.37:0/4094599511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14b006a9e0 0x7f14b0156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:55.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.241+0000 7f14b5871700 1 --2- 172.21.15.37:0/4094599511 >> v2:172.21.15.191:3300/0 conn(0x7f14b0150ab0 0x7f14b006a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:55.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.241+0000 7f14b486f700 1 -- 172.21.15.37:0/4094599511 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644766307 0 0) 0x7f14b00ac0a0 con 0x7f14b0157130 2023-10-06T02:23:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.241+0000 7f14b486f700 1 -- 172.21.15.37:0/4094599511 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1498003570 con 0x7f14b0157130 2023-10-06T02:23:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.241+0000 7f14b486f700 1 -- 172.21.15.37:0/4094599511 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 789082923 0 0) 0x7f1498003570 con 0x7f14b0157130 2023-10-06T02:23:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.241+0000 7f14b5070700 1 -- 172.21.15.37:0/4094599511 >> v2:172.21.15.191:3300/0 conn(0x7f14b0150ab0 msgr2=0x7f14b006a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.241+0000 7f14b5070700 1 --2- 172.21.15.37:0/4094599511 >> v2:172.21.15.191:3300/0 conn(0x7f14b0150ab0 0x7f14b006a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.241+0000 7f14b5070700 1 -- 172.21.15.37:0/4094599511 >> v1:172.21.15.37:6789/0 conn(0x7f14b0157130 legacy=0x7f14b00a9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.241+0000 7f14b5070700 1 -- 172.21.15.37:0/4094599511 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b015a0a0 con 0x7f14b006a9e0 2023-10-06T02:23:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.241+0000 7f14b5871700 1 --2- 172.21.15.37:0/4094599511 >> v2:172.21.15.191:3300/0 conn(0x7f14b0150ab0 0x7f14b006a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.241+0000 7f14b5070700 1 --2- 172.21.15.37:0/4094599511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14b006a9e0 0x7f14b0156bf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f14a40098e0 tx=0x7f14a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb870de5f12a17be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.242+0000 7f14b486f700 1 -- 172.21.15.37:0/4094599511 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0001470 con 0x7f14b006a9e0 2023-10-06T02:23:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.242+0000 7f14b486f700 1 -- 172.21.15.37:0/4094599511 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a4011420 con 0x7f14b006a9e0 2023-10-06T02:23:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.242+0000 7f14b486f700 1 -- 172.21.15.37:0/4094599511 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a40117a0 con 0x7f14b006a9e0 2023-10-06T02:23:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.242+0000 7f14b7ad5700 1 -- 172.21.15.37:0/4094599511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14b006a9e0 msgr2=0x7f14b0156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:55.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.242+0000 7f14b7ad5700 1 --2- 172.21.15.37:0/4094599511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14b006a9e0 0x7f14b0156bf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f14a40098e0 tx=0x7f14a40091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.242+0000 7f14b7ad5700 1 -- 172.21.15.37:0/4094599511 shutdown_connections 2023-10-06T02:23:55.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.242+0000 7f14b7ad5700 1 --2- 172.21.15.37:0/4094599511 >> v2:172.21.15.191:3300/0 conn(0x7f14b0150ab0 0x7f14b006a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.242+0000 7f14b7ad5700 1 --2- 172.21.15.37:0/4094599511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14b006a9e0 0x7f14b0156bf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.242+0000 7f14b7ad5700 1 -- 172.21.15.37:0/4094599511 >> 172.21.15.37:0/4094599511 conn(0x7f14b00cc120 msgr2=0x7f14b00cc520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:55.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.242+0000 7f14b7ad5700 1 -- 172.21.15.37:0/4094599511 shutdown_connections 2023-10-06T02:23:55.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.242+0000 7f14b7ad5700 1 -- 172.21.15.37:0/4094599511 wait complete. 2023-10-06T02:23:55.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.243+0000 7f14b7ad5700 1 Processor -- start 2023-10-06T02:23:55.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.243+0000 7f14b7ad5700 1 -- start start 2023-10-06T02:23:55.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.244+0000 7f14b7ad5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14b006a9e0 0x7f14b00cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:55.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.244+0000 7f14b7ad5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14b0150ab0 0x7f14b00a8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:55.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.244+0000 7f14b7ad5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14b0157130 0x7f14b00a92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:55.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.244+0000 7f14b7ad5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b0156820 con 0x7f14b0150ab0 2023-10-06T02:23:55.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.244+0000 7f14b7ad5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b0155ef0 con 0x7f14b006a9e0 2023-10-06T02:23:55.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.244+0000 7f14b7ad5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b01561d0 con 0x7f14b0157130 2023-10-06T02:23:55.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.244+0000 7f14b5070700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14b0150ab0 0x7f14b00a8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:55.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.244+0000 7f14b5070700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14b0150ab0 0x7f14b00a8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51028/0 (socket says 172.21.15.37:51028) 2023-10-06T02:23:55.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.244+0000 7f14b5070700 1 -- 172.21.15.37:0/3225444285 learned_addr learned my addr 172.21.15.37:0/3225444285 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:55.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.244+0000 7f14b5871700 1 --2- 172.21.15.37:0/3225444285 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14b006a9e0 0x7f14b00cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:55.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.245+0000 7f14b6072700 1 --2- 172.21.15.37:0/3225444285 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14b0157130 0x7f14b00a92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:55.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.245+0000 7f14b5070700 1 -- 172.21.15.37:0/3225444285 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14b0157130 msgr2=0x7f14b00a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:55.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.245+0000 7f14b5070700 1 --2- 172.21.15.37:0/3225444285 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14b0157130 0x7f14b00a92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.245+0000 7f14b5070700 1 -- 172.21.15.37:0/3225444285 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14b006a9e0 msgr2=0x7f14b00cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:55.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.245+0000 7f14b5070700 1 --2- 172.21.15.37:0/3225444285 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14b006a9e0 0x7f14b00cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.245+0000 7f14b5070700 1 -- 172.21.15.37:0/3225444285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a8009a20 con 0x7f14b0150ab0 2023-10-06T02:23:55.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.245+0000 7f14b5871700 1 --2- 172.21.15.37:0/3225444285 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14b006a9e0 0x7f14b00cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:55.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.245+0000 7f14b5070700 1 --2- 172.21.15.37:0/3225444285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14b0150ab0 0x7f14b00a8d60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f14b0157a60 tx=0x7f14a4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:55.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.245+0000 7f14adffb700 1 -- 172.21.15.37:0/3225444285 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a401cba0 con 0x7f14b0150ab0 2023-10-06T02:23:55.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.245+0000 7f14adffb700 1 -- 172.21.15.37:0/3225444285 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a401cd00 con 0x7f14b0150ab0 2023-10-06T02:23:55.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.245+0000 7f14b7ad5700 1 -- 172.21.15.37:0/3225444285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a4009420 con 0x7f14b0150ab0 2023-10-06T02:23:55.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.245+0000 7f14adffb700 1 -- 172.21.15.37:0/3225444285 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a401a6a0 con 0x7f14b0150ab0 2023-10-06T02:23:55.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.245+0000 7f14b7ad5700 1 -- 172.21.15.37:0/3225444285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b0156cb0 con 0x7f14b0150ab0 2023-10-06T02:23:55.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.246+0000 7f14b7ad5700 1 -- 172.21.15.37:0/3225444285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b0156990 con 0x7f14b0150ab0 2023-10-06T02:23:55.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.247+0000 7f14adffb700 1 -- 172.21.15.37:0/3225444285 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14a401aa50 con 0x7f14b0150ab0 2023-10-06T02:23:55.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.247+0000 7f14adffb700 1 --2- 172.21.15.37:0/3225444285 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f149c066f30 0x7f149c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:55.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.247+0000 7f14adffb700 1 -- 172.21.15.37:0/3225444285 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f14a4086070 con 0x7f14b0150ab0 2023-10-06T02:23:55.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.247+0000 7f14b5871700 1 --2- 172.21.15.37:0/3225444285 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f149c066f30 0x7f149c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:55.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.248+0000 7f14b5871700 1 --2- 172.21.15.37:0/3225444285 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f149c066f30 0x7f149c0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f14a80099f0 tx=0x7f14a800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:55.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.252+0000 7f14adffb700 1 -- 172.21.15.37:0/3225444285 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14a4053180 con 0x7f14b0150ab0 2023-10-06T02:23:55.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.445+0000 7f14b7ad5700 1 -- 172.21.15.37:0/3225444285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14b015a380 con 0x7f14b0150ab0 2023-10-06T02:23:55.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.446+0000 7f14adffb700 1 -- 172.21.15.37:0/3225444285 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f14a40567a0 con 0x7f14b0150ab0 2023-10-06T02:23:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:23:55.448 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:23:16.897625+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:23:13.004596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:23:14.268809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:23:55.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.448+0000 7f14b7ad5700 1 -- 172.21.15.37:0/3225444285 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f149c066f30 msgr2=0x7f149c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:55.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.448+0000 7f14b7ad5700 1 --2- 172.21.15.37:0/3225444285 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f149c066f30 0x7f149c0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f14a80099f0 tx=0x7f14a800b040 comp rx=0 tx=0).stop 2023-10-06T02:23:55.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.448+0000 7f14b7ad5700 1 -- 172.21.15.37:0/3225444285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14b0150ab0 msgr2=0x7f14b00a8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:55.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.448+0000 7f14b7ad5700 1 --2- 172.21.15.37:0/3225444285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14b0150ab0 0x7f14b00a8d60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f14b0157a60 tx=0x7f14a4016000 comp rx=0 tx=0).stop 2023-10-06T02:23:55.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.448+0000 7f14b7ad5700 1 -- 172.21.15.37:0/3225444285 shutdown_connections 2023-10-06T02:23:55.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.448+0000 7f14b7ad5700 1 --2- 172.21.15.37:0/3225444285 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14b0157130 0x7f14b00a92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.448+0000 7f14b7ad5700 1 --2- 172.21.15.37:0/3225444285 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f149c066f30 0x7f149c0693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.448+0000 7f14b7ad5700 1 --2- 172.21.15.37:0/3225444285 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14b006a9e0 0x7f14b00cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.448+0000 7f14b7ad5700 1 --2- 172.21.15.37:0/3225444285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14b0150ab0 0x7f14b00a8d60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.448+0000 7f14b7ad5700 1 -- 172.21.15.37:0/3225444285 >> 172.21.15.37:0/3225444285 conn(0x7f14b00cc120 msgr2=0x7f14b00b16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:55.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.448+0000 7f14b7ad5700 1 -- 172.21.15.37:0/3225444285 shutdown_connections 2023-10-06T02:23:55.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.448+0000 7f14b7ad5700 1 -- 172.21.15.37:0/3225444285 wait complete. 2023-10-06T02:23:55.461 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:23:55.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.580+0000 7fa33d32c700 1 Processor -- start 2023-10-06T02:23:55.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.580+0000 7fa33d32c700 1 -- start start 2023-10-06T02:23:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.580+0000 7fa33d32c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa338159560 0x7fa3380acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.580+0000 7fa33d32c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa338159930 0x7fa33806c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.580+0000 7fa33d32c700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33815aec0 con 0x7fa33806c5f0 2023-10-06T02:23:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.580+0000 7fa33d32c700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa33806ca90 con 0x7fa338159930 2023-10-06T02:23:55.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.580+0000 7fa33d32c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380c9ea0 con 0x7fa338159560 2023-10-06T02:23:55.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.581+0000 7fa3367fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa338159930 0x7fa33806c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:55.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.581+0000 7fa3377fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa33806c5f0 0x7fa3380cd1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40072/0 (socket says 172.21.15.37:40072) 2023-10-06T02:23:55.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.581+0000 7fa3377fe700 1 -- 172.21.15.37:0/2772844137 learned_addr learned my addr 172.21.15.37:0/2772844137 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:55.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.581+0000 7fa336ffd700 1 --2- 172.21.15.37:0/2772844137 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa338159560 0x7fa3380acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:55.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.581+0000 7fa3367fc700 1 -- 172.21.15.37:0/2772844137 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa338159560 msgr2=0x7fa3380acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:55.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.581+0000 7fa3367fc700 1 --2- 172.21.15.37:0/2772844137 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa338159560 0x7fa3380acaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.581+0000 7fa3367fc700 1 -- 172.21.15.37:0/2772844137 >> v1:172.21.15.37:6789/0 conn(0x7fa33806c5f0 legacy=0x7fa3380cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:55.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.581+0000 7fa335ffb700 1 -- 172.21.15.37:0/2772844137 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313456007 0 0) 0x7fa33815aec0 con 0x7fa33806c5f0 2023-10-06T02:23:55.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.581+0000 7fa3367fc700 1 -- 172.21.15.37:0/2772844137 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3380ca0f0 con 0x7fa338159930 2023-10-06T02:23:55.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.581+0000 7fa3367fc700 1 --2- 172.21.15.37:0/2772844137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa338159930 0x7fa33806c0b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa3200098e0 tx=0x7fa3200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2fe6d5e8fa037d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:55.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.581+0000 7fa335ffb700 1 -- 172.21.15.37:0/2772844137 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa320009e80 con 0x7fa338159930 2023-10-06T02:23:55.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.581+0000 7fa335ffb700 1 -- 172.21.15.37:0/2772844137 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32000b860 con 0x7fa338159930 2023-10-06T02:23:55.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.581+0000 7fa335ffb700 1 -- 172.21.15.37:0/2772844137 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32000bbe0 con 0x7fa338159930 2023-10-06T02:23:55.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.582+0000 7fa33d32c700 1 -- 172.21.15.37:0/2772844137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa338159930 msgr2=0x7fa33806c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:55.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.582+0000 7fa33d32c700 1 --2- 172.21.15.37:0/2772844137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa338159930 0x7fa33806c0b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa3200098e0 tx=0x7fa3200091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.582+0000 7fa33d32c700 1 -- 172.21.15.37:0/2772844137 shutdown_connections 2023-10-06T02:23:55.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.582+0000 7fa33d32c700 1 --2- 172.21.15.37:0/2772844137 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa338159560 0x7fa3380acaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.582+0000 7fa33d32c700 1 --2- 172.21.15.37:0/2772844137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa338159930 0x7fa33806c0b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.582+0000 7fa33d32c700 1 -- 172.21.15.37:0/2772844137 >> 172.21.15.37:0/2772844137 conn(0x7fa33806e9d0 msgr2=0x7fa33806edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:55.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.582+0000 7fa33d32c700 1 -- 172.21.15.37:0/2772844137 shutdown_connections 2023-10-06T02:23:55.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.582+0000 7fa33d32c700 1 -- 172.21.15.37:0/2772844137 wait complete. 2023-10-06T02:23:55.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.583+0000 7fa33d32c700 1 Processor -- start 2023-10-06T02:23:55.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.583+0000 7fa33d32c700 1 -- start start 2023-10-06T02:23:55.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.584+0000 7fa33d32c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa33806c5f0 0x7fa3380cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:55.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.584+0000 7fa33d32c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa338159560 0x7fa338150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:55.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.584+0000 7fa33d32c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa338159930 0x7fa338154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:55.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.584+0000 7fa33d32c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380cd3e0 con 0x7fa33806c5f0 2023-10-06T02:23:55.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.584+0000 7fa33d32c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380cc340 con 0x7fa338159560 2023-10-06T02:23:55.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.584+0000 7fa33d32c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380cc620 con 0x7fa338159930 2023-10-06T02:23:55.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.584+0000 7fa336ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa33806c5f0 0x7fa3380cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:55.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.584+0000 7fa336ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa33806c5f0 0x7fa3380cbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51054/0 (socket says 172.21.15.37:51054) 2023-10-06T02:23:55.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.584+0000 7fa336ffd700 1 -- 172.21.15.37:0/2197483963 learned_addr learned my addr 172.21.15.37:0/2197483963 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:55.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.584+0000 7fa3377fe700 1 --2- 172.21.15.37:0/2197483963 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa338159930 0x7fa338154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:55.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.584+0000 7fa336ffd700 1 -- 172.21.15.37:0/2197483963 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa338159930 msgr2=0x7fa338154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:55.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.584+0000 7fa3367fc700 1 --2- 172.21.15.37:0/2197483963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa338159560 0x7fa338150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:55.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.584+0000 7fa336ffd700 1 --2- 172.21.15.37:0/2197483963 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa338159930 0x7fa338154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.584+0000 7fa336ffd700 1 -- 172.21.15.37:0/2197483963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa338159560 msgr2=0x7fa338150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:55.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.584+0000 7fa336ffd700 1 --2- 172.21.15.37:0/2197483963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa338159560 0x7fa338150890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.584+0000 7fa336ffd700 1 -- 172.21.15.37:0/2197483963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa320009420 con 0x7fa33806c5f0 2023-10-06T02:23:55.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.584+0000 7fa3377fe700 1 --2- 172.21.15.37:0/2197483963 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa338159930 0x7fa338154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:55.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.584+0000 7fa336ffd700 1 --2- 172.21.15.37:0/2197483963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa33806c5f0 0x7fa3380cbad0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa33000d890 tx=0x7fa330008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:55.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.585+0000 7fa32effd700 1 -- 172.21.15.37:0/2197483963 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33000b600 con 0x7fa33806c5f0 2023-10-06T02:23:55.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.585+0000 7fa32effd700 1 -- 172.21.15.37:0/2197483963 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33000b760 con 0x7fa33806c5f0 2023-10-06T02:23:55.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.585+0000 7fa33d32c700 1 -- 172.21.15.37:0/2197483963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3380cc900 con 0x7fa33806c5f0 2023-10-06T02:23:55.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.585+0000 7fa32effd700 1 -- 172.21.15.37:0/2197483963 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33000bae0 con 0x7fa33806c5f0 2023-10-06T02:23:55.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.585+0000 7fa33d32c700 1 -- 172.21.15.37:0/2197483963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3380ccec0 con 0x7fa33806c5f0 2023-10-06T02:23:55.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.586+0000 7fa33d32c700 1 -- 172.21.15.37:0/2197483963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3380cd230 con 0x7fa33806c5f0 2023-10-06T02:23:55.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.586+0000 7fa32effd700 1 -- 172.21.15.37:0/2197483963 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa33001e460 con 0x7fa33806c5f0 2023-10-06T02:23:55.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.586+0000 7fa32effd700 1 --2- 172.21.15.37:0/2197483963 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa318066f30 0x7fa3180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:55.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.586+0000 7fa32effd700 1 -- 172.21.15.37:0/2197483963 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa330084d40 con 0x7fa33806c5f0 2023-10-06T02:23:55.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.587+0000 7fa3367fc700 1 --2- 172.21.15.37:0/2197483963 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa318066f30 0x7fa3180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:55.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.587+0000 7fa3367fc700 1 --2- 172.21.15.37:0/2197483963 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa318066f30 0x7fa3180693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa3380aeea0 tx=0x7fa320017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:55.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.591+0000 7fa32effd700 1 -- 172.21.15.37:0/2197483963 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa330051e50 con 0x7fa33806c5f0 2023-10-06T02:23:55.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.830+0000 7fa33d32c700 1 -- 172.21.15.37:0/2197483963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa33816af50 con 0x7fa33806c5f0 2023-10-06T02:23:55.831 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-10-06T02:23:55.830+0000 7f292cc58700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:23:55.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.834+0000 7fa32effd700 1 -- 172.21.15.37:0/2197483963 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa330055470 con 0x7fa33806c5f0 2023-10-06T02:23:55.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.836+0000 7fa33d32c700 1 -- 172.21.15.37:0/2197483963 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa318066f30 msgr2=0x7fa3180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:55.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.836+0000 7fa33d32c700 1 --2- 172.21.15.37:0/2197483963 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa318066f30 0x7fa3180693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa3380aeea0 tx=0x7fa320017000 comp rx=0 tx=0).stop 2023-10-06T02:23:55.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.836+0000 7fa33d32c700 1 -- 172.21.15.37:0/2197483963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa33806c5f0 msgr2=0x7fa3380cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:55.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.836+0000 7fa33d32c700 1 --2- 172.21.15.37:0/2197483963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa33806c5f0 0x7fa3380cbad0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa33000d890 tx=0x7fa330008040 comp rx=0 tx=0).stop 2023-10-06T02:23:55.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.836+0000 7fa33d32c700 1 -- 172.21.15.37:0/2197483963 shutdown_connections 2023-10-06T02:23:55.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.836+0000 7fa33d32c700 1 --2- 172.21.15.37:0/2197483963 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa338159930 0x7fa338154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.836+0000 7fa33d32c700 1 --2- 172.21.15.37:0/2197483963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa33806c5f0 0x7fa3380cbad0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.836+0000 7fa33d32c700 1 --2- 172.21.15.37:0/2197483963 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa318066f30 0x7fa3180693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.836+0000 7fa33d32c700 1 --2- 172.21.15.37:0/2197483963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa338159560 0x7fa338150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.836+0000 7fa33d32c700 1 -- 172.21.15.37:0/2197483963 >> 172.21.15.37:0/2197483963 conn(0x7fa33806e9d0 msgr2=0x7fa338152780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:55.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.836+0000 7fa33d32c700 1 -- 172.21.15.37:0/2197483963 shutdown_connections 2023-10-06T02:23:55.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.836+0000 7fa33d32c700 1 -- 172.21.15.37:0/2197483963 wait complete. 2023-10-06T02:23:55.839 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:23:55.842 INFO:tasks.ceph.mds.b.smithi191.stderr: -2204> 2023-10-06T02:23:20.950+0000 7fe3df873700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:23:55.850 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:23:55.863 INFO:tasks.ceph.mds.b.smithi191.stdout:starting mds.b at 2023-10-06T02:23:55.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.971+0000 7fa25d09b700 1 Processor -- start 2023-10-06T02:23:55.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.971+0000 7fa25d09b700 1 -- start start 2023-10-06T02:23:55.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.972+0000 7fa25d09b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa2580b2a90 0x7fa258159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:55.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.972+0000 7fa25d09b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2580ccb30 0x7fa2580ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:55.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.972+0000 7fa25d09b700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2580b07a0 con 0x7fa2581593c0 2023-10-06T02:23:55.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.972+0000 7fa25d09b700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2580cd8a0 con 0x7fa2580b2a90 2023-10-06T02:23:55.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.972+0000 7fa25d09b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2580afe70 con 0x7fa2580ccb30 2023-10-06T02:23:55.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.973+0000 7fa25759e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2580ccb30 0x7fa2580ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:55.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.973+0000 7fa25659c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa2580b2a90 0x7fa258159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:55.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.973+0000 7fa25759e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2580ccb30 0x7fa2580ccfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:56592/0 (socket says 172.21.15.37:56592) 2023-10-06T02:23:55.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.973+0000 7fa256d9d700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fa2581593c0 0x7fa2580b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:48108/0 (socket says 172.21.15.37:48108) 2023-10-06T02:23:55.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.973+0000 7fa25759e700 1 -- 172.21.15.37:0/2643453249 learned_addr learned my addr 172.21.15.37:0/2643453249 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:55.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.973+0000 7fa25659c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa2580b2a90 0x7fa258159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:43314/0 (socket says 172.21.15.37:43314) 2023-10-06T02:23:55.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.973+0000 7fa25759e700 1 -- 172.21.15.37:0/2643453249 >> v2:172.21.15.191:3300/0 conn(0x7fa2580b2a90 msgr2=0x7fa258159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:55.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.973+0000 7fa25759e700 1 --2- 172.21.15.37:0/2643453249 >> v2:172.21.15.191:3300/0 conn(0x7fa2580b2a90 0x7fa258159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.973+0000 7fa25759e700 1 -- 172.21.15.37:0/2643453249 >> v1:172.21.15.191:6789/0 conn(0x7fa2581593c0 legacy=0x7fa2580b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:55.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.973+0000 7fa255d9b700 1 -- 172.21.15.37:0/2643453249 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3729069504 0 0) 0x7fa2580b07a0 con 0x7fa2581593c0 2023-10-06T02:23:55.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.973+0000 7fa25759e700 1 -- 172.21.15.37:0/2643453249 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2580b0150 con 0x7fa2580ccb30 2023-10-06T02:23:55.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.973+0000 7fa25659c700 1 --2- 172.21.15.37:0/2643453249 >> v2:172.21.15.191:3300/0 conn(0x7fa2580b2a90 0x7fa258159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:55.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.973+0000 7fa25759e700 1 --2- 172.21.15.37:0/2643453249 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2580ccb30 0x7fa2580ccfb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa248009f20 tx=0x7fa248009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f11a64aa3327e096 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:55.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.973+0000 7fa255d9b700 1 -- 172.21.15.37:0/2643453249 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24800e070 con 0x7fa2580ccb30 2023-10-06T02:23:55.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.973+0000 7fa255d9b700 1 -- 172.21.15.37:0/2643453249 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24800b9d0 con 0x7fa2580ccb30 2023-10-06T02:23:55.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.973+0000 7fa255d9b700 1 -- 172.21.15.37:0/2643453249 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2480092e0 con 0x7fa2580ccb30 2023-10-06T02:23:55.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.974+0000 7fa25d09b700 1 -- 172.21.15.37:0/2643453249 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2580ccb30 msgr2=0x7fa2580ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:55.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.974+0000 7fa25d09b700 1 --2- 172.21.15.37:0/2643453249 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2580ccb30 0x7fa2580ccfb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa248009f20 tx=0x7fa248009840 comp rx=0 tx=0).stop 2023-10-06T02:23:55.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.974+0000 7fa25d09b700 1 -- 172.21.15.37:0/2643453249 shutdown_connections 2023-10-06T02:23:55.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.974+0000 7fa25d09b700 1 --2- 172.21.15.37:0/2643453249 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2580ccb30 0x7fa2580ccfb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.974+0000 7fa25d09b700 1 --2- 172.21.15.37:0/2643453249 >> v2:172.21.15.191:3300/0 conn(0x7fa2580b2a90 0x7fa258159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.974+0000 7fa25d09b700 1 -- 172.21.15.37:0/2643453249 >> 172.21.15.37:0/2643453249 conn(0x7fa25806c0b0 msgr2=0x7fa25806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:55.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.974+0000 7fa25d09b700 1 -- 172.21.15.37:0/2643453249 shutdown_connections 2023-10-06T02:23:55.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.974+0000 7fa25d09b700 1 -- 172.21.15.37:0/2643453249 wait complete. 2023-10-06T02:23:55.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.975+0000 7fa25d09b700 1 Processor -- start 2023-10-06T02:23:55.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.975+0000 7fa25d09b700 1 -- start start 2023-10-06T02:23:55.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.976+0000 7fa25d09b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2580b2a90 0x7fa2580c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:55.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.976+0000 7fa25d09b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2580ccb30 0x7fa258148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.976+0000 7fa25d09b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2581593c0 0x7fa2581485c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.976+0000 7fa25d09b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa258147870 con 0x7fa2580b2a90 2023-10-06T02:23:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.976+0000 7fa25d09b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa258146c60 con 0x7fa2580ccb30 2023-10-06T02:23:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.976+0000 7fa25d09b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa258146f40 con 0x7fa2581593c0 2023-10-06T02:23:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.976+0000 7fa256d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2580b2a90 0x7fa2580c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.976+0000 7fa256d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2580b2a90 0x7fa2580c9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51068/0 (socket says 172.21.15.37:51068) 2023-10-06T02:23:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.976+0000 7fa256d9d700 1 -- 172.21.15.37:0/1923567908 learned_addr learned my addr 172.21.15.37:0/1923567908 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.976+0000 7fa25759e700 1 --2- 172.21.15.37:0/1923567908 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2581593c0 0x7fa2581485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.976+0000 7fa25659c700 1 --2- 172.21.15.37:0/1923567908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2580ccb30 0x7fa258148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.976+0000 7fa256d9d700 1 -- 172.21.15.37:0/1923567908 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2581593c0 msgr2=0x7fa2581485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.976+0000 7fa256d9d700 1 --2- 172.21.15.37:0/1923567908 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2581593c0 0x7fa2581485c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.976+0000 7fa256d9d700 1 -- 172.21.15.37:0/1923567908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2580ccb30 msgr2=0x7fa258148080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:55.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.976+0000 7fa256d9d700 1 --2- 172.21.15.37:0/1923567908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2580ccb30 0x7fa258148080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:55.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.976+0000 7fa256d9d700 1 -- 172.21.15.37:0/1923567908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa240009420 con 0x7fa2580b2a90 2023-10-06T02:23:55.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.976+0000 7fa25659c700 1 --2- 172.21.15.37:0/1923567908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2580ccb30 0x7fa258148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:23:55.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.977+0000 7fa256d9d700 1 --2- 172.21.15.37:0/1923567908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2580b2a90 0x7fa2580c9790 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa25000c5b0 tx=0x7fa250001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:55.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.977+0000 7fa24effd700 1 -- 172.21.15.37:0/1923567908 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250005a70 con 0x7fa2580b2a90 2023-10-06T02:23:55.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.977+0000 7fa24effd700 1 -- 172.21.15.37:0/1923567908 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa250005bd0 con 0x7fa2580b2a90 2023-10-06T02:23:55.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.977+0000 7fa24effd700 1 -- 172.21.15.37:0/1923567908 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2500070d0 con 0x7fa2580b2a90 2023-10-06T02:23:55.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.977+0000 7fa25d09b700 1 -- 172.21.15.37:0/1923567908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa248009ae0 con 0x7fa2580b2a90 2023-10-06T02:23:55.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.977+0000 7fa25d09b700 1 -- 172.21.15.37:0/1923567908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa258147500 con 0x7fa2580b2a90 2023-10-06T02:23:55.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.978+0000 7fa25d09b700 1 -- 172.21.15.37:0/1923567908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa258088bb0 con 0x7fa2580b2a90 2023-10-06T02:23:55.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.978+0000 7fa24effd700 1 -- 172.21.15.37:0/1923567908 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa250007480 con 0x7fa2580b2a90 2023-10-06T02:23:55.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.978+0000 7fa24effd700 1 --2- 172.21.15.37:0/1923567908 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa238066f30 0x7fa2380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:55.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.979+0000 7fa24effd700 1 -- 172.21.15.37:0/1923567908 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fa250083c00 con 0x7fa2580b2a90 2023-10-06T02:23:55.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.979+0000 7fa25659c700 1 --2- 172.21.15.37:0/1923567908 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa238066f30 0x7fa2380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:55.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.979+0000 7fa25659c700 1 --2- 172.21.15.37:0/1923567908 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa238066f30 0x7fa2380693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa2400093f0 tx=0x7fa240008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:55.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:55.983+0000 7fa24effd700 1 -- 172.21.15.37:0/1923567908 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa25008a080 con 0x7fa2580b2a90 2023-10-06T02:23:56.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.218+0000 7fa25d09b700 1 -- 172.21.15.37:0/1923567908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa2580b0430 con 0x7fa2580b2a90 2023-10-06T02:23:56.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.834+0000 7fa24effd700 1 -- 172.21.15.37:0/1923567908 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa2500170a0 con 0x7fa2580b2a90 2023-10-06T02:23:56.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.837+0000 7fa25d09b700 1 -- 172.21.15.37:0/1923567908 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa238066f30 msgr2=0x7fa2380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:56.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.837+0000 7fa25d09b700 1 --2- 172.21.15.37:0/1923567908 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa238066f30 0x7fa2380693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa2400093f0 tx=0x7fa240008040 comp rx=0 tx=0).stop 2023-10-06T02:23:56.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.837+0000 7fa25d09b700 1 -- 172.21.15.37:0/1923567908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2580b2a90 msgr2=0x7fa2580c9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:56.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.837+0000 7fa25d09b700 1 --2- 172.21.15.37:0/1923567908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2580b2a90 0x7fa2580c9790 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa25000c5b0 tx=0x7fa250001040 comp rx=0 tx=0).stop 2023-10-06T02:23:56.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.837+0000 7fa25d09b700 1 -- 172.21.15.37:0/1923567908 shutdown_connections 2023-10-06T02:23:56.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.837+0000 7fa25d09b700 1 --2- 172.21.15.37:0/1923567908 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2581593c0 0x7fa2581485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:56.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.837+0000 7fa25d09b700 1 --2- 172.21.15.37:0/1923567908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2580b2a90 0x7fa2580c9790 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:56.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.837+0000 7fa25d09b700 1 --2- 172.21.15.37:0/1923567908 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa238066f30 0x7fa2380693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:56.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.837+0000 7fa25d09b700 1 --2- 172.21.15.37:0/1923567908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2580ccb30 0x7fa258148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:56.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.837+0000 7fa25d09b700 1 -- 172.21.15.37:0/1923567908 >> 172.21.15.37:0/1923567908 conn(0x7fa25806c0b0 msgr2=0x7fa25806c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:56.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.837+0000 7fa25d09b700 1 -- 172.21.15.37:0/1923567908 shutdown_connections 2023-10-06T02:23:56.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.837+0000 7fa25d09b700 1 -- 172.21.15.37:0/1923567908 wait complete. 2023-10-06T02:23:56.852 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:23:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.978+0000 7fc80e730700 1 Processor -- start 2023-10-06T02:23:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.978+0000 7fc80e730700 1 -- start start 2023-10-06T02:23:56.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.978+0000 7fc80e730700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc808159550 0x7fc808159920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:56.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.978+0000 7fc80e730700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc80806c7c0 0x7fc80815ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:56.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.978+0000 7fc80e730700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc80815e300 con 0x7fc8080b24d0 2023-10-06T02:23:56.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.978+0000 7fc80e730700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8080b29b0 con 0x7fc80806c7c0 2023-10-06T02:23:56.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.978+0000 7fc80e730700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080b2c90 con 0x7fc808159550 2023-10-06T02:23:56.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.979+0000 7fc807fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc808159550 0x7fc808159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:56.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.979+0000 7fc80cccd700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc80806c7c0 0x7fc80815ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:56.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.979+0000 7fc80cccd700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc80806c7c0 0x7fc80815ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:43336/0 (socket says 172.21.15.37:43336) 2023-10-06T02:23:56.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.979+0000 7fc8077fe700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fc8080b24d0 0x7fc80806c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:48120/0 (socket says 172.21.15.37:48120) 2023-10-06T02:23:56.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.979+0000 7fc807fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc808159550 0x7fc808159920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:56596/0 (socket says 172.21.15.37:56596) 2023-10-06T02:23:56.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.979+0000 7fc80cccd700 1 -- 172.21.15.37:0/4097860490 learned_addr learned my addr 172.21.15.37:0/4097860490 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:56.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.979+0000 7fc807fff700 1 -- 172.21.15.37:0/4097860490 >> v2:172.21.15.191:3300/0 conn(0x7fc80806c7c0 msgr2=0x7fc80815ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:56.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.979+0000 7fc807fff700 1 --2- 172.21.15.37:0/4097860490 >> v2:172.21.15.191:3300/0 conn(0x7fc80806c7c0 0x7fc80815ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:56.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.979+0000 7fc807fff700 1 -- 172.21.15.37:0/4097860490 >> v1:172.21.15.191:6789/0 conn(0x7fc8080b24d0 legacy=0x7fc80806c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:56.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.979+0000 7fc806ffd700 1 -- 172.21.15.37:0/4097860490 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249573848 0 0) 0x7fc80815e300 con 0x7fc8080b24d0 2023-10-06T02:23:56.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.979+0000 7fc807fff700 1 -- 172.21.15.37:0/4097860490 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8080cb620 con 0x7fc808159550 2023-10-06T02:23:56.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.979+0000 7fc80cccd700 1 --2- 172.21.15.37:0/4097860490 >> v2:172.21.15.191:3300/0 conn(0x7fc80806c7c0 0x7fc80815ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:56.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.979+0000 7fc807fff700 1 --2- 172.21.15.37:0/4097860490 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc808159550 0x7fc808159920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00098e0 tx=0x7fc7f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=135b99cf782ff9fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:56.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.980+0000 7fc806ffd700 1 -- 172.21.15.37:0/4097860490 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f000b640 con 0x7fc808159550 2023-10-06T02:23:56.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.980+0000 7fc806ffd700 1 -- 172.21.15.37:0/4097860490 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f000b7a0 con 0x7fc808159550 2023-10-06T02:23:56.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.980+0000 7fc806ffd700 1 -- 172.21.15.37:0/4097860490 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f000bb40 con 0x7fc808159550 2023-10-06T02:23:56.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.980+0000 7fc80e730700 1 -- 172.21.15.37:0/4097860490 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc808159550 msgr2=0x7fc808159920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:56.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.980+0000 7fc80e730700 1 --2- 172.21.15.37:0/4097860490 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc808159550 0x7fc808159920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00098e0 tx=0x7fc7f00091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:56.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.980+0000 7fc80e730700 1 -- 172.21.15.37:0/4097860490 shutdown_connections 2023-10-06T02:23:56.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.980+0000 7fc80e730700 1 --2- 172.21.15.37:0/4097860490 >> v2:172.21.15.191:3300/0 conn(0x7fc80806c7c0 0x7fc80815ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:56.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.980+0000 7fc80e730700 1 --2- 172.21.15.37:0/4097860490 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc808159550 0x7fc808159920 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:56.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.980+0000 7fc80e730700 1 -- 172.21.15.37:0/4097860490 >> 172.21.15.37:0/4097860490 conn(0x7fc80806d900 msgr2=0x7fc80806dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:56.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.980+0000 7fc80e730700 1 -- 172.21.15.37:0/4097860490 shutdown_connections 2023-10-06T02:23:56.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.980+0000 7fc80e730700 1 -- 172.21.15.37:0/4097860490 wait complete. 2023-10-06T02:23:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.981+0000 7fc80e730700 1 Processor -- start 2023-10-06T02:23:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.981+0000 7fc80e730700 1 -- start start 2023-10-06T02:23:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.982+0000 7fc80e730700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc80806c7c0 0x7fc80815a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.982+0000 7fc80e730700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8080b24d0 0x7fc808156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.982+0000 7fc80e730700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc808159550 0x7fc8080c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.982+0000 7fc80e730700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080c3df0 con 0x7fc8080b24d0 2023-10-06T02:23:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.982+0000 7fc80e730700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080c4650 con 0x7fc808159550 2023-10-06T02:23:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.982+0000 7fc80e730700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80815ac50 con 0x7fc80806c7c0 2023-10-06T02:23:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.982+0000 7fc8077fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8080b24d0 0x7fc808156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.982+0000 7fc8077fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8080b24d0 0x7fc808156530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51072/0 (socket says 172.21.15.37:51072) 2023-10-06T02:23:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.982+0000 7fc8077fe700 1 -- 172.21.15.37:0/1218717343 learned_addr learned my addr 172.21.15.37:0/1218717343 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.982+0000 7fc807fff700 1 --2- 172.21.15.37:0/1218717343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc80806c7c0 0x7fc80815a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.982+0000 7fc80cccd700 1 --2- 172.21.15.37:0/1218717343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc808159550 0x7fc8080c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.983+0000 7fc8077fe700 1 -- 172.21.15.37:0/1218717343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc80806c7c0 msgr2=0x7fc80815a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.983+0000 7fc8077fe700 1 --2- 172.21.15.37:0/1218717343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc80806c7c0 0x7fc80815a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.983+0000 7fc8077fe700 1 -- 172.21.15.37:0/1218717343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc808159550 msgr2=0x7fc8080c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.983+0000 7fc8077fe700 1 --2- 172.21.15.37:0/1218717343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc808159550 0x7fc8080c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.983+0000 7fc8077fe700 1 -- 172.21.15.37:0/1218717343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc800009ae0 con 0x7fc8080b24d0 2023-10-06T02:23:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.983+0000 7fc8077fe700 1 --2- 172.21.15.37:0/1218717343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8080b24d0 0x7fc808156530 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc7f800c7e0 tx=0x7fc7f8007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.983+0000 7fc7fffff700 1 -- 172.21.15.37:0/1218717343 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8005b40 con 0x7fc8080b24d0 2023-10-06T02:23:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.983+0000 7fc7fffff700 1 -- 172.21.15.37:0/1218717343 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f8005cc0 con 0x7fc8080b24d0 2023-10-06T02:23:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.983+0000 7fc80e730700 1 -- 172.21.15.37:0/1218717343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f0009420 con 0x7fc8080b24d0 2023-10-06T02:23:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.983+0000 7fc7fffff700 1 -- 172.21.15.37:0/1218717343 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8007320 con 0x7fc8080b24d0 2023-10-06T02:23:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.983+0000 7fc80e730700 1 -- 172.21.15.37:0/1218717343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8080c4000 con 0x7fc8080b24d0 2023-10-06T02:23:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.984+0000 7fc80e730700 1 -- 172.21.15.37:0/1218717343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc808088b20 con 0x7fc8080b24d0 2023-10-06T02:23:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.984+0000 7fc7fffff700 1 -- 172.21.15.37:0/1218717343 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc7f801b3b0 con 0x7fc8080b24d0 2023-10-06T02:23:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.985+0000 7fc7fffff700 1 --2- 172.21.15.37:0/1218717343 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc7e8066f30 0x7fc7e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.985+0000 7fc7fffff700 1 -- 172.21.15.37:0/1218717343 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fc7f8083bb0 con 0x7fc8080b24d0 2023-10-06T02:23:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.985+0000 7fc807fff700 1 --2- 172.21.15.37:0/1218717343 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc7e8066f30 0x7fc7e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.985+0000 7fc807fff700 1 --2- 172.21.15.37:0/1218717343 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc7e8066f30 0x7fc7e80693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00093f0 tx=0x7fc7f0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:56.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:56.989+0000 7fc7fffff700 1 -- 172.21.15.37:0/1218717343 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7f8050c70 con 0x7fc8080b24d0 2023-10-06T02:23:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.180+0000 7fc80e730700 1 -- 172.21.15.37:0/1218717343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc8080c4790 con 0x7fc8080b24d0 2023-10-06T02:23:57.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.841+0000 7fc7fffff700 1 -- 172.21.15.37:0/1218717343 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc7f8017020 con 0x7fc8080b24d0 2023-10-06T02:23:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.844+0000 7fc80e730700 1 -- 172.21.15.37:0/1218717343 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc7e8066f30 msgr2=0x7fc7e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.844+0000 7fc80e730700 1 --2- 172.21.15.37:0/1218717343 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc7e8066f30 0x7fc7e80693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00093f0 tx=0x7fc7f0017000 comp rx=0 tx=0).stop 2023-10-06T02:23:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.844+0000 7fc80e730700 1 -- 172.21.15.37:0/1218717343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8080b24d0 msgr2=0x7fc808156530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.844+0000 7fc80e730700 1 --2- 172.21.15.37:0/1218717343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8080b24d0 0x7fc808156530 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc7f800c7e0 tx=0x7fc7f8007de0 comp rx=0 tx=0).stop 2023-10-06T02:23:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.844+0000 7fc80e730700 1 -- 172.21.15.37:0/1218717343 shutdown_connections 2023-10-06T02:23:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.844+0000 7fc80e730700 1 --2- 172.21.15.37:0/1218717343 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc7e8066f30 0x7fc7e80693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.844+0000 7fc80e730700 1 --2- 172.21.15.37:0/1218717343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc808159550 0x7fc8080c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.844+0000 7fc80e730700 1 --2- 172.21.15.37:0/1218717343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc80806c7c0 0x7fc80815a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:57.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.844+0000 7fc80e730700 1 --2- 172.21.15.37:0/1218717343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8080b24d0 0x7fc808156530 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.844+0000 7fc80e730700 1 -- 172.21.15.37:0/1218717343 >> 172.21.15.37:0/1218717343 conn(0x7fc80806d900 msgr2=0x7fc8080cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.844+0000 7fc80e730700 1 -- 172.21.15.37:0/1218717343 shutdown_connections 2023-10-06T02:23:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.845+0000 7fc80e730700 1 -- 172.21.15.37:0/1218717343 wait complete. 2023-10-06T02:23:57.870 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:23:57.870 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:23:57.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.996+0000 7f424a3e9700 1 Processor -- start 2023-10-06T02:23:57.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.996+0000 7f424a3e9700 1 -- start start 2023-10-06T02:23:58.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.997+0000 7f424a3e9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4244154f60 0x7f424415bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:58.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.997+0000 7f424a3e9700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f42440680a0 0x7f42440cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:58.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.997+0000 7f424a3e9700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4244158df0 con 0x7f4244157be0 2023-10-06T02:23:58.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.997+0000 7f424a3e9700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42440b13c0 con 0x7f4244154f60 2023-10-06T02:23:58.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.997+0000 7f424a3e9700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f424415c120 con 0x7f42440680a0 2023-10-06T02:23:58.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.997+0000 7f4243fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4244154f60 0x7f424415bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:58.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.997+0000 7f42437fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4244157be0 0x7f4244067990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40086/0 (socket says 172.21.15.37:40086) 2023-10-06T02:23:58.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.997+0000 7f42437fe700 1 -- 172.21.15.37:0/2449945805 learned_addr learned my addr 172.21.15.37:0/2449945805 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:58.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.998+0000 7f4248986700 1 --2- 172.21.15.37:0/2449945805 >> v2:172.21.15.191:3300/0 conn(0x7f42440680a0 0x7f42440cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:58.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.998+0000 7f4243fff700 1 -- 172.21.15.37:0/2449945805 >> v2:172.21.15.191:3300/0 conn(0x7f42440680a0 msgr2=0x7f42440cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:58.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.998+0000 7f4243fff700 1 --2- 172.21.15.37:0/2449945805 >> v2:172.21.15.191:3300/0 conn(0x7f42440680a0 0x7f42440cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:58.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.998+0000 7f4243fff700 1 -- 172.21.15.37:0/2449945805 >> v1:172.21.15.37:6789/0 conn(0x7f4244157be0 legacy=0x7f4244067990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:58.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.998+0000 7f4243fff700 1 -- 172.21.15.37:0/2449945805 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42440cbf50 con 0x7f4244154f60 2023-10-06T02:23:58.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.998+0000 7f4242ffd700 1 -- 172.21.15.37:0/2449945805 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865978070 0 0) 0x7f4244158df0 con 0x7f4244157be0 2023-10-06T02:23:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.998+0000 7f4243fff700 1 --2- 172.21.15.37:0/2449945805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4244154f60 0x7f424415bbe0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f42440cb7b0 tx=0x7f422c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f107848e850819e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.998+0000 7f4242ffd700 1 -- 172.21.15.37:0/2449945805 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c00b6b0 con 0x7f4244154f60 2023-10-06T02:23:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.998+0000 7f4242ffd700 1 -- 172.21.15.37:0/2449945805 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c00b810 con 0x7f4244154f60 2023-10-06T02:23:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.998+0000 7f4242ffd700 1 -- 172.21.15.37:0/2449945805 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c00bbb0 con 0x7f4244154f60 2023-10-06T02:23:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.999+0000 7f424a3e9700 1 -- 172.21.15.37:0/2449945805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4244154f60 msgr2=0x7f424415bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.999+0000 7f424a3e9700 1 --2- 172.21.15.37:0/2449945805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4244154f60 0x7f424415bbe0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f42440cb7b0 tx=0x7f422c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.999+0000 7f424a3e9700 1 -- 172.21.15.37:0/2449945805 shutdown_connections 2023-10-06T02:23:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.999+0000 7f424a3e9700 1 --2- 172.21.15.37:0/2449945805 >> v2:172.21.15.191:3300/0 conn(0x7f42440680a0 0x7f42440cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.999+0000 7f424a3e9700 1 --2- 172.21.15.37:0/2449945805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4244154f60 0x7f424415bbe0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.999+0000 7f424a3e9700 1 -- 172.21.15.37:0/2449945805 >> 172.21.15.37:0/2449945805 conn(0x7f42440ce360 msgr2=0x7f42440ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.999+0000 7f424a3e9700 1 -- 172.21.15.37:0/2449945805 shutdown_connections 2023-10-06T02:23:58.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:57.999+0000 7f424a3e9700 1 -- 172.21.15.37:0/2449945805 wait complete. 2023-10-06T02:23:58.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.000+0000 7f424a3e9700 1 Processor -- start 2023-10-06T02:23:58.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.000+0000 7f424a3e9700 1 -- start start 2023-10-06T02:23:58.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f424a3e9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42440680a0 0x7f42440c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:58.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f424a3e9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4244154f60 0x7f4244156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f424a3e9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4244157be0 0x7f4244169ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f424a3e9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424406dc30 con 0x7f4244157be0 2023-10-06T02:23:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f424a3e9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4244157380 con 0x7f4244154f60 2023-10-06T02:23:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f424a3e9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42440c8b40 con 0x7f42440680a0 2023-10-06T02:23:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f4248986700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4244157be0 0x7f4244169ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f4248986700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4244157be0 0x7f4244169ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51086/0 (socket says 172.21.15.37:51086) 2023-10-06T02:23:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f4248986700 1 -- 172.21.15.37:0/124892913 learned_addr learned my addr 172.21.15.37:0/124892913 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f42437fe700 1 --2- 172.21.15.37:0/124892913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4244154f60 0x7f4244156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f4243fff700 1 --2- 172.21.15.37:0/124892913 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42440680a0 0x7f42440c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f4248986700 1 -- 172.21.15.37:0/124892913 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42440680a0 msgr2=0x7f42440c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f4248986700 1 --2- 172.21.15.37:0/124892913 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42440680a0 0x7f42440c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f4248986700 1 -- 172.21.15.37:0/124892913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4244154f60 msgr2=0x7f4244156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f4248986700 1 --2- 172.21.15.37:0/124892913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4244154f60 0x7f4244156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f4248986700 1 -- 172.21.15.37:0/124892913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c009420 con 0x7f4244157be0 2023-10-06T02:23:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f42437fe700 1 --2- 172.21.15.37:0/124892913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4244154f60 0x7f4244156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f4243fff700 1 --2- 172.21.15.37:0/124892913 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42440680a0 0x7f42440c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:23:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f4248986700 1 --2- 172.21.15.37:0/124892913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4244157be0 0x7f4244169ba0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f423c007f50 tx=0x7f423c0098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f423bfff700 1 -- 172.21.15.37:0/124892913 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c00ec70 con 0x7f4244157be0 2023-10-06T02:23:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f423bfff700 1 -- 172.21.15.37:0/124892913 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c00edf0 con 0x7f4244157be0 2023-10-06T02:23:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f424a3e9700 1 -- 172.21.15.37:0/124892913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4244156840 con 0x7f4244157be0 2023-10-06T02:23:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f423bfff700 1 -- 172.21.15.37:0/124892913 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c014670 con 0x7f4244157be0 2023-10-06T02:23:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.001+0000 7f424a3e9700 1 -- 172.21.15.37:0/124892913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4244156b90 con 0x7f4244157be0 2023-10-06T02:23:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.002+0000 7f424a3e9700 1 -- 172.21.15.37:0/124892913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f424406d990 con 0x7f4244157be0 2023-10-06T02:23:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.003+0000 7f423bfff700 1 -- 172.21.15.37:0/124892913 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f423c014a60 con 0x7f4244157be0 2023-10-06T02:23:58.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.003+0000 7f423bfff700 1 --2- 172.21.15.37:0/124892913 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4224066f30 0x7f42240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:58.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.003+0000 7f423bfff700 1 -- 172.21.15.37:0/124892913 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f423c084c10 con 0x7f4244157be0 2023-10-06T02:23:58.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.003+0000 7f4243fff700 1 --2- 172.21.15.37:0/124892913 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4224066f30 0x7f42240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:58.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.004+0000 7f4243fff700 1 --2- 172.21.15.37:0/124892913 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4224066f30 0x7f42240693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f422c003080 tx=0x7f422c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:58.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.008+0000 7f423bfff700 1 -- 172.21.15.37:0/124892913 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f424406d990 con 0x7f4244157be0 2023-10-06T02:23:58.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.199+0000 7f424a3e9700 1 -- 172.21.15.37:0/124892913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f424406d990 con 0x7f4244157be0 2023-10-06T02:23:58.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.847+0000 7f423bfff700 1 -- 172.21.15.37:0/124892913 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f424406d990 con 0x7f4244157be0 2023-10-06T02:23:58.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.851+0000 7f424a3e9700 1 -- 172.21.15.37:0/124892913 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4224066f30 msgr2=0x7f42240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:58.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.851+0000 7f424a3e9700 1 --2- 172.21.15.37:0/124892913 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4224066f30 0x7f42240693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f422c003080 tx=0x7f422c017000 comp rx=0 tx=0).stop 2023-10-06T02:23:58.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.851+0000 7f424a3e9700 1 -- 172.21.15.37:0/124892913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4244157be0 msgr2=0x7f4244169ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:58.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.851+0000 7f424a3e9700 1 --2- 172.21.15.37:0/124892913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4244157be0 0x7f4244169ba0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f423c007f50 tx=0x7f423c0098a0 comp rx=0 tx=0).stop 2023-10-06T02:23:58.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.851+0000 7f424a3e9700 1 -- 172.21.15.37:0/124892913 shutdown_connections 2023-10-06T02:23:58.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.851+0000 7f424a3e9700 1 --2- 172.21.15.37:0/124892913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4244157be0 0x7f4244169ba0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:58.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.851+0000 7f424a3e9700 1 --2- 172.21.15.37:0/124892913 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42440680a0 0x7f42440c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:58.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.851+0000 7f424a3e9700 1 --2- 172.21.15.37:0/124892913 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4224066f30 0x7f42240693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:58.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.851+0000 7f424a3e9700 1 --2- 172.21.15.37:0/124892913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4244154f60 0x7f4244156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:58.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.851+0000 7f424a3e9700 1 -- 172.21.15.37:0/124892913 >> 172.21.15.37:0/124892913 conn(0x7f42440ce360 msgr2=0x7f42440b1780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:58.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.852+0000 7f424a3e9700 1 -- 172.21.15.37:0/124892913 shutdown_connections 2023-10-06T02:23:58.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:58.852+0000 7f424a3e9700 1 -- 172.21.15.37:0/124892913 wait complete. 2023-10-06T02:23:58.888 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-10-06T02:23:58.889 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:23:58.889 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:23:58.889 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:23:58.889 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:23:58.889 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:23:58.890 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:23:58.890 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:23:58.890 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:23:58.890 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:23:58.890 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:23:58.890 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:23:58.890 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:23:58.891 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:23:58.891 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:23:58.891 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:23:58.891 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:23:58.899 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:23:58.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:23:58.900 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:23:58.901 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:23:58.902 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:23:58.902 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:23:58.903 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:23:58.903 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:23:58.943 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:23:58.962 DEBUG:teuthology.parallel:result is None 2023-10-06T02:23:58.963 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:23:58.963 DEBUG:teuthology.parallel:result is None 2023-10-06T02:23:58.964 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:23:58.964 DEBUG:teuthology.parallel:result is None 2023-10-06T02:23:58.965 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:23:58.965 DEBUG:teuthology.parallel:result is None 2023-10-06T02:23:58.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:23:59.022 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-10-06T02:23:59.022 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-10-06T02:23:59.046 INFO:tasks.ceph.mds.b.smithi191.stdout:starting mds.b at 2023-10-06T02:23:59.046 INFO:tasks.ceph.mds.d.smithi191.stdout:starting mds.d at 2023-10-06T02:23:59.047 INFO:tasks.ceph.mds.b.smithi191.stderr:2023-10-06T02:23:59.045+0000 7f155d7a7700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-06T02:23:59.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.090+0000 7f4c4d892700 1 Processor -- start 2023-10-06T02:23:59.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.090+0000 7f4c4d892700 1 -- start start 2023-10-06T02:23:59.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.091+0000 7f4c4d892700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c480b29d0 0x7f4c480ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:59.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.091+0000 7f4c4d892700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4c480cb170 0x7f4c480cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:59.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.091+0000 7f4c4d892700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c480b2da0 con 0x7f4c480cf340 2023-10-06T02:23:59.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.091+0000 7f4c4d892700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c48099bd0 con 0x7f4c480cb170 2023-10-06T02:23:59.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.091+0000 7f4c4d892700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c48159a70 con 0x7f4c480b29d0 2023-10-06T02:23:59.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.091+0000 7f4c467fc700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4c480cb170 0x7f4c480cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:59.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.091+0000 7f4c46ffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c480b29d0 0x7f4c480ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:59.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.091+0000 7f4c477fe700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f4c480cf340 0x7f4c480c5170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:48148/0 (socket says 172.21.15.37:48148) 2023-10-06T02:23:59.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.091+0000 7f4c467fc700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4c480cb170 0x7f4c480cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:43418/0 (socket says 172.21.15.37:43418) 2023-10-06T02:23:59.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.091+0000 7f4c46ffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c480b29d0 0x7f4c480ce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:56644/0 (socket says 172.21.15.37:56644) 2023-10-06T02:23:59.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.091+0000 7f4c477fe700 1 -- 172.21.15.37:0/3520046155 learned_addr learned my addr 172.21.15.37:0/3520046155 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:23:59.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.092+0000 7f4c467fc700 1 -- 172.21.15.37:0/3520046155 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c480b29d0 msgr2=0x7f4c480ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:23:59.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.092+0000 7f4c467fc700 1 --2- 172.21.15.37:0/3520046155 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c480b29d0 0x7f4c480ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.092+0000 7f4c467fc700 1 -- 172.21.15.37:0/3520046155 >> v1:172.21.15.191:6789/0 conn(0x7f4c480cf340 legacy=0x7f4c480c5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:59.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.092+0000 7f4c467fc700 1 -- 172.21.15.37:0/3520046155 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c480cb5e0 con 0x7f4c480cb170 2023-10-06T02:23:59.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.092+0000 7f4c45ffb700 1 -- 172.21.15.37:0/3520046155 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315745294 0 0) 0x7f4c40001490 con 0x7f4c480cf340 2023-10-06T02:23:59.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.092+0000 7f4c467fc700 1 --2- 172.21.15.37:0/3520046155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c480cb170 0x7f4c480cee00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c0098e0 tx=0x7f4c3c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8033f5ac25be56c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:59.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.092+0000 7f4c45ffb700 1 -- 172.21.15.37:0/3520046155 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c00b640 con 0x7f4c480cb170 2023-10-06T02:23:59.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.092+0000 7f4c45ffb700 1 -- 172.21.15.37:0/3520046155 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c00b7a0 con 0x7f4c480cb170 2023-10-06T02:23:59.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.092+0000 7f4c45ffb700 1 -- 172.21.15.37:0/3520046155 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c00bb40 con 0x7f4c480cb170 2023-10-06T02:23:59.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.093+0000 7f4c4d892700 1 -- 172.21.15.37:0/3520046155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c480cb170 msgr2=0x7f4c480cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:59.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.093+0000 7f4c4d892700 1 --2- 172.21.15.37:0/3520046155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c480cb170 0x7f4c480cee00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c0098e0 tx=0x7f4c3c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.093+0000 7f4c4d892700 1 -- 172.21.15.37:0/3520046155 shutdown_connections 2023-10-06T02:23:59.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.093+0000 7f4c4d892700 1 --2- 172.21.15.37:0/3520046155 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c480b29d0 0x7f4c480ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.093+0000 7f4c4d892700 1 --2- 172.21.15.37:0/3520046155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c480cb170 0x7f4c480cee00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.093+0000 7f4c4d892700 1 -- 172.21.15.37:0/3520046155 >> 172.21.15.37:0/3520046155 conn(0x7f4c48099610 msgr2=0x7f4c4806c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:59.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.093+0000 7f4c4d892700 1 -- 172.21.15.37:0/3520046155 shutdown_connections 2023-10-06T02:23:59.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.093+0000 7f4c4d892700 1 -- 172.21.15.37:0/3520046155 wait complete. 2023-10-06T02:23:59.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.094+0000 7f4c4d892700 1 Processor -- start 2023-10-06T02:23:59.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.094+0000 7f4c4d892700 1 -- start start 2023-10-06T02:23:59.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c4d892700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c480b29d0 0x7f4c480b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:59.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c4d892700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c480cb170 0x7f4c480b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c4d892700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c480cf340 0x7f4c48155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c4d892700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4815abf0 con 0x7f4c480cf340 2023-10-06T02:23:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c4d892700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4815ad80 con 0x7f4c480cb170 2023-10-06T02:23:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c4d892700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c480b3870 con 0x7f4c480b29d0 2023-10-06T02:23:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c477fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c480cf340 0x7f4c48155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c46ffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c480b29d0 0x7f4c480b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c46ffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c480b29d0 0x7f4c480b3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:56656/0 (socket says 172.21.15.37:56656) 2023-10-06T02:23:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c46ffd700 1 -- 172.21.15.37:0/926874275 learned_addr learned my addr 172.21.15.37:0/926874275 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:23:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c467fc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c480cb170 0x7f4c480b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c477fe700 1 -- 172.21.15.37:0/926874275 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c480b29d0 msgr2=0x7f4c480b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c477fe700 1 --2- 172.21.15.37:0/926874275 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c480b29d0 0x7f4c480b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c477fe700 1 -- 172.21.15.37:0/926874275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c480cb170 msgr2=0x7f4c480b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:59.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c477fe700 1 --2- 172.21.15.37:0/926874275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c480cb170 0x7f4c480b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c477fe700 1 -- 172.21.15.37:0/926874275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3c009420 con 0x7f4c480cf340 2023-10-06T02:23:59.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c467fc700 1 --2- 172.21.15.37:0/926874275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c480cb170 0x7f4c480b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:23:59.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c477fe700 1 --2- 172.21.15.37:0/926874275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c480cf340 0x7f4c48155980 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000cbc0 tx=0x7f4c400018f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:59.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c2effd700 1 -- 172.21.15.37:0/926874275 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000a740 con 0x7f4c480cf340 2023-10-06T02:23:59.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c2effd700 1 -- 172.21.15.37:0/926874275 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4000a8a0 con 0x7f4c480cf340 2023-10-06T02:23:59.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c2effd700 1 -- 172.21.15.37:0/926874275 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000ac60 con 0x7f4c480cf340 2023-10-06T02:23:59.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.095+0000 7f4c4d892700 1 -- 172.21.15.37:0/926874275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c480b3b50 con 0x7f4c480cf340 2023-10-06T02:23:59.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.096+0000 7f4c4d892700 1 -- 172.21.15.37:0/926874275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c480b4110 con 0x7f4c480cf340 2023-10-06T02:23:59.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.096+0000 7f4c4d892700 1 -- 172.21.15.37:0/926874275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c480c7010 con 0x7f4c480cf340 2023-10-06T02:23:59.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.097+0000 7f4c2effd700 1 -- 172.21.15.37:0/926874275 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c40007300 con 0x7f4c480cf340 2023-10-06T02:23:59.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.097+0000 7f4c2effd700 1 --2- 172.21.15.37:0/926874275 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4c34066f30 0x7f4c340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:23:59.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.097+0000 7f4c2effd700 1 -- 172.21.15.37:0/926874275 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f4c400843e0 con 0x7f4c480cf340 2023-10-06T02:23:59.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.097+0000 7f4c46ffd700 1 --2- 172.21.15.37:0/926874275 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4c34066f30 0x7f4c340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:23:59.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.098+0000 7f4c46ffd700 1 --2- 172.21.15.37:0/926874275 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4c34066f30 0x7f4c340693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4c38009e70 tx=0x7f4c380091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:23:59.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.101+0000 7f4c2effd700 1 -- 172.21.15.37:0/926874275 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c40051870 con 0x7f4c480cf340 2023-10-06T02:23:59.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.313+0000 7f4c4d892700 1 -- 172.21.15.37:0/926874275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4c480b2da0 con 0x7f4c480cf340 2023-10-06T02:23:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.861+0000 7f4c2effd700 1 -- 172.21.15.37:0/926874275 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4c480b2da0 con 0x7f4c480cf340 2023-10-06T02:23:59.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.864+0000 7f4c4d892700 1 -- 172.21.15.37:0/926874275 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4c34066f30 msgr2=0x7f4c340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:59.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.864+0000 7f4c4d892700 1 --2- 172.21.15.37:0/926874275 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4c34066f30 0x7f4c340693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4c38009e70 tx=0x7f4c380091a0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.864+0000 7f4c4d892700 1 -- 172.21.15.37:0/926874275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c480cf340 msgr2=0x7f4c48155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:23:59.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.864+0000 7f4c4d892700 1 --2- 172.21.15.37:0/926874275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c480cf340 0x7f4c48155980 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000cbc0 tx=0x7f4c400018f0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.864+0000 7f4c4d892700 1 -- 172.21.15.37:0/926874275 shutdown_connections 2023-10-06T02:23:59.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.864+0000 7f4c4d892700 1 --2- 172.21.15.37:0/926874275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c480cf340 0x7f4c48155980 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.864+0000 7f4c4d892700 1 --2- 172.21.15.37:0/926874275 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c480b29d0 0x7f4c480b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.864+0000 7f4c4d892700 1 --2- 172.21.15.37:0/926874275 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4c34066f30 0x7f4c340693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.864+0000 7f4c4d892700 1 --2- 172.21.15.37:0/926874275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c480cb170 0x7f4c480b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:23:59.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.864+0000 7f4c4d892700 1 -- 172.21.15.37:0/926874275 >> 172.21.15.37:0/926874275 conn(0x7f4c48099610 msgr2=0x7f4c480cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:23:59.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.864+0000 7f4c4d892700 1 -- 172.21.15.37:0/926874275 shutdown_connections 2023-10-06T02:23:59.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:23:59.864+0000 7f4c4d892700 1 -- 172.21.15.37:0/926874275 wait complete. 2023-10-06T02:23:59.868 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-10-06T02:23:59.880 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:24:00.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.004+0000 7f56a727b700 1 Processor -- start 2023-10-06T02:24:00.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.004+0000 7f56a727b700 1 -- start start 2023-10-06T02:24:00.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.005+0000 7f56a727b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f56a00c2be0 0x7f56a01559b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:00.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.005+0000 7f56a727b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56a00c1550 0x7f56a00c1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:00.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.005+0000 7f56a727b700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a006a590 con 0x7f56a01555e0 2023-10-06T02:24:00.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.005+0000 7f56a727b700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a00c1ec0 con 0x7f56a00c2be0 2023-10-06T02:24:00.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.005+0000 7f56a727b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a006aa20 con 0x7f56a00c1550 2023-10-06T02:24:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.005+0000 7f56a5a78700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f56a00c2be0 0x7f56a01559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.005+0000 7f56a6a7a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56a00c1550 0x7f56a00c1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.005+0000 7f56a6a7a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56a00c1550 0x7f56a00c1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:56658/0 (socket says 172.21.15.37:56658) 2023-10-06T02:24:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.005+0000 7f56a6a7a700 1 -- 172.21.15.37:0/264162702 learned_addr learned my addr 172.21.15.37:0/264162702 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.006+0000 7f56a5a78700 1 -- 172.21.15.37:0/264162702 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56a00c1550 msgr2=0x7f56a00c1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.006+0000 7f56a5a78700 1 --2- 172.21.15.37:0/264162702 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56a00c1550 0x7f56a00c1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.006+0000 7f56a5a78700 1 -- 172.21.15.37:0/264162702 >> v1:172.21.15.191:6789/0 conn(0x7f56a01555e0 legacy=0x7f56a00c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.006+0000 7f56a5a78700 1 -- 172.21.15.37:0/264162702 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a0069980 con 0x7f56a00c2be0 2023-10-06T02:24:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.006+0000 7f56a6a7a700 1 --2- 172.21.15.37:0/264162702 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56a00c1550 0x7f56a00c1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:24:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.006+0000 7f56a5277700 1 -- 172.21.15.37:0/264162702 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797304996 0 0) 0x7f56a006a590 con 0x7f56a01555e0 2023-10-06T02:24:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.006+0000 7f56a5a78700 1 --2- 172.21.15.37:0/264162702 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56a00c2be0 0x7f56a01559b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f56940098e0 tx=0x7f56940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=708b5371d3fb30a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.006+0000 7f56a5277700 1 -- 172.21.15.37:0/264162702 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569400b640 con 0x7f56a00c2be0 2023-10-06T02:24:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.006+0000 7f56a5277700 1 -- 172.21.15.37:0/264162702 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569400b7a0 con 0x7f56a00c2be0 2023-10-06T02:24:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.006+0000 7f56a5277700 1 -- 172.21.15.37:0/264162702 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569400bb40 con 0x7f56a00c2be0 2023-10-06T02:24:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.007+0000 7f56a727b700 1 -- 172.21.15.37:0/264162702 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56a00c2be0 msgr2=0x7f56a01559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.007+0000 7f56a727b700 1 --2- 172.21.15.37:0/264162702 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56a00c2be0 0x7f56a01559b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f56940098e0 tx=0x7f56940091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.007+0000 7f56a727b700 1 -- 172.21.15.37:0/264162702 shutdown_connections 2023-10-06T02:24:00.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.007+0000 7f56a727b700 1 --2- 172.21.15.37:0/264162702 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56a00c1550 0x7f56a00c1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.007+0000 7f56a727b700 1 --2- 172.21.15.37:0/264162702 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56a00c2be0 0x7f56a01559b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.007+0000 7f56a727b700 1 -- 172.21.15.37:0/264162702 >> 172.21.15.37:0/264162702 conn(0x7f56a00cbf20 msgr2=0x7f56a00cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:00.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.007+0000 7f56a727b700 1 -- 172.21.15.37:0/264162702 shutdown_connections 2023-10-06T02:24:00.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.007+0000 7f56a727b700 1 -- 172.21.15.37:0/264162702 wait complete. 2023-10-06T02:24:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.008+0000 7f56a727b700 1 Processor -- start 2023-10-06T02:24:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.008+0000 7f56a727b700 1 -- start start 2023-10-06T02:24:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.008+0000 7f56a727b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56a00c1550 0x7f56a00c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.008+0000 7f56a727b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56a00c2be0 0x7f56a006dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.008+0000 7f56a727b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56a01555e0 0x7f56a006e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.009+0000 7f56a727b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a014bcc0 con 0x7f56a01555e0 2023-10-06T02:24:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.009+0000 7f56a727b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a014af90 con 0x7f56a00c1550 2023-10-06T02:24:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.009+0000 7f56a727b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a014a380 con 0x7f56a00c2be0 2023-10-06T02:24:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.009+0000 7f56a6a7a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56a01555e0 0x7f56a006e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.009+0000 7f56a6a7a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56a01555e0 0x7f56a006e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51134/0 (socket says 172.21.15.37:51134) 2023-10-06T02:24:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.009+0000 7f56a6a7a700 1 -- 172.21.15.37:0/622350609 learned_addr learned my addr 172.21.15.37:0/622350609 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:00.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.009+0000 7f56a5a78700 1 --2- 172.21.15.37:0/622350609 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56a00c2be0 0x7f56a006dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:00.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.009+0000 7f56a6279700 1 --2- 172.21.15.37:0/622350609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56a00c1550 0x7f56a00c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:00.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.009+0000 7f56a6a7a700 1 -- 172.21.15.37:0/622350609 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56a00c2be0 msgr2=0x7f56a006dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:00.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.009+0000 7f56a6a7a700 1 --2- 172.21.15.37:0/622350609 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56a00c2be0 0x7f56a006dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.009+0000 7f56a6a7a700 1 -- 172.21.15.37:0/622350609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56a00c1550 msgr2=0x7f56a00c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:00.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.009+0000 7f56a6a7a700 1 --2- 172.21.15.37:0/622350609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56a00c1550 0x7f56a00c59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.009+0000 7f56a6a7a700 1 -- 172.21.15.37:0/622350609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56980094f0 con 0x7f56a01555e0 2023-10-06T02:24:00.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.009+0000 7f56a6a7a700 1 --2- 172.21.15.37:0/622350609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56a01555e0 0x7f56a006e4e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f569800ec50 tx=0x7f5698009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:00.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.009+0000 7f569e7fc700 1 -- 172.21.15.37:0/622350609 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569800c850 con 0x7f56a01555e0 2023-10-06T02:24:00.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.009+0000 7f569e7fc700 1 -- 172.21.15.37:0/622350609 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569800c9b0 con 0x7f56a01555e0 2023-10-06T02:24:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.009+0000 7f56a727b700 1 -- 172.21.15.37:0/622350609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5694009420 con 0x7f56a01555e0 2023-10-06T02:24:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.009+0000 7f569e7fc700 1 -- 172.21.15.37:0/622350609 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569800cd50 con 0x7f56a01555e0 2023-10-06T02:24:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.009+0000 7f56a727b700 1 -- 172.21.15.37:0/622350609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a014a940 con 0x7f56a01555e0 2023-10-06T02:24:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.010+0000 7f56a727b700 1 -- 172.21.15.37:0/622350609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a014b100 con 0x7f56a01555e0 2023-10-06T02:24:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.011+0000 7f569e7fc700 1 -- 172.21.15.37:0/622350609 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5698013680 con 0x7f56a01555e0 2023-10-06T02:24:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.011+0000 7f569e7fc700 1 --2- 172.21.15.37:0/622350609 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f568c066f30 0x7f568c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.011+0000 7f569e7fc700 1 -- 172.21.15.37:0/622350609 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f56980845f0 con 0x7f56a01555e0 2023-10-06T02:24:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.011+0000 7f56a6279700 1 --2- 172.21.15.37:0/622350609 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f568c066f30 0x7f568c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.012+0000 7f56a6279700 1 --2- 172.21.15.37:0/622350609 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f568c066f30 0x7f568c0693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5690007fd0 tx=0x7f5690001640 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:00.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.015+0000 7f569e7fc700 1 -- 172.21.15.37:0/622350609 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5698051a50 con 0x7f56a01555e0 2023-10-06T02:24:00.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.285+0000 7f56a727b700 1 -- 172.21.15.37:0/622350609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f56a0064b00 con 0x7f56a01555e0 2023-10-06T02:24:00.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.285+0000 7f569e7fc700 1 -- 172.21.15.37:0/622350609 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f5698055070 con 0x7f56a01555e0 2023-10-06T02:24:00.287 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:00.287 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:24:00.287 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-10-06T02:24:00.287 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.287 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-10-06T02:24:00.287 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lkQF5HRAAmDbVzKumixz+mz8C9Ibu4w==", 2023-10-06T02:24:00.287 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.287 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:24:00.288 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T02:24:00.288 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T02:24:00.288 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:00.288 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.288 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.288 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.288 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-10-06T02:24:00.288 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lpPDVKBAAdg+chey8icfN9/u/REprEw==", 2023-10-06T02:24:00.288 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.288 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:24:00.288 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T02:24:00.289 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T02:24:00.289 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:00.289 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.289 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.289 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.289 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-10-06T02:24:00.289 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lSQ5oJBAAvXZ5RKQNOEujDD8kM0QU+Q==", 2023-10-06T02:24:00.289 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.289 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:24:00.289 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T02:24:00.289 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T02:24:00.289 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:00.290 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.290 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.290 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.290 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-10-06T02:24:00.290 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lE5adLxAAb6XIxhNYBl7FVcprFY526g==", 2023-10-06T02:24:00.290 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.290 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:24:00.290 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T02:24:00.290 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T02:24:00.290 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:00.290 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.290 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.290 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.291 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-10-06T02:24:00.291 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBjbx9lLEJuDRAA5astKYoPcHwja09KROk+tQ==", 2023-10-06T02:24:00.291 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.291 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:00.291 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:24:00.291 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:00.291 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.291 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.291 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.291 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-10-06T02:24:00.291 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBmbx9lwdVEDBAA5TMlEiE5UAavPJzdV22Gtw==", 2023-10-06T02:24:00.291 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.291 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:00.292 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:24:00.292 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:00.292 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.292 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.292 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.292 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-10-06T02:24:00.292 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBpbx9lF5UeChAA1fYYSrtxmm7yMS4pn/hacQ==", 2023-10-06T02:24:00.292 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.292 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:00.292 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:24:00.293 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:00.293 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.293 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.293 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.293 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-10-06T02:24:00.293 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBsbx9l3oTYCBAADYVyJ6Yt2sZfXhundjqceQ==", 2023-10-06T02:24:00.293 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.293 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:00.293 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:24:00.293 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:00.293 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.293 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.293 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.294 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-10-06T02:24:00.294 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBybx9lhrfuCBAA7A97uVPnZDT9ia70W5180A==", 2023-10-06T02:24:00.294 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.294 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:00.294 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:24:00.294 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:00.294 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.294 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.294 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.294 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-10-06T02:24:00.294 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQB1bx9lEntaBxAAzvIEHp4iJvnev2yuqPL3tA==", 2023-10-06T02:24:00.295 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.295 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:00.295 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:24:00.295 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:00.295 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.295 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.295 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.295 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-10-06T02:24:00.295 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQB4bx9lZaxXBxAAE+FsUplhP39hVXuZ4btCqQ==", 2023-10-06T02:24:00.295 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.295 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:00.295 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:24:00.295 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:00.296 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.296 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.296 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.296 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-10-06T02:24:00.296 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQB7bx9lAtvBBhAAZzUs75blYnu3OocrsTVHSg==", 2023-10-06T02:24:00.296 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.296 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:00.296 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:24:00.296 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:00.296 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.296 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.296 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.297 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-10-06T02:24:00.297 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9llHl0MxAAPrpwRuKiAcn+W0aDwzBvvQ==", 2023-10-06T02:24:00.297 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.297 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:24:00.297 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T02:24:00.297 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T02:24:00.297 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T02:24:00.297 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.297 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.297 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.297 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-10-06T02:24:00.297 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBgbx9lgp1AABAA+oAQVt7MWVsWnRxbWVLNbA==", 2023-10-06T02:24:00.297 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.298 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:24:00.298 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T02:24:00.298 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T02:24:00.298 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T02:24:00.298 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.298 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.298 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.298 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-10-06T02:24:00.298 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lByLlOBAAeTJLSorscEidED7VHIPKCg==", 2023-10-06T02:24:00.299 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.299 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:24:00.299 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T02:24:00.299 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T02:24:00.299 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T02:24:00.299 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.299 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.299 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.299 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-10-06T02:24:00.299 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBgbx9l6LuWBRAAvYfXvGvgMYDPlB4CgKaNqw==", 2023-10-06T02:24:00.299 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.299 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:24:00.299 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T02:24:00.300 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T02:24:00.300 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T02:24:00.300 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.300 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.300 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.300 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-10-06T02:24:00.300 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lgayZAhAA9VQix+78KreRH/YEeftPQA==", 2023-10-06T02:24:00.300 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.300 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T02:24:00.300 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T02:24:00.300 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T02:24:00.300 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:00.301 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.301 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.301 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.301 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mds", 2023-10-06T02:24:00.301 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCAbx9lKS4UMxAA4yVoDYiigcecHPQLy0adkA==", 2023-10-06T02:24:00.301 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.301 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T02:24:00.301 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.301 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.301 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.301 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T02:24:00.301 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCAbx9l9jkUMxAA+iZ/3OBYsNB44p1mkKbUhg==", 2023-10-06T02:24:00.302 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.302 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T02:24:00.302 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.302 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.302 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.302 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-osd", 2023-10-06T02:24:00.302 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCAbx9lZ0MUMxAA6YeycF92lAhIsZSms7AYkA==", 2023-10-06T02:24:00.302 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.302 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T02:24:00.302 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.302 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.302 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.302 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T02:24:00.303 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCAbx9lxksUMxAAJoqKv2ih/XRyw8o+kYUV3A==", 2023-10-06T02:24:00.303 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.303 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T02:24:00.303 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.303 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.303 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.303 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T02:24:00.303 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCAbx9lPlQUMxAAXsGiAvG0T7sJ6GFRTW6xCg==", 2023-10-06T02:24:00.303 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.303 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T02:24:00.303 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.303 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.304 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.304 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T02:24:00.304 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCAbx9l9lwUMxAA6xy5KJZcNmzMOn5VLMg3fQ==", 2023-10-06T02:24:00.304 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.304 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T02:24:00.304 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.304 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.304 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.304 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-10-06T02:24:00.304 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lg7hcGhAAelKPvNX7CL80KycBGoQ8cw==", 2023-10-06T02:24:00.304 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.304 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T02:24:00.305 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-10-06T02:24:00.305 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:00.305 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.305 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:00.305 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:00.305 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-10-06T02:24:00.305 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9l5BH7FhAAotvMdV8pKCJzZUqTviL3CQ==", 2023-10-06T02:24:00.305 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:00.305 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T02:24:00.305 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-10-06T02:24:00.305 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:00.305 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.306 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:00.306 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-06T02:24:00.306 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:24:00.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.287+0000 7f56a727b700 1 -- 172.21.15.37:0/622350609 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f568c066f30 msgr2=0x7f568c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:00.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.287+0000 7f56a727b700 1 --2- 172.21.15.37:0/622350609 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f568c066f30 0x7f568c0693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5690007fd0 tx=0x7f5690001640 comp rx=0 tx=0).stop 2023-10-06T02:24:00.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.287+0000 7f56a727b700 1 -- 172.21.15.37:0/622350609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56a01555e0 msgr2=0x7f56a006e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:00.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.287+0000 7f56a727b700 1 --2- 172.21.15.37:0/622350609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56a01555e0 0x7f56a006e4e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f569800ec50 tx=0x7f5698009250 comp rx=0 tx=0).stop 2023-10-06T02:24:00.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.287+0000 7f56a727b700 1 -- 172.21.15.37:0/622350609 shutdown_connections 2023-10-06T02:24:00.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.287+0000 7f56a727b700 1 --2- 172.21.15.37:0/622350609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56a01555e0 0x7f56a006e4e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.287+0000 7f56a727b700 1 --2- 172.21.15.37:0/622350609 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f568c066f30 0x7f568c0693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.287+0000 7f56a727b700 1 --2- 172.21.15.37:0/622350609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56a00c1550 0x7f56a00c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.287+0000 7f56a727b700 1 --2- 172.21.15.37:0/622350609 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56a00c2be0 0x7f56a006dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.287+0000 7f56a727b700 1 -- 172.21.15.37:0/622350609 >> 172.21.15.37:0/622350609 conn(0x7f56a00cbf20 msgr2=0x7f56a014d670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:00.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.288+0000 7f56a727b700 1 -- 172.21.15.37:0/622350609 shutdown_connections 2023-10-06T02:24:00.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.288+0000 7f56a727b700 1 -- 172.21.15.37:0/622350609 wait complete. 2023-10-06T02:24:00.308 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T02:24:00.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.426+0000 7f58779af700 1 Processor -- start 2023-10-06T02:24:00.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.426+0000 7f58779af700 1 -- start start 2023-10-06T02:24:00.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.427+0000 7f58779af700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f587006c640 0x7f58700b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:00.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.427+0000 7f58779af700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5870159820 0x7f587015de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:00.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.427+0000 7f58779af700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58700b3270 con 0x7f587006c270 2023-10-06T02:24:00.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.427+0000 7f58779af700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587015e340 con 0x7f587006c640 2023-10-06T02:24:00.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.427+0000 7f58779af700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5870159ca0 con 0x7f5870159820 2023-10-06T02:24:00.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.427+0000 7f587574b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f587006c270 0x7f5870159110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40112/0 (socket says 172.21.15.37:40112) 2023-10-06T02:24:00.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.427+0000 7f587574b700 1 -- 172.21.15.37:0/3382554131 learned_addr learned my addr 172.21.15.37:0/3382554131 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f586ffff700 1 -- 172.21.15.37:0/3382554131 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463782339 0 0) 0x7f58700b3270 con 0x7f587006c270 2023-10-06T02:24:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f5874f4a700 1 --2- 172.21.15.37:0/3382554131 >> v2:172.21.15.191:3300/0 conn(0x7f587006c640 0x7f58700b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f586ffff700 1 -- 172.21.15.37:0/3382554131 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5858003570 con 0x7f587006c270 2023-10-06T02:24:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f5875f4c700 1 --2- 172.21.15.37:0/3382554131 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5870159820 0x7f587015de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f586ffff700 1 -- 172.21.15.37:0/3382554131 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 219436671 0 0) 0x7f5858003570 con 0x7f587006c270 2023-10-06T02:24:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f586ffff700 1 -- 172.21.15.37:0/3382554131 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5870159820 msgr2=0x7f587015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f586ffff700 1 --2- 172.21.15.37:0/3382554131 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5870159820 0x7f587015de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f586ffff700 1 -- 172.21.15.37:0/3382554131 >> v2:172.21.15.191:3300/0 conn(0x7f587006c640 msgr2=0x7f58700b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:00.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f586ffff700 1 --2- 172.21.15.37:0/3382554131 >> v2:172.21.15.191:3300/0 conn(0x7f587006c640 0x7f58700b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f586ffff700 1 -- 172.21.15.37:0/3382554131 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58700b07a0 con 0x7f587006c270 2023-10-06T02:24:00.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f586ffff700 1 -- 172.21.15.37:0/3382554131 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f5868001470 con 0x7f587006c270 2023-10-06T02:24:00.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f586ffff700 1 -- 172.21.15.37:0/3382554131 >> v1:172.21.15.37:6789/0 conn(0x7f587006c270 legacy=0x7f5870159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:00.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f586ffff700 1 --2- 172.21.15.37:0/3382554131 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5858003a60 0x7f5858003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:00.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f586ffff700 1 --2- 172.21.15.37:0/3382554131 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5870159820 0x7f5858004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:00.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f586ffff700 1 --2- 172.21.15.37:0/3382554131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5858004d50 0x7f58580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:00.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f586ffff700 1 -- 172.21.15.37:0/3382554131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587015e340 con 0x7f5858004d50 2023-10-06T02:24:00.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f586ffff700 1 -- 172.21.15.37:0/3382554131 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5870159ca0 con 0x7f5858003a60 2023-10-06T02:24:00.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f586ffff700 1 -- 172.21.15.37:0/3382554131 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585800ba60 con 0x7f5870159820 2023-10-06T02:24:00.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f5875f4c700 1 --2- 172.21.15.37:0/3382554131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5858004d50 0x7f58580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:00.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f5874f4a700 1 --2- 172.21.15.37:0/3382554131 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5870159820 0x7f5858004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:00.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f587574b700 1 --2- 172.21.15.37:0/3382554131 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5858003a60 0x7f5858003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:00.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f5875f4c700 1 -- 172.21.15.37:0/3382554131 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5870159820 msgr2=0x7f5858004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:00.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f5875f4c700 1 --2- 172.21.15.37:0/3382554131 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5870159820 0x7f5858004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f5875f4c700 1 -- 172.21.15.37:0/3382554131 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5858003a60 msgr2=0x7f5858003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:00.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f5875f4c700 1 --2- 172.21.15.37:0/3382554131 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5858003a60 0x7f5858003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.428+0000 7f5875f4c700 1 -- 172.21.15.37:0/3382554131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5858003570 con 0x7f5858004d50 2023-10-06T02:24:00.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.429+0000 7f5875f4c700 1 --2- 172.21.15.37:0/3382554131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5858004d50 0x7f58580051c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f586000e210 tx=0x7f586000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c89d9792a2423ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.429+0000 7f586ffff700 1 -- 172.21.15.37:0/3382554131 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586000ea60 con 0x7f5858004d50 2023-10-06T02:24:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.429+0000 7f586ffff700 1 -- 172.21.15.37:0/3382554131 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586000f040 con 0x7f5858004d50 2023-10-06T02:24:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.429+0000 7f586ffff700 1 -- 172.21.15.37:0/3382554131 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586000ee10 con 0x7f5858004d50 2023-10-06T02:24:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.429+0000 7f58779af700 1 -- 172.21.15.37:0/3382554131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5858004d50 msgr2=0x7f58580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.429+0000 7f58779af700 1 --2- 172.21.15.37:0/3382554131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5858004d50 0x7f58580051c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f586000e210 tx=0x7f586000b040 comp rx=0 tx=0).stop 2023-10-06T02:24:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.429+0000 7f5875f4c700 1 -- 172.21.15.37:0/3382554131 reap_dead start 2023-10-06T02:24:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.429+0000 7f58779af700 1 -- 172.21.15.37:0/3382554131 shutdown_connections 2023-10-06T02:24:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.429+0000 7f58779af700 1 -- 172.21.15.37:0/3382554131 >> 172.21.15.37:0/3382554131 conn(0x7f58700ccf30 msgr2=0x7f58700cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.429+0000 7f58779af700 1 -- 172.21.15.37:0/3382554131 shutdown_connections 2023-10-06T02:24:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.429+0000 7f58779af700 1 -- 172.21.15.37:0/3382554131 wait complete. 2023-10-06T02:24:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.430+0000 7f58779af700 1 Processor -- start 2023-10-06T02:24:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.431+0000 7f58779af700 1 -- start start 2023-10-06T02:24:00.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.431+0000 7f58779af700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5858004d50 0x7f587014d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:00.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.431+0000 7f58779af700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58700b3ee0 0x7f58700b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:00.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.431+0000 7f58779af700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58700c4400 0x7f58700c4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:00.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.431+0000 7f58779af700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58700c74d0 con 0x7f5858004d50 2023-10-06T02:24:00.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.431+0000 7f58779af700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58700b4890 con 0x7f58700b3ee0 2023-10-06T02:24:00.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.431+0000 7f58779af700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587015b6e0 con 0x7f58700c4400 2023-10-06T02:24:00.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.431+0000 7f587574b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5858004d50 0x7f587014d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.431+0000 7f587574b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5858004d50 0x7f587014d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51158/0 (socket says 172.21.15.37:51158) 2023-10-06T02:24:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.431+0000 7f587574b700 1 -- 172.21.15.37:0/1231339911 learned_addr learned my addr 172.21.15.37:0/1231339911 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.432+0000 7f5874f4a700 1 --2- 172.21.15.37:0/1231339911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58700b3ee0 0x7f58700b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.432+0000 7f5875f4c700 1 --2- 172.21.15.37:0/1231339911 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58700c4400 0x7f58700c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.432+0000 7f587574b700 1 -- 172.21.15.37:0/1231339911 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58700c4400 msgr2=0x7f58700c4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.432+0000 7f587574b700 1 --2- 172.21.15.37:0/1231339911 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58700c4400 0x7f58700c4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.432+0000 7f587574b700 1 -- 172.21.15.37:0/1231339911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58700b3ee0 msgr2=0x7f58700b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.432+0000 7f587574b700 1 --2- 172.21.15.37:0/1231339911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58700b3ee0 0x7f58700b4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.432+0000 7f587574b700 1 -- 172.21.15.37:0/1231339911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58700c5170 con 0x7f5858004d50 2023-10-06T02:24:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.432+0000 7f587574b700 1 --2- 172.21.15.37:0/1231339911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5858004d50 0x7f587014d810 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5868001d20 tx=0x7f5868001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.432+0000 7f586d7fa700 1 -- 172.21.15.37:0/1231339911 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868018030 con 0x7f5858004d50 2023-10-06T02:24:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.432+0000 7f586d7fa700 1 -- 172.21.15.37:0/1231339911 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5868007740 con 0x7f5858004d50 2023-10-06T02:24:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.432+0000 7f58779af700 1 -- 172.21.15.37:0/1231339911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58700c5450 con 0x7f5858004d50 2023-10-06T02:24:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.432+0000 7f586d7fa700 1 -- 172.21.15.37:0/1231339911 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586800faf0 con 0x7f5858004d50 2023-10-06T02:24:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.432+0000 7f58779af700 1 -- 172.21.15.37:0/1231339911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587015b370 con 0x7f5858004d50 2023-10-06T02:24:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.433+0000 7f58779af700 1 -- 172.21.15.37:0/1231339911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5870088310 con 0x7f5858004d50 2023-10-06T02:24:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.434+0000 7f586d7fa700 1 -- 172.21.15.37:0/1231339911 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f586801b070 con 0x7f5858004d50 2023-10-06T02:24:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.434+0000 7f586d7fa700 1 --2- 172.21.15.37:0/1231339911 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f585c066f30 0x7f585c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.434+0000 7f586d7fa700 1 -- 172.21.15.37:0/1231339911 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5868019070 con 0x7f5858004d50 2023-10-06T02:24:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.434+0000 7f5874f4a700 1 --2- 172.21.15.37:0/1231339911 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f585c066f30 0x7f585c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.435+0000 7f5874f4a700 1 --2- 172.21.15.37:0/1231339911 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f585c066f30 0x7f585c0693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5870157750 tx=0x7f58640091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:00.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.438+0000 7f586d7fa700 1 -- 172.21.15.37:0/1231339911 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58680515f0 con 0x7f5858004d50 2023-10-06T02:24:00.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.709+0000 7f58779af700 1 -- 172.21.15.37:0/1231339911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f58700b1440 con 0x7f5858004d50 2023-10-06T02:24:00.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.712+0000 7f586d7fa700 1 -- 172.21.15.37:0/1231339911 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5868054c10 con 0x7f5858004d50 2023-10-06T02:24:00.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.714+0000 7f58779af700 1 -- 172.21.15.37:0/1231339911 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f585c066f30 msgr2=0x7f585c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:00.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.714+0000 7f58779af700 1 --2- 172.21.15.37:0/1231339911 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f585c066f30 0x7f585c0693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5870157750 tx=0x7f58640091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.714+0000 7f58779af700 1 -- 172.21.15.37:0/1231339911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5858004d50 msgr2=0x7f587014d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:00.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.714+0000 7f58779af700 1 --2- 172.21.15.37:0/1231339911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5858004d50 0x7f587014d810 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5868001d20 tx=0x7f5868001e90 comp rx=0 tx=0).stop 2023-10-06T02:24:00.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.714+0000 7f58779af700 1 -- 172.21.15.37:0/1231339911 shutdown_connections 2023-10-06T02:24:00.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.714+0000 7f58779af700 1 --2- 172.21.15.37:0/1231339911 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58700c4400 0x7f58700c4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.714+0000 7f58779af700 1 --2- 172.21.15.37:0/1231339911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5858004d50 0x7f587014d810 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.714+0000 7f58779af700 1 --2- 172.21.15.37:0/1231339911 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f585c066f30 0x7f585c0693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.714+0000 7f58779af700 1 --2- 172.21.15.37:0/1231339911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58700b3ee0 0x7f58700b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.714+0000 7f58779af700 1 -- 172.21.15.37:0/1231339911 >> 172.21.15.37:0/1231339911 conn(0x7f58700ccf30 msgr2=0x7f58700703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:00.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.715+0000 7f58779af700 1 -- 172.21.15.37:0/1231339911 shutdown_connections 2023-10-06T02:24:00.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.715+0000 7f58779af700 1 -- 172.21.15.37:0/1231339911 wait complete. 2023-10-06T02:24:00.728 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T02:24:00.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.845+0000 7f82efd58700 1 Processor -- start 2023-10-06T02:24:00.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.846+0000 7f82efd58700 1 -- start start 2023-10-06T02:24:00.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.846+0000 7f82efd58700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f82e81575f0 0x7f82e806c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.846+0000 7f82efd58700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e8069cd0 con 0x7f82e80c76c0 2023-10-06T02:24:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.846+0000 7f82efd58700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e806ab30 con 0x7f82e8157220 2023-10-06T02:24:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.846+0000 7f82efd58700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e8069f20 con 0x7f82e81575f0 2023-10-06T02:24:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.846+0000 7f82ed2f3700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f82e80c76c0 0x7f82e806c220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40120/0 (socket says 172.21.15.37:40120) 2023-10-06T02:24:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.847+0000 7f82ed2f3700 1 -- 172.21.15.37:0/3513439832 learned_addr learned my addr 172.21.15.37:0/3513439832 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.847+0000 7f82ee2f5700 1 --2- 172.21.15.37:0/3513439832 >> v2:172.21.15.191:3300/0 conn(0x7f82e81575f0 0x7f82e806c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.847+0000 7f82ecaf2700 1 -- 172.21.15.37:0/3513439832 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3675738616 0 0) 0x7f82e8069cd0 con 0x7f82e80c76c0 2023-10-06T02:24:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.847+0000 7f82ecaf2700 1 -- 172.21.15.37:0/3513439832 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82d0003570 con 0x7f82e80c76c0 2023-10-06T02:24:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.847+0000 7f82ee2f5700 1 -- 172.21.15.37:0/3513439832 >> v1:172.21.15.191:6789/0 conn(0x7f82e8157220 legacy=0x7f82e80c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:00.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.847+0000 7f82ecaf2700 1 -- 172.21.15.37:0/3513439832 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2901935510 0 0) 0x7f82d0003570 con 0x7f82e80c76c0 2023-10-06T02:24:00.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.847+0000 7f82ee2f5700 1 -- 172.21.15.37:0/3513439832 >> v1:172.21.15.37:6789/0 conn(0x7f82e80c76c0 legacy=0x7f82e806c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:00.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.847+0000 7f82ee2f5700 1 -- 172.21.15.37:0/3513439832 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e806a200 con 0x7f82e81575f0 2023-10-06T02:24:00.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.848+0000 7f82ee2f5700 1 --2- 172.21.15.37:0/3513439832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82e81575f0 0x7f82e806c930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f82d8009e60 tx=0x7f82d8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56625d344e222de2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:00.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.850+0000 7f82ecaf2700 1 -- 172.21.15.37:0/3513439832 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d800e070 con 0x7f82e81575f0 2023-10-06T02:24:00.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.850+0000 7f82ecaf2700 1 -- 172.21.15.37:0/3513439832 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d800b850 con 0x7f82e81575f0 2023-10-06T02:24:00.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.850+0000 7f82ecaf2700 1 -- 172.21.15.37:0/3513439832 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc001470 con 0x7f82e81575f0 2023-10-06T02:24:00.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.851+0000 7f82efd58700 1 -- 172.21.15.37:0/3513439832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82e81575f0 msgr2=0x7f82e806c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:00.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.851+0000 7f82efd58700 1 --2- 172.21.15.37:0/3513439832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82e81575f0 0x7f82e806c930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f82d8009e60 tx=0x7f82d8009780 comp rx=0 tx=0).stop 2023-10-06T02:24:00.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.851+0000 7f82efd58700 1 -- 172.21.15.37:0/3513439832 shutdown_connections 2023-10-06T02:24:00.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.851+0000 7f82efd58700 1 --2- 172.21.15.37:0/3513439832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82e81575f0 0x7f82e806c930 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.851+0000 7f82efd58700 1 -- 172.21.15.37:0/3513439832 >> 172.21.15.37:0/3513439832 conn(0x7f82e80cc970 msgr2=0x7f82e80ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:00.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.851+0000 7f82efd58700 1 -- 172.21.15.37:0/3513439832 shutdown_connections 2023-10-06T02:24:00.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.851+0000 7f82efd58700 1 -- 172.21.15.37:0/3513439832 wait complete. 2023-10-06T02:24:00.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.852+0000 7f82efd58700 1 Processor -- start 2023-10-06T02:24:00.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.852+0000 7f82efd58700 1 -- start start 2023-10-06T02:24:00.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.853+0000 7f82efd58700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82e80c76c0 0x7f82e80c3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:00.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.853+0000 7f82efd58700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82e8157220 0x7f82e8150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:00.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.853+0000 7f82efd58700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82e81575f0 0x7f82e814eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:00.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.853+0000 7f82efd58700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80ca750 con 0x7f82e8157220 2023-10-06T02:24:00.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.853+0000 7f82efd58700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80caa30 con 0x7f82e80c76c0 2023-10-06T02:24:00.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.853+0000 7f82efd58700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80cad10 con 0x7f82e81575f0 2023-10-06T02:24:00.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.853+0000 7f82ed2f3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82e8157220 0x7f82e8150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:00.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.853+0000 7f82ed2f3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82e8157220 0x7f82e8150580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51168/0 (socket says 172.21.15.37:51168) 2023-10-06T02:24:00.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.853+0000 7f82ed2f3700 1 -- 172.21.15.37:0/4159984163 learned_addr learned my addr 172.21.15.37:0/4159984163 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:00.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.853+0000 7f82edaf4700 1 --2- 172.21.15.37:0/4159984163 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82e80c76c0 0x7f82e80c3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:00.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.853+0000 7f82ee2f5700 1 --2- 172.21.15.37:0/4159984163 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82e81575f0 0x7f82e814eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:00.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.853+0000 7f82ed2f3700 1 -- 172.21.15.37:0/4159984163 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82e81575f0 msgr2=0x7f82e814eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:00.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.853+0000 7f82ed2f3700 1 --2- 172.21.15.37:0/4159984163 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82e81575f0 0x7f82e814eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.853+0000 7f82ed2f3700 1 -- 172.21.15.37:0/4159984163 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82e80c76c0 msgr2=0x7f82e80c3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:00.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.853+0000 7f82ed2f3700 1 --2- 172.21.15.37:0/4159984163 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82e80c76c0 0x7f82e80c3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:00.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.853+0000 7f82ed2f3700 1 -- 172.21.15.37:0/4159984163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d8009a20 con 0x7f82e8157220 2023-10-06T02:24:00.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.854+0000 7f82ed2f3700 1 --2- 172.21.15.37:0/4159984163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82e8157220 0x7f82e8150580 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00cb90 tx=0x7f82dc001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:00.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.854+0000 7f82e5ffb700 1 -- 172.21.15.37:0/4159984163 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc007150 con 0x7f82e8157220 2023-10-06T02:24:00.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.854+0000 7f82e5ffb700 1 -- 172.21.15.37:0/4159984163 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82dc0072d0 con 0x7f82e8157220 2023-10-06T02:24:00.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.854+0000 7f82efd58700 1 -- 172.21.15.37:0/4159984163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e80caff0 con 0x7f82e8157220 2023-10-06T02:24:00.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.854+0000 7f82e5ffb700 1 -- 172.21.15.37:0/4159984163 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc007690 con 0x7f82e8157220 2023-10-06T02:24:00.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.854+0000 7f82efd58700 1 -- 172.21.15.37:0/4159984163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e8150ac0 con 0x7f82e8157220 2023-10-06T02:24:00.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.855+0000 7f82e5ffb700 1 -- 172.21.15.37:0/4159984163 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82dc004a40 con 0x7f82e8157220 2023-10-06T02:24:00.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.855+0000 7f82efd58700 1 -- 172.21.15.37:0/4159984163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e80697b0 con 0x7f82e8157220 2023-10-06T02:24:00.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.856+0000 7f82e5ffb700 1 --2- 172.21.15.37:0/4159984163 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f82d4066f30 0x7f82d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:00.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.856+0000 7f82e5ffb700 1 -- 172.21.15.37:0/4159984163 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f82dc0839b0 con 0x7f82e8157220 2023-10-06T02:24:00.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.856+0000 7f82edaf4700 1 --2- 172.21.15.37:0/4159984163 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f82d4066f30 0x7f82d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:00.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.856+0000 7f82edaf4700 1 --2- 172.21.15.37:0/4159984163 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f82d4066f30 0x7f82d40693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f82e0003a80 tx=0x7f82e0007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:00.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:00.860+0000 7f82e5ffb700 1 -- 172.21.15.37:0/4159984163 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82dc050e90 con 0x7f82e8157220 2023-10-06T02:24:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.134+0000 7f82efd58700 1 -- 172.21.15.37:0/4159984163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f82e806a4e0 con 0x7f82e8157220 2023-10-06T02:24:01.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.138+0000 7f82e5ffb700 1 -- 172.21.15.37:0/4159984163 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f82dc018020 con 0x7f82e8157220 2023-10-06T02:24:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.140+0000 7f82efd58700 1 -- 172.21.15.37:0/4159984163 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f82d4066f30 msgr2=0x7f82d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.140+0000 7f82efd58700 1 --2- 172.21.15.37:0/4159984163 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f82d4066f30 0x7f82d40693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f82e0003a80 tx=0x7f82e0007ec0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.140+0000 7f82efd58700 1 -- 172.21.15.37:0/4159984163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82e8157220 msgr2=0x7f82e8150580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.140+0000 7f82efd58700 1 --2- 172.21.15.37:0/4159984163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82e8157220 0x7f82e8150580 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00cb90 tx=0x7f82dc001ad0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.140+0000 7f82efd58700 1 -- 172.21.15.37:0/4159984163 shutdown_connections 2023-10-06T02:24:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.140+0000 7f82efd58700 1 --2- 172.21.15.37:0/4159984163 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82e81575f0 0x7f82e814eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.140+0000 7f82efd58700 1 --2- 172.21.15.37:0/4159984163 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f82d4066f30 0x7f82d40693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.140+0000 7f82efd58700 1 --2- 172.21.15.37:0/4159984163 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82e80c76c0 0x7f82e80c3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.140+0000 7f82efd58700 1 --2- 172.21.15.37:0/4159984163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82e8157220 0x7f82e8150580 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.140+0000 7f82efd58700 1 -- 172.21.15.37:0/4159984163 >> 172.21.15.37:0/4159984163 conn(0x7f82e80cc970 msgr2=0x7f82e80ccd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:01.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.140+0000 7f82efd58700 1 -- 172.21.15.37:0/4159984163 shutdown_connections 2023-10-06T02:24:01.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.140+0000 7f82efd58700 1 -- 172.21.15.37:0/4159984163 wait complete. 2023-10-06T02:24:01.153 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T02:24:01.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.271+0000 7f9840243700 1 Processor -- start 2023-10-06T02:24:01.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.272+0000 7f9840243700 1 -- start start 2023-10-06T02:24:01.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.272+0000 7f9840243700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f98381595a0 0x7f98380b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:01.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.272+0000 7f9840243700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98380b1000 con 0x7f983806dfa0 2023-10-06T02:24:01.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.272+0000 7f9840243700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983815d750 con 0x7f9838159970 2023-10-06T02:24:01.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.272+0000 7f9840243700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983815da30 con 0x7f98381595a0 2023-10-06T02:24:01.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.273+0000 7f983e7e0700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f983806dfa0 0x7f98380aee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40128/0 (socket says 172.21.15.37:40128) 2023-10-06T02:24:01.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.273+0000 7f983e7e0700 1 -- 172.21.15.37:0/3746181098 learned_addr learned my addr 172.21.15.37:0/3746181098 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:01.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.273+0000 7f983dfdf700 1 --2- 172.21.15.37:0/3746181098 >> v2:172.21.15.191:3300/0 conn(0x7f98381595a0 0x7f98380b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:01.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.273+0000 7f983cfdd700 1 -- 172.21.15.37:0/3746181098 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967398679 0 0) 0x7f98380b1000 con 0x7f983806dfa0 2023-10-06T02:24:01.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.273+0000 7f983cfdd700 1 -- 172.21.15.37:0/3746181098 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9820003570 con 0x7f983806dfa0 2023-10-06T02:24:01.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.273+0000 7f983cfdd700 1 -- 172.21.15.37:0/3746181098 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 360546590 0 0) 0x7f9820003570 con 0x7f983806dfa0 2023-10-06T02:24:01.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.273+0000 7f983cfdd700 1 -- 172.21.15.37:0/3746181098 >> v2:172.21.15.191:3300/0 conn(0x7f98381595a0 msgr2=0x7f98380b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:01.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.273+0000 7f983cfdd700 1 --2- 172.21.15.37:0/3746181098 >> v2:172.21.15.191:3300/0 conn(0x7f98381595a0 0x7f98380b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.273+0000 7f983cfdd700 1 -- 172.21.15.37:0/3746181098 >> v1:172.21.15.191:6789/0 conn(0x7f9838159970 legacy=0x7f983806d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:01.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.273+0000 7f983cfdd700 1 -- 172.21.15.37:0/3746181098 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983815dd10 con 0x7f983806dfa0 2023-10-06T02:24:01.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.273+0000 7f983cfdd700 1 -- 172.21.15.37:0/3746181098 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f98280017f0 con 0x7f983806dfa0 2023-10-06T02:24:01.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.273+0000 7f983cfdd700 1 -- 172.21.15.37:0/3746181098 >> v1:172.21.15.37:6789/0 conn(0x7f983806dfa0 legacy=0x7f98380aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:01.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.273+0000 7f983cfdd700 1 --2- 172.21.15.37:0/3746181098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9820003a60 0x7f9820003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:01.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.273+0000 7f983cfdd700 1 --2- 172.21.15.37:0/3746181098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9820004810 0x7f9820004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:01.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.273+0000 7f983cfdd700 1 --2- 172.21.15.37:0/3746181098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98200051c0 0x7f982000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:01.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.273+0000 7f983cfdd700 1 -- 172.21.15.37:0/3746181098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983815da30 con 0x7f98200051c0 2023-10-06T02:24:01.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.273+0000 7f983cfdd700 1 -- 172.21.15.37:0/3746181098 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98200148e0 con 0x7f9820004810 2023-10-06T02:24:01.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.273+0000 7f983cfdd700 1 -- 172.21.15.37:0/3746181098 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9820014aa0 con 0x7f9820003a60 2023-10-06T02:24:01.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.273+0000 7f983e7e0700 1 --2- 172.21.15.37:0/3746181098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98200051c0 0x7f982000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:01.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.274+0000 7f983d7de700 1 --2- 172.21.15.37:0/3746181098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9820004810 0x7f9820004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:01.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.274+0000 7f983dfdf700 1 --2- 172.21.15.37:0/3746181098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9820003a60 0x7f9820003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:01.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.274+0000 7f983e7e0700 1 -- 172.21.15.37:0/3746181098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9820003a60 msgr2=0x7f9820003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:01.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.274+0000 7f983e7e0700 1 --2- 172.21.15.37:0/3746181098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9820003a60 0x7f9820003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.274+0000 7f983e7e0700 1 -- 172.21.15.37:0/3746181098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9820004810 msgr2=0x7f9820004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:01.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.274+0000 7f983e7e0700 1 --2- 172.21.15.37:0/3746181098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9820004810 0x7f9820004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.274+0000 7f983e7e0700 1 -- 172.21.15.37:0/3746181098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9820003570 con 0x7f98200051c0 2023-10-06T02:24:01.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.274+0000 7f983e7e0700 1 -- 172.21.15.37:0/3746181098 reap_dead start 2023-10-06T02:24:01.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.274+0000 7f983e7e0700 1 --2- 172.21.15.37:0/3746181098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98200051c0 0x7f982000ba60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f982800a900 tx=0x7f98280021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefcd50af61cf6dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:01.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.274+0000 7f983cfdd700 1 -- 172.21.15.37:0/3746181098 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98280070d0 con 0x7f98200051c0 2023-10-06T02:24:01.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.274+0000 7f983cfdd700 1 -- 172.21.15.37:0/3746181098 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9828007250 con 0x7f98200051c0 2023-10-06T02:24:01.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.274+0000 7f983cfdd700 1 -- 172.21.15.37:0/3746181098 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9828007610 con 0x7f98200051c0 2023-10-06T02:24:01.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.275+0000 7f9840243700 1 -- 172.21.15.37:0/3746181098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98200051c0 msgr2=0x7f982000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:01.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.275+0000 7f9840243700 1 --2- 172.21.15.37:0/3746181098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98200051c0 0x7f982000ba60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f982800a900 tx=0x7f98280021d0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.275+0000 7f9840243700 1 -- 172.21.15.37:0/3746181098 shutdown_connections 2023-10-06T02:24:01.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.275+0000 7f9840243700 1 --2- 172.21.15.37:0/3746181098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98200051c0 0x7f982000ba60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.275+0000 7f9840243700 1 -- 172.21.15.37:0/3746181098 >> 172.21.15.37:0/3746181098 conn(0x7f98380d04d0 msgr2=0x7f98380d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:01.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.275+0000 7f9840243700 1 -- 172.21.15.37:0/3746181098 shutdown_connections 2023-10-06T02:24:01.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.275+0000 7f9840243700 1 -- 172.21.15.37:0/3746181098 wait complete. 2023-10-06T02:24:01.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.276+0000 7f9840243700 1 Processor -- start 2023-10-06T02:24:01.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.276+0000 7f9840243700 1 -- start start 2023-10-06T02:24:01.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f9840243700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98200051c0 0x7f9838157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:01.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f9840243700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f983815bd80 0x7f983815c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:01.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f9840243700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98380c4720 0x7f98380c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:01.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f9840243700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983815c730 con 0x7f98380c4720 2023-10-06T02:24:01.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f9840243700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98380c54c0 con 0x7f98200051c0 2023-10-06T02:24:01.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f9840243700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98380c57a0 con 0x7f983815bd80 2023-10-06T02:24:01.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f983e7e0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98380c4720 0x7f98380c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:01.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f983e7e0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98380c4720 0x7f98380c4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51178/0 (socket says 172.21.15.37:51178) 2023-10-06T02:24:01.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f983e7e0700 1 -- 172.21.15.37:0/3291688835 learned_addr learned my addr 172.21.15.37:0/3291688835 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:01.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f983dfdf700 1 --2- 172.21.15.37:0/3291688835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98200051c0 0x7f9838157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:01.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f983d7de700 1 --2- 172.21.15.37:0/3291688835 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f983815bd80 0x7f983815c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:01.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f983e7e0700 1 -- 172.21.15.37:0/3291688835 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f983815bd80 msgr2=0x7f983815c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:01.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f983e7e0700 1 --2- 172.21.15.37:0/3291688835 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f983815bd80 0x7f983815c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f983e7e0700 1 -- 172.21.15.37:0/3291688835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98200051c0 msgr2=0x7f9838157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:01.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f983e7e0700 1 --2- 172.21.15.37:0/3291688835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98200051c0 0x7f9838157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f983e7e0700 1 -- 172.21.15.37:0/3291688835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98380c5a80 con 0x7f98380c4720 2023-10-06T02:24:01.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f983e7e0700 1 --2- 172.21.15.37:0/3291688835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98380c4720 0x7f98380c4b90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f982800a900 tx=0x7f9828016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:01.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f9835ffb700 1 -- 172.21.15.37:0/3291688835 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98280070d0 con 0x7f98380c4720 2023-10-06T02:24:01.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f9835ffb700 1 -- 172.21.15.37:0/3291688835 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98280075d0 con 0x7f98380c4720 2023-10-06T02:24:01.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f9835ffb700 1 -- 172.21.15.37:0/3291688835 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982801d670 con 0x7f98380c4720 2023-10-06T02:24:01.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.277+0000 7f9840243700 1 -- 172.21.15.37:0/3291688835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98380c5d60 con 0x7f98380c4720 2023-10-06T02:24:01.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.278+0000 7f9840243700 1 -- 172.21.15.37:0/3291688835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9838157fa0 con 0x7f98380c4720 2023-10-06T02:24:01.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.279+0000 7f9840243700 1 -- 172.21.15.37:0/3291688835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98380c7d90 con 0x7f98380c4720 2023-10-06T02:24:01.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.279+0000 7f9835ffb700 1 -- 172.21.15.37:0/3291688835 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f982801d9e0 con 0x7f98380c4720 2023-10-06T02:24:01.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.279+0000 7f9835ffb700 1 --2- 172.21.15.37:0/3291688835 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9824066f30 0x7f98240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:01.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.279+0000 7f9835ffb700 1 -- 172.21.15.37:0/3291688835 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9828086800 con 0x7f98380c4720 2023-10-06T02:24:01.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.280+0000 7f983dfdf700 1 --2- 172.21.15.37:0/3291688835 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9824066f30 0x7f98240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:01.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.280+0000 7f983dfdf700 1 --2- 172.21.15.37:0/3291688835 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9824066f30 0x7f98240693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9830006f00 tx=0x7f98300091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:01.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.284+0000 7f9835ffb700 1 -- 172.21.15.37:0/3291688835 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98380c7d90 con 0x7f98380c4720 2023-10-06T02:24:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.554+0000 7f9840243700 1 -- 172.21.15.37:0/3291688835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f983804bb80 con 0x7f98380c4720 2023-10-06T02:24:01.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.558+0000 7f9835ffb700 1 -- 172.21.15.37:0/3291688835 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9828053c60 con 0x7f98380c4720 2023-10-06T02:24:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.560+0000 7f9840243700 1 -- 172.21.15.37:0/3291688835 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9824066f30 msgr2=0x7f98240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.560+0000 7f9840243700 1 --2- 172.21.15.37:0/3291688835 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9824066f30 0x7f98240693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9830006f00 tx=0x7f98300091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.560+0000 7f9840243700 1 -- 172.21.15.37:0/3291688835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98380c4720 msgr2=0x7f98380c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.560+0000 7f9840243700 1 --2- 172.21.15.37:0/3291688835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98380c4720 0x7f98380c4b90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f982800a900 tx=0x7f9828016000 comp rx=0 tx=0).stop 2023-10-06T02:24:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.560+0000 7f9840243700 1 -- 172.21.15.37:0/3291688835 shutdown_connections 2023-10-06T02:24:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.560+0000 7f9840243700 1 --2- 172.21.15.37:0/3291688835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98380c4720 0x7f98380c4b90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.560+0000 7f9840243700 1 --2- 172.21.15.37:0/3291688835 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9824066f30 0x7f98240693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.560+0000 7f9840243700 1 --2- 172.21.15.37:0/3291688835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98200051c0 0x7f9838157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.560+0000 7f9840243700 1 --2- 172.21.15.37:0/3291688835 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f983815bd80 0x7f983815c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.560+0000 7f9840243700 1 -- 172.21.15.37:0/3291688835 >> 172.21.15.37:0/3291688835 conn(0x7f98380d04d0 msgr2=0x7f98380cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:01.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.560+0000 7f9840243700 1 -- 172.21.15.37:0/3291688835 shutdown_connections 2023-10-06T02:24:01.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.560+0000 7f9840243700 1 -- 172.21.15.37:0/3291688835 wait complete. 2023-10-06T02:24:01.574 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T02:24:01.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.693+0000 7f2d64ba6700 1 Processor -- start 2023-10-06T02:24:01.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.693+0000 7f2d64ba6700 1 -- start start 2023-10-06T02:24:01.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.694+0000 7f2d64ba6700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2d601564d0 0x7f2d600aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:01.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.694+0000 7f2d64ba6700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d6006c0b0 0x7f2d6006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:01.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.694+0000 7f2d64ba6700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6006a1e0 con 0x7f2d60156100 2023-10-06T02:24:01.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.694+0000 7f2d64ba6700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d600c9250 con 0x7f2d6006c0b0 2023-10-06T02:24:01.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.694+0000 7f2d64ba6700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6006cea0 con 0x7f2d601564d0 2023-10-06T02:24:01.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.694+0000 7f2d5ed9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d6006c0b0 0x7f2d6006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:01.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.694+0000 7f2d5e59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2d60156100 0x7f2d600ca540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40130/0 (socket says 172.21.15.37:40130) 2023-10-06T02:24:01.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.694+0000 7f2d5e59c700 1 -- 172.21.15.37:0/2313519888 learned_addr learned my addr 172.21.15.37:0/2313519888 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:01.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.694+0000 7f2d5dd9b700 1 --2- 172.21.15.37:0/2313519888 >> v2:172.21.15.191:3300/0 conn(0x7f2d601564d0 0x7f2d600aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:01.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.694+0000 7f2d5ed9d700 1 -- 172.21.15.37:0/2313519888 >> v2:172.21.15.191:3300/0 conn(0x7f2d601564d0 msgr2=0x7f2d600aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:01.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.694+0000 7f2d5ed9d700 1 --2- 172.21.15.37:0/2313519888 >> v2:172.21.15.191:3300/0 conn(0x7f2d601564d0 0x7f2d600aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.694+0000 7f2d5ed9d700 1 -- 172.21.15.37:0/2313519888 >> v1:172.21.15.37:6789/0 conn(0x7f2d60156100 legacy=0x7f2d600ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:01.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.694+0000 7f2d5ed9d700 1 -- 172.21.15.37:0/2313519888 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6006c9e0 con 0x7f2d6006c0b0 2023-10-06T02:24:01.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.694+0000 7f2d5d59a700 1 -- 172.21.15.37:0/2313519888 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094596711 0 0) 0x7f2d6006a1e0 con 0x7f2d60156100 2023-10-06T02:24:01.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.694+0000 7f2d5dd9b700 1 --2- 172.21.15.37:0/2313519888 >> v2:172.21.15.191:3300/0 conn(0x7f2d601564d0 0x7f2d600aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:01.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.694+0000 7f2d5ed9d700 1 --2- 172.21.15.37:0/2313519888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6006c0b0 0x7f2d6006c4a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2d60069c60 tx=0x7f2d50009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a424db8c52531e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:01.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.694+0000 7f2d5d59a700 1 -- 172.21.15.37:0/2313519888 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5000e070 con 0x7f2d6006c0b0 2023-10-06T02:24:01.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.694+0000 7f2d5d59a700 1 -- 172.21.15.37:0/2313519888 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5000bc30 con 0x7f2d6006c0b0 2023-10-06T02:24:01.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.694+0000 7f2d5d59a700 1 -- 172.21.15.37:0/2313519888 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d50012430 con 0x7f2d6006c0b0 2023-10-06T02:24:01.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.695+0000 7f2d64ba6700 1 -- 172.21.15.37:0/2313519888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6006c0b0 msgr2=0x7f2d6006c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:01.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.695+0000 7f2d64ba6700 1 --2- 172.21.15.37:0/2313519888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6006c0b0 0x7f2d6006c4a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2d60069c60 tx=0x7f2d50009780 comp rx=0 tx=0).stop 2023-10-06T02:24:01.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.695+0000 7f2d64ba6700 1 -- 172.21.15.37:0/2313519888 shutdown_connections 2023-10-06T02:24:01.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.695+0000 7f2d64ba6700 1 --2- 172.21.15.37:0/2313519888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6006c0b0 0x7f2d6006c4a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.695+0000 7f2d64ba6700 1 --2- 172.21.15.37:0/2313519888 >> v2:172.21.15.191:3300/0 conn(0x7f2d601564d0 0x7f2d600aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.695+0000 7f2d64ba6700 1 -- 172.21.15.37:0/2313519888 >> 172.21.15.37:0/2313519888 conn(0x7f2d600cc970 msgr2=0x7f2d600ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:01.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.695+0000 7f2d64ba6700 1 -- 172.21.15.37:0/2313519888 shutdown_connections 2023-10-06T02:24:01.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.695+0000 7f2d64ba6700 1 -- 172.21.15.37:0/2313519888 wait complete. 2023-10-06T02:24:01.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.696+0000 7f2d64ba6700 1 Processor -- start 2023-10-06T02:24:01.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.696+0000 7f2d64ba6700 1 -- start start 2023-10-06T02:24:01.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.697+0000 7f2d64ba6700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d6006c0b0 0x7f2d6015cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:01.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.697+0000 7f2d64ba6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d60156100 0x7f2d6015d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:01.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.697+0000 7f2d64ba6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d601564d0 0x7f2d60167910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:01.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.697+0000 7f2d64ba6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6016b1b0 con 0x7f2d60156100 2023-10-06T02:24:01.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.697+0000 7f2d64ba6700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6016aba0 con 0x7f2d6006c0b0 2023-10-06T02:24:01.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.697+0000 7f2d64ba6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d60156ef0 con 0x7f2d601564d0 2023-10-06T02:24:01.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.697+0000 7f2d5dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d60156100 0x7f2d6015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:01.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.697+0000 7f2d5dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d60156100 0x7f2d6015d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51198/0 (socket says 172.21.15.37:51198) 2023-10-06T02:24:01.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.697+0000 7f2d5dd9b700 1 -- 172.21.15.37:0/2287496679 learned_addr learned my addr 172.21.15.37:0/2287496679 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:01.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.697+0000 7f2d5e59c700 1 --2- 172.21.15.37:0/2287496679 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d6006c0b0 0x7f2d6015cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:01.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.697+0000 7f2d5ed9d700 1 --2- 172.21.15.37:0/2287496679 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d601564d0 0x7f2d60167910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:01.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.697+0000 7f2d5dd9b700 1 -- 172.21.15.37:0/2287496679 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d601564d0 msgr2=0x7f2d60167910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:01.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.697+0000 7f2d5dd9b700 1 --2- 172.21.15.37:0/2287496679 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d601564d0 0x7f2d60167910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.697+0000 7f2d5dd9b700 1 -- 172.21.15.37:0/2287496679 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d6006c0b0 msgr2=0x7f2d6015cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:01.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.697+0000 7f2d5dd9b700 1 --2- 172.21.15.37:0/2287496679 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d6006c0b0 0x7f2d6015cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.697+0000 7f2d5dd9b700 1 -- 172.21.15.37:0/2287496679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d50009a20 con 0x7f2d60156100 2023-10-06T02:24:01.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.697+0000 7f2d5dd9b700 1 --2- 172.21.15.37:0/2287496679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d60156100 0x7f2d6015d460 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2d4800c830 tx=0x7f2d48008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:01.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.698+0000 7f2d567fc700 1 -- 172.21.15.37:0/2287496679 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48011600 con 0x7f2d60156100 2023-10-06T02:24:01.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.698+0000 7f2d567fc700 1 -- 172.21.15.37:0/2287496679 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d48011760 con 0x7f2d60156100 2023-10-06T02:24:01.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.698+0000 7f2d567fc700 1 -- 172.21.15.37:0/2287496679 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48011b20 con 0x7f2d60156100 2023-10-06T02:24:01.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.698+0000 7f2d64ba6700 1 -- 172.21.15.37:0/2287496679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d60156c10 con 0x7f2d60156100 2023-10-06T02:24:01.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.698+0000 7f2d64ba6700 1 -- 172.21.15.37:0/2287496679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d601568a0 con 0x7f2d60156100 2023-10-06T02:24:01.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.699+0000 7f2d64ba6700 1 -- 172.21.15.37:0/2287496679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6016aa00 con 0x7f2d60156100 2023-10-06T02:24:01.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.699+0000 7f2d567fc700 1 -- 172.21.15.37:0/2287496679 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d4800a3e0 con 0x7f2d60156100 2023-10-06T02:24:01.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.700+0000 7f2d567fc700 1 --2- 172.21.15.37:0/2287496679 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2d40066f30 0x7f2d400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:01.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.700+0000 7f2d567fc700 1 -- 172.21.15.37:0/2287496679 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2d480848a0 con 0x7f2d60156100 2023-10-06T02:24:01.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.700+0000 7f2d5e59c700 1 --2- 172.21.15.37:0/2287496679 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2d40066f30 0x7f2d400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:01.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.700+0000 7f2d5e59c700 1 --2- 172.21.15.37:0/2287496679 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2d40066f30 0x7f2d400693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2d6015dba0 tx=0x7f2d58009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:01.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.704+0000 7f2d567fc700 1 -- 172.21.15.37:0/2287496679 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d6016aa00 con 0x7f2d60156100 2023-10-06T02:24:01.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.975+0000 7f2d64ba6700 1 -- 172.21.15.37:0/2287496679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f2d6016aa00 con 0x7f2d60156100 2023-10-06T02:24:01.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.979+0000 7f2d567fc700 1 -- 172.21.15.37:0/2287496679 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2d6016aa00 con 0x7f2d60156100 2023-10-06T02:24:01.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.981+0000 7f2d64ba6700 1 -- 172.21.15.37:0/2287496679 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2d40066f30 msgr2=0x7f2d400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:01.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.981+0000 7f2d64ba6700 1 --2- 172.21.15.37:0/2287496679 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2d40066f30 0x7f2d400693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2d6015dba0 tx=0x7f2d58009040 comp rx=0 tx=0).stop 2023-10-06T02:24:01.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.981+0000 7f2d64ba6700 1 -- 172.21.15.37:0/2287496679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d60156100 msgr2=0x7f2d6015d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:01.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.981+0000 7f2d64ba6700 1 --2- 172.21.15.37:0/2287496679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d60156100 0x7f2d6015d460 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2d4800c830 tx=0x7f2d48008040 comp rx=0 tx=0).stop 2023-10-06T02:24:01.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.981+0000 7f2d64ba6700 1 -- 172.21.15.37:0/2287496679 shutdown_connections 2023-10-06T02:24:01.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.981+0000 7f2d64ba6700 1 --2- 172.21.15.37:0/2287496679 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d601564d0 0x7f2d60167910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.981+0000 7f2d64ba6700 1 --2- 172.21.15.37:0/2287496679 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2d40066f30 0x7f2d400693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.981+0000 7f2d64ba6700 1 --2- 172.21.15.37:0/2287496679 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d6006c0b0 0x7f2d6015cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.981+0000 7f2d64ba6700 1 --2- 172.21.15.37:0/2287496679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d60156100 0x7f2d6015d460 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:01.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.981+0000 7f2d64ba6700 1 -- 172.21.15.37:0/2287496679 >> 172.21.15.37:0/2287496679 conn(0x7f2d600cc970 msgr2=0x7f2d600cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:01.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.981+0000 7f2d64ba6700 1 -- 172.21.15.37:0/2287496679 shutdown_connections 2023-10-06T02:24:01.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:01.981+0000 7f2d64ba6700 1 -- 172.21.15.37:0/2287496679 wait complete. 2023-10-06T02:24:01.994 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T02:24:02.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.113+0000 7fb1a7f15700 1 Processor -- start 2023-10-06T02:24:02.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.113+0000 7fb1a7f15700 1 -- start start 2023-10-06T02:24:02.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.113+0000 7fb1a7f15700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb1a006dab0 0x7fb1a00cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:02.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.114+0000 7fb1a7f15700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1a006de80 0x7fb1a00b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:02.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.114+0000 7fb1a7f15700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a00cc250 con 0x7fb1a00cb080 2023-10-06T02:24:02.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.114+0000 7fb1a7f15700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a00b0e00 con 0x7fb1a006dab0 2023-10-06T02:24:02.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.114+0000 7fb1a7f15700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a00ccc20 con 0x7fb1a006de80 2023-10-06T02:24:02.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.114+0000 7fb1a5cb1700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb1a006dab0 0x7fb1a00cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:02.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.114+0000 7fb1a64b2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1a006de80 0x7fb1a00b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:02.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.114+0000 7fb1a54b0700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fb1a00cb080 0x7fb1a00b01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:48182/0 (socket says 172.21.15.37:48182) 2023-10-06T02:24:02.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.114+0000 7fb1a64b2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1a006de80 0x7fb1a00b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:56732/0 (socket says 172.21.15.37:56732) 2023-10-06T02:24:02.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.114+0000 7fb1a5cb1700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb1a006dab0 0x7fb1a00cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:43538/0 (socket says 172.21.15.37:43538) 2023-10-06T02:24:02.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.114+0000 7fb1a54b0700 1 -- 172.21.15.37:0/3367566218 learned_addr learned my addr 172.21.15.37:0/3367566218 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:02.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.114+0000 7fb1a4caf700 1 -- 172.21.15.37:0/3367566218 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156896609 0 0) 0x7fb1a00cc250 con 0x7fb1a00cb080 2023-10-06T02:24:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.114+0000 7fb1a4caf700 1 -- 172.21.15.37:0/3367566218 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb188003570 con 0x7fb1a00cb080 2023-10-06T02:24:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.114+0000 7fb1a64b2700 1 -- 172.21.15.37:0/3367566218 >> v2:172.21.15.191:3300/0 conn(0x7fb1a006dab0 msgr2=0x7fb1a00cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.114+0000 7fb1a64b2700 1 --2- 172.21.15.37:0/3367566218 >> v2:172.21.15.191:3300/0 conn(0x7fb1a006dab0 0x7fb1a00cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.114+0000 7fb1a64b2700 1 -- 172.21.15.37:0/3367566218 >> v1:172.21.15.191:6789/0 conn(0x7fb1a00cb080 legacy=0x7fb1a00b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.114+0000 7fb1a64b2700 1 -- 172.21.15.37:0/3367566218 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a00cb640 con 0x7fb1a006de80 2023-10-06T02:24:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.114+0000 7fb1a5cb1700 1 --2- 172.21.15.37:0/3367566218 >> v2:172.21.15.191:3300/0 conn(0x7fb1a006dab0 0x7fb1a00cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:24:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.115+0000 7fb1a64b2700 1 --2- 172.21.15.37:0/3367566218 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1a006de80 0x7fb1a00b08c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb190009e60 tx=0x7fb190009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ce707543388cba3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.115+0000 7fb1a4caf700 1 -- 172.21.15.37:0/3367566218 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19000e070 con 0x7fb1a006de80 2023-10-06T02:24:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.115+0000 7fb1a4caf700 1 -- 172.21.15.37:0/3367566218 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19000bab0 con 0x7fb1a006de80 2023-10-06T02:24:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.115+0000 7fb1a4caf700 1 -- 172.21.15.37:0/3367566218 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19000be30 con 0x7fb1a006de80 2023-10-06T02:24:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.115+0000 7fb1a7f15700 1 -- 172.21.15.37:0/3367566218 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1a006de80 msgr2=0x7fb1a00b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.115+0000 7fb1a7f15700 1 --2- 172.21.15.37:0/3367566218 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1a006de80 0x7fb1a00b08c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb190009e60 tx=0x7fb190009780 comp rx=0 tx=0).stop 2023-10-06T02:24:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.115+0000 7fb1a7f15700 1 -- 172.21.15.37:0/3367566218 shutdown_connections 2023-10-06T02:24:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.115+0000 7fb1a7f15700 1 --2- 172.21.15.37:0/3367566218 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1a006de80 0x7fb1a00b08c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.115+0000 7fb1a7f15700 1 --2- 172.21.15.37:0/3367566218 >> v2:172.21.15.191:3300/0 conn(0x7fb1a006dab0 0x7fb1a00cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.115+0000 7fb1a7f15700 1 -- 172.21.15.37:0/3367566218 >> 172.21.15.37:0/3367566218 conn(0x7fb1a00d0510 msgr2=0x7fb1a00d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.115+0000 7fb1a7f15700 1 -- 172.21.15.37:0/3367566218 shutdown_connections 2023-10-06T02:24:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.115+0000 7fb1a7f15700 1 -- 172.21.15.37:0/3367566218 wait complete. 2023-10-06T02:24:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.116+0000 7fb1a7f15700 1 Processor -- start 2023-10-06T02:24:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.117+0000 7fb1a7f15700 1 -- start start 2023-10-06T02:24:02.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.117+0000 7fb1a7f15700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1a006dab0 0x7fb1a00b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.117+0000 7fb1a7f15700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a006de80 0x7fb1a015af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.117+0000 7fb1a7f15700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1a00cb080 0x7fb1a0147f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.117+0000 7fb1a7f15700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a015c2a0 con 0x7fb1a006de80 2023-10-06T02:24:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.117+0000 7fb1a7f15700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a015b690 con 0x7fb1a006dab0 2023-10-06T02:24:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.117+0000 7fb1a7f15700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a015b970 con 0x7fb1a00cb080 2023-10-06T02:24:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.117+0000 7fb1a54b0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a006de80 0x7fb1a015af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.117+0000 7fb1a54b0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a006de80 0x7fb1a015af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51212/0 (socket says 172.21.15.37:51212) 2023-10-06T02:24:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.117+0000 7fb1a54b0700 1 -- 172.21.15.37:0/3811564966 learned_addr learned my addr 172.21.15.37:0/3811564966 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.117+0000 7fb1a5cb1700 1 --2- 172.21.15.37:0/3811564966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1a006dab0 0x7fb1a00b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.118+0000 7fb1a64b2700 1 --2- 172.21.15.37:0/3811564966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1a00cb080 0x7fb1a0147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.118+0000 7fb1a54b0700 1 -- 172.21.15.37:0/3811564966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1a00cb080 msgr2=0x7fb1a0147f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.118+0000 7fb1a54b0700 1 --2- 172.21.15.37:0/3811564966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1a00cb080 0x7fb1a0147f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.118+0000 7fb1a54b0700 1 -- 172.21.15.37:0/3811564966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1a006dab0 msgr2=0x7fb1a00b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.118+0000 7fb1a54b0700 1 --2- 172.21.15.37:0/3811564966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1a006dab0 0x7fb1a00b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.118+0000 7fb1a54b0700 1 -- 172.21.15.37:0/3811564966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb198009420 con 0x7fb1a006de80 2023-10-06T02:24:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.118+0000 7fb1a54b0700 1 --2- 172.21.15.37:0/3811564966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a006de80 0x7fb1a015af90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb1940011e0 tx=0x7fb194007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.118+0000 7fb19dffb700 1 -- 172.21.15.37:0/3811564966 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194005b30 con 0x7fb1a006de80 2023-10-06T02:24:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.118+0000 7fb19dffb700 1 -- 172.21.15.37:0/3811564966 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb194005c90 con 0x7fb1a006de80 2023-10-06T02:24:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.118+0000 7fb1a7f15700 1 -- 172.21.15.37:0/3811564966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb190009a20 con 0x7fb1a006de80 2023-10-06T02:24:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.118+0000 7fb19dffb700 1 -- 172.21.15.37:0/3811564966 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194007320 con 0x7fb1a006de80 2023-10-06T02:24:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.118+0000 7fb1a7f15700 1 -- 172.21.15.37:0/3811564966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a015bf30 con 0x7fb1a006de80 2023-10-06T02:24:02.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.119+0000 7fb1a7f15700 1 -- 172.21.15.37:0/3811564966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a00b2e90 con 0x7fb1a006de80 2023-10-06T02:24:02.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.119+0000 7fb19dffb700 1 -- 172.21.15.37:0/3811564966 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb194007690 con 0x7fb1a006de80 2023-10-06T02:24:02.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.120+0000 7fb19dffb700 1 --2- 172.21.15.37:0/3811564966 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb18c066f30 0x7fb18c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:02.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.120+0000 7fb19dffb700 1 -- 172.21.15.37:0/3811564966 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fb1940836f0 con 0x7fb1a006de80 2023-10-06T02:24:02.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.120+0000 7fb1a5cb1700 1 --2- 172.21.15.37:0/3811564966 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb18c066f30 0x7fb18c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:02.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.121+0000 7fb1a5cb1700 1 --2- 172.21.15.37:0/3811564966 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb18c066f30 0x7fb18c0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00c57c0 tx=0x7fb1980091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:02.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.124+0000 7fb19dffb700 1 -- 172.21.15.37:0/3811564966 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb194050b50 con 0x7fb1a006de80 2023-10-06T02:24:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.396+0000 7fb1a7f15700 1 -- 172.21.15.37:0/3811564966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fb1a015c3e0 con 0x7fb1a006de80 2023-10-06T02:24:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.399+0000 7fb19dffb700 1 -- 172.21.15.37:0/3811564966 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb1940170a0 con 0x7fb1a006de80 2023-10-06T02:24:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.401+0000 7fb1a7f15700 1 -- 172.21.15.37:0/3811564966 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb18c066f30 msgr2=0x7fb18c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.401+0000 7fb1a7f15700 1 --2- 172.21.15.37:0/3811564966 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb18c066f30 0x7fb18c0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00c57c0 tx=0x7fb1980091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.401+0000 7fb1a7f15700 1 -- 172.21.15.37:0/3811564966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a006de80 msgr2=0x7fb1a015af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.401+0000 7fb1a7f15700 1 --2- 172.21.15.37:0/3811564966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a006de80 0x7fb1a015af90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb1940011e0 tx=0x7fb194007df0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.401+0000 7fb1a7f15700 1 -- 172.21.15.37:0/3811564966 shutdown_connections 2023-10-06T02:24:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.401+0000 7fb1a7f15700 1 --2- 172.21.15.37:0/3811564966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1a00cb080 0x7fb1a0147f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.401+0000 7fb1a7f15700 1 --2- 172.21.15.37:0/3811564966 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb18c066f30 0x7fb18c0693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.401+0000 7fb1a7f15700 1 --2- 172.21.15.37:0/3811564966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1a006dab0 0x7fb1a00b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.401+0000 7fb1a7f15700 1 --2- 172.21.15.37:0/3811564966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a006de80 0x7fb1a015af90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.402+0000 7fb1a7f15700 1 -- 172.21.15.37:0/3811564966 >> 172.21.15.37:0/3811564966 conn(0x7fb1a00d0510 msgr2=0x7fb1a00c95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.402+0000 7fb1a7f15700 1 -- 172.21.15.37:0/3811564966 shutdown_connections 2023-10-06T02:24:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.402+0000 7fb1a7f15700 1 -- 172.21.15.37:0/3811564966 wait complete. 2023-10-06T02:24:02.415 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T02:24:02.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.533+0000 7f184263d700 1 Processor -- start 2023-10-06T02:24:02.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.533+0000 7f184263d700 1 -- start start 2023-10-06T02:24:02.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.534+0000 7f184263d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f183c06de80 0x7f183c0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:02.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.534+0000 7f184263d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f183c0cc250 con 0x7f183c0cb080 2023-10-06T02:24:02.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.534+0000 7f184263d700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f183c0cb640 con 0x7f183c06dab0 2023-10-06T02:24:02.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.534+0000 7f184263d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183c0b0e00 con 0x7f183c06de80 2023-10-06T02:24:02.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.534+0000 7f183b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f183c0cb080 0x7f183c0b01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40138/0 (socket says 172.21.15.37:40138) 2023-10-06T02:24:02.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.534+0000 7f183b7fe700 1 -- 172.21.15.37:0/1813894607 learned_addr learned my addr 172.21.15.37:0/1813894607 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:02.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.534+0000 7f1840bda700 1 --2- 172.21.15.37:0/1813894607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f183c06de80 0x7f183c0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:02.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.534+0000 7f183affd700 1 -- 172.21.15.37:0/1813894607 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662706506 0 0) 0x7f183c0cc250 con 0x7f183c0cb080 2023-10-06T02:24:02.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.534+0000 7f183affd700 1 -- 172.21.15.37:0/1813894607 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1824003570 con 0x7f183c0cb080 2023-10-06T02:24:02.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.534+0000 7f183affd700 1 -- 172.21.15.37:0/1813894607 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513353050 0 0) 0x7f183c0cb640 con 0x7f183c06dab0 2023-10-06T02:24:02.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.534+0000 7f183affd700 1 -- 172.21.15.37:0/1813894607 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f183c0cc250 con 0x7f183c06dab0 2023-10-06T02:24:02.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.534+0000 7f183affd700 1 -- 172.21.15.37:0/1813894607 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3508350092 0 0) 0x7f1824003570 con 0x7f183c0cb080 2023-10-06T02:24:02.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.534+0000 7f1840bda700 1 -- 172.21.15.37:0/1813894607 >> v1:172.21.15.191:6789/0 conn(0x7f183c06dab0 legacy=0x7f183c0cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:02.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.534+0000 7f1840bda700 1 -- 172.21.15.37:0/1813894607 >> v1:172.21.15.37:6789/0 conn(0x7f183c0cb080 legacy=0x7f183c0b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:02.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.534+0000 7f1840bda700 1 -- 172.21.15.37:0/1813894607 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183c0cb920 con 0x7f183c06de80 2023-10-06T02:24:02.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.534+0000 7f1840bda700 1 --2- 172.21.15.37:0/1813894607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f183c06de80 0x7f183c0b08c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1834009e90 tx=0x7f1834009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa576f029b1872cb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:02.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.535+0000 7f183affd700 1 -- 172.21.15.37:0/1813894607 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183400e070 con 0x7f183c06de80 2023-10-06T02:24:02.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.535+0000 7f183affd700 1 -- 172.21.15.37:0/1813894607 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183400b870 con 0x7f183c06de80 2023-10-06T02:24:02.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.535+0000 7f183affd700 1 -- 172.21.15.37:0/1813894607 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830001470 con 0x7f183c06de80 2023-10-06T02:24:02.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.535+0000 7f184263d700 1 -- 172.21.15.37:0/1813894607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f183c06de80 msgr2=0x7f183c0b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.535+0000 7f184263d700 1 --2- 172.21.15.37:0/1813894607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f183c06de80 0x7f183c0b08c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1834009e90 tx=0x7f1834009780 comp rx=0 tx=0).stop 2023-10-06T02:24:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.535+0000 7f184263d700 1 -- 172.21.15.37:0/1813894607 shutdown_connections 2023-10-06T02:24:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.535+0000 7f184263d700 1 --2- 172.21.15.37:0/1813894607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f183c06de80 0x7f183c0b08c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.535+0000 7f184263d700 1 -- 172.21.15.37:0/1813894607 >> 172.21.15.37:0/1813894607 conn(0x7f183c0d0510 msgr2=0x7f183c0d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.535+0000 7f184263d700 1 -- 172.21.15.37:0/1813894607 shutdown_connections 2023-10-06T02:24:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.535+0000 7f184263d700 1 -- 172.21.15.37:0/1813894607 wait complete. 2023-10-06T02:24:02.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.536+0000 7f184263d700 1 Processor -- start 2023-10-06T02:24:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.537+0000 7f184263d700 1 -- start start 2023-10-06T02:24:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.537+0000 7f184263d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f183c06dab0 0x7f183c14e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.537+0000 7f184263d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f183c06de80 0x7f183c15df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.537+0000 7f184263d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f183c0cb080 0x7f183c15e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.537+0000 7f184263d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c14fc20 con 0x7f183c06de80 2023-10-06T02:24:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.537+0000 7f184263d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c14e6f0 con 0x7f183c0cb080 2023-10-06T02:24:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.537+0000 7f184263d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183c0c9f70 con 0x7f183c06dab0 2023-10-06T02:24:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.537+0000 7f183b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f183c06de80 0x7f183c15df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.537+0000 7f183b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f183c06de80 0x7f183c15df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51220/0 (socket says 172.21.15.37:51220) 2023-10-06T02:24:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.537+0000 7f183b7fe700 1 -- 172.21.15.37:0/1582080896 learned_addr learned my addr 172.21.15.37:0/1582080896 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.537+0000 7f183bfff700 1 --2- 172.21.15.37:0/1582080896 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f183c06dab0 0x7f183c14e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.538+0000 7f1840bda700 1 --2- 172.21.15.37:0/1582080896 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f183c0cb080 0x7f183c15e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.538+0000 7f183b7fe700 1 -- 172.21.15.37:0/1582080896 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f183c06dab0 msgr2=0x7f183c14e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.538+0000 7f183b7fe700 1 --2- 172.21.15.37:0/1582080896 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f183c06dab0 0x7f183c14e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.538+0000 7f183b7fe700 1 -- 172.21.15.37:0/1582080896 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f183c0cb080 msgr2=0x7f183c15e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.538+0000 7f183b7fe700 1 --2- 172.21.15.37:0/1582080896 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f183c0cb080 0x7f183c15e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.538+0000 7f183b7fe700 1 -- 172.21.15.37:0/1582080896 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1834009a20 con 0x7f183c06de80 2023-10-06T02:24:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.538+0000 7f183bfff700 1 --2- 172.21.15.37:0/1582080896 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f183c06dab0 0x7f183c14e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.538+0000 7f1840bda700 1 --2- 172.21.15.37:0/1582080896 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f183c0cb080 0x7f183c15e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.538+0000 7f183b7fe700 1 --2- 172.21.15.37:0/1582080896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f183c06de80 0x7f183c15df20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f183000cb70 tx=0x7f1830001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.538+0000 7f1823fff700 1 -- 172.21.15.37:0/1582080896 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830001d20 con 0x7f183c06de80 2023-10-06T02:24:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.538+0000 7f1823fff700 1 -- 172.21.15.37:0/1582080896 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1830007360 con 0x7f183c06de80 2023-10-06T02:24:02.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.538+0000 7f184263d700 1 -- 172.21.15.37:0/1582080896 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183c14f5d0 con 0x7f183c06de80 2023-10-06T02:24:02.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.538+0000 7f1823fff700 1 -- 172.21.15.37:0/1582080896 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830004830 con 0x7f183c06de80 2023-10-06T02:24:02.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.538+0000 7f184263d700 1 -- 172.21.15.37:0/1582080896 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f183c0ca250 con 0x7f183c06de80 2023-10-06T02:24:02.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.539+0000 7f184263d700 1 -- 172.21.15.37:0/1582080896 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183c14fd90 con 0x7f183c06de80 2023-10-06T02:24:02.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.539+0000 7f1823fff700 1 -- 172.21.15.37:0/1582080896 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1830004ba0 con 0x7f183c06de80 2023-10-06T02:24:02.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.540+0000 7f1823fff700 1 --2- 172.21.15.37:0/1582080896 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1828066f30 0x7f18280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:02.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.540+0000 7f1823fff700 1 -- 172.21.15.37:0/1582080896 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1830083aa0 con 0x7f183c06de80 2023-10-06T02:24:02.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.540+0000 7f183bfff700 1 --2- 172.21.15.37:0/1582080896 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1828066f30 0x7f18280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:02.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.540+0000 7f183bfff700 1 --2- 172.21.15.37:0/1582080896 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1828066f30 0x7f18280693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f182c003990 tx=0x7f182c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.544+0000 7f1823fff700 1 -- 172.21.15.37:0/1582080896 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1830050f80 con 0x7f183c06de80 2023-10-06T02:24:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.817+0000 7f184263d700 1 -- 172.21.15.37:0/1582080896 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f183c0cbc00 con 0x7f183c06de80 2023-10-06T02:24:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.820+0000 7f1823fff700 1 -- 172.21.15.37:0/1582080896 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f18300180a0 con 0x7f183c06de80 2023-10-06T02:24:02.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.823+0000 7f184263d700 1 -- 172.21.15.37:0/1582080896 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1828066f30 msgr2=0x7f18280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:02.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.823+0000 7f184263d700 1 --2- 172.21.15.37:0/1582080896 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1828066f30 0x7f18280693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f182c003990 tx=0x7f182c009040 comp rx=0 tx=0).stop 2023-10-06T02:24:02.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.823+0000 7f184263d700 1 -- 172.21.15.37:0/1582080896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f183c06de80 msgr2=0x7f183c15df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:02.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.823+0000 7f184263d700 1 --2- 172.21.15.37:0/1582080896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f183c06de80 0x7f183c15df20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f183000cb70 tx=0x7f1830001ab0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.823+0000 7f184263d700 1 -- 172.21.15.37:0/1582080896 shutdown_connections 2023-10-06T02:24:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.823+0000 7f184263d700 1 --2- 172.21.15.37:0/1582080896 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1828066f30 0x7f18280693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.823+0000 7f184263d700 1 --2- 172.21.15.37:0/1582080896 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f183c0cb080 0x7f183c15e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.823+0000 7f184263d700 1 --2- 172.21.15.37:0/1582080896 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f183c06dab0 0x7f183c14e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.823+0000 7f184263d700 1 --2- 172.21.15.37:0/1582080896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f183c06de80 0x7f183c15df20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.823+0000 7f184263d700 1 -- 172.21.15.37:0/1582080896 >> 172.21.15.37:0/1582080896 conn(0x7f183c0d0510 msgr2=0x7f183c0b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.823+0000 7f184263d700 1 -- 172.21.15.37:0/1582080896 shutdown_connections 2023-10-06T02:24:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.823+0000 7f184263d700 1 -- 172.21.15.37:0/1582080896 wait complete. 2023-10-06T02:24:02.836 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:24:02.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.955+0000 7f2d795ee700 1 Processor -- start 2023-10-06T02:24:02.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.955+0000 7f2d795ee700 1 -- start start 2023-10-06T02:24:02.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.955+0000 7f2d795ee700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2d7406c300 0x7f2d740cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:02.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.955+0000 7f2d795ee700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d7406c6d0 0x7f2d740cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:02.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.955+0000 7f2d795ee700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d7415e040 con 0x7f2d74159180 2023-10-06T02:24:02.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.955+0000 7f2d795ee700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d740cbbd0 con 0x7f2d7406c300 2023-10-06T02:24:02.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.955+0000 7f2d795ee700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7415d430 con 0x7f2d7406c6d0 2023-10-06T02:24:02.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d737fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2d74159180 0x7f2d74159600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40140/0 (socket says 172.21.15.37:40140) 2023-10-06T02:24:02.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d737fe700 1 -- 172.21.15.37:0/3151673140 learned_addr learned my addr 172.21.15.37:0/3151673140 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:02.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d727fc700 1 --2- 172.21.15.37:0/3151673140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d7406c6d0 0x7f2d740cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:02.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d71ffb700 1 -- 172.21.15.37:0/3151673140 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476322192 0 0) 0x7f2d7415e040 con 0x7f2d74159180 2023-10-06T02:24:02.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d72ffd700 1 --2- 172.21.15.37:0/3151673140 >> v2:172.21.15.191:3300/0 conn(0x7f2d7406c300 0x7f2d740cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:02.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d71ffb700 1 -- 172.21.15.37:0/3151673140 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d60003570 con 0x7f2d74159180 2023-10-06T02:24:02.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d71ffb700 1 -- 172.21.15.37:0/3151673140 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2230145122 0 0) 0x7f2d60003570 con 0x7f2d74159180 2023-10-06T02:24:02.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d71ffb700 1 -- 172.21.15.37:0/3151673140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d7406c6d0 msgr2=0x7f2d740cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:02.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d71ffb700 1 --2- 172.21.15.37:0/3151673140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d7406c6d0 0x7f2d740cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d71ffb700 1 -- 172.21.15.37:0/3151673140 >> v2:172.21.15.191:3300/0 conn(0x7f2d7406c300 msgr2=0x7f2d740cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:02.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d71ffb700 1 --2- 172.21.15.37:0/3151673140 >> v2:172.21.15.191:3300/0 conn(0x7f2d7406c300 0x7f2d740cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d71ffb700 1 -- 172.21.15.37:0/3151673140 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7415d710 con 0x7f2d74159180 2023-10-06T02:24:02.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d71ffb700 1 -- 172.21.15.37:0/3151673140 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f2d6c001470 con 0x7f2d74159180 2023-10-06T02:24:02.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d71ffb700 1 -- 172.21.15.37:0/3151673140 >> v1:172.21.15.37:6789/0 conn(0x7f2d74159180 legacy=0x7f2d74159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:02.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d71ffb700 1 --2- 172.21.15.37:0/3151673140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d7406c6d0 0x7f2d60003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:02.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d71ffb700 1 --2- 172.21.15.37:0/3151673140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d60003fe0 0x7f2d60004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:02.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d71ffb700 1 --2- 172.21.15.37:0/3151673140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d60004d50 0x7f2d600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:02.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d71ffb700 1 -- 172.21.15.37:0/3151673140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d740cbbd0 con 0x7f2d60003fe0 2023-10-06T02:24:02.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d71ffb700 1 -- 172.21.15.37:0/3151673140 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7415d430 con 0x7f2d60004d50 2023-10-06T02:24:02.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d71ffb700 1 -- 172.21.15.37:0/3151673140 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6000ba90 con 0x7f2d7406c6d0 2023-10-06T02:24:02.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d727fc700 1 --2- 172.21.15.37:0/3151673140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d60003fe0 0x7f2d60004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:02.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d72ffd700 1 --2- 172.21.15.37:0/3151673140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d7406c6d0 0x7f2d60003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:02.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.956+0000 7f2d737fe700 1 --2- 172.21.15.37:0/3151673140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d60004d50 0x7f2d600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:02.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.957+0000 7f2d727fc700 1 -- 172.21.15.37:0/3151673140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d7406c6d0 msgr2=0x7f2d60003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:02.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.957+0000 7f2d727fc700 1 --2- 172.21.15.37:0/3151673140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d7406c6d0 0x7f2d60003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.957+0000 7f2d727fc700 1 -- 172.21.15.37:0/3151673140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d60004d50 msgr2=0x7f2d600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:02.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.957+0000 7f2d727fc700 1 --2- 172.21.15.37:0/3151673140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d60004d50 0x7f2d600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.957+0000 7f2d727fc700 1 -- 172.21.15.37:0/3151673140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d60003570 con 0x7f2d60003fe0 2023-10-06T02:24:02.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.957+0000 7f2d727fc700 1 --2- 172.21.15.37:0/3151673140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d60003fe0 0x7f2d60004810 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c009c00 tx=0x7f2d5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45838fb66ac4371 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:02.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.957+0000 7f2d71ffb700 1 -- 172.21.15.37:0/3151673140 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c00e6b0 con 0x7f2d60003fe0 2023-10-06T02:24:02.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.957+0000 7f2d71ffb700 1 -- 172.21.15.37:0/3151673140 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5c00e810 con 0x7f2d60003fe0 2023-10-06T02:24:02.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.957+0000 7f2d71ffb700 1 -- 172.21.15.37:0/3151673140 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c00ebd0 con 0x7f2d60003fe0 2023-10-06T02:24:02.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.957+0000 7f2d795ee700 1 -- 172.21.15.37:0/3151673140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d60003fe0 msgr2=0x7f2d60004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:02.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.957+0000 7f2d795ee700 1 --2- 172.21.15.37:0/3151673140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d60003fe0 0x7f2d60004810 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c009c00 tx=0x7f2d5c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.957+0000 7f2d737fe700 1 -- 172.21.15.37:0/3151673140 reap_dead start 2023-10-06T02:24:02.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.958+0000 7f2d795ee700 1 -- 172.21.15.37:0/3151673140 shutdown_connections 2023-10-06T02:24:02.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.958+0000 7f2d795ee700 1 -- 172.21.15.37:0/3151673140 >> 172.21.15.37:0/3151673140 conn(0x7f2d740cd290 msgr2=0x7f2d740cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:02.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.958+0000 7f2d795ee700 1 -- 172.21.15.37:0/3151673140 shutdown_connections 2023-10-06T02:24:02.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.958+0000 7f2d795ee700 1 -- 172.21.15.37:0/3151673140 wait complete. 2023-10-06T02:24:02.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.959+0000 7f2d795ee700 1 Processor -- start 2023-10-06T02:24:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.959+0000 7f2d795ee700 1 -- start start 2023-10-06T02:24:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d795ee700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d60003fe0 0x7f2d74153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d795ee700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d7416aff0 0x7f2d740b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d795ee700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d740b2550 0x7f2d74157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d795ee700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d740c6270 con 0x7f2d60003fe0 2023-10-06T02:24:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d795ee700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d74169df0 con 0x7f2d740b2550 2023-10-06T02:24:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d795ee700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d74153a80 con 0x7f2d7416aff0 2023-10-06T02:24:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d72ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d60003fe0 0x7f2d74153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d72ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d60003fe0 0x7f2d74153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51234/0 (socket says 172.21.15.37:51234) 2023-10-06T02:24:02.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d72ffd700 1 -- 172.21.15.37:0/2868755116 learned_addr learned my addr 172.21.15.37:0/2868755116 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:02.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d727fc700 1 --2- 172.21.15.37:0/2868755116 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d7416aff0 0x7f2d740b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:02.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d72ffd700 1 -- 172.21.15.37:0/2868755116 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d7416aff0 msgr2=0x7f2d740b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:02.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d72ffd700 1 --2- 172.21.15.37:0/2868755116 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d7416aff0 0x7f2d740b2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d72ffd700 1 -- 172.21.15.37:0/2868755116 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d740b2550 msgr2=0x7f2d74157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:02.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d72ffd700 1 --2- 172.21.15.37:0/2868755116 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d740b2550 0x7f2d74157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:02.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d72ffd700 1 -- 172.21.15.37:0/2868755116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d740c56f0 con 0x7f2d60003fe0 2023-10-06T02:24:02.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d727fc700 1 --2- 172.21.15.37:0/2868755116 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d7416aff0 0x7f2d740b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:02.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d72ffd700 1 --2- 172.21.15.37:0/2868755116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d60003fe0 0x7f2d74153540 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2d64011f80 tx=0x7f2d6400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:02.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d6affd700 1 -- 172.21.15.37:0/2868755116 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6400e040 con 0x7f2d60003fe0 2023-10-06T02:24:02.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d6affd700 1 -- 172.21.15.37:0/2868755116 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6400f040 con 0x7f2d60003fe0 2023-10-06T02:24:02.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d795ee700 1 -- 172.21.15.37:0/2868755116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d740c59d0 con 0x7f2d60003fe0 2023-10-06T02:24:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d6affd700 1 -- 172.21.15.37:0/2868755116 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64015430 con 0x7f2d60003fe0 2023-10-06T02:24:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.960+0000 7f2d795ee700 1 -- 172.21.15.37:0/2868755116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d740c5f90 con 0x7f2d60003fe0 2023-10-06T02:24:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.961+0000 7f2d795ee700 1 -- 172.21.15.37:0/2868755116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d74069820 con 0x7f2d60003fe0 2023-10-06T02:24:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.962+0000 7f2d6affd700 1 -- 172.21.15.37:0/2868755116 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d64015820 con 0x7f2d60003fe0 2023-10-06T02:24:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.962+0000 7f2d6affd700 1 --2- 172.21.15.37:0/2868755116 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2d54066f30 0x7f2d540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.962+0000 7f2d6affd700 1 -- 172.21.15.37:0/2868755116 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2d640850d0 con 0x7f2d60003fe0 2023-10-06T02:24:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.962+0000 7f2d727fc700 1 --2- 172.21.15.37:0/2868755116 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2d54066f30 0x7f2d540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.963+0000 7f2d727fc700 1 --2- 172.21.15.37:0/2868755116 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2d54066f30 0x7f2d540693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2d74067e90 tx=0x7f2d5c01a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:02.967+0000 7f2d6affd700 1 -- 172.21.15.37:0/2868755116 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d64055fc0 con 0x7f2d60003fe0 2023-10-06T02:24:03.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.160+0000 7f2d795ee700 1 -- 172.21.15.37:0/2868755116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d7415d9f0 con 0x7f2d60003fe0 2023-10-06T02:24:03.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.161+0000 7f2d6affd700 1 -- 172.21.15.37:0/2868755116 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+13650 (secure 0 0 0) 0x7f2d64055b50 con 0x7f2d60003fe0 2023-10-06T02:24:03.162 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:03.162 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:23:59.871506+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:24:03.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.163+0000 7f2d795ee700 1 -- 172.21.15.37:0/2868755116 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2d54066f30 msgr2=0x7f2d540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:03.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.163+0000 7f2d795ee700 1 --2- 172.21.15.37:0/2868755116 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2d54066f30 0x7f2d540693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2d74067e90 tx=0x7f2d5c01a000 comp rx=0 tx=0).stop 2023-10-06T02:24:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.163+0000 7f2d795ee700 1 -- 172.21.15.37:0/2868755116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d60003fe0 msgr2=0x7f2d74153540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.163+0000 7f2d795ee700 1 --2- 172.21.15.37:0/2868755116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d60003fe0 0x7f2d74153540 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2d64011f80 tx=0x7f2d6400b040 comp rx=0 tx=0).stop 2023-10-06T02:24:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.163+0000 7f2d795ee700 1 -- 172.21.15.37:0/2868755116 shutdown_connections 2023-10-06T02:24:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.163+0000 7f2d795ee700 1 --2- 172.21.15.37:0/2868755116 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2d54066f30 0x7f2d540693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.163+0000 7f2d795ee700 1 --2- 172.21.15.37:0/2868755116 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d740b2550 0x7f2d74157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.163+0000 7f2d795ee700 1 --2- 172.21.15.37:0/2868755116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d60003fe0 0x7f2d74153540 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.163+0000 7f2d795ee700 1 --2- 172.21.15.37:0/2868755116 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d7416aff0 0x7f2d740b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.163+0000 7f2d795ee700 1 -- 172.21.15.37:0/2868755116 >> 172.21.15.37:0/2868755116 conn(0x7f2d740cd290 msgr2=0x7f2d74154330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.163+0000 7f2d795ee700 1 -- 172.21.15.37:0/2868755116 shutdown_connections 2023-10-06T02:24:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.163+0000 7f2d795ee700 1 -- 172.21.15.37:0/2868755116 wait complete. 2023-10-06T02:24:03.176 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:23:08.066048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:23:08.561964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T02:24:03.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:24:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.298+0000 7fd09359e700 1 Processor -- start 2023-10-06T02:24:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.298+0000 7fd09359e700 1 -- start start 2023-10-06T02:24:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.299+0000 7fd09359e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0940b29d0 0x7fd0940ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.299+0000 7fd09359e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd0940cb170 0x7fd0940cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.299+0000 7fd09359e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0940cf340 0x7fd0940c5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.299+0000 7fd09359e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0940b2da0 con 0x7fd0940cf340 2023-10-06T02:24:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.299+0000 7fd09359e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd094099bd0 con 0x7fd0940cb170 2023-10-06T02:24:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.299+0000 7fd09359e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd094159a70 con 0x7fd0940b29d0 2023-10-06T02:24:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.299+0000 7fd092d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0940cf340 0x7fd0940c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.300+0000 7fd092d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0940cf340 0x7fd0940c5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51248/0 (socket says 172.21.15.37:51248) 2023-10-06T02:24:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.300+0000 7fd092d9d700 1 -- 172.21.15.37:0/3486023064 learned_addr learned my addr 172.21.15.37:0/3486023064 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.300+0000 7fd091d9b700 1 --2- 172.21.15.37:0/3486023064 >> v2:172.21.15.191:3300/0 conn(0x7fd0940cb170 0x7fd0940cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.300+0000 7fd09259c700 1 --2- 172.21.15.37:0/3486023064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0940b29d0 0x7fd0940ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.300+0000 7fd092d9d700 1 -- 172.21.15.37:0/3486023064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0940b29d0 msgr2=0x7fd0940ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.300+0000 7fd092d9d700 1 --2- 172.21.15.37:0/3486023064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0940b29d0 0x7fd0940ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.300+0000 7fd092d9d700 1 -- 172.21.15.37:0/3486023064 >> v2:172.21.15.191:3300/0 conn(0x7fd0940cb170 msgr2=0x7fd0940cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.300+0000 7fd092d9d700 1 --2- 172.21.15.37:0/3486023064 >> v2:172.21.15.191:3300/0 conn(0x7fd0940cb170 0x7fd0940cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.300+0000 7fd092d9d700 1 -- 172.21.15.37:0/3486023064 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0940cb5e0 con 0x7fd0940cf340 2023-10-06T02:24:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.300+0000 7fd091d9b700 1 --2- 172.21.15.37:0/3486023064 >> v2:172.21.15.191:3300/0 conn(0x7fd0940cb170 0x7fd0940cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.300+0000 7fd092d9d700 1 --2- 172.21.15.37:0/3486023064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0940cf340 0x7fd0940c5170 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd0940d14e0 tx=0x7fd08c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43721b63e301210a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.300+0000 7fd09159a700 1 -- 172.21.15.37:0/3486023064 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c00b860 con 0x7fd0940cf340 2023-10-06T02:24:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.300+0000 7fd09159a700 1 -- 172.21.15.37:0/3486023064 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08c00b9c0 con 0x7fd0940cf340 2023-10-06T02:24:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.300+0000 7fd09159a700 1 -- 172.21.15.37:0/3486023064 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c00bd60 con 0x7fd0940cf340 2023-10-06T02:24:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.301+0000 7fd09359e700 1 -- 172.21.15.37:0/3486023064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0940cf340 msgr2=0x7fd0940c5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.301+0000 7fd09359e700 1 --2- 172.21.15.37:0/3486023064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0940cf340 0x7fd0940c5170 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd0940d14e0 tx=0x7fd08c009250 comp rx=0 tx=0).stop 2023-10-06T02:24:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.301+0000 7fd09359e700 1 -- 172.21.15.37:0/3486023064 shutdown_connections 2023-10-06T02:24:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.301+0000 7fd09359e700 1 --2- 172.21.15.37:0/3486023064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0940cf340 0x7fd0940c5170 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.301+0000 7fd09359e700 1 --2- 172.21.15.37:0/3486023064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0940b29d0 0x7fd0940ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.301+0000 7fd09359e700 1 --2- 172.21.15.37:0/3486023064 >> v2:172.21.15.191:3300/0 conn(0x7fd0940cb170 0x7fd0940cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.301+0000 7fd09359e700 1 -- 172.21.15.37:0/3486023064 >> 172.21.15.37:0/3486023064 conn(0x7fd094099610 msgr2=0x7fd09406c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.301+0000 7fd09359e700 1 -- 172.21.15.37:0/3486023064 shutdown_connections 2023-10-06T02:24:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.301+0000 7fd09359e700 1 -- 172.21.15.37:0/3486023064 wait complete. 2023-10-06T02:24:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.302+0000 7fd09359e700 1 Processor -- start 2023-10-06T02:24:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.302+0000 7fd09359e700 1 -- start start 2023-10-06T02:24:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd09359e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0940b29d0 0x7fd09415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd09359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0940cb170 0x7fd0940b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd09359e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0940cf340 0x7fd094154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd09359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0940b5840 con 0x7fd0940cb170 2023-10-06T02:24:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd09359e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd094155240 con 0x7fd0940cf340 2023-10-06T02:24:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd09359e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0940b5560 con 0x7fd0940b29d0 2023-10-06T02:24:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd091d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0940cb170 0x7fd0940b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd091d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0940cb170 0x7fd0940b3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51264/0 (socket says 172.21.15.37:51264) 2023-10-06T02:24:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd091d9b700 1 -- 172.21.15.37:0/1878108517 learned_addr learned my addr 172.21.15.37:0/1878108517 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd09259c700 1 --2- 172.21.15.37:0/1878108517 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0940b29d0 0x7fd09415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd092d9d700 1 --2- 172.21.15.37:0/1878108517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0940cf340 0x7fd094154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd091d9b700 1 -- 172.21.15.37:0/1878108517 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0940b29d0 msgr2=0x7fd09415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd091d9b700 1 --2- 172.21.15.37:0/1878108517 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0940b29d0 0x7fd09415cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd091d9b700 1 -- 172.21.15.37:0/1878108517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0940cf340 msgr2=0x7fd094154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd091d9b700 1 --2- 172.21.15.37:0/1878108517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0940cf340 0x7fd094154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd091d9b700 1 -- 172.21.15.37:0/1878108517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c0094f0 con 0x7fd0940cb170 2023-10-06T02:24:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd091d9b700 1 --2- 172.21.15.37:0/1878108517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0940cb170 0x7fd0940b3d80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd08800e8d0 tx=0x7fd088008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd0827fc700 1 -- 172.21.15.37:0/1878108517 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd088013410 con 0x7fd0940cb170 2023-10-06T02:24:03.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd0827fc700 1 -- 172.21.15.37:0/1878108517 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd088013570 con 0x7fd0940cb170 2023-10-06T02:24:03.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd09359e700 1 -- 172.21.15.37:0/1878108517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0940b32a0 con 0x7fd0940cb170 2023-10-06T02:24:03.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.303+0000 7fd0827fc700 1 -- 172.21.15.37:0/1878108517 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd088013910 con 0x7fd0940cb170 2023-10-06T02:24:03.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.304+0000 7fd09359e700 1 -- 172.21.15.37:0/1878108517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0940b3860 con 0x7fd0940cb170 2023-10-06T02:24:03.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.304+0000 7fd09359e700 1 -- 172.21.15.37:0/1878108517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0940884f0 con 0x7fd0940cb170 2023-10-06T02:24:03.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.305+0000 7fd0827fc700 1 -- 172.21.15.37:0/1878108517 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd088013d40 con 0x7fd0940cb170 2023-10-06T02:24:03.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.305+0000 7fd0827fc700 1 --2- 172.21.15.37:0/1878108517 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd074066f30 0x7fd0740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.305+0000 7fd0827fc700 1 -- 172.21.15.37:0/1878108517 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd0880841c0 con 0x7fd0940cb170 2023-10-06T02:24:03.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.305+0000 7fd09259c700 1 --2- 172.21.15.37:0/1878108517 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd074066f30 0x7fd0740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.306+0000 7fd09259c700 1 --2- 172.21.15.37:0/1878108517 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd074066f30 0x7fd0740693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd084009fd0 tx=0x7fd084009880 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:03.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.309+0000 7fd0827fc700 1 -- 172.21.15.37:0/1878108517 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd088051580 con 0x7fd0940cb170 2023-10-06T02:24:03.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.501+0000 7fd09359e700 1 -- 172.21.15.37:0/1878108517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd094064b00 con 0x7fd0940cb170 2023-10-06T02:24:03.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.502+0000 7fd0827fc700 1 -- 172.21.15.37:0/1878108517 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd088054ba0 con 0x7fd0940cb170 2023-10-06T02:24:03.503 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T02:24:03.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.503+0000 7fd09359e700 1 -- 172.21.15.37:0/1878108517 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd074066f30 msgr2=0x7fd0740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:03.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.503+0000 7fd09359e700 1 --2- 172.21.15.37:0/1878108517 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd074066f30 0x7fd0740693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd084009fd0 tx=0x7fd084009880 comp rx=0 tx=0).stop 2023-10-06T02:24:03.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.504+0000 7fd09359e700 1 -- 172.21.15.37:0/1878108517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0940cb170 msgr2=0x7fd0940b3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:03.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.504+0000 7fd09359e700 1 --2- 172.21.15.37:0/1878108517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0940cb170 0x7fd0940b3d80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd08800e8d0 tx=0x7fd088008040 comp rx=0 tx=0).stop 2023-10-06T02:24:03.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.504+0000 7fd09359e700 1 -- 172.21.15.37:0/1878108517 shutdown_connections 2023-10-06T02:24:03.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.504+0000 7fd09359e700 1 --2- 172.21.15.37:0/1878108517 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd074066f30 0x7fd0740693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.504+0000 7fd09359e700 1 --2- 172.21.15.37:0/1878108517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0940cf340 0x7fd094154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.504+0000 7fd09359e700 1 --2- 172.21.15.37:0/1878108517 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0940b29d0 0x7fd09415cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.504+0000 7fd09359e700 1 --2- 172.21.15.37:0/1878108517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0940cb170 0x7fd0940b3d80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.504+0000 7fd09359e700 1 -- 172.21.15.37:0/1878108517 >> 172.21.15.37:0/1878108517 conn(0x7fd094099610 msgr2=0x7fd0940cd190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:03.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.504+0000 7fd09359e700 1 -- 172.21.15.37:0/1878108517 shutdown_connections 2023-10-06T02:24:03.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.504+0000 7fd09359e700 1 -- 172.21.15.37:0/1878108517 wait complete. 2023-10-06T02:24:03.517 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:24:03.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.637+0000 7f000f950700 1 Processor -- start 2023-10-06T02:24:03.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.637+0000 7f000f950700 1 -- start start 2023-10-06T02:24:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.638+0000 7f000f950700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f000813fc40 0x7f00080ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.638+0000 7f000f950700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00080c9f30 con 0x7f0008140010 2023-10-06T02:24:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.638+0000 7f000f950700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00080c9320 con 0x7f00080ca900 2023-10-06T02:24:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.638+0000 7f000f950700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00080c9600 con 0x7f000813fc40 2023-10-06T02:24:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.638+0000 7f000ceeb700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0008140010 0x7f00080b0040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40146/0 (socket says 172.21.15.37:40146) 2023-10-06T02:24:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.638+0000 7f000ceeb700 1 -- 172.21.15.37:0/1533173045 learned_addr learned my addr 172.21.15.37:0/1533173045 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f000d6ec700 1 --2- 172.21.15.37:0/1533173045 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f000813fc40 0x7f00080ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f0007fff700 1 -- 172.21.15.37:0/1533173045 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199567147 0 0) 0x7f00080c9f30 con 0x7f0008140010 2023-10-06T02:24:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f0007fff700 1 -- 172.21.15.37:0/1533173045 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff0003570 con 0x7f0008140010 2023-10-06T02:24:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f0007fff700 1 -- 172.21.15.37:0/1533173045 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426384722 0 0) 0x7f00080c9320 con 0x7f00080ca900 2023-10-06T02:24:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f0007fff700 1 -- 172.21.15.37:0/1533173045 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00080c9f30 con 0x7f00080ca900 2023-10-06T02:24:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f0007fff700 1 -- 172.21.15.37:0/1533173045 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 970830799 0 0) 0x7efff0003570 con 0x7f0008140010 2023-10-06T02:24:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f0007fff700 1 -- 172.21.15.37:0/1533173045 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f000813fc40 msgr2=0x7f00080ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f0007fff700 1 --2- 172.21.15.37:0/1533173045 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f000813fc40 0x7f00080ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f0007fff700 1 -- 172.21.15.37:0/1533173045 >> v1:172.21.15.191:6789/0 conn(0x7f00080ca900 legacy=0x7f000806a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f0007fff700 1 -- 172.21.15.37:0/1533173045 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00080c98e0 con 0x7f0008140010 2023-10-06T02:24:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f0007fff700 1 -- 172.21.15.37:0/1533173045 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7efffc0013f0 con 0x7f0008140010 2023-10-06T02:24:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f0007fff700 1 -- 172.21.15.37:0/1533173045 >> v1:172.21.15.37:6789/0 conn(0x7f0008140010 legacy=0x7f00080b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f0007fff700 1 --2- 172.21.15.37:0/1533173045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efff0003c20 0x7efff0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f0007fff700 1 --2- 172.21.15.37:0/1533173045 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efff0004810 0x7efff0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f0007fff700 1 --2- 172.21.15.37:0/1533173045 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f000813fc40 0x7efff0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f0007fff700 1 -- 172.21.15.37:0/1533173045 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00080c9600 con 0x7efff0003c20 2023-10-06T02:24:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f0007fff700 1 -- 172.21.15.37:0/1533173045 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff000bbf0 con 0x7efff0004810 2023-10-06T02:24:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f0007fff700 1 -- 172.21.15.37:0/1533173045 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff000dfc0 con 0x7f000813fc40 2023-10-06T02:24:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f000d6ec700 1 --2- 172.21.15.37:0/1533173045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efff0003c20 0x7efff0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f000ceeb700 1 --2- 172.21.15.37:0/1533173045 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efff0004810 0x7efff0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.639+0000 7f000deed700 1 --2- 172.21.15.37:0/1533173045 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f000813fc40 0x7efff0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.640+0000 7f000d6ec700 1 -- 172.21.15.37:0/1533173045 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f000813fc40 msgr2=0x7efff0005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.640+0000 7f000d6ec700 1 --2- 172.21.15.37:0/1533173045 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f000813fc40 0x7efff0005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.640+0000 7f000d6ec700 1 -- 172.21.15.37:0/1533173045 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efff0004810 msgr2=0x7efff0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.640+0000 7f000d6ec700 1 --2- 172.21.15.37:0/1533173045 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efff0004810 0x7efff0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.640+0000 7f000d6ec700 1 -- 172.21.15.37:0/1533173045 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff0003570 con 0x7efff0003c20 2023-10-06T02:24:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.640+0000 7f000d6ec700 1 --2- 172.21.15.37:0/1533173045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efff0003c20 0x7efff0004010 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efff8009c00 tx=0x7efff80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4360f21e95ece407 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.640+0000 7f0007fff700 1 -- 172.21.15.37:0/1533173045 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff800e710 con 0x7efff0003c20 2023-10-06T02:24:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.640+0000 7f0007fff700 1 -- 172.21.15.37:0/1533173045 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff800e870 con 0x7efff0003c20 2023-10-06T02:24:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.640+0000 7f0007fff700 1 -- 172.21.15.37:0/1533173045 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff800ec30 con 0x7efff0003c20 2023-10-06T02:24:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.640+0000 7f000f950700 1 -- 172.21.15.37:0/1533173045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efff0003c20 msgr2=0x7efff0004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.640+0000 7f000f950700 1 --2- 172.21.15.37:0/1533173045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efff0003c20 0x7efff0004010 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efff8009c00 tx=0x7efff80091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.640+0000 7f000deed700 1 -- 172.21.15.37:0/1533173045 reap_dead start 2023-10-06T02:24:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.640+0000 7f000f950700 1 -- 172.21.15.37:0/1533173045 shutdown_connections 2023-10-06T02:24:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.640+0000 7f000f950700 1 -- 172.21.15.37:0/1533173045 >> 172.21.15.37:0/1533173045 conn(0x7f00080680f0 msgr2=0x7f000806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.641+0000 7f000f950700 1 -- 172.21.15.37:0/1533173045 shutdown_connections 2023-10-06T02:24:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.641+0000 7f000f950700 1 -- 172.21.15.37:0/1533173045 wait complete. 2023-10-06T02:24:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.642+0000 7f000f950700 1 Processor -- start 2023-10-06T02:24:03.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.642+0000 7f000f950700 1 -- start start 2023-10-06T02:24:03.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.642+0000 7f000f950700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efff0003c20 0x7f00080c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.642+0000 7f000f950700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00080abbb0 0x7f0008169ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.642+0000 7f000f950700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f000816dcb0 0x7f00080ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.642+0000 7f000f950700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000816d540 con 0x7f000816dcb0 2023-10-06T02:24:03.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.642+0000 7f000f950700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000816d820 con 0x7efff0003c20 2023-10-06T02:24:03.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.642+0000 7f000f950700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000816a720 con 0x7f00080abbb0 2023-10-06T02:24:03.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.643+0000 7f000deed700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f000816dcb0 0x7f00080ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.643+0000 7f000deed700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f000816dcb0 0x7f00080ae880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51286/0 (socket says 172.21.15.37:51286) 2023-10-06T02:24:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.643+0000 7f000deed700 1 -- 172.21.15.37:0/712494347 learned_addr learned my addr 172.21.15.37:0/712494347 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.643+0000 7f000d6ec700 1 --2- 172.21.15.37:0/712494347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efff0003c20 0x7f00080c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.643+0000 7f000ceeb700 1 --2- 172.21.15.37:0/712494347 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00080abbb0 0x7f0008169ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.643+0000 7f000deed700 1 -- 172.21.15.37:0/712494347 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00080abbb0 msgr2=0x7f0008169ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.643+0000 7f000deed700 1 --2- 172.21.15.37:0/712494347 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00080abbb0 0x7f0008169ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.643+0000 7f000deed700 1 -- 172.21.15.37:0/712494347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efff0003c20 msgr2=0x7f00080c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.643+0000 7f000deed700 1 --2- 172.21.15.37:0/712494347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efff0003c20 0x7f00080c6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.643+0000 7f000deed700 1 -- 172.21.15.37:0/712494347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000816aa00 con 0x7f000816dcb0 2023-10-06T02:24:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.643+0000 7f000deed700 1 --2- 172.21.15.37:0/712494347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f000816dcb0 0x7f00080ae880 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0008070ff0 tx=0x7f0000009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.643+0000 7f00057fa700 1 -- 172.21.15.37:0/712494347 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00000032e0 con 0x7f000816dcb0 2023-10-06T02:24:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.643+0000 7f00057fa700 1 -- 172.21.15.37:0/712494347 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0000003440 con 0x7f000816dcb0 2023-10-06T02:24:03.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.643+0000 7f000f950700 1 -- 172.21.15.37:0/712494347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000816ace0 con 0x7f000816dcb0 2023-10-06T02:24:03.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.643+0000 7f00057fa700 1 -- 172.21.15.37:0/712494347 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000001910 con 0x7f000816dcb0 2023-10-06T02:24:03.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.643+0000 7f000f950700 1 -- 172.21.15.37:0/712494347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00080ac020 con 0x7f000816dcb0 2023-10-06T02:24:03.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.644+0000 7f000f950700 1 -- 172.21.15.37:0/712494347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f000816aed0 con 0x7f000816dcb0 2023-10-06T02:24:03.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.645+0000 7f00057fa700 1 -- 172.21.15.37:0/712494347 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0000001cc0 con 0x7f000816dcb0 2023-10-06T02:24:03.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.645+0000 7f00057fa700 1 --2- 172.21.15.37:0/712494347 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7efff4066f30 0x7efff40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.645+0000 7f00057fa700 1 -- 172.21.15.37:0/712494347 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0000083de0 con 0x7f000816dcb0 2023-10-06T02:24:03.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.645+0000 7f000d6ec700 1 --2- 172.21.15.37:0/712494347 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7efff4066f30 0x7efff40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.646+0000 7f000d6ec700 1 --2- 172.21.15.37:0/712494347 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7efff4066f30 0x7efff40693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efff80091e0 tx=0x7efff801a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:03.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.649+0000 7f00057fa700 1 -- 172.21.15.37:0/712494347 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f000816aed0 con 0x7f000816dcb0 2023-10-06T02:24:03.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.844+0000 7f000f950700 1 -- 172.21.15.37:0/712494347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0008159dd0 con 0x7f000816dcb0 2023-10-06T02:24:03.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.844+0000 7f00057fa700 1 -- 172.21.15.37:0/712494347 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f00000190a0 con 0x7f000816dcb0 2023-10-06T02:24:03.846 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T02:24:03.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.846+0000 7f000f950700 1 -- 172.21.15.37:0/712494347 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7efff4066f30 msgr2=0x7efff40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:03.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.846+0000 7f000f950700 1 --2- 172.21.15.37:0/712494347 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7efff4066f30 0x7efff40693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efff80091e0 tx=0x7efff801a000 comp rx=0 tx=0).stop 2023-10-06T02:24:03.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.846+0000 7f000f950700 1 -- 172.21.15.37:0/712494347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f000816dcb0 msgr2=0x7f00080ae880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:03.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.846+0000 7f000f950700 1 --2- 172.21.15.37:0/712494347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f000816dcb0 0x7f00080ae880 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0008070ff0 tx=0x7f0000009040 comp rx=0 tx=0).stop 2023-10-06T02:24:03.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.846+0000 7f000f950700 1 -- 172.21.15.37:0/712494347 shutdown_connections 2023-10-06T02:24:03.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.846+0000 7f000f950700 1 --2- 172.21.15.37:0/712494347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f000816dcb0 0x7f00080ae880 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.846+0000 7f000f950700 1 --2- 172.21.15.37:0/712494347 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7efff4066f30 0x7efff40693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.846+0000 7f000f950700 1 --2- 172.21.15.37:0/712494347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efff0003c20 0x7f00080c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.846+0000 7f000f950700 1 --2- 172.21.15.37:0/712494347 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00080abbb0 0x7f0008169ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.846+0000 7f000f950700 1 -- 172.21.15.37:0/712494347 >> 172.21.15.37:0/712494347 conn(0x7f00080680f0 msgr2=0x7f00080c2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:03.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.847+0000 7f000f950700 1 -- 172.21.15.37:0/712494347 shutdown_connections 2023-10-06T02:24:03.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.847+0000 7f000f950700 1 -- 172.21.15.37:0/712494347 wait complete. 2023-10-06T02:24:03.860 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:24:03.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.978+0000 7f0e92f15700 1 Processor -- start 2023-10-06T02:24:03.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.978+0000 7f0e92f15700 1 -- start start 2023-10-06T02:24:03.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.978+0000 7f0e92f15700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0e8c159760 0x7f0e8c15d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.978+0000 7f0e92f15700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e8c15dd50 0x7f0e8c0cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.978+0000 7f0e92f15700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e8c15e1d0 con 0x7f0e8c15d8d0 2023-10-06T02:24:03.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.978+0000 7f0e92f15700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e8c0cc2d0 con 0x7f0e8c159760 2023-10-06T02:24:03.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.978+0000 7f0e92f15700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c0cb650 con 0x7f0e8c15dd50 2023-10-06T02:24:03.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.979+0000 7f0e90cb1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0e8c159760 0x7f0e8c15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.979+0000 7f0e90cb1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0e8c159760 0x7f0e8c15d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51296/0 (socket says 172.21.15.37:51296) 2023-10-06T02:24:03.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.979+0000 7f0e90cb1700 1 -- 172.21.15.37:0/391093065 learned_addr learned my addr 172.21.15.37:0/391093065 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:03.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.979+0000 7f0e914b2700 1 --2- 172.21.15.37:0/391093065 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e8c15dd50 0x7f0e8c0cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.979+0000 7f0e90cb1700 1 -- 172.21.15.37:0/391093065 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e8c15dd50 msgr2=0x7f0e8c0cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:03.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.979+0000 7f0e90cb1700 1 --2- 172.21.15.37:0/391093065 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e8c15dd50 0x7f0e8c0cfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.979+0000 7f0e90cb1700 1 -- 172.21.15.37:0/391093065 >> v1:172.21.15.191:6789/0 conn(0x7f0e8c15d8d0 legacy=0x7f0e8c0c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:03.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.979+0000 7f0e90cb1700 1 -- 172.21.15.37:0/391093065 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8c0cb930 con 0x7f0e8c159760 2023-10-06T02:24:03.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.979+0000 7f0e90cb1700 1 --2- 172.21.15.37:0/391093065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e8c159760 0x7f0e8c15d390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009f20 tx=0x7f0e84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ee73f76a457f10 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:03.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.979+0000 7f0e8b7fe700 1 -- 172.21.15.37:0/391093065 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8400e070 con 0x7f0e8c159760 2023-10-06T02:24:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.979+0000 7f0e8b7fe700 1 -- 172.21.15.37:0/391093065 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8400bb10 con 0x7f0e8c159760 2023-10-06T02:24:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.979+0000 7f0e8b7fe700 1 -- 172.21.15.37:0/391093065 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e840092e0 con 0x7f0e8c159760 2023-10-06T02:24:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.980+0000 7f0e92f15700 1 -- 172.21.15.37:0/391093065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e8c159760 msgr2=0x7f0e8c15d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.980+0000 7f0e92f15700 1 --2- 172.21.15.37:0/391093065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e8c159760 0x7f0e8c15d390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009f20 tx=0x7f0e84009840 comp rx=0 tx=0).stop 2023-10-06T02:24:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.980+0000 7f0e92f15700 1 -- 172.21.15.37:0/391093065 shutdown_connections 2023-10-06T02:24:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.980+0000 7f0e92f15700 1 --2- 172.21.15.37:0/391093065 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e8c15dd50 0x7f0e8c0cfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.980+0000 7f0e92f15700 1 --2- 172.21.15.37:0/391093065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e8c159760 0x7f0e8c15d390 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.980+0000 7f0e92f15700 1 -- 172.21.15.37:0/391093065 >> 172.21.15.37:0/391093065 conn(0x7f0e8c06c890 msgr2=0x7f0e8c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.980+0000 7f0e92f15700 1 -- 172.21.15.37:0/391093065 shutdown_connections 2023-10-06T02:24:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.980+0000 7f0e92f15700 1 -- 172.21.15.37:0/391093065 wait complete. 2023-10-06T02:24:03.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.981+0000 7f0e92f15700 1 Processor -- start 2023-10-06T02:24:03.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.981+0000 7f0e92f15700 1 -- start start 2023-10-06T02:24:03.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.982+0000 7f0e92f15700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e8c159760 0x7f0e8c14dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.982+0000 7f0e92f15700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e8c15d8d0 0x7f0e8c0c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.982+0000 7f0e92f15700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e8c15dd50 0x7f0e8c0c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.982+0000 7f0e92f15700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c14d200 con 0x7f0e8c15d8d0 2023-10-06T02:24:03.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.982+0000 7f0e92f15700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c0c9790 con 0x7f0e8c15dd50 2023-10-06T02:24:03.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.982+0000 7f0e92f15700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c0c8b80 con 0x7f0e8c159760 2023-10-06T02:24:03.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.982+0000 7f0e8bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e8c15d8d0 0x7f0e8c0c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.982+0000 7f0e8bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e8c15d8d0 0x7f0e8c0c7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51302/0 (socket says 172.21.15.37:51302) 2023-10-06T02:24:03.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.982+0000 7f0e8bfff700 1 -- 172.21.15.37:0/1881963252 learned_addr learned my addr 172.21.15.37:0/1881963252 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:03.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.982+0000 7f0e90cb1700 1 --2- 172.21.15.37:0/1881963252 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e8c159760 0x7f0e8c14dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.982+0000 7f0e914b2700 1 --2- 172.21.15.37:0/1881963252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e8c15dd50 0x7f0e8c0c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.982+0000 7f0e8bfff700 1 -- 172.21.15.37:0/1881963252 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e8c159760 msgr2=0x7f0e8c14dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:03.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.982+0000 7f0e8bfff700 1 --2- 172.21.15.37:0/1881963252 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e8c159760 0x7f0e8c14dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.982+0000 7f0e8bfff700 1 -- 172.21.15.37:0/1881963252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e8c15dd50 msgr2=0x7f0e8c0c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:03.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.982+0000 7f0e8bfff700 1 --2- 172.21.15.37:0/1881963252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e8c15dd50 0x7f0e8c0c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:03.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.982+0000 7f0e8bfff700 1 -- 172.21.15.37:0/1881963252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e84009ae0 con 0x7f0e8c15d8d0 2023-10-06T02:24:03.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.983+0000 7f0e8bfff700 1 --2- 172.21.15.37:0/1881963252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e8c15d8d0 0x7f0e8c0c7fa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c00c590 tx=0x7f0e7c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:03.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.983+0000 7f0e88ff9700 1 -- 172.21.15.37:0/1881963252 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c011590 con 0x7f0e8c15d8d0 2023-10-06T02:24:03.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.983+0000 7f0e88ff9700 1 -- 172.21.15.37:0/1881963252 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7c011710 con 0x7f0e8c15d8d0 2023-10-06T02:24:03.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.983+0000 7f0e92f15700 1 -- 172.21.15.37:0/1881963252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e8c0c8e60 con 0x7f0e8c15d8d0 2023-10-06T02:24:03.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.983+0000 7f0e88ff9700 1 -- 172.21.15.37:0/1881963252 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c011ad0 con 0x7f0e8c15d8d0 2023-10-06T02:24:03.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.983+0000 7f0e92f15700 1 -- 172.21.15.37:0/1881963252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e8c0c9420 con 0x7f0e8c15d8d0 2023-10-06T02:24:03.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.984+0000 7f0e92f15700 1 -- 172.21.15.37:0/1881963252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e8c0c9900 con 0x7f0e8c15d8d0 2023-10-06T02:24:03.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.984+0000 7f0e88ff9700 1 -- 172.21.15.37:0/1881963252 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e7c01b3b0 con 0x7f0e8c15d8d0 2023-10-06T02:24:03.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.985+0000 7f0e88ff9700 1 --2- 172.21.15.37:0/1881963252 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0e6c066f30 0x7f0e6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:03.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.985+0000 7f0e88ff9700 1 -- 172.21.15.37:0/1881963252 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0e7c083870 con 0x7f0e8c15d8d0 2023-10-06T02:24:03.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.985+0000 7f0e90cb1700 1 --2- 172.21.15.37:0/1881963252 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0e6c066f30 0x7f0e6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:03.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.986+0000 7f0e90cb1700 1 --2- 172.21.15.37:0/1881963252 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0e6c066f30 0x7f0e6c0693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009880 tx=0x7f0e84018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:03.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:03.989+0000 7f0e88ff9700 1 -- 172.21.15.37:0/1881963252 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e7c050c30 con 0x7f0e8c15d8d0 2023-10-06T02:24:04.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.185+0000 7f0e92f15700 1 -- 172.21.15.37:0/1881963252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0e8c06fbf0 con 0x7f0e8c15d8d0 2023-10-06T02:24:04.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.185+0000 7f0e88ff9700 1 -- 172.21.15.37:0/1881963252 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+126 (secure 0 0 0) 0x7f0e7c017020 con 0x7f0e8c15d8d0 2023-10-06T02:24:04.187 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:04.187 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-10-06T02:24:04.187 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:04.187 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-10-06T02:24:04.187 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-10-06T02:24:04.187 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:04.187 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:04.188 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-10-06T02:24:04.188 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-10-06T02:24:04.188 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:04.188 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-10-06T02:24:04.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.187+0000 7f0e92f15700 1 -- 172.21.15.37:0/1881963252 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0e6c066f30 msgr2=0x7f0e6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:04.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.187+0000 7f0e92f15700 1 --2- 172.21.15.37:0/1881963252 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0e6c066f30 0x7f0e6c0693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009880 tx=0x7f0e84018000 comp rx=0 tx=0).stop 2023-10-06T02:24:04.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.187+0000 7f0e92f15700 1 -- 172.21.15.37:0/1881963252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e8c15d8d0 msgr2=0x7f0e8c0c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:04.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.187+0000 7f0e92f15700 1 --2- 172.21.15.37:0/1881963252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e8c15d8d0 0x7f0e8c0c7fa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c00c590 tx=0x7f0e7c00c8a0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.187+0000 7f0e92f15700 1 -- 172.21.15.37:0/1881963252 shutdown_connections 2023-10-06T02:24:04.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.187+0000 7f0e92f15700 1 --2- 172.21.15.37:0/1881963252 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0e6c066f30 0x7f0e6c0693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.187+0000 7f0e92f15700 1 --2- 172.21.15.37:0/1881963252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e8c15dd50 0x7f0e8c0c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.187+0000 7f0e92f15700 1 --2- 172.21.15.37:0/1881963252 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e8c159760 0x7f0e8c14dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.187+0000 7f0e92f15700 1 --2- 172.21.15.37:0/1881963252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e8c15d8d0 0x7f0e8c0c7fa0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.187+0000 7f0e92f15700 1 -- 172.21.15.37:0/1881963252 >> 172.21.15.37:0/1881963252 conn(0x7f0e8c06c890 msgr2=0x7f0e8c158a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:04.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.188+0000 7f0e92f15700 1 -- 172.21.15.37:0/1881963252 shutdown_connections 2023-10-06T02:24:04.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.188+0000 7f0e92f15700 1 -- 172.21.15.37:0/1881963252 wait complete. 2023-10-06T02:24:04.201 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:24:04.201 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:24:04.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.322+0000 7fe3e3581700 1 Processor -- start 2023-10-06T02:24:04.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.323+0000 7fe3e3581700 1 -- start start 2023-10-06T02:24:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.323+0000 7fe3e3581700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe3dc159550 0x7fe3dc159920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.323+0000 7fe3e3581700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3dc0b24d0 0x7fe3dc15ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.323+0000 7fe3e3581700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe3dc06c0b0 0x7fe3dc06c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.323+0000 7fe3e3581700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3dc15e300 con 0x7fe3dc159550 2023-10-06T02:24:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.323+0000 7fe3e3581700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3dc06ca10 con 0x7fe3dc06c0b0 2023-10-06T02:24:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.323+0000 7fe3e3581700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc0b29b0 con 0x7fe3dc0b24d0 2023-10-06T02:24:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.324+0000 7fe3e131d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe3dc159550 0x7fe3dc159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.324+0000 7fe3e131d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe3dc159550 0x7fe3dc159920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51312/0 (socket says 172.21.15.37:51312) 2023-10-06T02:24:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.324+0000 7fe3e131d700 1 -- 172.21.15.37:0/1002524992 learned_addr learned my addr 172.21.15.37:0/1002524992 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.324+0000 7fe3e131d700 1 -- 172.21.15.37:0/1002524992 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3dc0b24d0 msgr2=0x7fe3dc15ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.324+0000 7fe3e0b1c700 1 --2- 172.21.15.37:0/1002524992 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3dc0b24d0 0x7fe3dc15ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.324+0000 7fe3e1b1e700 1 --2- 172.21.15.37:0/1002524992 >> v2:172.21.15.191:3300/0 conn(0x7fe3dc06c0b0 0x7fe3dc06c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.324+0000 7fe3e131d700 1 --2- 172.21.15.37:0/1002524992 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3dc0b24d0 0x7fe3dc15ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.324+0000 7fe3e131d700 1 -- 172.21.15.37:0/1002524992 >> v2:172.21.15.191:3300/0 conn(0x7fe3dc06c0b0 msgr2=0x7fe3dc06c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.324+0000 7fe3e131d700 1 --2- 172.21.15.37:0/1002524992 >> v2:172.21.15.191:3300/0 conn(0x7fe3dc06c0b0 0x7fe3dc06c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.324+0000 7fe3e131d700 1 -- 172.21.15.37:0/1002524992 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc0b2c90 con 0x7fe3dc159550 2023-10-06T02:24:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.324+0000 7fe3e0b1c700 1 --2- 172.21.15.37:0/1002524992 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3dc0b24d0 0x7fe3dc15ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.324+0000 7fe3e1b1e700 1 --2- 172.21.15.37:0/1002524992 >> v2:172.21.15.191:3300/0 conn(0x7fe3dc06c0b0 0x7fe3dc06c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.324+0000 7fe3e131d700 1 --2- 172.21.15.37:0/1002524992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3dc159550 0x7fe3dc159920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc06be40 tx=0x7fe3d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d883f6cc1d989a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.324+0000 7fe3dbfff700 1 -- 172.21.15.37:0/1002524992 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d400b860 con 0x7fe3dc159550 2023-10-06T02:24:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.324+0000 7fe3dbfff700 1 -- 172.21.15.37:0/1002524992 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d400b9c0 con 0x7fe3dc159550 2023-10-06T02:24:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.324+0000 7fe3dbfff700 1 -- 172.21.15.37:0/1002524992 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d400bd60 con 0x7fe3dc159550 2023-10-06T02:24:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.325+0000 7fe3e3581700 1 -- 172.21.15.37:0/1002524992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3dc159550 msgr2=0x7fe3dc159920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.325+0000 7fe3e3581700 1 --2- 172.21.15.37:0/1002524992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3dc159550 0x7fe3dc159920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc06be40 tx=0x7fe3d4009250 comp rx=0 tx=0).stop 2023-10-06T02:24:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.325+0000 7fe3e3581700 1 -- 172.21.15.37:0/1002524992 shutdown_connections 2023-10-06T02:24:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.325+0000 7fe3e3581700 1 --2- 172.21.15.37:0/1002524992 >> v2:172.21.15.191:3300/0 conn(0x7fe3dc06c0b0 0x7fe3dc06c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.325+0000 7fe3e3581700 1 --2- 172.21.15.37:0/1002524992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3dc159550 0x7fe3dc159920 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.325+0000 7fe3e3581700 1 --2- 172.21.15.37:0/1002524992 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3dc0b24d0 0x7fe3dc15ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.325+0000 7fe3e3581700 1 -- 172.21.15.37:0/1002524992 >> 172.21.15.37:0/1002524992 conn(0x7fe3dc06d900 msgr2=0x7fe3dc06dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.325+0000 7fe3e3581700 1 -- 172.21.15.37:0/1002524992 shutdown_connections 2023-10-06T02:24:04.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.325+0000 7fe3e3581700 1 -- 172.21.15.37:0/1002524992 wait complete. 2023-10-06T02:24:04.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.326+0000 7fe3e3581700 1 Processor -- start 2023-10-06T02:24:04.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.326+0000 7fe3e3581700 1 -- start start 2023-10-06T02:24:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.327+0000 7fe3e3581700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3dc06c0b0 0x7fe3dc15a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.327+0000 7fe3e3581700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3dc0b24d0 0x7fe3dc0c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.327+0000 7fe3e3581700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3dc159550 0x7fe3dc14a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.327+0000 7fe3e3581700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc0c4bf0 con 0x7fe3dc06c0b0 2023-10-06T02:24:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.327+0000 7fe3e3581700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc0c4ed0 con 0x7fe3dc0b24d0 2023-10-06T02:24:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.327+0000 7fe3e3581700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc15cc40 con 0x7fe3dc159550 2023-10-06T02:24:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.327+0000 7fe3e131d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3dc06c0b0 0x7fe3dc15a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.327+0000 7fe3e131d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3dc06c0b0 0x7fe3dc15a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51314/0 (socket says 172.21.15.37:51314) 2023-10-06T02:24:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.327+0000 7fe3e131d700 1 -- 172.21.15.37:0/1644680254 learned_addr learned my addr 172.21.15.37:0/1644680254 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.327+0000 7fe3e0b1c700 1 --2- 172.21.15.37:0/1644680254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3dc0b24d0 0x7fe3dc0c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.327+0000 7fe3e1b1e700 1 --2- 172.21.15.37:0/1644680254 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3dc159550 0x7fe3dc14a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.327+0000 7fe3e131d700 1 -- 172.21.15.37:0/1644680254 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3dc159550 msgr2=0x7fe3dc14a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.327+0000 7fe3e131d700 1 --2- 172.21.15.37:0/1644680254 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3dc159550 0x7fe3dc14a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.327+0000 7fe3e131d700 1 -- 172.21.15.37:0/1644680254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3dc0b24d0 msgr2=0x7fe3dc0c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.327+0000 7fe3e131d700 1 --2- 172.21.15.37:0/1644680254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3dc0b24d0 0x7fe3dc0c6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.327+0000 7fe3e131d700 1 -- 172.21.15.37:0/1644680254 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d40094f0 con 0x7fe3dc06c0b0 2023-10-06T02:24:04.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.327+0000 7fe3e0b1c700 1 --2- 172.21.15.37:0/1644680254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3dc0b24d0 0x7fe3dc0c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:04.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.327+0000 7fe3e1b1e700 1 --2- 172.21.15.37:0/1644680254 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3dc159550 0x7fe3dc14a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:04.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.327+0000 7fe3e131d700 1 --2- 172.21.15.37:0/1644680254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3dc06c0b0 0x7fe3dc15a310 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4006fd0 tx=0x7fe3d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:04.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.328+0000 7fe3d97fa700 1 -- 172.21.15.37:0/1644680254 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4024440 con 0x7fe3dc06c0b0 2023-10-06T02:24:04.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.328+0000 7fe3d97fa700 1 -- 172.21.15.37:0/1644680254 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d40245a0 con 0x7fe3dc06c0b0 2023-10-06T02:24:04.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.328+0000 7fe3d97fa700 1 -- 172.21.15.37:0/1644680254 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4024960 con 0x7fe3dc06c0b0 2023-10-06T02:24:04.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.328+0000 7fe3e3581700 1 -- 172.21.15.37:0/1644680254 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3dc15cf20 con 0x7fe3dc06c0b0 2023-10-06T02:24:04.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.328+0000 7fe3e3581700 1 -- 172.21.15.37:0/1644680254 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3dc15bdb0 con 0x7fe3dc06c0b0 2023-10-06T02:24:04.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.329+0000 7fe3e3581700 1 -- 172.21.15.37:0/1644680254 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3dc088b20 con 0x7fe3dc06c0b0 2023-10-06T02:24:04.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.329+0000 7fe3d97fa700 1 -- 172.21.15.37:0/1644680254 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3d401a420 con 0x7fe3dc06c0b0 2023-10-06T02:24:04.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.329+0000 7fe3d97fa700 1 --2- 172.21.15.37:0/1644680254 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe3c8066f30 0x7fe3c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:04.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.330+0000 7fe3d97fa700 1 -- 172.21.15.37:0/1644680254 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe3d4086130 con 0x7fe3dc06c0b0 2023-10-06T02:24:04.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.330+0000 7fe3e0b1c700 1 --2- 172.21.15.37:0/1644680254 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe3c8066f30 0x7fe3c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:04.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.330+0000 7fe3e0b1c700 1 --2- 172.21.15.37:0/1644680254 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe3c8066f30 0x7fe3c80693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc0b28e0 tx=0x7fe3d0006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:04.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.334+0000 7fe3d97fa700 1 -- 172.21.15.37:0/1644680254 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3d4053610 con 0x7fe3dc06c0b0 2023-10-06T02:24:04.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.528+0000 7fe3e3581700 1 -- 172.21.15.37:0/1644680254 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe3dc04bb80 con 0x7fe3dc06c0b0 2023-10-06T02:24:04.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.863+0000 7fe3d97fa700 1 -- 172.21.15.37:0/1644680254 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe3d4056c30 con 0x7fe3dc06c0b0 2023-10-06T02:24:04.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.866+0000 7fe3e3581700 1 -- 172.21.15.37:0/1644680254 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe3c8066f30 msgr2=0x7fe3c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:04.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.866+0000 7fe3e3581700 1 --2- 172.21.15.37:0/1644680254 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe3c8066f30 0x7fe3c80693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc0b28e0 tx=0x7fe3d0006f90 comp rx=0 tx=0).stop 2023-10-06T02:24:04.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.866+0000 7fe3e3581700 1 -- 172.21.15.37:0/1644680254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3dc06c0b0 msgr2=0x7fe3dc15a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:04.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.866+0000 7fe3e3581700 1 --2- 172.21.15.37:0/1644680254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3dc06c0b0 0x7fe3dc15a310 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4006fd0 tx=0x7fe3d4017000 comp rx=0 tx=0).stop 2023-10-06T02:24:04.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.866+0000 7fe3e3581700 1 -- 172.21.15.37:0/1644680254 shutdown_connections 2023-10-06T02:24:04.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.866+0000 7fe3e3581700 1 --2- 172.21.15.37:0/1644680254 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3dc159550 0x7fe3dc14a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.866+0000 7fe3e3581700 1 --2- 172.21.15.37:0/1644680254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3dc06c0b0 0x7fe3dc15a310 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.866+0000 7fe3e3581700 1 --2- 172.21.15.37:0/1644680254 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe3c8066f30 0x7fe3c80693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.866+0000 7fe3e3581700 1 --2- 172.21.15.37:0/1644680254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3dc0b24d0 0x7fe3dc0c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:04.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.866+0000 7fe3e3581700 1 -- 172.21.15.37:0/1644680254 >> 172.21.15.37:0/1644680254 conn(0x7fe3dc06d900 msgr2=0x7fe3dc1589e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:04.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.867+0000 7fe3e3581700 1 -- 172.21.15.37:0/1644680254 shutdown_connections 2023-10-06T02:24:04.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:04.867+0000 7fe3e3581700 1 -- 172.21.15.37:0/1644680254 wait complete. 2023-10-06T02:24:04.870 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-10-06T02:24:04.883 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:24:05.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.029+0000 7f6be759e700 1 Processor -- start 2023-10-06T02:24:05.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.029+0000 7f6be759e700 1 -- start start 2023-10-06T02:24:05.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.030+0000 7f6be759e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6be8157200 0x7f6be80cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:05.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.030+0000 7f6be759e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6be81575d0 0x7f6be80c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:05.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.030+0000 7f6be759e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be81587b0 con 0x7f6be80c8d00 2023-10-06T02:24:05.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.030+0000 7f6be759e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be80c90d0 con 0x7f6be8157200 2023-10-06T02:24:05.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.030+0000 7f6be759e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be8157ba0 con 0x7f6be81575d0 2023-10-06T02:24:05.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.030+0000 7f6be659c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6be8157200 0x7f6be80cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:05.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.030+0000 7f6be659c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6be8157200 0x7f6be80cbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51318/0 (socket says 172.21.15.37:51318) 2023-10-06T02:24:05.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.030+0000 7f6be659c700 1 -- 172.21.15.37:0/1665275351 learned_addr learned my addr 172.21.15.37:0/1665275351 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:05.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.030+0000 7f6be5d9b700 1 --2- 172.21.15.37:0/1665275351 >> v2:172.21.15.191:3300/0 conn(0x7f6be81575d0 0x7f6be80c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:05.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.030+0000 7f6be659c700 1 -- 172.21.15.37:0/1665275351 >> v2:172.21.15.191:3300/0 conn(0x7f6be81575d0 msgr2=0x7f6be80c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:05.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.030+0000 7f6be659c700 1 --2- 172.21.15.37:0/1665275351 >> v2:172.21.15.191:3300/0 conn(0x7f6be81575d0 0x7f6be80c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:05.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.030+0000 7f6be659c700 1 -- 172.21.15.37:0/1665275351 >> v1:172.21.15.191:6789/0 conn(0x7f6be80c8d00 legacy=0x7f6be80b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:05.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.030+0000 7f6be659c700 1 -- 172.21.15.37:0/1665275351 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be8157e80 con 0x7f6be8157200 2023-10-06T02:24:05.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.031+0000 7f6be659c700 1 --2- 172.21.15.37:0/1665275351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be8157200 0x7f6be80cbd50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6be80cd810 tx=0x7f6bd8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c157e355dcda37d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:05.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.031+0000 7f6be559a700 1 -- 172.21.15.37:0/1665275351 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd800e070 con 0x7f6be8157200 2023-10-06T02:24:05.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.031+0000 7f6be559a700 1 -- 172.21.15.37:0/1665275351 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd800ba10 con 0x7f6be8157200 2023-10-06T02:24:05.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.031+0000 7f6be559a700 1 -- 172.21.15.37:0/1665275351 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd80092e0 con 0x7f6be8157200 2023-10-06T02:24:05.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.031+0000 7f6be759e700 1 -- 172.21.15.37:0/1665275351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be8157200 msgr2=0x7f6be80cbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:05.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.031+0000 7f6be759e700 1 --2- 172.21.15.37:0/1665275351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be8157200 0x7f6be80cbd50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6be80cd810 tx=0x7f6bd8009840 comp rx=0 tx=0).stop 2023-10-06T02:24:05.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.031+0000 7f6be759e700 1 -- 172.21.15.37:0/1665275351 shutdown_connections 2023-10-06T02:24:05.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.031+0000 7f6be759e700 1 --2- 172.21.15.37:0/1665275351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be8157200 0x7f6be80cbd50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:05.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.031+0000 7f6be759e700 1 --2- 172.21.15.37:0/1665275351 >> v2:172.21.15.191:3300/0 conn(0x7f6be81575d0 0x7f6be80c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:05.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.031+0000 7f6be759e700 1 -- 172.21.15.37:0/1665275351 >> 172.21.15.37:0/1665275351 conn(0x7f6be806c0b0 msgr2=0x7f6be806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:05.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.031+0000 7f6be759e700 1 -- 172.21.15.37:0/1665275351 shutdown_connections 2023-10-06T02:24:05.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.031+0000 7f6be759e700 1 -- 172.21.15.37:0/1665275351 wait complete. 2023-10-06T02:24:05.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.032+0000 7f6be759e700 1 Processor -- start 2023-10-06T02:24:05.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.032+0000 7f6be759e700 1 -- start start 2023-10-06T02:24:05.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.033+0000 7f6be759e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6be80c8d00 0x7f6be80b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:05.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.033+0000 7f6be759e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6be8157200 0x7f6be814fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:05.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.033+0000 7f6be759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be81575d0 0x7f6be81501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:05.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.033+0000 7f6be759e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80c5ba0 con 0x7f6be81575d0 2023-10-06T02:24:05.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.033+0000 7f6be759e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80c6160 con 0x7f6be8157200 2023-10-06T02:24:05.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.033+0000 7f6be759e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80b2030 con 0x7f6be80c8d00 2023-10-06T02:24:05.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.033+0000 7f6be6d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be81575d0 0x7f6be81501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:05.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.033+0000 7f6be6d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be81575d0 0x7f6be81501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51322/0 (socket says 172.21.15.37:51322) 2023-10-06T02:24:05.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.033+0000 7f6be6d9d700 1 -- 172.21.15.37:0/1245001129 learned_addr learned my addr 172.21.15.37:0/1245001129 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:05.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.033+0000 7f6be5d9b700 1 --2- 172.21.15.37:0/1245001129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6be8157200 0x7f6be814fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:05.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.033+0000 7f6be659c700 1 --2- 172.21.15.37:0/1245001129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6be80c8d00 0x7f6be80b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:05.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.034+0000 7f6be6d9d700 1 -- 172.21.15.37:0/1245001129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6be80c8d00 msgr2=0x7f6be80b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:05.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.034+0000 7f6be6d9d700 1 --2- 172.21.15.37:0/1245001129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6be80c8d00 0x7f6be80b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:05.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.034+0000 7f6be6d9d700 1 -- 172.21.15.37:0/1245001129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6be8157200 msgr2=0x7f6be814fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.034+0000 7f6be6d9d700 1 --2- 172.21.15.37:0/1245001129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6be8157200 0x7f6be814fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.034+0000 7f6be6d9d700 1 -- 172.21.15.37:0/1245001129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd8009ae0 con 0x7f6be81575d0 2023-10-06T02:24:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.034+0000 7f6be6d9d700 1 --2- 172.21.15.37:0/1245001129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be81575d0 0x7f6be81501d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6be000c560 tx=0x7f6be0002060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.034+0000 7f6bde7fc700 1 -- 172.21.15.37:0/1245001129 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0011590 con 0x7f6be81575d0 2023-10-06T02:24:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.034+0000 7f6bde7fc700 1 -- 172.21.15.37:0/1245001129 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be0011710 con 0x7f6be81575d0 2023-10-06T02:24:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.034+0000 7f6bde7fc700 1 -- 172.21.15.37:0/1245001129 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0011ad0 con 0x7f6be81575d0 2023-10-06T02:24:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.034+0000 7f6be759e700 1 -- 172.21.15.37:0/1245001129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be80af100 con 0x7f6be81575d0 2023-10-06T02:24:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.034+0000 7f6be759e700 1 -- 172.21.15.37:0/1245001129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be80c5df0 con 0x7f6be81575d0 2023-10-06T02:24:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.035+0000 7f6be759e700 1 -- 172.21.15.37:0/1245001129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be8064160 con 0x7f6be81575d0 2023-10-06T02:24:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.035+0000 7f6bde7fc700 1 -- 172.21.15.37:0/1245001129 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6be001c460 con 0x7f6be81575d0 2023-10-06T02:24:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.036+0000 7f6bde7fc700 1 --2- 172.21.15.37:0/1245001129 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6bc8066f30 0x7f6bc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:05.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.036+0000 7f6bde7fc700 1 -- 172.21.15.37:0/1245001129 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f6be00840a0 con 0x7f6be81575d0 2023-10-06T02:24:05.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.036+0000 7f6be659c700 1 --2- 172.21.15.37:0/1245001129 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6bc8066f30 0x7f6bc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:05.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.037+0000 7f6be659c700 1 --2- 172.21.15.37:0/1245001129 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6bc8066f30 0x7f6bc80693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8009880 tx=0x7f6bd8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:05.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.040+0000 7f6bde7fc700 1 -- 172.21.15.37:0/1245001129 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6be00512f0 con 0x7f6be81575d0 2023-10-06T02:24:05.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.232+0000 7f6be759e700 1 -- 172.21.15.37:0/1245001129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6be80c62f0 con 0x7f6be81575d0 2023-10-06T02:24:05.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.869+0000 7f6bde7fc700 1 -- 172.21.15.37:0/1245001129 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6be0054910 con 0x7f6be81575d0 2023-10-06T02:24:05.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.875+0000 7f6be759e700 1 -- 172.21.15.37:0/1245001129 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6bc8066f30 msgr2=0x7f6bc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:05.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.875+0000 7f6be759e700 1 --2- 172.21.15.37:0/1245001129 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6bc8066f30 0x7f6bc80693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8009880 tx=0x7f6bd8017000 comp rx=0 tx=0).stop 2023-10-06T02:24:05.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.875+0000 7f6be759e700 1 -- 172.21.15.37:0/1245001129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be81575d0 msgr2=0x7f6be81501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:05.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.875+0000 7f6be759e700 1 --2- 172.21.15.37:0/1245001129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be81575d0 0x7f6be81501d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6be000c560 tx=0x7f6be0002060 comp rx=0 tx=0).stop 2023-10-06T02:24:05.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.875+0000 7f6be759e700 1 -- 172.21.15.37:0/1245001129 shutdown_connections 2023-10-06T02:24:05.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.875+0000 7f6be759e700 1 --2- 172.21.15.37:0/1245001129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be81575d0 0x7f6be81501d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:05.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.875+0000 7f6be759e700 1 --2- 172.21.15.37:0/1245001129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6be80c8d00 0x7f6be80b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:05.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.875+0000 7f6be759e700 1 --2- 172.21.15.37:0/1245001129 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6bc8066f30 0x7f6bc80693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:05.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.875+0000 7f6be759e700 1 --2- 172.21.15.37:0/1245001129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6be8157200 0x7f6be814fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:05.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.875+0000 7f6be759e700 1 -- 172.21.15.37:0/1245001129 >> 172.21.15.37:0/1245001129 conn(0x7f6be806c0b0 msgr2=0x7f6be81596d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:05.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.875+0000 7f6be759e700 1 -- 172.21.15.37:0/1245001129 shutdown_connections 2023-10-06T02:24:05.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:05.875+0000 7f6be759e700 1 -- 172.21.15.37:0/1245001129 wait complete. 2023-10-06T02:24:05.881 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-10-06T02:24:05.898 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:24:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.021+0000 7fccdf224700 1 Processor -- start 2023-10-06T02:24:06.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.021+0000 7fccdf224700 1 -- start start 2023-10-06T02:24:06.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.022+0000 7fccdf224700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fccd80b2a90 0x7fccd8159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:06.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.022+0000 7fccdf224700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fccd80ccb30 0x7fccd80ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:06.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.022+0000 7fccdf224700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd80b07a0 con 0x7fccd81593c0 2023-10-06T02:24:06.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.022+0000 7fccdf224700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd80cd8a0 con 0x7fccd80ccb30 2023-10-06T02:24:06.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.022+0000 7fccdf224700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd80afe70 con 0x7fccd80b2a90 2023-10-06T02:24:06.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.022+0000 7fccdd7c1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fccd80ccb30 0x7fccd80ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:06.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.022+0000 7fccdd7c1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fccd80ccb30 0x7fccd80ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41248/0 (socket says 172.21.15.37:41248) 2023-10-06T02:24:06.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.022+0000 7fccdd7c1700 1 -- 172.21.15.37:0/891087427 learned_addr learned my addr 172.21.15.37:0/891087427 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:06.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.022+0000 7fccd7fff700 1 --2- 172.21.15.37:0/891087427 >> v2:172.21.15.191:3300/0 conn(0x7fccd80b2a90 0x7fccd8159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:06.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.023+0000 7fccdd7c1700 1 -- 172.21.15.37:0/891087427 >> v2:172.21.15.191:3300/0 conn(0x7fccd80b2a90 msgr2=0x7fccd8159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:06.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.023+0000 7fccdd7c1700 1 --2- 172.21.15.37:0/891087427 >> v2:172.21.15.191:3300/0 conn(0x7fccd80b2a90 0x7fccd8159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:06.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.023+0000 7fccdd7c1700 1 -- 172.21.15.37:0/891087427 >> v1:172.21.15.191:6789/0 conn(0x7fccd81593c0 legacy=0x7fccd80b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:06.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.023+0000 7fccdd7c1700 1 -- 172.21.15.37:0/891087427 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd80b0150 con 0x7fccd80ccb30 2023-10-06T02:24:06.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.023+0000 7fccdd7c1700 1 --2- 172.21.15.37:0/891087427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccd80ccb30 0x7fccd80ccf90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fccd80b2170 tx=0x7fccc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eccf05f6e3e8e371 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:06.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.023+0000 7fccd77fe700 1 -- 172.21.15.37:0/891087427 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc000b860 con 0x7fccd80ccb30 2023-10-06T02:24:06.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.023+0000 7fccd77fe700 1 -- 172.21.15.37:0/891087427 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc000b9c0 con 0x7fccd80ccb30 2023-10-06T02:24:06.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.023+0000 7fccd77fe700 1 -- 172.21.15.37:0/891087427 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc000bd60 con 0x7fccd80ccb30 2023-10-06T02:24:06.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.023+0000 7fccdf224700 1 -- 172.21.15.37:0/891087427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccd80ccb30 msgr2=0x7fccd80ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:06.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.023+0000 7fccdf224700 1 --2- 172.21.15.37:0/891087427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccd80ccb30 0x7fccd80ccf90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fccd80b2170 tx=0x7fccc0009250 comp rx=0 tx=0).stop 2023-10-06T02:24:06.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.024+0000 7fccdf224700 1 -- 172.21.15.37:0/891087427 shutdown_connections 2023-10-06T02:24:06.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.024+0000 7fccdf224700 1 --2- 172.21.15.37:0/891087427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccd80ccb30 0x7fccd80ccf90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:06.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.024+0000 7fccdf224700 1 --2- 172.21.15.37:0/891087427 >> v2:172.21.15.191:3300/0 conn(0x7fccd80b2a90 0x7fccd8159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:06.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.024+0000 7fccdf224700 1 -- 172.21.15.37:0/891087427 >> 172.21.15.37:0/891087427 conn(0x7fccd806c0b0 msgr2=0x7fccd806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:06.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.024+0000 7fccdf224700 1 -- 172.21.15.37:0/891087427 shutdown_connections 2023-10-06T02:24:06.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.024+0000 7fccdf224700 1 -- 172.21.15.37:0/891087427 wait complete. 2023-10-06T02:24:06.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.025+0000 7fccdf224700 1 Processor -- start 2023-10-06T02:24:06.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.025+0000 7fccdf224700 1 -- start start 2023-10-06T02:24:06.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccdf224700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fccd80b2a90 0x7fccd80c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:06.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccdf224700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccd80ccb30 0x7fccd80b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:06.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccdf224700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccd81593c0 0x7fccd8157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:06.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccdf224700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd80c8460 con 0x7fccd81593c0 2023-10-06T02:24:06.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccdf224700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd80c3d00 con 0x7fccd80ccb30 2023-10-06T02:24:06.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccdf224700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd80c3fc0 con 0x7fccd80b2a90 2023-10-06T02:24:06.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccdd7c1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccd81593c0 0x7fccd8157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:06.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccdd7c1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccd81593c0 0x7fccd8157a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41254/0 (socket says 172.21.15.37:41254) 2023-10-06T02:24:06.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccdd7c1700 1 -- 172.21.15.37:0/1774304537 learned_addr learned my addr 172.21.15.37:0/1774304537 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:06.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccd7fff700 1 --2- 172.21.15.37:0/1774304537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccd80ccb30 0x7fccd80b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:06.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccdcfc0700 1 --2- 172.21.15.37:0/1774304537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fccd80b2a90 0x7fccd80c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:06.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccdd7c1700 1 -- 172.21.15.37:0/1774304537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fccd80b2a90 msgr2=0x7fccd80c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:06.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccdd7c1700 1 --2- 172.21.15.37:0/1774304537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fccd80b2a90 0x7fccd80c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:06.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccdd7c1700 1 -- 172.21.15.37:0/1774304537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccd80ccb30 msgr2=0x7fccd80b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:06.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccdd7c1700 1 --2- 172.21.15.37:0/1774304537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccd80ccb30 0x7fccd80b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:06.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccdd7c1700 1 -- 172.21.15.37:0/1774304537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc00094f0 con 0x7fccd81593c0 2023-10-06T02:24:06.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccdd7c1700 1 --2- 172.21.15.37:0/1774304537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccd81593c0 0x7fccd8157a30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fccd80894a0 tx=0x7fccc0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:06.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccd4ff9700 1 -- 172.21.15.37:0/1774304537 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc0011e80 con 0x7fccd81593c0 2023-10-06T02:24:06.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccd4ff9700 1 -- 172.21.15.37:0/1774304537 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc001a630 con 0x7fccd81593c0 2023-10-06T02:24:06.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccdf224700 1 -- 172.21.15.37:0/1774304537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd80b5020 con 0x7fccd81593c0 2023-10-06T02:24:06.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccd4ff9700 1 -- 172.21.15.37:0/1774304537 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc001a9d0 con 0x7fccd81593c0 2023-10-06T02:24:06.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.026+0000 7fccdf224700 1 -- 172.21.15.37:0/1774304537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd80c7ea0 con 0x7fccd81593c0 2023-10-06T02:24:06.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.027+0000 7fccdf224700 1 -- 172.21.15.37:0/1774304537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd8088bb0 con 0x7fccd81593c0 2023-10-06T02:24:06.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.028+0000 7fccd4ff9700 1 -- 172.21.15.37:0/1774304537 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fccc002d440 con 0x7fccd81593c0 2023-10-06T02:24:06.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.028+0000 7fccd4ff9700 1 --2- 172.21.15.37:0/1774304537 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fccb8066f30 0x7fccb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:06.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.029+0000 7fccd4ff9700 1 -- 172.21.15.37:0/1774304537 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fccc0086290 con 0x7fccd81593c0 2023-10-06T02:24:06.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.029+0000 7fccdcfc0700 1 --2- 172.21.15.37:0/1774304537 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fccb8066f30 0x7fccb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:06.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.029+0000 7fccdcfc0700 1 --2- 172.21.15.37:0/1774304537 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fccb8066f30 0x7fccb80693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fccd0003230 tx=0x7fccd0016040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:06.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.033+0000 7fccd4ff9700 1 -- 172.21.15.37:0/1774304537 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fccc0053400 con 0x7fccd81593c0 2023-10-06T02:24:06.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.272+0000 7fccdf224700 1 -- 172.21.15.37:0/1774304537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fccd80b0430 con 0x7fccd81593c0 2023-10-06T02:24:06.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.876+0000 7fccd4ff9700 1 -- 172.21.15.37:0/1774304537 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fccc0056a20 con 0x7fccd81593c0 2023-10-06T02:24:06.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.880+0000 7fccdf224700 1 -- 172.21.15.37:0/1774304537 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fccb8066f30 msgr2=0x7fccb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:06.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.880+0000 7fccdf224700 1 --2- 172.21.15.37:0/1774304537 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fccb8066f30 0x7fccb80693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fccd0003230 tx=0x7fccd0016040 comp rx=0 tx=0).stop 2023-10-06T02:24:06.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.880+0000 7fccdf224700 1 -- 172.21.15.37:0/1774304537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccd81593c0 msgr2=0x7fccd8157a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:06.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.880+0000 7fccdf224700 1 --2- 172.21.15.37:0/1774304537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccd81593c0 0x7fccd8157a30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fccd80894a0 tx=0x7fccc0017000 comp rx=0 tx=0).stop 2023-10-06T02:24:06.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.880+0000 7fccdf224700 1 -- 172.21.15.37:0/1774304537 shutdown_connections 2023-10-06T02:24:06.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.880+0000 7fccdf224700 1 --2- 172.21.15.37:0/1774304537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccd81593c0 0x7fccd8157a30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:06.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.880+0000 7fccdf224700 1 --2- 172.21.15.37:0/1774304537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fccd80b2a90 0x7fccd80c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:06.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.880+0000 7fccdf224700 1 --2- 172.21.15.37:0/1774304537 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fccb8066f30 0x7fccb80693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:06.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.880+0000 7fccdf224700 1 --2- 172.21.15.37:0/1774304537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccd80ccb30 0x7fccd80b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:06.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.881+0000 7fccdf224700 1 -- 172.21.15.37:0/1774304537 >> 172.21.15.37:0/1774304537 conn(0x7fccd806c0b0 msgr2=0x7fccd806c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:06.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.881+0000 7fccdf224700 1 -- 172.21.15.37:0/1774304537 shutdown_connections 2023-10-06T02:24:06.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:06.881+0000 7fccdf224700 1 -- 172.21.15.37:0/1774304537 wait complete. 2023-10-06T02:24:06.884 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 5 and data pool 6 2023-10-06T02:24:06.896 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:24:07.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.014+0000 7f272ef65700 1 Processor -- start 2023-10-06T02:24:07.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.015+0000 7f272ef65700 1 -- start start 2023-10-06T02:24:07.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.015+0000 7f272ef65700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2728159aa0 0x7f27280c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:07.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.015+0000 7f272ef65700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27280c6b30 0x7f27280cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:07.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.015+0000 7f272ef65700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27280c5300 con 0x7f27281596d0 2023-10-06T02:24:07.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.015+0000 7f272ef65700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27280c6160 con 0x7f2728159aa0 2023-10-06T02:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.015+0000 7f272ef65700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27280c5550 con 0x7f27280c6b30 2023-10-06T02:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.015+0000 7f2727fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2728159aa0 0x7f27280c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.015+0000 7f272cd01700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f27281596d0 0x7f27280b3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58132/0 (socket says 172.21.15.37:58132) 2023-10-06T02:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.016+0000 7f272cd01700 1 -- 172.21.15.37:0/244163944 learned_addr learned my addr 172.21.15.37:0/244163944 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.016+0000 7f272d502700 1 --2- 172.21.15.37:0/244163944 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27280c6b30 0x7f27280cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.016+0000 7f2727fff700 1 -- 172.21.15.37:0/244163944 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27280c6b30 msgr2=0x7f27280cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.016+0000 7f2727fff700 1 --2- 172.21.15.37:0/244163944 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27280c6b30 0x7f27280cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.016+0000 7f2727fff700 1 -- 172.21.15.37:0/244163944 >> v1:172.21.15.37:6789/0 conn(0x7f27281596d0 legacy=0x7f27280b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.016+0000 7f27277fe700 1 -- 172.21.15.37:0/244163944 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078702402 0 0) 0x7f27280c5300 con 0x7f27281596d0 2023-10-06T02:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.016+0000 7f2727fff700 1 -- 172.21.15.37:0/244163944 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27280c5830 con 0x7f2728159aa0 2023-10-06T02:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.016+0000 7f2727fff700 1 --2- 172.21.15.37:0/244163944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2728159aa0 0x7f27280c65f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f27100098e0 tx=0x7f27100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3ba7003bb601ce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.016+0000 7f27277fe700 1 -- 172.21.15.37:0/244163944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710009e80 con 0x7f2728159aa0 2023-10-06T02:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.016+0000 7f27277fe700 1 -- 172.21.15.37:0/244163944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271000b860 con 0x7f2728159aa0 2023-10-06T02:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.016+0000 7f27277fe700 1 -- 172.21.15.37:0/244163944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271000bbe0 con 0x7f2728159aa0 2023-10-06T02:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.017+0000 7f272ef65700 1 -- 172.21.15.37:0/244163944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2728159aa0 msgr2=0x7f27280c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.017+0000 7f272ef65700 1 --2- 172.21.15.37:0/244163944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2728159aa0 0x7f27280c65f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f27100098e0 tx=0x7f27100091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.017+0000 7f272ef65700 1 -- 172.21.15.37:0/244163944 shutdown_connections 2023-10-06T02:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.017+0000 7f272ef65700 1 --2- 172.21.15.37:0/244163944 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27280c6b30 0x7f27280cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.017+0000 7f272ef65700 1 --2- 172.21.15.37:0/244163944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2728159aa0 0x7f27280c65f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.017+0000 7f272ef65700 1 -- 172.21.15.37:0/244163944 >> 172.21.15.37:0/244163944 conn(0x7f272806c890 msgr2=0x7f27280d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.017+0000 7f272ef65700 1 -- 172.21.15.37:0/244163944 shutdown_connections 2023-10-06T02:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.017+0000 7f272ef65700 1 -- 172.21.15.37:0/244163944 wait complete. 2023-10-06T02:24:07.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.018+0000 7f272ef65700 1 Processor -- start 2023-10-06T02:24:07.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.018+0000 7f272ef65700 1 -- start start 2023-10-06T02:24:07.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.019+0000 7f272ef65700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27280c6b30 0x7f272809d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:07.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.019+0000 7f272ef65700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27281596d0 0x7f27280cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:07.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.019+0000 7f272ef65700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2728159aa0 0x7f27280cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:07.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.019+0000 7f272ef65700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272815f320 con 0x7f27281596d0 2023-10-06T02:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.019+0000 7f272ef65700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272816ad00 con 0x7f2728159aa0 2023-10-06T02:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.019+0000 7f272ef65700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272809dd70 con 0x7f27280c6b30 2023-10-06T02:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.019+0000 7f2727fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27281596d0 0x7f27280cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.019+0000 7f2727fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27281596d0 0x7f27280cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41276/0 (socket says 172.21.15.37:41276) 2023-10-06T02:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.019+0000 7f2727fff700 1 -- 172.21.15.37:0/2187162339 learned_addr learned my addr 172.21.15.37:0/2187162339 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.019+0000 7f272cd01700 1 --2- 172.21.15.37:0/2187162339 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27280c6b30 0x7f272809d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.019+0000 7f2727fff700 1 -- 172.21.15.37:0/2187162339 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27280c6b30 msgr2=0x7f272809d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.019+0000 7f2727fff700 1 --2- 172.21.15.37:0/2187162339 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27280c6b30 0x7f272809d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.019+0000 7f2727fff700 1 -- 172.21.15.37:0/2187162339 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2728159aa0 msgr2=0x7f27280cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.019+0000 7f272d502700 1 --2- 172.21.15.37:0/2187162339 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2728159aa0 0x7f27280cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.019+0000 7f2727fff700 1 --2- 172.21.15.37:0/2187162339 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2728159aa0 0x7f27280cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.019+0000 7f2727fff700 1 -- 172.21.15.37:0/2187162339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2710009420 con 0x7f27281596d0 2023-10-06T02:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.019+0000 7f2727fff700 1 --2- 172.21.15.37:0/2187162339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27281596d0 0x7f27280cf5f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2728088950 tx=0x7f2710017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.019+0000 7f2724ff9700 1 -- 172.21.15.37:0/2187162339 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271000bbe0 con 0x7f27281596d0 2023-10-06T02:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.020+0000 7f2724ff9700 1 -- 172.21.15.37:0/2187162339 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2710011420 con 0x7f27281596d0 2023-10-06T02:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.020+0000 7f272ef65700 1 -- 172.21.15.37:0/2187162339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272816a110 con 0x7f27281596d0 2023-10-06T02:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.020+0000 7f2724ff9700 1 -- 172.21.15.37:0/2187162339 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100117e0 con 0x7f27281596d0 2023-10-06T02:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.020+0000 7f272ef65700 1 -- 172.21.15.37:0/2187162339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272816a6b0 con 0x7f27281596d0 2023-10-06T02:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.020+0000 7f272ef65700 1 -- 172.21.15.37:0/2187162339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272806fbf0 con 0x7f27281596d0 2023-10-06T02:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.021+0000 7f2724ff9700 1 -- 172.21.15.37:0/2187162339 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2710011b90 con 0x7f27281596d0 2023-10-06T02:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.021+0000 7f2724ff9700 1 --2- 172.21.15.37:0/2187162339 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2708066f30 0x7f27080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.021+0000 7f2724ff9700 1 -- 172.21.15.37:0/2187162339 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f27100860b0 con 0x7f27281596d0 2023-10-06T02:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.021+0000 7f272cd01700 1 --2- 172.21.15.37:0/2187162339 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2708066f30 0x7f27080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:07.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.022+0000 7f272cd01700 1 --2- 172.21.15.37:0/2187162339 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2708066f30 0x7f27080693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f27200021a0 tx=0x7f2720009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:07.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.026+0000 7f2724ff9700 1 -- 172.21.15.37:0/2187162339 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27100531c0 con 0x7f27281596d0 2023-10-06T02:24:07.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.224+0000 7f272ef65700 1 -- 172.21.15.37:0/2187162339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2728156910 con 0x7f27281596d0 2023-10-06T02:24:07.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.225+0000 7f2724ff9700 1 -- 172.21.15.37:0/2187162339 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16879 (secure 0 0 0) 0x7f27100567e0 con 0x7f27281596d0 2023-10-06T02:24:07.226 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:07.226 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:24:06.273938+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:24:04.559429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T02:24:05.263596+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:24:07.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.227+0000 7f272ef65700 1 -- 172.21.15.37:0/2187162339 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2708066f30 msgr2=0x7f27080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.227+0000 7f272ef65700 1 --2- 172.21.15.37:0/2187162339 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2708066f30 0x7f27080693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f27200021a0 tx=0x7f2720009040 comp rx=0 tx=0).stop 2023-10-06T02:24:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.227+0000 7f272ef65700 1 -- 172.21.15.37:0/2187162339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27281596d0 msgr2=0x7f27280cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.227+0000 7f272ef65700 1 --2- 172.21.15.37:0/2187162339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27281596d0 0x7f27280cf5f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2728088950 tx=0x7f2710017000 comp rx=0 tx=0).stop 2023-10-06T02:24:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.227+0000 7f272ef65700 1 -- 172.21.15.37:0/2187162339 shutdown_connections 2023-10-06T02:24:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.227+0000 7f272ef65700 1 --2- 172.21.15.37:0/2187162339 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2708066f30 0x7f27080693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.227+0000 7f272ef65700 1 --2- 172.21.15.37:0/2187162339 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2728159aa0 0x7f27280cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.227+0000 7f272ef65700 1 --2- 172.21.15.37:0/2187162339 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27280c6b30 0x7f272809d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.227+0000 7f272ef65700 1 --2- 172.21.15.37:0/2187162339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27281596d0 0x7f27280cf5f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.227+0000 7f272ef65700 1 -- 172.21.15.37:0/2187162339 >> 172.21.15.37:0/2187162339 conn(0x7f272806c890 msgr2=0x7f27281576b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:07.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.227+0000 7f272ef65700 1 -- 172.21.15.37:0/2187162339 shutdown_connections 2023-10-06T02:24:07.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.227+0000 7f272ef65700 1 -- 172.21.15.37:0/2187162339 wait complete. 2023-10-06T02:24:07.240 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:24:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.358+0000 7fd0357db700 1 Processor -- start 2023-10-06T02:24:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.358+0000 7fd0357db700 1 -- start start 2023-10-06T02:24:07.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.358+0000 7fd0357db700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd030159760 0x7fd03015d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:07.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.359+0000 7fd0357db700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd03015dd50 0x7fd0300cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:07.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.359+0000 7fd0357db700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd03015e1d0 con 0x7fd03015d8d0 2023-10-06T02:24:07.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.359+0000 7fd0357db700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0300cc2d0 con 0x7fd03015dd50 2023-10-06T02:24:07.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.359+0000 7fd0357db700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0300cb650 con 0x7fd030159760 2023-10-06T02:24:07.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.359+0000 7fd02f7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd03015dd50 0x7fd0300cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:07.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.359+0000 7fd02e7fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd03015d8d0 0x7fd0300c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58136/0 (socket says 172.21.15.37:58136) 2023-10-06T02:24:07.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.359+0000 7fd02e7fc700 1 -- 172.21.15.37:0/3803001942 learned_addr learned my addr 172.21.15.37:0/3803001942 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:07.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.359+0000 7fd02effd700 1 --2- 172.21.15.37:0/3803001942 >> v2:172.21.15.191:3300/0 conn(0x7fd030159760 0x7fd03015d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:07.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.359+0000 7fd02f7fe700 1 -- 172.21.15.37:0/3803001942 >> v2:172.21.15.191:3300/0 conn(0x7fd030159760 msgr2=0x7fd03015d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:07.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.359+0000 7fd02f7fe700 1 --2- 172.21.15.37:0/3803001942 >> v2:172.21.15.191:3300/0 conn(0x7fd030159760 0x7fd03015d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.359+0000 7fd02f7fe700 1 -- 172.21.15.37:0/3803001942 >> v1:172.21.15.37:6789/0 conn(0x7fd03015d8d0 legacy=0x7fd0300c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:07.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.359+0000 7fd02f7fe700 1 -- 172.21.15.37:0/3803001942 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0300cb930 con 0x7fd03015dd50 2023-10-06T02:24:07.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.359+0000 7fd02effd700 1 --2- 172.21.15.37:0/3803001942 >> v2:172.21.15.191:3300/0 conn(0x7fd030159760 0x7fd03015d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:07.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.359+0000 7fd02dffb700 1 -- 172.21.15.37:0/3803001942 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543092228 0 0) 0x7fd03015e1d0 con 0x7fd03015d8d0 2023-10-06T02:24:07.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.359+0000 7fd02f7fe700 1 --2- 172.21.15.37:0/3803001942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03015dd50 0x7fd0300cfc00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd0300897f0 tx=0x7fd0280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4280530ee399b880 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:07.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.359+0000 7fd02dffb700 1 -- 172.21.15.37:0/3803001942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02800b740 con 0x7fd03015dd50 2023-10-06T02:24:07.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.359+0000 7fd02dffb700 1 -- 172.21.15.37:0/3803001942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02800b8a0 con 0x7fd03015dd50 2023-10-06T02:24:07.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.359+0000 7fd02dffb700 1 -- 172.21.15.37:0/3803001942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02800bc40 con 0x7fd03015dd50 2023-10-06T02:24:07.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.360+0000 7fd0357db700 1 -- 172.21.15.37:0/3803001942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03015dd50 msgr2=0x7fd0300cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:07.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.360+0000 7fd0357db700 1 --2- 172.21.15.37:0/3803001942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03015dd50 0x7fd0300cfc00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd0300897f0 tx=0x7fd0280091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.360+0000 7fd0357db700 1 -- 172.21.15.37:0/3803001942 shutdown_connections 2023-10-06T02:24:07.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.360+0000 7fd0357db700 1 --2- 172.21.15.37:0/3803001942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03015dd50 0x7fd0300cfc00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.360+0000 7fd0357db700 1 --2- 172.21.15.37:0/3803001942 >> v2:172.21.15.191:3300/0 conn(0x7fd030159760 0x7fd03015d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.360+0000 7fd0357db700 1 -- 172.21.15.37:0/3803001942 >> 172.21.15.37:0/3803001942 conn(0x7fd03006c890 msgr2=0x7fd0300d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:07.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.360+0000 7fd0357db700 1 -- 172.21.15.37:0/3803001942 shutdown_connections 2023-10-06T02:24:07.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.360+0000 7fd0357db700 1 -- 172.21.15.37:0/3803001942 wait complete. 2023-10-06T02:24:07.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.361+0000 7fd0357db700 1 Processor -- start 2023-10-06T02:24:07.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.361+0000 7fd0357db700 1 -- start start 2023-10-06T02:24:07.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.362+0000 7fd0357db700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd030159760 0x7fd030169d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:07.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.362+0000 7fd0357db700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd03015d8d0 0x7fd03006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.362+0000 7fd0357db700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd03015dd50 0x7fd03014bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.362+0000 7fd0357db700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03016a2a0 con 0x7fd030159760 2023-10-06T02:24:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.362+0000 7fd0357db700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0300b4730 con 0x7fd03015d8d0 2023-10-06T02:24:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.362+0000 7fd0357db700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0300b4a10 con 0x7fd03015dd50 2023-10-06T02:24:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.362+0000 7fd02effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd030159760 0x7fd030169d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.362+0000 7fd02effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd030159760 0x7fd030169d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41298/0 (socket says 172.21.15.37:41298) 2023-10-06T02:24:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.362+0000 7fd02effd700 1 -- 172.21.15.37:0/3588071049 learned_addr learned my addr 172.21.15.37:0/3588071049 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.362+0000 7fd02effd700 1 -- 172.21.15.37:0/3588071049 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd03015dd50 msgr2=0x7fd03014bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.362+0000 7fd02effd700 1 --2- 172.21.15.37:0/3588071049 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd03015dd50 0x7fd03014bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.362+0000 7fd02effd700 1 -- 172.21.15.37:0/3588071049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd03015d8d0 msgr2=0x7fd03006ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.362+0000 7fd02effd700 1 --2- 172.21.15.37:0/3588071049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd03015d8d0 0x7fd03006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.362+0000 7fd02effd700 1 -- 172.21.15.37:0/3588071049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd028009420 con 0x7fd030159760 2023-10-06T02:24:07.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.362+0000 7fd02effd700 1 --2- 172.21.15.37:0/3588071049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd030159760 0x7fd030169d60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd02000d180 tx=0x7fd0200099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:07.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.362+0000 7fd026ffd700 1 -- 172.21.15.37:0/3588071049 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02000de20 con 0x7fd030159760 2023-10-06T02:24:07.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.362+0000 7fd026ffd700 1 -- 172.21.15.37:0/3588071049 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02000f040 con 0x7fd030159760 2023-10-06T02:24:07.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.363+0000 7fd026ffd700 1 -- 172.21.15.37:0/3588071049 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020015670 con 0x7fd030159760 2023-10-06T02:24:07.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.363+0000 7fd0357db700 1 -- 172.21.15.37:0/3588071049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd03015b4f0 con 0x7fd030159760 2023-10-06T02:24:07.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.363+0000 7fd0357db700 1 -- 172.21.15.37:0/3588071049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0300b4cf0 con 0x7fd030159760 2023-10-06T02:24:07.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.363+0000 7fd0357db700 1 -- 172.21.15.37:0/3588071049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd03015bb40 con 0x7fd030159760 2023-10-06T02:24:07.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.364+0000 7fd026ffd700 1 -- 172.21.15.37:0/3588071049 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd020015a60 con 0x7fd030159760 2023-10-06T02:24:07.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.364+0000 7fd026ffd700 1 --2- 172.21.15.37:0/3588071049 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd010066f30 0x7fd0100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:07.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.364+0000 7fd026ffd700 1 -- 172.21.15.37:0/3588071049 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd020084ac0 con 0x7fd030159760 2023-10-06T02:24:07.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.365+0000 7fd02e7fc700 1 --2- 172.21.15.37:0/3588071049 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd010066f30 0x7fd0100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:07.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.365+0000 7fd02e7fc700 1 --2- 172.21.15.37:0/3588071049 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd010066f30 0x7fd0100693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd0180011e0 tx=0x7fd0180079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:07.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.369+0000 7fd026ffd700 1 -- 172.21.15.37:0/3588071049 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd02004e5a0 con 0x7fd030159760 2023-10-06T02:24:07.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.566+0000 7fd0357db700 1 -- 172.21.15.37:0/3588071049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd03006fbf0 con 0x7fd030159760 2023-10-06T02:24:07.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.567+0000 7fd026ffd700 1 -- 172.21.15.37:0/3588071049 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16879 (secure 0 0 0) 0x7fd02001a090 con 0x7fd030159760 2023-10-06T02:24:07.568 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:07.569 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:24:06.273938+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:24:04.559429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T02:24:05.263596+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:24:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.569+0000 7fd0357db700 1 -- 172.21.15.37:0/3588071049 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd010066f30 msgr2=0x7fd0100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.569+0000 7fd0357db700 1 --2- 172.21.15.37:0/3588071049 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd010066f30 0x7fd0100693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd0180011e0 tx=0x7fd0180079d0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.569+0000 7fd0357db700 1 -- 172.21.15.37:0/3588071049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd030159760 msgr2=0x7fd030169d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.569+0000 7fd0357db700 1 --2- 172.21.15.37:0/3588071049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd030159760 0x7fd030169d60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd02000d180 tx=0x7fd0200099f0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.569+0000 7fd0357db700 1 -- 172.21.15.37:0/3588071049 shutdown_connections 2023-10-06T02:24:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.569+0000 7fd0357db700 1 --2- 172.21.15.37:0/3588071049 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd03015dd50 0x7fd03014bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.569+0000 7fd0357db700 1 --2- 172.21.15.37:0/3588071049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd030159760 0x7fd030169d60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.569+0000 7fd0357db700 1 --2- 172.21.15.37:0/3588071049 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd010066f30 0x7fd0100693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.569+0000 7fd0357db700 1 --2- 172.21.15.37:0/3588071049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd03015d8d0 0x7fd03006ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.569+0000 7fd0357db700 1 -- 172.21.15.37:0/3588071049 >> 172.21.15.37:0/3588071049 conn(0x7fd03006c890 msgr2=0x7fd0300c5300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.569+0000 7fd0357db700 1 -- 172.21.15.37:0/3588071049 shutdown_connections 2023-10-06T02:24:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.569+0000 7fd0357db700 1 -- 172.21.15.37:0/3588071049 wait complete. 2023-10-06T02:24:07.583 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:24:07.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.704+0000 7f19634a5700 1 Processor -- start 2023-10-06T02:24:07.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.704+0000 7f19634a5700 1 -- start start 2023-10-06T02:24:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.705+0000 7f19634a5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f195c0cc450 0x7f195c0c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.705+0000 7f19634a5700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c0697c0 con 0x7f195c0ca020 2023-10-06T02:24:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.705+0000 7f19634a5700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c068bb0 con 0x7f195c0ca3f0 2023-10-06T02:24:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.705+0000 7f19634a5700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c068e90 con 0x7f195c0cc450 2023-10-06T02:24:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.705+0000 7f1962ca4700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f195c0cc450 0x7f195c0c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.705+0000 7f19624a3700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f195c0ca020 0x7f195c0cbd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58138/0 (socket says 172.21.15.37:58138) 2023-10-06T02:24:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.705+0000 7f19624a3700 1 -- 172.21.15.37:0/306246762 learned_addr learned my addr 172.21.15.37:0/306246762 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.705+0000 7f1962ca4700 1 -- 172.21.15.37:0/306246762 >> v1:172.21.15.191:6789/0 conn(0x7f195c0ca3f0 legacy=0x7f195c0caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:07.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.705+0000 7f1962ca4700 1 -- 172.21.15.37:0/306246762 >> v1:172.21.15.37:6789/0 conn(0x7f195c0ca020 legacy=0x7f195c0cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:07.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.705+0000 7f1962ca4700 1 -- 172.21.15.37:0/306246762 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c069170 con 0x7f195c0cc450 2023-10-06T02:24:07.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.705+0000 7f19614a1700 1 -- 172.21.15.37:0/306246762 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818646746 0 0) 0x7f195c0697c0 con 0x7f195c0ca020 2023-10-06T02:24:07.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.706+0000 7f1962ca4700 1 --2- 172.21.15.37:0/306246762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c0cc450 0x7f195c0c87b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f194c009e60 tx=0x7f194c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66471fbef5cf9b5e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:07.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.706+0000 7f19614a1700 1 -- 172.21.15.37:0/306246762 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c00e070 con 0x7f195c0cc450 2023-10-06T02:24:07.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.706+0000 7f19614a1700 1 -- 172.21.15.37:0/306246762 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c00bbf0 con 0x7f195c0cc450 2023-10-06T02:24:07.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.706+0000 7f19614a1700 1 -- 172.21.15.37:0/306246762 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c012430 con 0x7f195c0cc450 2023-10-06T02:24:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.706+0000 7f19634a5700 1 -- 172.21.15.37:0/306246762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c0cc450 msgr2=0x7f195c0c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.706+0000 7f19634a5700 1 --2- 172.21.15.37:0/306246762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c0cc450 0x7f195c0c87b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f194c009e60 tx=0x7f194c009780 comp rx=0 tx=0).stop 2023-10-06T02:24:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.706+0000 7f19634a5700 1 -- 172.21.15.37:0/306246762 shutdown_connections 2023-10-06T02:24:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.706+0000 7f19634a5700 1 --2- 172.21.15.37:0/306246762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c0cc450 0x7f195c0c87b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.706+0000 7f19634a5700 1 -- 172.21.15.37:0/306246762 >> 172.21.15.37:0/306246762 conn(0x7f195c068130 msgr2=0x7f195c06c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.706+0000 7f19634a5700 1 -- 172.21.15.37:0/306246762 shutdown_connections 2023-10-06T02:24:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.706+0000 7f19634a5700 1 -- 172.21.15.37:0/306246762 wait complete. 2023-10-06T02:24:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.707+0000 7f19634a5700 1 Processor -- start 2023-10-06T02:24:07.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.708+0000 7f19634a5700 1 -- start start 2023-10-06T02:24:07.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.708+0000 7f19634a5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c0ca020 0x7f195c169e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:07.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.708+0000 7f19634a5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f195c0ca3f0 0x7f195c0c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:07.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.708+0000 7f19634a5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f195c0cc450 0x7f195c0c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:07.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.708+0000 7f19634a5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0b2140 con 0x7f195c0ca020 2023-10-06T02:24:07.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.708+0000 7f19634a5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0c80e0 con 0x7f195c0cc450 2023-10-06T02:24:07.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.708+0000 7f19634a5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0c83c0 con 0x7f195c0ca3f0 2023-10-06T02:24:07.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.708+0000 7f19624a3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c0ca020 0x7f195c169e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:07.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.708+0000 7f19624a3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c0ca020 0x7f195c169e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41312/0 (socket says 172.21.15.37:41312) 2023-10-06T02:24:07.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.708+0000 7f19624a3700 1 -- 172.21.15.37:0/2065487414 learned_addr learned my addr 172.21.15.37:0/2065487414 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:07.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.709+0000 7f1962ca4700 1 --2- 172.21.15.37:0/2065487414 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f195c0cc450 0x7f195c0c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:07.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.709+0000 7f1961ca2700 1 --2- 172.21.15.37:0/2065487414 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f195c0ca3f0 0x7f195c0c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:07.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.709+0000 7f19624a3700 1 -- 172.21.15.37:0/2065487414 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f195c0ca3f0 msgr2=0x7f195c0c59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:07.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.709+0000 7f19624a3700 1 --2- 172.21.15.37:0/2065487414 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f195c0ca3f0 0x7f195c0c59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.709+0000 7f19624a3700 1 -- 172.21.15.37:0/2065487414 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f195c0cc450 msgr2=0x7f195c0c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:07.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.709+0000 7f19624a3700 1 --2- 172.21.15.37:0/2065487414 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f195c0cc450 0x7f195c0c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:07.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.709+0000 7f19624a3700 1 -- 172.21.15.37:0/2065487414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c009a20 con 0x7f195c0ca020 2023-10-06T02:24:07.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.709+0000 7f19624a3700 1 --2- 172.21.15.37:0/2065487414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c0ca020 0x7f195c169e80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f195400c7e0 tx=0x7f1954007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:07.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.709+0000 7f195a7fc700 1 -- 172.21.15.37:0/2065487414 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1954005b30 con 0x7f195c0ca020 2023-10-06T02:24:07.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.709+0000 7f195a7fc700 1 -- 172.21.15.37:0/2065487414 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1954005c90 con 0x7f195c0ca020 2023-10-06T02:24:07.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.709+0000 7f19634a5700 1 -- 172.21.15.37:0/2065487414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195c0b1af0 con 0x7f195c0ca020 2023-10-06T02:24:07.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.709+0000 7f195a7fc700 1 -- 172.21.15.37:0/2065487414 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1954007300 con 0x7f195c0ca020 2023-10-06T02:24:07.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.709+0000 7f19634a5700 1 -- 172.21.15.37:0/2065487414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195c0b3e00 con 0x7f195c0ca020 2023-10-06T02:24:07.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.710+0000 7f19634a5700 1 -- 172.21.15.37:0/2065487414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195c064b00 con 0x7f195c0ca020 2023-10-06T02:24:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.710+0000 7f195a7fc700 1 -- 172.21.15.37:0/2065487414 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f195401b400 con 0x7f195c0ca020 2023-10-06T02:24:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.711+0000 7f195a7fc700 1 --2- 172.21.15.37:0/2065487414 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1948066f30 0x7f19480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.711+0000 7f195a7fc700 1 -- 172.21.15.37:0/2065487414 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1954084140 con 0x7f195c0ca020 2023-10-06T02:24:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.711+0000 7f1961ca2700 1 --2- 172.21.15.37:0/2065487414 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1948066f30 0x7f19480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.712+0000 7f1961ca2700 1 --2- 172.21.15.37:0/2065487414 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1948066f30 0x7f19480693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f195c13c330 tx=0x7f1950009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.715+0000 7f195a7fc700 1 -- 172.21.15.37:0/2065487414 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19540512d0 con 0x7f195c0ca020 2023-10-06T02:24:07.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:07.953+0000 7f19634a5700 1 -- 172.21.15.37:0/2065487414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f195c04bb80 con 0x7f195c0ca020 2023-10-06T02:24:08.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:08.885+0000 7f195a7fc700 1 -- 172.21.15.37:0/2065487414 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f19540548f0 con 0x7f195c0ca020 2023-10-06T02:24:08.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:08.888+0000 7f19634a5700 1 -- 172.21.15.37:0/2065487414 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1948066f30 msgr2=0x7f19480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:08.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:08.888+0000 7f19634a5700 1 --2- 172.21.15.37:0/2065487414 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1948066f30 0x7f19480693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f195c13c330 tx=0x7f1950009040 comp rx=0 tx=0).stop 2023-10-06T02:24:08.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:08.888+0000 7f19634a5700 1 -- 172.21.15.37:0/2065487414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c0ca020 msgr2=0x7f195c169e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:08.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:08.888+0000 7f19634a5700 1 --2- 172.21.15.37:0/2065487414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c0ca020 0x7f195c169e80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f195400c7e0 tx=0x7f1954007df0 comp rx=0 tx=0).stop 2023-10-06T02:24:08.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:08.888+0000 7f19634a5700 1 -- 172.21.15.37:0/2065487414 shutdown_connections 2023-10-06T02:24:08.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:08.888+0000 7f19634a5700 1 --2- 172.21.15.37:0/2065487414 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1948066f30 0x7f19480693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:08.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:08.888+0000 7f19634a5700 1 --2- 172.21.15.37:0/2065487414 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f195c0cc450 0x7f195c0c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:08.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:08.888+0000 7f19634a5700 1 --2- 172.21.15.37:0/2065487414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f195c0ca020 0x7f195c169e80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:08.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:08.888+0000 7f19634a5700 1 --2- 172.21.15.37:0/2065487414 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f195c0ca3f0 0x7f195c0c59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:08.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:08.888+0000 7f19634a5700 1 -- 172.21.15.37:0/2065487414 >> 172.21.15.37:0/2065487414 conn(0x7f195c068130 msgr2=0x7f195c1531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:08.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:08.888+0000 7f19634a5700 1 -- 172.21.15.37:0/2065487414 shutdown_connections 2023-10-06T02:24:08.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:08.888+0000 7f19634a5700 1 -- 172.21.15.37:0/2065487414 wait complete. 2023-10-06T02:24:08.904 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:24:09.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.031+0000 7fad9fbcd700 1 Processor -- start 2023-10-06T02:24:09.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.031+0000 7fad9fbcd700 1 -- start start 2023-10-06T02:24:09.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.032+0000 7fad9fbcd700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fad981593c0 0x7fad98159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:09.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.032+0000 7fad9fbcd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad980b2380 0x7fad980b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:09.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.032+0000 7fad9fbcd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad980ccb30 0x7fad980ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:09.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.032+0000 7fad9fbcd700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad980b07a0 con 0x7fad980ccb30 2023-10-06T02:24:09.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.032+0000 7fad9fbcd700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad980cd8a0 con 0x7fad981593c0 2023-10-06T02:24:09.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.032+0000 7fad9fbcd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad980afe70 con 0x7fad980b2380 2023-10-06T02:24:09.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.032+0000 7fad9e16a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad980ccb30 0x7fad980ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:09.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.032+0000 7fad9e16a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad980ccb30 0x7fad980ccfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41316/0 (socket says 172.21.15.37:41316) 2023-10-06T02:24:09.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.032+0000 7fad9e16a700 1 -- 172.21.15.37:0/891090176 learned_addr learned my addr 172.21.15.37:0/891090176 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:09.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.032+0000 7fad9d168700 1 --2- 172.21.15.37:0/891090176 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad980b2380 0x7fad980b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:09.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.032+0000 7fad9d969700 1 --2- 172.21.15.37:0/891090176 >> v2:172.21.15.191:3300/0 conn(0x7fad981593c0 0x7fad98159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:09.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.032+0000 7fad9e16a700 1 -- 172.21.15.37:0/891090176 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad980b2380 msgr2=0x7fad980b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:09.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.032+0000 7fad9e16a700 1 --2- 172.21.15.37:0/891090176 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad980b2380 0x7fad980b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:09.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.032+0000 7fad9e16a700 1 -- 172.21.15.37:0/891090176 >> v2:172.21.15.191:3300/0 conn(0x7fad981593c0 msgr2=0x7fad98159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:09.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.032+0000 7fad9e16a700 1 --2- 172.21.15.37:0/891090176 >> v2:172.21.15.191:3300/0 conn(0x7fad981593c0 0x7fad98159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:09.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.032+0000 7fad9e16a700 1 -- 172.21.15.37:0/891090176 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad980b0150 con 0x7fad980ccb30 2023-10-06T02:24:09.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.032+0000 7fad9d969700 1 --2- 172.21.15.37:0/891090176 >> v2:172.21.15.191:3300/0 conn(0x7fad981593c0 0x7fad98159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:09.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.032+0000 7fad9e16a700 1 --2- 172.21.15.37:0/891090176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad980ccb30 0x7fad980ccfb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fad9806d520 tx=0x7fad88009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c7d0aa0d8ba0d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:09.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.033+0000 7fad9c967700 1 -- 172.21.15.37:0/891090176 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8800e070 con 0x7fad980ccb30 2023-10-06T02:24:09.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.033+0000 7fad9c967700 1 -- 172.21.15.37:0/891090176 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8800ba50 con 0x7fad980ccb30 2023-10-06T02:24:09.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.033+0000 7fad9c967700 1 -- 172.21.15.37:0/891090176 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad880092e0 con 0x7fad980ccb30 2023-10-06T02:24:09.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.033+0000 7fad9fbcd700 1 -- 172.21.15.37:0/891090176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad980ccb30 msgr2=0x7fad980ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:09.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.033+0000 7fad9fbcd700 1 --2- 172.21.15.37:0/891090176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad980ccb30 0x7fad980ccfb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fad9806d520 tx=0x7fad88009840 comp rx=0 tx=0).stop 2023-10-06T02:24:09.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.033+0000 7fad9fbcd700 1 -- 172.21.15.37:0/891090176 shutdown_connections 2023-10-06T02:24:09.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.033+0000 7fad9fbcd700 1 --2- 172.21.15.37:0/891090176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad980ccb30 0x7fad980ccfb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:09.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.033+0000 7fad9fbcd700 1 --2- 172.21.15.37:0/891090176 >> v2:172.21.15.191:3300/0 conn(0x7fad981593c0 0x7fad98159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:09.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.033+0000 7fad9fbcd700 1 --2- 172.21.15.37:0/891090176 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad980b2380 0x7fad980b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:09.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.033+0000 7fad9fbcd700 1 -- 172.21.15.37:0/891090176 >> 172.21.15.37:0/891090176 conn(0x7fad9806c0b0 msgr2=0x7fad9806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:09.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.033+0000 7fad9fbcd700 1 -- 172.21.15.37:0/891090176 shutdown_connections 2023-10-06T02:24:09.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.033+0000 7fad9fbcd700 1 -- 172.21.15.37:0/891090176 wait complete. 2023-10-06T02:24:09.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.034+0000 7fad9fbcd700 1 Processor -- start 2023-10-06T02:24:09.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.034+0000 7fad9fbcd700 1 -- start start 2023-10-06T02:24:09.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.035+0000 7fad9fbcd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad980b2380 0x7fad98148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:09.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.035+0000 7fad9fbcd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad980ccb30 0x7fad980c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:09.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.035+0000 7fad9fbcd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad981593c0 0x7fad9815e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:09.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.035+0000 7fad9fbcd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9815c8f0 con 0x7fad980ccb30 2023-10-06T02:24:09.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.035+0000 7fad9fbcd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad980c8840 con 0x7fad980b2380 2023-10-06T02:24:09.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.035+0000 7fad9fbcd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad980c8b20 con 0x7fad981593c0 2023-10-06T02:24:09.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.035+0000 7fad9d168700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad980ccb30 0x7fad980c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:09.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.035+0000 7fad9d168700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad980ccb30 0x7fad980c7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41322/0 (socket says 172.21.15.37:41322) 2023-10-06T02:24:09.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.035+0000 7fad9d168700 1 -- 172.21.15.37:0/3690321111 learned_addr learned my addr 172.21.15.37:0/3690321111 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:09.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.035+0000 7fad9d969700 1 --2- 172.21.15.37:0/3690321111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad980b2380 0x7fad98148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:09.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.035+0000 7fad9d168700 1 -- 172.21.15.37:0/3690321111 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad981593c0 msgr2=0x7fad9815e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:09.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.035+0000 7fad9e16a700 1 --2- 172.21.15.37:0/3690321111 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad981593c0 0x7fad9815e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:09.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.036+0000 7fad9d168700 1 --2- 172.21.15.37:0/3690321111 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad981593c0 0x7fad9815e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:09.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.036+0000 7fad9d168700 1 -- 172.21.15.37:0/3690321111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad980b2380 msgr2=0x7fad98148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:09.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.036+0000 7fad9d168700 1 --2- 172.21.15.37:0/3690321111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad980b2380 0x7fad98148a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:09.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.036+0000 7fad9d168700 1 -- 172.21.15.37:0/3690321111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad88009ae0 con 0x7fad980ccb30 2023-10-06T02:24:09.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.036+0000 7fad9d168700 1 --2- 172.21.15.37:0/3690321111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad980ccb30 0x7fad980c7ef0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00d890 tx=0x7fad8c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:09.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.036+0000 7fad95ffb700 1 -- 172.21.15.37:0/3690321111 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c00b600 con 0x7fad980ccb30 2023-10-06T02:24:09.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.036+0000 7fad95ffb700 1 -- 172.21.15.37:0/3690321111 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c00b760 con 0x7fad980ccb30 2023-10-06T02:24:09.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.036+0000 7fad9fbcd700 1 -- 172.21.15.37:0/3690321111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9815c580 con 0x7fad980ccb30 2023-10-06T02:24:09.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.036+0000 7fad95ffb700 1 -- 172.21.15.37:0/3690321111 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c00bae0 con 0x7fad980ccb30 2023-10-06T02:24:09.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.036+0000 7fad9fbcd700 1 -- 172.21.15.37:0/3690321111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad980c8430 con 0x7fad980ccb30 2023-10-06T02:24:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.037+0000 7fad9fbcd700 1 -- 172.21.15.37:0/3690321111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9815c3d0 con 0x7fad980ccb30 2023-10-06T02:24:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.038+0000 7fad95ffb700 1 -- 172.21.15.37:0/3690321111 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad8c01e460 con 0x7fad980ccb30 2023-10-06T02:24:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.038+0000 7fad95ffb700 1 --2- 172.21.15.37:0/3690321111 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fad84066f30 0x7fad840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.038+0000 7fad95ffb700 1 -- 172.21.15.37:0/3690321111 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fad8c084d40 con 0x7fad980ccb30 2023-10-06T02:24:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.038+0000 7fad9d969700 1 --2- 172.21.15.37:0/3690321111 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fad84066f30 0x7fad840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.039+0000 7fad9d969700 1 --2- 172.21.15.37:0/3690321111 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fad84066f30 0x7fad840693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fad90006f00 tx=0x7fad90008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:09.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.042+0000 7fad95ffb700 1 -- 172.21.15.37:0/3690321111 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad8c051e50 con 0x7fad980ccb30 2023-10-06T02:24:09.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.281+0000 7fad9fbcd700 1 -- 172.21.15.37:0/3690321111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fad9815ca30 con 0x7fad980ccb30 2023-10-06T02:24:09.859 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-10-06T02:24:09.858+0000 7f1270cd5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:24:09.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.886+0000 7fad95ffb700 1 -- 172.21.15.37:0/3690321111 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fad8c055470 con 0x7fad980ccb30 2023-10-06T02:24:09.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.888+0000 7fad9fbcd700 1 -- 172.21.15.37:0/3690321111 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fad84066f30 msgr2=0x7fad840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:09.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.888+0000 7fad9fbcd700 1 --2- 172.21.15.37:0/3690321111 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fad84066f30 0x7fad840693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fad90006f00 tx=0x7fad90008040 comp rx=0 tx=0).stop 2023-10-06T02:24:09.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.888+0000 7fad9fbcd700 1 -- 172.21.15.37:0/3690321111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad980ccb30 msgr2=0x7fad980c7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:09.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.888+0000 7fad9fbcd700 1 --2- 172.21.15.37:0/3690321111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad980ccb30 0x7fad980c7ef0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00d890 tx=0x7fad8c008040 comp rx=0 tx=0).stop 2023-10-06T02:24:09.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.889+0000 7fad9fbcd700 1 -- 172.21.15.37:0/3690321111 shutdown_connections 2023-10-06T02:24:09.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.889+0000 7fad9fbcd700 1 --2- 172.21.15.37:0/3690321111 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad981593c0 0x7fad9815e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:09.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.889+0000 7fad9fbcd700 1 --2- 172.21.15.37:0/3690321111 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fad84066f30 0x7fad840693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:09.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.889+0000 7fad9fbcd700 1 --2- 172.21.15.37:0/3690321111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad980b2380 0x7fad98148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:09.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.889+0000 7fad9fbcd700 1 --2- 172.21.15.37:0/3690321111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad980ccb30 0x7fad980c7ef0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:09.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.889+0000 7fad9fbcd700 1 -- 172.21.15.37:0/3690321111 >> 172.21.15.37:0/3690321111 conn(0x7fad9806c0b0 msgr2=0x7fad980cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:09.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.889+0000 7fad9fbcd700 1 -- 172.21.15.37:0/3690321111 shutdown_connections 2023-10-06T02:24:09.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:09.889+0000 7fad9fbcd700 1 -- 172.21.15.37:0/3690321111 wait complete. 2023-10-06T02:24:09.904 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:10.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.025+0000 7fade546a700 1 Processor -- start 2023-10-06T02:24:10.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.025+0000 7fade546a700 1 -- start start 2023-10-06T02:24:10.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.026+0000 7fade546a700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fade01596d0 0x7fade00b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.026+0000 7fade546a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fade00b3840 0x7fade00c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.026+0000 7fade546a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fade0159aa0 0x7fade00c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.026+0000 7fade546a700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade00c5300 con 0x7fade00b3840 2023-10-06T02:24:10.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.026+0000 7fade546a700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade00c6160 con 0x7fade01596d0 2023-10-06T02:24:10.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.026+0000 7fade546a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade00c5550 con 0x7fade0159aa0 2023-10-06T02:24:10.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.026+0000 7fadde7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fade00b3840 0x7fade00c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.026+0000 7fadde7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fade00b3840 0x7fade00c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41330/0 (socket says 172.21.15.37:41330) 2023-10-06T02:24:10.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.026+0000 7fadde7fc700 1 -- 172.21.15.37:0/773035605 learned_addr learned my addr 172.21.15.37:0/773035605 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:10.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.026+0000 7faddeffd700 1 --2- 172.21.15.37:0/773035605 >> v2:172.21.15.191:3300/0 conn(0x7fade01596d0 0x7fade00b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.026+0000 7faddf7fe700 1 --2- 172.21.15.37:0/773035605 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fade0159aa0 0x7fade00c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.026+0000 7fadde7fc700 1 -- 172.21.15.37:0/773035605 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fade0159aa0 msgr2=0x7fade00c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:10.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.026+0000 7fadde7fc700 1 --2- 172.21.15.37:0/773035605 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fade0159aa0 0x7fade00c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.026+0000 7fadde7fc700 1 -- 172.21.15.37:0/773035605 >> v2:172.21.15.191:3300/0 conn(0x7fade01596d0 msgr2=0x7fade00b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:10.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.026+0000 7fadde7fc700 1 --2- 172.21.15.37:0/773035605 >> v2:172.21.15.191:3300/0 conn(0x7fade01596d0 0x7fade00b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.026+0000 7fadde7fc700 1 -- 172.21.15.37:0/773035605 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade00c5830 con 0x7fade00b3840 2023-10-06T02:24:10.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.026+0000 7faddf7fe700 1 --2- 172.21.15.37:0/773035605 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fade0159aa0 0x7fade00c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:10.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.026+0000 7fadde7fc700 1 --2- 172.21.15.37:0/773035605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fade00b3840 0x7fade00c65f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fade00896e0 tx=0x7fadc8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a875bc94f19b625 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:10.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.027+0000 7fadddffb700 1 -- 172.21.15.37:0/773035605 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8009e70 con 0x7fade00b3840 2023-10-06T02:24:10.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.027+0000 7fadddffb700 1 -- 172.21.15.37:0/773035605 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc800b860 con 0x7fade00b3840 2023-10-06T02:24:10.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.027+0000 7fadddffb700 1 -- 172.21.15.37:0/773035605 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800bc00 con 0x7fade00b3840 2023-10-06T02:24:10.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.027+0000 7fade546a700 1 -- 172.21.15.37:0/773035605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fade00b3840 msgr2=0x7fade00c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.027+0000 7fade546a700 1 --2- 172.21.15.37:0/773035605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fade00b3840 0x7fade00c65f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fade00896e0 tx=0x7fadc8009250 comp rx=0 tx=0).stop 2023-10-06T02:24:10.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.027+0000 7fade546a700 1 -- 172.21.15.37:0/773035605 shutdown_connections 2023-10-06T02:24:10.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.027+0000 7fade546a700 1 --2- 172.21.15.37:0/773035605 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fade0159aa0 0x7fade00c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.027+0000 7fade546a700 1 --2- 172.21.15.37:0/773035605 >> v2:172.21.15.191:3300/0 conn(0x7fade01596d0 0x7fade00b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.027+0000 7fade546a700 1 --2- 172.21.15.37:0/773035605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fade00b3840 0x7fade00c65f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.027+0000 7fade546a700 1 -- 172.21.15.37:0/773035605 >> 172.21.15.37:0/773035605 conn(0x7fade006c890 msgr2=0x7fade00d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:10.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.027+0000 7fade546a700 1 -- 172.21.15.37:0/773035605 shutdown_connections 2023-10-06T02:24:10.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.027+0000 7fade546a700 1 -- 172.21.15.37:0/773035605 wait complete. 2023-10-06T02:24:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.028+0000 7fade546a700 1 Processor -- start 2023-10-06T02:24:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.029+0000 7fade546a700 1 -- start start 2023-10-06T02:24:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.029+0000 7fade546a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fade00b3840 0x7fade00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.029+0000 7fade546a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fade01596d0 0x7fade016d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.029+0000 7fade546a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fade0159aa0 0x7fade016d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.029+0000 7fade546a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade015a290 con 0x7fade00b3840 2023-10-06T02:24:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.029+0000 7fade546a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade015a570 con 0x7fade0159aa0 2023-10-06T02:24:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.029+0000 7fade546a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade015a850 con 0x7fade01596d0 2023-10-06T02:24:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.029+0000 7faddeffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fade00b3840 0x7fade00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.029+0000 7faddeffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fade00b3840 0x7fade00b4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41340/0 (socket says 172.21.15.37:41340) 2023-10-06T02:24:10.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.029+0000 7faddeffd700 1 -- 172.21.15.37:0/3401205096 learned_addr learned my addr 172.21.15.37:0/3401205096 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:10.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.030+0000 7faddf7fe700 1 --2- 172.21.15.37:0/3401205096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fade0159aa0 0x7fade016d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.030+0000 7fadde7fc700 1 --2- 172.21.15.37:0/3401205096 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fade01596d0 0x7fade016d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.030+0000 7faddeffd700 1 -- 172.21.15.37:0/3401205096 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fade01596d0 msgr2=0x7fade016d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.030+0000 7faddeffd700 1 --2- 172.21.15.37:0/3401205096 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fade01596d0 0x7fade016d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.030+0000 7faddeffd700 1 -- 172.21.15.37:0/3401205096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fade0159aa0 msgr2=0x7fade016d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.030+0000 7faddeffd700 1 --2- 172.21.15.37:0/3401205096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fade0159aa0 0x7fade016d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.030+0000 7faddeffd700 1 -- 172.21.15.37:0/3401205096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc80094f0 con 0x7fade00b3840 2023-10-06T02:24:10.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.030+0000 7faddf7fe700 1 --2- 172.21.15.37:0/3401205096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fade0159aa0 0x7fade016d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:10.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.030+0000 7faddeffd700 1 --2- 172.21.15.37:0/3401205096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fade00b3840 0x7fade00b4e50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fadd800e930 tx=0x7fadd80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:10.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.030+0000 7fadd6ffd700 1 -- 172.21.15.37:0/3401205096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd800eed0 con 0x7fade00b3840 2023-10-06T02:24:10.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.030+0000 7fade546a700 1 -- 172.21.15.37:0/3401205096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade015ab30 con 0x7fade00b3840 2023-10-06T02:24:10.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.030+0000 7fadd6ffd700 1 -- 172.21.15.37:0/3401205096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd800c850 con 0x7fade00b3840 2023-10-06T02:24:10.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.030+0000 7fadd6ffd700 1 -- 172.21.15.37:0/3401205096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd800cbf0 con 0x7fade00b3840 2023-10-06T02:24:10.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.030+0000 7fade546a700 1 -- 172.21.15.37:0/3401205096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade0159ef0 con 0x7fade00b3840 2023-10-06T02:24:10.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.031+0000 7fade546a700 1 -- 172.21.15.37:0/3401205096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade006fbf0 con 0x7fade00b3840 2023-10-06T02:24:10.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.031+0000 7fadd6ffd700 1 -- 172.21.15.37:0/3401205096 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fadd8013470 con 0x7fade00b3840 2023-10-06T02:24:10.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.032+0000 7fadd6ffd700 1 --2- 172.21.15.37:0/3401205096 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fadc0066f30 0x7fadc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.032+0000 7fadd6ffd700 1 -- 172.21.15.37:0/3401205096 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fadd8084920 con 0x7fade00b3840 2023-10-06T02:24:10.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.032+0000 7fadde7fc700 1 --2- 172.21.15.37:0/3401205096 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fadc0066f30 0x7fadc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.033+0000 7fadde7fc700 1 --2- 172.21.15.37:0/3401205096 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fadc0066f30 0x7fadc00693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fade00896e0 tx=0x7fadc8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:10.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.036+0000 7fadd6ffd700 1 -- 172.21.15.37:0/3401205096 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fadd8051a30 con 0x7fade00b3840 2023-10-06T02:24:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.275+0000 7fade546a700 1 -- 172.21.15.37:0/3401205096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fade00d13e0 con 0x7fade00b3840 2023-10-06T02:24:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.276+0000 7fadd6ffd700 1 -- 172.21.15.37:0/3401205096 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fadd8017090 con 0x7fade00b3840 2023-10-06T02:24:10.277 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:10.277 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1320242500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1320242500},{"type":"v1","addr":"172.21.15.37:6835","nonce":1320242500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4900,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/3862379925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3862379925},{"type":"v1","addr":"172.21.15.191:6836","nonce":3862379925}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1922753638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":1922753638},{"type":"v1","addr":"172.21.15.191:6837","nonce":1922753638}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:06.274246+0000","modified":"2023-10-06T02:24:09.884600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/967425730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":967425730},{"type":"v1","addr":"172.21.15.37:6834","nonce":967425730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:24:10.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.277+0000 7fade546a700 1 -- 172.21.15.37:0/3401205096 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fadc0066f30 msgr2=0x7fadc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.277+0000 7fade546a700 1 --2- 172.21.15.37:0/3401205096 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fadc0066f30 0x7fadc00693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fade00896e0 tx=0x7fadc8017000 comp rx=0 tx=0).stop 2023-10-06T02:24:10.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.277+0000 7fade546a700 1 -- 172.21.15.37:0/3401205096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fade00b3840 msgr2=0x7fade00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.277+0000 7fade546a700 1 --2- 172.21.15.37:0/3401205096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fade00b3840 0x7fade00b4e50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fadd800e930 tx=0x7fadd80091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.277+0000 7fade546a700 1 -- 172.21.15.37:0/3401205096 shutdown_connections 2023-10-06T02:24:10.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.277+0000 7fade546a700 1 --2- 172.21.15.37:0/3401205096 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fadc0066f30 0x7fadc00693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.277+0000 7fade546a700 1 --2- 172.21.15.37:0/3401205096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fade0159aa0 0x7fade016d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.277+0000 7fade546a700 1 --2- 172.21.15.37:0/3401205096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fade00b3840 0x7fade00b4e50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.277+0000 7fade546a700 1 --2- 172.21.15.37:0/3401205096 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fade01596d0 0x7fade016d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.277+0000 7fade546a700 1 -- 172.21.15.37:0/3401205096 >> 172.21.15.37:0/3401205096 conn(0x7fade006c890 msgr2=0x7fade0154e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:10.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.278+0000 7fade546a700 1 -- 172.21.15.37:0/3401205096 shutdown_connections 2023-10-06T02:24:10.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.278+0000 7fade546a700 1 -- 172.21.15.37:0/3401205096 wait complete. 2023-10-06T02:24:10.280 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2023-10-06T02:24:10.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:24:10.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.408+0000 7f56963a2700 1 Processor -- start 2023-10-06T02:24:10.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.408+0000 7f56963a2700 1 -- start start 2023-10-06T02:24:10.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.409+0000 7f56963a2700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5690159370 0x7f5690159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.409+0000 7f56963a2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56900b2270 0x7f569015db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.409+0000 7f56963a2700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f56900aff10 0x7f56900b0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.409+0000 7f56963a2700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56900b5c00 con 0x7f56900aff10 2023-10-06T02:24:10.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.409+0000 7f56963a2700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56900b08d0 con 0x7f5690159370 2023-10-06T02:24:10.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.409+0000 7f56963a2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56900cb200 con 0x7f56900b2270 2023-10-06T02:24:10.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.409+0000 7f5695ba1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f56900aff10 0x7f56900b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.409+0000 7f5695ba1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f56900aff10 0x7f56900b0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41350/0 (socket says 172.21.15.37:41350) 2023-10-06T02:24:10.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.409+0000 7f5695ba1700 1 -- 172.21.15.37:0/3604480341 learned_addr learned my addr 172.21.15.37:0/3604480341 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:10.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.410+0000 7f5694b9f700 1 --2- 172.21.15.37:0/3604480341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56900b2270 0x7f569015db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.410+0000 7f56953a0700 1 --2- 172.21.15.37:0/3604480341 >> v2:172.21.15.191:3300/0 conn(0x7f5690159370 0x7f5690159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.410+0000 7f5695ba1700 1 -- 172.21.15.37:0/3604480341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56900b2270 msgr2=0x7f569015db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:10.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.410+0000 7f5695ba1700 1 --2- 172.21.15.37:0/3604480341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56900b2270 0x7f569015db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.410+0000 7f5695ba1700 1 -- 172.21.15.37:0/3604480341 >> v2:172.21.15.191:3300/0 conn(0x7f5690159370 msgr2=0x7f5690159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:10.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.410+0000 7f5695ba1700 1 --2- 172.21.15.37:0/3604480341 >> v2:172.21.15.191:3300/0 conn(0x7f5690159370 0x7f5690159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.410+0000 7f5695ba1700 1 -- 172.21.15.37:0/3604480341 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56900cb7c0 con 0x7f56900aff10 2023-10-06T02:24:10.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.410+0000 7f5695ba1700 1 --2- 172.21.15.37:0/3604480341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56900aff10 0x7f56900b0390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f56900d13a0 tx=0x7f5680009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8363749d5f6e5eb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:10.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.410+0000 7f568ffff700 1 -- 172.21.15.37:0/3604480341 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568000e070 con 0x7f56900aff10 2023-10-06T02:24:10.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.410+0000 7f568ffff700 1 -- 172.21.15.37:0/3604480341 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568000ba40 con 0x7f56900aff10 2023-10-06T02:24:10.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.410+0000 7f568ffff700 1 -- 172.21.15.37:0/3604480341 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56800092e0 con 0x7f56900aff10 2023-10-06T02:24:10.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.410+0000 7f56963a2700 1 -- 172.21.15.37:0/3604480341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56900aff10 msgr2=0x7f56900b0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.410+0000 7f56963a2700 1 --2- 172.21.15.37:0/3604480341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56900aff10 0x7f56900b0390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f56900d13a0 tx=0x7f5680009840 comp rx=0 tx=0).stop 2023-10-06T02:24:10.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.411+0000 7f56963a2700 1 -- 172.21.15.37:0/3604480341 shutdown_connections 2023-10-06T02:24:10.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.411+0000 7f56963a2700 1 --2- 172.21.15.37:0/3604480341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56900aff10 0x7f56900b0390 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.411+0000 7f56963a2700 1 --2- 172.21.15.37:0/3604480341 >> v2:172.21.15.191:3300/0 conn(0x7f5690159370 0x7f5690159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.411+0000 7f56963a2700 1 --2- 172.21.15.37:0/3604480341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56900b2270 0x7f569015db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.411+0000 7f56963a2700 1 -- 172.21.15.37:0/3604480341 >> 172.21.15.37:0/3604480341 conn(0x7f569006c0b0 msgr2=0x7f569006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:10.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.411+0000 7f56963a2700 1 -- 172.21.15.37:0/3604480341 shutdown_connections 2023-10-06T02:24:10.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.411+0000 7f56963a2700 1 -- 172.21.15.37:0/3604480341 wait complete. 2023-10-06T02:24:10.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.412+0000 7f56963a2700 1 Processor -- start 2023-10-06T02:24:10.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.412+0000 7f56963a2700 1 -- start start 2023-10-06T02:24:10.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f56963a2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56900aff10 0x7f5690155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f56963a2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56900b2270 0x7f56900cf960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f56963a2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5690159370 0x7f56900cde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f56963a2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569015b1c0 con 0x7f56900b2270 2023-10-06T02:24:10.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f56963a2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569015a890 con 0x7f56900aff10 2023-10-06T02:24:10.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f56963a2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569015ab70 con 0x7f5690159370 2023-10-06T02:24:10.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f5694b9f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56900b2270 0x7f56900cf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f5694b9f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56900b2270 0x7f56900cf960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41362/0 (socket says 172.21.15.37:41362) 2023-10-06T02:24:10.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f5694b9f700 1 -- 172.21.15.37:0/3974809739 learned_addr learned my addr 172.21.15.37:0/3974809739 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:10.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f56953a0700 1 --2- 172.21.15.37:0/3974809739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56900aff10 0x7f5690155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f5695ba1700 1 --2- 172.21.15.37:0/3974809739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5690159370 0x7f56900cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f5694b9f700 1 -- 172.21.15.37:0/3974809739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5690159370 msgr2=0x7f56900cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f5694b9f700 1 --2- 172.21.15.37:0/3974809739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5690159370 0x7f56900cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f5694b9f700 1 -- 172.21.15.37:0/3974809739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56900aff10 msgr2=0x7f5690155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f5694b9f700 1 --2- 172.21.15.37:0/3974809739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56900aff10 0x7f5690155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f5694b9f700 1 -- 172.21.15.37:0/3974809739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5680009ae0 con 0x7f56900b2270 2023-10-06T02:24:10.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f5694b9f700 1 --2- 172.21.15.37:0/3974809739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56900b2270 0x7f56900cf960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f568400d860 tx=0x7f5684008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:10.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f568d7fa700 1 -- 172.21.15.37:0/3974809739 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56840125f0 con 0x7f56900b2270 2023-10-06T02:24:10.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f568d7fa700 1 -- 172.21.15.37:0/3974809739 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5684012750 con 0x7f56900b2270 2023-10-06T02:24:10.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f56963a2700 1 -- 172.21.15.37:0/3974809739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569015ae50 con 0x7f56900b2270 2023-10-06T02:24:10.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.413+0000 7f568d7fa700 1 -- 172.21.15.37:0/3974809739 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5684012af0 con 0x7f56900b2270 2023-10-06T02:24:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.414+0000 7f56963a2700 1 -- 172.21.15.37:0/3974809739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56901563b0 con 0x7f56900b2270 2023-10-06T02:24:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.414+0000 7f56963a2700 1 -- 172.21.15.37:0/3974809739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569015b370 con 0x7f56900b2270 2023-10-06T02:24:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.415+0000 7f568d7fa700 1 -- 172.21.15.37:0/3974809739 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f568401e460 con 0x7f56900b2270 2023-10-06T02:24:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.415+0000 7f568d7fa700 1 --2- 172.21.15.37:0/3974809739 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f567c066f30 0x7f567c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.415+0000 7f568d7fa700 1 -- 172.21.15.37:0/3974809739 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5684084d10 con 0x7f56900b2270 2023-10-06T02:24:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.415+0000 7f56953a0700 1 --2- 172.21.15.37:0/3974809739 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f567c066f30 0x7f567c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.416+0000 7f56953a0700 1 --2- 172.21.15.37:0/3974809739 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f567c066f30 0x7f567c0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5688006fd0 tx=0x7f5688008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:10.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.419+0000 7f568d7fa700 1 -- 172.21.15.37:0/3974809739 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f569015b370 con 0x7f56900b2270 2023-10-06T02:24:10.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.614+0000 7f56963a2700 1 -- 172.21.15.37:0/3974809739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f569015b370 con 0x7f56900b2270 2023-10-06T02:24:10.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.615+0000 7f568d7fa700 1 -- 172.21.15.37:0/3974809739 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f569015b370 con 0x7f56900b2270 2023-10-06T02:24:10.616 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:10.617 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:24:07.621902+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:24:04.559429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T02:24:05.263596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:24:10.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.617+0000 7f56963a2700 1 -- 172.21.15.37:0/3974809739 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f567c066f30 msgr2=0x7f567c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.617+0000 7f56963a2700 1 --2- 172.21.15.37:0/3974809739 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f567c066f30 0x7f567c0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5688006fd0 tx=0x7f5688008040 comp rx=0 tx=0).stop 2023-10-06T02:24:10.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.617+0000 7f56963a2700 1 -- 172.21.15.37:0/3974809739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56900b2270 msgr2=0x7f56900cf960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.617+0000 7f56963a2700 1 --2- 172.21.15.37:0/3974809739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56900b2270 0x7f56900cf960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f568400d860 tx=0x7f5684008040 comp rx=0 tx=0).stop 2023-10-06T02:24:10.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.617+0000 7f56963a2700 1 -- 172.21.15.37:0/3974809739 shutdown_connections 2023-10-06T02:24:10.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.617+0000 7f56963a2700 1 --2- 172.21.15.37:0/3974809739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5690159370 0x7f56900cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.617+0000 7f56963a2700 1 --2- 172.21.15.37:0/3974809739 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f567c066f30 0x7f567c0693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.617+0000 7f56963a2700 1 --2- 172.21.15.37:0/3974809739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56900aff10 0x7f5690155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.617+0000 7f56963a2700 1 --2- 172.21.15.37:0/3974809739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56900b2270 0x7f56900cf960 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.617+0000 7f56963a2700 1 -- 172.21.15.37:0/3974809739 >> 172.21.15.37:0/3974809739 conn(0x7f569006c0b0 msgr2=0x7f56900b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.617+0000 7f56963a2700 1 -- 172.21.15.37:0/3974809739 shutdown_connections 2023-10-06T02:24:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.617+0000 7f56963a2700 1 -- 172.21.15.37:0/3974809739 wait complete. 2023-10-06T02:24:10.632 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:24:10.632 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:24:10.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.749+0000 7fd39e033700 1 Processor -- start 2023-10-06T02:24:10.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.749+0000 7fd39e033700 1 -- start start 2023-10-06T02:24:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.750+0000 7fd39e033700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd3980b02c0 0x7fd3980b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.750+0000 7fd39e033700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd3981597f0 0x7fd3980b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.750+0000 7fd39e033700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39815e140 con 0x7fd3980b0690 2023-10-06T02:24:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.750+0000 7fd39e033700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd398159c10 con 0x7fd3980b02c0 2023-10-06T02:24:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.750+0000 7fd39e033700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3980cb2d0 con 0x7fd3981597f0 2023-10-06T02:24:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.750+0000 7fd3977fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd3980b02c0 0x7fd3980b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.750+0000 7fd3977fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd3980b02c0 0x7fd3980b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41364/0 (socket says 172.21.15.37:41364) 2023-10-06T02:24:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.750+0000 7fd3977fe700 1 -- 172.21.15.37:0/2585034253 learned_addr learned my addr 172.21.15.37:0/2585034253 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.750+0000 7fd397fff700 1 --2- 172.21.15.37:0/2585034253 >> v2:172.21.15.191:3300/0 conn(0x7fd3981597f0 0x7fd3980b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.751+0000 7fd3977fe700 1 -- 172.21.15.37:0/2585034253 >> v2:172.21.15.191:3300/0 conn(0x7fd3981597f0 msgr2=0x7fd3980b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.751+0000 7fd3977fe700 1 --2- 172.21.15.37:0/2585034253 >> v2:172.21.15.191:3300/0 conn(0x7fd3981597f0 0x7fd3980b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.751+0000 7fd3977fe700 1 -- 172.21.15.37:0/2585034253 >> v1:172.21.15.191:6789/0 conn(0x7fd3980b0690 legacy=0x7fd3981590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.751+0000 7fd3977fe700 1 -- 172.21.15.37:0/2585034253 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3980cb5b0 con 0x7fd3980b02c0 2023-10-06T02:24:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.751+0000 7fd3977fe700 1 --2- 172.21.15.37:0/2585034253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3980b02c0 0x7fd3980b2360 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd3980b0b30 tx=0x7fd38c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4242781f2e611d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.751+0000 7fd3967fc700 1 -- 172.21.15.37:0/2585034253 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c00b820 con 0x7fd3980b02c0 2023-10-06T02:24:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.751+0000 7fd3967fc700 1 -- 172.21.15.37:0/2585034253 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c00b980 con 0x7fd3980b02c0 2023-10-06T02:24:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.751+0000 7fd3967fc700 1 -- 172.21.15.37:0/2585034253 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c00bd20 con 0x7fd3980b02c0 2023-10-06T02:24:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.751+0000 7fd39e033700 1 -- 172.21.15.37:0/2585034253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3980b02c0 msgr2=0x7fd3980b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.751+0000 7fd39e033700 1 --2- 172.21.15.37:0/2585034253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3980b02c0 0x7fd3980b2360 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd3980b0b30 tx=0x7fd38c009250 comp rx=0 tx=0).stop 2023-10-06T02:24:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.751+0000 7fd39e033700 1 -- 172.21.15.37:0/2585034253 shutdown_connections 2023-10-06T02:24:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.751+0000 7fd39e033700 1 --2- 172.21.15.37:0/2585034253 >> v2:172.21.15.191:3300/0 conn(0x7fd3981597f0 0x7fd3980b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.751+0000 7fd39e033700 1 --2- 172.21.15.37:0/2585034253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3980b02c0 0x7fd3980b2360 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.751+0000 7fd39e033700 1 -- 172.21.15.37:0/2585034253 >> 172.21.15.37:0/2585034253 conn(0x7fd39806d8b0 msgr2=0x7fd39806dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.751+0000 7fd39e033700 1 -- 172.21.15.37:0/2585034253 shutdown_connections 2023-10-06T02:24:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.751+0000 7fd39e033700 1 -- 172.21.15.37:0/2585034253 wait complete. 2023-10-06T02:24:10.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.753+0000 7fd39e033700 1 Processor -- start 2023-10-06T02:24:10.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.753+0000 7fd39e033700 1 -- start start 2023-10-06T02:24:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.753+0000 7fd39e033700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd3980b02c0 0x7fd398154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.753+0000 7fd39e033700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3980b0690 0x7fd3980c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.753+0000 7fd39e033700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3981597f0 0x7fd3980c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.753+0000 7fd39e033700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980c8c20 con 0x7fd3980b0690 2023-10-06T02:24:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.753+0000 7fd39e033700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39815b390 con 0x7fd3981597f0 2023-10-06T02:24:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.753+0000 7fd39e033700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980c8010 con 0x7fd3980b02c0 2023-10-06T02:24:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.754+0000 7fd396ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3980b0690 0x7fd3980c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.754+0000 7fd396ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3980b0690 0x7fd3980c74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41370/0 (socket says 172.21.15.37:41370) 2023-10-06T02:24:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.754+0000 7fd396ffd700 1 -- 172.21.15.37:0/1853793085 learned_addr learned my addr 172.21.15.37:0/1853793085 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.754+0000 7fd397fff700 1 --2- 172.21.15.37:0/1853793085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3981597f0 0x7fd3980c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.754+0000 7fd3977fe700 1 --2- 172.21.15.37:0/1853793085 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd3980b02c0 0x7fd398154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.754+0000 7fd396ffd700 1 -- 172.21.15.37:0/1853793085 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd3980b02c0 msgr2=0x7fd398154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.754+0000 7fd396ffd700 1 --2- 172.21.15.37:0/1853793085 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd3980b02c0 0x7fd398154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.754+0000 7fd396ffd700 1 -- 172.21.15.37:0/1853793085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3981597f0 msgr2=0x7fd3980c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.754+0000 7fd396ffd700 1 --2- 172.21.15.37:0/1853793085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3981597f0 0x7fd3980c79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.754+0000 7fd396ffd700 1 -- 172.21.15.37:0/1853793085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38c0094f0 con 0x7fd3980b0690 2023-10-06T02:24:10.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.754+0000 7fd396ffd700 1 --2- 172.21.15.37:0/1853793085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3980b0690 0x7fd3980c74a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd38800b5e0 tx=0x7fd3880090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:10.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.754+0000 7fd37f7fe700 1 -- 172.21.15.37:0/1853793085 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38800f510 con 0x7fd3980b0690 2023-10-06T02:24:10.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.754+0000 7fd37f7fe700 1 -- 172.21.15.37:0/1853793085 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38800f690 con 0x7fd3980b0690 2023-10-06T02:24:10.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.754+0000 7fd39e033700 1 -- 172.21.15.37:0/1853793085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3980c82f0 con 0x7fd3980b0690 2023-10-06T02:24:10.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.754+0000 7fd37f7fe700 1 -- 172.21.15.37:0/1853793085 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38800fa50 con 0x7fd3980b0690 2023-10-06T02:24:10.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.754+0000 7fd39e033700 1 -- 172.21.15.37:0/1853793085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3980c88b0 con 0x7fd3980b0690 2023-10-06T02:24:10.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.755+0000 7fd39e033700 1 -- 172.21.15.37:0/1853793085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3980c8dd0 con 0x7fd3980b0690 2023-10-06T02:24:10.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.756+0000 7fd37f7fe700 1 -- 172.21.15.37:0/1853793085 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd38801a400 con 0x7fd3980b0690 2023-10-06T02:24:10.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.756+0000 7fd37f7fe700 1 --2- 172.21.15.37:0/1853793085 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd384066f30 0x7fd3840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:10.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.756+0000 7fd37f7fe700 1 -- 172.21.15.37:0/1853793085 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd388084060 con 0x7fd3980b0690 2023-10-06T02:24:10.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.756+0000 7fd3977fe700 1 --2- 172.21.15.37:0/1853793085 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd384066f30 0x7fd3840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:10.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.757+0000 7fd3977fe700 1 --2- 172.21.15.37:0/1853793085 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd384066f30 0x7fd3840693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd3980b0b30 tx=0x7fd38c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:10.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.760+0000 7fd37f7fe700 1 -- 172.21.15.37:0/1853793085 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3980c8dd0 con 0x7fd3980b0690 2023-10-06T02:24:10.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.950+0000 7fd39e033700 1 -- 172.21.15.37:0/1853793085 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd398064870 con 0x7fd384066f30 2023-10-06T02:24:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.960+0000 7fd37f7fe700 1 -- 172.21.15.37:0/1853793085 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289977 (secure 0 0 0) 0x7fd398064870 con 0x7fd384066f30 2023-10-06T02:24:10.964 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.962+0000 7fd39e033700 1 -- 172.21.15.37:0/1853793085 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd384066f30 msgr2=0x7fd3840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.962+0000 7fd39e033700 1 --2- 172.21.15.37:0/1853793085 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd384066f30 0x7fd3840693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd3980b0b30 tx=0x7fd38c016000 comp rx=0 tx=0).stop 2023-10-06T02:24:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.962+0000 7fd39e033700 1 -- 172.21.15.37:0/1853793085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3980b0690 msgr2=0x7fd3980c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.962+0000 7fd39e033700 1 --2- 172.21.15.37:0/1853793085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3980b0690 0x7fd3980c74a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd38800b5e0 tx=0x7fd3880090f0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.962+0000 7fd39e033700 1 -- 172.21.15.37:0/1853793085 shutdown_connections 2023-10-06T02:24:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.962+0000 7fd39e033700 1 --2- 172.21.15.37:0/1853793085 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd384066f30 0x7fd3840693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.962+0000 7fd39e033700 1 --2- 172.21.15.37:0/1853793085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3981597f0 0x7fd3980c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.962+0000 7fd39e033700 1 --2- 172.21.15.37:0/1853793085 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd3980b02c0 0x7fd398154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.962+0000 7fd39e033700 1 --2- 172.21.15.37:0/1853793085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3980b0690 0x7fd3980c74a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:10.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.963+0000 7fd39e033700 1 -- 172.21.15.37:0/1853793085 >> 172.21.15.37:0/1853793085 conn(0x7fd39806d8b0 msgr2=0x7fd3980b5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:10.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.963+0000 7fd39e033700 1 -- 172.21.15.37:0/1853793085 shutdown_connections 2023-10-06T02:24:10.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:10.963+0000 7fd39e033700 1 -- 172.21.15.37:0/1853793085 wait complete. 2023-10-06T02:24:10.968 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:24:10.976 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-10-06T02:24:10.521348+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382188,"kb_used_data":3884,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592532,"statfs":{"total":773094113280,"available":770654752768,"internally_reserved":0,"allocated":3977216,"data_stored":2283805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.648554"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.636326+0000","last_change":"2023-10-06T02:24:06.636326+0000","last_active":"2023-10-06T02:24:06.636326+0000","last_peered":"2023-10-06T02:24:06.636326+0000","last_clean":"2023-10-06T02:24:06.636326+0000","last_became_active":"2023-10-06T02:24:06.636044+0000","last_became_peered":"2023-10-06T02:24:06.636044+0000","last_unstale":"2023-10-06T02:24:06.636326+0000","last_undegraded":"2023-10-06T02:24:06.636326+0000","last_fullsized":"2023-10-06T02:24:06.636326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:04.573805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.639220+0000","last_change":"2023-10-06T02:24:06.639220+0000","last_active":"2023-10-06T02:24:06.639220+0000","last_peered":"2023-10-06T02:24:06.639220+0000","last_clean":"2023-10-06T02:24:06.639220+0000","last_became_active":"2023-10-06T02:24:06.638916+0000","last_became_peered":"2023-10-06T02:24:06.638916+0000","last_unstale":"2023-10-06T02:24:06.639220+0000","last_undegraded":"2023-10-06T02:24:06.639220+0000","last_fullsized":"2023-10-06T02:24:06.639220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:18.359433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.636148+0000","last_change":"2023-10-06T02:24:06.633608+0000","last_active":"2023-10-06T02:24:06.636148+0000","last_peered":"2023-10-06T02:24:06.636148+0000","last_clean":"2023-10-06T02:24:06.636148+0000","last_became_active":"2023-10-06T02:24:06.633326+0000","last_became_peered":"2023-10-06T02:24:06.633326+0000","last_unstale":"2023-10-06T02:24:06.636148+0000","last_undegraded":"2023-10-06T02:24:06.636148+0000","last_fullsized":"2023-10-06T02:24:06.636148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:27.744243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.645629+0000","last_change":"2023-10-06T02:24:06.641310+0000","last_active":"2023-10-06T02:24:06.645629+0000","last_peered":"2023-10-06T02:24:06.645629+0000","last_clean":"2023-10-06T02:24:06.645629+0000","last_became_active":"2023-10-06T02:24:06.640943+0000","last_became_peered":"2023-10-06T02:24:06.640943+0000","last_unstale":"2023-10-06T02:24:06.645629+0000","last_undegraded":"2023-10-06T02:24:06.645629+0000","last_fullsized":"2023-10-06T02:24:06.645629+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:32.277470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.645696+0000","last_change":"2023-10-06T02:24:06.642017+0000","last_active":"2023-10-06T02:24:06.645696+0000","last_peered":"2023-10-06T02:24:06.645696+0000","last_clean":"2023-10-06T02:24:06.645696+0000","last_became_active":"2023-10-06T02:24:06.641492+0000","last_became_peered":"2023-10-06T02:24:06.641492+0000","last_unstale":"2023-10-06T02:24:06.645696+0000","last_undegraded":"2023-10-06T02:24:06.645696+0000","last_fullsized":"2023-10-06T02:24:06.645696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:22.053926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.642673+0000","last_change":"2023-10-06T02:24:06.642673+0000","last_active":"2023-10-06T02:24:06.642673+0000","last_peered":"2023-10-06T02:24:06.642673+0000","last_clean":"2023-10-06T02:24:06.642673+0000","last_became_active":"2023-10-06T02:24:06.642414+0000","last_became_peered":"2023-10-06T02:24:06.642414+0000","last_unstale":"2023-10-06T02:24:06.642673+0000","last_undegraded":"2023-10-06T02:24:06.642673+0000","last_fullsized":"2023-10-06T02:24:06.642673+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:16.128949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646734+0000","last_change":"2023-10-06T02:24:06.640066+0000","last_active":"2023-10-06T02:24:06.646734+0000","last_peered":"2023-10-06T02:24:06.646734+0000","last_clean":"2023-10-06T02:24:06.646734+0000","last_became_active":"2023-10-06T02:24:06.639791+0000","last_became_peered":"2023-10-06T02:24:06.639791+0000","last_unstale":"2023-10-06T02:24:06.646734+0000","last_undegraded":"2023-10-06T02:24:06.646734+0000","last_fullsized":"2023-10-06T02:24:06.646734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:04.102026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.637290+0000","last_change":"2023-10-06T02:24:06.637290+0000","last_active":"2023-10-06T02:24:06.637290+0000","last_peered":"2023-10-06T02:24:06.637290+0000","last_clean":"2023-10-06T02:24:06.637290+0000","last_became_active":"2023-10-06T02:24:06.637038+0000","last_became_peered":"2023-10-06T02:24:06.637038+0000","last_unstale":"2023-10-06T02:24:06.637290+0000","last_undegraded":"2023-10-06T02:24:06.637290+0000","last_fullsized":"2023-10-06T02:24:06.637290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:26.428409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.638239+0000","last_change":"2023-10-06T02:24:06.634502+0000","last_active":"2023-10-06T02:24:06.638239+0000","last_peered":"2023-10-06T02:24:06.638239+0000","last_clean":"2023-10-06T02:24:06.638239+0000","last_became_active":"2023-10-06T02:24:06.634245+0000","last_became_peered":"2023-10-06T02:24:06.634245+0000","last_unstale":"2023-10-06T02:24:06.638239+0000","last_undegraded":"2023-10-06T02:24:06.638239+0000","last_fullsized":"2023-10-06T02:24:06.638239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:43.769507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646242+0000","last_change":"2023-10-06T02:24:06.635631+0000","last_active":"2023-10-06T02:24:06.646242+0000","last_peered":"2023-10-06T02:24:06.646242+0000","last_clean":"2023-10-06T02:24:06.646242+0000","last_became_active":"2023-10-06T02:24:06.635375+0000","last_became_peered":"2023-10-06T02:24:06.635375+0000","last_unstale":"2023-10-06T02:24:06.646242+0000","last_undegraded":"2023-10-06T02:24:06.646242+0000","last_fullsized":"2023-10-06T02:24:06.646242+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:45:50.081930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646407+0000","last_change":"2023-10-06T02:24:06.637745+0000","last_active":"2023-10-06T02:24:06.646407+0000","last_peered":"2023-10-06T02:24:06.646407+0000","last_clean":"2023-10-06T02:24:06.646407+0000","last_became_active":"2023-10-06T02:24:06.637437+0000","last_became_peered":"2023-10-06T02:24:06.637437+0000","last_unstale":"2023-10-06T02:24:06.646407+0000","last_undegraded":"2023-10-06T02:24:06.646407+0000","last_fullsized":"2023-10-06T02:24:06.646407+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:03:41.379092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.638268+0000","last_change":"2023-10-06T02:24:06.635693+0000","last_active":"2023-10-06T02:24:06.638268+0000","last_peered":"2023-10-06T02:24:06.638268+0000","last_clean":"2023-10-06T02:24:06.638268+0000","last_became_active":"2023-10-06T02:24:06.635421+0000","last_became_peered":"2023-10-06T02:24:06.635421+0000","last_unstale":"2023-10-06T02:24:06.638268+0000","last_undegraded":"2023-10-06T02:24:06.638268+0000","last_fullsized":"2023-10-06T02:24:06.638268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:44.446270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646389+0000","last_change":"2023-10-06T02:24:06.635838+0000","last_active":"2023-10-06T02:24:06.646389+0000","last_peered":"2023-10-06T02:24:06.646389+0000","last_clean":"2023-10-06T02:24:06.646389+0000","last_became_active":"2023-10-06T02:24:06.635534+0000","last_became_peered":"2023-10-06T02:24:06.635534+0000","last_unstale":"2023-10-06T02:24:06.646389+0000","last_undegraded":"2023-10-06T02:24:06.646389+0000","last_fullsized":"2023-10-06T02:24:06.646389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:43.769507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.645662+0000","last_change":"2023-10-06T02:24:06.637840+0000","last_active":"2023-10-06T02:24:06.645662+0000","last_peered":"2023-10-06T02:24:06.645662+0000","last_clean":"2023-10-06T02:24:06.645662+0000","last_became_active":"2023-10-06T02:24:06.637570+0000","last_became_peered":"2023-10-06T02:24:06.637570+0000","last_unstale":"2023-10-06T02:24:06.645662+0000","last_undegraded":"2023-10-06T02:24:06.645662+0000","last_fullsized":"2023-10-06T02:24:06.645662+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:18.359433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646250+0000","last_change":"2023-10-06T02:24:06.635717+0000","last_active":"2023-10-06T02:24:06.646250+0000","last_peered":"2023-10-06T02:24:06.646250+0000","last_clean":"2023-10-06T02:24:06.646250+0000","last_became_active":"2023-10-06T02:24:06.635450+0000","last_became_peered":"2023-10-06T02:24:06.635450+0000","last_unstale":"2023-10-06T02:24:06.646250+0000","last_undegraded":"2023-10-06T02:24:06.646250+0000","last_fullsized":"2023-10-06T02:24:06.646250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:12.339691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.644957+0000","last_change":"2023-10-06T02:24:06.644957+0000","last_active":"2023-10-06T02:24:06.644957+0000","last_peered":"2023-10-06T02:24:06.644957+0000","last_clean":"2023-10-06T02:24:06.644957+0000","last_became_active":"2023-10-06T02:24:06.644693+0000","last_became_peered":"2023-10-06T02:24:06.644693+0000","last_unstale":"2023-10-06T02:24:06.644957+0000","last_undegraded":"2023-10-06T02:24:06.644957+0000","last_fullsized":"2023-10-06T02:24:06.644957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:53.101590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.644689+0000","last_change":"2023-10-06T02:24:06.644689+0000","last_active":"2023-10-06T02:24:06.644689+0000","last_peered":"2023-10-06T02:24:06.644689+0000","last_clean":"2023-10-06T02:24:06.644689+0000","last_became_active":"2023-10-06T02:24:06.644444+0000","last_became_peered":"2023-10-06T02:24:06.644444+0000","last_unstale":"2023-10-06T02:24:06.644689+0000","last_undegraded":"2023-10-06T02:24:06.644689+0000","last_fullsized":"2023-10-06T02:24:06.644689+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:00.850409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.642377+0000","last_change":"2023-10-06T02:24:06.642377+0000","last_active":"2023-10-06T02:24:06.642377+0000","last_peered":"2023-10-06T02:24:06.642377+0000","last_clean":"2023-10-06T02:24:06.642377+0000","last_became_active":"2023-10-06T02:24:06.641848+0000","last_became_peered":"2023-10-06T02:24:06.641848+0000","last_unstale":"2023-10-06T02:24:06.642377+0000","last_undegraded":"2023-10-06T02:24:06.642377+0000","last_fullsized":"2023-10-06T02:24:06.642377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:39.487172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646046+0000","last_change":"2023-10-06T02:24:06.643920+0000","last_active":"2023-10-06T02:24:06.646046+0000","last_peered":"2023-10-06T02:24:06.646046+0000","last_clean":"2023-10-06T02:24:06.646046+0000","last_became_active":"2023-10-06T02:24:06.643579+0000","last_became_peered":"2023-10-06T02:24:06.643579+0000","last_unstale":"2023-10-06T02:24:06.646046+0000","last_undegraded":"2023-10-06T02:24:06.646046+0000","last_fullsized":"2023-10-06T02:24:06.646046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:43.140326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646437+0000","last_change":"2023-10-06T02:24:06.646437+0000","last_active":"2023-10-06T02:24:06.646437+0000","last_peered":"2023-10-06T02:24:06.646437+0000","last_clean":"2023-10-06T02:24:06.646437+0000","last_became_active":"2023-10-06T02:24:06.646119+0000","last_became_peered":"2023-10-06T02:24:06.646119+0000","last_unstale":"2023-10-06T02:24:06.646437+0000","last_undegraded":"2023-10-06T02:24:06.646437+0000","last_fullsized":"2023-10-06T02:24:06.646437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:32.277470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646646+0000","last_change":"2023-10-06T02:24:06.637913+0000","last_active":"2023-10-06T02:24:06.646646+0000","last_peered":"2023-10-06T02:24:06.646646+0000","last_clean":"2023-10-06T02:24:06.646646+0000","last_became_active":"2023-10-06T02:24:06.637656+0000","last_became_peered":"2023-10-06T02:24:06.637656+0000","last_unstale":"2023-10-06T02:24:06.646646+0000","last_undegraded":"2023-10-06T02:24:06.646646+0000","last_fullsized":"2023-10-06T02:24:06.646646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:33:33.875455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.645697+0000","last_change":"2023-10-06T02:24:06.639412+0000","last_active":"2023-10-06T02:24:06.645697+0000","last_peered":"2023-10-06T02:24:06.645697+0000","last_clean":"2023-10-06T02:24:06.645697+0000","last_became_active":"2023-10-06T02:24:06.639245+0000","last_became_peered":"2023-10-06T02:24:06.639245+0000","last_unstale":"2023-10-06T02:24:06.645697+0000","last_undegraded":"2023-10-06T02:24:06.645697+0000","last_fullsized":"2023-10-06T02:24:06.645697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:03:41.379092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.638544+0000","last_change":"2023-10-06T02:24:06.638544+0000","last_active":"2023-10-06T02:24:06.638544+0000","last_peered":"2023-10-06T02:24:06.638544+0000","last_clean":"2023-10-06T02:24:06.638544+0000","last_became_active":"2023-10-06T02:24:06.638159+0000","last_became_peered":"2023-10-06T02:24:06.638159+0000","last_unstale":"2023-10-06T02:24:06.638544+0000","last_undegraded":"2023-10-06T02:24:06.638544+0000","last_fullsized":"2023-10-06T02:24:06.638544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:43.769507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.648152+0000","last_change":"2023-10-06T02:24:06.646641+0000","last_active":"2023-10-06T02:24:06.648152+0000","last_peered":"2023-10-06T02:24:06.648152+0000","last_clean":"2023-10-06T02:24:06.648152+0000","last_became_active":"2023-10-06T02:24:06.646390+0000","last_became_peered":"2023-10-06T02:24:06.646390+0000","last_unstale":"2023-10-06T02:24:06.648152+0000","last_undegraded":"2023-10-06T02:24:06.648152+0000","last_fullsized":"2023-10-06T02:24:06.648152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:00.902536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.637249+0000","last_change":"2023-10-06T02:24:06.637249+0000","last_active":"2023-10-06T02:24:06.637249+0000","last_peered":"2023-10-06T02:24:06.637249+0000","last_clean":"2023-10-06T02:24:06.637249+0000","last_became_active":"2023-10-06T02:24:06.636958+0000","last_became_peered":"2023-10-06T02:24:06.636958+0000","last_unstale":"2023-10-06T02:24:06.637249+0000","last_undegraded":"2023-10-06T02:24:06.637249+0000","last_fullsized":"2023-10-06T02:24:06.637249+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:00.902536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.647034+0000","last_change":"2023-10-06T02:24:06.647034+0000","last_active":"2023-10-06T02:24:06.647034+0000","last_peered":"2023-10-06T02:24:06.647034+0000","last_clean":"2023-10-06T02:24:06.647034+0000","last_became_active":"2023-10-06T02:24:06.646809+0000","last_became_peered":"2023-10-06T02:24:06.646809+0000","last_unstale":"2023-10-06T02:24:06.647034+0000","last_undegraded":"2023-10-06T02:24:06.647034+0000","last_fullsized":"2023-10-06T02:24:06.647034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:55.038619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.640605+0000","last_change":"2023-10-06T02:24:06.640605+0000","last_active":"2023-10-06T02:24:06.640605+0000","last_peered":"2023-10-06T02:24:06.640605+0000","last_clean":"2023-10-06T02:24:06.640605+0000","last_became_active":"2023-10-06T02:24:06.640214+0000","last_became_peered":"2023-10-06T02:24:06.640214+0000","last_unstale":"2023-10-06T02:24:06.640605+0000","last_undegraded":"2023-10-06T02:24:06.640605+0000","last_fullsized":"2023-10-06T02:24:06.640605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:43.140326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646499+0000","last_change":"2023-10-06T02:24:06.638557+0000","last_active":"2023-10-06T02:24:06.646499+0000","last_peered":"2023-10-06T02:24:06.646499+0000","last_clean":"2023-10-06T02:24:06.646499+0000","last_became_active":"2023-10-06T02:24:06.638268+0000","last_became_peered":"2023-10-06T02:24:06.638268+0000","last_unstale":"2023-10-06T02:24:06.646499+0000","last_undegraded":"2023-10-06T02:24:06.646499+0000","last_fullsized":"2023-10-06T02:24:06.646499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:04.573805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.639257+0000","last_change":"2023-10-06T02:24:06.639257+0000","last_active":"2023-10-06T02:24:06.639257+0000","last_peered":"2023-10-06T02:24:06.639257+0000","last_clean":"2023-10-06T02:24:06.639257+0000","last_became_active":"2023-10-06T02:24:06.639010+0000","last_became_peered":"2023-10-06T02:24:06.639010+0000","last_unstale":"2023-10-06T02:24:06.639257+0000","last_undegraded":"2023-10-06T02:24:06.639257+0000","last_fullsized":"2023-10-06T02:24:06.639257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:22.053926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.637795+0000","last_change":"2023-10-06T02:24:06.637795+0000","last_active":"2023-10-06T02:24:06.637795+0000","last_peered":"2023-10-06T02:24:06.637795+0000","last_clean":"2023-10-06T02:24:06.637795+0000","last_became_active":"2023-10-06T02:24:06.637548+0000","last_became_peered":"2023-10-06T02:24:06.637548+0000","last_unstale":"2023-10-06T02:24:06.637795+0000","last_undegraded":"2023-10-06T02:24:06.637795+0000","last_fullsized":"2023-10-06T02:24:06.637795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:22.475390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.638964+0000","last_change":"2023-10-06T02:24:06.638964+0000","last_active":"2023-10-06T02:24:06.638964+0000","last_peered":"2023-10-06T02:24:06.638964+0000","last_clean":"2023-10-06T02:24:06.638964+0000","last_became_active":"2023-10-06T02:24:06.638696+0000","last_became_peered":"2023-10-06T02:24:06.638696+0000","last_unstale":"2023-10-06T02:24:06.638964+0000","last_undegraded":"2023-10-06T02:24:06.638964+0000","last_fullsized":"2023-10-06T02:24:06.638964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:28.283593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.638908+0000","last_change":"2023-10-06T02:24:06.638908+0000","last_active":"2023-10-06T02:24:06.638908+0000","last_peered":"2023-10-06T02:24:06.638908+0000","last_clean":"2023-10-06T02:24:06.638908+0000","last_became_active":"2023-10-06T02:24:06.638611+0000","last_became_peered":"2023-10-06T02:24:06.638611+0000","last_unstale":"2023-10-06T02:24:06.638908+0000","last_undegraded":"2023-10-06T02:24:06.638908+0000","last_fullsized":"2023-10-06T02:24:06.638908+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:06.568329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.643121+0000","last_change":"2023-10-06T02:24:06.643121+0000","last_active":"2023-10-06T02:24:06.643121+0000","last_peered":"2023-10-06T02:24:06.643121+0000","last_clean":"2023-10-06T02:24:06.643121+0000","last_became_active":"2023-10-06T02:24:06.642886+0000","last_became_peered":"2023-10-06T02:24:06.642886+0000","last_unstale":"2023-10-06T02:24:06.643121+0000","last_undegraded":"2023-10-06T02:24:06.643121+0000","last_fullsized":"2023-10-06T02:24:06.643121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:27.744243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"30'4","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.887699+0000","last_change":"2023-10-06T02:24:05.891640+0000","last_active":"2023-10-06T02:24:06.887699+0000","last_peered":"2023-10-06T02:24:06.887699+0000","last_clean":"2023-10-06T02:24:06.887699+0000","last_became_active":"2023-10-06T02:24:05.891345+0000","last_became_peered":"2023-10-06T02:24:05.891345+0000","last_unstale":"2023-10-06T02:24:06.887699+0000","last_undegraded":"2023-10-06T02:24:06.887699+0000","last_fullsized":"2023-10-06T02:24:06.887699+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:58.807876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.647157+0000","last_change":"2023-10-06T02:24:06.647157+0000","last_active":"2023-10-06T02:24:06.647157+0000","last_peered":"2023-10-06T02:24:06.647157+0000","last_clean":"2023-10-06T02:24:06.647157+0000","last_became_active":"2023-10-06T02:24:06.646897+0000","last_became_peered":"2023-10-06T02:24:06.646897+0000","last_unstale":"2023-10-06T02:24:06.647157+0000","last_undegraded":"2023-10-06T02:24:06.647157+0000","last_fullsized":"2023-10-06T02:24:06.647157+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:50.077514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.884547+0000","last_change":"2023-10-06T02:24:05.881403+0000","last_active":"2023-10-06T02:24:06.884547+0000","last_peered":"2023-10-06T02:24:06.884547+0000","last_clean":"2023-10-06T02:24:06.884547+0000","last_became_active":"2023-10-06T02:24:05.880998+0000","last_became_peered":"2023-10-06T02:24:05.880998+0000","last_unstale":"2023-10-06T02:24:06.884547+0000","last_undegraded":"2023-10-06T02:24:06.884547+0000","last_fullsized":"2023-10-06T02:24:06.884547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:53.273164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.648417+0000","last_change":"2023-10-06T02:24:06.640859+0000","last_active":"2023-10-06T02:24:06.648417+0000","last_peered":"2023-10-06T02:24:06.648417+0000","last_clean":"2023-10-06T02:24:06.648417+0000","last_became_active":"2023-10-06T02:24:06.640587+0000","last_became_peered":"2023-10-06T02:24:06.640587+0000","last_unstale":"2023-10-06T02:24:06.648417+0000","last_undegraded":"2023-10-06T02:24:06.648417+0000","last_fullsized":"2023-10-06T02:24:06.648417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:04.573805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.887373+0000","last_change":"2023-10-06T02:24:05.892267+0000","last_active":"2023-10-06T02:24:06.887373+0000","last_peered":"2023-10-06T02:24:06.887373+0000","last_clean":"2023-10-06T02:24:06.887373+0000","last_became_active":"2023-10-06T02:24:05.892016+0000","last_became_peered":"2023-10-06T02:24:05.892016+0000","last_unstale":"2023-10-06T02:24:06.887373+0000","last_undegraded":"2023-10-06T02:24:06.887373+0000","last_fullsized":"2023-10-06T02:24:06.887373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:58:35.085178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.637858+0000","last_change":"2023-10-06T02:24:06.637858+0000","last_active":"2023-10-06T02:24:06.637858+0000","last_peered":"2023-10-06T02:24:06.637858+0000","last_clean":"2023-10-06T02:24:06.637858+0000","last_became_active":"2023-10-06T02:24:06.637600+0000","last_became_peered":"2023-10-06T02:24:06.637600+0000","last_unstale":"2023-10-06T02:24:06.637858+0000","last_undegraded":"2023-10-06T02:24:06.637858+0000","last_fullsized":"2023-10-06T02:24:06.637858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:12.339691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.887014+0000","last_change":"2023-10-06T02:24:05.890180+0000","last_active":"2023-10-06T02:24:06.887014+0000","last_peered":"2023-10-06T02:24:06.887014+0000","last_clean":"2023-10-06T02:24:06.887014+0000","last_became_active":"2023-10-06T02:24:05.889894+0000","last_became_peered":"2023-10-06T02:24:05.889894+0000","last_unstale":"2023-10-06T02:24:06.887014+0000","last_undegraded":"2023-10-06T02:24:06.887014+0000","last_fullsized":"2023-10-06T02:24:06.887014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:43.441636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.645522+0000","last_change":"2023-10-06T02:24:06.639593+0000","last_active":"2023-10-06T02:24:06.645522+0000","last_peered":"2023-10-06T02:24:06.645522+0000","last_clean":"2023-10-06T02:24:06.645522+0000","last_became_active":"2023-10-06T02:24:06.639099+0000","last_became_peered":"2023-10-06T02:24:06.639099+0000","last_unstale":"2023-10-06T02:24:06.645522+0000","last_undegraded":"2023-10-06T02:24:06.645522+0000","last_fullsized":"2023-10-06T02:24:06.645522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:45:50.081930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.884342+0000","last_change":"2023-10-06T02:24:05.879335+0000","last_active":"2023-10-06T02:24:06.884342+0000","last_peered":"2023-10-06T02:24:06.884342+0000","last_clean":"2023-10-06T02:24:06.884342+0000","last_became_active":"2023-10-06T02:24:05.878162+0000","last_became_peered":"2023-10-06T02:24:05.878162+0000","last_unstale":"2023-10-06T02:24:06.884342+0000","last_undegraded":"2023-10-06T02:24:06.884342+0000","last_fullsized":"2023-10-06T02:24:06.884342+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:53.273164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.647219+0000","last_change":"2023-10-06T02:24:06.641173+0000","last_active":"2023-10-06T02:24:06.647219+0000","last_peered":"2023-10-06T02:24:06.647219+0000","last_clean":"2023-10-06T02:24:06.647219+0000","last_became_active":"2023-10-06T02:24:06.640877+0000","last_became_peered":"2023-10-06T02:24:06.640877+0000","last_unstale":"2023-10-06T02:24:06.647219+0000","last_undegraded":"2023-10-06T02:24:06.647219+0000","last_fullsized":"2023-10-06T02:24:06.647219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:23.320138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"30'1","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.630871+0000","last_change":"2023-10-06T02:24:05.890651+0000","last_active":"2023-10-06T02:24:06.630871+0000","last_peered":"2023-10-06T02:24:06.630871+0000","last_clean":"2023-10-06T02:24:06.630871+0000","last_became_active":"2023-10-06T02:24:05.890361+0000","last_became_peered":"2023-10-06T02:24:05.890361+0000","last_unstale":"2023-10-06T02:24:06.630871+0000","last_undegraded":"2023-10-06T02:24:06.630871+0000","last_fullsized":"2023-10-06T02:24:06.630871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:57.092721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.645640+0000","last_change":"2023-10-06T02:24:06.636512+0000","last_active":"2023-10-06T02:24:06.645640+0000","last_peered":"2023-10-06T02:24:06.645640+0000","last_clean":"2023-10-06T02:24:06.645640+0000","last_became_active":"2023-10-06T02:24:06.636209+0000","last_became_peered":"2023-10-06T02:24:06.636209+0000","last_unstale":"2023-10-06T02:24:06.645640+0000","last_undegraded":"2023-10-06T02:24:06.645640+0000","last_fullsized":"2023-10-06T02:24:06.645640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:46.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.887911+0000","last_change":"2023-10-06T02:24:05.886105+0000","last_active":"2023-10-06T02:24:05.887911+0000","last_peered":"2023-10-06T02:24:05.887911+0000","last_clean":"2023-10-06T02:24:05.887911+0000","last_became_active":"2023-10-06T02:24:05.885859+0000","last_became_peered":"2023-10-06T02:24:05.885859+0000","last_unstale":"2023-10-06T02:24:05.887911+0000","last_undegraded":"2023-10-06T02:24:05.887911+0000","last_fullsized":"2023-10-06T02:24:05.887911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:57.092721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646604+0000","last_change":"2023-10-06T02:24:06.646604+0000","last_active":"2023-10-06T02:24:06.646604+0000","last_peered":"2023-10-06T02:24:06.646604+0000","last_clean":"2023-10-06T02:24:06.646604+0000","last_became_active":"2023-10-06T02:24:06.646325+0000","last_became_peered":"2023-10-06T02:24:06.646325+0000","last_unstale":"2023-10-06T02:24:06.646604+0000","last_undegraded":"2023-10-06T02:24:06.646604+0000","last_fullsized":"2023-10-06T02:24:06.646604+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:20.764470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.628413+0000","last_change":"2023-10-06T02:24:05.890192+0000","last_active":"2023-10-06T02:24:06.628413+0000","last_peered":"2023-10-06T02:24:06.628413+0000","last_clean":"2023-10-06T02:24:06.628413+0000","last_became_active":"2023-10-06T02:24:05.889910+0000","last_became_peered":"2023-10-06T02:24:05.889910+0000","last_unstale":"2023-10-06T02:24:06.628413+0000","last_undegraded":"2023-10-06T02:24:06.628413+0000","last_fullsized":"2023-10-06T02:24:06.628413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:59.554515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.645604+0000","last_change":"2023-10-06T02:24:06.641295+0000","last_active":"2023-10-06T02:24:06.645604+0000","last_peered":"2023-10-06T02:24:06.645604+0000","last_clean":"2023-10-06T02:24:06.645604+0000","last_became_active":"2023-10-06T02:24:06.640940+0000","last_became_peered":"2023-10-06T02:24:06.640940+0000","last_unstale":"2023-10-06T02:24:06.645604+0000","last_undegraded":"2023-10-06T02:24:06.645604+0000","last_fullsized":"2023-10-06T02:24:06.645604+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:22.475390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.887857+0000","last_change":"2023-10-06T02:24:05.885620+0000","last_active":"2023-10-06T02:24:05.887857+0000","last_peered":"2023-10-06T02:24:05.887857+0000","last_clean":"2023-10-06T02:24:05.887857+0000","last_became_active":"2023-10-06T02:24:05.885014+0000","last_became_peered":"2023-10-06T02:24:05.885014+0000","last_unstale":"2023-10-06T02:24:05.887857+0000","last_undegraded":"2023-10-06T02:24:05.887857+0000","last_fullsized":"2023-10-06T02:24:05.887857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:49.072880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.642089+0000","last_change":"2023-10-06T02:24:06.642089+0000","last_active":"2023-10-06T02:24:06.642089+0000","last_peered":"2023-10-06T02:24:06.642089+0000","last_clean":"2023-10-06T02:24:06.642089+0000","last_became_active":"2023-10-06T02:24:06.641613+0000","last_became_peered":"2023-10-06T02:24:06.641613+0000","last_unstale":"2023-10-06T02:24:06.642089+0000","last_undegraded":"2023-10-06T02:24:06.642089+0000","last_fullsized":"2023-10-06T02:24:06.642089+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:33:33.875455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.625816+0000","last_change":"2023-10-06T02:24:05.885153+0000","last_active":"2023-10-06T02:24:06.625816+0000","last_peered":"2023-10-06T02:24:06.625816+0000","last_clean":"2023-10-06T02:24:06.625816+0000","last_became_active":"2023-10-06T02:24:05.884873+0000","last_became_peered":"2023-10-06T02:24:05.884873+0000","last_unstale":"2023-10-06T02:24:06.625816+0000","last_undegraded":"2023-10-06T02:24:06.625816+0000","last_fullsized":"2023-10-06T02:24:06.625816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:38.482538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.638255+0000","last_change":"2023-10-06T02:24:06.635483+0000","last_active":"2023-10-06T02:24:06.638255+0000","last_peered":"2023-10-06T02:24:06.638255+0000","last_clean":"2023-10-06T02:24:06.638255+0000","last_became_active":"2023-10-06T02:24:06.635248+0000","last_became_peered":"2023-10-06T02:24:06.635248+0000","last_unstale":"2023-10-06T02:24:06.638255+0000","last_undegraded":"2023-10-06T02:24:06.638255+0000","last_fullsized":"2023-10-06T02:24:06.638255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:53.101590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"30'3","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.885656+0000","last_change":"2023-10-06T02:24:05.888093+0000","last_active":"2023-10-06T02:24:06.885656+0000","last_peered":"2023-10-06T02:24:06.885656+0000","last_clean":"2023-10-06T02:24:06.885656+0000","last_became_active":"2023-10-06T02:24:05.887797+0000","last_became_peered":"2023-10-06T02:24:05.887797+0000","last_unstale":"2023-10-06T02:24:06.885656+0000","last_undegraded":"2023-10-06T02:24:06.885656+0000","last_fullsized":"2023-10-06T02:24:06.885656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:31.272836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.648304+0000","last_change":"2023-10-06T02:24:06.639820+0000","last_active":"2023-10-06T02:24:06.648304+0000","last_peered":"2023-10-06T02:24:06.648304+0000","last_clean":"2023-10-06T02:24:06.648304+0000","last_became_active":"2023-10-06T02:24:06.639564+0000","last_became_peered":"2023-10-06T02:24:06.639564+0000","last_unstale":"2023-10-06T02:24:06.648304+0000","last_undegraded":"2023-10-06T02:24:06.648304+0000","last_fullsized":"2023-10-06T02:24:06.648304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:23.320138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"30'6","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.890549+0000","last_change":"2023-10-06T02:24:05.885379+0000","last_active":"2023-10-06T02:24:06.890549+0000","last_peered":"2023-10-06T02:24:06.890549+0000","last_clean":"2023-10-06T02:24:06.890549+0000","last_became_active":"2023-10-06T02:24:05.885113+0000","last_became_peered":"2023-10-06T02:24:05.885113+0000","last_unstale":"2023-10-06T02:24:06.890549+0000","last_undegraded":"2023-10-06T02:24:06.890549+0000","last_fullsized":"2023-10-06T02:24:06.890549+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:22.226316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.636257+0000","last_change":"2023-10-06T02:24:06.633991+0000","last_active":"2023-10-06T02:24:06.636257+0000","last_peered":"2023-10-06T02:24:06.636257+0000","last_clean":"2023-10-06T02:24:06.636257+0000","last_became_active":"2023-10-06T02:24:06.633729+0000","last_became_peered":"2023-10-06T02:24:06.633729+0000","last_unstale":"2023-10-06T02:24:06.636257+0000","last_undegraded":"2023-10-06T02:24:06.636257+0000","last_fullsized":"2023-10-06T02:24:06.636257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:54.618077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.884659+0000","last_change":"2023-10-06T02:24:05.890355+0000","last_active":"2023-10-06T02:24:06.884659+0000","last_peered":"2023-10-06T02:24:06.884659+0000","last_clean":"2023-10-06T02:24:06.884659+0000","last_became_active":"2023-10-06T02:24:05.890011+0000","last_became_peered":"2023-10-06T02:24:05.890011+0000","last_unstale":"2023-10-06T02:24:06.884659+0000","last_undegraded":"2023-10-06T02:24:06.884659+0000","last_fullsized":"2023-10-06T02:24:06.884659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:54.033984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.637879+0000","last_change":"2023-10-06T02:24:06.637879+0000","last_active":"2023-10-06T02:24:06.637879+0000","last_peered":"2023-10-06T02:24:06.637879+0000","last_clean":"2023-10-06T02:24:06.637879+0000","last_became_active":"2023-10-06T02:24:06.637580+0000","last_became_peered":"2023-10-06T02:24:06.637580+0000","last_unstale":"2023-10-06T02:24:06.637879+0000","last_undegraded":"2023-10-06T02:24:06.637879+0000","last_fullsized":"2023-10-06T02:24:06.637879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:23.320138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.887641+0000","last_change":"2023-10-06T02:24:05.884713+0000","last_active":"2023-10-06T02:24:05.887641+0000","last_peered":"2023-10-06T02:24:05.887641+0000","last_clean":"2023-10-06T02:24:05.887641+0000","last_became_active":"2023-10-06T02:24:05.884365+0000","last_became_peered":"2023-10-06T02:24:05.884365+0000","last_unstale":"2023-10-06T02:24:05.887641+0000","last_undegraded":"2023-10-06T02:24:05.887641+0000","last_fullsized":"2023-10-06T02:24:05.887641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:01.750335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.644467+0000","last_change":"2023-10-06T02:24:06.644467+0000","last_active":"2023-10-06T02:24:06.644467+0000","last_peered":"2023-10-06T02:24:06.644467+0000","last_clean":"2023-10-06T02:24:06.644467+0000","last_became_active":"2023-10-06T02:24:06.644142+0000","last_became_peered":"2023-10-06T02:24:06.644142+0000","last_unstale":"2023-10-06T02:24:06.644467+0000","last_undegraded":"2023-10-06T02:24:06.644467+0000","last_fullsized":"2023-10-06T02:24:06.644467+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:56.132640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.892910+0000","last_change":"2023-10-06T02:24:05.888127+0000","last_active":"2023-10-06T02:24:05.892910+0000","last_peered":"2023-10-06T02:24:05.892910+0000","last_clean":"2023-10-06T02:24:05.892910+0000","last_became_active":"2023-10-06T02:24:05.887837+0000","last_became_peered":"2023-10-06T02:24:05.887837+0000","last_unstale":"2023-10-06T02:24:05.892910+0000","last_undegraded":"2023-10-06T02:24:05.892910+0000","last_fullsized":"2023-10-06T02:24:05.892910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:34:05.397936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.637071+0000","last_change":"2023-10-06T02:24:06.637071+0000","last_active":"2023-10-06T02:24:06.637071+0000","last_peered":"2023-10-06T02:24:06.637071+0000","last_clean":"2023-10-06T02:24:06.637071+0000","last_became_active":"2023-10-06T02:24:06.636772+0000","last_became_peered":"2023-10-06T02:24:06.636772+0000","last_unstale":"2023-10-06T02:24:06.637071+0000","last_undegraded":"2023-10-06T02:24:06.637071+0000","last_fullsized":"2023-10-06T02:24:06.637071+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:03:41.379092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'8","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.890619+0000","last_change":"2023-10-06T02:24:05.892127+0000","last_active":"2023-10-06T02:24:06.890619+0000","last_peered":"2023-10-06T02:24:06.890619+0000","last_clean":"2023-10-06T02:24:06.890619+0000","last_became_active":"2023-10-06T02:24:05.891833+0000","last_became_peered":"2023-10-06T02:24:05.891833+0000","last_unstale":"2023-10-06T02:24:06.890619+0000","last_undegraded":"2023-10-06T02:24:06.890619+0000","last_fullsized":"2023-10-06T02:24:06.890619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:21.470756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.638727+0000","last_change":"2023-10-06T02:24:06.638727+0000","last_active":"2023-10-06T02:24:06.638727+0000","last_peered":"2023-10-06T02:24:06.638727+0000","last_clean":"2023-10-06T02:24:06.638727+0000","last_became_active":"2023-10-06T02:24:06.638505+0000","last_became_peered":"2023-10-06T02:24:06.638505+0000","last_unstale":"2023-10-06T02:24:06.638727+0000","last_undegraded":"2023-10-06T02:24:06.638727+0000","last_fullsized":"2023-10-06T02:24:06.638727+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:28.283593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.887473+0000","last_change":"2023-10-06T02:24:05.891230+0000","last_active":"2023-10-06T02:24:06.887473+0000","last_peered":"2023-10-06T02:24:06.887473+0000","last_clean":"2023-10-06T02:24:06.887473+0000","last_became_active":"2023-10-06T02:24:05.890916+0000","last_became_peered":"2023-10-06T02:24:05.890916+0000","last_unstale":"2023-10-06T02:24:06.887473+0000","last_undegraded":"2023-10-06T02:24:06.887473+0000","last_fullsized":"2023-10-06T02:24:06.887473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:05.563695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.647359+0000","last_change":"2023-10-06T02:24:06.641115+0000","last_active":"2023-10-06T02:24:06.647359+0000","last_peered":"2023-10-06T02:24:06.647359+0000","last_clean":"2023-10-06T02:24:06.647359+0000","last_became_active":"2023-10-06T02:24:06.640850+0000","last_became_peered":"2023-10-06T02:24:06.640850+0000","last_unstale":"2023-10-06T02:24:06.647359+0000","last_undegraded":"2023-10-06T02:24:06.647359+0000","last_fullsized":"2023-10-06T02:24:06.647359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:26.428409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.887358+0000","last_change":"2023-10-06T02:24:05.890856+0000","last_active":"2023-10-06T02:24:06.887358+0000","last_peered":"2023-10-06T02:24:06.887358+0000","last_clean":"2023-10-06T02:24:06.887358+0000","last_became_active":"2023-10-06T02:24:05.890579+0000","last_became_peered":"2023-10-06T02:24:05.890579+0000","last_unstale":"2023-10-06T02:24:06.887358+0000","last_undegraded":"2023-10-06T02:24:06.887358+0000","last_fullsized":"2023-10-06T02:24:06.887358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:53.613443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.648441+0000","last_change":"2023-10-06T02:24:06.642965+0000","last_active":"2023-10-06T02:24:06.648441+0000","last_peered":"2023-10-06T02:24:06.648441+0000","last_clean":"2023-10-06T02:24:06.648441+0000","last_became_active":"2023-10-06T02:24:06.642726+0000","last_became_peered":"2023-10-06T02:24:06.642726+0000","last_unstale":"2023-10-06T02:24:06.648441+0000","last_undegraded":"2023-10-06T02:24:06.648441+0000","last_fullsized":"2023-10-06T02:24:06.648441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:20.764470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.887468+0000","last_change":"2023-10-06T02:24:05.882616+0000","last_active":"2023-10-06T02:24:06.887468+0000","last_peered":"2023-10-06T02:24:06.887468+0000","last_clean":"2023-10-06T02:24:06.887468+0000","last_became_active":"2023-10-06T02:24:05.882361+0000","last_became_peered":"2023-10-06T02:24:05.882361+0000","last_unstale":"2023-10-06T02:24:06.887468+0000","last_undegraded":"2023-10-06T02:24:06.887468+0000","last_fullsized":"2023-10-06T02:24:06.887468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:57.109787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.645619+0000","last_change":"2023-10-06T02:24:06.641427+0000","last_active":"2023-10-06T02:24:06.645619+0000","last_peered":"2023-10-06T02:24:06.645619+0000","last_clean":"2023-10-06T02:24:06.645619+0000","last_became_active":"2023-10-06T02:24:06.640756+0000","last_became_peered":"2023-10-06T02:24:06.640756+0000","last_unstale":"2023-10-06T02:24:06.645619+0000","last_undegraded":"2023-10-06T02:24:06.645619+0000","last_fullsized":"2023-10-06T02:24:06.645619+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:58.097355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.893261+0000","last_change":"2023-10-06T02:24:05.890722+0000","last_active":"2023-10-06T02:24:05.893261+0000","last_peered":"2023-10-06T02:24:05.893261+0000","last_clean":"2023-10-06T02:24:05.893261+0000","last_became_active":"2023-10-06T02:24:05.890423+0000","last_became_peered":"2023-10-06T02:24:05.890423+0000","last_unstale":"2023-10-06T02:24:05.893261+0000","last_undegraded":"2023-10-06T02:24:05.893261+0000","last_fullsized":"2023-10-06T02:24:05.893261+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:30.556061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.645627+0000","last_change":"2023-10-06T02:24:06.645627+0000","last_active":"2023-10-06T02:24:06.645627+0000","last_peered":"2023-10-06T02:24:06.645627+0000","last_clean":"2023-10-06T02:24:06.645627+0000","last_became_active":"2023-10-06T02:24:06.645247+0000","last_became_peered":"2023-10-06T02:24:06.645247+0000","last_unstale":"2023-10-06T02:24:06.645627+0000","last_undegraded":"2023-10-06T02:24:06.645627+0000","last_fullsized":"2023-10-06T02:24:06.645627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:46.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.884325+0000","last_change":"2023-10-06T02:24:05.877336+0000","last_active":"2023-10-06T02:24:06.884325+0000","last_peered":"2023-10-06T02:24:06.884325+0000","last_clean":"2023-10-06T02:24:06.884325+0000","last_became_active":"2023-10-06T02:24:05.877056+0000","last_became_peered":"2023-10-06T02:24:05.877056+0000","last_unstale":"2023-10-06T02:24:06.884325+0000","last_undegraded":"2023-10-06T02:24:06.884325+0000","last_fullsized":"2023-10-06T02:24:06.884325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:58.807876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.639173+0000","last_change":"2023-10-06T02:24:06.635697+0000","last_active":"2023-10-06T02:24:06.639173+0000","last_peered":"2023-10-06T02:24:06.639173+0000","last_clean":"2023-10-06T02:24:06.639173+0000","last_became_active":"2023-10-06T02:24:06.635240+0000","last_became_peered":"2023-10-06T02:24:06.635240+0000","last_unstale":"2023-10-06T02:24:06.639173+0000","last_undegraded":"2023-10-06T02:24:06.639173+0000","last_fullsized":"2023-10-06T02:24:06.639173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:56.132640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.628512+0000","last_change":"2023-10-06T02:24:05.888389+0000","last_active":"2023-10-06T02:24:06.628512+0000","last_peered":"2023-10-06T02:24:06.628512+0000","last_clean":"2023-10-06T02:24:06.628512+0000","last_became_active":"2023-10-06T02:24:05.887986+0000","last_became_peered":"2023-10-06T02:24:05.887986+0000","last_unstale":"2023-10-06T02:24:06.628512+0000","last_undegraded":"2023-10-06T02:24:06.628512+0000","last_fullsized":"2023-10-06T02:24:06.628512+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:37.984772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646556+0000","last_change":"2023-10-06T02:24:06.638463+0000","last_active":"2023-10-06T02:24:06.646556+0000","last_peered":"2023-10-06T02:24:06.646556+0000","last_clean":"2023-10-06T02:24:06.646556+0000","last_became_active":"2023-10-06T02:24:06.638189+0000","last_became_peered":"2023-10-06T02:24:06.638189+0000","last_unstale":"2023-10-06T02:24:06.646556+0000","last_undegraded":"2023-10-06T02:24:06.646556+0000","last_fullsized":"2023-10-06T02:24:06.646556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:28.283593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.890350+0000","last_change":"2023-10-06T02:24:05.884238+0000","last_active":"2023-10-06T02:24:05.890350+0000","last_peered":"2023-10-06T02:24:05.890350+0000","last_clean":"2023-10-06T02:24:05.890350+0000","last_became_active":"2023-10-06T02:24:05.883917+0000","last_became_peered":"2023-10-06T02:24:05.883917+0000","last_unstale":"2023-10-06T02:24:05.890350+0000","last_undegraded":"2023-10-06T02:24:05.890350+0000","last_fullsized":"2023-10-06T02:24:05.890350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:21.049292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646616+0000","last_change":"2023-10-06T02:24:06.646616+0000","last_active":"2023-10-06T02:24:06.646616+0000","last_peered":"2023-10-06T02:24:06.646616+0000","last_clean":"2023-10-06T02:24:06.646616+0000","last_became_active":"2023-10-06T02:24:06.646337+0000","last_became_peered":"2023-10-06T02:24:06.646337+0000","last_unstale":"2023-10-06T02:24:06.646616+0000","last_undegraded":"2023-10-06T02:24:06.646616+0000","last_fullsized":"2023-10-06T02:24:06.646616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:04.102026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.629034+0000","last_change":"2023-10-06T02:24:05.882056+0000","last_active":"2023-10-06T02:24:06.629034+0000","last_peered":"2023-10-06T02:24:06.629034+0000","last_clean":"2023-10-06T02:24:06.629034+0000","last_became_active":"2023-10-06T02:24:05.881783+0000","last_became_peered":"2023-10-06T02:24:05.881783+0000","last_unstale":"2023-10-06T02:24:06.629034+0000","last_undegraded":"2023-10-06T02:24:06.629034+0000","last_fullsized":"2023-10-06T02:24:06.629034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:55.526523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.645681+0000","last_change":"2023-10-06T02:24:06.637873+0000","last_active":"2023-10-06T02:24:06.645681+0000","last_peered":"2023-10-06T02:24:06.645681+0000","last_clean":"2023-10-06T02:24:06.645681+0000","last_became_active":"2023-10-06T02:24:06.637582+0000","last_became_peered":"2023-10-06T02:24:06.637582+0000","last_unstale":"2023-10-06T02:24:06.645681+0000","last_undegraded":"2023-10-06T02:24:06.645681+0000","last_fullsized":"2023-10-06T02:24:06.645681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:04.102026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.628632+0000","last_change":"2023-10-06T02:24:05.888084+0000","last_active":"2023-10-06T02:24:06.628632+0000","last_peered":"2023-10-06T02:24:06.628632+0000","last_clean":"2023-10-06T02:24:06.628632+0000","last_became_active":"2023-10-06T02:24:05.887834+0000","last_became_peered":"2023-10-06T02:24:05.887834+0000","last_unstale":"2023-10-06T02:24:06.628632+0000","last_undegraded":"2023-10-06T02:24:06.628632+0000","last_fullsized":"2023-10-06T02:24:06.628632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:59.845775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.628466+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:24:06.628466+0000","last_peered":"2023-10-06T02:24:06.628466+0000","last_clean":"2023-10-06T02:24:06.628466+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:24:06.628466+0000","last_undegraded":"2023-10-06T02:24:06.628466+0000","last_fullsized":"2023-10-06T02:24:06.628466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.644417+0000","last_change":"2023-10-06T02:24:06.644417+0000","last_active":"2023-10-06T02:24:06.644417+0000","last_peered":"2023-10-06T02:24:06.644417+0000","last_clean":"2023-10-06T02:24:06.644417+0000","last_became_active":"2023-10-06T02:24:06.644113+0000","last_became_peered":"2023-10-06T02:24:06.644113+0000","last_unstale":"2023-10-06T02:24:06.644417+0000","last_undegraded":"2023-10-06T02:24:06.644417+0000","last_fullsized":"2023-10-06T02:24:06.644417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:54.618077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.887942+0000","last_change":"2023-10-06T02:24:05.885175+0000","last_active":"2023-10-06T02:24:05.887942+0000","last_peered":"2023-10-06T02:24:05.887942+0000","last_clean":"2023-10-06T02:24:05.887942+0000","last_became_active":"2023-10-06T02:24:05.884916+0000","last_became_peered":"2023-10-06T02:24:05.884916+0000","last_unstale":"2023-10-06T02:24:05.887942+0000","last_undegraded":"2023-10-06T02:24:05.887942+0000","last_fullsized":"2023-10-06T02:24:05.887942+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:15.124315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.875755+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:24:05.875755+0000","last_peered":"2023-10-06T02:24:05.875755+0000","last_clean":"2023-10-06T02:24:05.875755+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:24:05.875755+0000","last_undegraded":"2023-10-06T02:24:05.875755+0000","last_fullsized":"2023-10-06T02:24:05.875755+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.647154+0000","last_change":"2023-10-06T02:24:06.647154+0000","last_active":"2023-10-06T02:24:06.647154+0000","last_peered":"2023-10-06T02:24:06.647154+0000","last_clean":"2023-10-06T02:24:06.647154+0000","last_became_active":"2023-10-06T02:24:06.646891+0000","last_became_peered":"2023-10-06T02:24:06.646891+0000","last_unstale":"2023-10-06T02:24:06.647154+0000","last_undegraded":"2023-10-06T02:24:06.647154+0000","last_fullsized":"2023-10-06T02:24:06.647154+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:23.230951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.888707+0000","last_change":"2023-10-06T02:24:05.885173+0000","last_active":"2023-10-06T02:24:06.888707+0000","last_peered":"2023-10-06T02:24:06.888707+0000","last_clean":"2023-10-06T02:24:06.888707+0000","last_became_active":"2023-10-06T02:24:05.884871+0000","last_became_peered":"2023-10-06T02:24:05.884871+0000","last_unstale":"2023-10-06T02:24:06.888707+0000","last_undegraded":"2023-10-06T02:24:06.888707+0000","last_fullsized":"2023-10-06T02:24:06.888707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:21.470756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.873749+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:24:05.873749+0000","last_peered":"2023-10-06T02:24:05.873749+0000","last_clean":"2023-10-06T02:24:05.873749+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:24:05.873749+0000","last_undegraded":"2023-10-06T02:24:05.873749+0000","last_fullsized":"2023-10-06T02:24:05.873749+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.879397+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:24:05.879397+0000","last_peered":"2023-10-06T02:24:05.879397+0000","last_clean":"2023-10-06T02:24:05.879397+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:24:05.879397+0000","last_undegraded":"2023-10-06T02:24:05.879397+0000","last_fullsized":"2023-10-06T02:24:05.879397+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.642216+0000","last_change":"2023-10-06T02:24:06.642216+0000","last_active":"2023-10-06T02:24:06.642216+0000","last_peered":"2023-10-06T02:24:06.642216+0000","last_clean":"2023-10-06T02:24:06.642216+0000","last_became_active":"2023-10-06T02:24:06.641952+0000","last_became_peered":"2023-10-06T02:24:06.641952+0000","last_unstale":"2023-10-06T02:24:06.642216+0000","last_undegraded":"2023-10-06T02:24:06.642216+0000","last_fullsized":"2023-10-06T02:24:06.642216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:45:50.081930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.628551+0000","last_change":"2023-10-06T02:24:05.878711+0000","last_active":"2023-10-06T02:24:06.628551+0000","last_peered":"2023-10-06T02:24:06.628551+0000","last_clean":"2023-10-06T02:24:06.628551+0000","last_became_active":"2023-10-06T02:24:05.878441+0000","last_became_peered":"2023-10-06T02:24:05.878441+0000","last_unstale":"2023-10-06T02:24:06.628551+0000","last_undegraded":"2023-10-06T02:24:06.628551+0000","last_fullsized":"2023-10-06T02:24:06.628551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:16.544997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.880665+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:24:05.880665+0000","last_peered":"2023-10-06T02:24:05.880665+0000","last_clean":"2023-10-06T02:24:05.880665+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:24:05.880665+0000","last_undegraded":"2023-10-06T02:24:05.880665+0000","last_fullsized":"2023-10-06T02:24:05.880665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646890+0000","last_change":"2023-10-06T02:24:06.640211+0000","last_active":"2023-10-06T02:24:06.646890+0000","last_peered":"2023-10-06T02:24:06.646890+0000","last_clean":"2023-10-06T02:24:06.646890+0000","last_became_active":"2023-10-06T02:24:06.639947+0000","last_became_peered":"2023-10-06T02:24:06.639947+0000","last_unstale":"2023-10-06T02:24:06.646890+0000","last_undegraded":"2023-10-06T02:24:06.646890+0000","last_fullsized":"2023-10-06T02:24:06.646890+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:46.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.892908+0000","last_change":"2023-10-06T02:24:05.888495+0000","last_active":"2023-10-06T02:24:05.892908+0000","last_peered":"2023-10-06T02:24:05.892908+0000","last_clean":"2023-10-06T02:24:05.892908+0000","last_became_active":"2023-10-06T02:24:05.888163+0000","last_became_peered":"2023-10-06T02:24:05.888163+0000","last_unstale":"2023-10-06T02:24:05.892908+0000","last_undegraded":"2023-10-06T02:24:05.892908+0000","last_fullsized":"2023-10-06T02:24:05.892908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:31.272836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.879307+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:24:05.879307+0000","last_peered":"2023-10-06T02:24:05.879307+0000","last_clean":"2023-10-06T02:24:05.879307+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:24:05.879307+0000","last_undegraded":"2023-10-06T02:24:05.879307+0000","last_fullsized":"2023-10-06T02:24:05.879307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.640911+0000","last_change":"2023-10-06T02:24:06.640911+0000","last_active":"2023-10-06T02:24:06.640911+0000","last_peered":"2023-10-06T02:24:06.640911+0000","last_clean":"2023-10-06T02:24:06.640911+0000","last_became_active":"2023-10-06T02:24:06.640668+0000","last_became_peered":"2023-10-06T02:24:06.640668+0000","last_unstale":"2023-10-06T02:24:06.640911+0000","last_undegraded":"2023-10-06T02:24:06.640911+0000","last_fullsized":"2023-10-06T02:24:06.640911+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:57.991241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.626662+0000","last_change":"2023-10-06T02:24:05.886578+0000","last_active":"2023-10-06T02:24:06.626662+0000","last_peered":"2023-10-06T02:24:06.626662+0000","last_clean":"2023-10-06T02:24:06.626662+0000","last_became_active":"2023-10-06T02:24:05.886253+0000","last_became_peered":"2023-10-06T02:24:05.886253+0000","last_unstale":"2023-10-06T02:24:06.626662+0000","last_undegraded":"2023-10-06T02:24:06.626662+0000","last_fullsized":"2023-10-06T02:24:06.626662+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:31.272836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.625724+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:24:06.625724+0000","last_peered":"2023-10-06T02:24:06.625724+0000","last_clean":"2023-10-06T02:24:06.625724+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:24:06.625724+0000","last_undegraded":"2023-10-06T02:24:06.625724+0000","last_fullsized":"2023-10-06T02:24:06.625724+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.638813+0000","last_change":"2023-10-06T02:24:06.638813+0000","last_active":"2023-10-06T02:24:06.638813+0000","last_peered":"2023-10-06T02:24:06.638813+0000","last_clean":"2023-10-06T02:24:06.638813+0000","last_became_active":"2023-10-06T02:24:06.638526+0000","last_became_peered":"2023-10-06T02:24:06.638526+0000","last_unstale":"2023-10-06T02:24:06.638813+0000","last_undegraded":"2023-10-06T02:24:06.638813+0000","last_fullsized":"2023-10-06T02:24:06.638813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:28.143952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.892875+0000","last_change":"2023-10-06T02:24:05.887405+0000","last_active":"2023-10-06T02:24:05.892875+0000","last_peered":"2023-10-06T02:24:05.892875+0000","last_clean":"2023-10-06T02:24:05.892875+0000","last_became_active":"2023-10-06T02:24:05.887127+0000","last_became_peered":"2023-10-06T02:24:05.887127+0000","last_unstale":"2023-10-06T02:24:05.892875+0000","last_undegraded":"2023-10-06T02:24:05.892875+0000","last_fullsized":"2023-10-06T02:24:05.892875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:55.526523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.877911+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:24:05.877911+0000","last_peered":"2023-10-06T02:24:05.877911+0000","last_clean":"2023-10-06T02:24:05.877911+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:24:05.877911+0000","last_undegraded":"2023-10-06T02:24:05.877911+0000","last_fullsized":"2023-10-06T02:24:05.877911+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.636087+0000","last_change":"2023-10-06T02:24:06.633584+0000","last_active":"2023-10-06T02:24:06.636087+0000","last_peered":"2023-10-06T02:24:06.636087+0000","last_clean":"2023-10-06T02:24:06.636087+0000","last_became_active":"2023-10-06T02:24:06.633310+0000","last_became_peered":"2023-10-06T02:24:06.633310+0000","last_unstale":"2023-10-06T02:24:06.636087+0000","last_undegraded":"2023-10-06T02:24:06.636087+0000","last_fullsized":"2023-10-06T02:24:06.636087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:28.283593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.626200+0000","last_change":"2023-10-06T02:24:05.882322+0000","last_active":"2023-10-06T02:24:06.626200+0000","last_peered":"2023-10-06T02:24:06.626200+0000","last_clean":"2023-10-06T02:24:06.626200+0000","last_became_active":"2023-10-06T02:24:05.881714+0000","last_became_peered":"2023-10-06T02:24:05.881714+0000","last_unstale":"2023-10-06T02:24:06.626200+0000","last_undegraded":"2023-10-06T02:24:06.626200+0000","last_fullsized":"2023-10-06T02:24:06.626200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:38.482538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.878546+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:24:05.878546+0000","last_peered":"2023-10-06T02:24:05.878546+0000","last_clean":"2023-10-06T02:24:05.878546+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:24:05.878546+0000","last_undegraded":"2023-10-06T02:24:05.878546+0000","last_fullsized":"2023-10-06T02:24:05.878546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":726468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":133695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298200,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073640,"statfs":{"total":96636764160,"available":96331407360,"internally_reserved":0,"allocated":933888,"data_stored":724952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074212,"statfs":{"total":96636764160,"available":96331993088,"internally_reserved":0,"allocated":348160,"data_stored":139816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297632,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074208,"statfs":{"total":96636764160,"available":96331988992,"internally_reserved":0,"allocated":352256,"data_stored":141205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.41999999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.253},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.31900000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.39000000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.625},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.52100000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53700000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.47099999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074212,"statfs":{"total":96636764160,"available":96331993088,"internally_reserved":0,"allocated":348160,"data_stored":134711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074204,"statfs":{"total":96636764160,"available":96331984896,"internally_reserved":0,"allocated":356352,"data_stored":141711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074204,"statfs":{"total":96636764160,"available":96331984896,"internally_reserved":0,"allocated":356352,"data_stored":141247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:24:10.982 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:24:11.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.134+0000 7fabde47c700 1 Processor -- start 2023-10-06T02:24:11.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.134+0000 7fabde47c700 1 -- start start 2023-10-06T02:24:11.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.135+0000 7fabde47c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fabd8140990 0x7fabd80c7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.135+0000 7fabde47c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabd80c9f80 0x7fabd80afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.135+0000 7fabde47c700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd806aa70 con 0x7fabd8140d60 2023-10-06T02:24:11.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.135+0000 7fabde47c700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd80ca4f0 con 0x7fabd8140990 2023-10-06T02:24:11.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.135+0000 7fabde47c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd80ca7d0 con 0x7fabd80c9f80 2023-10-06T02:24:11.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.135+0000 7fabddc7b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fabd8140d60 0x7fabd806c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58142/0 (socket says 172.21.15.37:58142) 2023-10-06T02:24:11.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.135+0000 7fabddc7b700 1 -- 172.21.15.37:0/2556836797 learned_addr learned my addr 172.21.15.37:0/2556836797 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:11.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabdcc79700 1 --2- 172.21.15.37:0/2556836797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabd80c9f80 0x7fabd80afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabdd47a700 1 --2- 172.21.15.37:0/2556836797 >> v2:172.21.15.191:3300/0 conn(0x7fabd8140990 0x7fabd80c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabd7fff700 1 -- 172.21.15.37:0/2556836797 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3750859191 0 0) 0x7fabd806aa70 con 0x7fabd8140d60 2023-10-06T02:24:11.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabd7fff700 1 -- 172.21.15.37:0/2556836797 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabc0003570 con 0x7fabd8140d60 2023-10-06T02:24:11.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabd7fff700 1 -- 172.21.15.37:0/2556836797 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1043903834 0 0) 0x7fabc0003570 con 0x7fabd8140d60 2023-10-06T02:24:11.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabd7fff700 1 -- 172.21.15.37:0/2556836797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabd80c9f80 msgr2=0x7fabd80afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:11.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabd7fff700 1 --2- 172.21.15.37:0/2556836797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabd80c9f80 0x7fabd80afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabd7fff700 1 -- 172.21.15.37:0/2556836797 >> v2:172.21.15.191:3300/0 conn(0x7fabd8140990 msgr2=0x7fabd80c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:11.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabd7fff700 1 --2- 172.21.15.37:0/2556836797 >> v2:172.21.15.191:3300/0 conn(0x7fabd8140990 0x7fabd80c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabd7fff700 1 -- 172.21.15.37:0/2556836797 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd806a420 con 0x7fabd8140d60 2023-10-06T02:24:11.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabd7fff700 1 -- 172.21.15.37:0/2556836797 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7fabc8001470 con 0x7fabd8140d60 2023-10-06T02:24:11.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabd7fff700 1 -- 172.21.15.37:0/2556836797 >> v1:172.21.15.37:6789/0 conn(0x7fabd8140d60 legacy=0x7fabd806c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:11.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabd7fff700 1 --2- 172.21.15.37:0/2556836797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc0003a60 0x7fabc0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabd7fff700 1 --2- 172.21.15.37:0/2556836797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabc0004810 0x7fabc0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabd7fff700 1 --2- 172.21.15.37:0/2556836797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabd80c9f80 0x7fabc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabd7fff700 1 -- 172.21.15.37:0/2556836797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd80ca4f0 con 0x7fabc0003a60 2023-10-06T02:24:11.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabd7fff700 1 -- 172.21.15.37:0/2556836797 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd80ca7d0 con 0x7fabc0004810 2023-10-06T02:24:11.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabd7fff700 1 -- 172.21.15.37:0/2556836797 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc000ba60 con 0x7fabd80c9f80 2023-10-06T02:24:11.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabdd47a700 1 --2- 172.21.15.37:0/2556836797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc0003a60 0x7fabc0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabdcc79700 1 --2- 172.21.15.37:0/2556836797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabc0004810 0x7fabc0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabddc7b700 1 --2- 172.21.15.37:0/2556836797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabd80c9f80 0x7fabc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabdd47a700 1 -- 172.21.15.37:0/2556836797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabd80c9f80 msgr2=0x7fabc00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:11.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabdd47a700 1 --2- 172.21.15.37:0/2556836797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabd80c9f80 0x7fabc00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabdd47a700 1 -- 172.21.15.37:0/2556836797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabc0004810 msgr2=0x7fabc0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:11.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabdd47a700 1 --2- 172.21.15.37:0/2556836797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabc0004810 0x7fabc0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.136+0000 7fabdd47a700 1 -- 172.21.15.37:0/2556836797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc0003570 con 0x7fabc0003a60 2023-10-06T02:24:11.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.137+0000 7fabdd47a700 1 --2- 172.21.15.37:0/2556836797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc0003a60 0x7fabc0003e70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fabd000e240 tx=0x7fabd000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d9a0b55a281aa3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:11.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.137+0000 7fabd7fff700 1 -- 172.21.15.37:0/2556836797 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd000eaf0 con 0x7fabc0003a60 2023-10-06T02:24:11.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.137+0000 7fabd7fff700 1 -- 172.21.15.37:0/2556836797 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd000f040 con 0x7fabc0003a60 2023-10-06T02:24:11.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.137+0000 7fabd7fff700 1 -- 172.21.15.37:0/2556836797 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd000eea0 con 0x7fabc0003a60 2023-10-06T02:24:11.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.137+0000 7fabde47c700 1 -- 172.21.15.37:0/2556836797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc0003a60 msgr2=0x7fabc0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:11.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.137+0000 7fabde47c700 1 --2- 172.21.15.37:0/2556836797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc0003a60 0x7fabc0003e70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fabd000e240 tx=0x7fabd000b040 comp rx=0 tx=0).stop 2023-10-06T02:24:11.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.137+0000 7fabddc7b700 1 -- 172.21.15.37:0/2556836797 reap_dead start 2023-10-06T02:24:11.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.137+0000 7fabde47c700 1 -- 172.21.15.37:0/2556836797 shutdown_connections 2023-10-06T02:24:11.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.137+0000 7fabde47c700 1 -- 172.21.15.37:0/2556836797 >> 172.21.15.37:0/2556836797 conn(0x7fabd806dc90 msgr2=0x7fabd806ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:11.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.137+0000 7fabde47c700 1 -- 172.21.15.37:0/2556836797 shutdown_connections 2023-10-06T02:24:11.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.137+0000 7fabde47c700 1 -- 172.21.15.37:0/2556836797 wait complete. 2023-10-06T02:24:11.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.138+0000 7fabde47c700 1 Processor -- start 2023-10-06T02:24:11.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.138+0000 7fabde47c700 1 -- start start 2023-10-06T02:24:11.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.139+0000 7fabde47c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabc0003a60 0x7fabd813d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.139+0000 7fabde47c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabd80a5490 0x7fabd80a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.139+0000 7fabde47c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabd8159370 0x7fabd81597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.139+0000 7fabde47c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd80a5e40 con 0x7fabd8159370 2023-10-06T02:24:11.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.139+0000 7fabde47c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd80c5650 con 0x7fabc0003a60 2023-10-06T02:24:11.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.139+0000 7fabde47c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd80c49f0 con 0x7fabd80a5490 2023-10-06T02:24:11.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.139+0000 7fabddc7b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabd8159370 0x7fabd81597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.139+0000 7fabddc7b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabd8159370 0x7fabd81597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41388/0 (socket says 172.21.15.37:41388) 2023-10-06T02:24:11.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.139+0000 7fabddc7b700 1 -- 172.21.15.37:0/3142245180 learned_addr learned my addr 172.21.15.37:0/3142245180 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:11.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.140+0000 7fabdcc79700 1 --2- 172.21.15.37:0/3142245180 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabd80a5490 0x7fabd80a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.140+0000 7fabdd47a700 1 --2- 172.21.15.37:0/3142245180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabc0003a60 0x7fabd813d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.140+0000 7fabddc7b700 1 -- 172.21.15.37:0/3142245180 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabd80a5490 msgr2=0x7fabd80a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:11.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.140+0000 7fabddc7b700 1 --2- 172.21.15.37:0/3142245180 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabd80a5490 0x7fabd80a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.140+0000 7fabddc7b700 1 -- 172.21.15.37:0/3142245180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabc0003a60 msgr2=0x7fabd813d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:11.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.140+0000 7fabddc7b700 1 --2- 172.21.15.37:0/3142245180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabc0003a60 0x7fabd813d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.140+0000 7fabddc7b700 1 -- 172.21.15.37:0/3142245180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd80c5040 con 0x7fabd8159370 2023-10-06T02:24:11.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.140+0000 7fabddc7b700 1 --2- 172.21.15.37:0/3142245180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabd8159370 0x7fabd81597d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fabd80c3e80 tx=0x7fabc8001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:11.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.140+0000 7fabd57fa700 1 -- 172.21.15.37:0/3142245180 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8011590 con 0x7fabd8159370 2023-10-06T02:24:11.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.140+0000 7fabd57fa700 1 -- 172.21.15.37:0/3142245180 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc80116f0 con 0x7fabd8159370 2023-10-06T02:24:11.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.140+0000 7fabde47c700 1 -- 172.21.15.37:0/3142245180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd8159d10 con 0x7fabd8159370 2023-10-06T02:24:11.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.140+0000 7fabd57fa700 1 -- 172.21.15.37:0/3142245180 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8011ab0 con 0x7fabd8159370 2023-10-06T02:24:11.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.140+0000 7fabde47c700 1 -- 172.21.15.37:0/3142245180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd80c52e0 con 0x7fabd8159370 2023-10-06T02:24:11.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.141+0000 7fabde47c700 1 -- 172.21.15.37:0/3142245180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd80c5800 con 0x7fabd8159370 2023-10-06T02:24:11.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.141+0000 7fabd57fa700 1 -- 172.21.15.37:0/3142245180 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fabc801d3b0 con 0x7fabd8159370 2023-10-06T02:24:11.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.142+0000 7fabd57fa700 1 --2- 172.21.15.37:0/3142245180 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fabc4066f30 0x7fabc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.142+0000 7fabd57fa700 1 -- 172.21.15.37:0/3142245180 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fabc8084110 con 0x7fabd8159370 2023-10-06T02:24:11.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.142+0000 7fabdd47a700 1 --2- 172.21.15.37:0/3142245180 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fabc4066f30 0x7fabc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.142+0000 7fabdd47a700 1 --2- 172.21.15.37:0/3142245180 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fabc4066f30 0x7fabc40693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009c30 tx=0x7fabd001a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:11.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.146+0000 7fabd57fa700 1 -- 172.21.15.37:0/3142245180 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabd80c5800 con 0x7fabd8159370 2023-10-06T02:24:11.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.336+0000 7fabde47c700 1 -- 172.21.15.37:0/3142245180 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fabd80c5800 con 0x7fabc4066f30 2023-10-06T02:24:11.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.344+0000 7fabd57fa700 1 -- 172.21.15.37:0/3142245180 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289977 (secure 0 0 0) 0x7fabd80c5800 con 0x7fabc4066f30 2023-10-06T02:24:11.349 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:11.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.347+0000 7fabde47c700 1 -- 172.21.15.37:0/3142245180 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fabc4066f30 msgr2=0x7fabc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:11.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.347+0000 7fabde47c700 1 --2- 172.21.15.37:0/3142245180 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fabc4066f30 0x7fabc40693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009c30 tx=0x7fabd001a000 comp rx=0 tx=0).stop 2023-10-06T02:24:11.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.347+0000 7fabde47c700 1 -- 172.21.15.37:0/3142245180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabd8159370 msgr2=0x7fabd81597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:11.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.347+0000 7fabde47c700 1 --2- 172.21.15.37:0/3142245180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabd8159370 0x7fabd81597d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fabd80c3e80 tx=0x7fabc8001e90 comp rx=0 tx=0).stop 2023-10-06T02:24:11.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.347+0000 7fabde47c700 1 -- 172.21.15.37:0/3142245180 shutdown_connections 2023-10-06T02:24:11.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.347+0000 7fabde47c700 1 --2- 172.21.15.37:0/3142245180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabd8159370 0x7fabd81597d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.347+0000 7fabde47c700 1 --2- 172.21.15.37:0/3142245180 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fabc4066f30 0x7fabc40693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.347+0000 7fabde47c700 1 --2- 172.21.15.37:0/3142245180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabc0003a60 0x7fabd813d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.347+0000 7fabde47c700 1 --2- 172.21.15.37:0/3142245180 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabd80a5490 0x7fabd80a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.347+0000 7fabde47c700 1 -- 172.21.15.37:0/3142245180 >> 172.21.15.37:0/3142245180 conn(0x7fabd806dc90 msgr2=0x7fabd80c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:11.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.347+0000 7fabde47c700 1 -- 172.21.15.37:0/3142245180 shutdown_connections 2023-10-06T02:24:11.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.347+0000 7fabde47c700 1 -- 172.21.15.37:0/3142245180 wait complete. 2023-10-06T02:24:11.352 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:24:11.360 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-10-06T02:24:10.521348+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382188,"kb_used_data":3884,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592532,"statfs":{"total":773094113280,"available":770654752768,"internally_reserved":0,"allocated":3977216,"data_stored":2283805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.648554"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.636326+0000","last_change":"2023-10-06T02:24:06.636326+0000","last_active":"2023-10-06T02:24:06.636326+0000","last_peered":"2023-10-06T02:24:06.636326+0000","last_clean":"2023-10-06T02:24:06.636326+0000","last_became_active":"2023-10-06T02:24:06.636044+0000","last_became_peered":"2023-10-06T02:24:06.636044+0000","last_unstale":"2023-10-06T02:24:06.636326+0000","last_undegraded":"2023-10-06T02:24:06.636326+0000","last_fullsized":"2023-10-06T02:24:06.636326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:04.573805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.639220+0000","last_change":"2023-10-06T02:24:06.639220+0000","last_active":"2023-10-06T02:24:06.639220+0000","last_peered":"2023-10-06T02:24:06.639220+0000","last_clean":"2023-10-06T02:24:06.639220+0000","last_became_active":"2023-10-06T02:24:06.638916+0000","last_became_peered":"2023-10-06T02:24:06.638916+0000","last_unstale":"2023-10-06T02:24:06.639220+0000","last_undegraded":"2023-10-06T02:24:06.639220+0000","last_fullsized":"2023-10-06T02:24:06.639220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:18.359433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.636148+0000","last_change":"2023-10-06T02:24:06.633608+0000","last_active":"2023-10-06T02:24:06.636148+0000","last_peered":"2023-10-06T02:24:06.636148+0000","last_clean":"2023-10-06T02:24:06.636148+0000","last_became_active":"2023-10-06T02:24:06.633326+0000","last_became_peered":"2023-10-06T02:24:06.633326+0000","last_unstale":"2023-10-06T02:24:06.636148+0000","last_undegraded":"2023-10-06T02:24:06.636148+0000","last_fullsized":"2023-10-06T02:24:06.636148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:27.744243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.645629+0000","last_change":"2023-10-06T02:24:06.641310+0000","last_active":"2023-10-06T02:24:06.645629+0000","last_peered":"2023-10-06T02:24:06.645629+0000","last_clean":"2023-10-06T02:24:06.645629+0000","last_became_active":"2023-10-06T02:24:06.640943+0000","last_became_peered":"2023-10-06T02:24:06.640943+0000","last_unstale":"2023-10-06T02:24:06.645629+0000","last_undegraded":"2023-10-06T02:24:06.645629+0000","last_fullsized":"2023-10-06T02:24:06.645629+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:32.277470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.645696+0000","last_change":"2023-10-06T02:24:06.642017+0000","last_active":"2023-10-06T02:24:06.645696+0000","last_peered":"2023-10-06T02:24:06.645696+0000","last_clean":"2023-10-06T02:24:06.645696+0000","last_became_active":"2023-10-06T02:24:06.641492+0000","last_became_peered":"2023-10-06T02:24:06.641492+0000","last_unstale":"2023-10-06T02:24:06.645696+0000","last_undegraded":"2023-10-06T02:24:06.645696+0000","last_fullsized":"2023-10-06T02:24:06.645696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:22.053926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.642673+0000","last_change":"2023-10-06T02:24:06.642673+0000","last_active":"2023-10-06T02:24:06.642673+0000","last_peered":"2023-10-06T02:24:06.642673+0000","last_clean":"2023-10-06T02:24:06.642673+0000","last_became_active":"2023-10-06T02:24:06.642414+0000","last_became_peered":"2023-10-06T02:24:06.642414+0000","last_unstale":"2023-10-06T02:24:06.642673+0000","last_undegraded":"2023-10-06T02:24:06.642673+0000","last_fullsized":"2023-10-06T02:24:06.642673+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:16.128949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646734+0000","last_change":"2023-10-06T02:24:06.640066+0000","last_active":"2023-10-06T02:24:06.646734+0000","last_peered":"2023-10-06T02:24:06.646734+0000","last_clean":"2023-10-06T02:24:06.646734+0000","last_became_active":"2023-10-06T02:24:06.639791+0000","last_became_peered":"2023-10-06T02:24:06.639791+0000","last_unstale":"2023-10-06T02:24:06.646734+0000","last_undegraded":"2023-10-06T02:24:06.646734+0000","last_fullsized":"2023-10-06T02:24:06.646734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:04.102026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.637290+0000","last_change":"2023-10-06T02:24:06.637290+0000","last_active":"2023-10-06T02:24:06.637290+0000","last_peered":"2023-10-06T02:24:06.637290+0000","last_clean":"2023-10-06T02:24:06.637290+0000","last_became_active":"2023-10-06T02:24:06.637038+0000","last_became_peered":"2023-10-06T02:24:06.637038+0000","last_unstale":"2023-10-06T02:24:06.637290+0000","last_undegraded":"2023-10-06T02:24:06.637290+0000","last_fullsized":"2023-10-06T02:24:06.637290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:26.428409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.638239+0000","last_change":"2023-10-06T02:24:06.634502+0000","last_active":"2023-10-06T02:24:06.638239+0000","last_peered":"2023-10-06T02:24:06.638239+0000","last_clean":"2023-10-06T02:24:06.638239+0000","last_became_active":"2023-10-06T02:24:06.634245+0000","last_became_peered":"2023-10-06T02:24:06.634245+0000","last_unstale":"2023-10-06T02:24:06.638239+0000","last_undegraded":"2023-10-06T02:24:06.638239+0000","last_fullsized":"2023-10-06T02:24:06.638239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:43.769507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646242+0000","last_change":"2023-10-06T02:24:06.635631+0000","last_active":"2023-10-06T02:24:06.646242+0000","last_peered":"2023-10-06T02:24:06.646242+0000","last_clean":"2023-10-06T02:24:06.646242+0000","last_became_active":"2023-10-06T02:24:06.635375+0000","last_became_peered":"2023-10-06T02:24:06.635375+0000","last_unstale":"2023-10-06T02:24:06.646242+0000","last_undegraded":"2023-10-06T02:24:06.646242+0000","last_fullsized":"2023-10-06T02:24:06.646242+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:45:50.081930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646407+0000","last_change":"2023-10-06T02:24:06.637745+0000","last_active":"2023-10-06T02:24:06.646407+0000","last_peered":"2023-10-06T02:24:06.646407+0000","last_clean":"2023-10-06T02:24:06.646407+0000","last_became_active":"2023-10-06T02:24:06.637437+0000","last_became_peered":"2023-10-06T02:24:06.637437+0000","last_unstale":"2023-10-06T02:24:06.646407+0000","last_undegraded":"2023-10-06T02:24:06.646407+0000","last_fullsized":"2023-10-06T02:24:06.646407+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:03:41.379092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.638268+0000","last_change":"2023-10-06T02:24:06.635693+0000","last_active":"2023-10-06T02:24:06.638268+0000","last_peered":"2023-10-06T02:24:06.638268+0000","last_clean":"2023-10-06T02:24:06.638268+0000","last_became_active":"2023-10-06T02:24:06.635421+0000","last_became_peered":"2023-10-06T02:24:06.635421+0000","last_unstale":"2023-10-06T02:24:06.638268+0000","last_undegraded":"2023-10-06T02:24:06.638268+0000","last_fullsized":"2023-10-06T02:24:06.638268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:44.446270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646389+0000","last_change":"2023-10-06T02:24:06.635838+0000","last_active":"2023-10-06T02:24:06.646389+0000","last_peered":"2023-10-06T02:24:06.646389+0000","last_clean":"2023-10-06T02:24:06.646389+0000","last_became_active":"2023-10-06T02:24:06.635534+0000","last_became_peered":"2023-10-06T02:24:06.635534+0000","last_unstale":"2023-10-06T02:24:06.646389+0000","last_undegraded":"2023-10-06T02:24:06.646389+0000","last_fullsized":"2023-10-06T02:24:06.646389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:43.769507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.645662+0000","last_change":"2023-10-06T02:24:06.637840+0000","last_active":"2023-10-06T02:24:06.645662+0000","last_peered":"2023-10-06T02:24:06.645662+0000","last_clean":"2023-10-06T02:24:06.645662+0000","last_became_active":"2023-10-06T02:24:06.637570+0000","last_became_peered":"2023-10-06T02:24:06.637570+0000","last_unstale":"2023-10-06T02:24:06.645662+0000","last_undegraded":"2023-10-06T02:24:06.645662+0000","last_fullsized":"2023-10-06T02:24:06.645662+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:18.359433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646250+0000","last_change":"2023-10-06T02:24:06.635717+0000","last_active":"2023-10-06T02:24:06.646250+0000","last_peered":"2023-10-06T02:24:06.646250+0000","last_clean":"2023-10-06T02:24:06.646250+0000","last_became_active":"2023-10-06T02:24:06.635450+0000","last_became_peered":"2023-10-06T02:24:06.635450+0000","last_unstale":"2023-10-06T02:24:06.646250+0000","last_undegraded":"2023-10-06T02:24:06.646250+0000","last_fullsized":"2023-10-06T02:24:06.646250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:12.339691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.644957+0000","last_change":"2023-10-06T02:24:06.644957+0000","last_active":"2023-10-06T02:24:06.644957+0000","last_peered":"2023-10-06T02:24:06.644957+0000","last_clean":"2023-10-06T02:24:06.644957+0000","last_became_active":"2023-10-06T02:24:06.644693+0000","last_became_peered":"2023-10-06T02:24:06.644693+0000","last_unstale":"2023-10-06T02:24:06.644957+0000","last_undegraded":"2023-10-06T02:24:06.644957+0000","last_fullsized":"2023-10-06T02:24:06.644957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:53.101590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.644689+0000","last_change":"2023-10-06T02:24:06.644689+0000","last_active":"2023-10-06T02:24:06.644689+0000","last_peered":"2023-10-06T02:24:06.644689+0000","last_clean":"2023-10-06T02:24:06.644689+0000","last_became_active":"2023-10-06T02:24:06.644444+0000","last_became_peered":"2023-10-06T02:24:06.644444+0000","last_unstale":"2023-10-06T02:24:06.644689+0000","last_undegraded":"2023-10-06T02:24:06.644689+0000","last_fullsized":"2023-10-06T02:24:06.644689+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:00.850409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.642377+0000","last_change":"2023-10-06T02:24:06.642377+0000","last_active":"2023-10-06T02:24:06.642377+0000","last_peered":"2023-10-06T02:24:06.642377+0000","last_clean":"2023-10-06T02:24:06.642377+0000","last_became_active":"2023-10-06T02:24:06.641848+0000","last_became_peered":"2023-10-06T02:24:06.641848+0000","last_unstale":"2023-10-06T02:24:06.642377+0000","last_undegraded":"2023-10-06T02:24:06.642377+0000","last_fullsized":"2023-10-06T02:24:06.642377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:39.487172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646046+0000","last_change":"2023-10-06T02:24:06.643920+0000","last_active":"2023-10-06T02:24:06.646046+0000","last_peered":"2023-10-06T02:24:06.646046+0000","last_clean":"2023-10-06T02:24:06.646046+0000","last_became_active":"2023-10-06T02:24:06.643579+0000","last_became_peered":"2023-10-06T02:24:06.643579+0000","last_unstale":"2023-10-06T02:24:06.646046+0000","last_undegraded":"2023-10-06T02:24:06.646046+0000","last_fullsized":"2023-10-06T02:24:06.646046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:43.140326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646437+0000","last_change":"2023-10-06T02:24:06.646437+0000","last_active":"2023-10-06T02:24:06.646437+0000","last_peered":"2023-10-06T02:24:06.646437+0000","last_clean":"2023-10-06T02:24:06.646437+0000","last_became_active":"2023-10-06T02:24:06.646119+0000","last_became_peered":"2023-10-06T02:24:06.646119+0000","last_unstale":"2023-10-06T02:24:06.646437+0000","last_undegraded":"2023-10-06T02:24:06.646437+0000","last_fullsized":"2023-10-06T02:24:06.646437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:32.277470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646646+0000","last_change":"2023-10-06T02:24:06.637913+0000","last_active":"2023-10-06T02:24:06.646646+0000","last_peered":"2023-10-06T02:24:06.646646+0000","last_clean":"2023-10-06T02:24:06.646646+0000","last_became_active":"2023-10-06T02:24:06.637656+0000","last_became_peered":"2023-10-06T02:24:06.637656+0000","last_unstale":"2023-10-06T02:24:06.646646+0000","last_undegraded":"2023-10-06T02:24:06.646646+0000","last_fullsized":"2023-10-06T02:24:06.646646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:33:33.875455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.645697+0000","last_change":"2023-10-06T02:24:06.639412+0000","last_active":"2023-10-06T02:24:06.645697+0000","last_peered":"2023-10-06T02:24:06.645697+0000","last_clean":"2023-10-06T02:24:06.645697+0000","last_became_active":"2023-10-06T02:24:06.639245+0000","last_became_peered":"2023-10-06T02:24:06.639245+0000","last_unstale":"2023-10-06T02:24:06.645697+0000","last_undegraded":"2023-10-06T02:24:06.645697+0000","last_fullsized":"2023-10-06T02:24:06.645697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:03:41.379092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.638544+0000","last_change":"2023-10-06T02:24:06.638544+0000","last_active":"2023-10-06T02:24:06.638544+0000","last_peered":"2023-10-06T02:24:06.638544+0000","last_clean":"2023-10-06T02:24:06.638544+0000","last_became_active":"2023-10-06T02:24:06.638159+0000","last_became_peered":"2023-10-06T02:24:06.638159+0000","last_unstale":"2023-10-06T02:24:06.638544+0000","last_undegraded":"2023-10-06T02:24:06.638544+0000","last_fullsized":"2023-10-06T02:24:06.638544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:43.769507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.648152+0000","last_change":"2023-10-06T02:24:06.646641+0000","last_active":"2023-10-06T02:24:06.648152+0000","last_peered":"2023-10-06T02:24:06.648152+0000","last_clean":"2023-10-06T02:24:06.648152+0000","last_became_active":"2023-10-06T02:24:06.646390+0000","last_became_peered":"2023-10-06T02:24:06.646390+0000","last_unstale":"2023-10-06T02:24:06.648152+0000","last_undegraded":"2023-10-06T02:24:06.648152+0000","last_fullsized":"2023-10-06T02:24:06.648152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:00.902536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.637249+0000","last_change":"2023-10-06T02:24:06.637249+0000","last_active":"2023-10-06T02:24:06.637249+0000","last_peered":"2023-10-06T02:24:06.637249+0000","last_clean":"2023-10-06T02:24:06.637249+0000","last_became_active":"2023-10-06T02:24:06.636958+0000","last_became_peered":"2023-10-06T02:24:06.636958+0000","last_unstale":"2023-10-06T02:24:06.637249+0000","last_undegraded":"2023-10-06T02:24:06.637249+0000","last_fullsized":"2023-10-06T02:24:06.637249+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:00.902536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.647034+0000","last_change":"2023-10-06T02:24:06.647034+0000","last_active":"2023-10-06T02:24:06.647034+0000","last_peered":"2023-10-06T02:24:06.647034+0000","last_clean":"2023-10-06T02:24:06.647034+0000","last_became_active":"2023-10-06T02:24:06.646809+0000","last_became_peered":"2023-10-06T02:24:06.646809+0000","last_unstale":"2023-10-06T02:24:06.647034+0000","last_undegraded":"2023-10-06T02:24:06.647034+0000","last_fullsized":"2023-10-06T02:24:06.647034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:55.038619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.640605+0000","last_change":"2023-10-06T02:24:06.640605+0000","last_active":"2023-10-06T02:24:06.640605+0000","last_peered":"2023-10-06T02:24:06.640605+0000","last_clean":"2023-10-06T02:24:06.640605+0000","last_became_active":"2023-10-06T02:24:06.640214+0000","last_became_peered":"2023-10-06T02:24:06.640214+0000","last_unstale":"2023-10-06T02:24:06.640605+0000","last_undegraded":"2023-10-06T02:24:06.640605+0000","last_fullsized":"2023-10-06T02:24:06.640605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:19:43.140326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646499+0000","last_change":"2023-10-06T02:24:06.638557+0000","last_active":"2023-10-06T02:24:06.646499+0000","last_peered":"2023-10-06T02:24:06.646499+0000","last_clean":"2023-10-06T02:24:06.646499+0000","last_became_active":"2023-10-06T02:24:06.638268+0000","last_became_peered":"2023-10-06T02:24:06.638268+0000","last_unstale":"2023-10-06T02:24:06.646499+0000","last_undegraded":"2023-10-06T02:24:06.646499+0000","last_fullsized":"2023-10-06T02:24:06.646499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:04.573805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.639257+0000","last_change":"2023-10-06T02:24:06.639257+0000","last_active":"2023-10-06T02:24:06.639257+0000","last_peered":"2023-10-06T02:24:06.639257+0000","last_clean":"2023-10-06T02:24:06.639257+0000","last_became_active":"2023-10-06T02:24:06.639010+0000","last_became_peered":"2023-10-06T02:24:06.639010+0000","last_unstale":"2023-10-06T02:24:06.639257+0000","last_undegraded":"2023-10-06T02:24:06.639257+0000","last_fullsized":"2023-10-06T02:24:06.639257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:22.053926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.637795+0000","last_change":"2023-10-06T02:24:06.637795+0000","last_active":"2023-10-06T02:24:06.637795+0000","last_peered":"2023-10-06T02:24:06.637795+0000","last_clean":"2023-10-06T02:24:06.637795+0000","last_became_active":"2023-10-06T02:24:06.637548+0000","last_became_peered":"2023-10-06T02:24:06.637548+0000","last_unstale":"2023-10-06T02:24:06.637795+0000","last_undegraded":"2023-10-06T02:24:06.637795+0000","last_fullsized":"2023-10-06T02:24:06.637795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:22.475390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.638964+0000","last_change":"2023-10-06T02:24:06.638964+0000","last_active":"2023-10-06T02:24:06.638964+0000","last_peered":"2023-10-06T02:24:06.638964+0000","last_clean":"2023-10-06T02:24:06.638964+0000","last_became_active":"2023-10-06T02:24:06.638696+0000","last_became_peered":"2023-10-06T02:24:06.638696+0000","last_unstale":"2023-10-06T02:24:06.638964+0000","last_undegraded":"2023-10-06T02:24:06.638964+0000","last_fullsized":"2023-10-06T02:24:06.638964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:28.283593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.638908+0000","last_change":"2023-10-06T02:24:06.638908+0000","last_active":"2023-10-06T02:24:06.638908+0000","last_peered":"2023-10-06T02:24:06.638908+0000","last_clean":"2023-10-06T02:24:06.638908+0000","last_became_active":"2023-10-06T02:24:06.638611+0000","last_became_peered":"2023-10-06T02:24:06.638611+0000","last_unstale":"2023-10-06T02:24:06.638908+0000","last_undegraded":"2023-10-06T02:24:06.638908+0000","last_fullsized":"2023-10-06T02:24:06.638908+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:06.568329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.643121+0000","last_change":"2023-10-06T02:24:06.643121+0000","last_active":"2023-10-06T02:24:06.643121+0000","last_peered":"2023-10-06T02:24:06.643121+0000","last_clean":"2023-10-06T02:24:06.643121+0000","last_became_active":"2023-10-06T02:24:06.642886+0000","last_became_peered":"2023-10-06T02:24:06.642886+0000","last_unstale":"2023-10-06T02:24:06.643121+0000","last_undegraded":"2023-10-06T02:24:06.643121+0000","last_fullsized":"2023-10-06T02:24:06.643121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:27.744243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"30'4","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.887699+0000","last_change":"2023-10-06T02:24:05.891640+0000","last_active":"2023-10-06T02:24:06.887699+0000","last_peered":"2023-10-06T02:24:06.887699+0000","last_clean":"2023-10-06T02:24:06.887699+0000","last_became_active":"2023-10-06T02:24:05.891345+0000","last_became_peered":"2023-10-06T02:24:05.891345+0000","last_unstale":"2023-10-06T02:24:06.887699+0000","last_undegraded":"2023-10-06T02:24:06.887699+0000","last_fullsized":"2023-10-06T02:24:06.887699+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:58.807876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.647157+0000","last_change":"2023-10-06T02:24:06.647157+0000","last_active":"2023-10-06T02:24:06.647157+0000","last_peered":"2023-10-06T02:24:06.647157+0000","last_clean":"2023-10-06T02:24:06.647157+0000","last_became_active":"2023-10-06T02:24:06.646897+0000","last_became_peered":"2023-10-06T02:24:06.646897+0000","last_unstale":"2023-10-06T02:24:06.647157+0000","last_undegraded":"2023-10-06T02:24:06.647157+0000","last_fullsized":"2023-10-06T02:24:06.647157+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:50.077514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.884547+0000","last_change":"2023-10-06T02:24:05.881403+0000","last_active":"2023-10-06T02:24:06.884547+0000","last_peered":"2023-10-06T02:24:06.884547+0000","last_clean":"2023-10-06T02:24:06.884547+0000","last_became_active":"2023-10-06T02:24:05.880998+0000","last_became_peered":"2023-10-06T02:24:05.880998+0000","last_unstale":"2023-10-06T02:24:06.884547+0000","last_undegraded":"2023-10-06T02:24:06.884547+0000","last_fullsized":"2023-10-06T02:24:06.884547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:53.273164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.648417+0000","last_change":"2023-10-06T02:24:06.640859+0000","last_active":"2023-10-06T02:24:06.648417+0000","last_peered":"2023-10-06T02:24:06.648417+0000","last_clean":"2023-10-06T02:24:06.648417+0000","last_became_active":"2023-10-06T02:24:06.640587+0000","last_became_peered":"2023-10-06T02:24:06.640587+0000","last_unstale":"2023-10-06T02:24:06.648417+0000","last_undegraded":"2023-10-06T02:24:06.648417+0000","last_fullsized":"2023-10-06T02:24:06.648417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:04.573805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.887373+0000","last_change":"2023-10-06T02:24:05.892267+0000","last_active":"2023-10-06T02:24:06.887373+0000","last_peered":"2023-10-06T02:24:06.887373+0000","last_clean":"2023-10-06T02:24:06.887373+0000","last_became_active":"2023-10-06T02:24:05.892016+0000","last_became_peered":"2023-10-06T02:24:05.892016+0000","last_unstale":"2023-10-06T02:24:06.887373+0000","last_undegraded":"2023-10-06T02:24:06.887373+0000","last_fullsized":"2023-10-06T02:24:06.887373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:58:35.085178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.637858+0000","last_change":"2023-10-06T02:24:06.637858+0000","last_active":"2023-10-06T02:24:06.637858+0000","last_peered":"2023-10-06T02:24:06.637858+0000","last_clean":"2023-10-06T02:24:06.637858+0000","last_became_active":"2023-10-06T02:24:06.637600+0000","last_became_peered":"2023-10-06T02:24:06.637600+0000","last_unstale":"2023-10-06T02:24:06.637858+0000","last_undegraded":"2023-10-06T02:24:06.637858+0000","last_fullsized":"2023-10-06T02:24:06.637858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:12.339691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.887014+0000","last_change":"2023-10-06T02:24:05.890180+0000","last_active":"2023-10-06T02:24:06.887014+0000","last_peered":"2023-10-06T02:24:06.887014+0000","last_clean":"2023-10-06T02:24:06.887014+0000","last_became_active":"2023-10-06T02:24:05.889894+0000","last_became_peered":"2023-10-06T02:24:05.889894+0000","last_unstale":"2023-10-06T02:24:06.887014+0000","last_undegraded":"2023-10-06T02:24:06.887014+0000","last_fullsized":"2023-10-06T02:24:06.887014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:43.441636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.645522+0000","last_change":"2023-10-06T02:24:06.639593+0000","last_active":"2023-10-06T02:24:06.645522+0000","last_peered":"2023-10-06T02:24:06.645522+0000","last_clean":"2023-10-06T02:24:06.645522+0000","last_became_active":"2023-10-06T02:24:06.639099+0000","last_became_peered":"2023-10-06T02:24:06.639099+0000","last_unstale":"2023-10-06T02:24:06.645522+0000","last_undegraded":"2023-10-06T02:24:06.645522+0000","last_fullsized":"2023-10-06T02:24:06.645522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:45:50.081930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.884342+0000","last_change":"2023-10-06T02:24:05.879335+0000","last_active":"2023-10-06T02:24:06.884342+0000","last_peered":"2023-10-06T02:24:06.884342+0000","last_clean":"2023-10-06T02:24:06.884342+0000","last_became_active":"2023-10-06T02:24:05.878162+0000","last_became_peered":"2023-10-06T02:24:05.878162+0000","last_unstale":"2023-10-06T02:24:06.884342+0000","last_undegraded":"2023-10-06T02:24:06.884342+0000","last_fullsized":"2023-10-06T02:24:06.884342+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:53.273164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.647219+0000","last_change":"2023-10-06T02:24:06.641173+0000","last_active":"2023-10-06T02:24:06.647219+0000","last_peered":"2023-10-06T02:24:06.647219+0000","last_clean":"2023-10-06T02:24:06.647219+0000","last_became_active":"2023-10-06T02:24:06.640877+0000","last_became_peered":"2023-10-06T02:24:06.640877+0000","last_unstale":"2023-10-06T02:24:06.647219+0000","last_undegraded":"2023-10-06T02:24:06.647219+0000","last_fullsized":"2023-10-06T02:24:06.647219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:23.320138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"30'1","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.630871+0000","last_change":"2023-10-06T02:24:05.890651+0000","last_active":"2023-10-06T02:24:06.630871+0000","last_peered":"2023-10-06T02:24:06.630871+0000","last_clean":"2023-10-06T02:24:06.630871+0000","last_became_active":"2023-10-06T02:24:05.890361+0000","last_became_peered":"2023-10-06T02:24:05.890361+0000","last_unstale":"2023-10-06T02:24:06.630871+0000","last_undegraded":"2023-10-06T02:24:06.630871+0000","last_fullsized":"2023-10-06T02:24:06.630871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:57.092721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.645640+0000","last_change":"2023-10-06T02:24:06.636512+0000","last_active":"2023-10-06T02:24:06.645640+0000","last_peered":"2023-10-06T02:24:06.645640+0000","last_clean":"2023-10-06T02:24:06.645640+0000","last_became_active":"2023-10-06T02:24:06.636209+0000","last_became_peered":"2023-10-06T02:24:06.636209+0000","last_unstale":"2023-10-06T02:24:06.645640+0000","last_undegraded":"2023-10-06T02:24:06.645640+0000","last_fullsized":"2023-10-06T02:24:06.645640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:46.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.887911+0000","last_change":"2023-10-06T02:24:05.886105+0000","last_active":"2023-10-06T02:24:05.887911+0000","last_peered":"2023-10-06T02:24:05.887911+0000","last_clean":"2023-10-06T02:24:05.887911+0000","last_became_active":"2023-10-06T02:24:05.885859+0000","last_became_peered":"2023-10-06T02:24:05.885859+0000","last_unstale":"2023-10-06T02:24:05.887911+0000","last_undegraded":"2023-10-06T02:24:05.887911+0000","last_fullsized":"2023-10-06T02:24:05.887911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:57.092721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646604+0000","last_change":"2023-10-06T02:24:06.646604+0000","last_active":"2023-10-06T02:24:06.646604+0000","last_peered":"2023-10-06T02:24:06.646604+0000","last_clean":"2023-10-06T02:24:06.646604+0000","last_became_active":"2023-10-06T02:24:06.646325+0000","last_became_peered":"2023-10-06T02:24:06.646325+0000","last_unstale":"2023-10-06T02:24:06.646604+0000","last_undegraded":"2023-10-06T02:24:06.646604+0000","last_fullsized":"2023-10-06T02:24:06.646604+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:20.764470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.628413+0000","last_change":"2023-10-06T02:24:05.890192+0000","last_active":"2023-10-06T02:24:06.628413+0000","last_peered":"2023-10-06T02:24:06.628413+0000","last_clean":"2023-10-06T02:24:06.628413+0000","last_became_active":"2023-10-06T02:24:05.889910+0000","last_became_peered":"2023-10-06T02:24:05.889910+0000","last_unstale":"2023-10-06T02:24:06.628413+0000","last_undegraded":"2023-10-06T02:24:06.628413+0000","last_fullsized":"2023-10-06T02:24:06.628413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:59.554515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.645604+0000","last_change":"2023-10-06T02:24:06.641295+0000","last_active":"2023-10-06T02:24:06.645604+0000","last_peered":"2023-10-06T02:24:06.645604+0000","last_clean":"2023-10-06T02:24:06.645604+0000","last_became_active":"2023-10-06T02:24:06.640940+0000","last_became_peered":"2023-10-06T02:24:06.640940+0000","last_unstale":"2023-10-06T02:24:06.645604+0000","last_undegraded":"2023-10-06T02:24:06.645604+0000","last_fullsized":"2023-10-06T02:24:06.645604+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:22.475390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.887857+0000","last_change":"2023-10-06T02:24:05.885620+0000","last_active":"2023-10-06T02:24:05.887857+0000","last_peered":"2023-10-06T02:24:05.887857+0000","last_clean":"2023-10-06T02:24:05.887857+0000","last_became_active":"2023-10-06T02:24:05.885014+0000","last_became_peered":"2023-10-06T02:24:05.885014+0000","last_unstale":"2023-10-06T02:24:05.887857+0000","last_undegraded":"2023-10-06T02:24:05.887857+0000","last_fullsized":"2023-10-06T02:24:05.887857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:49.072880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.642089+0000","last_change":"2023-10-06T02:24:06.642089+0000","last_active":"2023-10-06T02:24:06.642089+0000","last_peered":"2023-10-06T02:24:06.642089+0000","last_clean":"2023-10-06T02:24:06.642089+0000","last_became_active":"2023-10-06T02:24:06.641613+0000","last_became_peered":"2023-10-06T02:24:06.641613+0000","last_unstale":"2023-10-06T02:24:06.642089+0000","last_undegraded":"2023-10-06T02:24:06.642089+0000","last_fullsized":"2023-10-06T02:24:06.642089+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:33:33.875455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.625816+0000","last_change":"2023-10-06T02:24:05.885153+0000","last_active":"2023-10-06T02:24:06.625816+0000","last_peered":"2023-10-06T02:24:06.625816+0000","last_clean":"2023-10-06T02:24:06.625816+0000","last_became_active":"2023-10-06T02:24:05.884873+0000","last_became_peered":"2023-10-06T02:24:05.884873+0000","last_unstale":"2023-10-06T02:24:06.625816+0000","last_undegraded":"2023-10-06T02:24:06.625816+0000","last_fullsized":"2023-10-06T02:24:06.625816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:38.482538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.638255+0000","last_change":"2023-10-06T02:24:06.635483+0000","last_active":"2023-10-06T02:24:06.638255+0000","last_peered":"2023-10-06T02:24:06.638255+0000","last_clean":"2023-10-06T02:24:06.638255+0000","last_became_active":"2023-10-06T02:24:06.635248+0000","last_became_peered":"2023-10-06T02:24:06.635248+0000","last_unstale":"2023-10-06T02:24:06.638255+0000","last_undegraded":"2023-10-06T02:24:06.638255+0000","last_fullsized":"2023-10-06T02:24:06.638255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:53.101590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"30'3","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.885656+0000","last_change":"2023-10-06T02:24:05.888093+0000","last_active":"2023-10-06T02:24:06.885656+0000","last_peered":"2023-10-06T02:24:06.885656+0000","last_clean":"2023-10-06T02:24:06.885656+0000","last_became_active":"2023-10-06T02:24:05.887797+0000","last_became_peered":"2023-10-06T02:24:05.887797+0000","last_unstale":"2023-10-06T02:24:06.885656+0000","last_undegraded":"2023-10-06T02:24:06.885656+0000","last_fullsized":"2023-10-06T02:24:06.885656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:31.272836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.648304+0000","last_change":"2023-10-06T02:24:06.639820+0000","last_active":"2023-10-06T02:24:06.648304+0000","last_peered":"2023-10-06T02:24:06.648304+0000","last_clean":"2023-10-06T02:24:06.648304+0000","last_became_active":"2023-10-06T02:24:06.639564+0000","last_became_peered":"2023-10-06T02:24:06.639564+0000","last_unstale":"2023-10-06T02:24:06.648304+0000","last_undegraded":"2023-10-06T02:24:06.648304+0000","last_fullsized":"2023-10-06T02:24:06.648304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:23.320138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"30'6","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.890549+0000","last_change":"2023-10-06T02:24:05.885379+0000","last_active":"2023-10-06T02:24:06.890549+0000","last_peered":"2023-10-06T02:24:06.890549+0000","last_clean":"2023-10-06T02:24:06.890549+0000","last_became_active":"2023-10-06T02:24:05.885113+0000","last_became_peered":"2023-10-06T02:24:05.885113+0000","last_unstale":"2023-10-06T02:24:06.890549+0000","last_undegraded":"2023-10-06T02:24:06.890549+0000","last_fullsized":"2023-10-06T02:24:06.890549+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:22.226316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.636257+0000","last_change":"2023-10-06T02:24:06.633991+0000","last_active":"2023-10-06T02:24:06.636257+0000","last_peered":"2023-10-06T02:24:06.636257+0000","last_clean":"2023-10-06T02:24:06.636257+0000","last_became_active":"2023-10-06T02:24:06.633729+0000","last_became_peered":"2023-10-06T02:24:06.633729+0000","last_unstale":"2023-10-06T02:24:06.636257+0000","last_undegraded":"2023-10-06T02:24:06.636257+0000","last_fullsized":"2023-10-06T02:24:06.636257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:54.618077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.884659+0000","last_change":"2023-10-06T02:24:05.890355+0000","last_active":"2023-10-06T02:24:06.884659+0000","last_peered":"2023-10-06T02:24:06.884659+0000","last_clean":"2023-10-06T02:24:06.884659+0000","last_became_active":"2023-10-06T02:24:05.890011+0000","last_became_peered":"2023-10-06T02:24:05.890011+0000","last_unstale":"2023-10-06T02:24:06.884659+0000","last_undegraded":"2023-10-06T02:24:06.884659+0000","last_fullsized":"2023-10-06T02:24:06.884659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:54.033984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.637879+0000","last_change":"2023-10-06T02:24:06.637879+0000","last_active":"2023-10-06T02:24:06.637879+0000","last_peered":"2023-10-06T02:24:06.637879+0000","last_clean":"2023-10-06T02:24:06.637879+0000","last_became_active":"2023-10-06T02:24:06.637580+0000","last_became_peered":"2023-10-06T02:24:06.637580+0000","last_unstale":"2023-10-06T02:24:06.637879+0000","last_undegraded":"2023-10-06T02:24:06.637879+0000","last_fullsized":"2023-10-06T02:24:06.637879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:23.320138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.887641+0000","last_change":"2023-10-06T02:24:05.884713+0000","last_active":"2023-10-06T02:24:05.887641+0000","last_peered":"2023-10-06T02:24:05.887641+0000","last_clean":"2023-10-06T02:24:05.887641+0000","last_became_active":"2023-10-06T02:24:05.884365+0000","last_became_peered":"2023-10-06T02:24:05.884365+0000","last_unstale":"2023-10-06T02:24:05.887641+0000","last_undegraded":"2023-10-06T02:24:05.887641+0000","last_fullsized":"2023-10-06T02:24:05.887641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:01.750335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.644467+0000","last_change":"2023-10-06T02:24:06.644467+0000","last_active":"2023-10-06T02:24:06.644467+0000","last_peered":"2023-10-06T02:24:06.644467+0000","last_clean":"2023-10-06T02:24:06.644467+0000","last_became_active":"2023-10-06T02:24:06.644142+0000","last_became_peered":"2023-10-06T02:24:06.644142+0000","last_unstale":"2023-10-06T02:24:06.644467+0000","last_undegraded":"2023-10-06T02:24:06.644467+0000","last_fullsized":"2023-10-06T02:24:06.644467+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:56.132640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.892910+0000","last_change":"2023-10-06T02:24:05.888127+0000","last_active":"2023-10-06T02:24:05.892910+0000","last_peered":"2023-10-06T02:24:05.892910+0000","last_clean":"2023-10-06T02:24:05.892910+0000","last_became_active":"2023-10-06T02:24:05.887837+0000","last_became_peered":"2023-10-06T02:24:05.887837+0000","last_unstale":"2023-10-06T02:24:05.892910+0000","last_undegraded":"2023-10-06T02:24:05.892910+0000","last_fullsized":"2023-10-06T02:24:05.892910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:34:05.397936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.637071+0000","last_change":"2023-10-06T02:24:06.637071+0000","last_active":"2023-10-06T02:24:06.637071+0000","last_peered":"2023-10-06T02:24:06.637071+0000","last_clean":"2023-10-06T02:24:06.637071+0000","last_became_active":"2023-10-06T02:24:06.636772+0000","last_became_peered":"2023-10-06T02:24:06.636772+0000","last_unstale":"2023-10-06T02:24:06.637071+0000","last_undegraded":"2023-10-06T02:24:06.637071+0000","last_fullsized":"2023-10-06T02:24:06.637071+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:03:41.379092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'8","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.890619+0000","last_change":"2023-10-06T02:24:05.892127+0000","last_active":"2023-10-06T02:24:06.890619+0000","last_peered":"2023-10-06T02:24:06.890619+0000","last_clean":"2023-10-06T02:24:06.890619+0000","last_became_active":"2023-10-06T02:24:05.891833+0000","last_became_peered":"2023-10-06T02:24:05.891833+0000","last_unstale":"2023-10-06T02:24:06.890619+0000","last_undegraded":"2023-10-06T02:24:06.890619+0000","last_fullsized":"2023-10-06T02:24:06.890619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:21.470756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.638727+0000","last_change":"2023-10-06T02:24:06.638727+0000","last_active":"2023-10-06T02:24:06.638727+0000","last_peered":"2023-10-06T02:24:06.638727+0000","last_clean":"2023-10-06T02:24:06.638727+0000","last_became_active":"2023-10-06T02:24:06.638505+0000","last_became_peered":"2023-10-06T02:24:06.638505+0000","last_unstale":"2023-10-06T02:24:06.638727+0000","last_undegraded":"2023-10-06T02:24:06.638727+0000","last_fullsized":"2023-10-06T02:24:06.638727+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:28.283593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.887473+0000","last_change":"2023-10-06T02:24:05.891230+0000","last_active":"2023-10-06T02:24:06.887473+0000","last_peered":"2023-10-06T02:24:06.887473+0000","last_clean":"2023-10-06T02:24:06.887473+0000","last_became_active":"2023-10-06T02:24:05.890916+0000","last_became_peered":"2023-10-06T02:24:05.890916+0000","last_unstale":"2023-10-06T02:24:06.887473+0000","last_undegraded":"2023-10-06T02:24:06.887473+0000","last_fullsized":"2023-10-06T02:24:06.887473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:05.563695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.647359+0000","last_change":"2023-10-06T02:24:06.641115+0000","last_active":"2023-10-06T02:24:06.647359+0000","last_peered":"2023-10-06T02:24:06.647359+0000","last_clean":"2023-10-06T02:24:06.647359+0000","last_became_active":"2023-10-06T02:24:06.640850+0000","last_became_peered":"2023-10-06T02:24:06.640850+0000","last_unstale":"2023-10-06T02:24:06.647359+0000","last_undegraded":"2023-10-06T02:24:06.647359+0000","last_fullsized":"2023-10-06T02:24:06.647359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:26.428409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.887358+0000","last_change":"2023-10-06T02:24:05.890856+0000","last_active":"2023-10-06T02:24:06.887358+0000","last_peered":"2023-10-06T02:24:06.887358+0000","last_clean":"2023-10-06T02:24:06.887358+0000","last_became_active":"2023-10-06T02:24:05.890579+0000","last_became_peered":"2023-10-06T02:24:05.890579+0000","last_unstale":"2023-10-06T02:24:06.887358+0000","last_undegraded":"2023-10-06T02:24:06.887358+0000","last_fullsized":"2023-10-06T02:24:06.887358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:53.613443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.648441+0000","last_change":"2023-10-06T02:24:06.642965+0000","last_active":"2023-10-06T02:24:06.648441+0000","last_peered":"2023-10-06T02:24:06.648441+0000","last_clean":"2023-10-06T02:24:06.648441+0000","last_became_active":"2023-10-06T02:24:06.642726+0000","last_became_peered":"2023-10-06T02:24:06.642726+0000","last_unstale":"2023-10-06T02:24:06.648441+0000","last_undegraded":"2023-10-06T02:24:06.648441+0000","last_fullsized":"2023-10-06T02:24:06.648441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:20.764470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.887468+0000","last_change":"2023-10-06T02:24:05.882616+0000","last_active":"2023-10-06T02:24:06.887468+0000","last_peered":"2023-10-06T02:24:06.887468+0000","last_clean":"2023-10-06T02:24:06.887468+0000","last_became_active":"2023-10-06T02:24:05.882361+0000","last_became_peered":"2023-10-06T02:24:05.882361+0000","last_unstale":"2023-10-06T02:24:06.887468+0000","last_undegraded":"2023-10-06T02:24:06.887468+0000","last_fullsized":"2023-10-06T02:24:06.887468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:57.109787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.645619+0000","last_change":"2023-10-06T02:24:06.641427+0000","last_active":"2023-10-06T02:24:06.645619+0000","last_peered":"2023-10-06T02:24:06.645619+0000","last_clean":"2023-10-06T02:24:06.645619+0000","last_became_active":"2023-10-06T02:24:06.640756+0000","last_became_peered":"2023-10-06T02:24:06.640756+0000","last_unstale":"2023-10-06T02:24:06.645619+0000","last_undegraded":"2023-10-06T02:24:06.645619+0000","last_fullsized":"2023-10-06T02:24:06.645619+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:58.097355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.893261+0000","last_change":"2023-10-06T02:24:05.890722+0000","last_active":"2023-10-06T02:24:05.893261+0000","last_peered":"2023-10-06T02:24:05.893261+0000","last_clean":"2023-10-06T02:24:05.893261+0000","last_became_active":"2023-10-06T02:24:05.890423+0000","last_became_peered":"2023-10-06T02:24:05.890423+0000","last_unstale":"2023-10-06T02:24:05.893261+0000","last_undegraded":"2023-10-06T02:24:05.893261+0000","last_fullsized":"2023-10-06T02:24:05.893261+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:30.556061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.645627+0000","last_change":"2023-10-06T02:24:06.645627+0000","last_active":"2023-10-06T02:24:06.645627+0000","last_peered":"2023-10-06T02:24:06.645627+0000","last_clean":"2023-10-06T02:24:06.645627+0000","last_became_active":"2023-10-06T02:24:06.645247+0000","last_became_peered":"2023-10-06T02:24:06.645247+0000","last_unstale":"2023-10-06T02:24:06.645627+0000","last_undegraded":"2023-10-06T02:24:06.645627+0000","last_fullsized":"2023-10-06T02:24:06.645627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:46.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.884325+0000","last_change":"2023-10-06T02:24:05.877336+0000","last_active":"2023-10-06T02:24:06.884325+0000","last_peered":"2023-10-06T02:24:06.884325+0000","last_clean":"2023-10-06T02:24:06.884325+0000","last_became_active":"2023-10-06T02:24:05.877056+0000","last_became_peered":"2023-10-06T02:24:05.877056+0000","last_unstale":"2023-10-06T02:24:06.884325+0000","last_undegraded":"2023-10-06T02:24:06.884325+0000","last_fullsized":"2023-10-06T02:24:06.884325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:19:58.807876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.639173+0000","last_change":"2023-10-06T02:24:06.635697+0000","last_active":"2023-10-06T02:24:06.639173+0000","last_peered":"2023-10-06T02:24:06.639173+0000","last_clean":"2023-10-06T02:24:06.639173+0000","last_became_active":"2023-10-06T02:24:06.635240+0000","last_became_peered":"2023-10-06T02:24:06.635240+0000","last_unstale":"2023-10-06T02:24:06.639173+0000","last_undegraded":"2023-10-06T02:24:06.639173+0000","last_fullsized":"2023-10-06T02:24:06.639173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:56.132640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.628512+0000","last_change":"2023-10-06T02:24:05.888389+0000","last_active":"2023-10-06T02:24:06.628512+0000","last_peered":"2023-10-06T02:24:06.628512+0000","last_clean":"2023-10-06T02:24:06.628512+0000","last_became_active":"2023-10-06T02:24:05.887986+0000","last_became_peered":"2023-10-06T02:24:05.887986+0000","last_unstale":"2023-10-06T02:24:06.628512+0000","last_undegraded":"2023-10-06T02:24:06.628512+0000","last_fullsized":"2023-10-06T02:24:06.628512+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:37.984772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646556+0000","last_change":"2023-10-06T02:24:06.638463+0000","last_active":"2023-10-06T02:24:06.646556+0000","last_peered":"2023-10-06T02:24:06.646556+0000","last_clean":"2023-10-06T02:24:06.646556+0000","last_became_active":"2023-10-06T02:24:06.638189+0000","last_became_peered":"2023-10-06T02:24:06.638189+0000","last_unstale":"2023-10-06T02:24:06.646556+0000","last_undegraded":"2023-10-06T02:24:06.646556+0000","last_fullsized":"2023-10-06T02:24:06.646556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:28.283593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.890350+0000","last_change":"2023-10-06T02:24:05.884238+0000","last_active":"2023-10-06T02:24:05.890350+0000","last_peered":"2023-10-06T02:24:05.890350+0000","last_clean":"2023-10-06T02:24:05.890350+0000","last_became_active":"2023-10-06T02:24:05.883917+0000","last_became_peered":"2023-10-06T02:24:05.883917+0000","last_unstale":"2023-10-06T02:24:05.890350+0000","last_undegraded":"2023-10-06T02:24:05.890350+0000","last_fullsized":"2023-10-06T02:24:05.890350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:25:21.049292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646616+0000","last_change":"2023-10-06T02:24:06.646616+0000","last_active":"2023-10-06T02:24:06.646616+0000","last_peered":"2023-10-06T02:24:06.646616+0000","last_clean":"2023-10-06T02:24:06.646616+0000","last_became_active":"2023-10-06T02:24:06.646337+0000","last_became_peered":"2023-10-06T02:24:06.646337+0000","last_unstale":"2023-10-06T02:24:06.646616+0000","last_undegraded":"2023-10-06T02:24:06.646616+0000","last_fullsized":"2023-10-06T02:24:06.646616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:04.102026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.629034+0000","last_change":"2023-10-06T02:24:05.882056+0000","last_active":"2023-10-06T02:24:06.629034+0000","last_peered":"2023-10-06T02:24:06.629034+0000","last_clean":"2023-10-06T02:24:06.629034+0000","last_became_active":"2023-10-06T02:24:05.881783+0000","last_became_peered":"2023-10-06T02:24:05.881783+0000","last_unstale":"2023-10-06T02:24:06.629034+0000","last_undegraded":"2023-10-06T02:24:06.629034+0000","last_fullsized":"2023-10-06T02:24:06.629034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:55.526523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.645681+0000","last_change":"2023-10-06T02:24:06.637873+0000","last_active":"2023-10-06T02:24:06.645681+0000","last_peered":"2023-10-06T02:24:06.645681+0000","last_clean":"2023-10-06T02:24:06.645681+0000","last_became_active":"2023-10-06T02:24:06.637582+0000","last_became_peered":"2023-10-06T02:24:06.637582+0000","last_unstale":"2023-10-06T02:24:06.645681+0000","last_undegraded":"2023-10-06T02:24:06.645681+0000","last_fullsized":"2023-10-06T02:24:06.645681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:04.102026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.628632+0000","last_change":"2023-10-06T02:24:05.888084+0000","last_active":"2023-10-06T02:24:06.628632+0000","last_peered":"2023-10-06T02:24:06.628632+0000","last_clean":"2023-10-06T02:24:06.628632+0000","last_became_active":"2023-10-06T02:24:05.887834+0000","last_became_peered":"2023-10-06T02:24:05.887834+0000","last_unstale":"2023-10-06T02:24:06.628632+0000","last_undegraded":"2023-10-06T02:24:06.628632+0000","last_fullsized":"2023-10-06T02:24:06.628632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:59.845775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.628466+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:24:06.628466+0000","last_peered":"2023-10-06T02:24:06.628466+0000","last_clean":"2023-10-06T02:24:06.628466+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:24:06.628466+0000","last_undegraded":"2023-10-06T02:24:06.628466+0000","last_fullsized":"2023-10-06T02:24:06.628466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.644417+0000","last_change":"2023-10-06T02:24:06.644417+0000","last_active":"2023-10-06T02:24:06.644417+0000","last_peered":"2023-10-06T02:24:06.644417+0000","last_clean":"2023-10-06T02:24:06.644417+0000","last_became_active":"2023-10-06T02:24:06.644113+0000","last_became_peered":"2023-10-06T02:24:06.644113+0000","last_unstale":"2023-10-06T02:24:06.644417+0000","last_undegraded":"2023-10-06T02:24:06.644417+0000","last_fullsized":"2023-10-06T02:24:06.644417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:54.618077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.887942+0000","last_change":"2023-10-06T02:24:05.885175+0000","last_active":"2023-10-06T02:24:05.887942+0000","last_peered":"2023-10-06T02:24:05.887942+0000","last_clean":"2023-10-06T02:24:05.887942+0000","last_became_active":"2023-10-06T02:24:05.884916+0000","last_became_peered":"2023-10-06T02:24:05.884916+0000","last_unstale":"2023-10-06T02:24:05.887942+0000","last_undegraded":"2023-10-06T02:24:05.887942+0000","last_fullsized":"2023-10-06T02:24:05.887942+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:15.124315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.875755+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:24:05.875755+0000","last_peered":"2023-10-06T02:24:05.875755+0000","last_clean":"2023-10-06T02:24:05.875755+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:24:05.875755+0000","last_undegraded":"2023-10-06T02:24:05.875755+0000","last_fullsized":"2023-10-06T02:24:05.875755+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.647154+0000","last_change":"2023-10-06T02:24:06.647154+0000","last_active":"2023-10-06T02:24:06.647154+0000","last_peered":"2023-10-06T02:24:06.647154+0000","last_clean":"2023-10-06T02:24:06.647154+0000","last_became_active":"2023-10-06T02:24:06.646891+0000","last_became_peered":"2023-10-06T02:24:06.646891+0000","last_unstale":"2023-10-06T02:24:06.647154+0000","last_undegraded":"2023-10-06T02:24:06.647154+0000","last_fullsized":"2023-10-06T02:24:06.647154+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:23.230951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.888707+0000","last_change":"2023-10-06T02:24:05.885173+0000","last_active":"2023-10-06T02:24:06.888707+0000","last_peered":"2023-10-06T02:24:06.888707+0000","last_clean":"2023-10-06T02:24:06.888707+0000","last_became_active":"2023-10-06T02:24:05.884871+0000","last_became_peered":"2023-10-06T02:24:05.884871+0000","last_unstale":"2023-10-06T02:24:06.888707+0000","last_undegraded":"2023-10-06T02:24:06.888707+0000","last_fullsized":"2023-10-06T02:24:06.888707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:21.470756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.873749+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:24:05.873749+0000","last_peered":"2023-10-06T02:24:05.873749+0000","last_clean":"2023-10-06T02:24:05.873749+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:24:05.873749+0000","last_undegraded":"2023-10-06T02:24:05.873749+0000","last_fullsized":"2023-10-06T02:24:05.873749+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.879397+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:24:05.879397+0000","last_peered":"2023-10-06T02:24:05.879397+0000","last_clean":"2023-10-06T02:24:05.879397+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:24:05.879397+0000","last_undegraded":"2023-10-06T02:24:05.879397+0000","last_fullsized":"2023-10-06T02:24:05.879397+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.642216+0000","last_change":"2023-10-06T02:24:06.642216+0000","last_active":"2023-10-06T02:24:06.642216+0000","last_peered":"2023-10-06T02:24:06.642216+0000","last_clean":"2023-10-06T02:24:06.642216+0000","last_became_active":"2023-10-06T02:24:06.641952+0000","last_became_peered":"2023-10-06T02:24:06.641952+0000","last_unstale":"2023-10-06T02:24:06.642216+0000","last_undegraded":"2023-10-06T02:24:06.642216+0000","last_fullsized":"2023-10-06T02:24:06.642216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:45:50.081930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.628551+0000","last_change":"2023-10-06T02:24:05.878711+0000","last_active":"2023-10-06T02:24:06.628551+0000","last_peered":"2023-10-06T02:24:06.628551+0000","last_clean":"2023-10-06T02:24:06.628551+0000","last_became_active":"2023-10-06T02:24:05.878441+0000","last_became_peered":"2023-10-06T02:24:05.878441+0000","last_unstale":"2023-10-06T02:24:06.628551+0000","last_undegraded":"2023-10-06T02:24:06.628551+0000","last_fullsized":"2023-10-06T02:24:06.628551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:16.544997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.880665+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:24:05.880665+0000","last_peered":"2023-10-06T02:24:05.880665+0000","last_clean":"2023-10-06T02:24:05.880665+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:24:05.880665+0000","last_undegraded":"2023-10-06T02:24:05.880665+0000","last_fullsized":"2023-10-06T02:24:05.880665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.646890+0000","last_change":"2023-10-06T02:24:06.640211+0000","last_active":"2023-10-06T02:24:06.646890+0000","last_peered":"2023-10-06T02:24:06.646890+0000","last_clean":"2023-10-06T02:24:06.646890+0000","last_became_active":"2023-10-06T02:24:06.639947+0000","last_became_peered":"2023-10-06T02:24:06.639947+0000","last_unstale":"2023-10-06T02:24:06.646890+0000","last_undegraded":"2023-10-06T02:24:06.646890+0000","last_fullsized":"2023-10-06T02:24:06.646890+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:46.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.892908+0000","last_change":"2023-10-06T02:24:05.888495+0000","last_active":"2023-10-06T02:24:05.892908+0000","last_peered":"2023-10-06T02:24:05.892908+0000","last_clean":"2023-10-06T02:24:05.892908+0000","last_became_active":"2023-10-06T02:24:05.888163+0000","last_became_peered":"2023-10-06T02:24:05.888163+0000","last_unstale":"2023-10-06T02:24:05.892908+0000","last_undegraded":"2023-10-06T02:24:05.892908+0000","last_fullsized":"2023-10-06T02:24:05.892908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:31.272836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.879307+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:24:05.879307+0000","last_peered":"2023-10-06T02:24:05.879307+0000","last_clean":"2023-10-06T02:24:05.879307+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:24:05.879307+0000","last_undegraded":"2023-10-06T02:24:05.879307+0000","last_fullsized":"2023-10-06T02:24:05.879307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.640911+0000","last_change":"2023-10-06T02:24:06.640911+0000","last_active":"2023-10-06T02:24:06.640911+0000","last_peered":"2023-10-06T02:24:06.640911+0000","last_clean":"2023-10-06T02:24:06.640911+0000","last_became_active":"2023-10-06T02:24:06.640668+0000","last_became_peered":"2023-10-06T02:24:06.640668+0000","last_unstale":"2023-10-06T02:24:06.640911+0000","last_undegraded":"2023-10-06T02:24:06.640911+0000","last_fullsized":"2023-10-06T02:24:06.640911+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:57.991241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.626662+0000","last_change":"2023-10-06T02:24:05.886578+0000","last_active":"2023-10-06T02:24:06.626662+0000","last_peered":"2023-10-06T02:24:06.626662+0000","last_clean":"2023-10-06T02:24:06.626662+0000","last_became_active":"2023-10-06T02:24:05.886253+0000","last_became_peered":"2023-10-06T02:24:05.886253+0000","last_unstale":"2023-10-06T02:24:06.626662+0000","last_undegraded":"2023-10-06T02:24:06.626662+0000","last_fullsized":"2023-10-06T02:24:06.626662+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:31.272836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.625724+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:24:06.625724+0000","last_peered":"2023-10-06T02:24:06.625724+0000","last_clean":"2023-10-06T02:24:06.625724+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:24:06.625724+0000","last_undegraded":"2023-10-06T02:24:06.625724+0000","last_fullsized":"2023-10-06T02:24:06.625724+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.638813+0000","last_change":"2023-10-06T02:24:06.638813+0000","last_active":"2023-10-06T02:24:06.638813+0000","last_peered":"2023-10-06T02:24:06.638813+0000","last_clean":"2023-10-06T02:24:06.638813+0000","last_became_active":"2023-10-06T02:24:06.638526+0000","last_became_peered":"2023-10-06T02:24:06.638526+0000","last_unstale":"2023-10-06T02:24:06.638813+0000","last_undegraded":"2023-10-06T02:24:06.638813+0000","last_fullsized":"2023-10-06T02:24:06.638813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:28.143952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.892875+0000","last_change":"2023-10-06T02:24:05.887405+0000","last_active":"2023-10-06T02:24:05.892875+0000","last_peered":"2023-10-06T02:24:05.892875+0000","last_clean":"2023-10-06T02:24:05.892875+0000","last_became_active":"2023-10-06T02:24:05.887127+0000","last_became_peered":"2023-10-06T02:24:05.887127+0000","last_unstale":"2023-10-06T02:24:05.892875+0000","last_undegraded":"2023-10-06T02:24:05.892875+0000","last_fullsized":"2023-10-06T02:24:05.892875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:55.526523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.877911+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:24:05.877911+0000","last_peered":"2023-10-06T02:24:05.877911+0000","last_clean":"2023-10-06T02:24:05.877911+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:24:05.877911+0000","last_undegraded":"2023-10-06T02:24:05.877911+0000","last_fullsized":"2023-10-06T02:24:05.877911+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.636087+0000","last_change":"2023-10-06T02:24:06.633584+0000","last_active":"2023-10-06T02:24:06.636087+0000","last_peered":"2023-10-06T02:24:06.636087+0000","last_clean":"2023-10-06T02:24:06.636087+0000","last_became_active":"2023-10-06T02:24:06.633310+0000","last_became_peered":"2023-10-06T02:24:06.633310+0000","last_unstale":"2023-10-06T02:24:06.636087+0000","last_undegraded":"2023-10-06T02:24:06.636087+0000","last_fullsized":"2023-10-06T02:24:06.636087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:05.863241+0000","last_clean_scrub_stamp":"2023-10-06T02:24:05.863241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:28.283593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T02:24:06.626200+0000","last_change":"2023-10-06T02:24:05.882322+0000","last_active":"2023-10-06T02:24:06.626200+0000","last_peered":"2023-10-06T02:24:06.626200+0000","last_clean":"2023-10-06T02:24:06.626200+0000","last_became_active":"2023-10-06T02:24:05.881714+0000","last_became_peered":"2023-10-06T02:24:05.881714+0000","last_unstale":"2023-10-06T02:24:06.626200+0000","last_undegraded":"2023-10-06T02:24:06.626200+0000","last_fullsized":"2023-10-06T02:24:06.626200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:04.858606+0000","last_clean_scrub_stamp":"2023-10-06T02:24:04.858606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:38.482538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T02:24:05.878546+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:24:05.878546+0000","last_peered":"2023-10-06T02:24:05.878546+0000","last_clean":"2023-10-06T02:24:05.878546+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:24:05.878546+0000","last_undegraded":"2023-10-06T02:24:05.878546+0000","last_fullsized":"2023-10-06T02:24:05.878546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":726468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297616,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074224,"statfs":{"total":96636764160,"available":96332005376,"internally_reserved":0,"allocated":335872,"data_stored":133695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298200,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073640,"statfs":{"total":96636764160,"available":96331407360,"internally_reserved":0,"allocated":933888,"data_stored":724952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074212,"statfs":{"total":96636764160,"available":96331993088,"internally_reserved":0,"allocated":348160,"data_stored":139816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297632,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074208,"statfs":{"total":96636764160,"available":96331988992,"internally_reserved":0,"allocated":352256,"data_stored":141205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.41999999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.253},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.31900000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.39000000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.625},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.52100000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53700000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.47099999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074212,"statfs":{"total":96636764160,"available":96331993088,"internally_reserved":0,"allocated":348160,"data_stored":134711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074204,"statfs":{"total":96636764160,"available":96331984896,"internally_reserved":0,"allocated":356352,"data_stored":141711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074204,"statfs":{"total":96636764160,"available":96331984896,"internally_reserved":0,"allocated":356352,"data_stored":141247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:24:11.366 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:24:11.366 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:24:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.526+0000 7f5663fc6700 1 Processor -- start 2023-10-06T02:24:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.526+0000 7f5663fc6700 1 -- start start 2023-10-06T02:24:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.527+0000 7f5663fc6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f565c14e2a0 0x7f565c0ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.527+0000 7f5663fc6700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f565c0b3e80 0x7f565c0cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.527+0000 7f5663fc6700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565c1587a0 con 0x7f565c14e670 2023-10-06T02:24:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.527+0000 7f5663fc6700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f565c157b90 con 0x7f565c0b3e80 2023-10-06T02:24:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.527+0000 7f5663fc6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c157e70 con 0x7f565c14e2a0 2023-10-06T02:24:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.528+0000 7f5661d62700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f565c14e2a0 0x7f565c0ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.528+0000 7f5662563700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f565c0b3e80 0x7f565c0cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.528+0000 7f5661d62700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f565c14e2a0 0x7f565c0ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:35782/0 (socket says 172.21.15.37:35782) 2023-10-06T02:24:11.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.528+0000 7f5661d62700 1 -- 172.21.15.37:0/1021982539 learned_addr learned my addr 172.21.15.37:0/1021982539 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:11.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.528+0000 7f5662563700 1 --2- 172.21.15.37:0/1021982539 >> v2:172.21.15.191:3300/0 conn(0x7f565c0b3e80 0x7f565c0cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:37536/0 (socket says 172.21.15.37:37536) 2023-10-06T02:24:11.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.528+0000 7f5662563700 1 -- 172.21.15.37:0/1021982539 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f565c14e2a0 msgr2=0x7f565c0ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:11.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.528+0000 7f5662563700 1 --2- 172.21.15.37:0/1021982539 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f565c14e2a0 0x7f565c0ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.528+0000 7f5662563700 1 -- 172.21.15.37:0/1021982539 >> v1:172.21.15.191:6789/0 conn(0x7f565c14e670 legacy=0x7f565c0b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:11.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.528+0000 7f5662563700 1 -- 172.21.15.37:0/1021982539 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c158150 con 0x7f565c0b3e80 2023-10-06T02:24:11.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.528+0000 7f5660d60700 1 -- 172.21.15.37:0/1021982539 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483077158 0 0) 0x7f565c1587a0 con 0x7f565c14e670 2023-10-06T02:24:11.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.528+0000 7f5662563700 1 --2- 172.21.15.37:0/1021982539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f565c0b3e80 0x7f565c0cc2c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f56540098e0 tx=0x7f56540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31432a939c364a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:11.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.528+0000 7f5660d60700 1 -- 172.21.15.37:0/1021982539 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565400b640 con 0x7f565c0b3e80 2023-10-06T02:24:11.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.528+0000 7f5660d60700 1 -- 172.21.15.37:0/1021982539 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565400b7a0 con 0x7f565c0b3e80 2023-10-06T02:24:11.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.528+0000 7f5660d60700 1 -- 172.21.15.37:0/1021982539 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565400bb40 con 0x7f565c0b3e80 2023-10-06T02:24:11.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.529+0000 7f5663fc6700 1 -- 172.21.15.37:0/1021982539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f565c0b3e80 msgr2=0x7f565c0cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:11.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.529+0000 7f5663fc6700 1 --2- 172.21.15.37:0/1021982539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f565c0b3e80 0x7f565c0cc2c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f56540098e0 tx=0x7f56540091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.529+0000 7f5663fc6700 1 -- 172.21.15.37:0/1021982539 shutdown_connections 2023-10-06T02:24:11.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.529+0000 7f5663fc6700 1 --2- 172.21.15.37:0/1021982539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f565c0b3e80 0x7f565c0cc2c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.529+0000 7f5663fc6700 1 --2- 172.21.15.37:0/1021982539 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f565c14e2a0 0x7f565c0ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.529+0000 7f5663fc6700 1 -- 172.21.15.37:0/1021982539 >> 172.21.15.37:0/1021982539 conn(0x7f565c06c0b0 msgr2=0x7f565c06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:11.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.529+0000 7f5663fc6700 1 -- 172.21.15.37:0/1021982539 shutdown_connections 2023-10-06T02:24:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.529+0000 7f5663fc6700 1 -- 172.21.15.37:0/1021982539 wait complete. 2023-10-06T02:24:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.530+0000 7f5663fc6700 1 Processor -- start 2023-10-06T02:24:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.530+0000 7f5663fc6700 1 -- start start 2023-10-06T02:24:11.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.531+0000 7f5663fc6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f565c0b3e80 0x7f565c1473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.531+0000 7f5663fc6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f565c14e2a0 0x7f565c154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.531+0000 7f5663fc6700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f565c14e670 0x7f565c1565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.531+0000 7f5663fc6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c156fb0 con 0x7f565c0b3e80 2023-10-06T02:24:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.531+0000 7f5663fc6700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c154590 con 0x7f565c14e670 2023-10-06T02:24:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.531+0000 7f5663fc6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c153c60 con 0x7f565c14e2a0 2023-10-06T02:24:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.531+0000 7f5661d62700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f565c0b3e80 0x7f565c1473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.531+0000 7f5661d62700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f565c0b3e80 0x7f565c1473d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41394/0 (socket says 172.21.15.37:41394) 2023-10-06T02:24:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.531+0000 7f5661d62700 1 -- 172.21.15.37:0/2464414583 learned_addr learned my addr 172.21.15.37:0/2464414583 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.531+0000 7f5662563700 1 --2- 172.21.15.37:0/2464414583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f565c14e670 0x7f565c1565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.531+0000 7f5661561700 1 --2- 172.21.15.37:0/2464414583 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f565c14e2a0 0x7f565c154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.531+0000 7f5661d62700 1 -- 172.21.15.37:0/2464414583 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f565c14e2a0 msgr2=0x7f565c154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.531+0000 7f5661d62700 1 --2- 172.21.15.37:0/2464414583 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f565c14e2a0 0x7f565c154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.531+0000 7f5661d62700 1 -- 172.21.15.37:0/2464414583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f565c14e670 msgr2=0x7f565c1565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.531+0000 7f5661d62700 1 --2- 172.21.15.37:0/2464414583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f565c14e670 0x7f565c1565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.531+0000 7f5661d62700 1 -- 172.21.15.37:0/2464414583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5654009420 con 0x7f565c0b3e80 2023-10-06T02:24:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.531+0000 7f5661561700 1 --2- 172.21.15.37:0/2464414583 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f565c14e2a0 0x7f565c154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.532+0000 7f5661d62700 1 --2- 172.21.15.37:0/2464414583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f565c0b3e80 0x7f565c1473d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f564c009ed0 tx=0x7f564c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.532+0000 7f5659ffb700 1 -- 172.21.15.37:0/2464414583 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c00ca70 con 0x7f565c0b3e80 2023-10-06T02:24:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.532+0000 7f5659ffb700 1 -- 172.21.15.37:0/2464414583 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c00f040 con 0x7f565c0b3e80 2023-10-06T02:24:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.532+0000 7f5659ffb700 1 -- 172.21.15.37:0/2464414583 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c00cde0 con 0x7f565c0b3e80 2023-10-06T02:24:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.532+0000 7f5663fc6700 1 -- 172.21.15.37:0/2464414583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565c153f40 con 0x7f565c0b3e80 2023-10-06T02:24:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.532+0000 7f5663fc6700 1 -- 172.21.15.37:0/2464414583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565c154f60 con 0x7f565c0b3e80 2023-10-06T02:24:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.533+0000 7f5663fc6700 1 -- 172.21.15.37:0/2464414583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f565c154870 con 0x7f565c0b3e80 2023-10-06T02:24:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.533+0000 7f5659ffb700 1 -- 172.21.15.37:0/2464414583 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f564c014690 con 0x7f565c0b3e80 2023-10-06T02:24:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.534+0000 7f5659ffb700 1 --2- 172.21.15.37:0/2464414583 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5648066f30 0x7f56480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.534+0000 7f5659ffb700 1 -- 172.21.15.37:0/2464414583 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f564c084cc0 con 0x7f565c0b3e80 2023-10-06T02:24:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.534+0000 7f5661561700 1 --2- 172.21.15.37:0/2464414583 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5648066f30 0x7f56480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.535+0000 7f5661561700 1 --2- 172.21.15.37:0/2464414583 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5648066f30 0x7f56480693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f56500011e0 tx=0x7f5650009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:11.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.538+0000 7f5659ffb700 1 -- 172.21.15.37:0/2464414583 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f564c051dd0 con 0x7f565c0b3e80 2023-10-06T02:24:11.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.810+0000 7f5663fc6700 1 -- 172.21.15.37:0/2464414583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f565c155150 con 0x7f565c0b3e80 2023-10-06T02:24:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.813+0000 7f5659ffb700 1 -- 172.21.15.37:0/2464414583 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f564c0553f0 con 0x7f565c0b3e80 2023-10-06T02:24:11.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.815+0000 7f5663fc6700 1 -- 172.21.15.37:0/2464414583 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5648066f30 msgr2=0x7f56480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:11.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.815+0000 7f5663fc6700 1 --2- 172.21.15.37:0/2464414583 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5648066f30 0x7f56480693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f56500011e0 tx=0x7f5650009040 comp rx=0 tx=0).stop 2023-10-06T02:24:11.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.815+0000 7f5663fc6700 1 -- 172.21.15.37:0/2464414583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f565c0b3e80 msgr2=0x7f565c1473d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:11.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.815+0000 7f5663fc6700 1 --2- 172.21.15.37:0/2464414583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f565c0b3e80 0x7f565c1473d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f564c009ed0 tx=0x7f564c00b040 comp rx=0 tx=0).stop 2023-10-06T02:24:11.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.816+0000 7f5663fc6700 1 -- 172.21.15.37:0/2464414583 shutdown_connections 2023-10-06T02:24:11.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.816+0000 7f5663fc6700 1 --2- 172.21.15.37:0/2464414583 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5648066f30 0x7f56480693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.816+0000 7f5663fc6700 1 --2- 172.21.15.37:0/2464414583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f565c14e670 0x7f565c1565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.816+0000 7f5663fc6700 1 --2- 172.21.15.37:0/2464414583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f565c0b3e80 0x7f565c1473d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.816+0000 7f5663fc6700 1 --2- 172.21.15.37:0/2464414583 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f565c14e2a0 0x7f565c154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.816+0000 7f5663fc6700 1 -- 172.21.15.37:0/2464414583 >> 172.21.15.37:0/2464414583 conn(0x7f565c06c0b0 msgr2=0x7f565c14d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:11.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.816+0000 7f5663fc6700 1 -- 172.21.15.37:0/2464414583 shutdown_connections 2023-10-06T02:24:11.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.816+0000 7f5663fc6700 1 -- 172.21.15.37:0/2464414583 wait complete. 2023-10-06T02:24:11.818 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-10-06T02:24:11.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:11.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.947+0000 7fc00d4de700 1 Processor -- start 2023-10-06T02:24:11.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.947+0000 7fc00d4de700 1 -- start start 2023-10-06T02:24:11.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.948+0000 7fc00d4de700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0080af4d0 0x7fc0080b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.948+0000 7fc00d4de700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc0080d0a50 0x7fc0080b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.948+0000 7fc00d4de700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0080b40a0 con 0x7fc0080af8a0 2023-10-06T02:24:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.948+0000 7fc00d4de700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0080b1a60 con 0x7fc0080d0a50 2023-10-06T02:24:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.948+0000 7fc00d4de700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080b31b0 con 0x7fc0080af4d0 2023-10-06T02:24:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.948+0000 7fc0067fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc0080af8a0 0x7fc0080d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58144/0 (socket says 172.21.15.37:58144) 2023-10-06T02:24:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.948+0000 7fc0067fc700 1 -- 172.21.15.37:0/1385184635 learned_addr learned my addr 172.21.15.37:0/1385184635 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.948+0000 7fc0077fe700 1 --2- 172.21.15.37:0/1385184635 >> v2:172.21.15.191:3300/0 conn(0x7fc0080d0a50 0x7fc0080b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.948+0000 7fc006ffd700 1 --2- 172.21.15.37:0/1385184635 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0080af4d0 0x7fc0080b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.948+0000 7fc005ffb700 1 -- 172.21.15.37:0/1385184635 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171296500 0 0) 0x7fc0080b40a0 con 0x7fc0080af8a0 2023-10-06T02:24:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.948+0000 7fc005ffb700 1 -- 172.21.15.37:0/1385184635 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff4003570 con 0x7fc0080af8a0 2023-10-06T02:24:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc005ffb700 1 -- 172.21.15.37:0/1385184635 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1022160033 0 0) 0x7fbff4003570 con 0x7fc0080af8a0 2023-10-06T02:24:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc005ffb700 1 -- 172.21.15.37:0/1385184635 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0080af4d0 msgr2=0x7fc0080b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc005ffb700 1 --2- 172.21.15.37:0/1385184635 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0080af4d0 0x7fc0080b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc005ffb700 1 -- 172.21.15.37:0/1385184635 >> v2:172.21.15.191:3300/0 conn(0x7fc0080d0a50 msgr2=0x7fc0080b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc005ffb700 1 --2- 172.21.15.37:0/1385184635 >> v2:172.21.15.191:3300/0 conn(0x7fc0080d0a50 0x7fc0080b29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc005ffb700 1 -- 172.21.15.37:0/1385184635 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0080b3490 con 0x7fc0080af8a0 2023-10-06T02:24:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc005ffb700 1 -- 172.21.15.37:0/1385184635 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7fbff0001470 con 0x7fc0080af8a0 2023-10-06T02:24:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc0077fe700 1 --2- 172.21.15.37:0/1385184635 >> v2:172.21.15.191:3300/0 conn(0x7fc0080d0a50 0x7fc0080b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:24:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc005ffb700 1 -- 172.21.15.37:0/1385184635 >> v1:172.21.15.37:6789/0 conn(0x7fc0080af8a0 legacy=0x7fc0080d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc005ffb700 1 --2- 172.21.15.37:0/1385184635 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0080af4d0 0x7fbff4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc005ffb700 1 --2- 172.21.15.37:0/1385184635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbff4003fe0 0x7fbff4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc005ffb700 1 --2- 172.21.15.37:0/1385184635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff4004d50 0x7fbff40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc005ffb700 1 -- 172.21.15.37:0/1385184635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080b31b0 con 0x7fbff4004d50 2023-10-06T02:24:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc005ffb700 1 -- 172.21.15.37:0/1385184635 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff400ba60 con 0x7fbff4003fe0 2023-10-06T02:24:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc005ffb700 1 -- 172.21.15.37:0/1385184635 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff400bbd0 con 0x7fc0080af4d0 2023-10-06T02:24:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc006ffd700 1 --2- 172.21.15.37:0/1385184635 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0080af4d0 0x7fbff4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc0077fe700 1 --2- 172.21.15.37:0/1385184635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff4004d50 0x7fbff40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc0067fc700 1 --2- 172.21.15.37:0/1385184635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbff4003fe0 0x7fbff4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc0077fe700 1 -- 172.21.15.37:0/1385184635 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0080af4d0 msgr2=0x7fbff4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc0077fe700 1 --2- 172.21.15.37:0/1385184635 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0080af4d0 0x7fbff4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc0077fe700 1 -- 172.21.15.37:0/1385184635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbff4003fe0 msgr2=0x7fbff4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc0077fe700 1 --2- 172.21.15.37:0/1385184635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbff4003fe0 0x7fbff4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc0077fe700 1 -- 172.21.15.37:0/1385184635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff4003570 con 0x7fbff4004d50 2023-10-06T02:24:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.949+0000 7fc006ffd700 1 --2- 172.21.15.37:0/1385184635 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0080af4d0 0x7fbff4003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:24:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.950+0000 7fc0077fe700 1 --2- 172.21.15.37:0/1385184635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff4004d50 0x7fbff40051c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc0080895b0 tx=0x7fbff80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad2351791f02585 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.950+0000 7fc005ffb700 1 -- 172.21.15.37:0/1385184635 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff8009740 con 0x7fbff4004d50 2023-10-06T02:24:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.950+0000 7fc005ffb700 1 -- 172.21.15.37:0/1385184635 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff800e8c0 con 0x7fbff4004d50 2023-10-06T02:24:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.950+0000 7fc005ffb700 1 -- 172.21.15.37:0/1385184635 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff800ec60 con 0x7fbff4004d50 2023-10-06T02:24:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.950+0000 7fc00d4de700 1 -- 172.21.15.37:0/1385184635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff4004d50 msgr2=0x7fbff40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.950+0000 7fc00d4de700 1 --2- 172.21.15.37:0/1385184635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff4004d50 0x7fbff40051c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc0080895b0 tx=0x7fbff80091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.950+0000 7fc0077fe700 1 -- 172.21.15.37:0/1385184635 reap_dead start 2023-10-06T02:24:11.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.950+0000 7fc00d4de700 1 -- 172.21.15.37:0/1385184635 shutdown_connections 2023-10-06T02:24:11.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.950+0000 7fc00d4de700 1 -- 172.21.15.37:0/1385184635 >> 172.21.15.37:0/1385184635 conn(0x7fc00806c0b0 msgr2=0x7fc00806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:11.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.950+0000 7fc00d4de700 1 -- 172.21.15.37:0/1385184635 shutdown_connections 2023-10-06T02:24:11.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.950+0000 7fc00d4de700 1 -- 172.21.15.37:0/1385184635 wait complete. 2023-10-06T02:24:11.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.951+0000 7fc00d4de700 1 Processor -- start 2023-10-06T02:24:11.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.951+0000 7fc00d4de700 1 -- start start 2023-10-06T02:24:11.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.952+0000 7fc00d4de700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc00814a870 0x7fc0080ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.952+0000 7fc00d4de700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0080c73f0 0x7fc0080c5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.952+0000 7fc00d4de700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc00814ac40 0x7fc0080c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.952+0000 7fc00d4de700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00815b2b0 con 0x7fc0080c73f0 2023-10-06T02:24:11.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.952+0000 7fc00d4de700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080ca5a0 con 0x7fc00814ac40 2023-10-06T02:24:11.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.952+0000 7fc00d4de700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00815d2b0 con 0x7fc00814a870 2023-10-06T02:24:11.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.952+0000 7fc0067fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0080c73f0 0x7fc0080c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.952+0000 7fc0067fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0080c73f0 0x7fc0080c5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41410/0 (socket says 172.21.15.37:41410) 2023-10-06T02:24:11.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.952+0000 7fc0067fc700 1 -- 172.21.15.37:0/1922325508 learned_addr learned my addr 172.21.15.37:0/1922325508 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:11.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.952+0000 7fc0077fe700 1 --2- 172.21.15.37:0/1922325508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc00814ac40 0x7fc0080c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.952+0000 7fc006ffd700 1 --2- 172.21.15.37:0/1922325508 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc00814a870 0x7fc0080ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.953+0000 7fc0067fc700 1 -- 172.21.15.37:0/1922325508 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc00814a870 msgr2=0x7fc0080ca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:11.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.953+0000 7fc0067fc700 1 --2- 172.21.15.37:0/1922325508 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc00814a870 0x7fc0080ca060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.953+0000 7fc0067fc700 1 -- 172.21.15.37:0/1922325508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc00814ac40 msgr2=0x7fc0080c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:11.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.953+0000 7fc0067fc700 1 --2- 172.21.15.37:0/1922325508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc00814ac40 0x7fc0080c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:11.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.953+0000 7fc0067fc700 1 -- 172.21.15.37:0/1922325508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00815d590 con 0x7fc0080c73f0 2023-10-06T02:24:11.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.953+0000 7fc0067fc700 1 --2- 172.21.15.37:0/1922325508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0080c73f0 0x7fc0080c5620 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbff0007710 tx=0x7fbff0001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:11.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.953+0000 7fbffeffd700 1 -- 172.21.15.37:0/1922325508 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0018030 con 0x7fc0080c73f0 2023-10-06T02:24:11.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.953+0000 7fbffeffd700 1 -- 172.21.15.37:0/1922325508 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff0004e60 con 0x7fc0080c73f0 2023-10-06T02:24:11.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.953+0000 7fc00d4de700 1 -- 172.21.15.37:0/1922325508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00815d870 con 0x7fc0080c73f0 2023-10-06T02:24:11.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.953+0000 7fbffeffd700 1 -- 172.21.15.37:0/1922325508 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff000fe90 con 0x7fc0080c73f0 2023-10-06T02:24:11.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.953+0000 7fc00d4de700 1 -- 172.21.15.37:0/1922325508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00815e070 con 0x7fc0080c73f0 2023-10-06T02:24:11.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.954+0000 7fc00d4de700 1 -- 172.21.15.37:0/1922325508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc00815dd90 con 0x7fc0080c73f0 2023-10-06T02:24:11.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.954+0000 7fbffeffd700 1 -- 172.21.15.37:0/1922325508 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbff001b070 con 0x7fc0080c73f0 2023-10-06T02:24:11.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.955+0000 7fbffeffd700 1 --2- 172.21.15.37:0/1922325508 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbfe8066f60 0x7fbfe8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:11.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.955+0000 7fbffeffd700 1 -- 172.21.15.37:0/1922325508 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbff0019070 con 0x7fc0080c73f0 2023-10-06T02:24:11.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.955+0000 7fc006ffd700 1 --2- 172.21.15.37:0/1922325508 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbfe8066f60 0x7fbfe8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:11.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.955+0000 7fc006ffd700 1 --2- 172.21.15.37:0/1922325508 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbfe8066f60 0x7fbfe8069410 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc0000094a0 tx=0x7fc00000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:11.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:11.959+0000 7fbffeffd700 1 -- 172.21.15.37:0/1922325508 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc00815dd90 con 0x7fc0080c73f0 2023-10-06T02:24:12.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.197+0000 7fc00d4de700 1 -- 172.21.15.37:0/1922325508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc00815dd90 con 0x7fc0080c73f0 2023-10-06T02:24:12.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.197+0000 7fbffeffd700 1 -- 172.21.15.37:0/1922325508 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fc00815dd90 con 0x7fc0080c73f0 2023-10-06T02:24:12.199 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:12.199 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1320242500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1320242500},{"type":"v1","addr":"172.21.15.37:6835","nonce":1320242500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4900,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/3862379925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3862379925},{"type":"v1","addr":"172.21.15.191:6836","nonce":3862379925}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1922753638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":1922753638},{"type":"v1","addr":"172.21.15.191:6837","nonce":1922753638}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:06.274246+0000","modified":"2023-10-06T02:24:09.884600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/967425730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":967425730},{"type":"v1","addr":"172.21.15.37:6834","nonce":967425730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:24:12.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.199+0000 7fc00d4de700 1 -- 172.21.15.37:0/1922325508 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbfe8066f60 msgr2=0x7fbfe8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.199+0000 7fc00d4de700 1 --2- 172.21.15.37:0/1922325508 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbfe8066f60 0x7fbfe8069410 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc0000094a0 tx=0x7fc00000b040 comp rx=0 tx=0).stop 2023-10-06T02:24:12.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.199+0000 7fc00d4de700 1 -- 172.21.15.37:0/1922325508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0080c73f0 msgr2=0x7fc0080c5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.199+0000 7fc00d4de700 1 --2- 172.21.15.37:0/1922325508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0080c73f0 0x7fc0080c5620 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbff0007710 tx=0x7fbff0001e90 comp rx=0 tx=0).stop 2023-10-06T02:24:12.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.199+0000 7fc00d4de700 1 -- 172.21.15.37:0/1922325508 shutdown_connections 2023-10-06T02:24:12.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.199+0000 7fc00d4de700 1 --2- 172.21.15.37:0/1922325508 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbfe8066f60 0x7fbfe8069410 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.199+0000 7fc00d4de700 1 --2- 172.21.15.37:0/1922325508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc00814ac40 0x7fc0080c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.199+0000 7fc00d4de700 1 --2- 172.21.15.37:0/1922325508 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc00814a870 0x7fc0080ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.199+0000 7fc00d4de700 1 --2- 172.21.15.37:0/1922325508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0080c73f0 0x7fc0080c5620 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.199+0000 7fc00d4de700 1 -- 172.21.15.37:0/1922325508 >> 172.21.15.37:0/1922325508 conn(0x7fc00806c0b0 msgr2=0x7fc0080b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:12.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.199+0000 7fc00d4de700 1 -- 172.21.15.37:0/1922325508 shutdown_connections 2023-10-06T02:24:12.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.199+0000 7fc00d4de700 1 -- 172.21.15.37:0/1922325508 wait complete. 2023-10-06T02:24:12.202 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2023-10-06T02:24:12.615 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:06.274246+0000', 'modified': '2023-10-06T02:24:09.884600+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4980}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4980': {'gid': 4980, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6834/967425730', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 967425730}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 967425730}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:24:12.615 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:24:12.615 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T02:24:12.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.737+0000 7ff8048f8700 1 Processor -- start 2023-10-06T02:24:12.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.737+0000 7ff8048f8700 1 -- start start 2023-10-06T02:24:12.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff8048f8700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff80006de80 0x7ff8000b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff8048f8700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8000cc250 con 0x7ff8000cb080 2023-10-06T02:24:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff8048f8700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8000cb640 con 0x7ff80006dab0 2023-10-06T02:24:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff8048f8700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8000b0e00 con 0x7ff80006de80 2023-10-06T02:24:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff7fdd9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff8000cb080 0x7ff8000b01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58156/0 (socket says 172.21.15.37:58156) 2023-10-06T02:24:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff7fdd9b700 1 -- 172.21.15.37:0/4183705216 learned_addr learned my addr 172.21.15.37:0/4183705216 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff7fed9d700 1 --2- 172.21.15.37:0/4183705216 >> v2:172.21.15.191:3300/0 conn(0x7ff80006de80 0x7ff8000b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff7fd59a700 1 -- 172.21.15.37:0/4183705216 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950811316 0 0) 0x7ff8000cc250 con 0x7ff8000cb080 2023-10-06T02:24:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff7fd59a700 1 -- 172.21.15.37:0/4183705216 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7e8003570 con 0x7ff8000cb080 2023-10-06T02:24:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff7fd59a700 1 -- 172.21.15.37:0/4183705216 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537607884 0 0) 0x7ff8000cb640 con 0x7ff80006dab0 2023-10-06T02:24:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff7fd59a700 1 -- 172.21.15.37:0/4183705216 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8000cc250 con 0x7ff80006dab0 2023-10-06T02:24:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff7fd59a700 1 -- 172.21.15.37:0/4183705216 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2733576493 0 0) 0x7ff7e8003570 con 0x7ff8000cb080 2023-10-06T02:24:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff7fd59a700 1 -- 172.21.15.37:0/4183705216 >> v2:172.21.15.191:3300/0 conn(0x7ff80006de80 msgr2=0x7ff8000b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff7fd59a700 1 --2- 172.21.15.37:0/4183705216 >> v2:172.21.15.191:3300/0 conn(0x7ff80006de80 0x7ff8000b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff7fd59a700 1 -- 172.21.15.37:0/4183705216 >> v1:172.21.15.191:6789/0 conn(0x7ff80006dab0 legacy=0x7ff8000cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff7fd59a700 1 -- 172.21.15.37:0/4183705216 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8000cb920 con 0x7ff8000cb080 2023-10-06T02:24:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff7fd59a700 1 -- 172.21.15.37:0/4183705216 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7ff7f4001470 con 0x7ff8000cb080 2023-10-06T02:24:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff7fed9d700 1 --2- 172.21.15.37:0/4183705216 >> v2:172.21.15.191:3300/0 conn(0x7ff80006de80 0x7ff8000b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:24:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff7fd59a700 1 -- 172.21.15.37:0/4183705216 >> v1:172.21.15.37:6789/0 conn(0x7ff8000cb080 legacy=0x7ff8000b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff7fd59a700 1 --2- 172.21.15.37:0/4183705216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7e8003c40 0x7ff7e8004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.738+0000 7ff7fd59a700 1 --2- 172.21.15.37:0/4183705216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7e8004810 0x7ff7e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.739+0000 7ff7fd59a700 1 --2- 172.21.15.37:0/4183705216 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff7e8005210 0x7ff7e800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.739+0000 7ff7fd59a700 1 -- 172.21.15.37:0/4183705216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8000b0e00 con 0x7ff7e8004810 2023-10-06T02:24:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.739+0000 7ff7fd59a700 1 -- 172.21.15.37:0/4183705216 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e800c130 con 0x7ff7e8003c40 2023-10-06T02:24:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.739+0000 7ff7fd59a700 1 -- 172.21.15.37:0/4183705216 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e800c2c0 con 0x7ff7e8005210 2023-10-06T02:24:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.739+0000 7ff7fdd9b700 1 --2- 172.21.15.37:0/4183705216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7e8004810 0x7ff7e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.739+0000 7ff7fe59c700 1 --2- 172.21.15.37:0/4183705216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7e8003c40 0x7ff7e8004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.739+0000 7ff7fed9d700 1 --2- 172.21.15.37:0/4183705216 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff7e8005210 0x7ff7e800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.739+0000 7ff7fdd9b700 1 -- 172.21.15.37:0/4183705216 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff7e8005210 msgr2=0x7ff7e800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.739+0000 7ff7fdd9b700 1 --2- 172.21.15.37:0/4183705216 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff7e8005210 0x7ff7e800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.739+0000 7ff7fdd9b700 1 -- 172.21.15.37:0/4183705216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7e8003c40 msgr2=0x7ff7e8004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.739+0000 7ff7fdd9b700 1 --2- 172.21.15.37:0/4183705216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7e8003c40 0x7ff7e8004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.739+0000 7ff7fdd9b700 1 -- 172.21.15.37:0/4183705216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e8003570 con 0x7ff7e8004810 2023-10-06T02:24:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.739+0000 7ff7fed9d700 1 -- 172.21.15.37:0/4183705216 reap_dead start 2023-10-06T02:24:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.739+0000 7ff7fdd9b700 1 --2- 172.21.15.37:0/4183705216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7e8004810 0x7ff7e8004c80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400c240 tx=0x7ff7f4001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2499f19b5b22d0a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.739+0000 7ff7fd59a700 1 -- 172.21.15.37:0/4183705216 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f400cbc0 con 0x7ff7e8004810 2023-10-06T02:24:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.739+0000 7ff7fd59a700 1 -- 172.21.15.37:0/4183705216 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f400cd60 con 0x7ff7e8004810 2023-10-06T02:24:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.739+0000 7ff7fd59a700 1 -- 172.21.15.37:0/4183705216 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4005b70 con 0x7ff7e8004810 2023-10-06T02:24:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.740+0000 7ff8048f8700 1 -- 172.21.15.37:0/4183705216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7e8004810 msgr2=0x7ff7e8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.740+0000 7ff8048f8700 1 --2- 172.21.15.37:0/4183705216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7e8004810 0x7ff7e8004c80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400c240 tx=0x7ff7f4001d40 comp rx=0 tx=0).stop 2023-10-06T02:24:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.740+0000 7ff8048f8700 1 -- 172.21.15.37:0/4183705216 shutdown_connections 2023-10-06T02:24:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.740+0000 7ff8048f8700 1 --2- 172.21.15.37:0/4183705216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7e8004810 0x7ff7e8004c80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.740+0000 7ff8048f8700 1 -- 172.21.15.37:0/4183705216 >> 172.21.15.37:0/4183705216 conn(0x7ff8000d0510 msgr2=0x7ff8000d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.740+0000 7ff8048f8700 1 -- 172.21.15.37:0/4183705216 shutdown_connections 2023-10-06T02:24:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.740+0000 7ff8048f8700 1 -- 172.21.15.37:0/4183705216 wait complete. 2023-10-06T02:24:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.741+0000 7ff8048f8700 1 Processor -- start 2023-10-06T02:24:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.741+0000 7ff8048f8700 1 -- start start 2023-10-06T02:24:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.742+0000 7ff8048f8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7e8004810 0x7ff800152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.742+0000 7ff8048f8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff80014f140 0x7ff800150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.742+0000 7ff8048f8700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff8000b43e0 0x7ff8000b4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.742+0000 7ff8048f8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8000b4d90 con 0x7ff7e8004810 2023-10-06T02:24:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.742+0000 7ff8048f8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff800151700 con 0x7ff80014f140 2023-10-06T02:24:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.742+0000 7ff8048f8700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff800150af0 con 0x7ff8000b43e0 2023-10-06T02:24:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.742+0000 7ff7fe59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7e8004810 0x7ff800152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.742+0000 7ff7fe59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7e8004810 0x7ff800152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41420/0 (socket says 172.21.15.37:41420) 2023-10-06T02:24:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.742+0000 7ff7fe59c700 1 -- 172.21.15.37:0/795946035 learned_addr learned my addr 172.21.15.37:0/795946035 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.742+0000 7ff7fdd9b700 1 --2- 172.21.15.37:0/795946035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff80014f140 0x7ff800150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.742+0000 7ff7fed9d700 1 --2- 172.21.15.37:0/795946035 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff8000b43e0 0x7ff8000b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.742+0000 7ff7fe59c700 1 -- 172.21.15.37:0/795946035 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff8000b43e0 msgr2=0x7ff8000b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.742+0000 7ff7fe59c700 1 --2- 172.21.15.37:0/795946035 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff8000b43e0 0x7ff8000b4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.742+0000 7ff7fe59c700 1 -- 172.21.15.37:0/795946035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff80014f140 msgr2=0x7ff800150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.742+0000 7ff7fe59c700 1 --2- 172.21.15.37:0/795946035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff80014f140 0x7ff800150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.742+0000 7ff7fe59c700 1 -- 172.21.15.37:0/795946035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff800150dd0 con 0x7ff7e8004810 2023-10-06T02:24:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.742+0000 7ff7fdd9b700 1 --2- 172.21.15.37:0/795946035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff80014f140 0x7ff800150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.742+0000 7ff7fe59c700 1 --2- 172.21.15.37:0/795946035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7e8004810 0x7ff800152360 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0002a90 tx=0x7ff7f0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.743+0000 7ff7ee7fc700 1 -- 172.21.15.37:0/795946035 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0003510 con 0x7ff7e8004810 2023-10-06T02:24:12.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.743+0000 7ff7ee7fc700 1 -- 172.21.15.37:0/795946035 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f0006a30 con 0x7ff7e8004810 2023-10-06T02:24:12.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.743+0000 7ff8048f8700 1 -- 172.21.15.37:0/795946035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8001510b0 con 0x7ff7e8004810 2023-10-06T02:24:12.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.743+0000 7ff7ee7fc700 1 -- 172.21.15.37:0/795946035 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0006dd0 con 0x7ff7e8004810 2023-10-06T02:24:12.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.743+0000 7ff8048f8700 1 -- 172.21.15.37:0/795946035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff800150790 con 0x7ff7e8004810 2023-10-06T02:24:12.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.744+0000 7ff7ee7fc700 1 -- 172.21.15.37:0/795946035 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7f0007260 con 0x7ff7e8004810 2023-10-06T02:24:12.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.745+0000 7ff7ee7fc700 1 --2- 172.21.15.37:0/795946035 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff7e0066f60 0x7ff7e0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.745+0000 7ff7ee7fc700 1 -- 172.21.15.37:0/795946035 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff7f00849b0 con 0x7ff7e8004810 2023-10-06T02:24:12.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.745+0000 7ff7fdd9b700 1 --2- 172.21.15.37:0/795946035 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff7e0066f60 0x7ff7e0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.746+0000 7ff7fdd9b700 1 --2- 172.21.15.37:0/795946035 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff7e0066f60 0x7ff7e0069410 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400c240 tx=0x7ff7f4015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:12.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.747+0000 7ff80dbf0b80 1 Processor -- start 2023-10-06T02:24:12.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.747+0000 7ff80dbf0b80 1 -- start start 2023-10-06T02:24:12.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.747+0000 7ff80dbf0b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e8840 0x55789c3e8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.747+0000 7ff80dbf0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c3e9cc0 0x55789c4386c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.747+0000 7ff80dbf0b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c438c00 0x55789c439050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.747+0000 7ff80dbf0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55789c33fa70 con 0x55789c3e9cc0 2023-10-06T02:24:12.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.747+0000 7ff80dbf0b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55789c33d270 con 0x55789c3e8840 2023-10-06T02:24:12.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.747+0000 7ff80dbf0b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55789c339060 con 0x55789c438c00 2023-10-06T02:24:12.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.748+0000 7ff7fdd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c3e9cc0 0x55789c4386c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.748+0000 7ff7fdd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c3e9cc0 0x55789c4386c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41430/0 (socket says 172.21.15.37:41430) 2023-10-06T02:24:12.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.748+0000 7ff7fdd9b700 1 -- 172.21.15.37:0/4169792839 learned_addr learned my addr 172.21.15.37:0/4169792839 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:12.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.748+0000 7ff7fe59c700 1 --2- 172.21.15.37:0/4169792839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e8840 0x55789c3e8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.748+0000 7ff7fed9d700 1 --2- 172.21.15.37:0/4169792839 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c438c00 0x55789c439050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.748+0000 7ff7fdd9b700 1 -- 172.21.15.37:0/4169792839 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c438c00 msgr2=0x55789c439050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:12.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.748+0000 7ff7fdd9b700 1 --2- 172.21.15.37:0/4169792839 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c438c00 0x55789c439050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.748+0000 7ff7fdd9b700 1 -- 172.21.15.37:0/4169792839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e8840 msgr2=0x55789c3e8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:12.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.748+0000 7ff7fdd9b700 1 --2- 172.21.15.37:0/4169792839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e8840 0x55789c3e8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.748+0000 7ff7fdd9b700 1 -- 172.21.15.37:0/4169792839 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55789c1d3270 con 0x55789c3e9cc0 2023-10-06T02:24:12.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.748+0000 7ff7fed9d700 1 --2- 172.21.15.37:0/4169792839 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c438c00 0x55789c439050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:12.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.748+0000 7ff7fdd9b700 1 --2- 172.21.15.37:0/4169792839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c3e9cc0 0x55789c4386c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400c830 tx=0x7ff7f401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1af3c7b889d71a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:12.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.748+0000 7ff7df7fe700 1 -- 172.21.15.37:0/4169792839 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4000fa0 con 0x55789c3e9cc0 2023-10-06T02:24:12.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.748+0000 7ff7df7fe700 1 -- 172.21.15.37:0/4169792839 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f4000bc0 con 0x55789c3e9cc0 2023-10-06T02:24:12.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.748+0000 7ff7df7fe700 1 -- 172.21.15.37:0/4169792839 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4004830 con 0x55789c3e9cc0 2023-10-06T02:24:12.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.749+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/4169792839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c3e9cc0 msgr2=0x55789c4386c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.749+0000 7ff80dbf0b80 1 --2- 172.21.15.37:0/4169792839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c3e9cc0 0x55789c4386c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400c830 tx=0x7ff7f401e000 comp rx=0 tx=0).stop 2023-10-06T02:24:12.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.749+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/4169792839 shutdown_connections 2023-10-06T02:24:12.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.749+0000 7ff80dbf0b80 1 --2- 172.21.15.37:0/4169792839 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c438c00 0x55789c439050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.749+0000 7ff80dbf0b80 1 --2- 172.21.15.37:0/4169792839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e8840 0x55789c3e8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.749+0000 7ff80dbf0b80 1 --2- 172.21.15.37:0/4169792839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c3e9cc0 0x55789c4386c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.749+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/4169792839 >> 172.21.15.37:0/4169792839 conn(0x55789c3ea160 msgr2=0x55789c3ea530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:12.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.749+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/4169792839 shutdown_connections 2023-10-06T02:24:12.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.749+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/4169792839 wait complete. 2023-10-06T02:24:12.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.750+0000 7ff80dbf0b80 1 -- start start 2023-10-06T02:24:12.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.750+0000 7ff80dbf0b80 1 Processor -- start 2023-10-06T02:24:12.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff80dbf0b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e8840 0x55789c40e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff80dbf0b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c3e9cc0 0x55789c431d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff80dbf0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c438c00 0x55789c414f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff80dbf0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55789c2e4890 con 0x55789c438c00 2023-10-06T02:24:12.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff80dbf0b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55789c2ffea0 con 0x55789c3e8840 2023-10-06T02:24:12.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff80dbf0b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55789c1bbe30 con 0x55789c3e9cc0 2023-10-06T02:24:12.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff80dbf0b80 10 client.0 _ll_register_callbacks cb 0x55789c3abe70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:24:12.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff7fed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c438c00 0x55789c414f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff7fed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c438c00 0x55789c414f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41438/0 (socket says 172.21.15.37:41438) 2023-10-06T02:24:12.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff7fed9d700 1 -- 172.21.15.37:0/665505310 learned_addr learned my addr 172.21.15.37:0/665505310 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:12.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff7fe59c700 1 --2- 172.21.15.37:0/665505310 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e8840 0x55789c40e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff7fdd9b700 1 --2- 172.21.15.37:0/665505310 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c3e9cc0 0x55789c431d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff7fed9d700 1 -- 172.21.15.37:0/665505310 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c3e9cc0 msgr2=0x55789c431d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:12.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff7fed9d700 1 --2- 172.21.15.37:0/665505310 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c3e9cc0 0x55789c431d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff7fed9d700 1 -- 172.21.15.37:0/665505310 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e8840 msgr2=0x55789c40e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:12.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff7fed9d700 1 --2- 172.21.15.37:0/665505310 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e8840 0x55789c40e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff7fed9d700 1 -- 172.21.15.37:0/665505310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e8003570 con 0x55789c438c00 2023-10-06T02:24:12.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff7fed9d700 1 --2- 172.21.15.37:0/665505310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c438c00 0x55789c414f80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff8000b6510 tx=0x7ff7f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a86fc649e34a22 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:12.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff7dcff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:24:12.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff7dcff9700 1 -- 172.21.15.37:0/665505310 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f800e040 con 0x55789c438c00 2023-10-06T02:24:12.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/665505310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55789c3dd940 con 0x55789c438c00 2023-10-06T02:24:12.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.751+0000 7ff7dcff9700 1 -- 172.21.15.37:0/665505310 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff7f8008a10 con 0x55789c438c00 2023-10-06T02:24:12.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.752+0000 7ff7dcff9700 1 -- 172.21.15.37:0/665505310 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7f8008de0 con 0x55789c438c00 2023-10-06T02:24:12.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.752+0000 7ff80dbf0b80 10 client.5160 fetch_fsmap learned FSMap version 16 2023-10-06T02:24:12.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.752+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/665505310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55789c175fe0 con 0x55789c438c00 2023-10-06T02:24:12.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.752+0000 7ff7dcff9700 1 -- 172.21.15.37:0/665505310 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55789c3dd940 con 0x55789c438c00 2023-10-06T02:24:12.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.752+0000 7ff7dcff9700 1 -- 172.21.15.37:0/665505310 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff7f8017440 con 0x55789c438c00 2023-10-06T02:24:12.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.752+0000 7ff80dbf0b80 10 client.5160 fetch_fsmap finished waiting for FSMap version 16 2023-10-06T02:24:12.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.752+0000 7ff80dbf0b80 10 client.5160 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:24:12.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.752+0000 7ff80dbf0b80 20 client.5160 populate_metadata read hostname 'smithi037' 2023-10-06T02:24:12.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.752+0000 7ff80dbf0b80 1 --2- 172.21.15.37:0/665505310 >> [v2:172.21.15.37:6832/967425730,v1:172.21.15.37:6834/967425730] conn(0x55789c3e53f0 0x55789c3e57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.752+0000 7ff80dbf0b80 4 client.5160 mds_command: new command op to 4980 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:24:12.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.752+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/665505310 --> [v2:172.21.15.37:6832/967425730,v1:172.21.15.37:6834/967425730] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55789c3ba870 con 0x55789c3e53f0 2023-10-06T02:24:12.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.752+0000 7ff7fe59c700 1 --2- 172.21.15.37:0/665505310 >> [v2:172.21.15.37:6832/967425730,v1:172.21.15.37:6834/967425730] conn(0x55789c3e53f0 0x55789c3e57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.752+0000 7ff7dcff9700 10 client.5160 ms_handle_connect on v2:172.21.15.37:6832/967425730 2023-10-06T02:24:12.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.752+0000 7ff7fe59c700 1 --2- 172.21.15.37:0/665505310 >> [v2:172.21.15.37:6832/967425730,v1:172.21.15.37:6834/967425730] conn(0x55789c3e53f0 0x55789c3e57c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=155e84bc0b3ee9ea server_cookie=6e0adf28df5835f9 in_seq=0 out_seq=0 2023-10-06T02:24:12.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.753+0000 7ff7dcff9700 1 -- 172.21.15.37:0/665505310 <== mds.0 v2:172.21.15.37:6832/967425730 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55789c3ba870 con 0x55789c3e53f0 2023-10-06T02:24:12.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.753+0000 7ff7dcff9700 10 client.5160 handle_command_reply: tid=0 2023-10-06T02:24:12.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.753+0000 7ff80dbf0b80 1 client.5160 shutdown 2023-10-06T02:24:12.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.753+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/665505310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c438c00 msgr2=0x55789c414f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.753+0000 7ff80dbf0b80 1 --2- 172.21.15.37:0/665505310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c438c00 0x55789c414f80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff8000b6510 tx=0x7ff7f800b040 comp rx=0 tx=0).stop 2023-10-06T02:24:12.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.753+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/665505310 shutdown_connections 2023-10-06T02:24:12.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.753+0000 7ff80dbf0b80 1 --2- 172.21.15.37:0/665505310 >> [v2:172.21.15.37:6832/967425730,v1:172.21.15.37:6834/967425730] conn(0x55789c3e53f0 0x55789c3e57c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.753+0000 7ff80dbf0b80 1 --2- 172.21.15.37:0/665505310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c438c00 0x55789c414f80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.753+0000 7ff80dbf0b80 1 --2- 172.21.15.37:0/665505310 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e8840 0x55789c40e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.753+0000 7ff7dcff9700 0 client.5160 ms_handle_reset on v2:172.21.15.37:6832/967425730 2023-10-06T02:24:12.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.753+0000 7ff80dbf0b80 1 --2- 172.21.15.37:0/665505310 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c3e9cc0 0x55789c431d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.753+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/665505310 >> 172.21.15.37:0/665505310 conn(0x55789c3ea160 msgr2=0x55789c3e3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:12.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.753+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/665505310 shutdown_connections 2023-10-06T02:24:12.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.753+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/665505310 wait complete. 2023-10-06T02:24:12.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.754+0000 7ff80dbf0b80 20 client.5160 trim_cache size 0 max 16384 2023-10-06T02:24:12.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.770+0000 7ff80dbf0b80 1 Processor -- start 2023-10-06T02:24:12.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.771+0000 7ff80dbf0b80 1 -- start start 2023-10-06T02:24:12.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.771+0000 7ff80dbf0b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e8840 0x55789c414e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.771+0000 7ff80dbf0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c3e9cc0 0x55789c3e4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.771+0000 7ff80dbf0b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c438c00 0x55789c3e4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.771+0000 7ff80dbf0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55789c40de10 con 0x55789c3e9cc0 2023-10-06T02:24:12.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.771+0000 7ff80dbf0b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55789c3e5c00 con 0x55789c3e8840 2023-10-06T02:24:12.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.771+0000 7ff80dbf0b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55789c431ad0 con 0x55789c438c00 2023-10-06T02:24:12.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.771+0000 7ff7fdd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c3e9cc0 0x55789c3e4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.771+0000 7ff7fdd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c3e9cc0 0x55789c3e4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41442/0 (socket says 172.21.15.37:41442) 2023-10-06T02:24:12.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.771+0000 7ff7fdd9b700 1 -- 172.21.15.37:0/1398921395 learned_addr learned my addr 172.21.15.37:0/1398921395 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:12.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.772+0000 7ff7fe59c700 1 --2- 172.21.15.37:0/1398921395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e8840 0x55789c414e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.772+0000 7ff7fed9d700 1 --2- 172.21.15.37:0/1398921395 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c438c00 0x55789c3e4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.772+0000 7ff7fdd9b700 1 -- 172.21.15.37:0/1398921395 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c438c00 msgr2=0x55789c3e4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:12.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.772+0000 7ff7fdd9b700 1 --2- 172.21.15.37:0/1398921395 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c438c00 0x55789c3e4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.772+0000 7ff7fdd9b700 1 -- 172.21.15.37:0/1398921395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e8840 msgr2=0x55789c414e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:12.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.772+0000 7ff7fdd9b700 1 --2- 172.21.15.37:0/1398921395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e8840 0x55789c414e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.772+0000 7ff7fdd9b700 1 -- 172.21.15.37:0/1398921395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55789c4317e0 con 0x55789c3e9cc0 2023-10-06T02:24:12.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.772+0000 7ff7fed9d700 1 --2- 172.21.15.37:0/1398921395 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c438c00 0x55789c3e4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:12.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.772+0000 7ff7fdd9b700 1 --2- 172.21.15.37:0/1398921395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c3e9cc0 0x55789c3e4730 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff7f402a000 tx=0x7ff7f4028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b20ec8170b5704 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:12.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.772+0000 7ff7dffff700 1 -- 172.21.15.37:0/1398921395 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4004830 con 0x55789c3e9cc0 2023-10-06T02:24:12.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.772+0000 7ff7dffff700 1 -- 172.21.15.37:0/1398921395 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f4000ed0 con 0x55789c3e9cc0 2023-10-06T02:24:12.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.772+0000 7ff7dffff700 1 -- 172.21.15.37:0/1398921395 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4004db0 con 0x55789c3e9cc0 2023-10-06T02:24:12.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.773+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/1398921395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c3e9cc0 msgr2=0x55789c3e4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.773+0000 7ff80dbf0b80 1 --2- 172.21.15.37:0/1398921395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c3e9cc0 0x55789c3e4730 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff7f402a000 tx=0x7ff7f4028000 comp rx=0 tx=0).stop 2023-10-06T02:24:12.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.773+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/1398921395 shutdown_connections 2023-10-06T02:24:12.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.773+0000 7ff80dbf0b80 1 --2- 172.21.15.37:0/1398921395 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c438c00 0x55789c3e4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.773+0000 7ff80dbf0b80 1 --2- 172.21.15.37:0/1398921395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e8840 0x55789c414e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.773+0000 7ff80dbf0b80 1 --2- 172.21.15.37:0/1398921395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c3e9cc0 0x55789c3e4730 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.773+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/1398921395 >> 172.21.15.37:0/1398921395 conn(0x55789c3ea160 msgr2=0x55789c42f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:12.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.773+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/1398921395 shutdown_connections 2023-10-06T02:24:12.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.773+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/1398921395 wait complete. 2023-10-06T02:24:12.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.774+0000 7ff80dbf0b80 1 -- start start 2023-10-06T02:24:12.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.774+0000 7ff80dbf0b80 1 Processor -- start 2023-10-06T02:24:12.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.775+0000 7ff80dbf0b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c3e8840 0x55789c3e45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.775+0000 7ff80dbf0b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e9cc0 0x55789c4979d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.775+0000 7ff80dbf0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c438c00 0x55789c497f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.775+0000 7ff80dbf0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55789c4987d0 con 0x55789c438c00 2023-10-06T02:24:12.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.775+0000 7ff80dbf0b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55789c40dbd0 con 0x55789c3e9cc0 2023-10-06T02:24:12.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.775+0000 7ff80dbf0b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55789c3e4b20 con 0x55789c3e8840 2023-10-06T02:24:12.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.775+0000 7ff80dbf0b80 10 client.0 _ll_register_callbacks cb 0x55789c3abe70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:24:12.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.775+0000 7ff7fed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c438c00 0x55789c497f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.776+0000 7ff7fed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c438c00 0x55789c497f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41446/0 (socket says 172.21.15.37:41446) 2023-10-06T02:24:12.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.776+0000 7ff7fed9d700 1 -- 172.21.15.37:0/1848700840 learned_addr learned my addr 172.21.15.37:0/1848700840 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:12.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.776+0000 7ff7fdd9b700 1 --2- 172.21.15.37:0/1848700840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e9cc0 0x55789c4979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.776+0000 7ff7fe59c700 1 --2- 172.21.15.37:0/1848700840 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c3e8840 0x55789c3e45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.776+0000 7ff7fed9d700 1 -- 172.21.15.37:0/1848700840 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c3e8840 msgr2=0x55789c3e45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:12.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.776+0000 7ff7fed9d700 1 --2- 172.21.15.37:0/1848700840 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c3e8840 0x55789c3e45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.776+0000 7ff7fed9d700 1 -- 172.21.15.37:0/1848700840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e9cc0 msgr2=0x55789c4979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:12.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.776+0000 7ff7fed9d700 1 --2- 172.21.15.37:0/1848700840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e9cc0 0x55789c4979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.776+0000 7ff7fed9d700 1 -- 172.21.15.37:0/1848700840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55789c1d3270 con 0x55789c438c00 2023-10-06T02:24:12.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.776+0000 7ff7fdd9b700 1 --2- 172.21.15.37:0/1848700840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e9cc0 0x55789c4979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:12.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.776+0000 7ff7fed9d700 1 --2- 172.21.15.37:0/1848700840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c438c00 0x55789c497f10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55789c3e5ef0 tx=0x7ff7f801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7798737797fb6c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:12.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.776+0000 7ff7dcff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:24:12.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.776+0000 7ff7dcff9700 1 -- 172.21.15.37:0/1848700840 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f800e070 con 0x55789c438c00 2023-10-06T02:24:12.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.776+0000 7ff7dcff9700 1 -- 172.21.15.37:0/1848700840 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff7f8008a10 con 0x55789c438c00 2023-10-06T02:24:12.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.776+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/1848700840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff7f4000bc0 con 0x55789c438c00 2023-10-06T02:24:12.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.776+0000 7ff7dcff9700 1 -- 172.21.15.37:0/1848700840 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7f8008550 con 0x55789c438c00 2023-10-06T02:24:12.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.776+0000 7ff80dbf0b80 10 client.5166 fetch_fsmap learned FSMap version 16 2023-10-06T02:24:12.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.776+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/1848700840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55789c307780 con 0x55789c438c00 2023-10-06T02:24:12.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.776+0000 7ff7dcff9700 1 -- 172.21.15.37:0/1848700840 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f4000bc0 con 0x55789c438c00 2023-10-06T02:24:12.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.777+0000 7ff7dcff9700 1 -- 172.21.15.37:0/1848700840 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff7f8017440 con 0x55789c438c00 2023-10-06T02:24:12.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.777+0000 7ff80dbf0b80 10 client.5166 fetch_fsmap finished waiting for FSMap version 16 2023-10-06T02:24:12.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.777+0000 7ff80dbf0b80 10 client.5166 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:24:12.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.777+0000 7ff80dbf0b80 20 client.5166 populate_metadata read hostname 'smithi037' 2023-10-06T02:24:12.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.777+0000 7ff80dbf0b80 1 --2- 172.21.15.37:0/1848700840 >> [v2:172.21.15.37:6832/967425730,v1:172.21.15.37:6834/967425730] conn(0x55789c47d240 0x55789c47d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.777+0000 7ff80dbf0b80 4 client.5166 mds_command: new command op to 4980 tid=0[{"prefix": "status"}] 2023-10-06T02:24:12.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.777+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/1848700840 --> [v2:172.21.15.37:6832/967425730,v1:172.21.15.37:6834/967425730] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55789c2dbe00 con 0x55789c47d240 2023-10-06T02:24:12.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.777+0000 7ff7fe59c700 1 --2- 172.21.15.37:0/1848700840 >> [v2:172.21.15.37:6832/967425730,v1:172.21.15.37:6834/967425730] conn(0x55789c47d240 0x55789c47d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.777+0000 7ff7dcff9700 10 client.5166 ms_handle_connect on v2:172.21.15.37:6832/967425730 2023-10-06T02:24:12.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.777+0000 7ff7fe59c700 1 --2- 172.21.15.37:0/1848700840 >> [v2:172.21.15.37:6832/967425730,v1:172.21.15.37:6834/967425730] conn(0x55789c47d240 0x55789c47d610 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edf90a3aba3caaa5 server_cookie=8066f560cd559ea5 in_seq=0 out_seq=0 2023-10-06T02:24:12.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.777+0000 7ff7dcff9700 1 -- 172.21.15.37:0/1848700840 <== mds.0 v2:172.21.15.37:6832/967425730 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55789c2dbe00 con 0x55789c47d240 2023-10-06T02:24:12.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.777+0000 7ff7dcff9700 10 client.5166 handle_command_reply: tid=0 2023-10-06T02:24:12.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.777+0000 7ff80dbf0b80 1 client.5166 shutdown 2023-10-06T02:24:12.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.777+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/1848700840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c438c00 msgr2=0x55789c497f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.777+0000 7ff80dbf0b80 1 --2- 172.21.15.37:0/1848700840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c438c00 0x55789c497f10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55789c3e5ef0 tx=0x7ff7f801f000 comp rx=0 tx=0).stop 2023-10-06T02:24:12.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/1848700840 shutdown_connections 2023-10-06T02:24:12.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff80dbf0b80 1 --2- 172.21.15.37:0/1848700840 >> [v2:172.21.15.37:6832/967425730,v1:172.21.15.37:6834/967425730] conn(0x55789c47d240 0x55789c47d610 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff80dbf0b80 1 --2- 172.21.15.37:0/1848700840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55789c438c00 0x55789c497f10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff80dbf0b80 1 --2- 172.21.15.37:0/1848700840 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55789c3e8840 0x55789c3e45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff7dcff9700 0 client.5166 ms_handle_reset on v2:172.21.15.37:6832/967425730 2023-10-06T02:24:12.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff80dbf0b80 1 --2- 172.21.15.37:0/1848700840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55789c3e9cc0 0x55789c4979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/1848700840 >> 172.21.15.37:0/1848700840 conn(0x55789c3ea160 msgr2=0x55789c4294a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:12.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/1848700840 shutdown_connections 2023-10-06T02:24:12.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff80dbf0b80 1 -- 172.21.15.37:0/1848700840 wait complete. 2023-10-06T02:24:12.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff80dbf0b80 20 client.5166 trim_cache size 0 max 16384 2023-10-06T02:24:12.785 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:24:12.785 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "d1f292a2-fd8c-430a-be88-f44de408e77c", 2023-10-06T02:24:12.786 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-10-06T02:24:12.786 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4980, 2023-10-06T02:24:12.786 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-10-06T02:24:12.786 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-10-06T02:24:12.786 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-10-06T02:24:12.786 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 5.9030465550000004, 2023-10-06T02:24:12.786 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 16, 2023-10-06T02:24:12.786 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 31, 2023-10-06T02:24:12.786 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 31, 2023-10-06T02:24:12.786 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 13.755388643 2023-10-06T02:24:12.786 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:24:12.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff8048f8700 1 -- 172.21.15.37:0/795946035 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff7e0066f60 msgr2=0x7ff7e0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff8048f8700 1 --2- 172.21.15.37:0/795946035 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff7e0066f60 0x7ff7e0069410 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400c240 tx=0x7ff7f4015000 comp rx=0 tx=0).stop 2023-10-06T02:24:12.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff8048f8700 1 -- 172.21.15.37:0/795946035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7e8004810 msgr2=0x7ff800152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff8048f8700 1 --2- 172.21.15.37:0/795946035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7e8004810 0x7ff800152360 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0002a90 tx=0x7ff7f0007d30 comp rx=0 tx=0).stop 2023-10-06T02:24:12.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff8048f8700 1 -- 172.21.15.37:0/795946035 shutdown_connections 2023-10-06T02:24:12.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff8048f8700 1 --2- 172.21.15.37:0/795946035 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff8000b43e0 0x7ff8000b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff8048f8700 1 --2- 172.21.15.37:0/795946035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7e8004810 0x7ff800152360 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff8048f8700 1 --2- 172.21.15.37:0/795946035 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff7e0066f60 0x7ff7e0069410 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff8048f8700 1 --2- 172.21.15.37:0/795946035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff80014f140 0x7ff800150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff8048f8700 1 -- 172.21.15.37:0/795946035 >> 172.21.15.37:0/795946035 conn(0x7ff8000d0510 msgr2=0x7ff8000b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:12.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff8048f8700 1 -- 172.21.15.37:0/795946035 shutdown_connections 2023-10-06T02:24:12.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.778+0000 7ff8048f8700 1 -- 172.21.15.37:0/795946035 wait complete. 2023-10-06T02:24:12.792 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:24:12.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.911+0000 7f67d7383700 1 Processor -- start 2023-10-06T02:24:12.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.911+0000 7f67d7383700 1 -- start start 2023-10-06T02:24:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.912+0000 7f67d7383700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67d015a320 0x7f67d015a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.912+0000 7f67d7383700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f67d0155bc0 0x7f67d0156040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.912+0000 7f67d7383700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d0156580 con 0x7f67d0159f50 2023-10-06T02:24:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.912+0000 7f67d7383700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d00c7420 con 0x7f67d0155bc0 2023-10-06T02:24:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.912+0000 7f67d7383700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d00c7700 con 0x7f67d015a320 2023-10-06T02:24:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.912+0000 7f67d6b82700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f67d0155bc0 0x7f67d0156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.912+0000 7f67d6381700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f67d0159f50 0x7f67d00c0cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58166/0 (socket says 172.21.15.37:58166) 2023-10-06T02:24:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.912+0000 7f67d6381700 1 -- 172.21.15.37:0/2976364624 learned_addr learned my addr 172.21.15.37:0/2976364624 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.912+0000 7f67d5b80700 1 --2- 172.21.15.37:0/2976364624 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67d015a320 0x7f67d015a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.912+0000 7f67d6b82700 1 -- 172.21.15.37:0/2976364624 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67d015a320 msgr2=0x7f67d015a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.912+0000 7f67d6b82700 1 --2- 172.21.15.37:0/2976364624 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67d015a320 0x7f67d015a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.912+0000 7f67d6b82700 1 -- 172.21.15.37:0/2976364624 >> v1:172.21.15.37:6789/0 conn(0x7f67d0159f50 legacy=0x7f67d00c0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.912+0000 7f67d537f700 1 -- 172.21.15.37:0/2976364624 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280711422 0 0) 0x7f67d0156580 con 0x7f67d0159f50 2023-10-06T02:24:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.912+0000 7f67d6b82700 1 -- 172.21.15.37:0/2976364624 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d00c79e0 con 0x7f67d0155bc0 2023-10-06T02:24:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.912+0000 7f67d6b82700 1 --2- 172.21.15.37:0/2976364624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67d0155bc0 0x7f67d0156040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f67c8009e60 tx=0x7f67c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fc9abeaa35e55f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.913+0000 7f67d537f700 1 -- 172.21.15.37:0/2976364624 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c800e070 con 0x7f67d0155bc0 2023-10-06T02:24:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.913+0000 7f67d537f700 1 -- 172.21.15.37:0/2976364624 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c800bc30 con 0x7f67d0155bc0 2023-10-06T02:24:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.913+0000 7f67d537f700 1 -- 172.21.15.37:0/2976364624 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c8012430 con 0x7f67d0155bc0 2023-10-06T02:24:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.913+0000 7f67d7383700 1 -- 172.21.15.37:0/2976364624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67d0155bc0 msgr2=0x7f67d0156040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.913+0000 7f67d7383700 1 --2- 172.21.15.37:0/2976364624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67d0155bc0 0x7f67d0156040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f67c8009e60 tx=0x7f67c8009780 comp rx=0 tx=0).stop 2023-10-06T02:24:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.913+0000 7f67d7383700 1 -- 172.21.15.37:0/2976364624 shutdown_connections 2023-10-06T02:24:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.913+0000 7f67d7383700 1 --2- 172.21.15.37:0/2976364624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67d0155bc0 0x7f67d0156040 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.913+0000 7f67d7383700 1 --2- 172.21.15.37:0/2976364624 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67d015a320 0x7f67d015a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.913+0000 7f67d7383700 1 -- 172.21.15.37:0/2976364624 >> 172.21.15.37:0/2976364624 conn(0x7f67d00cbf20 msgr2=0x7f67d00cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.913+0000 7f67d7383700 1 -- 172.21.15.37:0/2976364624 shutdown_connections 2023-10-06T02:24:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.913+0000 7f67d7383700 1 -- 172.21.15.37:0/2976364624 wait complete. 2023-10-06T02:24:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.914+0000 7f67d7383700 1 Processor -- start 2023-10-06T02:24:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.914+0000 7f67d7383700 1 -- start start 2023-10-06T02:24:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.915+0000 7f67d7383700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67d0155bc0 0x7f67d014a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.915+0000 7f67d7383700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67d0159f50 0x7f67d00c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.915+0000 7f67d7383700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67d015a320 0x7f67d0168400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.915+0000 7f67d7383700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d0156ae0 con 0x7f67d0159f50 2023-10-06T02:24:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.915+0000 7f67d7383700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d014a9b0 con 0x7f67d0155bc0 2023-10-06T02:24:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.915+0000 7f67d7383700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d0158540 con 0x7f67d015a320 2023-10-06T02:24:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.915+0000 7f67d5b80700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67d0159f50 0x7f67d00c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.915+0000 7f67d5b80700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67d0159f50 0x7f67d00c4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41468/0 (socket says 172.21.15.37:41468) 2023-10-06T02:24:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.915+0000 7f67d5b80700 1 -- 172.21.15.37:0/417160086 learned_addr learned my addr 172.21.15.37:0/417160086 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.915+0000 7f67d6381700 1 --2- 172.21.15.37:0/417160086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67d0155bc0 0x7f67d014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.915+0000 7f67d6b82700 1 --2- 172.21.15.37:0/417160086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67d015a320 0x7f67d0168400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.915+0000 7f67d5b80700 1 -- 172.21.15.37:0/417160086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67d015a320 msgr2=0x7f67d0168400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.915+0000 7f67d5b80700 1 --2- 172.21.15.37:0/417160086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67d015a320 0x7f67d0168400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.915+0000 7f67d5b80700 1 -- 172.21.15.37:0/417160086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67d0155bc0 msgr2=0x7f67d014a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.915+0000 7f67d5b80700 1 --2- 172.21.15.37:0/417160086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67d0155bc0 0x7f67d014a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.916+0000 7f67d5b80700 1 -- 172.21.15.37:0/417160086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c8009a20 con 0x7f67d0159f50 2023-10-06T02:24:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.916+0000 7f67d5b80700 1 --2- 172.21.15.37:0/417160086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67d0159f50 0x7f67d00c4ff0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f67c000d890 tx=0x7f67c0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.916+0000 7f67c67fc700 1 -- 172.21.15.37:0/417160086 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c000b600 con 0x7f67d0159f50 2023-10-06T02:24:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.916+0000 7f67c67fc700 1 -- 172.21.15.37:0/417160086 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c000b760 con 0x7f67d0159f50 2023-10-06T02:24:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.916+0000 7f67d7383700 1 -- 172.21.15.37:0/417160086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d0158820 con 0x7f67d0159f50 2023-10-06T02:24:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.916+0000 7f67c67fc700 1 -- 172.21.15.37:0/417160086 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c000bae0 con 0x7f67d0159f50 2023-10-06T02:24:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.916+0000 7f67d7383700 1 -- 172.21.15.37:0/417160086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d0156770 con 0x7f67d0159f50 2023-10-06T02:24:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.917+0000 7f67d7383700 1 -- 172.21.15.37:0/417160086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d00c5de0 con 0x7f67d0159f50 2023-10-06T02:24:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.917+0000 7f67c67fc700 1 -- 172.21.15.37:0/417160086 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f67c001e460 con 0x7f67d0159f50 2023-10-06T02:24:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.918+0000 7f67c67fc700 1 --2- 172.21.15.37:0/417160086 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f67b4066f30 0x7f67b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.918+0000 7f67c67fc700 1 -- 172.21.15.37:0/417160086 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f67c0084da0 con 0x7f67d0159f50 2023-10-06T02:24:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.918+0000 7f67d6381700 1 --2- 172.21.15.37:0/417160086 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f67b4066f30 0x7f67b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.918+0000 7f67d6381700 1 --2- 172.21.15.37:0/417160086 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f67b4066f30 0x7f67b40693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00c8f0 tx=0x7f67cc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:12.922+0000 7f67c67fc700 1 -- 172.21.15.37:0/417160086 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67c0051eb0 con 0x7f67d0159f50 2023-10-06T02:24:13.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:13.160+0000 7f67d7383700 1 -- 172.21.15.37:0/417160086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f67d0064b00 con 0x7f67d0159f50 2023-10-06T02:24:13.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:13.160+0000 7f67c67fc700 1 -- 172.21.15.37:0/417160086 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f67c00554d0 con 0x7f67d0159f50 2023-10-06T02:24:13.161 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:24:13.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:13.162+0000 7f67d7383700 1 -- 172.21.15.37:0/417160086 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f67b4066f30 msgr2=0x7f67b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:13.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:13.162+0000 7f67d7383700 1 --2- 172.21.15.37:0/417160086 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f67b4066f30 0x7f67b40693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00c8f0 tx=0x7f67cc009040 comp rx=0 tx=0).stop 2023-10-06T02:24:13.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:13.162+0000 7f67d7383700 1 -- 172.21.15.37:0/417160086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67d0159f50 msgr2=0x7f67d00c4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:13.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:13.162+0000 7f67d7383700 1 --2- 172.21.15.37:0/417160086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67d0159f50 0x7f67d00c4ff0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f67c000d890 tx=0x7f67c0008040 comp rx=0 tx=0).stop 2023-10-06T02:24:13.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:13.162+0000 7f67d7383700 1 -- 172.21.15.37:0/417160086 shutdown_connections 2023-10-06T02:24:13.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:13.162+0000 7f67d7383700 1 --2- 172.21.15.37:0/417160086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67d015a320 0x7f67d0168400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:13.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:13.162+0000 7f67d7383700 1 --2- 172.21.15.37:0/417160086 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f67b4066f30 0x7f67b40693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:13.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:13.162+0000 7f67d7383700 1 --2- 172.21.15.37:0/417160086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67d0155bc0 0x7f67d014a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:13.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:13.162+0000 7f67d7383700 1 --2- 172.21.15.37:0/417160086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67d0159f50 0x7f67d00c4ff0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:13.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:13.162+0000 7f67d7383700 1 -- 172.21.15.37:0/417160086 >> 172.21.15.37:0/417160086 conn(0x7f67d00cbf20 msgr2=0x7f67d00ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:13.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:13.162+0000 7f67d7383700 1 -- 172.21.15.37:0/417160086 shutdown_connections 2023-10-06T02:24:13.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:13.162+0000 7f67d7383700 1 -- 172.21.15.37:0/417160086 wait complete. 2023-10-06T02:24:13.175 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:24:13.175 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:24:13.175 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-10-06T02:24:13.175 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:24:13.175 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:13.175 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:24:13.175 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:24:13.175 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:24:13.176 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:24:13.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:13.176 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-10-06T02:24:13.191 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:24:13.191 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:24:13.191 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:24:13.191 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:13.191 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T02:24:13.191 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:13.192 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:24:13.192 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:24:13.192 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-10-06T02:24:13.192 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:24:13.192 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:24:13.192 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-10-06T02:24:13.192 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:24:13.192 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42429sec preferred_lft 42429sec 2023-10-06T02:24:13.192 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-10-06T02:24:13.192 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:13.192 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:24:13.192 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:24:13.193 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-10-06T02:24:13.193 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:24:13.193 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:24:13.193 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-10-06T02:24:13.193 INFO:teuthology.orchestra.run.smithi037.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:24:13.193 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 26:84:4a:aa:8b:b5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:24:13.193 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:24:13.193 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:13.193 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::a0fb:38ff:fe90:57e1/64 scope link 2023-10-06T02:24:13.193 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:13.193 INFO:teuthology.orchestra.run.smithi037.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:24:13.193 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 36:fb:a9:50:59:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:24:13.194 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::34fb:a9ff:fe50:5976/64 scope link 2023-10-06T02:24:13.194 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:13.194 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:24:13.194 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 26:84:4a:aa:8b:b5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:24:13.194 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::2484:4aff:feaa:8bb5/64 scope link 2023-10-06T02:24:13.194 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:13.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:13.194 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:24:13.254 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T02:24:13.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:13.256 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-10-06T02:24:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-10-06T02:24:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:24:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:24:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:24:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:24:13.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:13.313 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T02:24:13.313 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T02:24:13.313 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:24:13.313 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:24:13.313 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:24:13.313 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T02:24:13.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:13.414 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T02:24:13.429 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:24:13.429 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:24:13.429 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:24:13.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:13.430 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-10-06T02:24:13.494 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:24:13.495 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:24:13.495 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:13.549 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:24:13.549 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:24:13.549 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:13.603 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T02:24:13.669 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:24:13.669 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:24:13.734 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:24:13.735 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:24:13.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:13.736 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T02:24:13.791 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:24:13.791 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:24:13.833 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T02:24:13.859 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:24:13.859 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:24:13.917 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-10-06T02:24:13.916+0000 7fa735573540 -1 init, newargv = 0x5621e87469d0 newargc=15 2023-10-06T02:24:13.917 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[103772]: starting ceph client 2023-10-06T02:24:13.922 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[103772]: starting fuse 2023-10-06T02:24:13.927 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:24:13.928 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:24:13.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:13.928 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T02:24:13.983 INFO:teuthology.orchestra.run.smithi037.stdout:46 2023-10-06T02:24:13.983 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T02:24:13.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:24:13.983 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-10-06T02:24:13.983 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-10-06T02:24:13.983 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:24:13.984 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-10-06T02:24:13.984 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:24:13.984 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-10-06T02:24:13.984 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:24:13.984 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-10-06T02:24:13.984 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:24:13.984 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:24:13.984 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-10-06T02:24:13.984 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-10-06T02:24:13.984 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-10-06T02:24:13.984 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-10-06T02:24:13.984 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:24:13.984 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-10-06T02:24:13.985 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:24:13.985 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:24:13.985 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:24:13.985 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-10-06T02:24:13.985 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-10-06T02:24:13.985 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-10-06T02:24:13.985 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:24:13.985 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:24:13.985 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-10-06T02:24:13.985 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:24:14.105 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.103772.asok 2023-10-06T02:24:14.287 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.103772.asok 2023-10-06T02:24:14.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:14.288 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.103772.asok status 2023-10-06T02:24:14.441 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:24:14.442 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-10-06T02:24:14.442 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:24:14.442 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:24:14.442 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-10-06T02:24:14.442 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-10-06T02:24:14.442 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:24:14.442 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "103772", 2023-10-06T02:24:14.442 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-10-06T02:24:14.442 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:14.442 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-10-06T02:24:14.442 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-10-06T02:24:14.443 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5178, 2023-10-06T02:24:14.443 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-10-06T02:24:14.443 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-10-06T02:24:14.443 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-10-06T02:24:14.443 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 5178 2023-10-06T02:24:14.443 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:14.443 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T02:24:14.443 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T02:24:14.443 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:24:14.443 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2643892273 2023-10-06T02:24:14.443 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:14.443 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:14.444 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T02:24:14.444 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T02:24:14.444 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:24:14.444 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2643892273 2023-10-06T02:24:14.444 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:14.444 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.5178 192.168.0.1:0/2643892273", 2023-10-06T02:24:14.444 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/2643892273", 2023-10-06T02:24:14.444 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-10-06T02:24:14.444 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 16, 2023-10-06T02:24:14.444 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 31, 2023-10-06T02:24:14.444 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:24:14.444 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-10-06T02:24:14.445 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-10-06T02:24:14.445 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:24:14.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:14.451 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-10-06T02:24:14.452 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:14.467 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-10-06T02:24:14.467 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:14.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:14.468 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:14.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:14.532 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2023-10-06T02:24:14.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:14.594 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2023-10-06T02:24:14.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:14.652 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2023-10-06T02:24:14.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:14.709 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2023-10-06T02:24:14.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:14.771 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2023-10-06T02:24:14.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:14.828 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2023-10-06T02:24:14.892 INFO:teuthology.orchestra.run.smithi037.stdout:./ 2023-10-06T02:24:14.892 INFO:teuthology.orchestra.run.smithi037.stdout:./rfile 2023-10-06T02:24:14.892 INFO:teuthology.orchestra.run.smithi037.stdout:./parentdir 2023-10-06T02:24:14.892 INFO:teuthology.orchestra.run.smithi037.stdout:./parentdir/pfile 2023-10-06T02:24:14.892 INFO:teuthology.orchestra.run.smithi037.stdout:./parentdir/childdir 2023-10-06T02:24:14.892 INFO:teuthology.orchestra.run.smithi037.stdout:./parentdir/childdir/cfile 2023-10-06T02:24:14.893 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:24:14.894 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:24:14.894 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:24:14.894 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:24:14.894 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2023-10-06T02:24:14.894 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:24:15.000 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T02:24:15.188 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:24:15.188 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:24:15.189 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:24:15.189 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:24:15.189 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2023-10-06T02:24:15.189 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:24:15.294 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627778 2023-10-06T02:24:15.483 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:24:15.483 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:24:15.483 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:24:15.483 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:24:15.484 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2023-10-06T02:24:15.484 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:24:15.589 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627776 2023-10-06T02:24:15.779 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:24:15.779 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:24:15.779 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:24:15.779 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:24:15.779 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2023-10-06T02:24:15.779 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:24:15.886 INFO:teuthology.orchestra.run.smithi037.stdout:1099511628279 2023-10-06T02:24:16.075 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:24:16.075 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:24:16.075 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:24:16.075 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:24:16.076 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2023-10-06T02:24:16.076 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:24:16.182 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627777 2023-10-06T02:24:16.370 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:24:16.371 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:24:16.371 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:24:16.371 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:24:16.371 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2023-10-06T02:24:16.371 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:24:16.476 INFO:teuthology.orchestra.run.smithi037.stdout:1099511628280 2023-10-06T02:24:16.665 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-10-06T02:24:16.665 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:24:16.665 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:16.740 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[103772]: fuse finished with error 0 and tester_r 0 2023-10-06T02:24:16.741 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:24:21.266 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:24:21.269 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:24:22.842 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:24:22.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:22.843 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:24:22.861 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:23.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.031+0000 7f618401d700 1 Processor -- start 2023-10-06T02:24:23.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.031+0000 7f618401d700 1 -- start start 2023-10-06T02:24:23.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.032+0000 7f618401d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f617c0a8920 0x7f617c0b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:23.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.032+0000 7f618401d700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f617c0a8cf0 0x7f617c0b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:23.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.032+0000 7f618401d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617c15d1f0 con 0x7f617c159040 2023-10-06T02:24:23.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.032+0000 7f618401d700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f617c159ba0 con 0x7f617c0a8cf0 2023-10-06T02:24:23.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.032+0000 7f618401d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c0b4150 con 0x7f617c0a8920 2023-10-06T02:24:23.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.032+0000 7f61825ba700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f617c159040 0x7f617c159490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43712/0 (socket says 172.21.15.37:43712) 2023-10-06T02:24:23.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.032+0000 7f61825ba700 1 -- 172.21.15.37:0/826779675 learned_addr learned my addr 172.21.15.37:0/826779675 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:23.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.032+0000 7f61815b8700 1 --2- 172.21.15.37:0/826779675 >> v2:172.21.15.191:3300/0 conn(0x7f617c0a8cf0 0x7f617c0b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:23.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.032+0000 7f6181db9700 1 --2- 172.21.15.37:0/826779675 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f617c0a8920 0x7f617c0b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:23.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.032+0000 7f6180db7700 1 -- 172.21.15.37:0/826779675 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871773510 0 0) 0x7f617c15d1f0 con 0x7f617c159040 2023-10-06T02:24:23.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.032+0000 7f6180db7700 1 -- 172.21.15.37:0/826779675 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6164003570 con 0x7f617c159040 2023-10-06T02:24:23.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.032+0000 7f6180db7700 1 -- 172.21.15.37:0/826779675 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2691421772 0 0) 0x7f6164003570 con 0x7f617c159040 2023-10-06T02:24:23.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.032+0000 7f6180db7700 1 -- 172.21.15.37:0/826779675 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f617c0a8920 msgr2=0x7f617c0b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:23.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.032+0000 7f6180db7700 1 --2- 172.21.15.37:0/826779675 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f617c0a8920 0x7f617c0b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.032+0000 7f6180db7700 1 -- 172.21.15.37:0/826779675 >> v2:172.21.15.191:3300/0 conn(0x7f617c0a8cf0 msgr2=0x7f617c0b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:23.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f6180db7700 1 --2- 172.21.15.37:0/826779675 >> v2:172.21.15.191:3300/0 conn(0x7f617c0a8cf0 0x7f617c0b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f6180db7700 1 -- 172.21.15.37:0/826779675 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c15dd70 con 0x7f617c159040 2023-10-06T02:24:23.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f6180db7700 1 -- 172.21.15.37:0/826779675 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f6174001470 con 0x7f617c159040 2023-10-06T02:24:23.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f6180db7700 1 -- 172.21.15.37:0/826779675 >> v1:172.21.15.37:6789/0 conn(0x7f617c159040 legacy=0x7f617c159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:23.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f6180db7700 1 --2- 172.21.15.37:0/826779675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6164003a60 0x7f6164003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f6180db7700 1 --2- 172.21.15.37:0/826779675 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f617c0a8920 0x7f6164004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f6180db7700 1 --2- 172.21.15.37:0/826779675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6164004d50 0x7f61640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f6180db7700 1 -- 172.21.15.37:0/826779675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c159ba0 con 0x7f6164003a60 2023-10-06T02:24:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f6180db7700 1 -- 172.21.15.37:0/826779675 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616400ba60 con 0x7f6164004d50 2023-10-06T02:24:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f6180db7700 1 -- 172.21.15.37:0/826779675 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616400bba0 con 0x7f617c0a8920 2023-10-06T02:24:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f61815b8700 1 --2- 172.21.15.37:0/826779675 >> v2:172.21.15.191:3300/0 conn(0x7f617c0a8cf0 0x7f617c0b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:24:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f6181db9700 1 --2- 172.21.15.37:0/826779675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6164003a60 0x7f6164003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f61825ba700 1 --2- 172.21.15.37:0/826779675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6164004d50 0x7f61640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f61815b8700 1 --2- 172.21.15.37:0/826779675 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f617c0a8920 0x7f6164004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f6181db9700 1 -- 172.21.15.37:0/826779675 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f617c0a8920 msgr2=0x7f6164004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f6181db9700 1 --2- 172.21.15.37:0/826779675 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f617c0a8920 0x7f6164004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f6181db9700 1 -- 172.21.15.37:0/826779675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6164004d50 msgr2=0x7f61640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:23.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f6181db9700 1 --2- 172.21.15.37:0/826779675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6164004d50 0x7f61640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f6181db9700 1 -- 172.21.15.37:0/826779675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6164003570 con 0x7f6164003a60 2023-10-06T02:24:23.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f61825ba700 1 --2- 172.21.15.37:0/826779675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6164004d50 0x7f61640051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:23.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f6181db9700 1 --2- 172.21.15.37:0/826779675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6164003a60 0x7f6164003e70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f616c00e2d0 tx=0x7f616c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33503253def04037 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:23.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f6180db7700 1 -- 172.21.15.37:0/826779675 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c00eac0 con 0x7f6164003a60 2023-10-06T02:24:23.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f6180db7700 1 -- 172.21.15.37:0/826779675 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616c00f040 con 0x7f6164003a60 2023-10-06T02:24:23.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.033+0000 7f6180db7700 1 -- 172.21.15.37:0/826779675 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c00ee70 con 0x7f6164003a60 2023-10-06T02:24:23.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.034+0000 7f618401d700 1 -- 172.21.15.37:0/826779675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6164003a60 msgr2=0x7f6164003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:23.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.034+0000 7f618401d700 1 --2- 172.21.15.37:0/826779675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6164003a60 0x7f6164003e70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f616c00e2d0 tx=0x7f616c00b040 comp rx=0 tx=0).stop 2023-10-06T02:24:23.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.034+0000 7f61825ba700 1 -- 172.21.15.37:0/826779675 reap_dead start 2023-10-06T02:24:23.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.034+0000 7f618401d700 1 -- 172.21.15.37:0/826779675 shutdown_connections 2023-10-06T02:24:23.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.034+0000 7f618401d700 1 -- 172.21.15.37:0/826779675 >> 172.21.15.37:0/826779675 conn(0x7f617c067b30 msgr2=0x7f617c067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.034+0000 7f618401d700 1 -- 172.21.15.37:0/826779675 shutdown_connections 2023-10-06T02:24:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.034+0000 7f618401d700 1 -- 172.21.15.37:0/826779675 wait complete. 2023-10-06T02:24:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.035+0000 7f618401d700 1 Processor -- start 2023-10-06T02:24:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.035+0000 7f618401d700 1 -- start start 2023-10-06T02:24:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.036+0000 7f618401d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6164003a60 0x7f617c13adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.036+0000 7f618401d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f617c15c790 0x7f617c15cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.036+0000 7f618401d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f617c15ba70 0x7f617c15bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.036+0000 7f618401d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c15f4c0 con 0x7f6164003a60 2023-10-06T02:24:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.036+0000 7f618401d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c15f760 con 0x7f617c15c790 2023-10-06T02:24:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.036+0000 7f618401d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c15fa40 con 0x7f617c15ba70 2023-10-06T02:24:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.036+0000 7f6181db9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6164003a60 0x7f617c13adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.036+0000 7f6181db9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6164003a60 0x7f617c13adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42810/0 (socket says 172.21.15.37:42810) 2023-10-06T02:24:23.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.036+0000 7f6181db9700 1 -- 172.21.15.37:0/288203800 learned_addr learned my addr 172.21.15.37:0/288203800 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:23.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.036+0000 7f61825ba700 1 --2- 172.21.15.37:0/288203800 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f617c15ba70 0x7f617c15bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:23.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.036+0000 7f61815b8700 1 --2- 172.21.15.37:0/288203800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f617c15c790 0x7f617c15cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:23.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.036+0000 7f6181db9700 1 -- 172.21.15.37:0/288203800 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f617c15ba70 msgr2=0x7f617c15bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:23.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.036+0000 7f6181db9700 1 --2- 172.21.15.37:0/288203800 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f617c15ba70 0x7f617c15bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.036+0000 7f6181db9700 1 -- 172.21.15.37:0/288203800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f617c15c790 msgr2=0x7f617c15cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:23.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.036+0000 7f6181db9700 1 --2- 172.21.15.37:0/288203800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f617c15c790 0x7f617c15cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.036+0000 7f6181db9700 1 -- 172.21.15.37:0/288203800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c15fd20 con 0x7f6164003a60 2023-10-06T02:24:23.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.036+0000 7f61825ba700 1 --2- 172.21.15.37:0/288203800 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f617c15ba70 0x7f617c15bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:23.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.036+0000 7f61815b8700 1 --2- 172.21.15.37:0/288203800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f617c15c790 0x7f617c15cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:23.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.036+0000 7f6181db9700 1 --2- 172.21.15.37:0/288203800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6164003a60 0x7f617c13adc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6164004730 tx=0x7f616c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:23.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.037+0000 7f6179ffb700 1 -- 172.21.15.37:0/288203800 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c01d420 con 0x7f6164003a60 2023-10-06T02:24:23.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.037+0000 7f6179ffb700 1 -- 172.21.15.37:0/288203800 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616c01d5a0 con 0x7f6164003a60 2023-10-06T02:24:23.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.037+0000 7f6179ffb700 1 -- 172.21.15.37:0/288203800 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c01d960 con 0x7f6164003a60 2023-10-06T02:24:23.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.037+0000 7f618401d700 1 -- 172.21.15.37:0/288203800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617c15d140 con 0x7f6164003a60 2023-10-06T02:24:23.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.037+0000 7f618401d700 1 -- 172.21.15.37:0/288203800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617c13b300 con 0x7f6164003a60 2023-10-06T02:24:23.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.038+0000 7f618401d700 1 -- 172.21.15.37:0/288203800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617c0a5e80 con 0x7f6164003a60 2023-10-06T02:24:23.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.038+0000 7f6179ffb700 1 -- 172.21.15.37:0/288203800 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f616c003040 con 0x7f6164003a60 2023-10-06T02:24:23.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.039+0000 7f6179ffb700 1 --2- 172.21.15.37:0/288203800 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6168066f30 0x7f61680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:23.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.039+0000 7f6179ffb700 1 -- 172.21.15.37:0/288203800 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f616c086b90 con 0x7f6164003a60 2023-10-06T02:24:23.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.039+0000 7f61815b8700 1 --2- 172.21.15.37:0/288203800 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6168066f30 0x7f61680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:23.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.039+0000 7f61815b8700 1 --2- 172.21.15.37:0/288203800 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6168066f30 0x7f61680693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6170006d80 tx=0x7f6170008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:23.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.043+0000 7f6179ffb700 1 -- 172.21.15.37:0/288203800 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f616c053ca0 con 0x7f6164003a60 2023-10-06T02:24:23.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.280+0000 7f618401d700 1 -- 172.21.15.37:0/288203800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f617c15feb0 con 0x7f6164003a60 2023-10-06T02:24:23.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.280+0000 7f6179ffb700 1 -- 172.21.15.37:0/288203800 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f616c018020 con 0x7f6164003a60 2023-10-06T02:24:23.281 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:23.281 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1320242500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1320242500},{"type":"v1","addr":"172.21.15.37:6835","nonce":1320242500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4900,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/3862379925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3862379925},{"type":"v1","addr":"172.21.15.191:6836","nonce":3862379925}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1922753638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":1922753638},{"type":"v1","addr":"172.21.15.191:6837","nonce":1922753638}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:06.274246+0000","modified":"2023-10-06T02:24:09.884600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/967425730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":967425730},{"type":"v1","addr":"172.21.15.37:6834","nonce":967425730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:24:23.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.283+0000 7f618401d700 1 -- 172.21.15.37:0/288203800 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6168066f30 msgr2=0x7f61680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:23.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.283+0000 7f618401d700 1 --2- 172.21.15.37:0/288203800 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6168066f30 0x7f61680693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6170006d80 tx=0x7f6170008040 comp rx=0 tx=0).stop 2023-10-06T02:24:23.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.283+0000 7f618401d700 1 -- 172.21.15.37:0/288203800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6164003a60 msgr2=0x7f617c13adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:23.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.283+0000 7f618401d700 1 --2- 172.21.15.37:0/288203800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6164003a60 0x7f617c13adc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6164004730 tx=0x7f616c01a000 comp rx=0 tx=0).stop 2023-10-06T02:24:23.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.283+0000 7f618401d700 1 -- 172.21.15.37:0/288203800 shutdown_connections 2023-10-06T02:24:23.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.283+0000 7f618401d700 1 --2- 172.21.15.37:0/288203800 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f617c15ba70 0x7f617c15bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.283+0000 7f618401d700 1 --2- 172.21.15.37:0/288203800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6164003a60 0x7f617c13adc0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.283+0000 7f618401d700 1 --2- 172.21.15.37:0/288203800 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6168066f30 0x7f61680693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.283+0000 7f618401d700 1 --2- 172.21.15.37:0/288203800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f617c15c790 0x7f617c15cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.283+0000 7f618401d700 1 -- 172.21.15.37:0/288203800 >> 172.21.15.37:0/288203800 conn(0x7f617c067b30 msgr2=0x7f617c1534d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:23.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.283+0000 7f618401d700 1 -- 172.21.15.37:0/288203800 shutdown_connections 2023-10-06T02:24:23.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.283+0000 7f618401d700 1 -- 172.21.15.37:0/288203800 wait complete. 2023-10-06T02:24:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2023-10-06T02:24:23.295 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-10-06T02:24:23.445 INFO:teuthology.orchestra.run.smithi037.stdout:{"message":"","return_code":0} 2023-10-06T02:24:23.446 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T02:24:23.446 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:23.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.564+0000 7f4529410700 1 Processor -- start 2023-10-06T02:24:23.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.565+0000 7f4529410700 1 -- start start 2023-10-06T02:24:23.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.565+0000 7f4529410700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4524159760 0x7f452415d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:23.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.565+0000 7f4529410700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f452415dd50 0x7f45240cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:23.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.565+0000 7f4529410700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f452415e1d0 con 0x7f452415d8d0 2023-10-06T02:24:23.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.565+0000 7f4529410700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45240cc2d0 con 0x7f4524159760 2023-10-06T02:24:23.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.565+0000 7f4529410700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45240cb650 con 0x7f452415dd50 2023-10-06T02:24:23.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.566+0000 7f45237fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f452415dd50 0x7f45240cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:23.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.566+0000 7f4522ffd700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4524159760 0x7f452415d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:23.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.566+0000 7f45237fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f452415dd50 0x7f45240cfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:60692/0 (socket says 172.21.15.37:60692) 2023-10-06T02:24:23.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.566+0000 7f45227fc700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f452415d8d0 0x7f45240c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:43112/0 (socket says 172.21.15.37:43112) 2023-10-06T02:24:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.566+0000 7f4522ffd700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4524159760 0x7f452415d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:50760/0 (socket says 172.21.15.37:50760) 2023-10-06T02:24:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.566+0000 7f45237fe700 1 -- 172.21.15.37:0/2914087420 learned_addr learned my addr 172.21.15.37:0/2914087420 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.566+0000 7f45237fe700 1 -- 172.21.15.37:0/2914087420 >> v2:172.21.15.191:3300/0 conn(0x7f4524159760 msgr2=0x7f452415d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.566+0000 7f45237fe700 1 --2- 172.21.15.37:0/2914087420 >> v2:172.21.15.191:3300/0 conn(0x7f4524159760 0x7f452415d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.566+0000 7f45237fe700 1 -- 172.21.15.37:0/2914087420 >> v1:172.21.15.191:6789/0 conn(0x7f452415d8d0 legacy=0x7f45240c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.566+0000 7f45237fe700 1 -- 172.21.15.37:0/2914087420 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45240cb930 con 0x7f452415dd50 2023-10-06T02:24:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.566+0000 7f4521ffb700 1 -- 172.21.15.37:0/2914087420 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338286602 0 0) 0x7f452415e1d0 con 0x7f452415d8d0 2023-10-06T02:24:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.566+0000 7f4522ffd700 1 --2- 172.21.15.37:0/2914087420 >> v2:172.21.15.191:3300/0 conn(0x7f4524159760 0x7f452415d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:24:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.566+0000 7f45237fe700 1 --2- 172.21.15.37:0/2914087420 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f452415dd50 0x7f45240cfc00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4514009f20 tx=0x7f4514009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=594b9100fb0ccf7b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.567+0000 7f4521ffb700 1 -- 172.21.15.37:0/2914087420 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451400e070 con 0x7f452415dd50 2023-10-06T02:24:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.567+0000 7f4521ffb700 1 -- 172.21.15.37:0/2914087420 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451400ba60 con 0x7f452415dd50 2023-10-06T02:24:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.567+0000 7f4521ffb700 1 -- 172.21.15.37:0/2914087420 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45140092e0 con 0x7f452415dd50 2023-10-06T02:24:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.567+0000 7f4529410700 1 -- 172.21.15.37:0/2914087420 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f452415dd50 msgr2=0x7f45240cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.567+0000 7f4529410700 1 --2- 172.21.15.37:0/2914087420 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f452415dd50 0x7f45240cfc00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4514009f20 tx=0x7f4514009840 comp rx=0 tx=0).stop 2023-10-06T02:24:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.567+0000 7f4529410700 1 -- 172.21.15.37:0/2914087420 shutdown_connections 2023-10-06T02:24:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.567+0000 7f4529410700 1 --2- 172.21.15.37:0/2914087420 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f452415dd50 0x7f45240cfc00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.567+0000 7f4529410700 1 --2- 172.21.15.37:0/2914087420 >> v2:172.21.15.191:3300/0 conn(0x7f4524159760 0x7f452415d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.567+0000 7f4529410700 1 -- 172.21.15.37:0/2914087420 >> 172.21.15.37:0/2914087420 conn(0x7f452406c890 msgr2=0x7f45240d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.567+0000 7f4529410700 1 -- 172.21.15.37:0/2914087420 shutdown_connections 2023-10-06T02:24:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.567+0000 7f4529410700 1 -- 172.21.15.37:0/2914087420 wait complete. 2023-10-06T02:24:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.568+0000 7f4529410700 1 Processor -- start 2023-10-06T02:24:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.568+0000 7f4529410700 1 -- start start 2023-10-06T02:24:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.569+0000 7f4529410700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4524159760 0x7f4524149100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.569+0000 7f4529410700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f452415d8d0 0x7f45240b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.569+0000 7f4529410700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452415dd50 0x7f45240c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.569+0000 7f4529410700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45240b5620 con 0x7f452415dd50 2023-10-06T02:24:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.569+0000 7f4529410700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452415a590 con 0x7f452415d8d0 2023-10-06T02:24:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.569+0000 7f4529410700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4524159c60 con 0x7f4524159760 2023-10-06T02:24:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.569+0000 7f45237fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452415dd50 0x7f45240c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.569+0000 7f45237fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452415dd50 0x7f45240c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42822/0 (socket says 172.21.15.37:42822) 2023-10-06T02:24:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.569+0000 7f45237fe700 1 -- 172.21.15.37:0/676712050 learned_addr learned my addr 172.21.15.37:0/676712050 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.569+0000 7f4522ffd700 1 --2- 172.21.15.37:0/676712050 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4524159760 0x7f4524149100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.569+0000 7f45227fc700 1 --2- 172.21.15.37:0/676712050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f452415d8d0 0x7f45240b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.570+0000 7f45237fe700 1 -- 172.21.15.37:0/676712050 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4524159760 msgr2=0x7f4524149100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.570+0000 7f45237fe700 1 --2- 172.21.15.37:0/676712050 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4524159760 0x7f4524149100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.570+0000 7f45237fe700 1 -- 172.21.15.37:0/676712050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f452415d8d0 msgr2=0x7f45240b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.570+0000 7f45237fe700 1 --2- 172.21.15.37:0/676712050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f452415d8d0 0x7f45240b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.570+0000 7f45237fe700 1 -- 172.21.15.37:0/676712050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c009420 con 0x7f452415dd50 2023-10-06T02:24:23.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.570+0000 7f45237fe700 1 --2- 172.21.15.37:0/676712050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452415dd50 0x7f45240c5390 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4514009880 tx=0x7f4514018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:23.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.570+0000 7f451affd700 1 -- 172.21.15.37:0/676712050 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45140094e0 con 0x7f452415dd50 2023-10-06T02:24:23.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.570+0000 7f451affd700 1 -- 172.21.15.37:0/676712050 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45140032f0 con 0x7f452415dd50 2023-10-06T02:24:23.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.570+0000 7f4529410700 1 -- 172.21.15.37:0/676712050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4514009ae0 con 0x7f452415dd50 2023-10-06T02:24:23.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.570+0000 7f451affd700 1 -- 172.21.15.37:0/676712050 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451401e430 con 0x7f452415dd50 2023-10-06T02:24:23.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.570+0000 7f4529410700 1 -- 172.21.15.37:0/676712050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f452415a220 con 0x7f452415dd50 2023-10-06T02:24:23.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.571+0000 7f4529410700 1 -- 172.21.15.37:0/676712050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452406fbf0 con 0x7f452415dd50 2023-10-06T02:24:23.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.571+0000 7f451affd700 1 -- 172.21.15.37:0/676712050 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4514003040 con 0x7f452415dd50 2023-10-06T02:24:23.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.572+0000 7f451affd700 1 --2- 172.21.15.37:0/676712050 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4504066f30 0x7f45040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:23.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.572+0000 7f451affd700 1 -- 172.21.15.37:0/676712050 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4514086690 con 0x7f452415dd50 2023-10-06T02:24:23.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.572+0000 7f4522ffd700 1 --2- 172.21.15.37:0/676712050 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4504066f30 0x7f45040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:23.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.573+0000 7f4522ffd700 1 --2- 172.21.15.37:0/676712050 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4504066f30 0x7f45040693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f451c009ea0 tx=0x7f451c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:23.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.576+0000 7f451affd700 1 -- 172.21.15.37:0/676712050 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45140537a0 con 0x7f452415dd50 2023-10-06T02:24:23.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.822+0000 7f4529410700 1 -- 172.21.15.37:0/676712050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f452404bb80 con 0x7f452415dd50 2023-10-06T02:24:23.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.822+0000 7f451affd700 1 -- 172.21.15.37:0/676712050 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f4514056dc0 con 0x7f452415dd50 2023-10-06T02:24:23.823 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:23.823 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1320242500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1320242500},{"type":"v1","addr":"172.21.15.37:6835","nonce":1320242500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4900,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/3862379925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3862379925},{"type":"v1","addr":"172.21.15.191:6836","nonce":3862379925}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1922753638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":1922753638},{"type":"v1","addr":"172.21.15.191:6837","nonce":1922753638}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:06.274246+0000","modified":"2023-10-06T02:24:09.884600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/967425730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":967425730},{"type":"v1","addr":"172.21.15.37:6834","nonce":967425730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:24:23.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.824+0000 7f4529410700 1 -- 172.21.15.37:0/676712050 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4504066f30 msgr2=0x7f45040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:23.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.824+0000 7f4529410700 1 --2- 172.21.15.37:0/676712050 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4504066f30 0x7f45040693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f451c009ea0 tx=0x7f451c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.824+0000 7f4529410700 1 -- 172.21.15.37:0/676712050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452415dd50 msgr2=0x7f45240c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:23.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.824+0000 7f4529410700 1 --2- 172.21.15.37:0/676712050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452415dd50 0x7f45240c5390 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4514009880 tx=0x7f4514018000 comp rx=0 tx=0).stop 2023-10-06T02:24:23.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.825+0000 7f4529410700 1 -- 172.21.15.37:0/676712050 shutdown_connections 2023-10-06T02:24:23.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.825+0000 7f4529410700 1 --2- 172.21.15.37:0/676712050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452415dd50 0x7f45240c5390 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.825+0000 7f4529410700 1 --2- 172.21.15.37:0/676712050 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4524159760 0x7f4524149100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.825+0000 7f4529410700 1 --2- 172.21.15.37:0/676712050 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4504066f30 0x7f45040693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.825+0000 7f4529410700 1 --2- 172.21.15.37:0/676712050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f452415d8d0 0x7f45240b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:23.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.825+0000 7f4529410700 1 -- 172.21.15.37:0/676712050 >> 172.21.15.37:0/676712050 conn(0x7f452406c890 msgr2=0x7f452406dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:23.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.825+0000 7f4529410700 1 -- 172.21.15.37:0/676712050 shutdown_connections 2023-10-06T02:24:23.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:23.825+0000 7f4529410700 1 -- 172.21.15.37:0/676712050 wait complete. 2023-10-06T02:24:23.826 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2023-10-06T02:24:23.837 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json tag path /parentdir mytag 2023-10-06T02:24:23.977 INFO:teuthology.orchestra.run.smithi037.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2023-10-06T02:24:23.977 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2023-10-06T02:24:33.978 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2023-10-06T02:24:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.024+0000 7f51eec02000 1 Processor -- start 2023-10-06T02:24:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.024+0000 7f51eec02000 1 -- start start 2023-10-06T02:24:34.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.024+0000 7f51eec02000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5e5366e20 0x55d5e5361060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.024+0000 7f51eec02000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d5e5382110 0x55d5e53609e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.024+0000 7f51eec02000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d5e53824e0 0x55d5e5364860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.024+0000 7f51eec02000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5e51f8620 con 0x55d5e5366e20 2023-10-06T02:24:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.024+0000 7f51eec02000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5e51ef400 con 0x55d5e5382110 2023-10-06T02:24:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.024+0000 7f51eec02000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d5e53652b0 con 0x55d5e53824e0 2023-10-06T02:24:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.024+0000 7f51e7e3d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5e5366e20 0x55d5e5361060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.024+0000 7f51e7e3d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5e5366e20 0x55d5e5361060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41342/0 (socket says 172.21.15.37:41342) 2023-10-06T02:24:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.024+0000 7f51e7e3d700 1 -- 172.21.15.37:0/2894027315 learned_addr learned my addr 172.21.15.37:0/2894027315 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.025+0000 7f51e863e700 1 --2- 172.21.15.37:0/2894027315 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d5e53824e0 0x55d5e5364860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.025+0000 7f51e763c700 1 --2- 172.21.15.37:0/2894027315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d5e5382110 0x55d5e53609e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.025+0000 7f51e7e3d700 1 -- 172.21.15.37:0/2894027315 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d5e53824e0 msgr2=0x55d5e5364860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.025+0000 7f51e7e3d700 1 --2- 172.21.15.37:0/2894027315 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d5e53824e0 0x55d5e5364860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.025+0000 7f51e7e3d700 1 -- 172.21.15.37:0/2894027315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d5e5382110 msgr2=0x55d5e53609e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.025+0000 7f51e7e3d700 1 --2- 172.21.15.37:0/2894027315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d5e5382110 0x55d5e53609e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.025+0000 7f51e7e3d700 1 -- 172.21.15.37:0/2894027315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc005db0 con 0x55d5e5366e20 2023-10-06T02:24:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.025+0000 7f51e7e3d700 1 --2- 172.21.15.37:0/2894027315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5e5366e20 0x55d5e5361060 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009950 tx=0x7f51d800c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc11c69415fb656 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.025+0000 7f51e663a700 1 -- 172.21.15.37:0/2894027315 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d800f040 con 0x55d5e5366e20 2023-10-06T02:24:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.025+0000 7f51e663a700 1 -- 172.21.15.37:0/2894027315 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d8008930 con 0x55d5e5366e20 2023-10-06T02:24:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.025+0000 7f51e663a700 1 -- 172.21.15.37:0/2894027315 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8008cd0 con 0x55d5e5366e20 2023-10-06T02:24:34.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.026+0000 7f51eec02000 1 -- 172.21.15.37:0/2894027315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5e5366e20 msgr2=0x55d5e5361060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.026+0000 7f51eec02000 1 --2- 172.21.15.37:0/2894027315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5e5366e20 0x55d5e5361060 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009950 tx=0x7f51d800c040 comp rx=0 tx=0).stop 2023-10-06T02:24:34.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.026+0000 7f51eec02000 1 -- 172.21.15.37:0/2894027315 shutdown_connections 2023-10-06T02:24:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.026+0000 7f51eec02000 1 --2- 172.21.15.37:0/2894027315 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d5e53824e0 0x55d5e5364860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.026+0000 7f51eec02000 1 --2- 172.21.15.37:0/2894027315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5e5366e20 0x55d5e5361060 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.026+0000 7f51eec02000 1 --2- 172.21.15.37:0/2894027315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d5e5382110 0x55d5e53609e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.026+0000 7f51eec02000 1 -- 172.21.15.37:0/2894027315 >> 172.21.15.37:0/2894027315 conn(0x55d5e52f6af0 msgr2=0x55d5e537e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.026+0000 7f51eec02000 1 -- 172.21.15.37:0/2894027315 shutdown_connections 2023-10-06T02:24:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.026+0000 7f51eec02000 1 -- 172.21.15.37:0/2894027315 wait complete. 2023-10-06T02:24:34.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.026+0000 7f51eec02000 1 Processor -- start 2023-10-06T02:24:34.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.026+0000 7f51eec02000 1 -- start start 2023-10-06T02:24:34.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.027+0000 7f51eec02000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5e5366e20 0x55d5e5363770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.027+0000 7f51eec02000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d5e5382110 0x55d5e5363cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.027+0000 7f51eec02000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d5e53824e0 0x55d5e537c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.027+0000 7f51eec02000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5e52f2c90 con 0x55d5e5366e20 2023-10-06T02:24:34.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.027+0000 7f51eec02000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5e5364900 con 0x55d5e53824e0 2023-10-06T02:24:34.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.027+0000 7f51eec02000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d5e5364b30 con 0x55d5e5382110 2023-10-06T02:24:34.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.027+0000 7f51e7e3d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5e5366e20 0x55d5e5363770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.027+0000 7f51e7e3d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5e5366e20 0x55d5e5363770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41352/0 (socket says 172.21.15.37:41352) 2023-10-06T02:24:34.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.027+0000 7f51e7e3d700 1 -- 172.21.15.37:0/41022169 learned_addr learned my addr 172.21.15.37:0/41022169 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:34.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.027+0000 7f51e763c700 1 --2- 172.21.15.37:0/41022169 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d5e5382110 0x55d5e5363cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.027+0000 7f51e863e700 1 --2- 172.21.15.37:0/41022169 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d5e53824e0 0x55d5e537c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.028+0000 7f51e7e3d700 1 -- 172.21.15.37:0/41022169 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d5e5382110 msgr2=0x55d5e5363cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.028+0000 7f51e7e3d700 1 --2- 172.21.15.37:0/41022169 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d5e5382110 0x55d5e5363cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.028+0000 7f51e7e3d700 1 -- 172.21.15.37:0/41022169 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d5e53824e0 msgr2=0x55d5e537c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.028+0000 7f51e7e3d700 1 --2- 172.21.15.37:0/41022169 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d5e53824e0 0x55d5e537c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.028+0000 7f51e7e3d700 1 -- 172.21.15.37:0/41022169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d8009580 con 0x55d5e5366e20 2023-10-06T02:24:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.028+0000 7f51e7e3d700 1 --2- 172.21.15.37:0/41022169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5e5366e20 0x55d5e5363770 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55d5e5360830 tx=0x7f51d8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.028+0000 7f51e4e37700 1 -- 172.21.15.37:0/41022169 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d800f030 con 0x55d5e5366e20 2023-10-06T02:24:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.028+0000 7f51e4e37700 1 -- 172.21.15.37:0/41022169 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d8013910 con 0x55d5e5366e20 2023-10-06T02:24:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.028+0000 7f51e4e37700 1 -- 172.21.15.37:0/41022169 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8013cf0 con 0x55d5e5366e20 2023-10-06T02:24:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.028+0000 7f51eec02000 1 -- 172.21.15.37:0/41022169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d5e52211c0 con 0x55d5e5366e20 2023-10-06T02:24:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.028+0000 7f51eec02000 1 -- 172.21.15.37:0/41022169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5e52073d0 con 0x55d5e5366e20 2023-10-06T02:24:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.030+0000 7f51e4e37700 1 -- 172.21.15.37:0/41022169 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51d801d610 con 0x55d5e5366e20 2023-10-06T02:24:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.030+0000 7f51e4e37700 1 --2- 172.21.15.37:0/41022169 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f51d4065890 0x7f51d4067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.030+0000 7f51e4e37700 1 -- 172.21.15.37:0/41022169 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f51d8084f40 con 0x55d5e5366e20 2023-10-06T02:24:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.030+0000 7f51e763c700 1 --2- 172.21.15.37:0/41022169 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f51d4065890 0x7f51d4067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.030+0000 7f51eec02000 1 --2- 172.21.15.37:0/41022169 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x55d5e539e620 0x55d5e53a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.030+0000 7f51eec02000 1 -- 172.21.15.37:0/41022169 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5e537d2e0 con 0x55d5e539e620 2023-10-06T02:24:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.030+0000 7f51e863e700 1 --2- 172.21.15.37:0/41022169 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x55d5e539e620 0x55d5e53a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.031+0000 7f51e763c700 1 --2- 172.21.15.37:0/41022169 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f51d4065890 0x7f51d4067d40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f51dc005b50 tx=0x7f51dc016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.031+0000 7f51e863e700 1 --2- 172.21.15.37:0/41022169 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x55d5e539e620 0x55d5e53a0a00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.031+0000 7f51e863e700 1 -- 172.21.15.37:0/41022169 <== osd.7 v2:172.21.15.191:6813/90854 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f51e0002d90 con 0x55d5e539e620 2023-10-06T02:24:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.031+0000 7f51eec02000 1 -- 172.21.15.37:0/41022169 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x55d5e539e620 msgr2=0x55d5e53a0a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.031+0000 7f51eec02000 1 --2- 172.21.15.37:0/41022169 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x55d5e539e620 0x55d5e53a0a00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.031+0000 7f51eec02000 1 -- 172.21.15.37:0/41022169 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f51d4065890 msgr2=0x7f51d4067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.031+0000 7f51eec02000 1 --2- 172.21.15.37:0/41022169 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f51d4065890 0x7f51d4067d40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f51dc005b50 tx=0x7f51dc016000 comp rx=0 tx=0).stop 2023-10-06T02:24:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.031+0000 7f51eec02000 1 -- 172.21.15.37:0/41022169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5e5366e20 msgr2=0x55d5e5363770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.031+0000 7f51eec02000 1 --2- 172.21.15.37:0/41022169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5e5366e20 0x55d5e5363770 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55d5e5360830 tx=0x7f51d8018000 comp rx=0 tx=0).stop 2023-10-06T02:24:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.032+0000 7f51e863e700 1 -- 172.21.15.37:0/41022169 reap_dead start 2023-10-06T02:24:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.032+0000 7f51eec02000 1 -- 172.21.15.37:0/41022169 shutdown_connections 2023-10-06T02:24:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.032+0000 7f51eec02000 1 -- 172.21.15.37:0/41022169 >> 172.21.15.37:0/41022169 conn(0x55d5e52f6af0 msgr2=0x55d5e53851d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.032+0000 7f51eec02000 1 -- 172.21.15.37:0/41022169 shutdown_connections 2023-10-06T02:24:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.032+0000 7f51eec02000 1 -- 172.21.15.37:0/41022169 wait complete. 2023-10-06T02:24:34.042 INFO:teuthology.orchestra.run.smithi037.stdout:mytag 2023-10-06T02:24:34.042 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2023-10-06T02:24:34.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.084+0000 7f2fe8581000 1 Processor -- start 2023-10-06T02:24:34.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.084+0000 7f2fe8581000 1 -- start start 2023-10-06T02:24:34.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.084+0000 7f2fe8581000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564fb1b1fde0 0x564fb1b1ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.084+0000 7f2fe8581000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564fb1bc4fa0 0x564fb1bd4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.084+0000 7f2fe8581000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fb1bc8da0 0x564fb1bd45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.084+0000 7f2fe8581000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fb1a3b980 con 0x564fb1bc8da0 2023-10-06T02:24:34.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.084+0000 7f2fe8581000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fb1a3b620 con 0x564fb1b1fde0 2023-10-06T02:24:34.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.084+0000 7f2fe8581000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x564fb1a32400 con 0x564fb1bc4fa0 2023-10-06T02:24:34.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.085+0000 7f2fe1fbd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fb1bc8da0 0x564fb1bd45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.085+0000 7f2fe1fbd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fb1bc8da0 0x564fb1bd45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41358/0 (socket says 172.21.15.37:41358) 2023-10-06T02:24:34.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.085+0000 7f2fe1fbd700 1 -- 172.21.15.37:0/3759749945 learned_addr learned my addr 172.21.15.37:0/3759749945 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:34.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.085+0000 7f2fe0fbb700 1 --2- 172.21.15.37:0/3759749945 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564fb1bc4fa0 0x564fb1bd4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.085+0000 7f2fe17bc700 1 --2- 172.21.15.37:0/3759749945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564fb1b1fde0 0x564fb1b1ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.085+0000 7f2fe1fbd700 1 -- 172.21.15.37:0/3759749945 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564fb1bc4fa0 msgr2=0x564fb1bd4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:34.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.085+0000 7f2fe1fbd700 1 --2- 172.21.15.37:0/3759749945 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564fb1bc4fa0 0x564fb1bd4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.085+0000 7f2fe1fbd700 1 -- 172.21.15.37:0/3759749945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564fb1b1fde0 msgr2=0x564fb1b1ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:34.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.085+0000 7f2fe1fbd700 1 --2- 172.21.15.37:0/3759749945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564fb1b1fde0 0x564fb1b1ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.085+0000 7f2fe1fbd700 1 -- 172.21.15.37:0/3759749945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc00a0e0 con 0x564fb1bc8da0 2023-10-06T02:24:34.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.085+0000 7f2fe1fbd700 1 --2- 172.21.15.37:0/3759749945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fb1bc8da0 0x564fb1bd45c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x564fb1b38690 tx=0x7f2fdc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f9b5ca8e3895f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.085+0000 7f2fd37fe700 1 -- 172.21.15.37:0/3759749945 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc00fe00 con 0x564fb1bc8da0 2023-10-06T02:24:34.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.085+0000 7f2fd37fe700 1 -- 172.21.15.37:0/3759749945 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc01f070 con 0x564fb1bc8da0 2023-10-06T02:24:34.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.085+0000 7f2fd37fe700 1 -- 172.21.15.37:0/3759749945 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc00f860 con 0x564fb1bc8da0 2023-10-06T02:24:34.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.086+0000 7f2fe8581000 1 -- 172.21.15.37:0/3759749945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fb1bc8da0 msgr2=0x564fb1bd45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.086+0000 7f2fe8581000 1 --2- 172.21.15.37:0/3759749945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fb1bc8da0 0x564fb1bd45c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x564fb1b38690 tx=0x7f2fdc015000 comp rx=0 tx=0).stop 2023-10-06T02:24:34.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.086+0000 7f2fe8581000 1 -- 172.21.15.37:0/3759749945 shutdown_connections 2023-10-06T02:24:34.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.086+0000 7f2fe8581000 1 --2- 172.21.15.37:0/3759749945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fb1bc8da0 0x564fb1bd45c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.086+0000 7f2fe8581000 1 --2- 172.21.15.37:0/3759749945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564fb1b1fde0 0x564fb1b1ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.086+0000 7f2fe8581000 1 --2- 172.21.15.37:0/3759749945 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564fb1bc4fa0 0x564fb1bd4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.086+0000 7f2fe8581000 1 -- 172.21.15.37:0/3759749945 >> 172.21.15.37:0/3759749945 conn(0x564fb1af03e0 msgr2=0x564fb1bc5370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:34.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.086+0000 7f2fe8581000 1 -- 172.21.15.37:0/3759749945 shutdown_connections 2023-10-06T02:24:34.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.086+0000 7f2fe8581000 1 -- 172.21.15.37:0/3759749945 wait complete. 2023-10-06T02:24:34.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.087+0000 7f2fe8581000 1 Processor -- start 2023-10-06T02:24:34.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.087+0000 7f2fe8581000 1 -- start start 2023-10-06T02:24:34.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.087+0000 7f2fe8581000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564fb1b1fde0 0x564fb1bbce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.087+0000 7f2fe8581000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564fb1bc4fa0 0x564fb1bbd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.087+0000 7f2fe8581000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fb1bc8da0 0x564fb1bc37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.087+0000 7f2fe8581000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fb1b1b540 con 0x564fb1bc8da0 2023-10-06T02:24:34.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.087+0000 7f2fe8581000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fb1bbd8f0 con 0x564fb1bc4fa0 2023-10-06T02:24:34.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.087+0000 7f2fe8581000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x564fb1b19ab0 con 0x564fb1b1fde0 2023-10-06T02:24:34.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.088+0000 7f2fe1fbd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fb1bc8da0 0x564fb1bc37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.088+0000 7f2fe1fbd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fb1bc8da0 0x564fb1bc37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41360/0 (socket says 172.21.15.37:41360) 2023-10-06T02:24:34.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.088+0000 7f2fe1fbd700 1 -- 172.21.15.37:0/2642549071 learned_addr learned my addr 172.21.15.37:0/2642549071 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:34.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.088+0000 7f2fe17bc700 1 --2- 172.21.15.37:0/2642549071 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564fb1b1fde0 0x564fb1bbce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.088+0000 7f2fe0fbb700 1 --2- 172.21.15.37:0/2642549071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564fb1bc4fa0 0x564fb1bbd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.088+0000 7f2fe1fbd700 1 -- 172.21.15.37:0/2642549071 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564fb1b1fde0 msgr2=0x564fb1bbce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.088+0000 7f2fe1fbd700 1 --2- 172.21.15.37:0/2642549071 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564fb1b1fde0 0x564fb1bbce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.088+0000 7f2fe1fbd700 1 -- 172.21.15.37:0/2642549071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564fb1bc4fa0 msgr2=0x564fb1bbd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.088+0000 7f2fe1fbd700 1 --2- 172.21.15.37:0/2642549071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564fb1bc4fa0 0x564fb1bbd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.088+0000 7f2fe1fbd700 1 -- 172.21.15.37:0/2642549071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fb1a641c0 con 0x564fb1bc8da0 2023-10-06T02:24:34.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.088+0000 7f2fe1fbd700 1 --2- 172.21.15.37:0/2642549071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fb1bc8da0 0x564fb1bc37f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc005d80 tx=0x7f2fdc01d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.088+0000 7f2fd1ffb700 1 -- 172.21.15.37:0/2642549071 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc024640 con 0x564fb1bc8da0 2023-10-06T02:24:34.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.088+0000 7f2fd1ffb700 1 -- 172.21.15.37:0/2642549071 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc0247e0 con 0x564fb1bc8da0 2023-10-06T02:24:34.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.088+0000 7f2fe8581000 1 -- 172.21.15.37:0/2642549071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564fb1a4a3d0 con 0x564fb1bc8da0 2023-10-06T02:24:34.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.088+0000 7f2fd1ffb700 1 -- 172.21.15.37:0/2642549071 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc024ba0 con 0x564fb1bc8da0 2023-10-06T02:24:34.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.088+0000 7f2fe8581000 1 -- 172.21.15.37:0/2642549071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564fb1a3dae0 con 0x564fb1bc8da0 2023-10-06T02:24:34.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.090+0000 7f2fd1ffb700 1 -- 172.21.15.37:0/2642549071 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fdc003040 con 0x564fb1bc8da0 2023-10-06T02:24:34.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.090+0000 7f2fd1ffb700 1 --2- 172.21.15.37:0/2642549071 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2fc4065890 0x7f2fc4067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.090+0000 7f2fd1ffb700 1 -- 172.21.15.37:0/2642549071 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2fdc086260 con 0x564fb1bc8da0 2023-10-06T02:24:34.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.090+0000 7f2fe17bc700 1 --2- 172.21.15.37:0/2642549071 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2fc4065890 0x7f2fc4067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.090+0000 7f2fe8581000 1 --2- 172.21.15.37:0/2642549071 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x564fb1bc4240 0x564fb1bc0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.090+0000 7f2fe8581000 1 -- 172.21.15.37:0/2642549071 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564fb1bc0c90 con 0x564fb1bc4240 2023-10-06T02:24:34.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.090+0000 7f2fe0fbb700 1 --2- 172.21.15.37:0/2642549071 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x564fb1bc4240 0x564fb1bc0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.091+0000 7f2fe17bc700 1 --2- 172.21.15.37:0/2642549071 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2fc4065890 0x7f2fc4067d40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4000c00 tx=0x7f2fd4001730 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.091+0000 7f2fe0fbb700 1 --2- 172.21.15.37:0/2642549071 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x564fb1bc4240 0x564fb1bc0750 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.091+0000 7f2fe0fbb700 1 -- 172.21.15.37:0/2642549071 <== osd.5 v2:172.21.15.191:6808/90853 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f2fd8012040 con 0x564fb1bc4240 2023-10-06T02:24:34.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.091+0000 7f2fe8581000 1 -- 172.21.15.37:0/2642549071 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x564fb1bc4240 msgr2=0x564fb1bc0750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.091+0000 7f2fe8581000 1 --2- 172.21.15.37:0/2642549071 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x564fb1bc4240 0x564fb1bc0750 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.091+0000 7f2fe8581000 1 -- 172.21.15.37:0/2642549071 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2fc4065890 msgr2=0x7f2fc4067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.091+0000 7f2fe8581000 1 --2- 172.21.15.37:0/2642549071 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2fc4065890 0x7f2fc4067d40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4000c00 tx=0x7f2fd4001730 comp rx=0 tx=0).stop 2023-10-06T02:24:34.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.091+0000 7f2fe8581000 1 -- 172.21.15.37:0/2642549071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fb1bc8da0 msgr2=0x564fb1bc37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.091+0000 7f2fe8581000 1 --2- 172.21.15.37:0/2642549071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fb1bc8da0 0x564fb1bc37f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc005d80 tx=0x7f2fdc01d070 comp rx=0 tx=0).stop 2023-10-06T02:24:34.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.091+0000 7f2fe1fbd700 1 -- 172.21.15.37:0/2642549071 reap_dead start 2023-10-06T02:24:34.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.092+0000 7f2fe8581000 1 -- 172.21.15.37:0/2642549071 shutdown_connections 2023-10-06T02:24:34.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.092+0000 7f2fe8581000 1 -- 172.21.15.37:0/2642549071 >> 172.21.15.37:0/2642549071 conn(0x564fb1af03e0 msgr2=0x564fb1bc68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:34.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.092+0000 7f2fe8581000 1 -- 172.21.15.37:0/2642549071 shutdown_connections 2023-10-06T02:24:34.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.092+0000 7f2fe8581000 1 -- 172.21.15.37:0/2642549071 wait complete. 2023-10-06T02:24:34.097 INFO:teuthology.orchestra.run.smithi037.stdout:mytag 2023-10-06T02:24:34.098 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2023-10-06T02:24:34.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.178+0000 7efef7eb3000 1 Processor -- start 2023-10-06T02:24:34.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.178+0000 7efef7eb3000 1 -- start start 2023-10-06T02:24:34.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.179+0000 7efef7eb3000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5590ae3d0e50 0x5590ae4a4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.179+0000 7efef7eb3000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5590ae3fa3f0 0x5590ae48acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.179+0000 7efef7eb3000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5590ae48bab0 0x5590ae3cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.179+0000 7efef7eb3000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590ae319980 con 0x5590ae48bab0 2023-10-06T02:24:34.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.179+0000 7efef7eb3000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590ae319620 con 0x5590ae3d0e50 2023-10-06T02:24:34.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.179+0000 7efef7eb3000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590ae310400 con 0x5590ae3fa3f0 2023-10-06T02:24:34.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.179+0000 7efef18ef700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5590ae48bab0 0x5590ae3cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.179+0000 7efef18ef700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5590ae48bab0 0x5590ae3cc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41374/0 (socket says 172.21.15.37:41374) 2023-10-06T02:24:34.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.179+0000 7efef18ef700 1 -- 172.21.15.37:0/2191628205 learned_addr learned my addr 172.21.15.37:0/2191628205 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:34.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.179+0000 7efef10ee700 1 --2- 172.21.15.37:0/2191628205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5590ae3d0e50 0x5590ae4a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.179+0000 7efef08ed700 1 --2- 172.21.15.37:0/2191628205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5590ae3fa3f0 0x5590ae48acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.179+0000 7efef18ef700 1 -- 172.21.15.37:0/2191628205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5590ae3fa3f0 msgr2=0x5590ae48acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:34.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.179+0000 7efef18ef700 1 --2- 172.21.15.37:0/2191628205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5590ae3fa3f0 0x5590ae48acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.179+0000 7efef18ef700 1 -- 172.21.15.37:0/2191628205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5590ae3d0e50 msgr2=0x5590ae4a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:34.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.179+0000 7efef18ef700 1 --2- 172.21.15.37:0/2191628205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5590ae3d0e50 0x5590ae4a4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.179+0000 7efef18ef700 1 -- 172.21.15.37:0/2191628205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee400a0e0 con 0x5590ae48bab0 2023-10-06T02:24:34.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.179+0000 7efef10ee700 1 --2- 172.21.15.37:0/2191628205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5590ae3d0e50 0x5590ae4a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:34.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.180+0000 7efef18ef700 1 --2- 172.21.15.37:0/2191628205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5590ae48bab0 0x5590ae3cc620 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efee400f610 tx=0x7efee4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f47102e07d3f1af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.180+0000 7efeeb7fe700 1 -- 172.21.15.37:0/2191628205 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4003300 con 0x5590ae48bab0 2023-10-06T02:24:34.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.180+0000 7efeeb7fe700 1 -- 172.21.15.37:0/2191628205 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee400f860 con 0x5590ae48bab0 2023-10-06T02:24:34.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.180+0000 7efeeb7fe700 1 -- 172.21.15.37:0/2191628205 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4024470 con 0x5590ae48bab0 2023-10-06T02:24:34.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.180+0000 7efef7eb3000 1 -- 172.21.15.37:0/2191628205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5590ae48bab0 msgr2=0x5590ae3cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.180+0000 7efef7eb3000 1 --2- 172.21.15.37:0/2191628205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5590ae48bab0 0x5590ae3cc620 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efee400f610 tx=0x7efee4015000 comp rx=0 tx=0).stop 2023-10-06T02:24:34.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.180+0000 7efef7eb3000 1 -- 172.21.15.37:0/2191628205 shutdown_connections 2023-10-06T02:24:34.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.180+0000 7efef7eb3000 1 --2- 172.21.15.37:0/2191628205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5590ae48bab0 0x5590ae3cc620 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.180+0000 7efef7eb3000 1 --2- 172.21.15.37:0/2191628205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5590ae3d0e50 0x5590ae4a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.180+0000 7efef7eb3000 1 --2- 172.21.15.37:0/2191628205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5590ae3fa3f0 0x5590ae48acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.180+0000 7efef7eb3000 1 -- 172.21.15.37:0/2191628205 >> 172.21.15.37:0/2191628205 conn(0x5590ae3cf500 msgr2=0x5590ae4a47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:34.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.180+0000 7efef7eb3000 1 -- 172.21.15.37:0/2191628205 shutdown_connections 2023-10-06T02:24:34.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.180+0000 7efef7eb3000 1 -- 172.21.15.37:0/2191628205 wait complete. 2023-10-06T02:24:34.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.181+0000 7efef7eb3000 1 Processor -- start 2023-10-06T02:24:34.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.181+0000 7efef7eb3000 1 -- start start 2023-10-06T02:24:34.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.182+0000 7efef7eb3000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5590ae3d0e50 0x5590ae4b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.182+0000 7efef7eb3000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5590ae3fa3f0 0x5590ae3cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.182+0000 7efef7eb3000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5590ae48bab0 0x5590ae486ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.182+0000 7efef7eb3000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590ae4a6570 con 0x5590ae48bab0 2023-10-06T02:24:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.182+0000 7efef7eb3000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590ae3fd350 con 0x5590ae3fa3f0 2023-10-06T02:24:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.182+0000 7efef7eb3000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590ae4a67d0 con 0x5590ae3d0e50 2023-10-06T02:24:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.182+0000 7efef18ef700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5590ae48bab0 0x5590ae486ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.182+0000 7efef18ef700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5590ae48bab0 0x5590ae486ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41386/0 (socket says 172.21.15.37:41386) 2023-10-06T02:24:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.182+0000 7efef18ef700 1 -- 172.21.15.37:0/3184869902 learned_addr learned my addr 172.21.15.37:0/3184869902 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.182+0000 7efef10ee700 1 --2- 172.21.15.37:0/3184869902 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5590ae3d0e50 0x5590ae4b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.182+0000 7efef08ed700 1 --2- 172.21.15.37:0/3184869902 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5590ae3fa3f0 0x5590ae3cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.182+0000 7efef18ef700 1 -- 172.21.15.37:0/3184869902 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5590ae3d0e50 msgr2=0x5590ae4b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.182+0000 7efef18ef700 1 --2- 172.21.15.37:0/3184869902 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5590ae3d0e50 0x5590ae4b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.182+0000 7efef18ef700 1 -- 172.21.15.37:0/3184869902 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5590ae3fa3f0 msgr2=0x5590ae3cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.182+0000 7efef18ef700 1 --2- 172.21.15.37:0/3184869902 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5590ae3fa3f0 0x5590ae3cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.182+0000 7efef18ef700 1 -- 172.21.15.37:0/3184869902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590ae3421c0 con 0x5590ae48bab0 2023-10-06T02:24:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.182+0000 7efef18ef700 1 --2- 172.21.15.37:0/3184869902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5590ae48bab0 0x5590ae486ab0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efee400a470 tx=0x7efee401d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.183+0000 7efee9ffb700 1 -- 172.21.15.37:0/3184869902 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee402f420 con 0x5590ae48bab0 2023-10-06T02:24:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.183+0000 7efee9ffb700 1 -- 172.21.15.37:0/3184869902 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee402f580 con 0x5590ae48bab0 2023-10-06T02:24:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.183+0000 7efee9ffb700 1 -- 172.21.15.37:0/3184869902 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee402f940 con 0x5590ae48bab0 2023-10-06T02:24:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.183+0000 7efef7eb3000 1 -- 172.21.15.37:0/3184869902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5590ae3283d0 con 0x5590ae48bab0 2023-10-06T02:24:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.183+0000 7efef7eb3000 1 -- 172.21.15.37:0/3184869902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590ae31bae0 con 0x5590ae48bab0 2023-10-06T02:24:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.184+0000 7efee9ffb700 1 -- 172.21.15.37:0/3184869902 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efee4024d50 con 0x5590ae48bab0 2023-10-06T02:24:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.184+0000 7efee9ffb700 1 --2- 172.21.15.37:0/3184869902 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7efed4065890 0x7efed4067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.184+0000 7efee9ffb700 1 -- 172.21.15.37:0/3184869902 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efee402b070 con 0x5590ae48bab0 2023-10-06T02:24:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.185+0000 7efef10ee700 1 --2- 172.21.15.37:0/3184869902 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7efed4065890 0x7efed4067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.185+0000 7efef7eb3000 1 --2- 172.21.15.37:0/3184869902 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x5590ae3ccd40 0x5590ae3fe200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.185+0000 7efef7eb3000 1 -- 172.21.15.37:0/3184869902 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:1 6.36 6:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5590ae4a1740 con 0x5590ae3ccd40 2023-10-06T02:24:34.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.185+0000 7efef08ed700 1 --2- 172.21.15.37:0/3184869902 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x5590ae3ccd40 0x5590ae3fe200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.185+0000 7efef10ee700 1 --2- 172.21.15.37:0/3184869902 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7efed4065890 0x7efed4067d40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efeec009b50 tx=0x7efeec005c60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.185+0000 7efef08ed700 1 --2- 172.21.15.37:0/3184869902 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x5590ae3ccd40 0x5590ae3fe200 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.186+0000 7efef08ed700 1 -- 172.21.15.37:0/3184869902 <== osd.5 v2:172.21.15.191:6808/90853 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7efedc0107f0 con 0x5590ae3ccd40 2023-10-06T02:24:34.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.186+0000 7efef7eb3000 1 -- 172.21.15.37:0/3184869902 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x5590ae3ccd40 msgr2=0x5590ae3fe200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.186+0000 7efef7eb3000 1 --2- 172.21.15.37:0/3184869902 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x5590ae3ccd40 0x5590ae3fe200 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.186+0000 7efef7eb3000 1 -- 172.21.15.37:0/3184869902 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7efed4065890 msgr2=0x7efed4067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.186+0000 7efef7eb3000 1 --2- 172.21.15.37:0/3184869902 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7efed4065890 0x7efed4067d40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efeec009b50 tx=0x7efeec005c60 comp rx=0 tx=0).stop 2023-10-06T02:24:34.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.186+0000 7efef7eb3000 1 -- 172.21.15.37:0/3184869902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5590ae48bab0 msgr2=0x5590ae486ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.186+0000 7efef7eb3000 1 --2- 172.21.15.37:0/3184869902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5590ae48bab0 0x5590ae486ab0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efee400a470 tx=0x7efee401d070 comp rx=0 tx=0).stop 2023-10-06T02:24:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.186+0000 7efef18ef700 1 -- 172.21.15.37:0/3184869902 reap_dead start 2023-10-06T02:24:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.186+0000 7efef7eb3000 1 -- 172.21.15.37:0/3184869902 shutdown_connections 2023-10-06T02:24:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.186+0000 7efef7eb3000 1 -- 172.21.15.37:0/3184869902 >> 172.21.15.37:0/3184869902 conn(0x5590ae3cf500 msgr2=0x5590ae4a47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.186+0000 7efef7eb3000 1 -- 172.21.15.37:0/3184869902 shutdown_connections 2023-10-06T02:24:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.186+0000 7efef7eb3000 1 -- 172.21.15.37:0/3184869902 wait complete. 2023-10-06T02:24:34.193 INFO:teuthology.orchestra.run.smithi037.stdout:mytag 2023-10-06T02:24:34.193 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2023-10-06T02:24:34.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.274+0000 7ff049653000 1 Processor -- start 2023-10-06T02:24:34.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.274+0000 7ff049653000 1 -- start start 2023-10-06T02:24:34.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.275+0000 7ff049653000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1aac17020 0x55b1aace8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.275+0000 7ff049653000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1aacd2ad0 0x55b1aacd1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.275+0000 7ff049653000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b1aaced3f0 0x55b1aac442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.275+0000 7ff049653000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1aabbb320 con 0x55b1aac17020 2023-10-06T02:24:34.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.275+0000 7ff049653000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1aab5f980 con 0x55b1aacd2ad0 2023-10-06T02:24:34.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.275+0000 7ff049653000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b1aab5f620 con 0x55b1aaced3f0 2023-10-06T02:24:34.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.275+0000 7ff04288e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1aac17020 0x55b1aace8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.275+0000 7ff04288e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1aac17020 0x55b1aace8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41400/0 (socket says 172.21.15.37:41400) 2023-10-06T02:24:34.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.275+0000 7ff04288e700 1 -- 172.21.15.37:0/3048465184 learned_addr learned my addr 172.21.15.37:0/3048465184 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:34.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.275+0000 7ff04288e700 1 -- 172.21.15.37:0/3048465184 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b1aaced3f0 msgr2=0x55b1aac442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:34.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.275+0000 7ff04288e700 1 --2- 172.21.15.37:0/3048465184 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b1aaced3f0 0x55b1aac442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.275+0000 7ff04288e700 1 -- 172.21.15.37:0/3048465184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1aacd2ad0 msgr2=0x55b1aacd1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:34.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.275+0000 7ff04288e700 1 --2- 172.21.15.37:0/3048465184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1aacd2ad0 0x55b1aacd1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.275+0000 7ff04288e700 1 -- 172.21.15.37:0/3048465184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03c005cf0 con 0x55b1aac17020 2023-10-06T02:24:34.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.275+0000 7ff04288e700 1 --2- 172.21.15.37:0/3048465184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1aac17020 0x55b1aace8a00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff034006fd0 tx=0x7ff034006a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669ab2a7d2250c68 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.276+0000 7ff04108b700 1 -- 172.21.15.37:0/3048465184 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034006110 con 0x55b1aac17020 2023-10-06T02:24:34.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.276+0000 7ff04108b700 1 -- 172.21.15.37:0/3048465184 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff034006290 con 0x55b1aac17020 2023-10-06T02:24:34.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.276+0000 7ff04108b700 1 -- 172.21.15.37:0/3048465184 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034006400 con 0x55b1aac17020 2023-10-06T02:24:34.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.276+0000 7ff049653000 1 -- 172.21.15.37:0/3048465184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1aac17020 msgr2=0x55b1aace8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.276+0000 7ff049653000 1 --2- 172.21.15.37:0/3048465184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1aac17020 0x55b1aace8a00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff034006fd0 tx=0x7ff034006a20 comp rx=0 tx=0).stop 2023-10-06T02:24:34.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.276+0000 7ff049653000 1 -- 172.21.15.37:0/3048465184 shutdown_connections 2023-10-06T02:24:34.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.276+0000 7ff049653000 1 --2- 172.21.15.37:0/3048465184 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b1aaced3f0 0x55b1aac442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.276+0000 7ff049653000 1 --2- 172.21.15.37:0/3048465184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1aac17020 0x55b1aace8a00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.276+0000 7ff049653000 1 --2- 172.21.15.37:0/3048465184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1aacd2ad0 0x55b1aacd1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.276+0000 7ff049653000 1 -- 172.21.15.37:0/3048465184 >> 172.21.15.37:0/3048465184 conn(0x55b1aac15500 msgr2=0x55b1aac5d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:34.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.276+0000 7ff049653000 1 -- 172.21.15.37:0/3048465184 shutdown_connections 2023-10-06T02:24:34.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.276+0000 7ff049653000 1 -- 172.21.15.37:0/3048465184 wait complete. 2023-10-06T02:24:34.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.277+0000 7ff049653000 1 Processor -- start 2023-10-06T02:24:34.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.277+0000 7ff049653000 1 -- start start 2023-10-06T02:24:34.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.277+0000 7ff049653000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1aac17020 0x55b1aac54a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.277+0000 7ff049653000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1aacd2ad0 0x55b1aaccc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.277+0000 7ff049653000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b1aaced3f0 0x55b1aaceb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.277+0000 7ff049653000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1aab56400 con 0x55b1aac17020 2023-10-06T02:24:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.277+0000 7ff049653000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1aac55210 con 0x55b1aacd2ad0 2023-10-06T02:24:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.277+0000 7ff049653000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b1aacd19b0 con 0x55b1aaced3f0 2023-10-06T02:24:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.278+0000 7ff04288e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1aac17020 0x55b1aac54a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.278+0000 7ff04288e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1aac17020 0x55b1aac54a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41402/0 (socket says 172.21.15.37:41402) 2023-10-06T02:24:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.278+0000 7ff04288e700 1 -- 172.21.15.37:0/1305738 learned_addr learned my addr 172.21.15.37:0/1305738 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.278+0000 7ff04308f700 1 --2- 172.21.15.37:0/1305738 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b1aaced3f0 0x55b1aaceb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.278+0000 7ff04208d700 1 --2- 172.21.15.37:0/1305738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1aacd2ad0 0x55b1aaccc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.278+0000 7ff04288e700 1 -- 172.21.15.37:0/1305738 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b1aaced3f0 msgr2=0x55b1aaceb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.278+0000 7ff04288e700 1 --2- 172.21.15.37:0/1305738 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b1aaced3f0 0x55b1aaceb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.278+0000 7ff04288e700 1 -- 172.21.15.37:0/1305738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1aacd2ad0 msgr2=0x55b1aaccc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.278+0000 7ff04288e700 1 --2- 172.21.15.37:0/1305738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1aacd2ad0 0x55b1aaccc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.278+0000 7ff04288e700 1 -- 172.21.15.37:0/1305738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff030001e10 con 0x55b1aac17020 2023-10-06T02:24:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.278+0000 7ff04208d700 1 --2- 172.21.15.37:0/1305738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b1aacd2ad0 0x55b1aaccc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:34.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.278+0000 7ff04288e700 1 --2- 172.21.15.37:0/1305738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1aac17020 0x55b1aac54a20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55b1aaccca60 tx=0x7ff034014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.278+0000 7ff03b7fe700 1 -- 172.21.15.37:0/1305738 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034022070 con 0x55b1aac17020 2023-10-06T02:24:34.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.278+0000 7ff03b7fe700 1 -- 172.21.15.37:0/1305738 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff034013630 con 0x55b1aac17020 2023-10-06T02:24:34.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.278+0000 7ff03b7fe700 1 -- 172.21.15.37:0/1305738 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034013a30 con 0x55b1aac17020 2023-10-06T02:24:34.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.278+0000 7ff049653000 1 -- 172.21.15.37:0/1305738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b1aab61ae0 con 0x55b1aac17020 2023-10-06T02:24:34.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.278+0000 7ff049653000 1 -- 172.21.15.37:0/1305738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1aab61540 con 0x55b1aac17020 2023-10-06T02:24:34.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.280+0000 7ff03b7fe700 1 -- 172.21.15.37:0/1305738 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff034027410 con 0x55b1aac17020 2023-10-06T02:24:34.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.280+0000 7ff03b7fe700 1 --2- 172.21.15.37:0/1305738 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff024065890 0x7ff024067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.280+0000 7ff03b7fe700 1 -- 172.21.15.37:0/1305738 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff034084f20 con 0x55b1aac17020 2023-10-06T02:24:34.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.280+0000 7ff04208d700 1 --2- 172.21.15.37:0/1305738 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff024065890 0x7ff024067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.280+0000 7ff049653000 1 --2- 172.21.15.37:0/1305738 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x55b1aacd0470 0x55b1aacf73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.280+0000 7ff049653000 1 -- 172.21.15.37:0/1305738 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:1 6.19 6:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b1aacf7920 con 0x55b1aacd0470 2023-10-06T02:24:34.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.281+0000 7ff04308f700 1 --2- 172.21.15.37:0/1305738 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x55b1aacd0470 0x55b1aacf73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.281+0000 7ff04208d700 1 --2- 172.21.15.37:0/1305738 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff024065890 0x7ff024067d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff02c000c00 tx=0x7ff02c001680 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.281+0000 7ff04308f700 1 --2- 172.21.15.37:0/1305738 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x55b1aacd0470 0x55b1aacf73e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.281+0000 7ff04308f700 1 -- 172.21.15.37:0/1305738 <== osd.5 v2:172.21.15.191:6808/90853 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7ff03c008970 con 0x55b1aacd0470 2023-10-06T02:24:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.281+0000 7ff049653000 1 -- 172.21.15.37:0/1305738 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x55b1aacd0470 msgr2=0x55b1aacf73e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.281+0000 7ff049653000 1 --2- 172.21.15.37:0/1305738 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x55b1aacd0470 0x55b1aacf73e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.281+0000 7ff049653000 1 -- 172.21.15.37:0/1305738 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff024065890 msgr2=0x7ff024067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.281+0000 7ff049653000 1 --2- 172.21.15.37:0/1305738 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff024065890 0x7ff024067d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff02c000c00 tx=0x7ff02c001680 comp rx=0 tx=0).stop 2023-10-06T02:24:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.281+0000 7ff049653000 1 -- 172.21.15.37:0/1305738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1aac17020 msgr2=0x55b1aac54a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.281+0000 7ff049653000 1 --2- 172.21.15.37:0/1305738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1aac17020 0x55b1aac54a20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55b1aaccca60 tx=0x7ff034014000 comp rx=0 tx=0).stop 2023-10-06T02:24:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.281+0000 7ff04308f700 1 -- 172.21.15.37:0/1305738 reap_dead start 2023-10-06T02:24:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.281+0000 7ff049653000 1 -- 172.21.15.37:0/1305738 shutdown_connections 2023-10-06T02:24:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.281+0000 7ff049653000 1 -- 172.21.15.37:0/1305738 >> 172.21.15.37:0/1305738 conn(0x55b1aac15500 msgr2=0x55b1aac5d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.281+0000 7ff049653000 1 -- 172.21.15.37:0/1305738 shutdown_connections 2023-10-06T02:24:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.281+0000 7ff049653000 1 -- 172.21.15.37:0/1305738 wait complete. 2023-10-06T02:24:34.291 INFO:teuthology.orchestra.run.smithi037.stdout:mytag 2023-10-06T02:24:34.291 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2023-10-06T02:24:34.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.371+0000 7f19bd598000 1 Processor -- start 2023-10-06T02:24:34.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.371+0000 7f19bd598000 1 -- start start 2023-10-06T02:24:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.372+0000 7f19bd598000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19a0002330 0x559b71c064b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.372+0000 7f19bd598000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559b71c069f0 0x559b71c0b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.372+0000 7f19bd598000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b71c0b5e0 0x559b71c1fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.372+0000 7f19bd598000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b71b82320 con 0x559b71c0b5e0 2023-10-06T02:24:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.372+0000 7f19bd598000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b71b26980 con 0x7f19a0002330 2023-10-06T02:24:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.372+0000 7f19bd598000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b71b26620 con 0x559b71c069f0 2023-10-06T02:24:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.372+0000 7f19b6fd4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b71c0b5e0 0x559b71c1fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.372+0000 7f19b6fd4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b71c0b5e0 0x559b71c1fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41424/0 (socket says 172.21.15.37:41424) 2023-10-06T02:24:34.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.372+0000 7f19b6fd4700 1 -- 172.21.15.37:0/2200461727 learned_addr learned my addr 172.21.15.37:0/2200461727 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:34.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.372+0000 7f19b67d3700 1 --2- 172.21.15.37:0/2200461727 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19a0002330 0x559b71c064b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.372+0000 7f19b5fd2700 1 --2- 172.21.15.37:0/2200461727 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559b71c069f0 0x559b71c0b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.372+0000 7f19b6fd4700 1 -- 172.21.15.37:0/2200461727 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559b71c069f0 msgr2=0x559b71c0b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:34.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.372+0000 7f19b6fd4700 1 --2- 172.21.15.37:0/2200461727 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559b71c069f0 0x559b71c0b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.372+0000 7f19b6fd4700 1 -- 172.21.15.37:0/2200461727 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19a0002330 msgr2=0x559b71c064b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:34.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.372+0000 7f19b6fd4700 1 --2- 172.21.15.37:0/2200461727 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19a0002330 0x559b71c064b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.372+0000 7f19b6fd4700 1 -- 172.21.15.37:0/2200461727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b71b28ae0 con 0x559b71c0b5e0 2023-10-06T02:24:34.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.372+0000 7f19b6fd4700 1 --2- 172.21.15.37:0/2200461727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b71c0b5e0 0x559b71c1fec0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f19b00044e0 tx=0x7f19b00020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c990991b43666f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.372+0000 7f19b4fd0700 1 -- 172.21.15.37:0/2200461727 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b000f450 con 0x559b71c0b5e0 2023-10-06T02:24:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.372+0000 7f19b4fd0700 1 -- 172.21.15.37:0/2200461727 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b000f5f0 con 0x559b71c0b5e0 2023-10-06T02:24:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.372+0000 7f19b4fd0700 1 -- 172.21.15.37:0/2200461727 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b000f9b0 con 0x559b71c0b5e0 2023-10-06T02:24:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.373+0000 7f19bd598000 1 -- 172.21.15.37:0/2200461727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b71c0b5e0 msgr2=0x559b71c1fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.373+0000 7f19bd598000 1 --2- 172.21.15.37:0/2200461727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b71c0b5e0 0x559b71c1fec0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f19b00044e0 tx=0x7f19b00020c0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.373+0000 7f19bd598000 1 -- 172.21.15.37:0/2200461727 shutdown_connections 2023-10-06T02:24:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.373+0000 7f19bd598000 1 --2- 172.21.15.37:0/2200461727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b71c0b5e0 0x559b71c1fec0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.373+0000 7f19bd598000 1 --2- 172.21.15.37:0/2200461727 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f19a0002330 0x559b71c064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.373+0000 7f19bd598000 1 --2- 172.21.15.37:0/2200461727 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559b71c069f0 0x559b71c0b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.373+0000 7f19bd598000 1 -- 172.21.15.37:0/2200461727 >> 172.21.15.37:0/2200461727 conn(0x559b71bdc500 msgr2=0x559b71c092a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.373+0000 7f19bd598000 1 -- 172.21.15.37:0/2200461727 shutdown_connections 2023-10-06T02:24:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.373+0000 7f19bd598000 1 -- 172.21.15.37:0/2200461727 wait complete. 2023-10-06T02:24:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.373+0000 7f19bd598000 1 Processor -- start 2023-10-06T02:24:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.374+0000 7f19bd598000 1 -- start start 2023-10-06T02:24:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.374+0000 7f19bd598000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b71c069f0 0x559b71ca6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.374+0000 7f19bd598000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b71c0b5e0 0x559b71cb6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.374+0000 7f19bd598000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f19a0002330 0x559b71cb85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.374+0000 7f19bd598000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b71b1d400 con 0x559b71c069f0 2023-10-06T02:24:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.374+0000 7f19bd598000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b71cb76d0 con 0x559b71c0b5e0 2023-10-06T02:24:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.374+0000 7f19bd598000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b71cb7970 con 0x7f19a0002330 2023-10-06T02:24:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.374+0000 7f19b67d3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b71c069f0 0x559b71ca6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.374+0000 7f19b67d3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b71c069f0 0x559b71ca6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41436/0 (socket says 172.21.15.37:41436) 2023-10-06T02:24:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.374+0000 7f19b67d3700 1 -- 172.21.15.37:0/1447494859 learned_addr learned my addr 172.21.15.37:0/1447494859 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.374+0000 7f19b6fd4700 1 --2- 172.21.15.37:0/1447494859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f19a0002330 0x559b71cb85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.374+0000 7f19b5fd2700 1 --2- 172.21.15.37:0/1447494859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b71c0b5e0 0x559b71cb6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.375+0000 7f19b67d3700 1 -- 172.21.15.37:0/1447494859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f19a0002330 msgr2=0x559b71cb85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.375+0000 7f19b67d3700 1 --2- 172.21.15.37:0/1447494859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f19a0002330 0x559b71cb85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.375+0000 7f19b67d3700 1 -- 172.21.15.37:0/1447494859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b71c0b5e0 msgr2=0x559b71cb6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.375+0000 7f19b67d3700 1 --2- 172.21.15.37:0/1447494859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b71c0b5e0 0x559b71cb6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.375+0000 7f19b67d3700 1 -- 172.21.15.37:0/1447494859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b000e040 con 0x559b71c069f0 2023-10-06T02:24:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.375+0000 7f19b67d3700 1 --2- 172.21.15.37:0/1447494859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b71c069f0 0x559b71ca6a20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f19a8005770 tx=0x7f19a8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.375+0000 7f19a6ffd700 1 -- 172.21.15.37:0/1447494859 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a800e040 con 0x559b71c069f0 2023-10-06T02:24:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.375+0000 7f19a6ffd700 1 -- 172.21.15.37:0/1447494859 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a8008ea0 con 0x559b71c069f0 2023-10-06T02:24:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.375+0000 7f19bd598000 1 -- 172.21.15.37:0/1447494859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559b71b28540 con 0x559b71c069f0 2023-10-06T02:24:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.375+0000 7f19a6ffd700 1 -- 172.21.15.37:0/1447494859 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a8013650 con 0x559b71c069f0 2023-10-06T02:24:34.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.375+0000 7f19bd598000 1 -- 172.21.15.37:0/1447494859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b71cb7eb0 con 0x559b71c069f0 2023-10-06T02:24:34.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:24:34.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.376+0000 7f19a6ffd700 1 -- 172.21.15.37:0/1447494859 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19a8013a80 con 0x559b71c069f0 2023-10-06T02:24:34.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.377+0000 7f19a6ffd700 1 --2- 172.21.15.37:0/1447494859 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1998065890 0x7f1998067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.377+0000 7f19a6ffd700 1 -- 172.21.15.37:0/1447494859 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f19a8083e00 con 0x559b71c069f0 2023-10-06T02:24:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.377+0000 7f19b5fd2700 1 --2- 172.21.15.37:0/1447494859 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1998065890 0x7f1998067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.377+0000 7f19bd598000 1 --2- 172.21.15.37:0/1447494859 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x559b71cb7220 0x559b71cc38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.377+0000 7f19bd598000 1 -- 172.21.15.37:0/1447494859 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:1 6.12 6:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559b71cb13b0 con 0x559b71cb7220 2023-10-06T02:24:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.377+0000 7f19b6fd4700 1 --2- 172.21.15.37:0/1447494859 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x559b71cb7220 0x559b71cc38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.377+0000 7f19b5fd2700 1 --2- 172.21.15.37:0/1447494859 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1998065890 0x7f1998067d40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f19ac0010e0 tx=0x7f19ac003930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.378+0000 7f19b6fd4700 1 --2- 172.21.15.37:0/1447494859 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x559b71cb7220 0x559b71cc38c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.378+0000 7f19b6fd4700 1 -- 172.21.15.37:0/1447494859 <== osd.7 v2:172.21.15.191:6813/90854 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f19b000fd20 con 0x559b71cb7220 2023-10-06T02:24:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2023-10-06T02:24:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.378+0000 7f19bd598000 1 -- 172.21.15.37:0/1447494859 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x559b71cb7220 msgr2=0x559b71cc38c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.378+0000 7f19bd598000 1 --2- 172.21.15.37:0/1447494859 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x559b71cb7220 0x559b71cc38c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.378+0000 7f19bd598000 1 -- 172.21.15.37:0/1447494859 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1998065890 msgr2=0x7f1998067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.378+0000 7f19bd598000 1 --2- 172.21.15.37:0/1447494859 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1998065890 0x7f1998067d40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f19ac0010e0 tx=0x7f19ac003930 comp rx=0 tx=0).stop 2023-10-06T02:24:34.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.378+0000 7f19bd598000 1 -- 172.21.15.37:0/1447494859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b71c069f0 msgr2=0x559b71ca6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.378+0000 7f19bd598000 1 --2- 172.21.15.37:0/1447494859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b71c069f0 0x559b71ca6a20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f19a8005770 tx=0x7f19a8015000 comp rx=0 tx=0).stop 2023-10-06T02:24:34.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.378+0000 7f19b6fd4700 1 -- 172.21.15.37:0/1447494859 reap_dead start 2023-10-06T02:24:34.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.378+0000 7f19bd598000 1 -- 172.21.15.37:0/1447494859 shutdown_connections 2023-10-06T02:24:34.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.378+0000 7f19bd598000 1 -- 172.21.15.37:0/1447494859 >> 172.21.15.37:0/1447494859 conn(0x559b71bdc500 msgr2=0x559b71c092a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:34.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.378+0000 7f19bd598000 1 -- 172.21.15.37:0/1447494859 shutdown_connections 2023-10-06T02:24:34.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.378+0000 7f19bd598000 1 -- 172.21.15.37:0/1447494859 wait complete. 2023-10-06T02:24:34.385 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:24:34.386 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:24:34.463 DEBUG:teuthology.orchestra.run.smithi191:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:24:34.516 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:24:34.516 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:24:34.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:34.517 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:24:34.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:24:34.532 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:24:34.532 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:24:34.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:34.532 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:24:34.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:24:34.549 INFO:teuthology.orchestra.run.smithi191.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T02:24:34.549 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:24:34.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:34.549 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T02:24:34.586 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:24:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T02:24:34.587 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:24:34.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:34.587 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T02:24:34.604 INFO:teuthology.orchestra.run.smithi191.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T02:24:34.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:24:34.605 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:34.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.745+0000 7fca33bfd700 1 Processor -- start 2023-10-06T02:24:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.745+0000 7fca33bfd700 1 -- start start 2023-10-06T02:24:34.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.746+0000 7fca33bfd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fca2c159670 0x7fca2c0b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.746+0000 7fca33bfd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca2c159eb0 0x7fca2c06d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.746+0000 7fca33bfd700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca2c15d7a0 con 0x7fca2c159a40 2023-10-06T02:24:34.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.746+0000 7fca33bfd700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2c15da80 con 0x7fca2c159670 2023-10-06T02:24:34.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.746+0000 7fca33bfd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c15dd60 con 0x7fca2c159eb0 2023-10-06T02:24:34.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.746+0000 7fca31999700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fca2c159670 0x7fca2c0b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.746+0000 7fca31198700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fca2c159a40 0x7fca2c067a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42536/0 (socket says 172.21.15.37:42536) 2023-10-06T02:24:34.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.746+0000 7fca31198700 1 -- 172.21.15.37:0/1025180095 learned_addr learned my addr 172.21.15.37:0/1025180095 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:34.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.747+0000 7fca3219a700 1 --2- 172.21.15.37:0/1025180095 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca2c159eb0 0x7fca2c06d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.747+0000 7fca31999700 1 -- 172.21.15.37:0/1025180095 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca2c159eb0 msgr2=0x7fca2c06d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:34.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.747+0000 7fca31999700 1 --2- 172.21.15.37:0/1025180095 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca2c159eb0 0x7fca2c06d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.747+0000 7fca31999700 1 -- 172.21.15.37:0/1025180095 >> v1:172.21.15.37:6789/0 conn(0x7fca2c159a40 legacy=0x7fca2c067a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.747+0000 7fca31999700 1 -- 172.21.15.37:0/1025180095 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c15e040 con 0x7fca2c159670 2023-10-06T02:24:34.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.747+0000 7fca30997700 1 -- 172.21.15.37:0/1025180095 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672223322 0 0) 0x7fca2c15d7a0 con 0x7fca2c159a40 2023-10-06T02:24:34.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.747+0000 7fca3219a700 1 --2- 172.21.15.37:0/1025180095 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca2c159eb0 0x7fca2c06d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:34.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.747+0000 7fca31999700 1 --2- 172.21.15.37:0/1025180095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca2c159670 0x7fca2c0b1ab0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fca240098d0 tx=0x7fca24009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44605a86122e0978 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.747+0000 7fca30997700 1 -- 172.21.15.37:0/1025180095 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca24009e70 con 0x7fca2c159670 2023-10-06T02:24:34.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.747+0000 7fca30997700 1 -- 172.21.15.37:0/1025180095 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca24005c10 con 0x7fca2c159670 2023-10-06T02:24:34.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.747+0000 7fca30997700 1 -- 172.21.15.37:0/1025180095 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2400b650 con 0x7fca2c159670 2023-10-06T02:24:34.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.748+0000 7fca33bfd700 1 -- 172.21.15.37:0/1025180095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca2c159670 msgr2=0x7fca2c0b1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.748+0000 7fca33bfd700 1 --2- 172.21.15.37:0/1025180095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca2c159670 0x7fca2c0b1ab0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fca240098d0 tx=0x7fca24009120 comp rx=0 tx=0).stop 2023-10-06T02:24:34.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.748+0000 7fca33bfd700 1 -- 172.21.15.37:0/1025180095 shutdown_connections 2023-10-06T02:24:34.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.748+0000 7fca33bfd700 1 --2- 172.21.15.37:0/1025180095 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca2c159eb0 0x7fca2c06d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.748+0000 7fca33bfd700 1 --2- 172.21.15.37:0/1025180095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca2c159670 0x7fca2c0b1ab0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.748+0000 7fca33bfd700 1 -- 172.21.15.37:0/1025180095 >> 172.21.15.37:0/1025180095 conn(0x7fca2c0ce330 msgr2=0x7fca2c0ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:34.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.748+0000 7fca33bfd700 1 -- 172.21.15.37:0/1025180095 shutdown_connections 2023-10-06T02:24:34.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.748+0000 7fca33bfd700 1 -- 172.21.15.37:0/1025180095 wait complete. 2023-10-06T02:24:34.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.749+0000 7fca33bfd700 1 Processor -- start 2023-10-06T02:24:34.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.749+0000 7fca33bfd700 1 -- start start 2023-10-06T02:24:34.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca33bfd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca2c159670 0x7fca2c1416c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca33bfd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca2c159a40 0x7fca2c15b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca33bfd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca2c159eb0 0x7fca2c15b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca33bfd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c157a20 con 0x7fca2c159670 2023-10-06T02:24:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca33bfd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c157d00 con 0x7fca2c159eb0 2023-10-06T02:24:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca33bfd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c0c74e0 con 0x7fca2c159a40 2023-10-06T02:24:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca31999700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca2c159670 0x7fca2c1416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca31999700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca2c159670 0x7fca2c1416c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41464/0 (socket says 172.21.15.37:41464) 2023-10-06T02:24:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca31999700 1 -- 172.21.15.37:0/1553905868 learned_addr learned my addr 172.21.15.37:0/1553905868 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca31198700 1 --2- 172.21.15.37:0/1553905868 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca2c159a40 0x7fca2c15b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca3219a700 1 --2- 172.21.15.37:0/1553905868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca2c159eb0 0x7fca2c15b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca31999700 1 -- 172.21.15.37:0/1553905868 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca2c159a40 msgr2=0x7fca2c15b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca31999700 1 --2- 172.21.15.37:0/1553905868 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca2c159a40 0x7fca2c15b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca31999700 1 -- 172.21.15.37:0/1553905868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca2c159eb0 msgr2=0x7fca2c15b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca31999700 1 --2- 172.21.15.37:0/1553905868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca2c159eb0 0x7fca2c15b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca31999700 1 -- 172.21.15.37:0/1553905868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca240093c0 con 0x7fca2c159670 2023-10-06T02:24:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca3219a700 1 --2- 172.21.15.37:0/1553905868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca2c159eb0 0x7fca2c15b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca31999700 1 --2- 172.21.15.37:0/1553905868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca2c159670 0x7fca2c1416c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fca2400b3c0 tx=0x7fca24016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca29ffb700 1 -- 172.21.15.37:0/1553905868 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca24006210 con 0x7fca2c159670 2023-10-06T02:24:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca29ffb700 1 -- 172.21.15.37:0/1553905868 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca24006370 con 0x7fca2c159670 2023-10-06T02:24:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca33bfd700 1 -- 172.21.15.37:0/1553905868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2c0c77c0 con 0x7fca2c159670 2023-10-06T02:24:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.750+0000 7fca29ffb700 1 -- 172.21.15.37:0/1553905868 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca24006730 con 0x7fca2c159670 2023-10-06T02:24:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.751+0000 7fca33bfd700 1 -- 172.21.15.37:0/1553905868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2c141c00 con 0x7fca2c159670 2023-10-06T02:24:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.752+0000 7fca33bfd700 1 -- 172.21.15.37:0/1553905868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca2c06a9d0 con 0x7fca2c159670 2023-10-06T02:24:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.752+0000 7fca29ffb700 1 -- 172.21.15.37:0/1553905868 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca2401b690 con 0x7fca2c159670 2023-10-06T02:24:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.752+0000 7fca29ffb700 1 --2- 172.21.15.37:0/1553905868 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fca18066f30 0x7fca180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.752+0000 7fca29ffb700 1 -- 172.21.15.37:0/1553905868 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fca240866b0 con 0x7fca2c159670 2023-10-06T02:24:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.753+0000 7fca31198700 1 --2- 172.21.15.37:0/1553905868 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fca18066f30 0x7fca180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.753+0000 7fca31198700 1 --2- 172.21.15.37:0/1553905868 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fca18066f30 0x7fca180693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fca2c158ee0 tx=0x7fca20007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:34.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.757+0000 7fca29ffb700 1 -- 172.21.15.37:0/1553905868 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca240537c0 con 0x7fca2c159670 2023-10-06T02:24:34.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.994+0000 7fca33bfd700 1 -- 172.21.15.37:0/1553905868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca2c04bb80 con 0x7fca2c159670 2023-10-06T02:24:34.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.995+0000 7fca29ffb700 1 -- 172.21.15.37:0/1553905868 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fca24056de0 con 0x7fca2c159670 2023-10-06T02:24:34.995 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:34.996 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1320242500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1320242500},{"type":"v1","addr":"172.21.15.37:6835","nonce":1320242500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4900,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/3862379925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3862379925},{"type":"v1","addr":"172.21.15.191:6836","nonce":3862379925}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1922753638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":1922753638},{"type":"v1","addr":"172.21.15.191:6837","nonce":1922753638}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:06.274246+0000","modified":"2023-10-06T02:24:09.884600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/967425730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":967425730},{"type":"v1","addr":"172.21.15.37:6834","nonce":967425730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:24:34.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.997+0000 7fca33bfd700 1 -- 172.21.15.37:0/1553905868 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fca18066f30 msgr2=0x7fca180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.997+0000 7fca33bfd700 1 --2- 172.21.15.37:0/1553905868 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fca18066f30 0x7fca180693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fca2c158ee0 tx=0x7fca20007d30 comp rx=0 tx=0).stop 2023-10-06T02:24:34.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.997+0000 7fca33bfd700 1 -- 172.21.15.37:0/1553905868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca2c159670 msgr2=0x7fca2c1416c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:34.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.997+0000 7fca33bfd700 1 --2- 172.21.15.37:0/1553905868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca2c159670 0x7fca2c1416c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fca2400b3c0 tx=0x7fca24016000 comp rx=0 tx=0).stop 2023-10-06T02:24:34.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.997+0000 7fca33bfd700 1 -- 172.21.15.37:0/1553905868 shutdown_connections 2023-10-06T02:24:34.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.997+0000 7fca33bfd700 1 --2- 172.21.15.37:0/1553905868 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fca18066f30 0x7fca180693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.997+0000 7fca33bfd700 1 --2- 172.21.15.37:0/1553905868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca2c159eb0 0x7fca2c15b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.997+0000 7fca33bfd700 1 --2- 172.21.15.37:0/1553905868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca2c159670 0x7fca2c1416c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.997+0000 7fca33bfd700 1 --2- 172.21.15.37:0/1553905868 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca2c159a40 0x7fca2c15b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:34.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.997+0000 7fca33bfd700 1 -- 172.21.15.37:0/1553905868 >> 172.21.15.37:0/1553905868 conn(0x7fca2c0ce330 msgr2=0x7fca2c1542a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:34.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.997+0000 7fca33bfd700 1 -- 172.21.15.37:0/1553905868 shutdown_connections 2023-10-06T02:24:34.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:34.997+0000 7fca33bfd700 1 -- 172.21.15.37:0/1553905868 wait complete. 2023-10-06T02:24:34.999 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2023-10-06T02:24:35.009 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:24:35.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.128+0000 7f1306bb9700 1 Processor -- start 2023-10-06T02:24:35.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.128+0000 7f1306bb9700 1 -- start start 2023-10-06T02:24:35.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.128+0000 7f1306bb9700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f13000a8920 0x7f13000b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:35.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.128+0000 7f1306bb9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1300159750 0x7f13000b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:35.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.128+0000 7f1306bb9700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f130015d1f0 con 0x7f13000a8cf0 2023-10-06T02:24:35.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.129+0000 7f1306bb9700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13000b4150 con 0x7f13000a8920 2023-10-06T02:24:35.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.129+0000 7f1306bb9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13000b1ce0 con 0x7f1300159750 2023-10-06T02:24:35.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.129+0000 7f1304955700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f13000a8920 0x7f13000b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:35.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.129+0000 7f1305156700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1300159750 0x7f13000b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:35.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.129+0000 7f1304955700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f13000a8920 0x7f13000b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:40834/0 (socket says 172.21.15.37:40834) 2023-10-06T02:24:35.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.129+0000 7f1304955700 1 -- 172.21.15.37:0/3844727601 learned_addr learned my addr 172.21.15.37:0/3844727601 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:35.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.129+0000 7f1304955700 1 -- 172.21.15.37:0/3844727601 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1300159750 msgr2=0x7f13000b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:35.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.129+0000 7f1304955700 1 --2- 172.21.15.37:0/3844727601 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1300159750 0x7f13000b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.129+0000 7f1304955700 1 -- 172.21.15.37:0/3844727601 >> v1:172.21.15.191:6789/0 conn(0x7f13000a8cf0 legacy=0x7f1300159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:35.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.129+0000 7f1304955700 1 -- 172.21.15.37:0/3844727601 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130015dd70 con 0x7f13000a8920 2023-10-06T02:24:35.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.129+0000 7f1304955700 1 --2- 172.21.15.37:0/3844727601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13000a8920 0x7f13000b1090 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009f70 tx=0x7f12f8009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdfe2dfafd049239 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:35.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.130+0000 7f12ff7fe700 1 -- 172.21.15.37:0/3844727601 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f800e070 con 0x7f13000a8920 2023-10-06T02:24:35.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.130+0000 7f12ff7fe700 1 -- 172.21.15.37:0/3844727601 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f800b920 con 0x7f13000a8920 2023-10-06T02:24:35.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.130+0000 7f12ff7fe700 1 -- 172.21.15.37:0/3844727601 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f80092e0 con 0x7f13000a8920 2023-10-06T02:24:35.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.130+0000 7f1306bb9700 1 -- 172.21.15.37:0/3844727601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13000a8920 msgr2=0x7f13000b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:35.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.130+0000 7f1306bb9700 1 --2- 172.21.15.37:0/3844727601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13000a8920 0x7f13000b1090 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009f70 tx=0x7f12f8009840 comp rx=0 tx=0).stop 2023-10-06T02:24:35.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.130+0000 7f1306bb9700 1 -- 172.21.15.37:0/3844727601 shutdown_connections 2023-10-06T02:24:35.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.130+0000 7f1306bb9700 1 --2- 172.21.15.37:0/3844727601 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1300159750 0x7f13000b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.130+0000 7f1306bb9700 1 --2- 172.21.15.37:0/3844727601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13000a8920 0x7f13000b1090 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.130+0000 7f1306bb9700 1 -- 172.21.15.37:0/3844727601 >> 172.21.15.37:0/3844727601 conn(0x7f1300067b30 msgr2=0x7f1300067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:35.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.130+0000 7f1306bb9700 1 -- 172.21.15.37:0/3844727601 shutdown_connections 2023-10-06T02:24:35.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.130+0000 7f1306bb9700 1 -- 172.21.15.37:0/3844727601 wait complete. 2023-10-06T02:24:35.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.131+0000 7f1306bb9700 1 Processor -- start 2023-10-06T02:24:35.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.132+0000 7f1306bb9700 1 -- start start 2023-10-06T02:24:35.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.132+0000 7f1306bb9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13000a8920 0x7f13001507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:35.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.132+0000 7f1306bb9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13000a8cf0 0x7f13000a5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:35.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.132+0000 7f1306bb9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1300159750 0x7f130015e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:35.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.132+0000 7f1306bb9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000a5d90 con 0x7f13000a8cf0 2023-10-06T02:24:35.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.132+0000 7f1306bb9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000a6070 con 0x7f13000a8920 2023-10-06T02:24:35.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.132+0000 7f1306bb9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13000a6350 con 0x7f1300159750 2023-10-06T02:24:35.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.132+0000 7f12fffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13000a8cf0 0x7f13000a5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:35.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.132+0000 7f12fffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13000a8cf0 0x7f13000a5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41472/0 (socket says 172.21.15.37:41472) 2023-10-06T02:24:35.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.132+0000 7f12fffff700 1 -- 172.21.15.37:0/838556712 learned_addr learned my addr 172.21.15.37:0/838556712 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:35.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.133+0000 7f1304955700 1 --2- 172.21.15.37:0/838556712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13000a8920 0x7f13001507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:35.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.133+0000 7f1305156700 1 --2- 172.21.15.37:0/838556712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1300159750 0x7f130015e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:35.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.133+0000 7f12fffff700 1 -- 172.21.15.37:0/838556712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1300159750 msgr2=0x7f130015e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:35.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.133+0000 7f12fffff700 1 --2- 172.21.15.37:0/838556712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1300159750 0x7f130015e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.133+0000 7f12fffff700 1 -- 172.21.15.37:0/838556712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13000a8920 msgr2=0x7f13001507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:35.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.133+0000 7f12fffff700 1 --2- 172.21.15.37:0/838556712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13000a8920 0x7f13001507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.133+0000 7f12fffff700 1 -- 172.21.15.37:0/838556712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f8009ae0 con 0x7f13000a8cf0 2023-10-06T02:24:35.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.133+0000 7f12fffff700 1 --2- 172.21.15.37:0/838556712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13000a8cf0 0x7f13000a5490 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f12f000c810 tx=0x7f12f0007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:35.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.133+0000 7f12fcff9700 1 -- 172.21.15.37:0/838556712 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0011590 con 0x7f13000a8cf0 2023-10-06T02:24:35.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.133+0000 7f12fcff9700 1 -- 172.21.15.37:0/838556712 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f00116f0 con 0x7f13000a8cf0 2023-10-06T02:24:35.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.133+0000 7f1306bb9700 1 -- 172.21.15.37:0/838556712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1300156940 con 0x7f13000a8cf0 2023-10-06T02:24:35.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.133+0000 7f12fcff9700 1 -- 172.21.15.37:0/838556712 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0011ab0 con 0x7f13000a8cf0 2023-10-06T02:24:35.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.133+0000 7f1306bb9700 1 -- 172.21.15.37:0/838556712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13000a59d0 con 0x7f13000a8cf0 2023-10-06T02:24:35.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.134+0000 7f1306bb9700 1 -- 172.21.15.37:0/838556712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13001567b0 con 0x7f13000a8cf0 2023-10-06T02:24:35.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.134+0000 7f12fcff9700 1 -- 172.21.15.37:0/838556712 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12f001b3b0 con 0x7f13000a8cf0 2023-10-06T02:24:35.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.135+0000 7f12fcff9700 1 --2- 172.21.15.37:0/838556712 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f12e0066f30 0x7f12e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:35.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.135+0000 7f12fcff9700 1 -- 172.21.15.37:0/838556712 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f12f0083c30 con 0x7f13000a8cf0 2023-10-06T02:24:35.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.135+0000 7f1304955700 1 --2- 172.21.15.37:0/838556712 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f12e0066f30 0x7f12e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:35.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.136+0000 7f1304955700 1 --2- 172.21.15.37:0/838556712 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f12e0066f30 0x7f12e00693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009880 tx=0x7f12f8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:35.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.139+0000 7f12fcff9700 1 -- 172.21.15.37:0/838556712 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12f0050d40 con 0x7f13000a8cf0 2023-10-06T02:24:35.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.333+0000 7f1306bb9700 1 -- 172.21.15.37:0/838556712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13000ad980 con 0x7f13000a8cf0 2023-10-06T02:24:35.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.334+0000 7f12fcff9700 1 -- 172.21.15.37:0/838556712 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f12f0017070 con 0x7f13000a8cf0 2023-10-06T02:24:35.334 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:35.335 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:24:07.621902+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:24:04.559429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T02:24:05.263596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:24:35.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.336+0000 7f1306bb9700 1 -- 172.21.15.37:0/838556712 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f12e0066f30 msgr2=0x7f12e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:35.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.336+0000 7f1306bb9700 1 --2- 172.21.15.37:0/838556712 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f12e0066f30 0x7f12e00693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009880 tx=0x7f12f8017000 comp rx=0 tx=0).stop 2023-10-06T02:24:35.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.336+0000 7f1306bb9700 1 -- 172.21.15.37:0/838556712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13000a8cf0 msgr2=0x7f13000a5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:35.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.336+0000 7f1306bb9700 1 --2- 172.21.15.37:0/838556712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13000a8cf0 0x7f13000a5490 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f12f000c810 tx=0x7f12f0007ee0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.336+0000 7f1306bb9700 1 -- 172.21.15.37:0/838556712 shutdown_connections 2023-10-06T02:24:35.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.336+0000 7f1306bb9700 1 --2- 172.21.15.37:0/838556712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1300159750 0x7f130015e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.336+0000 7f1306bb9700 1 --2- 172.21.15.37:0/838556712 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f12e0066f30 0x7f12e00693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.336+0000 7f1306bb9700 1 --2- 172.21.15.37:0/838556712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13000a8920 0x7f13001507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.336+0000 7f1306bb9700 1 --2- 172.21.15.37:0/838556712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13000a8cf0 0x7f13000a5490 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.336+0000 7f1306bb9700 1 -- 172.21.15.37:0/838556712 >> 172.21.15.37:0/838556712 conn(0x7f1300067b30 msgr2=0x7f1300068110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:35.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.336+0000 7f1306bb9700 1 -- 172.21.15.37:0/838556712 shutdown_connections 2023-10-06T02:24:35.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.336+0000 7f1306bb9700 1 -- 172.21.15.37:0/838556712 wait complete. 2023-10-06T02:24:35.349 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:23:08.066048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:23:08.561964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:24:04.559429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:24:05.263596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:24:35.349 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:24:35.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.470+0000 7f341655d700 1 Processor -- start 2023-10-06T02:24:35.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.471+0000 7f341655d700 1 -- start start 2023-10-06T02:24:35.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.471+0000 7f341655d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34101559d0 0x7f341006e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:35.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.471+0000 7f341655d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34100c73e0 con 0x7f3410155da0 2023-10-06T02:24:35.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.471+0000 7f341655d700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34100c67d0 con 0x7f341006a520 2023-10-06T02:24:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.471+0000 7f341655d700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34100c6ab0 con 0x7f34101559d0 2023-10-06T02:24:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.471+0000 7f340ffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34101559d0 0x7f341006e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.471+0000 7f340f7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3410155da0 0x7f3410069e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36030/0 (socket says 172.21.15.37:36030) 2023-10-06T02:24:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.472+0000 7f340ffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34101559d0 0x7f341006e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38326/0 (socket says 172.21.15.37:38326) 2023-10-06T02:24:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.472+0000 7f340f7fe700 1 -- 172.21.15.37:0/3108664669 learned_addr learned my addr 172.21.15.37:0/3108664669 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.472+0000 7f340ffff700 1 -- 172.21.15.37:0/3108664669 >> v1:172.21.15.191:6789/0 conn(0x7f341006a520 legacy=0x7f34100c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.472+0000 7f340ffff700 1 -- 172.21.15.37:0/3108664669 >> v1:172.21.15.37:6789/0 conn(0x7f3410155da0 legacy=0x7f3410069e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.472+0000 7f340ffff700 1 -- 172.21.15.37:0/3108664669 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34100c6d90 con 0x7f34101559d0 2023-10-06T02:24:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.472+0000 7f340ffff700 1 --2- 172.21.15.37:0/3108664669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34101559d0 0x7f341006e5e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f340000bb90 tx=0x7f340000b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40464b148cfbc3f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.472+0000 7f340effd700 1 -- 172.21.15.37:0/3108664669 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340000da90 con 0x7f34101559d0 2023-10-06T02:24:35.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.472+0000 7f340effd700 1 -- 172.21.15.37:0/3108664669 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340000dbf0 con 0x7f34101559d0 2023-10-06T02:24:35.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.472+0000 7f340effd700 1 -- 172.21.15.37:0/3108664669 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400017410 con 0x7f34101559d0 2023-10-06T02:24:35.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.473+0000 7f341655d700 1 -- 172.21.15.37:0/3108664669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34101559d0 msgr2=0x7f341006e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:35.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.473+0000 7f341655d700 1 --2- 172.21.15.37:0/3108664669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34101559d0 0x7f341006e5e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f340000bb90 tx=0x7f340000b430 comp rx=0 tx=0).stop 2023-10-06T02:24:35.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.473+0000 7f341655d700 1 -- 172.21.15.37:0/3108664669 shutdown_connections 2023-10-06T02:24:35.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.473+0000 7f341655d700 1 --2- 172.21.15.37:0/3108664669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34101559d0 0x7f341006e5e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.473+0000 7f341655d700 1 -- 172.21.15.37:0/3108664669 >> 172.21.15.37:0/3108664669 conn(0x7f34100cc100 msgr2=0x7f34100cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:35.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.473+0000 7f341655d700 1 -- 172.21.15.37:0/3108664669 shutdown_connections 2023-10-06T02:24:35.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.473+0000 7f341655d700 1 -- 172.21.15.37:0/3108664669 wait complete. 2023-10-06T02:24:35.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.474+0000 7f341655d700 1 Processor -- start 2023-10-06T02:24:35.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.474+0000 7f341655d700 1 -- start start 2023-10-06T02:24:35.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.475+0000 7f341655d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f341006a520 0x7f34100b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:35.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.475+0000 7f341655d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34101559d0 0x7f3410151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:35.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.475+0000 7f341655d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3410155da0 0x7f34100987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:35.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.475+0000 7f341655d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34100b18f0 con 0x7f3410155da0 2023-10-06T02:24:35.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.475+0000 7f341655d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34100980c0 con 0x7f34101559d0 2023-10-06T02:24:35.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.475+0000 7f341655d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3410097c30 con 0x7f341006a520 2023-10-06T02:24:35.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.475+0000 7f3414afa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3410155da0 0x7f34100987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:35.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.475+0000 7f3414afa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3410155da0 0x7f34100987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38330/0 (socket says 172.21.15.37:38330) 2023-10-06T02:24:35.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.475+0000 7f3414afa700 1 -- 172.21.15.37:0/3230680371 learned_addr learned my addr 172.21.15.37:0/3230680371 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:35.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.475+0000 7f340f7fe700 1 --2- 172.21.15.37:0/3230680371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34101559d0 0x7f3410151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:35.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.475+0000 7f340ffff700 1 --2- 172.21.15.37:0/3230680371 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f341006a520 0x7f34100b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:35.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.475+0000 7f3414afa700 1 -- 172.21.15.37:0/3230680371 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f341006a520 msgr2=0x7f34100b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:35.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.475+0000 7f3414afa700 1 --2- 172.21.15.37:0/3230680371 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f341006a520 0x7f34100b13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.475+0000 7f3414afa700 1 -- 172.21.15.37:0/3230680371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34101559d0 msgr2=0x7f3410151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:35.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.475+0000 7f3414afa700 1 --2- 172.21.15.37:0/3230680371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34101559d0 0x7f3410151430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.475+0000 7f3414afa700 1 -- 172.21.15.37:0/3230680371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340000b6d0 con 0x7f3410155da0 2023-10-06T02:24:35.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.475+0000 7f3414afa700 1 --2- 172.21.15.37:0/3230680371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3410155da0 0x7f34100987e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f340800c910 tx=0x7f34080016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:35.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.476+0000 7f33f7fff700 1 -- 172.21.15.37:0/3230680371 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408012630 con 0x7f3410155da0 2023-10-06T02:24:35.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.476+0000 7f33f7fff700 1 -- 172.21.15.37:0/3230680371 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34080127b0 con 0x7f3410155da0 2023-10-06T02:24:35.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.476+0000 7f341655d700 1 -- 172.21.15.37:0/3230680371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3410099690 con 0x7f3410155da0 2023-10-06T02:24:35.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.476+0000 7f33f7fff700 1 -- 172.21.15.37:0/3230680371 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408012b70 con 0x7f3410155da0 2023-10-06T02:24:35.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.476+0000 7f341655d700 1 -- 172.21.15.37:0/3230680371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34100978c0 con 0x7f3410155da0 2023-10-06T02:24:35.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.477+0000 7f341655d700 1 -- 172.21.15.37:0/3230680371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3410097440 con 0x7f3410155da0 2023-10-06T02:24:35.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.477+0000 7f33f7fff700 1 -- 172.21.15.37:0/3230680371 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3408003030 con 0x7f3410155da0 2023-10-06T02:24:35.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.477+0000 7f33f7fff700 1 --2- 172.21.15.37:0/3230680371 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f33fc066f30 0x7f33fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:35.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.477+0000 7f33f7fff700 1 -- 172.21.15.37:0/3230680371 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3408084480 con 0x7f3410155da0 2023-10-06T02:24:35.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.478+0000 7f340ffff700 1 --2- 172.21.15.37:0/3230680371 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f33fc066f30 0x7f33fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:35.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.478+0000 7f340ffff700 1 --2- 172.21.15.37:0/3230680371 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f33fc066f30 0x7f33fc0693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3400006db0 tx=0x7f3400019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:35.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.482+0000 7f33f7fff700 1 -- 172.21.15.37:0/3230680371 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3410097440 con 0x7f3410155da0 2023-10-06T02:24:35.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.677+0000 7f341655d700 1 -- 172.21.15.37:0/3230680371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3410097440 con 0x7f3410155da0 2023-10-06T02:24:35.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.678+0000 7f33f7fff700 1 -- 172.21.15.37:0/3230680371 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3410097440 con 0x7f3410155da0 2023-10-06T02:24:35.678 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T02:24:35.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.680+0000 7f341655d700 1 -- 172.21.15.37:0/3230680371 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f33fc066f30 msgr2=0x7f33fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:35.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.680+0000 7f341655d700 1 --2- 172.21.15.37:0/3230680371 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f33fc066f30 0x7f33fc0693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3400006db0 tx=0x7f3400019000 comp rx=0 tx=0).stop 2023-10-06T02:24:35.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.680+0000 7f341655d700 1 -- 172.21.15.37:0/3230680371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3410155da0 msgr2=0x7f34100987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:35.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.680+0000 7f341655d700 1 --2- 172.21.15.37:0/3230680371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3410155da0 0x7f34100987e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f340800c910 tx=0x7f34080016b0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.680+0000 7f341655d700 1 -- 172.21.15.37:0/3230680371 shutdown_connections 2023-10-06T02:24:35.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.680+0000 7f341655d700 1 --2- 172.21.15.37:0/3230680371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3410155da0 0x7f34100987e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.680+0000 7f341655d700 1 --2- 172.21.15.37:0/3230680371 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f341006a520 0x7f34100b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.680+0000 7f341655d700 1 --2- 172.21.15.37:0/3230680371 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f33fc066f30 0x7f33fc0693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.680+0000 7f341655d700 1 --2- 172.21.15.37:0/3230680371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34101559d0 0x7f3410151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.680+0000 7f341655d700 1 -- 172.21.15.37:0/3230680371 >> 172.21.15.37:0/3230680371 conn(0x7f34100cc100 msgr2=0x7f34100c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:35.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.680+0000 7f341655d700 1 -- 172.21.15.37:0/3230680371 shutdown_connections 2023-10-06T02:24:35.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.680+0000 7f341655d700 1 -- 172.21.15.37:0/3230680371 wait complete. 2023-10-06T02:24:35.692 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:24:35.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.814+0000 7fb38e654700 1 Processor -- start 2023-10-06T02:24:35.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.814+0000 7fb38e654700 1 -- start start 2023-10-06T02:24:35.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.814+0000 7fb38e654700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb3881593c0 0x7fb388159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:35.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.814+0000 7fb38e654700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb3880b2380 0x7fb3880b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:35.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.814+0000 7fb38e654700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3880b07a0 con 0x7fb3880ccb30 2023-10-06T02:24:35.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.814+0000 7fb38e654700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3880cd6a0 con 0x7fb3881593c0 2023-10-06T02:24:35.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.814+0000 7fb38e654700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3880cd8a0 con 0x7fb3880b2380 2023-10-06T02:24:35.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.815+0000 7fb387fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb3881593c0 0x7fb388159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:35.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.815+0000 7fb38cbf1700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb3880ccb30 0x7fb3880ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36040/0 (socket says 172.21.15.37:36040) 2023-10-06T02:24:35.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.815+0000 7fb38cbf1700 1 -- 172.21.15.37:0/693564573 learned_addr learned my addr 172.21.15.37:0/693564573 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:35.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.815+0000 7fb3877fe700 1 --2- 172.21.15.37:0/693564573 >> v2:172.21.15.191:3300/0 conn(0x7fb3880b2380 0x7fb3880b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:35.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.815+0000 7fb387fff700 1 -- 172.21.15.37:0/693564573 >> v2:172.21.15.191:3300/0 conn(0x7fb3880b2380 msgr2=0x7fb3880b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:35.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.815+0000 7fb387fff700 1 --2- 172.21.15.37:0/693564573 >> v2:172.21.15.191:3300/0 conn(0x7fb3880b2380 0x7fb3880b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.815+0000 7fb387fff700 1 -- 172.21.15.37:0/693564573 >> v1:172.21.15.37:6789/0 conn(0x7fb3880ccb30 legacy=0x7fb3880ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:35.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.815+0000 7fb386ffd700 1 -- 172.21.15.37:0/693564573 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89978573 0 0) 0x7fb3880b07a0 con 0x7fb3880ccb30 2023-10-06T02:24:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.815+0000 7fb387fff700 1 -- 172.21.15.37:0/693564573 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3880afe70 con 0x7fb3881593c0 2023-10-06T02:24:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.815+0000 7fb387fff700 1 --2- 172.21.15.37:0/693564573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3881593c0 0x7fb388159790 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb3880b2170 tx=0x7fb3780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6763ea0e03d97f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.815+0000 7fb386ffd700 1 -- 172.21.15.37:0/693564573 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb378011630 con 0x7fb3881593c0 2023-10-06T02:24:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.815+0000 7fb386ffd700 1 -- 172.21.15.37:0/693564573 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb378011790 con 0x7fb3881593c0 2023-10-06T02:24:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.815+0000 7fb386ffd700 1 -- 172.21.15.37:0/693564573 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb378011b30 con 0x7fb3881593c0 2023-10-06T02:24:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.816+0000 7fb38e654700 1 -- 172.21.15.37:0/693564573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3881593c0 msgr2=0x7fb388159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.816+0000 7fb38e654700 1 --2- 172.21.15.37:0/693564573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3881593c0 0x7fb388159790 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb3880b2170 tx=0x7fb3780091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.816+0000 7fb38e654700 1 -- 172.21.15.37:0/693564573 shutdown_connections 2023-10-06T02:24:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.816+0000 7fb38e654700 1 --2- 172.21.15.37:0/693564573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3881593c0 0x7fb388159790 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.816+0000 7fb38e654700 1 --2- 172.21.15.37:0/693564573 >> v2:172.21.15.191:3300/0 conn(0x7fb3880b2380 0x7fb3880b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.816+0000 7fb38e654700 1 -- 172.21.15.37:0/693564573 >> 172.21.15.37:0/693564573 conn(0x7fb38806c0b0 msgr2=0x7fb38806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:35.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.816+0000 7fb38e654700 1 -- 172.21.15.37:0/693564573 shutdown_connections 2023-10-06T02:24:35.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.816+0000 7fb38e654700 1 -- 172.21.15.37:0/693564573 wait complete. 2023-10-06T02:24:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.817+0000 7fb38e654700 1 Processor -- start 2023-10-06T02:24:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.817+0000 7fb38e654700 1 -- start start 2023-10-06T02:24:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.818+0000 7fb38e654700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3880b2380 0x7fb388160410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.818+0000 7fb38e654700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3880ccb30 0x7fb3880c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:35.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.818+0000 7fb38e654700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3881593c0 0x7fb3880c4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:35.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.818+0000 7fb38e654700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb388158150 con 0x7fb3881593c0 2023-10-06T02:24:35.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.818+0000 7fb38e654700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb388160950 con 0x7fb3880ccb30 2023-10-06T02:24:35.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.818+0000 7fb38e654700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3880c6480 con 0x7fb3880b2380 2023-10-06T02:24:35.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.818+0000 7fb38cbf1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3881593c0 0x7fb3880c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:35.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.818+0000 7fb38cbf1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3881593c0 0x7fb3880c4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38352/0 (socket says 172.21.15.37:38352) 2023-10-06T02:24:35.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.818+0000 7fb38cbf1700 1 -- 172.21.15.37:0/2289756880 learned_addr learned my addr 172.21.15.37:0/2289756880 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:35.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.818+0000 7fb387fff700 1 --2- 172.21.15.37:0/2289756880 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3880b2380 0x7fb388160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:35.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.818+0000 7fb3877fe700 1 --2- 172.21.15.37:0/2289756880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3880ccb30 0x7fb3880c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:35.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.818+0000 7fb38cbf1700 1 -- 172.21.15.37:0/2289756880 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3880b2380 msgr2=0x7fb388160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:35.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.818+0000 7fb38cbf1700 1 --2- 172.21.15.37:0/2289756880 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3880b2380 0x7fb388160410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.818+0000 7fb38cbf1700 1 -- 172.21.15.37:0/2289756880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3880ccb30 msgr2=0x7fb3880c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:35.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.818+0000 7fb38cbf1700 1 --2- 172.21.15.37:0/2289756880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3880ccb30 0x7fb3880c3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:35.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.818+0000 7fb38cbf1700 1 -- 172.21.15.37:0/2289756880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb378009420 con 0x7fb3881593c0 2023-10-06T02:24:35.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.818+0000 7fb387fff700 1 --2- 172.21.15.37:0/2289756880 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3880b2380 0x7fb388160410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:35.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.818+0000 7fb38cbf1700 1 --2- 172.21.15.37:0/2289756880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3881593c0 0x7fb3880c4260 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb38000ccc0 tx=0x7fb380001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:35.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.819+0000 7fb36ffff700 1 -- 172.21.15.37:0/2289756880 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38000a9e0 con 0x7fb3881593c0 2023-10-06T02:24:35.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.819+0000 7fb36ffff700 1 -- 172.21.15.37:0/2289756880 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38000ab40 con 0x7fb3881593c0 2023-10-06T02:24:35.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.819+0000 7fb38e654700 1 -- 172.21.15.37:0/2289756880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3880c4890 con 0x7fb3881593c0 2023-10-06T02:24:35.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.819+0000 7fb36ffff700 1 -- 172.21.15.37:0/2289756880 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3800070f0 con 0x7fb3881593c0 2023-10-06T02:24:35.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.819+0000 7fb38e654700 1 -- 172.21.15.37:0/2289756880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3880c4e50 con 0x7fb3881593c0 2023-10-06T02:24:35.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.820+0000 7fb38e654700 1 -- 172.21.15.37:0/2289756880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb388088bb0 con 0x7fb3881593c0 2023-10-06T02:24:35.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.820+0000 7fb36ffff700 1 -- 172.21.15.37:0/2289756880 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3800074a0 con 0x7fb3881593c0 2023-10-06T02:24:35.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.820+0000 7fb36ffff700 1 --2- 172.21.15.37:0/2289756880 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb374066f30 0x7fb3740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:35.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.820+0000 7fb36ffff700 1 -- 172.21.15.37:0/2289756880 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb380084b00 con 0x7fb3881593c0 2023-10-06T02:24:35.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.821+0000 7fb387fff700 1 --2- 172.21.15.37:0/2289756880 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb374066f30 0x7fb3740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:35.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.821+0000 7fb387fff700 1 --2- 172.21.15.37:0/2289756880 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb374066f30 0x7fb3740693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb3780093f0 tx=0x7fb378017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:35.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:35.825+0000 7fb36ffff700 1 -- 172.21.15.37:0/2289756880 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb380051c90 con 0x7fb3881593c0 2023-10-06T02:24:36.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.017+0000 7fb38e654700 1 -- 172.21.15.37:0/2289756880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb3880b0150 con 0x7fb3881593c0 2023-10-06T02:24:36.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.017+0000 7fb36ffff700 1 -- 172.21.15.37:0/2289756880 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb3800552b0 con 0x7fb3881593c0 2023-10-06T02:24:36.018 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T02:24:36.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.019+0000 7fb38e654700 1 -- 172.21.15.37:0/2289756880 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb374066f30 msgr2=0x7fb3740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.019+0000 7fb38e654700 1 --2- 172.21.15.37:0/2289756880 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb374066f30 0x7fb3740693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb3780093f0 tx=0x7fb378017000 comp rx=0 tx=0).stop 2023-10-06T02:24:36.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.019+0000 7fb38e654700 1 -- 172.21.15.37:0/2289756880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3881593c0 msgr2=0x7fb3880c4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.019+0000 7fb38e654700 1 --2- 172.21.15.37:0/2289756880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3881593c0 0x7fb3880c4260 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb38000ccc0 tx=0x7fb380001a80 comp rx=0 tx=0).stop 2023-10-06T02:24:36.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.019+0000 7fb38e654700 1 -- 172.21.15.37:0/2289756880 shutdown_connections 2023-10-06T02:24:36.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.019+0000 7fb38e654700 1 --2- 172.21.15.37:0/2289756880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3881593c0 0x7fb3880c4260 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.019+0000 7fb38e654700 1 --2- 172.21.15.37:0/2289756880 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3880b2380 0x7fb388160410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.019+0000 7fb38e654700 1 --2- 172.21.15.37:0/2289756880 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb374066f30 0x7fb3740693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.019+0000 7fb38e654700 1 --2- 172.21.15.37:0/2289756880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3880ccb30 0x7fb3880c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.019+0000 7fb38e654700 1 -- 172.21.15.37:0/2289756880 >> 172.21.15.37:0/2289756880 conn(0x7fb38806c0b0 msgr2=0x7fb3880d0500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:36.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.019+0000 7fb38e654700 1 -- 172.21.15.37:0/2289756880 shutdown_connections 2023-10-06T02:24:36.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.019+0000 7fb38e654700 1 -- 172.21.15.37:0/2289756880 wait complete. 2023-10-06T02:24:36.032 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:24:36.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.153+0000 7f357c4fe700 1 Processor -- start 2023-10-06T02:24:36.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.153+0000 7f357c4fe700 1 -- start start 2023-10-06T02:24:36.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.154+0000 7f357c4fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f3574150380 0x7f35740b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.154+0000 7f357c4fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35740b1ca0 0x7f357406d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.154+0000 7f357c4fe700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357415e070 con 0x7f3574150750 2023-10-06T02:24:36.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.154+0000 7f357c4fe700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357415d1c0 con 0x7f3574150380 2023-10-06T02:24:36.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.154+0000 7f357c4fe700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357415d460 con 0x7f35740b1ca0 2023-10-06T02:24:36.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.155+0000 7f357a29a700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f3574150380 0x7f35740b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.155+0000 7f357aa9b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35740b1ca0 0x7f357406d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.155+0000 7f357a29a700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f3574150380 0x7f35740b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:53552/0 (socket says 172.21.15.37:53552) 2023-10-06T02:24:36.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.155+0000 7f357a29a700 1 -- 172.21.15.37:0/3836327478 learned_addr learned my addr 172.21.15.37:0/3836327478 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:36.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.155+0000 7f357a29a700 1 -- 172.21.15.37:0/3836327478 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35740b1ca0 msgr2=0x7f357406d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:36.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.155+0000 7f357a29a700 1 --2- 172.21.15.37:0/3836327478 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35740b1ca0 0x7f357406d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.155+0000 7f357a29a700 1 -- 172.21.15.37:0/3836327478 >> v1:172.21.15.191:6789/0 conn(0x7f3574150750 legacy=0x7f35740b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.155+0000 7f357a29a700 1 -- 172.21.15.37:0/3836327478 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357415d740 con 0x7f3574150380 2023-10-06T02:24:36.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.155+0000 7f357a29a700 1 --2- 172.21.15.37:0/3836327478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3574150380 0x7f35740b3c90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3564009f20 tx=0x7f3564009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b92f4ca8bbe96eff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:36.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.155+0000 7f3579298700 1 -- 172.21.15.37:0/3836327478 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356400e070 con 0x7f3574150380 2023-10-06T02:24:36.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.155+0000 7f3579298700 1 -- 172.21.15.37:0/3836327478 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356400b9d0 con 0x7f3574150380 2023-10-06T02:24:36.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.155+0000 7f3579298700 1 -- 172.21.15.37:0/3836327478 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35640092e0 con 0x7f3574150380 2023-10-06T02:24:36.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.156+0000 7f357c4fe700 1 -- 172.21.15.37:0/3836327478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3574150380 msgr2=0x7f35740b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.156+0000 7f357c4fe700 1 --2- 172.21.15.37:0/3836327478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3574150380 0x7f35740b3c90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3564009f20 tx=0x7f3564009840 comp rx=0 tx=0).stop 2023-10-06T02:24:36.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.156+0000 7f357c4fe700 1 -- 172.21.15.37:0/3836327478 shutdown_connections 2023-10-06T02:24:36.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.156+0000 7f357c4fe700 1 --2- 172.21.15.37:0/3836327478 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35740b1ca0 0x7f357406d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.156+0000 7f357c4fe700 1 --2- 172.21.15.37:0/3836327478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3574150380 0x7f35740b3c90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.156+0000 7f357c4fe700 1 -- 172.21.15.37:0/3836327478 >> 172.21.15.37:0/3836327478 conn(0x7f357406c0b0 msgr2=0x7f357406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:36.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.156+0000 7f357c4fe700 1 -- 172.21.15.37:0/3836327478 shutdown_connections 2023-10-06T02:24:36.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.156+0000 7f357c4fe700 1 -- 172.21.15.37:0/3836327478 wait complete. 2023-10-06T02:24:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.157+0000 7f357c4fe700 1 Processor -- start 2023-10-06T02:24:36.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.157+0000 7f357c4fe700 1 -- start start 2023-10-06T02:24:36.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.158+0000 7f357c4fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35740b1ca0 0x7f3574140c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.158+0000 7f357c4fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3574150380 0x7f357406dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.158+0000 7f357c4fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3574150750 0x7f357406e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.158+0000 7f357c4fe700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357416a7b0 con 0x7f35740b1ca0 2023-10-06T02:24:36.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.158+0000 7f357c4fe700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35740ca330 con 0x7f3574150380 2023-10-06T02:24:36.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.158+0000 7f357c4fe700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357416a160 con 0x7f3574150750 2023-10-06T02:24:36.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.158+0000 7f357a29a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35740b1ca0 0x7f3574140c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.158+0000 7f357a29a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35740b1ca0 0x7f3574140c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38358/0 (socket says 172.21.15.37:38358) 2023-10-06T02:24:36.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.158+0000 7f357a29a700 1 -- 172.21.15.37:0/3850509655 learned_addr learned my addr 172.21.15.37:0/3850509655 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:36.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.158+0000 7f357aa9b700 1 --2- 172.21.15.37:0/3850509655 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3574150750 0x7f357406e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.158+0000 7f3579a99700 1 --2- 172.21.15.37:0/3850509655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3574150380 0x7f357406dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.158+0000 7f357a29a700 1 -- 172.21.15.37:0/3850509655 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3574150750 msgr2=0x7f357406e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.158+0000 7f357a29a700 1 --2- 172.21.15.37:0/3850509655 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3574150750 0x7f357406e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.158+0000 7f357a29a700 1 -- 172.21.15.37:0/3850509655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3574150380 msgr2=0x7f357406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.158+0000 7f357a29a700 1 --2- 172.21.15.37:0/3850509655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3574150380 0x7f357406dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.158+0000 7f357a29a700 1 -- 172.21.15.37:0/3850509655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3564009ae0 con 0x7f35740b1ca0 2023-10-06T02:24:36.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.159+0000 7f357a29a700 1 --2- 172.21.15.37:0/3850509655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35740b1ca0 0x7f3574140c70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f356400b610 tx=0x7f3564018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:36.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.159+0000 7f35727fc700 1 -- 172.21.15.37:0/3850509655 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35640088f0 con 0x7f35740b1ca0 2023-10-06T02:24:36.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.159+0000 7f35727fc700 1 -- 172.21.15.37:0/3850509655 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3564008a50 con 0x7f35740b1ca0 2023-10-06T02:24:36.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.159+0000 7f35727fc700 1 -- 172.21.15.37:0/3850509655 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564008e10 con 0x7f35740b1ca0 2023-10-06T02:24:36.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.159+0000 7f357c4fe700 1 -- 172.21.15.37:0/3850509655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f357416a440 con 0x7f35740b1ca0 2023-10-06T02:24:36.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.159+0000 7f357c4fe700 1 -- 172.21.15.37:0/3850509655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357416ac40 con 0x7f35740b1ca0 2023-10-06T02:24:36.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.160+0000 7f357c4fe700 1 -- 172.21.15.37:0/3850509655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357416aef0 con 0x7f35740b1ca0 2023-10-06T02:24:36.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.160+0000 7f35727fc700 1 -- 172.21.15.37:0/3850509655 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3564003040 con 0x7f35740b1ca0 2023-10-06T02:24:36.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.160+0000 7f35727fc700 1 --2- 172.21.15.37:0/3850509655 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3560066f30 0x7f35600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.161+0000 7f35727fc700 1 -- 172.21.15.37:0/3850509655 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3564086270 con 0x7f35740b1ca0 2023-10-06T02:24:36.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.161+0000 7f3579a99700 1 --2- 172.21.15.37:0/3850509655 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3560066f30 0x7f35600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.161+0000 7f3579a99700 1 --2- 172.21.15.37:0/3850509655 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3560066f30 0x7f35600693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f35680039e0 tx=0x7f3568007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:36.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.165+0000 7f35727fc700 1 -- 172.21.15.37:0/3850509655 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3564053380 con 0x7f35740b1ca0 2023-10-06T02:24:36.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.356+0000 7f357c4fe700 1 -- 172.21.15.37:0/3850509655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f357416aa90 con 0x7f35740b1ca0 2023-10-06T02:24:36.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.357+0000 7f35727fc700 1 -- 172.21.15.37:0/3850509655 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f35640569a0 con 0x7f35740b1ca0 2023-10-06T02:24:36.357 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T02:24:36.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.359+0000 7f357c4fe700 1 -- 172.21.15.37:0/3850509655 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3560066f30 msgr2=0x7f35600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.359+0000 7f357c4fe700 1 --2- 172.21.15.37:0/3850509655 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3560066f30 0x7f35600693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f35680039e0 tx=0x7f3568007ec0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.359+0000 7f357c4fe700 1 -- 172.21.15.37:0/3850509655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35740b1ca0 msgr2=0x7f3574140c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.359+0000 7f357c4fe700 1 --2- 172.21.15.37:0/3850509655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35740b1ca0 0x7f3574140c70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f356400b610 tx=0x7f3564018000 comp rx=0 tx=0).stop 2023-10-06T02:24:36.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.359+0000 7f357c4fe700 1 -- 172.21.15.37:0/3850509655 shutdown_connections 2023-10-06T02:24:36.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.359+0000 7f357c4fe700 1 --2- 172.21.15.37:0/3850509655 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3574150750 0x7f357406e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.359+0000 7f357c4fe700 1 --2- 172.21.15.37:0/3850509655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35740b1ca0 0x7f3574140c70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.359+0000 7f357c4fe700 1 --2- 172.21.15.37:0/3850509655 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3560066f30 0x7f35600693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.359+0000 7f357c4fe700 1 --2- 172.21.15.37:0/3850509655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3574150380 0x7f357406dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.359+0000 7f357c4fe700 1 -- 172.21.15.37:0/3850509655 >> 172.21.15.37:0/3850509655 conn(0x7f357406c0b0 msgr2=0x7f357414a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.359+0000 7f357c4fe700 1 -- 172.21.15.37:0/3850509655 shutdown_connections 2023-10-06T02:24:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.359+0000 7f357c4fe700 1 -- 172.21.15.37:0/3850509655 wait complete. 2023-10-06T02:24:36.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:24:36.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.492+0000 7f83ef4b2700 1 Processor -- start 2023-10-06T02:24:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.492+0000 7f83ef4b2700 1 -- start start 2023-10-06T02:24:36.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.493+0000 7f83ef4b2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e81593c0 0x7f83e8159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.493+0000 7f83ef4b2700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f83e80b2380 0x7f83e80b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.493+0000 7f83ef4b2700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f83e80ccb30 0x7f83e80ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.493+0000 7f83ef4b2700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e80b07a0 con 0x7f83e80b2380 2023-10-06T02:24:36.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.493+0000 7f83ef4b2700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e80cd8a0 con 0x7f83e80ccb30 2023-10-06T02:24:36.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.493+0000 7f83ef4b2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e80afe70 con 0x7f83e81593c0 2023-10-06T02:24:36.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.493+0000 7f83eca4d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f83e80b2380 0x7f83e80b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.493+0000 7f83eca4d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f83e80b2380 0x7f83e80b27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38374/0 (socket says 172.21.15.37:38374) 2023-10-06T02:24:36.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.493+0000 7f83eca4d700 1 -- 172.21.15.37:0/4254750570 learned_addr learned my addr 172.21.15.37:0/4254750570 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:36.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.493+0000 7f83eda4f700 1 --2- 172.21.15.37:0/4254750570 >> v2:172.21.15.191:3300/0 conn(0x7f83e80ccb30 0x7f83e80ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.493+0000 7f83ed24e700 1 --2- 172.21.15.37:0/4254750570 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e81593c0 0x7f83e8159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.493+0000 7f83eca4d700 1 -- 172.21.15.37:0/4254750570 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e81593c0 msgr2=0x7f83e8159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:36.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.493+0000 7f83eca4d700 1 --2- 172.21.15.37:0/4254750570 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e81593c0 0x7f83e8159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.493+0000 7f83eca4d700 1 -- 172.21.15.37:0/4254750570 >> v2:172.21.15.191:3300/0 conn(0x7f83e80ccb30 msgr2=0x7f83e80ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:36.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.493+0000 7f83eca4d700 1 --2- 172.21.15.37:0/4254750570 >> v2:172.21.15.191:3300/0 conn(0x7f83e80ccb30 0x7f83e80ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.493+0000 7f83eca4d700 1 -- 172.21.15.37:0/4254750570 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e80b0150 con 0x7f83e80b2380 2023-10-06T02:24:36.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.493+0000 7f83eca4d700 1 --2- 172.21.15.37:0/4254750570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83e80b2380 0x7f83e80b27f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f83e80cc940 tx=0x7f83dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c6c830b1e75470 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:36.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.493+0000 7f83e7fff700 1 -- 172.21.15.37:0/4254750570 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc00b640 con 0x7f83e80b2380 2023-10-06T02:24:36.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.494+0000 7f83e7fff700 1 -- 172.21.15.37:0/4254750570 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc00b7a0 con 0x7f83e80b2380 2023-10-06T02:24:36.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.494+0000 7f83e7fff700 1 -- 172.21.15.37:0/4254750570 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc00bb60 con 0x7f83e80b2380 2023-10-06T02:24:36.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.494+0000 7f83ef4b2700 1 -- 172.21.15.37:0/4254750570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83e80b2380 msgr2=0x7f83e80b27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.494+0000 7f83ef4b2700 1 --2- 172.21.15.37:0/4254750570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83e80b2380 0x7f83e80b27f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f83e80cc940 tx=0x7f83dc009250 comp rx=0 tx=0).stop 2023-10-06T02:24:36.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.494+0000 7f83ef4b2700 1 -- 172.21.15.37:0/4254750570 shutdown_connections 2023-10-06T02:24:36.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.494+0000 7f83ef4b2700 1 --2- 172.21.15.37:0/4254750570 >> v2:172.21.15.191:3300/0 conn(0x7f83e80ccb30 0x7f83e80ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.494+0000 7f83ef4b2700 1 --2- 172.21.15.37:0/4254750570 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e81593c0 0x7f83e8159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.494+0000 7f83ef4b2700 1 --2- 172.21.15.37:0/4254750570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83e80b2380 0x7f83e80b27f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.494+0000 7f83ef4b2700 1 -- 172.21.15.37:0/4254750570 >> 172.21.15.37:0/4254750570 conn(0x7f83e806c0b0 msgr2=0x7f83e806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:36.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.494+0000 7f83ef4b2700 1 -- 172.21.15.37:0/4254750570 shutdown_connections 2023-10-06T02:24:36.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.494+0000 7f83ef4b2700 1 -- 172.21.15.37:0/4254750570 wait complete. 2023-10-06T02:24:36.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.495+0000 7f83ef4b2700 1 Processor -- start 2023-10-06T02:24:36.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.495+0000 7f83ef4b2700 1 -- start start 2023-10-06T02:24:36.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.496+0000 7f83ef4b2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83e80b2380 0x7f83e81611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.496+0000 7f83ef4b2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83e80ccb30 0x7f83e80c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.496+0000 7f83ef4b2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e81593c0 0x7f83e8157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.496+0000 7f83ef4b2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e80c6320 con 0x7f83e80b2380 2023-10-06T02:24:36.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.496+0000 7f83ef4b2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e80c6600 con 0x7f83e80ccb30 2023-10-06T02:24:36.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.496+0000 7f83ef4b2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e80c68e0 con 0x7f83e81593c0 2023-10-06T02:24:36.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.496+0000 7f83ed24e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83e80b2380 0x7f83e81611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.496+0000 7f83ed24e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83e80b2380 0x7f83e81611d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38386/0 (socket says 172.21.15.37:38386) 2023-10-06T02:24:36.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.496+0000 7f83ed24e700 1 -- 172.21.15.37:0/2656624982 learned_addr learned my addr 172.21.15.37:0/2656624982 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:36.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.496+0000 7f83eda4f700 1 --2- 172.21.15.37:0/2656624982 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e81593c0 0x7f83e8157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.496+0000 7f83eca4d700 1 --2- 172.21.15.37:0/2656624982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83e80ccb30 0x7f83e80c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.496+0000 7f83ed24e700 1 -- 172.21.15.37:0/2656624982 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e81593c0 msgr2=0x7f83e8157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.497+0000 7f83ed24e700 1 --2- 172.21.15.37:0/2656624982 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e81593c0 0x7f83e8157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.497+0000 7f83ed24e700 1 -- 172.21.15.37:0/2656624982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83e80ccb30 msgr2=0x7f83e80c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.497+0000 7f83ed24e700 1 --2- 172.21.15.37:0/2656624982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83e80ccb30 0x7f83e80c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.497+0000 7f83ed24e700 1 -- 172.21.15.37:0/2656624982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc0094f0 con 0x7f83e80b2380 2023-10-06T02:24:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.497+0000 7f83eda4f700 1 --2- 172.21.15.37:0/2656624982 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e81593c0 0x7f83e8157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.497+0000 7f83eca4d700 1 --2- 172.21.15.37:0/2656624982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83e80ccb30 0x7f83e80c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.497+0000 7f83ed24e700 1 --2- 172.21.15.37:0/2656624982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83e80b2380 0x7f83e81611d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f83d8009e50 tx=0x7f83d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.497+0000 7f83e57fa700 1 -- 172.21.15.37:0/2656624982 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d800cc20 con 0x7f83e80b2380 2023-10-06T02:24:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.497+0000 7f83e57fa700 1 -- 172.21.15.37:0/2656624982 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d800f040 con 0x7f83e80b2380 2023-10-06T02:24:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.497+0000 7f83ef4b2700 1 -- 172.21.15.37:0/2656624982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e80c6bc0 con 0x7f83e80b2380 2023-10-06T02:24:36.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.497+0000 7f83e57fa700 1 -- 172.21.15.37:0/2656624982 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d8014480 con 0x7f83e80b2380 2023-10-06T02:24:36.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.497+0000 7f83ef4b2700 1 -- 172.21.15.37:0/2656624982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e815a160 con 0x7f83e80b2380 2023-10-06T02:24:36.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.498+0000 7f83ef4b2700 1 -- 172.21.15.37:0/2656624982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e8088bb0 con 0x7f83e80b2380 2023-10-06T02:24:36.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.498+0000 7f83e57fa700 1 -- 172.21.15.37:0/2656624982 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83d80147f0 con 0x7f83e80b2380 2023-10-06T02:24:36.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.499+0000 7f83e57fa700 1 --2- 172.21.15.37:0/2656624982 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f83d4066f30 0x7f83d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.499+0000 7f83e57fa700 1 -- 172.21.15.37:0/2656624982 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f83d8085350 con 0x7f83e80b2380 2023-10-06T02:24:36.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.499+0000 7f83eca4d700 1 --2- 172.21.15.37:0/2656624982 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f83d4066f30 0x7f83d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.499+0000 7f83eca4d700 1 --2- 172.21.15.37:0/2656624982 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f83d4066f30 0x7f83d40693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f83e80cc940 tx=0x7f83dc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:36.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.503+0000 7f83e57fa700 1 -- 172.21.15.37:0/2656624982 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83d8052460 con 0x7f83e80b2380 2023-10-06T02:24:36.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.696+0000 7f83ef4b2700 1 -- 172.21.15.37:0/2656624982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f83e80b0430 con 0x7f83e80b2380 2023-10-06T02:24:36.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.697+0000 7f83e57fa700 1 -- 172.21.15.37:0/2656624982 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f83d8055a80 con 0x7f83e80b2380 2023-10-06T02:24:36.697 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T02:24:36.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.699+0000 7f83ef4b2700 1 -- 172.21.15.37:0/2656624982 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f83d4066f30 msgr2=0x7f83d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.699+0000 7f83ef4b2700 1 --2- 172.21.15.37:0/2656624982 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f83d4066f30 0x7f83d40693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f83e80cc940 tx=0x7f83dc017000 comp rx=0 tx=0).stop 2023-10-06T02:24:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.699+0000 7f83ef4b2700 1 -- 172.21.15.37:0/2656624982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83e80b2380 msgr2=0x7f83e81611d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.699+0000 7f83ef4b2700 1 --2- 172.21.15.37:0/2656624982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83e80b2380 0x7f83e81611d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f83d8009e50 tx=0x7f83d800b040 comp rx=0 tx=0).stop 2023-10-06T02:24:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.699+0000 7f83ef4b2700 1 -- 172.21.15.37:0/2656624982 shutdown_connections 2023-10-06T02:24:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.699+0000 7f83ef4b2700 1 --2- 172.21.15.37:0/2656624982 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e81593c0 0x7f83e8157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.699+0000 7f83ef4b2700 1 --2- 172.21.15.37:0/2656624982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83e80b2380 0x7f83e81611d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.699+0000 7f83ef4b2700 1 --2- 172.21.15.37:0/2656624982 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f83d4066f30 0x7f83d40693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.699+0000 7f83ef4b2700 1 --2- 172.21.15.37:0/2656624982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83e80ccb30 0x7f83e80c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.699+0000 7f83ef4b2700 1 -- 172.21.15.37:0/2656624982 >> 172.21.15.37:0/2656624982 conn(0x7f83e806c0b0 msgr2=0x7f83e80ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.699+0000 7f83ef4b2700 1 -- 172.21.15.37:0/2656624982 shutdown_connections 2023-10-06T02:24:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.699+0000 7f83ef4b2700 1 -- 172.21.15.37:0/2656624982 wait complete. 2023-10-06T02:24:36.711 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:36.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.829+0000 7f2c4b1bb700 1 Processor -- start 2023-10-06T02:24:36.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.829+0000 7f2c4b1bb700 1 -- start start 2023-10-06T02:24:36.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.830+0000 7f2c4b1bb700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c441596d0 0x7f2c440b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.830+0000 7f2c4b1bb700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c440b3840 0x7f2c440c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.830+0000 7f2c4b1bb700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2c44159aa0 0x7f2c440c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.830+0000 7f2c4b1bb700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c440c5300 con 0x7f2c441596d0 2023-10-06T02:24:36.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.830+0000 7f2c4b1bb700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c440c6160 con 0x7f2c44159aa0 2023-10-06T02:24:36.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.830+0000 7f2c4b1bb700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c440c5550 con 0x7f2c440b3840 2023-10-06T02:24:36.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.830+0000 7f2c48f57700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c441596d0 0x7f2c440b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.830+0000 7f2c48f57700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c441596d0 0x7f2c440b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38390/0 (socket says 172.21.15.37:38390) 2023-10-06T02:24:36.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.830+0000 7f2c48f57700 1 -- 172.21.15.37:0/2620799647 learned_addr learned my addr 172.21.15.37:0/2620799647 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:36.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.830+0000 7f2c49758700 1 --2- 172.21.15.37:0/2620799647 >> v2:172.21.15.191:3300/0 conn(0x7f2c44159aa0 0x7f2c440c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.830+0000 7f2c43fff700 1 --2- 172.21.15.37:0/2620799647 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c440b3840 0x7f2c440c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.831+0000 7f2c48f57700 1 -- 172.21.15.37:0/2620799647 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c440b3840 msgr2=0x7f2c440c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:36.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.831+0000 7f2c48f57700 1 --2- 172.21.15.37:0/2620799647 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c440b3840 0x7f2c440c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.831+0000 7f2c48f57700 1 -- 172.21.15.37:0/2620799647 >> v2:172.21.15.191:3300/0 conn(0x7f2c44159aa0 msgr2=0x7f2c440c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:36.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.831+0000 7f2c48f57700 1 --2- 172.21.15.37:0/2620799647 >> v2:172.21.15.191:3300/0 conn(0x7f2c44159aa0 0x7f2c440c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.831+0000 7f2c48f57700 1 -- 172.21.15.37:0/2620799647 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c440c5830 con 0x7f2c441596d0 2023-10-06T02:24:36.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.831+0000 7f2c48f57700 1 --2- 172.21.15.37:0/2620799647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c441596d0 0x7f2c440b3300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2c4406d140 tx=0x7f2c3c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ef10479a742b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:36.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.831+0000 7f2c437fe700 1 -- 172.21.15.37:0/2620799647 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c00e070 con 0x7f2c441596d0 2023-10-06T02:24:36.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.831+0000 7f2c437fe700 1 -- 172.21.15.37:0/2620799647 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c00b970 con 0x7f2c441596d0 2023-10-06T02:24:36.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.831+0000 7f2c437fe700 1 -- 172.21.15.37:0/2620799647 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0092e0 con 0x7f2c441596d0 2023-10-06T02:24:36.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.832+0000 7f2c4b1bb700 1 -- 172.21.15.37:0/2620799647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c441596d0 msgr2=0x7f2c440b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.832+0000 7f2c4b1bb700 1 --2- 172.21.15.37:0/2620799647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c441596d0 0x7f2c440b3300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2c4406d140 tx=0x7f2c3c009840 comp rx=0 tx=0).stop 2023-10-06T02:24:36.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.832+0000 7f2c4b1bb700 1 -- 172.21.15.37:0/2620799647 shutdown_connections 2023-10-06T02:24:36.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.832+0000 7f2c4b1bb700 1 --2- 172.21.15.37:0/2620799647 >> v2:172.21.15.191:3300/0 conn(0x7f2c44159aa0 0x7f2c440c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.832+0000 7f2c4b1bb700 1 --2- 172.21.15.37:0/2620799647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c441596d0 0x7f2c440b3300 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.832+0000 7f2c4b1bb700 1 --2- 172.21.15.37:0/2620799647 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c440b3840 0x7f2c440c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.832+0000 7f2c4b1bb700 1 -- 172.21.15.37:0/2620799647 >> 172.21.15.37:0/2620799647 conn(0x7f2c4406c890 msgr2=0x7f2c440d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:36.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.832+0000 7f2c4b1bb700 1 -- 172.21.15.37:0/2620799647 shutdown_connections 2023-10-06T02:24:36.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.832+0000 7f2c4b1bb700 1 -- 172.21.15.37:0/2620799647 wait complete. 2023-10-06T02:24:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.833+0000 7f2c4b1bb700 1 Processor -- start 2023-10-06T02:24:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.833+0000 7f2c4b1bb700 1 -- start start 2023-10-06T02:24:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c4b1bb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c440b3840 0x7f2c44099fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c4b1bb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c441596d0 0x7f2c440b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c4b1bb700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c44159aa0 0x7f2c440b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c4b1bb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4415b290 con 0x7f2c440b3840 2023-10-06T02:24:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c4b1bb700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4415a680 con 0x7f2c441596d0 2023-10-06T02:24:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c4b1bb700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4415a960 con 0x7f2c44159aa0 2023-10-06T02:24:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c48f57700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c440b3840 0x7f2c44099fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c48f57700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c440b3840 0x7f2c44099fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38392/0 (socket says 172.21.15.37:38392) 2023-10-06T02:24:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c48f57700 1 -- 172.21.15.37:0/218162525 learned_addr learned my addr 172.21.15.37:0/218162525 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c43fff700 1 --2- 172.21.15.37:0/218162525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c441596d0 0x7f2c440b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c49758700 1 --2- 172.21.15.37:0/218162525 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c44159aa0 0x7f2c440b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c48f57700 1 -- 172.21.15.37:0/218162525 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c44159aa0 msgr2=0x7f2c440b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c48f57700 1 --2- 172.21.15.37:0/218162525 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c44159aa0 0x7f2c440b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c48f57700 1 -- 172.21.15.37:0/218162525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c441596d0 msgr2=0x7f2c440b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c48f57700 1 --2- 172.21.15.37:0/218162525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c441596d0 0x7f2c440b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c48f57700 1 -- 172.21.15.37:0/218162525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c009ae0 con 0x7f2c440b3840 2023-10-06T02:24:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c48f57700 1 --2- 172.21.15.37:0/218162525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c440b3840 0x7f2c44099fb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2c44088950 tx=0x7f2c3c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c40ff9700 1 -- 172.21.15.37:0/218162525 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0088a0 con 0x7f2c440b3840 2023-10-06T02:24:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c40ff9700 1 -- 172.21.15.37:0/218162525 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c008a00 con 0x7f2c440b3840 2023-10-06T02:24:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c40ff9700 1 -- 172.21.15.37:0/218162525 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c008dc0 con 0x7f2c440b3840 2023-10-06T02:24:36.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.834+0000 7f2c4b1bb700 1 -- 172.21.15.37:0/218162525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c4415ac40 con 0x7f2c440b3840 2023-10-06T02:24:36.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.835+0000 7f2c4b1bb700 1 -- 172.21.15.37:0/218162525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c440b46f0 con 0x7f2c440b3840 2023-10-06T02:24:36.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.835+0000 7f2c4b1bb700 1 -- 172.21.15.37:0/218162525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4406fbf0 con 0x7f2c440b3840 2023-10-06T02:24:36.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.836+0000 7f2c40ff9700 1 -- 172.21.15.37:0/218162525 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c3c003040 con 0x7f2c440b3840 2023-10-06T02:24:36.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.836+0000 7f2c40ff9700 1 --2- 172.21.15.37:0/218162525 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2c24066f30 0x7f2c240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:36.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.836+0000 7f2c40ff9700 1 -- 172.21.15.37:0/218162525 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2c3c085c20 con 0x7f2c440b3840 2023-10-06T02:24:36.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.836+0000 7f2c43fff700 1 --2- 172.21.15.37:0/218162525 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2c24066f30 0x7f2c240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:36.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.837+0000 7f2c43fff700 1 --2- 172.21.15.37:0/218162525 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2c24066f30 0x7f2c240693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2c34009d10 tx=0x7f2c340091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:36.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:36.840+0000 7f2c40ff9700 1 -- 172.21.15.37:0/218162525 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c3c052c90 con 0x7f2c440b3840 2023-10-06T02:24:37.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.078+0000 7f2c4b1bb700 1 -- 172.21.15.37:0/218162525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c4415a460 con 0x7f2c440b3840 2023-10-06T02:24:37.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.079+0000 7f2c40ff9700 1 -- 172.21.15.37:0/218162525 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f2c3c0562b0 con 0x7f2c440b3840 2023-10-06T02:24:37.079 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:37.079 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1320242500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1320242500},{"type":"v1","addr":"172.21.15.37:6835","nonce":1320242500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4900,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/3862379925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3862379925},{"type":"v1","addr":"172.21.15.191:6836","nonce":3862379925}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1922753638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":1922753638},{"type":"v1","addr":"172.21.15.191:6837","nonce":1922753638}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:06.274246+0000","modified":"2023-10-06T02:24:09.884600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/967425730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":967425730},{"type":"v1","addr":"172.21.15.37:6834","nonce":967425730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:24:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.081+0000 7f2c4b1bb700 1 -- 172.21.15.37:0/218162525 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2c24066f30 msgr2=0x7f2c240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.081+0000 7f2c4b1bb700 1 --2- 172.21.15.37:0/218162525 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2c24066f30 0x7f2c240693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2c34009d10 tx=0x7f2c340091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.081+0000 7f2c4b1bb700 1 -- 172.21.15.37:0/218162525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c440b3840 msgr2=0x7f2c44099fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.081+0000 7f2c4b1bb700 1 --2- 172.21.15.37:0/218162525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c440b3840 0x7f2c44099fb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2c44088950 tx=0x7f2c3c018000 comp rx=0 tx=0).stop 2023-10-06T02:24:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.081+0000 7f2c4b1bb700 1 -- 172.21.15.37:0/218162525 shutdown_connections 2023-10-06T02:24:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.081+0000 7f2c4b1bb700 1 --2- 172.21.15.37:0/218162525 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c44159aa0 0x7f2c440b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.081+0000 7f2c4b1bb700 1 --2- 172.21.15.37:0/218162525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c440b3840 0x7f2c44099fb0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.081+0000 7f2c4b1bb700 1 --2- 172.21.15.37:0/218162525 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2c24066f30 0x7f2c240693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.081+0000 7f2c4b1bb700 1 --2- 172.21.15.37:0/218162525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c441596d0 0x7f2c440b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.081+0000 7f2c4b1bb700 1 -- 172.21.15.37:0/218162525 >> 172.21.15.37:0/218162525 conn(0x7f2c4406c890 msgr2=0x7f2c44154ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.081+0000 7f2c4b1bb700 1 -- 172.21.15.37:0/218162525 shutdown_connections 2023-10-06T02:24:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.081+0000 7f2c4b1bb700 1 -- 172.21.15.37:0/218162525 wait complete. 2023-10-06T02:24:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2023-10-06T02:24:37.094 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:24:37.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.212+0000 7f40d1b96700 1 Processor -- start 2023-10-06T02:24:37.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.213+0000 7f40d1b96700 1 -- start start 2023-10-06T02:24:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.213+0000 7f40d1b96700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f40cc159760 0x7f40cc15d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.213+0000 7f40d1b96700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f40cc15dd50 0x7f40cc0cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.213+0000 7f40d1b96700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc15e1d0 con 0x7f40cc15d8d0 2023-10-06T02:24:37.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.213+0000 7f40d1b96700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc0cc2d0 con 0x7f40cc15dd50 2023-10-06T02:24:37.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.213+0000 7f40d1b96700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc0cb650 con 0x7f40cc159760 2023-10-06T02:24:37.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.213+0000 7f40cbfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f40cc15dd50 0x7f40cc0cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.213+0000 7f40caffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f40cc15d8d0 0x7f40cc0c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36052/0 (socket says 172.21.15.37:36052) 2023-10-06T02:24:37.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.213+0000 7f40caffd700 1 -- 172.21.15.37:0/617460128 learned_addr learned my addr 172.21.15.37:0/617460128 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:37.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.214+0000 7f40cb7fe700 1 --2- 172.21.15.37:0/617460128 >> v2:172.21.15.191:3300/0 conn(0x7f40cc159760 0x7f40cc15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.214+0000 7f40cbfff700 1 -- 172.21.15.37:0/617460128 >> v2:172.21.15.191:3300/0 conn(0x7f40cc159760 msgr2=0x7f40cc15d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:37.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.214+0000 7f40cbfff700 1 --2- 172.21.15.37:0/617460128 >> v2:172.21.15.191:3300/0 conn(0x7f40cc159760 0x7f40cc15d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.214+0000 7f40cbfff700 1 -- 172.21.15.37:0/617460128 >> v1:172.21.15.37:6789/0 conn(0x7f40cc15d8d0 legacy=0x7f40cc0c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.214+0000 7f40cbfff700 1 -- 172.21.15.37:0/617460128 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc0cb930 con 0x7f40cc15dd50 2023-10-06T02:24:37.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.214+0000 7f40ca7fc700 1 -- 172.21.15.37:0/617460128 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827934651 0 0) 0x7f40cc15e1d0 con 0x7f40cc15d8d0 2023-10-06T02:24:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.214+0000 7f40cbfff700 1 --2- 172.21.15.37:0/617460128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40cc15dd50 0x7f40cc0cfc00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0897f0 tx=0x7f40c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2f473fc122d5b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.214+0000 7f40ca7fc700 1 -- 172.21.15.37:0/617460128 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c400e070 con 0x7f40cc15dd50 2023-10-06T02:24:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.214+0000 7f40ca7fc700 1 -- 172.21.15.37:0/617460128 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c400bcc0 con 0x7f40cc15dd50 2023-10-06T02:24:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.214+0000 7f40ca7fc700 1 -- 172.21.15.37:0/617460128 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4012680 con 0x7f40cc15dd50 2023-10-06T02:24:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.215+0000 7f40d1b96700 1 -- 172.21.15.37:0/617460128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40cc15dd50 msgr2=0x7f40cc0cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.215+0000 7f40d1b96700 1 --2- 172.21.15.37:0/617460128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40cc15dd50 0x7f40cc0cfc00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0897f0 tx=0x7f40c4009780 comp rx=0 tx=0).stop 2023-10-06T02:24:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.215+0000 7f40d1b96700 1 -- 172.21.15.37:0/617460128 shutdown_connections 2023-10-06T02:24:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.215+0000 7f40d1b96700 1 --2- 172.21.15.37:0/617460128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40cc15dd50 0x7f40cc0cfc00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.215+0000 7f40d1b96700 1 --2- 172.21.15.37:0/617460128 >> v2:172.21.15.191:3300/0 conn(0x7f40cc159760 0x7f40cc15d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.215+0000 7f40d1b96700 1 -- 172.21.15.37:0/617460128 >> 172.21.15.37:0/617460128 conn(0x7f40cc06c890 msgr2=0x7f40cc0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.215+0000 7f40d1b96700 1 -- 172.21.15.37:0/617460128 shutdown_connections 2023-10-06T02:24:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.215+0000 7f40d1b96700 1 -- 172.21.15.37:0/617460128 wait complete. 2023-10-06T02:24:37.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.216+0000 7f40d1b96700 1 Processor -- start 2023-10-06T02:24:37.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.216+0000 7f40d1b96700 1 -- start start 2023-10-06T02:24:37.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40d1b96700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40cc159760 0x7f40cc15ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40d1b96700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40cc15d8d0 0x7f40cc14cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40d1b96700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40cc15dd50 0x7f40cc0c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40d1b96700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc15c6e0 con 0x7f40cc159760 2023-10-06T02:24:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40d1b96700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc15bad0 con 0x7f40cc15d8d0 2023-10-06T02:24:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40d1b96700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc15bdb0 con 0x7f40cc15dd50 2023-10-06T02:24:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40cb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40cc159760 0x7f40cc15ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40cb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40cc159760 0x7f40cc15ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38414/0 (socket says 172.21.15.37:38414) 2023-10-06T02:24:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40cb7fe700 1 -- 172.21.15.37:0/2966860229 learned_addr learned my addr 172.21.15.37:0/2966860229 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40cbfff700 1 --2- 172.21.15.37:0/2966860229 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40cc15dd50 0x7f40cc0c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40caffd700 1 --2- 172.21.15.37:0/2966860229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40cc15d8d0 0x7f40cc14cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40cb7fe700 1 -- 172.21.15.37:0/2966860229 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40cc15dd50 msgr2=0x7f40cc0c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40cb7fe700 1 --2- 172.21.15.37:0/2966860229 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40cc15dd50 0x7f40cc0c56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40cb7fe700 1 -- 172.21.15.37:0/2966860229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40cc15d8d0 msgr2=0x7f40cc14cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40cb7fe700 1 --2- 172.21.15.37:0/2966860229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40cc15d8d0 0x7f40cc14cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40cb7fe700 1 -- 172.21.15.37:0/2966860229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c4009a20 con 0x7f40cc159760 2023-10-06T02:24:37.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40caffd700 1 --2- 172.21.15.37:0/2966860229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40cc15d8d0 0x7f40cc14cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:37.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40cb7fe700 1 --2- 172.21.15.37:0/2966860229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40cc159760 0x7f40cc15ace0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00c880 tx=0x7f40bc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:37.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40b37fe700 1 -- 172.21.15.37:0/2966860229 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc011600 con 0x7f40cc159760 2023-10-06T02:24:37.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40b37fe700 1 -- 172.21.15.37:0/2966860229 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc011780 con 0x7f40cc159760 2023-10-06T02:24:37.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40d1b96700 1 -- 172.21.15.37:0/2966860229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40cc15c090 con 0x7f40cc159760 2023-10-06T02:24:37.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40b37fe700 1 -- 172.21.15.37:0/2966860229 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc011b40 con 0x7f40cc159760 2023-10-06T02:24:37.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.217+0000 7f40d1b96700 1 -- 172.21.15.37:0/2966860229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc15a000 con 0x7f40cc159760 2023-10-06T02:24:37.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.218+0000 7f40d1b96700 1 -- 172.21.15.37:0/2966860229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40cc06fbf0 con 0x7f40cc159760 2023-10-06T02:24:37.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.219+0000 7f40b37fe700 1 -- 172.21.15.37:0/2966860229 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40bc018360 con 0x7f40cc159760 2023-10-06T02:24:37.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.219+0000 7f40b37fe700 1 --2- 172.21.15.37:0/2966860229 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f40b8066f30 0x7f40b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.219+0000 7f40b37fe700 1 -- 172.21.15.37:0/2966860229 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f40bc084390 con 0x7f40cc159760 2023-10-06T02:24:37.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.219+0000 7f40caffd700 1 --2- 172.21.15.37:0/2966860229 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f40b8066f30 0x7f40b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.220+0000 7f40caffd700 1 --2- 172.21.15.37:0/2966860229 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f40b8066f30 0x7f40b80693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0c6240 tx=0x7f40c0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:37.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.223+0000 7f40b37fe700 1 -- 172.21.15.37:0/2966860229 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40bc054f30 con 0x7f40cc159760 2023-10-06T02:24:37.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.417+0000 7f40d1b96700 1 -- 172.21.15.37:0/2966860229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40cc15c9c0 con 0x7f40cc159760 2023-10-06T02:24:37.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.418+0000 7f40b37fe700 1 -- 172.21.15.37:0/2966860229 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f40bc054ac0 con 0x7f40cc159760 2023-10-06T02:24:37.419 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:37.419 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:24:07.621902+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:24:04.559429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T02:24:05.263596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:24:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.420+0000 7f40d1b96700 1 -- 172.21.15.37:0/2966860229 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f40b8066f30 msgr2=0x7f40b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.420+0000 7f40d1b96700 1 --2- 172.21.15.37:0/2966860229 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f40b8066f30 0x7f40b80693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0c6240 tx=0x7f40c0009040 comp rx=0 tx=0).stop 2023-10-06T02:24:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.420+0000 7f40d1b96700 1 -- 172.21.15.37:0/2966860229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40cc159760 msgr2=0x7f40cc15ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.420+0000 7f40d1b96700 1 --2- 172.21.15.37:0/2966860229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40cc159760 0x7f40cc15ace0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00c880 tx=0x7f40bc008040 comp rx=0 tx=0).stop 2023-10-06T02:24:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.420+0000 7f40d1b96700 1 -- 172.21.15.37:0/2966860229 shutdown_connections 2023-10-06T02:24:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.420+0000 7f40d1b96700 1 --2- 172.21.15.37:0/2966860229 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40cc15dd50 0x7f40cc0c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.420+0000 7f40d1b96700 1 --2- 172.21.15.37:0/2966860229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40cc159760 0x7f40cc15ace0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.420+0000 7f40d1b96700 1 --2- 172.21.15.37:0/2966860229 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f40b8066f30 0x7f40b80693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.420+0000 7f40d1b96700 1 --2- 172.21.15.37:0/2966860229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40cc15d8d0 0x7f40cc14cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.420+0000 7f40d1b96700 1 -- 172.21.15.37:0/2966860229 >> 172.21.15.37:0/2966860229 conn(0x7f40cc06c890 msgr2=0x7f40cc0c9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:37.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.420+0000 7f40d1b96700 1 -- 172.21.15.37:0/2966860229 shutdown_connections 2023-10-06T02:24:37.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.420+0000 7f40d1b96700 1 -- 172.21.15.37:0/2966860229 wait complete. 2023-10-06T02:24:37.433 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:24:37.433 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.551+0000 7f89f4700700 1 Processor -- start 2023-10-06T02:24:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.551+0000 7f89f4700700 1 -- start start 2023-10-06T02:24:37.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.552+0000 7f89f4700700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f89ec0b3be0 0x7f89ec157be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.552+0000 7f89f4700700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89ec068140 0x7f89ec0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.552+0000 7f89f4700700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ec158db0 con 0x7f89ec0b3fb0 2023-10-06T02:24:37.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.552+0000 7f89f4700700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ec0cc2f0 con 0x7f89ec0b3be0 2023-10-06T02:24:37.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.552+0000 7f89f4700700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec158510 con 0x7f89ec068140 2023-10-06T02:24:37.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.552+0000 7f89f249c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f89ec0b3be0 0x7f89ec157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.552+0000 7f89f2c9d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89ec068140 0x7f89ec0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.552+0000 7f89f1c9b700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f89ec0b3fb0 0x7f89ec067a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:42606/0 (socket says 172.21.15.37:42606) 2023-10-06T02:24:37.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.552+0000 7f89f1c9b700 1 -- 172.21.15.37:0/3208218341 learned_addr learned my addr 172.21.15.37:0/3208218341 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:37.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.552+0000 7f89f149a700 1 -- 172.21.15.37:0/3208218341 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928333878 0 0) 0x7f89ec158db0 con 0x7f89ec0b3fb0 2023-10-06T02:24:37.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.552+0000 7f89f149a700 1 -- 172.21.15.37:0/3208218341 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89d4003570 con 0x7f89ec0b3fb0 2023-10-06T02:24:37.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.553+0000 7f89f249c700 1 -- 172.21.15.37:0/3208218341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89ec068140 msgr2=0x7f89ec0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:37.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.553+0000 7f89f249c700 1 --2- 172.21.15.37:0/3208218341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89ec068140 0x7f89ec0cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.553+0000 7f89f249c700 1 -- 172.21.15.37:0/3208218341 >> v1:172.21.15.191:6789/0 conn(0x7f89ec0b3fb0 legacy=0x7f89ec067a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.553+0000 7f89f249c700 1 -- 172.21.15.37:0/3208218341 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec1587f0 con 0x7f89ec0b3be0 2023-10-06T02:24:37.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.553+0000 7f89f2c9d700 1 --2- 172.21.15.37:0/3208218341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89ec068140 0x7f89ec0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:24:37.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.553+0000 7f89f249c700 1 --2- 172.21.15.37:0/3208218341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89ec0b3be0 0x7f89ec157be0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009eb0 tx=0x7f89dc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9321a270be03f04 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:37.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.553+0000 7f89f149a700 1 -- 172.21.15.37:0/3208218341 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc00e070 con 0x7f89ec0b3be0 2023-10-06T02:24:37.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.553+0000 7f89f149a700 1 -- 172.21.15.37:0/3208218341 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89dc00bb80 con 0x7f89ec0b3be0 2023-10-06T02:24:37.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.553+0000 7f89f149a700 1 -- 172.21.15.37:0/3208218341 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc012430 con 0x7f89ec0b3be0 2023-10-06T02:24:37.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.553+0000 7f89f4700700 1 -- 172.21.15.37:0/3208218341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89ec0b3be0 msgr2=0x7f89ec157be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.553+0000 7f89f4700700 1 --2- 172.21.15.37:0/3208218341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89ec0b3be0 0x7f89ec157be0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009eb0 tx=0x7f89dc009780 comp rx=0 tx=0).stop 2023-10-06T02:24:37.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.554+0000 7f89f4700700 1 -- 172.21.15.37:0/3208218341 shutdown_connections 2023-10-06T02:24:37.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.554+0000 7f89f4700700 1 --2- 172.21.15.37:0/3208218341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89ec068140 0x7f89ec0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.554+0000 7f89f4700700 1 --2- 172.21.15.37:0/3208218341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89ec0b3be0 0x7f89ec157be0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.554+0000 7f89f4700700 1 -- 172.21.15.37:0/3208218341 >> 172.21.15.37:0/3208218341 conn(0x7f89ec0ce330 msgr2=0x7f89ec0ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:37.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.554+0000 7f89f4700700 1 -- 172.21.15.37:0/3208218341 shutdown_connections 2023-10-06T02:24:37.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.554+0000 7f89f4700700 1 -- 172.21.15.37:0/3208218341 wait complete. 2023-10-06T02:24:37.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.555+0000 7f89f4700700 1 Processor -- start 2023-10-06T02:24:37.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.555+0000 7f89f4700700 1 -- start start 2023-10-06T02:24:37.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.555+0000 7f89f4700700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89ec068140 0x7f89ec1686d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.555+0000 7f89f4700700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89ec0b3be0 0x7f89ec16a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.556+0000 7f89f4700700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89ec0b3fb0 0x7f89ec0afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.556+0000 7f89f4700700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec0c6180 con 0x7f89ec068140 2023-10-06T02:24:37.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.556+0000 7f89f4700700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec0c5570 con 0x7f89ec0b3fb0 2023-10-06T02:24:37.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.556+0000 7f89f4700700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec0c5850 con 0x7f89ec0b3be0 2023-10-06T02:24:37.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.556+0000 7f89f249c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89ec068140 0x7f89ec1686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.556+0000 7f89f249c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89ec068140 0x7f89ec1686d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38420/0 (socket says 172.21.15.37:38420) 2023-10-06T02:24:37.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.556+0000 7f89f249c700 1 -- 172.21.15.37:0/3580428110 learned_addr learned my addr 172.21.15.37:0/3580428110 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:37.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.556+0000 7f89f1c9b700 1 --2- 172.21.15.37:0/3580428110 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89ec0b3be0 0x7f89ec16a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.556+0000 7f89f2c9d700 1 --2- 172.21.15.37:0/3580428110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89ec0b3fb0 0x7f89ec0afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.556+0000 7f89f249c700 1 -- 172.21.15.37:0/3580428110 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89ec0b3be0 msgr2=0x7f89ec16a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.556+0000 7f89f249c700 1 --2- 172.21.15.37:0/3580428110 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89ec0b3be0 0x7f89ec16a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.556+0000 7f89f249c700 1 -- 172.21.15.37:0/3580428110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89ec0b3fb0 msgr2=0x7f89ec0afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.556+0000 7f89f249c700 1 --2- 172.21.15.37:0/3580428110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89ec0b3fb0 0x7f89ec0afd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.556+0000 7f89f249c700 1 -- 172.21.15.37:0/3580428110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e4009420 con 0x7f89ec068140 2023-10-06T02:24:37.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.556+0000 7f89f249c700 1 --2- 172.21.15.37:0/3580428110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89ec068140 0x7f89ec1686d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f89ec06bed0 tx=0x7f89dc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:37.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.556+0000 7f89ea7fc700 1 -- 172.21.15.37:0/3580428110 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc012cf0 con 0x7f89ec068140 2023-10-06T02:24:37.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.556+0000 7f89ea7fc700 1 -- 172.21.15.37:0/3580428110 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89dc012e70 con 0x7f89ec068140 2023-10-06T02:24:37.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.556+0000 7f89f4700700 1 -- 172.21.15.37:0/3580428110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc009a20 con 0x7f89ec068140 2023-10-06T02:24:37.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.556+0000 7f89ea7fc700 1 -- 172.21.15.37:0/3580428110 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc0276a0 con 0x7f89ec068140 2023-10-06T02:24:37.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.556+0000 7f89f4700700 1 -- 172.21.15.37:0/3580428110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ec0c5e10 con 0x7f89ec068140 2023-10-06T02:24:37.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.557+0000 7f89f4700700 1 -- 172.21.15.37:0/3580428110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ec0c6460 con 0x7f89ec068140 2023-10-06T02:24:37.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.558+0000 7f89ea7fc700 1 -- 172.21.15.37:0/3580428110 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f89dc024070 con 0x7f89ec068140 2023-10-06T02:24:37.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.558+0000 7f89ea7fc700 1 --2- 172.21.15.37:0/3580428110 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f89d8066f60 0x7f89d8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.558+0000 7f89ea7fc700 1 -- 172.21.15.37:0/3580428110 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f89dc086b70 con 0x7f89ec068140 2023-10-06T02:24:37.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.558+0000 7f89f1c9b700 1 --2- 172.21.15.37:0/3580428110 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f89d8066f60 0x7f89d8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.559+0000 7f89f1c9b700 1 --2- 172.21.15.37:0/3580428110 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f89d8066f60 0x7f89d8069410 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0b22f0 tx=0x7f89e0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:37.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.562+0000 7f89ea7fc700 1 -- 172.21.15.37:0/3580428110 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89dc053d40 con 0x7f89ec068140 2023-10-06T02:24:37.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.800+0000 7f89f4700700 1 -- 172.21.15.37:0/3580428110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89ec04bb80 con 0x7f89ec068140 2023-10-06T02:24:37.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.801+0000 7f89ea7fc700 1 -- 172.21.15.37:0/3580428110 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f89dc02c020 con 0x7f89ec068140 2023-10-06T02:24:37.801 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:37.801 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1320242500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1320242500},{"type":"v1","addr":"172.21.15.37:6835","nonce":1320242500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4900,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/3862379925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3862379925},{"type":"v1","addr":"172.21.15.191:6836","nonce":3862379925}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1922753638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":1922753638},{"type":"v1","addr":"172.21.15.191:6837","nonce":1922753638}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:06.274246+0000","modified":"2023-10-06T02:24:09.884600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/967425730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":967425730},{"type":"v1","addr":"172.21.15.37:6834","nonce":967425730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:24:37.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.803+0000 7f89f4700700 1 -- 172.21.15.37:0/3580428110 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f89d8066f60 msgr2=0x7f89d8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.803+0000 7f89f4700700 1 --2- 172.21.15.37:0/3580428110 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f89d8066f60 0x7f89d8069410 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0b22f0 tx=0x7f89e0009040 comp rx=0 tx=0).stop 2023-10-06T02:24:37.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.803+0000 7f89f4700700 1 -- 172.21.15.37:0/3580428110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89ec068140 msgr2=0x7f89ec1686d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.803+0000 7f89f4700700 1 --2- 172.21.15.37:0/3580428110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89ec068140 0x7f89ec1686d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f89ec06bed0 tx=0x7f89dc019000 comp rx=0 tx=0).stop 2023-10-06T02:24:37.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.803+0000 7f89f4700700 1 -- 172.21.15.37:0/3580428110 shutdown_connections 2023-10-06T02:24:37.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.803+0000 7f89f4700700 1 --2- 172.21.15.37:0/3580428110 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f89d8066f60 0x7f89d8069410 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.803+0000 7f89f4700700 1 --2- 172.21.15.37:0/3580428110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89ec0b3fb0 0x7f89ec0afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.803+0000 7f89f4700700 1 --2- 172.21.15.37:0/3580428110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89ec068140 0x7f89ec1686d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.803+0000 7f89f4700700 1 --2- 172.21.15.37:0/3580428110 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89ec0b3be0 0x7f89ec16a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.803+0000 7f89f4700700 1 -- 172.21.15.37:0/3580428110 >> 172.21.15.37:0/3580428110 conn(0x7f89ec0ce330 msgr2=0x7f89ec0cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:37.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.803+0000 7f89f4700700 1 -- 172.21.15.37:0/3580428110 shutdown_connections 2023-10-06T02:24:37.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.803+0000 7f89f4700700 1 -- 172.21.15.37:0/3580428110 wait complete. 2023-10-06T02:24:37.805 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2023-10-06T02:24:37.815 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.934+0000 7ff65c68b700 1 Processor -- start 2023-10-06T02:24:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.934+0000 7ff65c68b700 1 -- start start 2023-10-06T02:24:37.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.935+0000 7ff65c68b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff6541596d0 0x7ff6540b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.935+0000 7ff65c68b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6540b3840 0x7ff6540c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.935+0000 7ff65c68b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff654159aa0 0x7ff6540c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.935+0000 7ff65c68b700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6540c5300 con 0x7ff654159aa0 2023-10-06T02:24:37.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.935+0000 7ff65c68b700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6540c6160 con 0x7ff6541596d0 2023-10-06T02:24:37.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.935+0000 7ff65c68b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6540c5550 con 0x7ff6540b3840 2023-10-06T02:24:37.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.935+0000 7ff65ac28700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff654159aa0 0x7ff6540c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.936+0000 7ff65ac28700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff654159aa0 0x7ff6540c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38432/0 (socket says 172.21.15.37:38432) 2023-10-06T02:24:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.936+0000 7ff65ac28700 1 -- 172.21.15.37:0/3211969857 learned_addr learned my addr 172.21.15.37:0/3211969857 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.936+0000 7ff65a427700 1 --2- 172.21.15.37:0/3211969857 >> v2:172.21.15.191:3300/0 conn(0x7ff6541596d0 0x7ff6540b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.936+0000 7ff65ac28700 1 -- 172.21.15.37:0/3211969857 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6540b3840 msgr2=0x7ff6540c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.936+0000 7ff65ac28700 1 --2- 172.21.15.37:0/3211969857 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6540b3840 0x7ff6540c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.936+0000 7ff65ac28700 1 -- 172.21.15.37:0/3211969857 >> v2:172.21.15.191:3300/0 conn(0x7ff6541596d0 msgr2=0x7ff6540b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.936+0000 7ff65ac28700 1 --2- 172.21.15.37:0/3211969857 >> v2:172.21.15.191:3300/0 conn(0x7ff6541596d0 0x7ff6540b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.936+0000 7ff65ac28700 1 -- 172.21.15.37:0/3211969857 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6540c5830 con 0x7ff654159aa0 2023-10-06T02:24:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.936+0000 7ff65a427700 1 --2- 172.21.15.37:0/3211969857 >> v2:172.21.15.191:3300/0 conn(0x7ff6541596d0 0x7ff6540b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.936+0000 7ff65ac28700 1 --2- 172.21.15.37:0/3211969857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff654159aa0 0x7ff6540c6b30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff6540896e0 tx=0x7ff644009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3e81bf7079f349 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.936+0000 7ff659425700 1 -- 172.21.15.37:0/3211969857 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64400e070 con 0x7ff654159aa0 2023-10-06T02:24:37.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.936+0000 7ff659425700 1 -- 172.21.15.37:0/3211969857 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64400ba50 con 0x7ff654159aa0 2023-10-06T02:24:37.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.936+0000 7ff659425700 1 -- 172.21.15.37:0/3211969857 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6440092e0 con 0x7ff654159aa0 2023-10-06T02:24:37.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.937+0000 7ff65c68b700 1 -- 172.21.15.37:0/3211969857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff654159aa0 msgr2=0x7ff6540c6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.937+0000 7ff65c68b700 1 --2- 172.21.15.37:0/3211969857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff654159aa0 0x7ff6540c6b30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff6540896e0 tx=0x7ff644009840 comp rx=0 tx=0).stop 2023-10-06T02:24:37.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.937+0000 7ff65c68b700 1 -- 172.21.15.37:0/3211969857 shutdown_connections 2023-10-06T02:24:37.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.937+0000 7ff65c68b700 1 --2- 172.21.15.37:0/3211969857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff654159aa0 0x7ff6540c6b30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.937+0000 7ff65c68b700 1 --2- 172.21.15.37:0/3211969857 >> v2:172.21.15.191:3300/0 conn(0x7ff6541596d0 0x7ff6540b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.937+0000 7ff65c68b700 1 --2- 172.21.15.37:0/3211969857 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6540b3840 0x7ff6540c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.937+0000 7ff65c68b700 1 -- 172.21.15.37:0/3211969857 >> 172.21.15.37:0/3211969857 conn(0x7ff65406c890 msgr2=0x7ff6540d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:37.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.937+0000 7ff65c68b700 1 -- 172.21.15.37:0/3211969857 shutdown_connections 2023-10-06T02:24:37.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.937+0000 7ff65c68b700 1 -- 172.21.15.37:0/3211969857 wait complete. 2023-10-06T02:24:37.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.938+0000 7ff65c68b700 1 Processor -- start 2023-10-06T02:24:37.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.938+0000 7ff65c68b700 1 -- start start 2023-10-06T02:24:37.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff65c68b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6540b3840 0x7ff654147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff65c68b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6541596d0 0x7ff6540b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff65c68b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff654159aa0 0x7ff6540b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff65c68b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65409dba0 con 0x7ff6541596d0 2023-10-06T02:24:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff65c68b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff654148510 con 0x7ff6540b3840 2023-10-06T02:24:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff65c68b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65409cf90 con 0x7ff654159aa0 2023-10-06T02:24:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff659c26700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6541596d0 0x7ff6540b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff659c26700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6541596d0 0x7ff6540b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38438/0 (socket says 172.21.15.37:38438) 2023-10-06T02:24:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff659c26700 1 -- 172.21.15.37:0/885630499 learned_addr learned my addr 172.21.15.37:0/885630499 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff65a427700 1 --2- 172.21.15.37:0/885630499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6540b3840 0x7ff654147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff65ac28700 1 --2- 172.21.15.37:0/885630499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff654159aa0 0x7ff6540b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff659c26700 1 -- 172.21.15.37:0/885630499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff654159aa0 msgr2=0x7ff6540b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff659c26700 1 --2- 172.21.15.37:0/885630499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff654159aa0 0x7ff6540b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff659c26700 1 -- 172.21.15.37:0/885630499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6540b3840 msgr2=0x7ff654147fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:37.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff659c26700 1 --2- 172.21.15.37:0/885630499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6540b3840 0x7ff654147fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:37.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff659c26700 1 -- 172.21.15.37:0/885630499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff644009ae0 con 0x7ff6541596d0 2023-10-06T02:24:37.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff659c26700 1 --2- 172.21.15.37:0/885630499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6541596d0 0x7ff6540b4d90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff64800b810 tx=0x7ff6480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:37.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff6527fc700 1 -- 172.21.15.37:0/885630499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64800f510 con 0x7ff6541596d0 2023-10-06T02:24:37.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff6527fc700 1 -- 172.21.15.37:0/885630499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64800f670 con 0x7ff6541596d0 2023-10-06T02:24:37.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff65c68b700 1 -- 172.21.15.37:0/885630499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65409d270 con 0x7ff6541596d0 2023-10-06T02:24:37.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff6527fc700 1 -- 172.21.15.37:0/885630499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64800fa30 con 0x7ff6541596d0 2023-10-06T02:24:37.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.939+0000 7ff65c68b700 1 -- 172.21.15.37:0/885630499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65409d830 con 0x7ff6541596d0 2023-10-06T02:24:37.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.940+0000 7ff65c68b700 1 -- 172.21.15.37:0/885630499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65409dd10 con 0x7ff6541596d0 2023-10-06T02:24:37.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.941+0000 7ff6527fc700 1 -- 172.21.15.37:0/885630499 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff64801a400 con 0x7ff6541596d0 2023-10-06T02:24:37.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.941+0000 7ff6527fc700 1 --2- 172.21.15.37:0/885630499 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff640066f30 0x7ff6400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:37.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.941+0000 7ff6527fc700 1 -- 172.21.15.37:0/885630499 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff6480840c0 con 0x7ff6541596d0 2023-10-06T02:24:37.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.941+0000 7ff65a427700 1 --2- 172.21.15.37:0/885630499 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff640066f30 0x7ff6400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:37.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.942+0000 7ff65a427700 1 --2- 172.21.15.37:0/885630499 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff640066f30 0x7ff6400693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff64c006fd0 tx=0x7ff64c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:37.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:37.945+0000 7ff6527fc700 1 -- 172.21.15.37:0/885630499 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff648051250 con 0x7ff6541596d0 2023-10-06T02:24:38.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.180+0000 7ff65c68b700 1 -- 172.21.15.37:0/885630499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff65406fbf0 con 0x7ff6541596d0 2023-10-06T02:24:38.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.181+0000 7ff6527fc700 1 -- 172.21.15.37:0/885630499 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4600 (secure 0 0 0) 0x7ff648054870 con 0x7ff6541596d0 2023-10-06T02:24:38.181 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:38.182 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1320242500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1320242500},{"type":"v1","addr":"172.21.15.37:6835","nonce":1320242500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4900,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/3862379925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3862379925},{"type":"v1","addr":"172.21.15.191:6836","nonce":3862379925}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1922753638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":1922753638},{"type":"v1","addr":"172.21.15.191:6837","nonce":1922753638}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:06.274246+0000","modified":"2023-10-06T02:24:09.884600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/967425730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":967425730},{"type":"v1","addr":"172.21.15.37:6834","nonce":967425730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:24:38.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.183+0000 7ff65c68b700 1 -- 172.21.15.37:0/885630499 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff640066f30 msgr2=0x7ff6400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:38.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.183+0000 7ff65c68b700 1 --2- 172.21.15.37:0/885630499 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff640066f30 0x7ff6400693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff64c006fd0 tx=0x7ff64c008040 comp rx=0 tx=0).stop 2023-10-06T02:24:38.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.183+0000 7ff65c68b700 1 -- 172.21.15.37:0/885630499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6541596d0 msgr2=0x7ff6540b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:38.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.183+0000 7ff65c68b700 1 --2- 172.21.15.37:0/885630499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6541596d0 0x7ff6540b4d90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff64800b810 tx=0x7ff6480091d0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.183+0000 7ff65c68b700 1 -- 172.21.15.37:0/885630499 shutdown_connections 2023-10-06T02:24:38.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.183+0000 7ff65c68b700 1 --2- 172.21.15.37:0/885630499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff654159aa0 0x7ff6540b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.183+0000 7ff65c68b700 1 --2- 172.21.15.37:0/885630499 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff640066f30 0x7ff6400693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.183+0000 7ff65c68b700 1 --2- 172.21.15.37:0/885630499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6540b3840 0x7ff654147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.183+0000 7ff65c68b700 1 --2- 172.21.15.37:0/885630499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6541596d0 0x7ff6540b4d90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.183+0000 7ff65c68b700 1 -- 172.21.15.37:0/885630499 >> 172.21.15.37:0/885630499 conn(0x7ff65406c890 msgr2=0x7ff654154de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:38.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.183+0000 7ff65c68b700 1 -- 172.21.15.37:0/885630499 shutdown_connections 2023-10-06T02:24:38.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.183+0000 7ff65c68b700 1 -- 172.21.15.37:0/885630499 wait complete. 2023-10-06T02:24:38.185 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2023-10-06T02:24:38.196 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:24:38.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.314+0000 7f26d3277700 1 Processor -- start 2023-10-06T02:24:38.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.314+0000 7f26d3277700 1 -- start start 2023-10-06T02:24:38.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.315+0000 7f26d3277700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f26cc159370 0x7f26cc159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:38.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.315+0000 7f26d3277700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f26cc0b0620 0x7f26cc15db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:38.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.315+0000 7f26d3277700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26cc0cb200 con 0x7f26cc0b2270 2023-10-06T02:24:38.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.315+0000 7f26d3277700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc0b5c00 con 0x7f26cc159370 2023-10-06T02:24:38.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.315+0000 7f26d3277700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc0cb7c0 con 0x7f26cc0b0620 2023-10-06T02:24:38.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.315+0000 7f26d2275700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f26cc159370 0x7f26cc159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:38.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.315+0000 7f26d1a74700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f26cc0b2270 0x7f26cc0aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36064/0 (socket says 172.21.15.37:36064) 2023-10-06T02:24:38.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.315+0000 7f26d1a74700 1 -- 172.21.15.37:0/399030958 learned_addr learned my addr 172.21.15.37:0/399030958 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:38.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.315+0000 7f26d2a76700 1 --2- 172.21.15.37:0/399030958 >> v2:172.21.15.191:3300/0 conn(0x7f26cc0b0620 0x7f26cc15db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:38.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.315+0000 7f26d2275700 1 -- 172.21.15.37:0/399030958 >> v2:172.21.15.191:3300/0 conn(0x7f26cc0b0620 msgr2=0x7f26cc15db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:38.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.315+0000 7f26d2275700 1 --2- 172.21.15.37:0/399030958 >> v2:172.21.15.191:3300/0 conn(0x7f26cc0b0620 0x7f26cc15db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.315+0000 7f26d2275700 1 -- 172.21.15.37:0/399030958 >> v1:172.21.15.37:6789/0 conn(0x7f26cc0b2270 legacy=0x7f26cc0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:38.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.315+0000 7f26d1273700 1 -- 172.21.15.37:0/399030958 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028489397 0 0) 0x7f26cc0cb200 con 0x7f26cc0b2270 2023-10-06T02:24:38.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.315+0000 7f26d2275700 1 -- 172.21.15.37:0/399030958 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc15e0d0 con 0x7f26cc159370 2023-10-06T02:24:38.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.316+0000 7f26d2275700 1 --2- 172.21.15.37:0/399030958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26cc159370 0x7f26cc159740 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f26cc06d010 tx=0x7f26c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc53147433aa504 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:38.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.316+0000 7f26d1273700 1 -- 172.21.15.37:0/399030958 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c8011630 con 0x7f26cc159370 2023-10-06T02:24:38.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.316+0000 7f26d1273700 1 -- 172.21.15.37:0/399030958 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c8011790 con 0x7f26cc159370 2023-10-06T02:24:38.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.316+0000 7f26d1273700 1 -- 172.21.15.37:0/399030958 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c8011b30 con 0x7f26cc159370 2023-10-06T02:24:38.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.316+0000 7f26d3277700 1 -- 172.21.15.37:0/399030958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26cc159370 msgr2=0x7f26cc159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:38.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.316+0000 7f26d3277700 1 --2- 172.21.15.37:0/399030958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26cc159370 0x7f26cc159740 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f26cc06d010 tx=0x7f26c80091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.316+0000 7f26d3277700 1 -- 172.21.15.37:0/399030958 shutdown_connections 2023-10-06T02:24:38.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.316+0000 7f26d3277700 1 --2- 172.21.15.37:0/399030958 >> v2:172.21.15.191:3300/0 conn(0x7f26cc0b0620 0x7f26cc15db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.316+0000 7f26d3277700 1 --2- 172.21.15.37:0/399030958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26cc159370 0x7f26cc159740 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.316+0000 7f26d3277700 1 -- 172.21.15.37:0/399030958 >> 172.21.15.37:0/399030958 conn(0x7f26cc06c0b0 msgr2=0x7f26cc06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:38.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.316+0000 7f26d3277700 1 -- 172.21.15.37:0/399030958 shutdown_connections 2023-10-06T02:24:38.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.316+0000 7f26d3277700 1 -- 172.21.15.37:0/399030958 wait complete. 2023-10-06T02:24:38.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.317+0000 7f26d3277700 1 Processor -- start 2023-10-06T02:24:38.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.317+0000 7f26d3277700 1 -- start start 2023-10-06T02:24:38.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.318+0000 7f26d3277700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26cc0b0620 0x7f26cc0c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:38.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.318+0000 7f26d3277700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26cc0b2270 0x7f26cc0d0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:38.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.318+0000 7f26d3277700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26cc159370 0x7f26cc0c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:38.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.318+0000 7f26d3277700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0c6dd0 con 0x7f26cc0b0620 2023-10-06T02:24:38.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.318+0000 7f26d3277700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0ce6e0 con 0x7f26cc0b2270 2023-10-06T02:24:38.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.318+0000 7f26d3277700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0c6af0 con 0x7f26cc159370 2023-10-06T02:24:38.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.318+0000 7f26d2275700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26cc0b0620 0x7f26cc0c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:38.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.318+0000 7f26d2275700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26cc0b0620 0x7f26cc0c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38452/0 (socket says 172.21.15.37:38452) 2023-10-06T02:24:38.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.318+0000 7f26d2275700 1 -- 172.21.15.37:0/111134084 learned_addr learned my addr 172.21.15.37:0/111134084 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:38.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.318+0000 7f26d2a76700 1 --2- 172.21.15.37:0/111134084 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26cc159370 0x7f26cc0c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:38.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.318+0000 7f26d1a74700 1 --2- 172.21.15.37:0/111134084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26cc0b2270 0x7f26cc0d0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.318+0000 7f26d2275700 1 -- 172.21.15.37:0/111134084 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26cc159370 msgr2=0x7f26cc0c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.318+0000 7f26d2275700 1 --2- 172.21.15.37:0/111134084 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26cc159370 0x7f26cc0c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.319+0000 7f26d2275700 1 -- 172.21.15.37:0/111134084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26cc0b2270 msgr2=0x7f26cc0d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.319+0000 7f26d2275700 1 --2- 172.21.15.37:0/111134084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26cc0b2270 0x7f26cc0d0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.319+0000 7f26d2275700 1 -- 172.21.15.37:0/111134084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c8009420 con 0x7f26cc0b0620 2023-10-06T02:24:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.319+0000 7f26d2a76700 1 --2- 172.21.15.37:0/111134084 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26cc159370 0x7f26cc0c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.319+0000 7f26d1a74700 1 --2- 172.21.15.37:0/111134084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26cc0b2270 0x7f26cc0d0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.319+0000 7f26d2275700 1 --2- 172.21.15.37:0/111134084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26cc0b0620 0x7f26cc0c64a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f26cc06ea40 tx=0x7f26c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.319+0000 7f26c27fc700 1 -- 172.21.15.37:0/111134084 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c8011b10 con 0x7f26cc0b0620 2023-10-06T02:24:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.319+0000 7f26c27fc700 1 -- 172.21.15.37:0/111134084 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c80253f0 con 0x7f26cc0b0620 2023-10-06T02:24:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.319+0000 7f26d3277700 1 -- 172.21.15.37:0/111134084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26cc0ce090 con 0x7f26cc0b0620 2023-10-06T02:24:38.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.319+0000 7f26c27fc700 1 -- 172.21.15.37:0/111134084 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c8025790 con 0x7f26cc0b0620 2023-10-06T02:24:38.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.319+0000 7f26d3277700 1 -- 172.21.15.37:0/111134084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc0c4490 con 0x7f26cc0b0620 2023-10-06T02:24:38.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.320+0000 7f26d3277700 1 -- 172.21.15.37:0/111134084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26cc064b00 con 0x7f26cc0b0620 2023-10-06T02:24:38.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.320+0000 7f26c27fc700 1 -- 172.21.15.37:0/111134084 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26c8025b80 con 0x7f26cc0b0620 2023-10-06T02:24:38.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.321+0000 7f26c27fc700 1 --2- 172.21.15.37:0/111134084 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f26b0066f30 0x7f26b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:38.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.321+0000 7f26c27fc700 1 -- 172.21.15.37:0/111134084 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f26c8085f50 con 0x7f26cc0b0620 2023-10-06T02:24:38.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.321+0000 7f26d1a74700 1 --2- 172.21.15.37:0/111134084 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f26b0066f30 0x7f26b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:38.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.322+0000 7f26d1a74700 1 --2- 172.21.15.37:0/111134084 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f26b0066f30 0x7f26b00693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0c47c0 tx=0x7f26bc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:38.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.325+0000 7f26c27fc700 1 -- 172.21.15.37:0/111134084 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26c8053060 con 0x7f26cc0b0620 2023-10-06T02:24:38.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.521+0000 7f26d3277700 1 -- 172.21.15.37:0/111134084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26cc0645f0 con 0x7f26cc0b0620 2023-10-06T02:24:38.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.522+0000 7f26c27fc700 1 -- 172.21.15.37:0/111134084 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f26c8015090 con 0x7f26cc0b0620 2023-10-06T02:24:38.522 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:38.522 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:24:07.621902+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:24:04.559429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T02:24:05.263596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:24:38.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.524+0000 7f26d3277700 1 -- 172.21.15.37:0/111134084 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f26b0066f30 msgr2=0x7f26b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.524+0000 7f26d3277700 1 --2- 172.21.15.37:0/111134084 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f26b0066f30 0x7f26b00693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0c47c0 tx=0x7f26bc009040 comp rx=0 tx=0).stop 2023-10-06T02:24:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.524+0000 7f26d3277700 1 -- 172.21.15.37:0/111134084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26cc0b0620 msgr2=0x7f26cc0c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.524+0000 7f26d3277700 1 --2- 172.21.15.37:0/111134084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26cc0b0620 0x7f26cc0c64a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f26cc06ea40 tx=0x7f26c8017000 comp rx=0 tx=0).stop 2023-10-06T02:24:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.524+0000 7f26d3277700 1 -- 172.21.15.37:0/111134084 shutdown_connections 2023-10-06T02:24:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.524+0000 7f26d3277700 1 --2- 172.21.15.37:0/111134084 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26cc159370 0x7f26cc0c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.524+0000 7f26d3277700 1 --2- 172.21.15.37:0/111134084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26cc0b0620 0x7f26cc0c64a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.524+0000 7f26d3277700 1 --2- 172.21.15.37:0/111134084 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f26b0066f30 0x7f26b00693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.524+0000 7f26d3277700 1 --2- 172.21.15.37:0/111134084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26cc0b2270 0x7f26cc0d0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.524+0000 7f26d3277700 1 -- 172.21.15.37:0/111134084 >> 172.21.15.37:0/111134084 conn(0x7f26cc06c0b0 msgr2=0x7f26cc0c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.524+0000 7f26d3277700 1 -- 172.21.15.37:0/111134084 shutdown_connections 2023-10-06T02:24:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.524+0000 7f26d3277700 1 -- 172.21.15.37:0/111134084 wait complete. 2023-10-06T02:24:38.537 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:24:38.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.658+0000 7f23ecce6700 1 Processor -- start 2023-10-06T02:24:38.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.658+0000 7f23ecce6700 1 -- start start 2023-10-06T02:24:38.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.658+0000 7f23ecce6700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f23e8142e10 0x7f23e806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:38.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.659+0000 7f23ecce6700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f23e806d700 0x7f23e80c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:38.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.659+0000 7f23ecce6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23e80c35f0 0x7f23e80c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:38.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.659+0000 7f23ecce6700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e806db70 con 0x7f23e8142e10 2023-10-06T02:24:38.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.659+0000 7f23ecce6700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e80c4980 con 0x7f23e806d700 2023-10-06T02:24:38.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.659+0000 7f23ecce6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e80c3d70 con 0x7f23e80c35f0 2023-10-06T02:24:38.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.659+0000 7f23e659c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f23e8142e10 0x7f23e806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:38.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.659+0000 7f23e659c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f23e8142e10 0x7f23e806d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38462/0 (socket says 172.21.15.37:38462) 2023-10-06T02:24:38.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.659+0000 7f23e659c700 1 -- 172.21.15.37:0/3538291199 learned_addr learned my addr 172.21.15.37:0/3538291199 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:38.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.659+0000 7f23e5d9b700 1 --2- 172.21.15.37:0/3538291199 >> v2:172.21.15.191:3300/0 conn(0x7f23e806d700 0x7f23e80c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:38.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.659+0000 7f23e6d9d700 1 --2- 172.21.15.37:0/3538291199 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23e80c35f0 0x7f23e80c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:38.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.659+0000 7f23e659c700 1 -- 172.21.15.37:0/3538291199 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23e80c35f0 msgr2=0x7f23e80c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.659+0000 7f23e659c700 1 --2- 172.21.15.37:0/3538291199 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23e80c35f0 0x7f23e80c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.659+0000 7f23e659c700 1 -- 172.21.15.37:0/3538291199 >> v2:172.21.15.191:3300/0 conn(0x7f23e806d700 msgr2=0x7f23e80c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.659+0000 7f23e659c700 1 --2- 172.21.15.37:0/3538291199 >> v2:172.21.15.191:3300/0 conn(0x7f23e806d700 0x7f23e80c30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.659+0000 7f23e659c700 1 -- 172.21.15.37:0/3538291199 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e80c4050 con 0x7f23e8142e10 2023-10-06T02:24:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.659+0000 7f23e5d9b700 1 --2- 172.21.15.37:0/3538291199 >> v2:172.21.15.191:3300/0 conn(0x7f23e806d700 0x7f23e80c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.659+0000 7f23e659c700 1 --2- 172.21.15.37:0/3538291199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23e8142e10 0x7f23e806d1c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f23e806ade0 tx=0x7f23d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46eeb6d6a8bdc6c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.659+0000 7f23e559a700 1 -- 172.21.15.37:0/3538291199 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d800b860 con 0x7f23e8142e10 2023-10-06T02:24:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.659+0000 7f23e559a700 1 -- 172.21.15.37:0/3538291199 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d800b9c0 con 0x7f23e8142e10 2023-10-06T02:24:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.659+0000 7f23e559a700 1 -- 172.21.15.37:0/3538291199 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d800bd60 con 0x7f23e8142e10 2023-10-06T02:24:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.660+0000 7f23ecce6700 1 -- 172.21.15.37:0/3538291199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23e8142e10 msgr2=0x7f23e806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.660+0000 7f23ecce6700 1 --2- 172.21.15.37:0/3538291199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23e8142e10 0x7f23e806d1c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f23e806ade0 tx=0x7f23d8009250 comp rx=0 tx=0).stop 2023-10-06T02:24:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.660+0000 7f23ecce6700 1 -- 172.21.15.37:0/3538291199 shutdown_connections 2023-10-06T02:24:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.660+0000 7f23ecce6700 1 --2- 172.21.15.37:0/3538291199 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23e80c35f0 0x7f23e80c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.660+0000 7f23ecce6700 1 --2- 172.21.15.37:0/3538291199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23e8142e10 0x7f23e806d1c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.660+0000 7f23ecce6700 1 --2- 172.21.15.37:0/3538291199 >> v2:172.21.15.191:3300/0 conn(0x7f23e806d700 0x7f23e80c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.660+0000 7f23ecce6700 1 -- 172.21.15.37:0/3538291199 >> 172.21.15.37:0/3538291199 conn(0x7f23e8067b30 msgr2=0x7f23e8067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.660+0000 7f23ecce6700 1 -- 172.21.15.37:0/3538291199 shutdown_connections 2023-10-06T02:24:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.660+0000 7f23ecce6700 1 -- 172.21.15.37:0/3538291199 wait complete. 2023-10-06T02:24:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.661+0000 7f23ecce6700 1 Processor -- start 2023-10-06T02:24:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.662+0000 7f23ecce6700 1 -- start start 2023-10-06T02:24:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.663+0000 7f23ecce6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23e806d700 0x7f23e80ae590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.663+0000 7f23ecce6700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e80c35f0 0x7f23e815b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.663+0000 7f23ecce6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23e8142e10 0x7f23e80c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.663+0000 7f23ecce6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e80b4210 con 0x7f23e8142e10 2023-10-06T02:24:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.663+0000 7f23ecce6700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e80c99b0 con 0x7f23e80c35f0 2023-10-06T02:24:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.663+0000 7f23ecce6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e80b10b0 con 0x7f23e806d700 2023-10-06T02:24:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.663+0000 7f23e6d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23e8142e10 0x7f23e80c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.663+0000 7f23e6d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23e8142e10 0x7f23e80c77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38466/0 (socket says 172.21.15.37:38466) 2023-10-06T02:24:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.663+0000 7f23e6d9d700 1 -- 172.21.15.37:0/227988888 learned_addr learned my addr 172.21.15.37:0/227988888 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:38.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.663+0000 7f23e5d9b700 1 --2- 172.21.15.37:0/227988888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e80c35f0 0x7f23e815b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:38.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.663+0000 7f23e659c700 1 --2- 172.21.15.37:0/227988888 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23e806d700 0x7f23e80ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:38.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.663+0000 7f23e6d9d700 1 -- 172.21.15.37:0/227988888 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23e806d700 msgr2=0x7f23e80ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:38.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.663+0000 7f23e6d9d700 1 --2- 172.21.15.37:0/227988888 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23e806d700 0x7f23e80ae590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.663+0000 7f23e6d9d700 1 -- 172.21.15.37:0/227988888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e80c35f0 msgr2=0x7f23e815b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:38.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.663+0000 7f23e6d9d700 1 --2- 172.21.15.37:0/227988888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e80c35f0 0x7f23e815b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.663+0000 7f23e6d9d700 1 -- 172.21.15.37:0/227988888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d80094f0 con 0x7f23e8142e10 2023-10-06T02:24:38.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.663+0000 7f23e6d9d700 1 --2- 172.21.15.37:0/227988888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23e8142e10 0x7f23e80c77a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f23e0009fa0 tx=0x7f23e0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:38.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.663+0000 7f23d67fc700 1 -- 172.21.15.37:0/227988888 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e000ebc0 con 0x7f23e8142e10 2023-10-06T02:24:38.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.664+0000 7f23d67fc700 1 -- 172.21.15.37:0/227988888 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e000ed20 con 0x7f23e8142e10 2023-10-06T02:24:38.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.664+0000 7f23ecce6700 1 -- 172.21.15.37:0/227988888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e80b3c50 con 0x7f23e8142e10 2023-10-06T02:24:38.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.664+0000 7f23d67fc700 1 -- 172.21.15.37:0/227988888 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e0014670 con 0x7f23e8142e10 2023-10-06T02:24:38.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.664+0000 7f23ecce6700 1 -- 172.21.15.37:0/227988888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e80c9640 con 0x7f23e8142e10 2023-10-06T02:24:38.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.665+0000 7f23ecce6700 1 -- 172.21.15.37:0/227988888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e80c94a0 con 0x7f23e8142e10 2023-10-06T02:24:38.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.665+0000 7f23d67fc700 1 -- 172.21.15.37:0/227988888 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f23e00149e0 con 0x7f23e8142e10 2023-10-06T02:24:38.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.665+0000 7f23d67fc700 1 --2- 172.21.15.37:0/227988888 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f23c8066f30 0x7f23c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:38.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.665+0000 7f23d67fc700 1 -- 172.21.15.37:0/227988888 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f23e0084da0 con 0x7f23e8142e10 2023-10-06T02:24:38.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.665+0000 7f23e659c700 1 --2- 172.21.15.37:0/227988888 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f23c8066f30 0x7f23c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:38.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.666+0000 7f23e659c700 1 --2- 172.21.15.37:0/227988888 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f23c8066f30 0x7f23c80693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f23e806ade0 tx=0x7f23d8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:38.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.669+0000 7f23d67fc700 1 -- 172.21.15.37:0/227988888 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23e80c94a0 con 0x7f23e8142e10 2023-10-06T02:24:38.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.908+0000 7f23ecce6700 1 -- 172.21.15.37:0/227988888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f23e80c94a0 con 0x7f23e8142e10 2023-10-06T02:24:38.909 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-10-06T02:24:38.909+0000 7f292cc58700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:24:38.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.913+0000 7f23d67fc700 1 -- 172.21.15.37:0/227988888 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f23e80c94a0 con 0x7f23e8142e10 2023-10-06T02:24:38.915 INFO:tasks.ceph.mds.c.smithi037.stderr: -5450> 2023-10-06T02:24:09.858+0000 7f1270cd5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:24:38.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.915+0000 7f23ecce6700 1 -- 172.21.15.37:0/227988888 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f23c8066f30 msgr2=0x7f23c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:38.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.915+0000 7f23ecce6700 1 --2- 172.21.15.37:0/227988888 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f23c8066f30 0x7f23c80693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f23e806ade0 tx=0x7f23d8017000 comp rx=0 tx=0).stop 2023-10-06T02:24:38.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.915+0000 7f23ecce6700 1 -- 172.21.15.37:0/227988888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23e8142e10 msgr2=0x7f23e80c77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:38.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.915+0000 7f23ecce6700 1 --2- 172.21.15.37:0/227988888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23e8142e10 0x7f23e80c77a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f23e0009fa0 tx=0x7f23e0009900 comp rx=0 tx=0).stop 2023-10-06T02:24:38.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.915+0000 7f23ecce6700 1 -- 172.21.15.37:0/227988888 shutdown_connections 2023-10-06T02:24:38.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.915+0000 7f23ecce6700 1 --2- 172.21.15.37:0/227988888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23e8142e10 0x7f23e80c77a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.915+0000 7f23ecce6700 1 --2- 172.21.15.37:0/227988888 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23e806d700 0x7f23e80ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.915+0000 7f23ecce6700 1 --2- 172.21.15.37:0/227988888 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f23c8066f30 0x7f23c80693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.915+0000 7f23ecce6700 1 --2- 172.21.15.37:0/227988888 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e80c35f0 0x7f23e815b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:38.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.915+0000 7f23ecce6700 1 -- 172.21.15.37:0/227988888 >> 172.21.15.37:0/227988888 conn(0x7f23e8067b30 msgr2=0x7f23e80cd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:38.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.916+0000 7f23ecce6700 1 -- 172.21.15.37:0/227988888 shutdown_connections 2023-10-06T02:24:38.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:38.916+0000 7f23ecce6700 1 -- 172.21.15.37:0/227988888 wait complete. 2023-10-06T02:24:38.917 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:24:38.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:24:38.943 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-10-06T02:24:39.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.050+0000 7f1ebd985700 1 Processor -- start 2023-10-06T02:24:39.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.050+0000 7f1ebd985700 1 -- start start 2023-10-06T02:24:39.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.051+0000 7f1ebd985700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1eb8153b10 0x7f1eb80b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:39.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.051+0000 7f1ebd985700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1eb8153ee0 0x7f1eb80b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:39.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.051+0000 7f1ebd985700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f1eb80b1800 0x7f1eb8156740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:39.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.051+0000 7f1ebd985700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb80b0650 con 0x7f1eb8153b10 2023-10-06T02:24:39.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.051+0000 7f1ebd985700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb80b1c40 con 0x7f1eb80b1800 2023-10-06T02:24:39.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.051+0000 7f1ebd985700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb8157530 con 0x7f1eb8153ee0 2023-10-06T02:24:39.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.051+0000 7f1ebc983700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1eb8153b10 0x7f1eb80b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:39.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.051+0000 7f1ebc983700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1eb8153b10 0x7f1eb80b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38488/0 (socket says 172.21.15.37:38488) 2023-10-06T02:24:39.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.051+0000 7f1ebc983700 1 -- 172.21.15.37:0/186553823 learned_addr learned my addr 172.21.15.37:0/186553823 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:39.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.051+0000 7f1ebd184700 1 --2- 172.21.15.37:0/186553823 >> v2:172.21.15.191:3300/0 conn(0x7f1eb80b1800 0x7f1eb8156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:39.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.051+0000 7f1ebc983700 1 -- 172.21.15.37:0/186553823 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1eb8153ee0 msgr2=0x7f1eb80b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:39.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.051+0000 7f1eb7fff700 1 --2- 172.21.15.37:0/186553823 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1eb8153ee0 0x7f1eb80b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:39.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.051+0000 7f1ebc983700 1 --2- 172.21.15.37:0/186553823 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1eb8153ee0 0x7f1eb80b12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.051+0000 7f1ebc983700 1 -- 172.21.15.37:0/186553823 >> v2:172.21.15.191:3300/0 conn(0x7f1eb80b1800 msgr2=0x7f1eb8156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:39.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.051+0000 7f1ebc983700 1 --2- 172.21.15.37:0/186553823 >> v2:172.21.15.191:3300/0 conn(0x7f1eb80b1800 0x7f1eb8156740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.052+0000 7f1ebc983700 1 -- 172.21.15.37:0/186553823 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb80b0000 con 0x7f1eb8153b10 2023-10-06T02:24:39.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.052+0000 7f1ebc983700 1 --2- 172.21.15.37:0/186553823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb8153b10 0x7f1eb80b0ae0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1eb806a270 tx=0x7f1ea8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff96c78a09d117e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:39.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.052+0000 7f1eb77fe700 1 -- 172.21.15.37:0/186553823 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea800b860 con 0x7f1eb8153b10 2023-10-06T02:24:39.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.052+0000 7f1eb77fe700 1 -- 172.21.15.37:0/186553823 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea800b9c0 con 0x7f1eb8153b10 2023-10-06T02:24:39.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.052+0000 7f1eb77fe700 1 -- 172.21.15.37:0/186553823 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea800bd60 con 0x7f1eb8153b10 2023-10-06T02:24:39.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.052+0000 7f1ebd985700 1 -- 172.21.15.37:0/186553823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb8153b10 msgr2=0x7f1eb80b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:39.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.052+0000 7f1ebd985700 1 --2- 172.21.15.37:0/186553823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb8153b10 0x7f1eb80b0ae0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1eb806a270 tx=0x7f1ea8009250 comp rx=0 tx=0).stop 2023-10-06T02:24:39.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.052+0000 7f1ebd985700 1 -- 172.21.15.37:0/186553823 shutdown_connections 2023-10-06T02:24:39.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.052+0000 7f1ebd985700 1 --2- 172.21.15.37:0/186553823 >> v2:172.21.15.191:3300/0 conn(0x7f1eb80b1800 0x7f1eb8156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.052+0000 7f1ebd985700 1 --2- 172.21.15.37:0/186553823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb8153b10 0x7f1eb80b0ae0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.052+0000 7f1ebd985700 1 --2- 172.21.15.37:0/186553823 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1eb8153ee0 0x7f1eb80b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.052+0000 7f1ebd985700 1 -- 172.21.15.37:0/186553823 >> 172.21.15.37:0/186553823 conn(0x7f1eb806d1c0 msgr2=0x7f1eb806d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:39.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.052+0000 7f1ebd985700 1 -- 172.21.15.37:0/186553823 shutdown_connections 2023-10-06T02:24:39.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.052+0000 7f1ebd985700 1 -- 172.21.15.37:0/186553823 wait complete. 2023-10-06T02:24:39.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.054+0000 7f1ebd985700 1 Processor -- start 2023-10-06T02:24:39.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.054+0000 7f1ebd985700 1 -- start start 2023-10-06T02:24:39.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.054+0000 7f1ebd985700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1eb80b1800 0x7f1eb815d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:39.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.054+0000 7f1ebd985700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb8153b10 0x7f1eb815bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:39.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.054+0000 7f1ebd985700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1eb8153ee0 0x7f1eb8147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:39.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.054+0000 7f1ebd985700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb815cca0 con 0x7f1eb8153b10 2023-10-06T02:24:39.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.054+0000 7f1ebd985700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb80cccb0 con 0x7f1eb8153ee0 2023-10-06T02:24:39.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.054+0000 7f1ebd985700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb815c6e0 con 0x7f1eb80b1800 2023-10-06T02:24:39.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.055+0000 7f1eb7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb8153b10 0x7f1eb815bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:39.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.055+0000 7f1eb7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb8153b10 0x7f1eb815bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38490/0 (socket says 172.21.15.37:38490) 2023-10-06T02:24:39.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.055+0000 7f1eb7fff700 1 -- 172.21.15.37:0/3394562678 learned_addr learned my addr 172.21.15.37:0/3394562678 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:39.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.055+0000 7f1ebc983700 1 --2- 172.21.15.37:0/3394562678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1eb80b1800 0x7f1eb815d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:39.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.055+0000 7f1ebd184700 1 --2- 172.21.15.37:0/3394562678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1eb8153ee0 0x7f1eb8147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:39.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.055+0000 7f1eb7fff700 1 -- 172.21.15.37:0/3394562678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1eb80b1800 msgr2=0x7f1eb815d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:39.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.055+0000 7f1eb7fff700 1 --2- 172.21.15.37:0/3394562678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1eb80b1800 0x7f1eb815d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.055+0000 7f1eb7fff700 1 -- 172.21.15.37:0/3394562678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1eb8153ee0 msgr2=0x7f1eb8147ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:39.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.055+0000 7f1eb7fff700 1 --2- 172.21.15.37:0/3394562678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1eb8153ee0 0x7f1eb8147ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.055+0000 7f1eb7fff700 1 -- 172.21.15.37:0/3394562678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea80094f0 con 0x7f1eb8153b10 2023-10-06T02:24:39.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.055+0000 7f1eb7fff700 1 --2- 172.21.15.37:0/3394562678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb8153b10 0x7f1eb815bd70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00c880 tx=0x7f1eac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:39.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.055+0000 7f1eb4ff9700 1 -- 172.21.15.37:0/3394562678 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eac011600 con 0x7f1eb8153b10 2023-10-06T02:24:39.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.055+0000 7f1eb4ff9700 1 -- 172.21.15.37:0/3394562678 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eac011780 con 0x7f1eb8153b10 2023-10-06T02:24:39.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.055+0000 7f1ebd985700 1 -- 172.21.15.37:0/3394562678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb815c9c0 con 0x7f1eb8153b10 2023-10-06T02:24:39.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.055+0000 7f1eb4ff9700 1 -- 172.21.15.37:0/3394562678 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eac011b40 con 0x7f1eb8153b10 2023-10-06T02:24:39.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.055+0000 7f1ebd985700 1 -- 172.21.15.37:0/3394562678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb815d890 con 0x7f1eb8153b10 2023-10-06T02:24:39.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.056+0000 7f1ebd985700 1 -- 172.21.15.37:0/3394562678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb80cc7a0 con 0x7f1eb8153b10 2023-10-06T02:24:39.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.056+0000 7f1eb4ff9700 1 -- 172.21.15.37:0/3394562678 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1eac018360 con 0x7f1eb8153b10 2023-10-06T02:24:39.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.057+0000 7f1eb4ff9700 1 --2- 172.21.15.37:0/3394562678 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1ea4066f30 0x7f1ea40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:39.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.057+0000 7f1eb4ff9700 1 -- 172.21.15.37:0/3394562678 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f1eac0843e0 con 0x7f1eb8153b10 2023-10-06T02:24:39.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.057+0000 7f1ebc983700 1 --2- 172.21.15.37:0/3394562678 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1ea4066f30 0x7f1ea40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:39.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.058+0000 7f1ebc983700 1 --2- 172.21.15.37:0/3394562678 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1ea4066f30 0x7f1ea40693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1eb806a270 tx=0x7f1ea8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:39.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.061+0000 7f1eb4ff9700 1 -- 172.21.15.37:0/3394562678 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1eb80cc7a0 con 0x7f1eb8153b10 2023-10-06T02:24:39.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.299+0000 7f1ebd985700 1 -- 172.21.15.37:0/3394562678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1eb80cc7a0 con 0x7f1eb8153b10 2023-10-06T02:24:39.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.912+0000 7f1eb4ff9700 1 -- 172.21.15.37:0/3394562678 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1eb80cc7a0 con 0x7f1eb8153b10 2023-10-06T02:24:39.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.915+0000 7f1ebd985700 1 -- 172.21.15.37:0/3394562678 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1ea4066f30 msgr2=0x7f1ea40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:39.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.915+0000 7f1ebd985700 1 --2- 172.21.15.37:0/3394562678 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1ea4066f30 0x7f1ea40693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1eb806a270 tx=0x7f1ea8017000 comp rx=0 tx=0).stop 2023-10-06T02:24:39.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.915+0000 7f1ebd985700 1 -- 172.21.15.37:0/3394562678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb8153b10 msgr2=0x7f1eb815bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:39.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.915+0000 7f1ebd985700 1 --2- 172.21.15.37:0/3394562678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb8153b10 0x7f1eb815bd70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00c880 tx=0x7f1eac008040 comp rx=0 tx=0).stop 2023-10-06T02:24:39.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.915+0000 7f1ebd985700 1 -- 172.21.15.37:0/3394562678 shutdown_connections 2023-10-06T02:24:39.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.915+0000 7f1ebd985700 1 --2- 172.21.15.37:0/3394562678 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1ea4066f30 0x7f1ea40693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.915+0000 7f1ebd985700 1 --2- 172.21.15.37:0/3394562678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1eb8153ee0 0x7f1eb8147ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.915+0000 7f1ebd985700 1 --2- 172.21.15.37:0/3394562678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1eb80b1800 0x7f1eb815d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.915+0000 7f1ebd985700 1 --2- 172.21.15.37:0/3394562678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb8153b10 0x7f1eb815bd70 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:39.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.915+0000 7f1ebd985700 1 -- 172.21.15.37:0/3394562678 >> 172.21.15.37:0/3394562678 conn(0x7f1eb806d1c0 msgr2=0x7f1eb80c66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:39.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.915+0000 7f1ebd985700 1 -- 172.21.15.37:0/3394562678 shutdown_connections 2023-10-06T02:24:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:39.915+0000 7f1ebd985700 1 -- 172.21.15.37:0/3394562678 wait complete. 2023-10-06T02:24:39.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:24:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.097+0000 7ff4fd98e700 1 Processor -- start 2023-10-06T02:24:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.098+0000 7ff4fd98e700 1 -- start start 2023-10-06T02:24:40.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.098+0000 7ff4fd98e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff4f81595f0 0x7ff4f80b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:40.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.098+0000 7ff4fd98e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f80b1000 con 0x7ff4f806df40 2023-10-06T02:24:40.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.098+0000 7ff4fd98e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f815d710 con 0x7ff4f81599c0 2023-10-06T02:24:40.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.098+0000 7ff4fd98e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f80cb320 con 0x7ff4f81595f0 2023-10-06T02:24:40.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.098+0000 7ff4f77fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff4f806df40 0x7ff4f80cb740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36084/0 (socket says 172.21.15.37:36084) 2023-10-06T02:24:40.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.098+0000 7ff4f77fe700 1 -- 172.21.15.37:0/2064135157 learned_addr learned my addr 172.21.15.37:0/2064135157 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:40.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.099+0000 7ff4f6ffd700 1 --2- 172.21.15.37:0/2064135157 >> v2:172.21.15.191:3300/0 conn(0x7ff4f81595f0 0x7ff4f80b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:40.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.099+0000 7ff4f5ffb700 1 -- 172.21.15.37:0/2064135157 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583752030 0 0) 0x7ff4f80b1000 con 0x7ff4f806df40 2023-10-06T02:24:40.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.099+0000 7ff4f5ffb700 1 -- 172.21.15.37:0/2064135157 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4e4003570 con 0x7ff4f806df40 2023-10-06T02:24:40.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.099+0000 7ff4f6ffd700 1 -- 172.21.15.37:0/2064135157 >> v1:172.21.15.191:6789/0 conn(0x7ff4f81599c0 legacy=0x7ff4f806d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:40.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.099+0000 7ff4f5ffb700 1 -- 172.21.15.37:0/2064135157 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705339634 0 0) 0x7ff4f815d710 con 0x7ff4f81599c0 2023-10-06T02:24:40.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.099+0000 7ff4f6ffd700 1 -- 172.21.15.37:0/2064135157 >> v1:172.21.15.37:6789/0 conn(0x7ff4f806df40 legacy=0x7ff4f80cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:40.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.099+0000 7ff4f6ffd700 1 -- 172.21.15.37:0/2064135157 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f815d9f0 con 0x7ff4f81595f0 2023-10-06T02:24:40.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.099+0000 7ff4f6ffd700 1 --2- 172.21.15.37:0/2064135157 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f81595f0 0x7ff4f80b0ac0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff4f815e360 tx=0x7ff4f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b149d2500600b2f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:40.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.099+0000 7ff4f5ffb700 1 -- 172.21.15.37:0/2064135157 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0011630 con 0x7ff4f81595f0 2023-10-06T02:24:40.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.099+0000 7ff4f5ffb700 1 -- 172.21.15.37:0/2064135157 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f0011790 con 0x7ff4f81595f0 2023-10-06T02:24:40.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.099+0000 7ff4f5ffb700 1 -- 172.21.15.37:0/2064135157 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0011b50 con 0x7ff4f81595f0 2023-10-06T02:24:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.100+0000 7ff4fd98e700 1 -- 172.21.15.37:0/2064135157 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f81595f0 msgr2=0x7ff4f80b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.100+0000 7ff4fd98e700 1 --2- 172.21.15.37:0/2064135157 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f81595f0 0x7ff4f80b0ac0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff4f815e360 tx=0x7ff4f00091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.100+0000 7ff4fd98e700 1 -- 172.21.15.37:0/2064135157 shutdown_connections 2023-10-06T02:24:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.100+0000 7ff4fd98e700 1 --2- 172.21.15.37:0/2064135157 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f81595f0 0x7ff4f80b0ac0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.100+0000 7ff4fd98e700 1 -- 172.21.15.37:0/2064135157 >> 172.21.15.37:0/2064135157 conn(0x7ff4f80ccf90 msgr2=0x7ff4f80cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.100+0000 7ff4fd98e700 1 -- 172.21.15.37:0/2064135157 shutdown_connections 2023-10-06T02:24:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.100+0000 7ff4fd98e700 1 -- 172.21.15.37:0/2064135157 wait complete. 2023-10-06T02:24:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.101+0000 7ff4fd98e700 1 Processor -- start 2023-10-06T02:24:40.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.101+0000 7ff4fd98e700 1 -- start start 2023-10-06T02:24:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.102+0000 7ff4fd98e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f806df40 0x7ff4f80b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.102+0000 7ff4fd98e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4f81595f0 0x7ff4f815ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.102+0000 7ff4fd98e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4f81599c0 0x7ff4f80c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.102+0000 7ff4fd98e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f815ce40 con 0x7ff4f81595f0 2023-10-06T02:24:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.102+0000 7ff4fd98e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f80c4fe0 con 0x7ff4f806df40 2023-10-06T02:24:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.102+0000 7ff4fd98e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f80c4360 con 0x7ff4f81599c0 2023-10-06T02:24:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.102+0000 7ff4f67fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4f81595f0 0x7ff4f815ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.102+0000 7ff4f67fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4f81595f0 0x7ff4f815ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38504/0 (socket says 172.21.15.37:38504) 2023-10-06T02:24:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.102+0000 7ff4f67fc700 1 -- 172.21.15.37:0/1724487938 learned_addr learned my addr 172.21.15.37:0/1724487938 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.102+0000 7ff4f6ffd700 1 --2- 172.21.15.37:0/1724487938 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f806df40 0x7ff4f80b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:40.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.102+0000 7ff4f77fe700 1 --2- 172.21.15.37:0/1724487938 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4f81599c0 0x7ff4f80c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:40.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.102+0000 7ff4f67fc700 1 -- 172.21.15.37:0/1724487938 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4f81599c0 msgr2=0x7ff4f80c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:40.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.102+0000 7ff4f67fc700 1 --2- 172.21.15.37:0/1724487938 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4f81599c0 0x7ff4f80c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:40.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.102+0000 7ff4f67fc700 1 -- 172.21.15.37:0/1724487938 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f806df40 msgr2=0x7ff4f80b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:40.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.102+0000 7ff4f67fc700 1 --2- 172.21.15.37:0/1724487938 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f806df40 0x7ff4f80b0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:40.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.102+0000 7ff4f67fc700 1 -- 172.21.15.37:0/1724487938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0009420 con 0x7ff4f81595f0 2023-10-06T02:24:40.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.102+0000 7ff4f6ffd700 1 --2- 172.21.15.37:0/1724487938 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f806df40 0x7ff4f80b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:40.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.102+0000 7ff4f77fe700 1 --2- 172.21.15.37:0/1724487938 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4f81599c0 0x7ff4f80c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:40.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.103+0000 7ff4f67fc700 1 --2- 172.21.15.37:0/1724487938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4f81595f0 0x7ff4f815ad50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000c560 tx=0x7ff4e0007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:40.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.103+0000 7ff4eeffd700 1 -- 172.21.15.37:0/1724487938 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0011590 con 0x7ff4f81595f0 2023-10-06T02:24:40.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.103+0000 7ff4eeffd700 1 -- 172.21.15.37:0/1724487938 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e0011710 con 0x7ff4f81595f0 2023-10-06T02:24:40.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.103+0000 7ff4fd98e700 1 -- 172.21.15.37:0/1724487938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f80c4640 con 0x7ff4f81595f0 2023-10-06T02:24:40.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.103+0000 7ff4eeffd700 1 -- 172.21.15.37:0/1724487938 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0011ad0 con 0x7ff4f81595f0 2023-10-06T02:24:40.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.103+0000 7ff4fd98e700 1 -- 172.21.15.37:0/1724487938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f80c4c00 con 0x7ff4f81595f0 2023-10-06T02:24:40.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.104+0000 7ff4fd98e700 1 -- 172.21.15.37:0/1724487938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f8088b10 con 0x7ff4f81595f0 2023-10-06T02:24:40.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.104+0000 7ff4eeffd700 1 -- 172.21.15.37:0/1724487938 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4e001b3b0 con 0x7ff4f81595f0 2023-10-06T02:24:40.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.105+0000 7ff4eeffd700 1 --2- 172.21.15.37:0/1724487938 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff4d8066f30 0x7ff4d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:40.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.105+0000 7ff4eeffd700 1 -- 172.21.15.37:0/1724487938 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6144+0+0 (secure 0 0 0) 0x7ff4e0083d00 con 0x7ff4f81595f0 2023-10-06T02:24:40.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.105+0000 7ff4f6ffd700 1 --2- 172.21.15.37:0/1724487938 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff4d8066f30 0x7ff4d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:40.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.105+0000 7ff4f6ffd700 1 --2- 172.21.15.37:0/1724487938 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff4d8066f30 0x7ff4d80693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00093f0 tx=0x7ff4f0016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:40.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.109+0000 7ff4eeffd700 1 -- 172.21.15.37:0/1724487938 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4e0050d40 con 0x7ff4f81595f0 2023-10-06T02:24:40.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.304+0000 7ff4fd98e700 1 -- 172.21.15.37:0/1724487938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff4f804bb80 con 0x7ff4f81595f0 2023-10-06T02:24:40.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.918+0000 7ff4eeffd700 1 -- 172.21.15.37:0/1724487938 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff4e0017070 con 0x7ff4f81595f0 2023-10-06T02:24:40.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.922+0000 7ff4fd98e700 1 -- 172.21.15.37:0/1724487938 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff4d8066f30 msgr2=0x7ff4d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:40.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.922+0000 7ff4fd98e700 1 --2- 172.21.15.37:0/1724487938 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff4d8066f30 0x7ff4d80693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00093f0 tx=0x7ff4f0016000 comp rx=0 tx=0).stop 2023-10-06T02:24:40.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.922+0000 7ff4fd98e700 1 -- 172.21.15.37:0/1724487938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4f81595f0 msgr2=0x7ff4f815ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:40.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.922+0000 7ff4fd98e700 1 --2- 172.21.15.37:0/1724487938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4f81595f0 0x7ff4f815ad50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000c560 tx=0x7ff4e0007f50 comp rx=0 tx=0).stop 2023-10-06T02:24:40.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.923+0000 7ff4fd98e700 1 -- 172.21.15.37:0/1724487938 shutdown_connections 2023-10-06T02:24:40.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.923+0000 7ff4fd98e700 1 --2- 172.21.15.37:0/1724487938 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4f81599c0 0x7ff4f80c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:40.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.923+0000 7ff4fd98e700 1 --2- 172.21.15.37:0/1724487938 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff4d8066f30 0x7ff4d80693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:40.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.923+0000 7ff4fd98e700 1 --2- 172.21.15.37:0/1724487938 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f806df40 0x7ff4f80b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:40.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.923+0000 7ff4fd98e700 1 --2- 172.21.15.37:0/1724487938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4f81595f0 0x7ff4f815ad50 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:40.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.923+0000 7ff4fd98e700 1 -- 172.21.15.37:0/1724487938 >> 172.21.15.37:0/1724487938 conn(0x7ff4f80ccf90 msgr2=0x7ff4f81566a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:40.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.923+0000 7ff4fd98e700 1 -- 172.21.15.37:0/1724487938 shutdown_connections 2023-10-06T02:24:40.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:40.923+0000 7ff4fd98e700 1 -- 172.21.15.37:0/1724487938 wait complete. 2023-10-06T02:24:40.925 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:24:40.938 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:24:41.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.063+0000 7f0880d2a700 1 Processor -- start 2023-10-06T02:24:41.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.063+0000 7f0880d2a700 1 -- start start 2023-10-06T02:24:41.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.064+0000 7f0880d2a700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f087c140a10 0x7f087c0ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.064+0000 7f0880d2a700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f087c0ca010 con 0x7f087c140de0 2023-10-06T02:24:41.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.064+0000 7f0880d2a700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f087c0c9440 con 0x7f087c06c7c0 2023-10-06T02:24:41.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.064+0000 7f0880d2a700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f087c0c96e0 con 0x7f087c140a10 2023-10-06T02:24:41.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.064+0000 7f087affd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f087c140de0 0x7f087c06c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36098/0 (socket says 172.21.15.37:36098) 2023-10-06T02:24:41.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.064+0000 7f087affd700 1 -- 172.21.15.37:0/3474618563 learned_addr learned my addr 172.21.15.37:0/3474618563 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:41.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.064+0000 7f087b7fe700 1 --2- 172.21.15.37:0/3474618563 >> v2:172.21.15.191:3300/0 conn(0x7f087c140a10 0x7f087c0ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.064+0000 7f087a7fc700 1 -- 172.21.15.37:0/3474618563 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222992466 0 0) 0x7f087c0ca010 con 0x7f087c140de0 2023-10-06T02:24:41.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.064+0000 7f087a7fc700 1 -- 172.21.15.37:0/3474618563 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0864003570 con 0x7f087c140de0 2023-10-06T02:24:41.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087a7fc700 1 -- 172.21.15.37:0/3474618563 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1471890654 0 0) 0x7f0864003570 con 0x7f087c140de0 2023-10-06T02:24:41.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087a7fc700 1 -- 172.21.15.37:0/3474618563 >> v2:172.21.15.191:3300/0 conn(0x7f087c140a10 msgr2=0x7f087c0ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:41.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087a7fc700 1 --2- 172.21.15.37:0/3474618563 >> v2:172.21.15.191:3300/0 conn(0x7f087c140a10 0x7f087c0ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087a7fc700 1 -- 172.21.15.37:0/3474618563 >> v1:172.21.15.191:6789/0 conn(0x7f087c06c7c0 legacy=0x7f087c15b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087a7fc700 1 -- 172.21.15.37:0/3474618563 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c0c99c0 con 0x7f087c140de0 2023-10-06T02:24:41.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087a7fc700 1 -- 172.21.15.37:0/3474618563 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f0870001470 con 0x7f087c140de0 2023-10-06T02:24:41.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087a7fc700 1 -- 172.21.15.37:0/3474618563 >> v1:172.21.15.37:6789/0 conn(0x7f087c140de0 legacy=0x7f087c06c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087a7fc700 1 --2- 172.21.15.37:0/3474618563 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0864003a60 0x7f0864003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087a7fc700 1 --2- 172.21.15.37:0/3474618563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0864004810 0x7f0864004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087a7fc700 1 --2- 172.21.15.37:0/3474618563 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08640051c0 0x7f086400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087a7fc700 1 -- 172.21.15.37:0/3474618563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c0c96e0 con 0x7f0864004810 2023-10-06T02:24:41.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087a7fc700 1 -- 172.21.15.37:0/3474618563 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086400c0d0 con 0x7f0864003a60 2023-10-06T02:24:41.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087a7fc700 1 -- 172.21.15.37:0/3474618563 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086400c290 con 0x7f08640051c0 2023-10-06T02:24:41.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087affd700 1 --2- 172.21.15.37:0/3474618563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0864004810 0x7f0864004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087b7fe700 1 --2- 172.21.15.37:0/3474618563 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0864003a60 0x7f0864003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087bfff700 1 --2- 172.21.15.37:0/3474618563 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08640051c0 0x7f086400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087affd700 1 -- 172.21.15.37:0/3474618563 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08640051c0 msgr2=0x7f086400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:41.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087affd700 1 --2- 172.21.15.37:0/3474618563 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08640051c0 0x7f086400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087affd700 1 -- 172.21.15.37:0/3474618563 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0864003a60 msgr2=0x7f0864003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087affd700 1 --2- 172.21.15.37:0/3474618563 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0864003a60 0x7f0864003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087affd700 1 -- 172.21.15.37:0/3474618563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0864003570 con 0x7f0864004810 2023-10-06T02:24:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087bfff700 1 --2- 172.21.15.37:0/3474618563 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08640051c0 0x7f086400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087bfff700 1 -- 172.21.15.37:0/3474618563 reap_dead start 2023-10-06T02:24:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.065+0000 7f087affd700 1 --2- 172.21.15.37:0/3474618563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0864004810 0x7f0864004c80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f087c06a220 tx=0x7f087c158950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1811bb1207daa38b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.066+0000 7f087a7fc700 1 -- 172.21.15.37:0/3474618563 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087000cc00 con 0x7f0864004810 2023-10-06T02:24:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.066+0000 7f087a7fc700 1 -- 172.21.15.37:0/3474618563 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087000cd60 con 0x7f0864004810 2023-10-06T02:24:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.066+0000 7f087a7fc700 1 -- 172.21.15.37:0/3474618563 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870005b70 con 0x7f0864004810 2023-10-06T02:24:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.066+0000 7f0880d2a700 1 -- 172.21.15.37:0/3474618563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0864004810 msgr2=0x7f0864004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.066+0000 7f0880d2a700 1 --2- 172.21.15.37:0/3474618563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0864004810 0x7f0864004c80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f087c06a220 tx=0x7f087c158950 comp rx=0 tx=0).stop 2023-10-06T02:24:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.066+0000 7f0880d2a700 1 -- 172.21.15.37:0/3474618563 shutdown_connections 2023-10-06T02:24:41.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.066+0000 7f0880d2a700 1 --2- 172.21.15.37:0/3474618563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0864004810 0x7f0864004c80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.066+0000 7f0880d2a700 1 -- 172.21.15.37:0/3474618563 >> 172.21.15.37:0/3474618563 conn(0x7f087c06d1c0 msgr2=0x7f087c06d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:41.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.066+0000 7f0880d2a700 1 -- 172.21.15.37:0/3474618563 shutdown_connections 2023-10-06T02:24:41.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.066+0000 7f0880d2a700 1 -- 172.21.15.37:0/3474618563 wait complete. 2023-10-06T02:24:41.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.067+0000 7f0880d2a700 1 Processor -- start 2023-10-06T02:24:41.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.067+0000 7f0880d2a700 1 -- start start 2023-10-06T02:24:41.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.068+0000 7f0880d2a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0864004810 0x7f087c16b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.068+0000 7f0880d2a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f087c0c5940 0x7f087c13e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.068+0000 7f0880d2a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f087c0b1f10 0x7f087c0b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.068+0000 7f0880d2a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c0b28d0 con 0x7f087c0b1f10 2023-10-06T02:24:41.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.068+0000 7f0880d2a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c0c6230 con 0x7f0864004810 2023-10-06T02:24:41.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.068+0000 7f0880d2a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087c16be50 con 0x7f087c0c5940 2023-10-06T02:24:41.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.068+0000 7f087bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f087c0b1f10 0x7f087c0b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.068+0000 7f087bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f087c0b1f10 0x7f087c0b2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38520/0 (socket says 172.21.15.37:38520) 2023-10-06T02:24:41.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.068+0000 7f087bfff700 1 -- 172.21.15.37:0/2720489034 learned_addr learned my addr 172.21.15.37:0/2720489034 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:41.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.068+0000 7f087b7fe700 1 --2- 172.21.15.37:0/2720489034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0864004810 0x7f087c16b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.068+0000 7f087affd700 1 --2- 172.21.15.37:0/2720489034 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f087c0c5940 0x7f087c13e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.069+0000 7f087bfff700 1 -- 172.21.15.37:0/2720489034 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f087c0c5940 msgr2=0x7f087c13e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.069+0000 7f087bfff700 1 --2- 172.21.15.37:0/2720489034 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f087c0c5940 0x7f087c13e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.069+0000 7f087bfff700 1 -- 172.21.15.37:0/2720489034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0864004810 msgr2=0x7f087c16b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.069+0000 7f087bfff700 1 --2- 172.21.15.37:0/2720489034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0864004810 0x7f087c16b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.069+0000 7f087bfff700 1 -- 172.21.15.37:0/2720489034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c0c5ee0 con 0x7f087c0b1f10 2023-10-06T02:24:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.069+0000 7f087bfff700 1 --2- 172.21.15.37:0/2720489034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f087c0b1f10 0x7f087c0b2390 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f087c06f4c0 tx=0x7f0874009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.069+0000 7f08637fe700 1 -- 172.21.15.37:0/2720489034 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0874018070 con 0x7f087c0b1f10 2023-10-06T02:24:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.069+0000 7f08637fe700 1 -- 172.21.15.37:0/2720489034 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0874006ba0 con 0x7f087c0b1f10 2023-10-06T02:24:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.069+0000 7f0880d2a700 1 -- 172.21.15.37:0/2720489034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f087c0a5e90 con 0x7f087c0b1f10 2023-10-06T02:24:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.069+0000 7f08637fe700 1 -- 172.21.15.37:0/2720489034 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0874013630 con 0x7f087c0b1f10 2023-10-06T02:24:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.069+0000 7f0880d2a700 1 -- 172.21.15.37:0/2720489034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087c0a6450 con 0x7f087c0b1f10 2023-10-06T02:24:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.070+0000 7f0880d2a700 1 -- 172.21.15.37:0/2720489034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f087c064b00 con 0x7f087c0b1f10 2023-10-06T02:24:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.070+0000 7f08637fe700 1 -- 172.21.15.37:0/2720489034 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0874003030 con 0x7f087c0b1f10 2023-10-06T02:24:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.071+0000 7f08637fe700 1 --2- 172.21.15.37:0/2720489034 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0868066f30 0x7f08680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.071+0000 7f08637fe700 1 -- 172.21.15.37:0/2720489034 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f0874083ed0 con 0x7f087c0b1f10 2023-10-06T02:24:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.071+0000 7f087b7fe700 1 --2- 172.21.15.37:0/2720489034 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0868066f30 0x7f08680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:41.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.071+0000 7f087b7fe700 1 --2- 172.21.15.37:0/2720489034 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0868066f30 0x7f08680693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f086c006f00 tx=0x7f086c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:41.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.075+0000 7f08637fe700 1 -- 172.21.15.37:0/2720489034 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0874051140 con 0x7f087c0b1f10 2023-10-06T02:24:41.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.267+0000 7f0880d2a700 1 -- 172.21.15.37:0/2720489034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f087c0c6370 con 0x7f087c0b1f10 2023-10-06T02:24:41.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.921+0000 7f08637fe700 1 -- 172.21.15.37:0/2720489034 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0874054760 con 0x7f087c0b1f10 2023-10-06T02:24:41.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.924+0000 7f0880d2a700 1 -- 172.21.15.37:0/2720489034 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0868066f30 msgr2=0x7f08680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.924+0000 7f0880d2a700 1 --2- 172.21.15.37:0/2720489034 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0868066f30 0x7f08680693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f086c006f00 tx=0x7f086c008040 comp rx=0 tx=0).stop 2023-10-06T02:24:41.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.924+0000 7f0880d2a700 1 -- 172.21.15.37:0/2720489034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f087c0b1f10 msgr2=0x7f087c0b2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:41.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.924+0000 7f0880d2a700 1 --2- 172.21.15.37:0/2720489034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f087c0b1f10 0x7f087c0b2390 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f087c06f4c0 tx=0x7f0874009040 comp rx=0 tx=0).stop 2023-10-06T02:24:41.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.925+0000 7f0880d2a700 1 -- 172.21.15.37:0/2720489034 shutdown_connections 2023-10-06T02:24:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.925+0000 7f0880d2a700 1 --2- 172.21.15.37:0/2720489034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f087c0b1f10 0x7f087c0b2390 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.925+0000 7f0880d2a700 1 --2- 172.21.15.37:0/2720489034 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0868066f30 0x7f08680693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.925+0000 7f0880d2a700 1 --2- 172.21.15.37:0/2720489034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0864004810 0x7f087c16b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.925+0000 7f0880d2a700 1 --2- 172.21.15.37:0/2720489034 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f087c0c5940 0x7f087c13e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.925+0000 7f0880d2a700 1 -- 172.21.15.37:0/2720489034 >> 172.21.15.37:0/2720489034 conn(0x7f087c06d1c0 msgr2=0x7f087c15a150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.925+0000 7f0880d2a700 1 -- 172.21.15.37:0/2720489034 shutdown_connections 2023-10-06T02:24:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:41.925+0000 7f0880d2a700 1 -- 172.21.15.37:0/2720489034 wait complete. 2023-10-06T02:24:41.927 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-10-06T02:24:41.939 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:24:42.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.062+0000 7fdc126ac700 1 Processor -- start 2023-10-06T02:24:42.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.062+0000 7fdc126ac700 1 -- start start 2023-10-06T02:24:42.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.063+0000 7fdc126ac700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fdc0c159670 0x7fdc0c0b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:42.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.063+0000 7fdc126ac700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc0c0ce700 0x7fdc0c0b3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:42.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.063+0000 7fdc126ac700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0c0cef20 con 0x7fdc0c0b3bb0 2023-10-06T02:24:42.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.063+0000 7fdc126ac700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc0c0b4b30 con 0x7fdc0c159670 2023-10-06T02:24:42.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.063+0000 7fdc126ac700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c0b4030 con 0x7fdc0c0ce700 2023-10-06T02:24:42.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.063+0000 7fdc116aa700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fdc0c159670 0x7fdc0c0b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:42.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.063+0000 7fdc10ea9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc0c0ce700 0x7fdc0c0b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:42.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.063+0000 7fdc11eab700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fdc0c0b3bb0 0x7fdc0c0aa560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:42644/0 (socket says 172.21.15.37:42644) 2023-10-06T02:24:42.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.063+0000 7fdc11eab700 1 -- 172.21.15.37:0/960064060 learned_addr learned my addr 172.21.15.37:0/960064060 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:42.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.064+0000 7fdc03fff700 1 -- 172.21.15.37:0/960064060 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214846720 0 0) 0x7fdc0c0cef20 con 0x7fdc0c0b3bb0 2023-10-06T02:24:42.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.064+0000 7fdc03fff700 1 -- 172.21.15.37:0/960064060 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbf8003570 con 0x7fdc0c0b3bb0 2023-10-06T02:24:42.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.064+0000 7fdc10ea9700 1 -- 172.21.15.37:0/960064060 >> v2:172.21.15.191:3300/0 conn(0x7fdc0c159670 msgr2=0x7fdc0c0b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:42.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.064+0000 7fdc10ea9700 1 --2- 172.21.15.37:0/960064060 >> v2:172.21.15.191:3300/0 conn(0x7fdc0c159670 0x7fdc0c0b45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.064+0000 7fdc10ea9700 1 -- 172.21.15.37:0/960064060 >> v1:172.21.15.191:6789/0 conn(0x7fdc0c0b3bb0 legacy=0x7fdc0c0aa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:42.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.064+0000 7fdc10ea9700 1 -- 172.21.15.37:0/960064060 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c0cf200 con 0x7fdc0c0ce700 2023-10-06T02:24:42.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.064+0000 7fdc116aa700 1 --2- 172.21.15.37:0/960064060 >> v2:172.21.15.191:3300/0 conn(0x7fdc0c159670 0x7fdc0c0b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:24:42.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.064+0000 7fdc10ea9700 1 --2- 172.21.15.37:0/960064060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc0c0ce700 0x7fdc0c0b3670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0098e0 tx=0x7fdbfc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7911aaf3099787ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:42.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.064+0000 7fdc03fff700 1 -- 172.21.15.37:0/960064060 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc011630 con 0x7fdc0c0ce700 2023-10-06T02:24:42.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.064+0000 7fdc03fff700 1 -- 172.21.15.37:0/960064060 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbfc011790 con 0x7fdc0c0ce700 2023-10-06T02:24:42.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.064+0000 7fdc03fff700 1 -- 172.21.15.37:0/960064060 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc011b30 con 0x7fdc0c0ce700 2023-10-06T02:24:42.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.065+0000 7fdc126ac700 1 -- 172.21.15.37:0/960064060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc0c0ce700 msgr2=0x7fdc0c0b3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:42.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.065+0000 7fdc126ac700 1 --2- 172.21.15.37:0/960064060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc0c0ce700 0x7fdc0c0b3670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0098e0 tx=0x7fdbfc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.065+0000 7fdc126ac700 1 -- 172.21.15.37:0/960064060 shutdown_connections 2023-10-06T02:24:42.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.065+0000 7fdc126ac700 1 --2- 172.21.15.37:0/960064060 >> v2:172.21.15.191:3300/0 conn(0x7fdc0c159670 0x7fdc0c0b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.065+0000 7fdc126ac700 1 --2- 172.21.15.37:0/960064060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc0c0ce700 0x7fdc0c0b3670 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.065+0000 7fdc126ac700 1 -- 172.21.15.37:0/960064060 >> 172.21.15.37:0/960064060 conn(0x7fdc0c099610 msgr2=0x7fdc0c06c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:42.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.065+0000 7fdc126ac700 1 -- 172.21.15.37:0/960064060 shutdown_connections 2023-10-06T02:24:42.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.065+0000 7fdc126ac700 1 -- 172.21.15.37:0/960064060 wait complete. 2023-10-06T02:24:42.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.066+0000 7fdc126ac700 1 Processor -- start 2023-10-06T02:24:42.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.066+0000 7fdc126ac700 1 -- start start 2023-10-06T02:24:42.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.067+0000 7fdc126ac700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc0c0b3bb0 0x7fdc0c1559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:42.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.067+0000 7fdc126ac700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc0c0ce700 0x7fdc0c15c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:42.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.067+0000 7fdc126ac700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc0c159670 0x7fdc0c157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:42.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.067+0000 7fdc126ac700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c155f30 con 0x7fdc0c159670 2023-10-06T02:24:42.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.067+0000 7fdc126ac700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c15b490 con 0x7fdc0c0ce700 2023-10-06T02:24:42.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.067+0000 7fdc126ac700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c15a880 con 0x7fdc0c0b3bb0 2023-10-06T02:24:42.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.067+0000 7fdc11eab700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc0c159670 0x7fdc0c157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:42.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.067+0000 7fdc11eab700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc0c159670 0x7fdc0c157b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38530/0 (socket says 172.21.15.37:38530) 2023-10-06T02:24:42.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.067+0000 7fdc11eab700 1 -- 172.21.15.37:0/2133315665 learned_addr learned my addr 172.21.15.37:0/2133315665 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:42.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.067+0000 7fdc10ea9700 1 --2- 172.21.15.37:0/2133315665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc0c0ce700 0x7fdc0c15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:42.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.067+0000 7fdc116aa700 1 --2- 172.21.15.37:0/2133315665 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc0c0b3bb0 0x7fdc0c1559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:42.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.067+0000 7fdc11eab700 1 -- 172.21.15.37:0/2133315665 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc0c0b3bb0 msgr2=0x7fdc0c1559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:42.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.067+0000 7fdc11eab700 1 --2- 172.21.15.37:0/2133315665 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc0c0b3bb0 0x7fdc0c1559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.067+0000 7fdc11eab700 1 -- 172.21.15.37:0/2133315665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc0c0ce700 msgr2=0x7fdc0c15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:42.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.067+0000 7fdc11eab700 1 --2- 172.21.15.37:0/2133315665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc0c0ce700 0x7fdc0c15c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.067+0000 7fdc11eab700 1 -- 172.21.15.37:0/2133315665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc08009420 con 0x7fdc0c159670 2023-10-06T02:24:42.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.067+0000 7fdc10ea9700 1 --2- 172.21.15.37:0/2133315665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc0c0ce700 0x7fdc0c15c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:42.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.067+0000 7fdc11eab700 1 --2- 172.21.15.37:0/2133315665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc0c159670 0x7fdc0c157b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdc04001460 tx=0x7fdc04001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:42.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.067+0000 7fdc017fa700 1 -- 172.21.15.37:0/2133315665 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0400ce80 con 0x7fdc0c159670 2023-10-06T02:24:42.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.068+0000 7fdc017fa700 1 -- 172.21.15.37:0/2133315665 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0400ab70 con 0x7fdc0c159670 2023-10-06T02:24:42.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.068+0000 7fdc126ac700 1 -- 172.21.15.37:0/2133315665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbfc009420 con 0x7fdc0c159670 2023-10-06T02:24:42.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.068+0000 7fdc017fa700 1 -- 172.21.15.37:0/2133315665 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040070f0 con 0x7fdc0c159670 2023-10-06T02:24:42.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.068+0000 7fdc126ac700 1 -- 172.21.15.37:0/2133315665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0c15ae40 con 0x7fdc0c159670 2023-10-06T02:24:42.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.069+0000 7fdc126ac700 1 -- 172.21.15.37:0/2133315665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0c09bb60 con 0x7fdc0c159670 2023-10-06T02:24:42.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.069+0000 7fdc017fa700 1 -- 172.21.15.37:0/2133315665 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc040074e0 con 0x7fdc0c159670 2023-10-06T02:24:42.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.069+0000 7fdc017fa700 1 --2- 172.21.15.37:0/2133315665 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdbf0066f30 0x7fdbf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:42.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.069+0000 7fdc017fa700 1 -- 172.21.15.37:0/2133315665 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fdc04084880 con 0x7fdc0c159670 2023-10-06T02:24:42.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.069+0000 7fdc116aa700 1 --2- 172.21.15.37:0/2133315665 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdbf0066f30 0x7fdbf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:42.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.070+0000 7fdc116aa700 1 --2- 172.21.15.37:0/2133315665 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdbf0066f30 0x7fdbf00693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdc080093f0 tx=0x7fdc08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:42.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.074+0000 7fdc017fa700 1 -- 172.21.15.37:0/2133315665 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc0c09bb60 con 0x7fdc0c159670 2023-10-06T02:24:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.266+0000 7fdc126ac700 1 -- 172.21.15.37:0/2133315665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fdc0c09bb60 con 0x7fdc0c159670 2023-10-06T02:24:42.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.269+0000 7fdc017fa700 1 -- 172.21.15.37:0/2133315665 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdc0c09bb60 con 0x7fdc0c159670 2023-10-06T02:24:42.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.271+0000 7fdc126ac700 1 -- 172.21.15.37:0/2133315665 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdbf0066f30 msgr2=0x7fdbf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:42.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.271+0000 7fdc126ac700 1 --2- 172.21.15.37:0/2133315665 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdbf0066f30 0x7fdbf00693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdc080093f0 tx=0x7fdc08008040 comp rx=0 tx=0).stop 2023-10-06T02:24:42.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.271+0000 7fdc126ac700 1 -- 172.21.15.37:0/2133315665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc0c159670 msgr2=0x7fdc0c157b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:42.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.271+0000 7fdc126ac700 1 --2- 172.21.15.37:0/2133315665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc0c159670 0x7fdc0c157b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdc04001460 tx=0x7fdc04001ae0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.271+0000 7fdc126ac700 1 -- 172.21.15.37:0/2133315665 shutdown_connections 2023-10-06T02:24:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.271+0000 7fdc126ac700 1 --2- 172.21.15.37:0/2133315665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc0c159670 0x7fdc0c157b90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.271+0000 7fdc126ac700 1 --2- 172.21.15.37:0/2133315665 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc0c0b3bb0 0x7fdc0c1559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.271+0000 7fdc126ac700 1 --2- 172.21.15.37:0/2133315665 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdbf0066f30 0x7fdbf00693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.271+0000 7fdc126ac700 1 --2- 172.21.15.37:0/2133315665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc0c0ce700 0x7fdc0c15c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.271+0000 7fdc126ac700 1 -- 172.21.15.37:0/2133315665 >> 172.21.15.37:0/2133315665 conn(0x7fdc0c099610 msgr2=0x7fdc0c1588c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.272+0000 7fdc126ac700 1 -- 172.21.15.37:0/2133315665 shutdown_connections 2023-10-06T02:24:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.272+0000 7fdc126ac700 1 -- 172.21.15.37:0/2133315665 wait complete. 2023-10-06T02:24:42.289 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2023-10-06T02:24:42.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.408+0000 7f6e06a62700 1 Processor -- start 2023-10-06T02:24:42.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.408+0000 7f6e06a62700 1 -- start start 2023-10-06T02:24:42.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.409+0000 7f6e06a62700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e001596d0 0x7f6e000b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:42.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.409+0000 7f6e06a62700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6e000b3840 0x7f6e000c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:42.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.409+0000 7f6e06a62700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e000c5300 con 0x7f6e00159aa0 2023-10-06T02:24:42.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.409+0000 7f6e06a62700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e000c6160 con 0x7f6e000b3840 2023-10-06T02:24:42.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.409+0000 7f6e06a62700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e000c5550 con 0x7f6e001596d0 2023-10-06T02:24:42.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.409+0000 7f6e04fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6e00159aa0 0x7f6e000caba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36112/0 (socket says 172.21.15.37:36112) 2023-10-06T02:24:42.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.409+0000 7f6e04fff700 1 -- 172.21.15.37:0/2176576312 learned_addr learned my addr 172.21.15.37:0/2176576312 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:42.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.409+0000 7f6dff7fe700 1 --2- 172.21.15.37:0/2176576312 >> v2:172.21.15.191:3300/0 conn(0x7f6e000b3840 0x7f6e000c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:42.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.409+0000 7f6dfffff700 1 --2- 172.21.15.37:0/2176576312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e001596d0 0x7f6e000b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:42.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.409+0000 7f6dfeffd700 1 -- 172.21.15.37:0/2176576312 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821447718 0 0) 0x7f6e000c5300 con 0x7f6e00159aa0 2023-10-06T02:24:42.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.409+0000 7f6dfeffd700 1 -- 172.21.15.37:0/2176576312 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6de8003570 con 0x7f6e00159aa0 2023-10-06T02:24:42.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.409+0000 7f6dfeffd700 1 -- 172.21.15.37:0/2176576312 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 634183472 0 0) 0x7f6de8003570 con 0x7f6e00159aa0 2023-10-06T02:24:42.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.409+0000 7f6dfffff700 1 -- 172.21.15.37:0/2176576312 >> v2:172.21.15.191:3300/0 conn(0x7f6e000b3840 msgr2=0x7f6e000c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:42.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.409+0000 7f6dfffff700 1 --2- 172.21.15.37:0/2176576312 >> v2:172.21.15.191:3300/0 conn(0x7f6e000b3840 0x7f6e000c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.409+0000 7f6dfffff700 1 -- 172.21.15.37:0/2176576312 >> v1:172.21.15.37:6789/0 conn(0x7f6e00159aa0 legacy=0x7f6e000caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:42.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.409+0000 7f6dfffff700 1 -- 172.21.15.37:0/2176576312 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e000c5830 con 0x7f6e001596d0 2023-10-06T02:24:42.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.409+0000 7f6dff7fe700 1 --2- 172.21.15.37:0/2176576312 >> v2:172.21.15.191:3300/0 conn(0x7f6e000b3840 0x7f6e000c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:24:42.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.410+0000 7f6dfffff700 1 --2- 172.21.15.37:0/2176576312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e001596d0 0x7f6e000b3300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6df00098e0 tx=0x7f6df00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc77cf9149dc4312 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:42.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.410+0000 7f6dfeffd700 1 -- 172.21.15.37:0/2176576312 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df80017f0 con 0x7f6e001596d0 2023-10-06T02:24:42.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.410+0000 7f6dfeffd700 1 -- 172.21.15.37:0/2176576312 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df0011420 con 0x7f6e001596d0 2023-10-06T02:24:42.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.410+0000 7f6dfeffd700 1 -- 172.21.15.37:0/2176576312 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df00117c0 con 0x7f6e001596d0 2023-10-06T02:24:42.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.410+0000 7f6e06a62700 1 -- 172.21.15.37:0/2176576312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e001596d0 msgr2=0x7f6e000b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:42.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.410+0000 7f6e06a62700 1 --2- 172.21.15.37:0/2176576312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e001596d0 0x7f6e000b3300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6df00098e0 tx=0x7f6df00091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.410+0000 7f6e06a62700 1 -- 172.21.15.37:0/2176576312 shutdown_connections 2023-10-06T02:24:42.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.410+0000 7f6e06a62700 1 --2- 172.21.15.37:0/2176576312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e001596d0 0x7f6e000b3300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.410+0000 7f6e06a62700 1 --2- 172.21.15.37:0/2176576312 >> v2:172.21.15.191:3300/0 conn(0x7f6e000b3840 0x7f6e000c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.410+0000 7f6e06a62700 1 -- 172.21.15.37:0/2176576312 >> 172.21.15.37:0/2176576312 conn(0x7f6e0006c890 msgr2=0x7f6e000d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:42.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.410+0000 7f6e06a62700 1 -- 172.21.15.37:0/2176576312 shutdown_connections 2023-10-06T02:24:42.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.410+0000 7f6e06a62700 1 -- 172.21.15.37:0/2176576312 wait complete. 2023-10-06T02:24:42.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.411+0000 7f6e06a62700 1 Processor -- start 2023-10-06T02:24:42.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.412+0000 7f6e06a62700 1 -- start start 2023-10-06T02:24:42.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.412+0000 7f6e06a62700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e000b3840 0x7f6e00156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:42.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.412+0000 7f6e06a62700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e001596d0 0x7f6e00099fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:42.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.412+0000 7f6e06a62700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e00159aa0 0x7f6e0009d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:42.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.412+0000 7f6e06a62700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0009a4f0 con 0x7f6e000b3840 2023-10-06T02:24:42.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.412+0000 7f6e06a62700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0009b330 con 0x7f6e00159aa0 2023-10-06T02:24:42.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.412+0000 7f6e06a62700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0009a720 con 0x7f6e001596d0 2023-10-06T02:24:42.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.412+0000 7f6dfffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e000b3840 0x7f6e00156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:42.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.412+0000 7f6dfffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e000b3840 0x7f6e00156800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38546/0 (socket says 172.21.15.37:38546) 2023-10-06T02:24:42.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.413+0000 7f6dfffff700 1 -- 172.21.15.37:0/4246015908 learned_addr learned my addr 172.21.15.37:0/4246015908 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:42.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.413+0000 7f6dff7fe700 1 --2- 172.21.15.37:0/4246015908 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e001596d0 0x7f6e00099fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:42.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.413+0000 7f6e04fff700 1 --2- 172.21.15.37:0/4246015908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e00159aa0 0x7f6e0009d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:42.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.413+0000 7f6dfffff700 1 -- 172.21.15.37:0/4246015908 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e001596d0 msgr2=0x7f6e00099fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:42.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.413+0000 7f6dfffff700 1 --2- 172.21.15.37:0/4246015908 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e001596d0 0x7f6e00099fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.413+0000 7f6dfffff700 1 -- 172.21.15.37:0/4246015908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e00159aa0 msgr2=0x7f6e0009d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:42.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.413+0000 7f6dfffff700 1 --2- 172.21.15.37:0/4246015908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e00159aa0 0x7f6e0009d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.413+0000 7f6dfffff700 1 -- 172.21.15.37:0/4246015908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df4009420 con 0x7f6e000b3840 2023-10-06T02:24:42.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.413+0000 7f6dff7fe700 1 --2- 172.21.15.37:0/4246015908 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e001596d0 0x7f6e00099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.413+0000 7f6e04fff700 1 --2- 172.21.15.37:0/4246015908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e00159aa0 0x7f6e0009d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.413+0000 7f6dfffff700 1 --2- 172.21.15.37:0/4246015908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e000b3840 0x7f6e00156800 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6df00030c0 tx=0x7f6df0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.413+0000 7f6de7fff700 1 -- 172.21.15.37:0/4246015908 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df001cd60 con 0x7f6e000b3840 2023-10-06T02:24:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.413+0000 7f6de7fff700 1 -- 172.21.15.37:0/4246015908 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df001a450 con 0x7f6e000b3840 2023-10-06T02:24:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.413+0000 7f6e06a62700 1 -- 172.21.15.37:0/4246015908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df0009420 con 0x7f6e000b3840 2023-10-06T02:24:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.413+0000 7f6de7fff700 1 -- 172.21.15.37:0/4246015908 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df001a810 con 0x7f6e000b3840 2023-10-06T02:24:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.413+0000 7f6e06a62700 1 -- 172.21.15.37:0/4246015908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0009ace0 con 0x7f6e000b3840 2023-10-06T02:24:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.414+0000 7f6e06a62700 1 -- 172.21.15.37:0/4246015908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e0006fbf0 con 0x7f6e000b3840 2023-10-06T02:24:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.415+0000 7f6de7fff700 1 -- 172.21.15.37:0/4246015908 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6df001ac40 con 0x7f6e000b3840 2023-10-06T02:24:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.415+0000 7f6de7fff700 1 --2- 172.21.15.37:0/4246015908 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6dec066f30 0x7f6dec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.415+0000 7f6de7fff700 1 -- 172.21.15.37:0/4246015908 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f6df0085df0 con 0x7f6e000b3840 2023-10-06T02:24:42.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.415+0000 7f6dff7fe700 1 --2- 172.21.15.37:0/4246015908 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6dec066f30 0x7f6dec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:42.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.416+0000 7f6dff7fe700 1 --2- 172.21.15.37:0/4246015908 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6dec066f30 0x7f6dec0693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6df40093f0 tx=0x7f6df4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:42.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.419+0000 7f6de7fff700 1 -- 172.21.15.37:0/4246015908 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6df0053200 con 0x7f6e000b3840 2023-10-06T02:24:42.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.692+0000 7f6e06a62700 1 -- 172.21.15.37:0/4246015908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f6e000d13e0 con 0x7f6e000b3840 2023-10-06T02:24:42.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.921+0000 7f6de7fff700 1 -- 172.21.15.37:0/4246015908 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v92) v1 ==== 142+0+0 (secure 0 0 0) 0x7f6df0056820 con 0x7f6e000b3840 2023-10-06T02:24:42.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.924+0000 7f6e06a62700 1 -- 172.21.15.37:0/4246015908 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6dec066f30 msgr2=0x7f6dec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:42.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.924+0000 7f6e06a62700 1 --2- 172.21.15.37:0/4246015908 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6dec066f30 0x7f6dec0693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6df40093f0 tx=0x7f6df4008040 comp rx=0 tx=0).stop 2023-10-06T02:24:42.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.924+0000 7f6e06a62700 1 -- 172.21.15.37:0/4246015908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e000b3840 msgr2=0x7f6e00156800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.924+0000 7f6e06a62700 1 --2- 172.21.15.37:0/4246015908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e000b3840 0x7f6e00156800 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6df00030c0 tx=0x7f6df0016000 comp rx=0 tx=0).stop 2023-10-06T02:24:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.924+0000 7f6e06a62700 1 -- 172.21.15.37:0/4246015908 shutdown_connections 2023-10-06T02:24:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.924+0000 7f6e06a62700 1 --2- 172.21.15.37:0/4246015908 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6dec066f30 0x7f6dec0693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.924+0000 7f6e06a62700 1 --2- 172.21.15.37:0/4246015908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e00159aa0 0x7f6e0009d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.924+0000 7f6e06a62700 1 --2- 172.21.15.37:0/4246015908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e000b3840 0x7f6e00156800 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.924+0000 7f6e06a62700 1 --2- 172.21.15.37:0/4246015908 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e001596d0 0x7f6e00099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.924+0000 7f6e06a62700 1 -- 172.21.15.37:0/4246015908 >> 172.21.15.37:0/4246015908 conn(0x7f6e0006c890 msgr2=0x7f6e000b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.924+0000 7f6e06a62700 1 -- 172.21.15.37:0/4246015908 shutdown_connections 2023-10-06T02:24:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:42.924+0000 7f6e06a62700 1 -- 172.21.15.37:0/4246015908 wait complete. 2023-10-06T02:24:42.937 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2023-10-06T02:24:42.937 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2023-10-06T02:24:42.937 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-10-06T02:24:42.937 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2023-10-06T02:24:43.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.057+0000 7f0e831e8700 1 Processor -- start 2023-10-06T02:24:43.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.057+0000 7f0e831e8700 1 -- start start 2023-10-06T02:24:43.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.058+0000 7f0e831e8700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0e7c0b2270 0x7f0e7c159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:43.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.058+0000 7f0e831e8700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e7c0cb200 con 0x7f0e7c0b0620 2023-10-06T02:24:43.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.058+0000 7f0e831e8700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e7c0cb7c0 con 0x7f0e7c159370 2023-10-06T02:24:43.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.058+0000 7f0e831e8700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e7c0b5c00 con 0x7f0e7c0b2270 2023-10-06T02:24:43.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.058+0000 7f0e819e5700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0e7c0b0620 0x7f0e7c0cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36124/0 (socket says 172.21.15.37:36124) 2023-10-06T02:24:43.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.058+0000 7f0e819e5700 1 -- 172.21.15.37:0/1078349462 learned_addr learned my addr 172.21.15.37:0/1078349462 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:43.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e829e7700 1 --2- 172.21.15.37:0/1078349462 >> v2:172.21.15.191:3300/0 conn(0x7f0e7c0b2270 0x7f0e7c159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:43.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e811e4700 1 -- 172.21.15.37:0/1078349462 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000104238 0 0) 0x7f0e7c0cb200 con 0x7f0e7c0b0620 2023-10-06T02:24:43.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e811e4700 1 -- 172.21.15.37:0/1078349462 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e64003570 con 0x7f0e7c0b0620 2023-10-06T02:24:43.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e811e4700 1 -- 172.21.15.37:0/1078349462 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3413571288 0 0) 0x7f0e64003570 con 0x7f0e7c0b0620 2023-10-06T02:24:43.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e811e4700 1 -- 172.21.15.37:0/1078349462 >> v2:172.21.15.191:3300/0 conn(0x7f0e7c0b2270 msgr2=0x7f0e7c159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:43.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e811e4700 1 --2- 172.21.15.37:0/1078349462 >> v2:172.21.15.191:3300/0 conn(0x7f0e7c0b2270 0x7f0e7c159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:43.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e811e4700 1 -- 172.21.15.37:0/1078349462 >> v1:172.21.15.191:6789/0 conn(0x7f0e7c159370 legacy=0x7f0e7c0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:43.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e811e4700 1 -- 172.21.15.37:0/1078349462 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c0b2750 con 0x7f0e7c0b0620 2023-10-06T02:24:43.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e811e4700 1 -- 172.21.15.37:0/1078349462 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f0e70001470 con 0x7f0e7c0b0620 2023-10-06T02:24:43.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e811e4700 1 -- 172.21.15.37:0/1078349462 >> v1:172.21.15.37:6789/0 conn(0x7f0e7c0b0620 legacy=0x7f0e7c0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:43.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e811e4700 1 --2- 172.21.15.37:0/1078349462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e64003a60 0x7f0e64003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:43.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e811e4700 1 --2- 172.21.15.37:0/1078349462 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e64004810 0x7f0e64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:43.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e811e4700 1 --2- 172.21.15.37:0/1078349462 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e640051c0 0x7f0e6400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:43.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e811e4700 1 -- 172.21.15.37:0/1078349462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c0b5c00 con 0x7f0e64003a60 2023-10-06T02:24:43.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e811e4700 1 -- 172.21.15.37:0/1078349462 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6400c0d0 con 0x7f0e640051c0 2023-10-06T02:24:43.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e811e4700 1 -- 172.21.15.37:0/1078349462 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6400c290 con 0x7f0e64004810 2023-10-06T02:24:43.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e821e6700 1 --2- 172.21.15.37:0/1078349462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e64003a60 0x7f0e64003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:43.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e829e7700 1 --2- 172.21.15.37:0/1078349462 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e640051c0 0x7f0e6400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:43.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e819e5700 1 --2- 172.21.15.37:0/1078349462 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e64004810 0x7f0e64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:43.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e821e6700 1 -- 172.21.15.37:0/1078349462 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e64004810 msgr2=0x7f0e64004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:43.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e821e6700 1 --2- 172.21.15.37:0/1078349462 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e64004810 0x7f0e64004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:43.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e821e6700 1 -- 172.21.15.37:0/1078349462 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e640051c0 msgr2=0x7f0e6400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:43.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e821e6700 1 --2- 172.21.15.37:0/1078349462 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e640051c0 0x7f0e6400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:43.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e821e6700 1 -- 172.21.15.37:0/1078349462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e64003570 con 0x7f0e64003a60 2023-10-06T02:24:43.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.059+0000 7f0e829e7700 1 -- 172.21.15.37:0/1078349462 reap_dead start 2023-10-06T02:24:43.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.060+0000 7f0e821e6700 1 --2- 172.21.15.37:0/1078349462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e64003a60 0x7f0e64003e70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0e740018b0 tx=0x7f0e74007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5302426ca6a6149b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:43.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.060+0000 7f0e811e4700 1 -- 172.21.15.37:0/1078349462 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e74012420 con 0x7f0e64003a60 2023-10-06T02:24:43.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.060+0000 7f0e811e4700 1 -- 172.21.15.37:0/1078349462 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e740125a0 con 0x7f0e64003a60 2023-10-06T02:24:43.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.060+0000 7f0e811e4700 1 -- 172.21.15.37:0/1078349462 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e74012960 con 0x7f0e64003a60 2023-10-06T02:24:43.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.060+0000 7f0e831e8700 1 -- 172.21.15.37:0/1078349462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e64003a60 msgr2=0x7f0e64003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:43.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.060+0000 7f0e831e8700 1 --2- 172.21.15.37:0/1078349462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e64003a60 0x7f0e64003e70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0e740018b0 tx=0x7f0e74007d30 comp rx=0 tx=0).stop 2023-10-06T02:24:43.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.060+0000 7f0e831e8700 1 -- 172.21.15.37:0/1078349462 shutdown_connections 2023-10-06T02:24:43.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.060+0000 7f0e831e8700 1 --2- 172.21.15.37:0/1078349462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e64003a60 0x7f0e64003e70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:43.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.060+0000 7f0e831e8700 1 -- 172.21.15.37:0/1078349462 >> 172.21.15.37:0/1078349462 conn(0x7f0e7c06c0b0 msgr2=0x7f0e7c06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:43.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.060+0000 7f0e831e8700 1 -- 172.21.15.37:0/1078349462 shutdown_connections 2023-10-06T02:24:43.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.060+0000 7f0e831e8700 1 -- 172.21.15.37:0/1078349462 wait complete. 2023-10-06T02:24:43.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.061+0000 7f0e831e8700 1 Processor -- start 2023-10-06T02:24:43.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.062+0000 7f0e831e8700 1 -- start start 2023-10-06T02:24:43.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.062+0000 7f0e831e8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e64003a60 0x7f0e7c156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:43.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.062+0000 7f0e831e8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e7c16cf70 0x7f0e7c1699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.062+0000 7f0e831e8700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e7c169f00 0x7f0e7c0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.062+0000 7f0e831e8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c1572d0 con 0x7f0e7c16cf70 2023-10-06T02:24:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.062+0000 7f0e831e8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c0c9320 con 0x7f0e64003a60 2023-10-06T02:24:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.062+0000 7f0e831e8700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c16d4c0 con 0x7f0e7c169f00 2023-10-06T02:24:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.062+0000 7f0e819e5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e7c16cf70 0x7f0e7c1699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.062+0000 7f0e819e5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e7c16cf70 0x7f0e7c1699c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38574/0 (socket says 172.21.15.37:38574) 2023-10-06T02:24:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.062+0000 7f0e819e5700 1 -- 172.21.15.37:0/728578726 learned_addr learned my addr 172.21.15.37:0/728578726 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.062+0000 7f0e829e7700 1 --2- 172.21.15.37:0/728578726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e7c169f00 0x7f0e7c0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.062+0000 7f0e821e6700 1 --2- 172.21.15.37:0/728578726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e64003a60 0x7f0e7c156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.063+0000 7f0e819e5700 1 -- 172.21.15.37:0/728578726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e7c169f00 msgr2=0x7f0e7c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.063+0000 7f0e819e5700 1 --2- 172.21.15.37:0/728578726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e7c169f00 0x7f0e7c0ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.063+0000 7f0e819e5700 1 -- 172.21.15.37:0/728578726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e64003a60 msgr2=0x7f0e7c156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.063+0000 7f0e819e5700 1 --2- 172.21.15.37:0/728578726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e64003a60 0x7f0e7c156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.063+0000 7f0e819e5700 1 -- 172.21.15.37:0/728578726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c16d7a0 con 0x7f0e7c16cf70 2023-10-06T02:24:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.063+0000 7f0e819e5700 1 --2- 172.21.15.37:0/728578726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e7c16cf70 0x7f0e7c1699c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0e70007340 tx=0x7f0e70001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.063+0000 7f0e7a7fc700 1 -- 172.21.15.37:0/728578726 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70018030 con 0x7f0e7c16cf70 2023-10-06T02:24:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.063+0000 7f0e7a7fc700 1 -- 172.21.15.37:0/728578726 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e700115c0 con 0x7f0e7c16cf70 2023-10-06T02:24:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.063+0000 7f0e831e8700 1 -- 172.21.15.37:0/728578726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7c16da80 con 0x7f0e7c16cf70 2023-10-06T02:24:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.063+0000 7f0e7a7fc700 1 -- 172.21.15.37:0/728578726 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70011980 con 0x7f0e7c16cf70 2023-10-06T02:24:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.063+0000 7f0e831e8700 1 -- 172.21.15.37:0/728578726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7c0c4860 con 0x7f0e7c16cf70 2023-10-06T02:24:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.064+0000 7f0e831e8700 1 -- 172.21.15.37:0/728578726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7c0c94d0 con 0x7f0e7c16cf70 2023-10-06T02:24:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.065+0000 7f0e7a7fc700 1 -- 172.21.15.37:0/728578726 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e7001b070 con 0x7f0e7c16cf70 2023-10-06T02:24:43.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.065+0000 7f0e7a7fc700 1 --2- 172.21.15.37:0/728578726 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0e68066f60 0x7f0e68069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:43.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.065+0000 7f0e7a7fc700 1 -- 172.21.15.37:0/728578726 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f0e70019070 con 0x7f0e7c16cf70 2023-10-06T02:24:43.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.065+0000 7f0e821e6700 1 --2- 172.21.15.37:0/728578726 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0e68066f60 0x7f0e68069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:43.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.066+0000 7f0e821e6700 1 --2- 172.21.15.37:0/728578726 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0e68066f60 0x7f0e68069410 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0e74001010 tx=0x7f0e74015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:43.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.069+0000 7f0e7a7fc700 1 -- 172.21.15.37:0/728578726 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e7c0c94d0 con 0x7f0e7c16cf70 2023-10-06T02:24:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.340+0000 7f0e831e8700 1 -- 172.21.15.37:0/728578726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7f0e7c0645f0 con 0x7f0e7c16cf70 2023-10-06T02:24:43.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.925+0000 7f0e7a7fc700 1 -- 172.21.15.37:0/728578726 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v93) v1 ==== 152+0+0 (secure 0 0 0) 0x7f0e70051490 con 0x7f0e7c16cf70 2023-10-06T02:24:43.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.928+0000 7f0e831e8700 1 -- 172.21.15.37:0/728578726 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0e68066f60 msgr2=0x7f0e68069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.928+0000 7f0e831e8700 1 --2- 172.21.15.37:0/728578726 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0e68066f60 0x7f0e68069410 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0e74001010 tx=0x7f0e74015000 comp rx=0 tx=0).stop 2023-10-06T02:24:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.928+0000 7f0e831e8700 1 -- 172.21.15.37:0/728578726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e7c16cf70 msgr2=0x7f0e7c1699c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.928+0000 7f0e831e8700 1 --2- 172.21.15.37:0/728578726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e7c16cf70 0x7f0e7c1699c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0e70007340 tx=0x7f0e70001e50 comp rx=0 tx=0).stop 2023-10-06T02:24:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.928+0000 7f0e831e8700 1 -- 172.21.15.37:0/728578726 shutdown_connections 2023-10-06T02:24:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.928+0000 7f0e831e8700 1 --2- 172.21.15.37:0/728578726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e7c169f00 0x7f0e7c0ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.928+0000 7f0e831e8700 1 --2- 172.21.15.37:0/728578726 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0e68066f60 0x7f0e68069410 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.928+0000 7f0e831e8700 1 --2- 172.21.15.37:0/728578726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e64003a60 0x7f0e7c156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.928+0000 7f0e831e8700 1 --2- 172.21.15.37:0/728578726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e7c16cf70 0x7f0e7c1699c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.928+0000 7f0e831e8700 1 -- 172.21.15.37:0/728578726 >> 172.21.15.37:0/728578726 conn(0x7f0e7c06c0b0 msgr2=0x7f0e7c0cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:43.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.928+0000 7f0e831e8700 1 -- 172.21.15.37:0/728578726 shutdown_connections 2023-10-06T02:24:43.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:43.928+0000 7f0e831e8700 1 -- 172.21.15.37:0/728578726 wait complete. 2023-10-06T02:24:43.943 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:24:44.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.071+0000 7f69bb178700 1 Processor -- start 2023-10-06T02:24:44.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.071+0000 7f69bb178700 1 -- start start 2023-10-06T02:24:44.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.072+0000 7f69bb178700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f69b4159670 0x7f69b40b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.072+0000 7f69bb178700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69b40ce700 0x7f69b40b3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.072+0000 7f69bb178700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f69b40b3bb0 0x7f69b40aa560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.072+0000 7f69bb178700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b40b4b30 con 0x7f69b4159670 2023-10-06T02:24:44.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.072+0000 7f69bb178700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b40b4030 con 0x7f69b40b3bb0 2023-10-06T02:24:44.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.072+0000 7f69bb178700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b40cef20 con 0x7f69b40ce700 2023-10-06T02:24:44.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.072+0000 7f69ba176700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f69b4159670 0x7f69b40b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.072+0000 7f69ba176700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f69b4159670 0x7f69b40b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38586/0 (socket says 172.21.15.37:38586) 2023-10-06T02:24:44.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.072+0000 7f69ba176700 1 -- 172.21.15.37:0/3971521810 learned_addr learned my addr 172.21.15.37:0/3971521810 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:44.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.072+0000 7f69b9975700 1 --2- 172.21.15.37:0/3971521810 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69b40ce700 0x7f69b40b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.072+0000 7f69ba977700 1 --2- 172.21.15.37:0/3971521810 >> v2:172.21.15.191:3300/0 conn(0x7f69b40b3bb0 0x7f69b40aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.072+0000 7f69ba176700 1 -- 172.21.15.37:0/3971521810 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69b40ce700 msgr2=0x7f69b40b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:44.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.072+0000 7f69ba176700 1 --2- 172.21.15.37:0/3971521810 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69b40ce700 0x7f69b40b3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.072+0000 7f69ba176700 1 -- 172.21.15.37:0/3971521810 >> v2:172.21.15.191:3300/0 conn(0x7f69b40b3bb0 msgr2=0x7f69b40aa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:44.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.072+0000 7f69ba176700 1 --2- 172.21.15.37:0/3971521810 >> v2:172.21.15.191:3300/0 conn(0x7f69b40b3bb0 0x7f69b40aa560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.072+0000 7f69ba176700 1 -- 172.21.15.37:0/3971521810 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b40cf200 con 0x7f69b4159670 2023-10-06T02:24:44.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.072+0000 7f69ba176700 1 --2- 172.21.15.37:0/3971521810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b4159670 0x7f69b40b45f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f69b415d250 tx=0x7f69ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02027fb3dc4b796 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:44.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.073+0000 7f69b9174700 1 -- 172.21.15.37:0/3971521810 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac00b820 con 0x7f69b4159670 2023-10-06T02:24:44.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.073+0000 7f69b9174700 1 -- 172.21.15.37:0/3971521810 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac00b980 con 0x7f69b4159670 2023-10-06T02:24:44.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.073+0000 7f69b9174700 1 -- 172.21.15.37:0/3971521810 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac00bd20 con 0x7f69b4159670 2023-10-06T02:24:44.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.073+0000 7f69bb178700 1 -- 172.21.15.37:0/3971521810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b4159670 msgr2=0x7f69b40b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.073+0000 7f69bb178700 1 --2- 172.21.15.37:0/3971521810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b4159670 0x7f69b40b45f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f69b415d250 tx=0x7f69ac009250 comp rx=0 tx=0).stop 2023-10-06T02:24:44.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.073+0000 7f69bb178700 1 -- 172.21.15.37:0/3971521810 shutdown_connections 2023-10-06T02:24:44.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.073+0000 7f69bb178700 1 --2- 172.21.15.37:0/3971521810 >> v2:172.21.15.191:3300/0 conn(0x7f69b40b3bb0 0x7f69b40aa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.073+0000 7f69bb178700 1 --2- 172.21.15.37:0/3971521810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b4159670 0x7f69b40b45f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.073+0000 7f69bb178700 1 --2- 172.21.15.37:0/3971521810 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69b40ce700 0x7f69b40b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.073+0000 7f69bb178700 1 -- 172.21.15.37:0/3971521810 >> 172.21.15.37:0/3971521810 conn(0x7f69b4099610 msgr2=0x7f69b406c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:44.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.073+0000 7f69bb178700 1 -- 172.21.15.37:0/3971521810 shutdown_connections 2023-10-06T02:24:44.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.073+0000 7f69bb178700 1 -- 172.21.15.37:0/3971521810 wait complete. 2023-10-06T02:24:44.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.074+0000 7f69bb178700 1 Processor -- start 2023-10-06T02:24:44.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.074+0000 7f69bb178700 1 -- start start 2023-10-06T02:24:44.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.075+0000 7f69bb178700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b40b3bb0 0x7f69b40c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.075+0000 7f69bb178700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69b40ce700 0x7f69b409bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.075+0000 7f69bb178700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69b4159670 0x7f69b409c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.075+0000 7f69bb178700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b409db80 con 0x7f69b40b3bb0 2023-10-06T02:24:44.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.075+0000 7f69bb178700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b409c640 con 0x7f69b4159670 2023-10-06T02:24:44.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.075+0000 7f69bb178700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b409c920 con 0x7f69b40ce700 2023-10-06T02:24:44.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.075+0000 7f69ba176700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b40b3bb0 0x7f69b40c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.075+0000 7f69ba176700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b40b3bb0 0x7f69b40c58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38592/0 (socket says 172.21.15.37:38592) 2023-10-06T02:24:44.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.075+0000 7f69ba176700 1 -- 172.21.15.37:0/1107181807 learned_addr learned my addr 172.21.15.37:0/1107181807 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:44.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.075+0000 7f69b9975700 1 --2- 172.21.15.37:0/1107181807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69b40ce700 0x7f69b409bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.075+0000 7f69ba977700 1 --2- 172.21.15.37:0/1107181807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69b4159670 0x7f69b409c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.076+0000 7f69ba176700 1 -- 172.21.15.37:0/1107181807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69b40ce700 msgr2=0x7f69b409bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.076+0000 7f69ba176700 1 --2- 172.21.15.37:0/1107181807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69b40ce700 0x7f69b409bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.076+0000 7f69ba176700 1 -- 172.21.15.37:0/1107181807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69b4159670 msgr2=0x7f69b409c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.076+0000 7f69ba176700 1 --2- 172.21.15.37:0/1107181807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69b4159670 0x7f69b409c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.076+0000 7f69ba176700 1 -- 172.21.15.37:0/1107181807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ac0094f0 con 0x7f69b40b3bb0 2023-10-06T02:24:44.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.076+0000 7f69ba176700 1 --2- 172.21.15.37:0/1107181807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b40b3bb0 0x7f69b40c58d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f69ac0094c0 tx=0x7f69ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:44.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.076+0000 7f69b27fc700 1 -- 172.21.15.37:0/1107181807 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac024440 con 0x7f69b40b3bb0 2023-10-06T02:24:44.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.076+0000 7f69b27fc700 1 -- 172.21.15.37:0/1107181807 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac0245c0 con 0x7f69b40b3bb0 2023-10-06T02:24:44.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.076+0000 7f69bb178700 1 -- 172.21.15.37:0/1107181807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b409cc00 con 0x7f69b40b3bb0 2023-10-06T02:24:44.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.076+0000 7f69b27fc700 1 -- 172.21.15.37:0/1107181807 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac024980 con 0x7f69b40b3bb0 2023-10-06T02:24:44.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.076+0000 7f69bb178700 1 -- 172.21.15.37:0/1107181807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b409d1c0 con 0x7f69b40b3bb0 2023-10-06T02:24:44.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.077+0000 7f69bb178700 1 -- 172.21.15.37:0/1107181807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b40884f0 con 0x7f69b40b3bb0 2023-10-06T02:24:44.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.077+0000 7f69b27fc700 1 -- 172.21.15.37:0/1107181807 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69ac01a420 con 0x7f69b40b3bb0 2023-10-06T02:24:44.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.077+0000 7f69b27fc700 1 --2- 172.21.15.37:0/1107181807 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f69a0066f30 0x7f69a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.078+0000 7f69b27fc700 1 -- 172.21.15.37:0/1107181807 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f69ac086090 con 0x7f69b40b3bb0 2023-10-06T02:24:44.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.078+0000 7f69b9975700 1 --2- 172.21.15.37:0/1107181807 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f69a0066f30 0x7f69a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.078+0000 7f69b9975700 1 --2- 172.21.15.37:0/1107181807 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f69a0066f30 0x7f69a00693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f69b416d300 tx=0x7f69a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:44.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.082+0000 7f69b27fc700 1 -- 172.21.15.37:0/1107181807 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69ac0534a0 con 0x7f69b40b3bb0 2023-10-06T02:24:44.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.275+0000 7f69bb178700 1 -- 172.21.15.37:0/1107181807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f69b409d3b0 con 0x7f69b40b3bb0 2023-10-06T02:24:44.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.281+0000 7f69b27fc700 1 -- 172.21.15.37:0/1107181807 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f69ac056ac0 con 0x7f69b40b3bb0 2023-10-06T02:24:44.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.283+0000 7f69bb178700 1 -- 172.21.15.37:0/1107181807 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f69a0066f30 msgr2=0x7f69a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.283+0000 7f69bb178700 1 --2- 172.21.15.37:0/1107181807 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f69a0066f30 0x7f69a00693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f69b416d300 tx=0x7f69a8008040 comp rx=0 tx=0).stop 2023-10-06T02:24:44.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.283+0000 7f69bb178700 1 -- 172.21.15.37:0/1107181807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b40b3bb0 msgr2=0x7f69b40c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.283+0000 7f69bb178700 1 --2- 172.21.15.37:0/1107181807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b40b3bb0 0x7f69b40c58d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f69ac0094c0 tx=0x7f69ac017000 comp rx=0 tx=0).stop 2023-10-06T02:24:44.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.283+0000 7f69bb178700 1 -- 172.21.15.37:0/1107181807 shutdown_connections 2023-10-06T02:24:44.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.283+0000 7f69bb178700 1 --2- 172.21.15.37:0/1107181807 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f69a0066f30 0x7f69a00693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.283+0000 7f69bb178700 1 --2- 172.21.15.37:0/1107181807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69b4159670 0x7f69b409c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.283+0000 7f69bb178700 1 --2- 172.21.15.37:0/1107181807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b40b3bb0 0x7f69b40c58d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.283+0000 7f69bb178700 1 --2- 172.21.15.37:0/1107181807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69b40ce700 0x7f69b409bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.283+0000 7f69bb178700 1 -- 172.21.15.37:0/1107181807 >> 172.21.15.37:0/1107181807 conn(0x7f69b4099610 msgr2=0x7f69b40b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.283+0000 7f69bb178700 1 -- 172.21.15.37:0/1107181807 shutdown_connections 2023-10-06T02:24:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.283+0000 7f69bb178700 1 -- 172.21.15.37:0/1107181807 wait complete. 2023-10-06T02:24:44.295 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:24:44.295 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:24:44.332 DEBUG:teuthology.orchestra.run.smithi191:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:24:44.377 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:24:44.377 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:24:44.377 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:44.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.496+0000 7f2cf5fcc700 1 Processor -- start 2023-10-06T02:24:44.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.496+0000 7f2cf5fcc700 1 -- start start 2023-10-06T02:24:44.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.497+0000 7f2cf5fcc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2cf0159370 0x7f2cf0159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.497+0000 7f2cf5fcc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2cf00b0620 0x7f2cf015db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.497+0000 7f2cf5fcc700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf00cb200 con 0x7f2cf00b2270 2023-10-06T02:24:44.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.497+0000 7f2cf5fcc700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf00b5c00 con 0x7f2cf00b0620 2023-10-06T02:24:44.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.497+0000 7f2cf5fcc700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf00cb7c0 con 0x7f2cf0159370 2023-10-06T02:24:44.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.497+0000 7f2cf57cb700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2cf00b0620 0x7f2cf015db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.497+0000 7f2ceffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2cf00b2270 0x7f2cf00aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36126/0 (socket says 172.21.15.37:36126) 2023-10-06T02:24:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.497+0000 7f2ceffff700 1 -- 172.21.15.37:0/1957311632 learned_addr learned my addr 172.21.15.37:0/1957311632 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.497+0000 7f2cf57cb700 1 -- 172.21.15.37:0/1957311632 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2cf0159370 msgr2=0x7f2cf0159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.497+0000 7f2cf4fca700 1 --2- 172.21.15.37:0/1957311632 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2cf0159370 0x7f2cf0159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.497+0000 7f2cef7fe700 1 -- 172.21.15.37:0/1957311632 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488750770 0 0) 0x7f2cf00cb200 con 0x7f2cf00b2270 2023-10-06T02:24:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.497+0000 7f2cf57cb700 1 --2- 172.21.15.37:0/1957311632 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2cf0159370 0x7f2cf0159740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.497+0000 7f2cf57cb700 1 -- 172.21.15.37:0/1957311632 >> v1:172.21.15.37:6789/0 conn(0x7f2cf00b2270 legacy=0x7f2cf00aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.497+0000 7f2cf57cb700 1 -- 172.21.15.37:0/1957311632 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf015e0d0 con 0x7f2cf00b0620 2023-10-06T02:24:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.498+0000 7f2cf57cb700 1 --2- 172.21.15.37:0/1957311632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cf00b0620 0x7f2cf015db90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8009e90 tx=0x7f2ce8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f6691dbd05c756 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.498+0000 7f2cef7fe700 1 -- 172.21.15.37:0/1957311632 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce800e070 con 0x7f2cf00b0620 2023-10-06T02:24:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.498+0000 7f2cef7fe700 1 -- 172.21.15.37:0/1957311632 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce800bbf0 con 0x7f2cf00b0620 2023-10-06T02:24:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.498+0000 7f2cef7fe700 1 -- 172.21.15.37:0/1957311632 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8012430 con 0x7f2cf00b0620 2023-10-06T02:24:44.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.498+0000 7f2cf5fcc700 1 -- 172.21.15.37:0/1957311632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cf00b0620 msgr2=0x7f2cf015db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.498+0000 7f2cf5fcc700 1 --2- 172.21.15.37:0/1957311632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cf00b0620 0x7f2cf015db90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8009e90 tx=0x7f2ce8009780 comp rx=0 tx=0).stop 2023-10-06T02:24:44.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.498+0000 7f2cf5fcc700 1 -- 172.21.15.37:0/1957311632 shutdown_connections 2023-10-06T02:24:44.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.498+0000 7f2cf5fcc700 1 --2- 172.21.15.37:0/1957311632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cf00b0620 0x7f2cf015db90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.498+0000 7f2cf5fcc700 1 --2- 172.21.15.37:0/1957311632 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2cf0159370 0x7f2cf0159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.498+0000 7f2cf5fcc700 1 -- 172.21.15.37:0/1957311632 >> 172.21.15.37:0/1957311632 conn(0x7f2cf006c0b0 msgr2=0x7f2cf006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:44.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.498+0000 7f2cf5fcc700 1 -- 172.21.15.37:0/1957311632 shutdown_connections 2023-10-06T02:24:44.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.498+0000 7f2cf5fcc700 1 -- 172.21.15.37:0/1957311632 wait complete. 2023-10-06T02:24:44.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.499+0000 7f2cf5fcc700 1 Processor -- start 2023-10-06T02:24:44.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.500+0000 7f2cf5fcc700 1 -- start start 2023-10-06T02:24:44.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.500+0000 7f2cf5fcc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2cf00b0620 0x7f2cf00c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.500+0000 7f2cf5fcc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cf00b2270 0x7f2cf015a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.500+0000 7f2cf5fcc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cf0159370 0x7f2cf00cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.500+0000 7f2cf5fcc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf015ac40 con 0x7f2cf00b2270 2023-10-06T02:24:44.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.500+0000 7f2cf5fcc700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf00c8b60 con 0x7f2cf0159370 2023-10-06T02:24:44.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.500+0000 7f2cf5fcc700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf015a960 con 0x7f2cf00b0620 2023-10-06T02:24:44.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.500+0000 7f2ceffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cf00b2270 0x7f2cf015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.501+0000 7f2ceffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cf00b2270 0x7f2cf015a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38610/0 (socket says 172.21.15.37:38610) 2023-10-06T02:24:44.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.501+0000 7f2ceffff700 1 -- 172.21.15.37:0/1790830124 learned_addr learned my addr 172.21.15.37:0/1790830124 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:44.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.501+0000 7f2cf57cb700 1 --2- 172.21.15.37:0/1790830124 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cf0159370 0x7f2cf00cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.501+0000 7f2cf4fca700 1 --2- 172.21.15.37:0/1790830124 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2cf00b0620 0x7f2cf00c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.501+0000 7f2ceffff700 1 -- 172.21.15.37:0/1790830124 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2cf00b0620 msgr2=0x7f2cf00c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.501+0000 7f2ceffff700 1 --2- 172.21.15.37:0/1790830124 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2cf00b0620 0x7f2cf00c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.501+0000 7f2ceffff700 1 -- 172.21.15.37:0/1790830124 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cf0159370 msgr2=0x7f2cf00cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.501+0000 7f2ceffff700 1 --2- 172.21.15.37:0/1790830124 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cf0159370 0x7f2cf00cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.501+0000 7f2ceffff700 1 -- 172.21.15.37:0/1790830124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce8009a20 con 0x7f2cf00b2270 2023-10-06T02:24:44.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.501+0000 7f2cf4fca700 1 --2- 172.21.15.37:0/1790830124 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2cf00b0620 0x7f2cf00c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:44.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.501+0000 7f2ceffff700 1 --2- 172.21.15.37:0/1790830124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cf00b2270 0x7f2cf015a100 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400c840 tx=0x7f2ce4007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:44.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.501+0000 7f2cecff9700 1 -- 172.21.15.37:0/1790830124 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4005c00 con 0x7f2cf00b2270 2023-10-06T02:24:44.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.501+0000 7f2cecff9700 1 -- 172.21.15.37:0/1790830124 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce4005d60 con 0x7f2cf00b2270 2023-10-06T02:24:44.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.501+0000 7f2cf5fcc700 1 -- 172.21.15.37:0/1790830124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf00c8510 con 0x7f2cf00b2270 2023-10-06T02:24:44.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.501+0000 7f2cecff9700 1 -- 172.21.15.37:0/1790830124 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce40072e0 con 0x7f2cf00b2270 2023-10-06T02:24:44.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.501+0000 7f2cf5fcc700 1 -- 172.21.15.37:0/1790830124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf00c42d0 con 0x7f2cf00b2270 2023-10-06T02:24:44.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.502+0000 7f2cf5fcc700 1 -- 172.21.15.37:0/1790830124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf0064b00 con 0x7f2cf00b2270 2023-10-06T02:24:44.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.503+0000 7f2cecff9700 1 -- 172.21.15.37:0/1790830124 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ce401b3b0 con 0x7f2cf00b2270 2023-10-06T02:24:44.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.503+0000 7f2cecff9700 1 --2- 172.21.15.37:0/1790830124 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2cdc066f30 0x7f2cdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.503+0000 7f2cecff9700 1 -- 172.21.15.37:0/1790830124 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f2ce40837e0 con 0x7f2cf00b2270 2023-10-06T02:24:44.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.503+0000 7f2cf4fca700 1 --2- 172.21.15.37:0/1790830124 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2cdc066f30 0x7f2cdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.504+0000 7f2cf4fca700 1 --2- 172.21.15.37:0/1790830124 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2cdc066f30 0x7f2cdc0693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0006fd0 tx=0x7f2ce0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:44.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.507+0000 7f2cecff9700 1 -- 172.21.15.37:0/1790830124 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ce404b5a0 con 0x7f2cf00b2270 2023-10-06T02:24:44.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.745+0000 7f2cf5fcc700 1 -- 172.21.15.37:0/1790830124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2cf00c8ca0 con 0x7f2cf00b2270 2023-10-06T02:24:44.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.746+0000 7f2cecff9700 1 -- 172.21.15.37:0/1790830124 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f2ce4017090 con 0x7f2cf00b2270 2023-10-06T02:24:44.747 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:44.747 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1320242500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1320242500},{"type":"v1","addr":"172.21.15.37:6835","nonce":1320242500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4900,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/3862379925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3862379925},{"type":"v1","addr":"172.21.15.191:6836","nonce":3862379925}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1922753638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":1922753638},{"type":"v1","addr":"172.21.15.191:6837","nonce":1922753638}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/282737096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":282737096},{"type":"v1","addr":"172.21.15.37:6834","nonce":282737096}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2023-10-06T02:24:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.748+0000 7f2cf5fcc700 1 -- 172.21.15.37:0/1790830124 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2cdc066f30 msgr2=0x7f2cdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.748+0000 7f2cf5fcc700 1 --2- 172.21.15.37:0/1790830124 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2cdc066f30 0x7f2cdc0693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0006fd0 tx=0x7f2ce0008040 comp rx=0 tx=0).stop 2023-10-06T02:24:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.748+0000 7f2cf5fcc700 1 -- 172.21.15.37:0/1790830124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cf00b2270 msgr2=0x7f2cf015a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.748+0000 7f2cf5fcc700 1 --2- 172.21.15.37:0/1790830124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cf00b2270 0x7f2cf015a100 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400c840 tx=0x7f2ce4007db0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.748+0000 7f2cf5fcc700 1 -- 172.21.15.37:0/1790830124 shutdown_connections 2023-10-06T02:24:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.748+0000 7f2cf5fcc700 1 --2- 172.21.15.37:0/1790830124 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2cdc066f30 0x7f2cdc0693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.748+0000 7f2cf5fcc700 1 --2- 172.21.15.37:0/1790830124 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2cf0159370 0x7f2cf00cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.748+0000 7f2cf5fcc700 1 --2- 172.21.15.37:0/1790830124 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2cf00b0620 0x7f2cf00c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.748+0000 7f2cf5fcc700 1 --2- 172.21.15.37:0/1790830124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cf00b2270 0x7f2cf015a100 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.748+0000 7f2cf5fcc700 1 -- 172.21.15.37:0/1790830124 >> 172.21.15.37:0/1790830124 conn(0x7f2cf006c0b0 msgr2=0x7f2cf00b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.748+0000 7f2cf5fcc700 1 -- 172.21.15.37:0/1790830124 shutdown_connections 2023-10-06T02:24:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.748+0000 7f2cf5fcc700 1 -- 172.21.15.37:0/1790830124 wait complete. 2023-10-06T02:24:44.750 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 18 2023-10-06T02:24:44.760 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:24:44.761 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:24:44.761 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:24:44.761 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:24:44.761 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:24:44.761 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:24:44.762 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:24:44.762 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:24:44.762 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:24:44.762 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:24:44.762 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:24:44.762 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:24:44.762 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:24:44.763 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:24:44.763 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:24:44.763 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:24:44.770 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:24:44.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:24:44.771 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:24:44.772 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:24:44.774 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:24:44.774 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:24:44.775 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:24:44.775 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:24:44.814 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:24:44.814 DEBUG:teuthology.parallel:result is None 2023-10-06T02:24:44.815 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:24:44.815 DEBUG:teuthology.parallel:result is None 2023-10-06T02:24:44.817 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:24:44.817 DEBUG:teuthology.parallel:result is None 2023-10-06T02:24:44.817 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:24:44.818 DEBUG:teuthology.parallel:result is None 2023-10-06T02:24:44.818 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:24:44.889 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-10-06T02:24:44.889 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-10-06T02:24:44.896 INFO:tasks.ceph.mds.b.smithi191.stdout:starting mds.b at 2023-10-06T02:24:44.896 INFO:tasks.ceph.mds.d.smithi191.stdout:starting mds.d at 2023-10-06T02:24:44.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.945+0000 7fc63fbe8700 1 Processor -- start 2023-10-06T02:24:44.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.945+0000 7fc63fbe8700 1 -- start start 2023-10-06T02:24:44.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.946+0000 7fc63fbe8700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc6380b2b40 0x7fc6380c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.946+0000 7fc63fbe8700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc63806c0b0 0x7fc63806c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.946+0000 7fc63fbe8700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6380ca2a0 con 0x7fc638159c50 2023-10-06T02:24:44.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.946+0000 7fc63fbe8700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63815a020 con 0x7fc6380b2b40 2023-10-06T02:24:44.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.946+0000 7fc63fbe8700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63815a290 con 0x7fc63806c0b0 2023-10-06T02:24:44.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.946+0000 7fc63d183700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc6380b2b40 0x7fc6380c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.946+0000 7fc63d984700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc638159c50 0x7fc63806a570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36130/0 (socket says 172.21.15.37:36130) 2023-10-06T02:24:44.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.946+0000 7fc63d984700 1 -- 172.21.15.37:0/1815977290 learned_addr learned my addr 172.21.15.37:0/1815977290 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:44.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.946+0000 7fc63e185700 1 --2- 172.21.15.37:0/1815977290 >> v2:172.21.15.191:3300/0 conn(0x7fc63806c0b0 0x7fc63806c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.947+0000 7fc63d183700 1 -- 172.21.15.37:0/1815977290 >> v2:172.21.15.191:3300/0 conn(0x7fc63806c0b0 msgr2=0x7fc63806c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:44.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.947+0000 7fc63d183700 1 --2- 172.21.15.37:0/1815977290 >> v2:172.21.15.191:3300/0 conn(0x7fc63806c0b0 0x7fc63806c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.947+0000 7fc63d183700 1 -- 172.21.15.37:0/1815977290 >> v1:172.21.15.37:6789/0 conn(0x7fc638159c50 legacy=0x7fc63806a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.947+0000 7fc63d183700 1 -- 172.21.15.37:0/1815977290 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6380ca580 con 0x7fc6380b2b40 2023-10-06T02:24:44.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.947+0000 7fc63c982700 1 -- 172.21.15.37:0/1815977290 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096729894 0 0) 0x7fc6380ca2a0 con 0x7fc638159c50 2023-10-06T02:24:44.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.947+0000 7fc63d183700 1 --2- 172.21.15.37:0/1815977290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6380b2b40 0x7fc6380c9c10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc638063cf0 tx=0x7fc6280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785d4d9b09b08383 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:44.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.947+0000 7fc63c982700 1 -- 172.21.15.37:0/1815977290 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc628011630 con 0x7fc6380b2b40 2023-10-06T02:24:44.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.947+0000 7fc63c982700 1 -- 172.21.15.37:0/1815977290 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc628011790 con 0x7fc6380b2b40 2023-10-06T02:24:44.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.947+0000 7fc63c982700 1 -- 172.21.15.37:0/1815977290 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc628011b30 con 0x7fc6380b2b40 2023-10-06T02:24:44.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.948+0000 7fc63fbe8700 1 -- 172.21.15.37:0/1815977290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6380b2b40 msgr2=0x7fc6380c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.948+0000 7fc63fbe8700 1 --2- 172.21.15.37:0/1815977290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6380b2b40 0x7fc6380c9c10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc638063cf0 tx=0x7fc6280091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.948+0000 7fc63fbe8700 1 -- 172.21.15.37:0/1815977290 shutdown_connections 2023-10-06T02:24:44.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.948+0000 7fc63fbe8700 1 --2- 172.21.15.37:0/1815977290 >> v2:172.21.15.191:3300/0 conn(0x7fc63806c0b0 0x7fc63806c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.948+0000 7fc63fbe8700 1 --2- 172.21.15.37:0/1815977290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6380b2b40 0x7fc6380c9c10 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.948+0000 7fc63fbe8700 1 -- 172.21.15.37:0/1815977290 >> 172.21.15.37:0/1815977290 conn(0x7fc63806d1c0 msgr2=0x7fc63806d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:44.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.948+0000 7fc63fbe8700 1 -- 172.21.15.37:0/1815977290 shutdown_connections 2023-10-06T02:24:44.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.948+0000 7fc63fbe8700 1 -- 172.21.15.37:0/1815977290 wait complete. 2023-10-06T02:24:44.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.949+0000 7fc63fbe8700 1 Processor -- start 2023-10-06T02:24:44.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.949+0000 7fc63fbe8700 1 -- start start 2023-10-06T02:24:44.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.950+0000 7fc63fbe8700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc63806c0b0 0x7fc63815c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.950+0000 7fc63fbe8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6380b2b40 0x7fc63815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.950+0000 7fc63fbe8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc638159c50 0x7fc63816ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.950+0000 7fc63fbe8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63815e5f0 con 0x7fc638159c50 2023-10-06T02:24:44.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.950+0000 7fc63fbe8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380ac6d0 con 0x7fc6380b2b40 2023-10-06T02:24:44.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.950+0000 7fc63fbe8700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380aa530 con 0x7fc63806c0b0 2023-10-06T02:24:44.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.950+0000 7fc63e185700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc638159c50 0x7fc63816ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.950+0000 7fc63e185700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc638159c50 0x7fc63816ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38674/0 (socket says 172.21.15.37:38674) 2023-10-06T02:24:44.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.950+0000 7fc63e185700 1 -- 172.21.15.37:0/1569464332 learned_addr learned my addr 172.21.15.37:0/1569464332 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:44.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.950+0000 7fc63d183700 1 --2- 172.21.15.37:0/1569464332 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6380b2b40 0x7fc63815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.950+0000 7fc63d984700 1 --2- 172.21.15.37:0/1569464332 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc63806c0b0 0x7fc63815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.950+0000 7fc63e185700 1 -- 172.21.15.37:0/1569464332 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc63806c0b0 msgr2=0x7fc63815c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.950+0000 7fc63e185700 1 --2- 172.21.15.37:0/1569464332 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc63806c0b0 0x7fc63815c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.950+0000 7fc63e185700 1 -- 172.21.15.37:0/1569464332 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6380b2b40 msgr2=0x7fc63815e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:44.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.950+0000 7fc63e185700 1 --2- 172.21.15.37:0/1569464332 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6380b2b40 0x7fc63815e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:44.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.950+0000 7fc63e185700 1 -- 172.21.15.37:0/1569464332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc628009420 con 0x7fc638159c50 2023-10-06T02:24:44.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.950+0000 7fc63e185700 1 --2- 172.21.15.37:0/1569464332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc638159c50 0x7fc63816ad70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc630009e90 tx=0x7fc63000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:44.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.953+0000 7fc62dffb700 1 -- 172.21.15.37:0/1569464332 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000cb70 con 0x7fc638159c50 2023-10-06T02:24:44.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.953+0000 7fc62dffb700 1 -- 172.21.15.37:0/1569464332 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63000f040 con 0x7fc638159c50 2023-10-06T02:24:44.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.953+0000 7fc63fbe8700 1 -- 172.21.15.37:0/1569464332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63816b2b0 con 0x7fc638159c50 2023-10-06T02:24:44.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.953+0000 7fc62dffb700 1 -- 172.21.15.37:0/1569464332 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630014480 con 0x7fc638159c50 2023-10-06T02:24:44.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.953+0000 7fc63fbe8700 1 -- 172.21.15.37:0/1569464332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63815d2f0 con 0x7fc638159c50 2023-10-06T02:24:44.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.954+0000 7fc63fbe8700 1 -- 172.21.15.37:0/1569464332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6380cde90 con 0x7fc638159c50 2023-10-06T02:24:44.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.955+0000 7fc62dffb700 1 -- 172.21.15.37:0/1569464332 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc630014830 con 0x7fc638159c50 2023-10-06T02:24:44.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.955+0000 7fc62dffb700 1 --2- 172.21.15.37:0/1569464332 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc61c066f30 0x7fc61c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:44.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.955+0000 7fc62dffb700 1 -- 172.21.15.37:0/1569464332 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fc6300850c0 con 0x7fc638159c50 2023-10-06T02:24:44.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.955+0000 7fc63d984700 1 --2- 172.21.15.37:0/1569464332 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc61c066f30 0x7fc61c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:44.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.956+0000 7fc63d984700 1 --2- 172.21.15.37:0/1569464332 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc61c066f30 0x7fc61c0693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc63806b940 tx=0x7fc634007f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:44.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:44.960+0000 7fc62dffb700 1 -- 172.21.15.37:0/1569464332 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6300524d0 con 0x7fc638159c50 2023-10-06T02:24:45.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:45.170+0000 7fc63fbe8700 1 -- 172.21.15.37:0/1569464332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc63804bb80 con 0x7fc638159c50 2023-10-06T02:24:45.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:45.952+0000 7fc62dffb700 1 -- 172.21.15.37:0/1569464332 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v39) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc630055af0 con 0x7fc638159c50 2023-10-06T02:24:45.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:45.954+0000 7fc63fbe8700 1 -- 172.21.15.37:0/1569464332 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc61c066f30 msgr2=0x7fc61c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:45.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:45.954+0000 7fc63fbe8700 1 --2- 172.21.15.37:0/1569464332 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc61c066f30 0x7fc61c0693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc63806b940 tx=0x7fc634007f50 comp rx=0 tx=0).stop 2023-10-06T02:24:45.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:45.954+0000 7fc63fbe8700 1 -- 172.21.15.37:0/1569464332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc638159c50 msgr2=0x7fc63816ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:45.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:45.954+0000 7fc63fbe8700 1 --2- 172.21.15.37:0/1569464332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc638159c50 0x7fc63816ad70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc630009e90 tx=0x7fc63000b040 comp rx=0 tx=0).stop 2023-10-06T02:24:45.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:45.955+0000 7fc63fbe8700 1 -- 172.21.15.37:0/1569464332 shutdown_connections 2023-10-06T02:24:45.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:45.955+0000 7fc63fbe8700 1 --2- 172.21.15.37:0/1569464332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc638159c50 0x7fc63816ad70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:45.955+0000 7fc63fbe8700 1 --2- 172.21.15.37:0/1569464332 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc63806c0b0 0x7fc63815c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:45.955+0000 7fc63fbe8700 1 --2- 172.21.15.37:0/1569464332 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc61c066f30 0x7fc61c0693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:45.955+0000 7fc63fbe8700 1 --2- 172.21.15.37:0/1569464332 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6380b2b40 0x7fc63815e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:45.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:45.955+0000 7fc63fbe8700 1 -- 172.21.15.37:0/1569464332 >> 172.21.15.37:0/1569464332 conn(0x7fc63806d1c0 msgr2=0x7fc6380cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:45.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:45.955+0000 7fc63fbe8700 1 -- 172.21.15.37:0/1569464332 shutdown_connections 2023-10-06T02:24:45.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:45.955+0000 7fc63fbe8700 1 -- 172.21.15.37:0/1569464332 wait complete. 2023-10-06T02:24:45.957 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-10-06T02:24:45.969 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:24:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.089+0000 7f901e9a4700 1 Processor -- start 2023-10-06T02:24:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.089+0000 7f901e9a4700 1 -- start start 2023-10-06T02:24:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.090+0000 7f901e9a4700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f901806d890 0x7f901806dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.090+0000 7f901e9a4700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901815e180 con 0x7f90180cb590 2023-10-06T02:24:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.090+0000 7f901e9a4700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901815d570 con 0x7f90181595a0 2023-10-06T02:24:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.090+0000 7f901e9a4700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f901806e270 con 0x7f901806d890 2023-10-06T02:24:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.090+0000 7f901cf41700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f90180cb590 0x7f90180cb9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39108/0 (socket says 172.21.15.37:39108) 2023-10-06T02:24:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.090+0000 7f901cf41700 1 -- 172.21.15.37:0/3433129231 learned_addr learned my addr 172.21.15.37:0/3433129231 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.090+0000 7f90177fe700 1 --2- 172.21.15.37:0/3433129231 >> v2:172.21.15.37:3300/0 conn(0x7f901806d890 0x7f901806dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.091+0000 7f9016ffd700 1 -- 172.21.15.37:0/3433129231 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344647118 0 0) 0x7f901815e180 con 0x7f90180cb590 2023-10-06T02:24:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.091+0000 7f9016ffd700 1 -- 172.21.15.37:0/3433129231 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9004003570 con 0x7f90180cb590 2023-10-06T02:24:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.091+0000 7f90177fe700 1 -- 172.21.15.37:0/3433129231 >> v1:172.21.15.191:6789/0 conn(0x7f90181595a0 legacy=0x7f90180b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.091+0000 7f90177fe700 1 -- 172.21.15.37:0/3433129231 >> v1:172.21.15.37:6789/0 conn(0x7f90180cb590 legacy=0x7f90180cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.091+0000 7f90177fe700 1 -- 172.21.15.37:0/3433129231 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901815d850 con 0x7f901806d890 2023-10-06T02:24:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.091+0000 7f90177fe700 1 --2- 172.21.15.37:0/3433129231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f901806d890 0x7f901806dd30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f90000098e0 tx=0x7f90000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ba6727ecadbc06 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.091+0000 7f9016ffd700 1 -- 172.21.15.37:0/3433129231 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900000b640 con 0x7f901806d890 2023-10-06T02:24:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.091+0000 7f9016ffd700 1 -- 172.21.15.37:0/3433129231 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900000b7a0 con 0x7f901806d890 2023-10-06T02:24:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.091+0000 7f9016ffd700 1 -- 172.21.15.37:0/3433129231 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900000bb20 con 0x7f901806d890 2023-10-06T02:24:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.092+0000 7f901e9a4700 1 -- 172.21.15.37:0/3433129231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f901806d890 msgr2=0x7f901806dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.092+0000 7f901e9a4700 1 --2- 172.21.15.37:0/3433129231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f901806d890 0x7f901806dd30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f90000098e0 tx=0x7f90000091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.092+0000 7f901e9a4700 1 -- 172.21.15.37:0/3433129231 shutdown_connections 2023-10-06T02:24:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.092+0000 7f901e9a4700 1 --2- 172.21.15.37:0/3433129231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f901806d890 0x7f901806dd30 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.092+0000 7f901e9a4700 1 -- 172.21.15.37:0/3433129231 >> 172.21.15.37:0/3433129231 conn(0x7f90180d04d0 msgr2=0x7f90180d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.092+0000 7f901e9a4700 1 -- 172.21.15.37:0/3433129231 shutdown_connections 2023-10-06T02:24:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.092+0000 7f901e9a4700 1 -- 172.21.15.37:0/3433129231 wait complete. 2023-10-06T02:24:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.093+0000 7f901e9a4700 1 Processor -- start 2023-10-06T02:24:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.093+0000 7f901e9a4700 1 -- start start 2023-10-06T02:24:46.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f901e9a4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f901806d890 0x7f90180c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f901e9a4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90180cb590 0x7f901816d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f901e9a4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90181595a0 0x7f90180c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f901e9a4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901816a510 con 0x7f901806d890 2023-10-06T02:24:46.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f901e9a4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901816dee0 con 0x7f90180cb590 2023-10-06T02:24:46.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f901e9a4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901816e1c0 con 0x7f90181595a0 2023-10-06T02:24:46.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f9017fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f901806d890 0x7f90180c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f9017fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f901806d890 0x7f90180c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37718/0 (socket says 172.21.15.37:37718) 2023-10-06T02:24:46.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f9017fff700 1 -- 172.21.15.37:0/819178348 learned_addr learned my addr 172.21.15.37:0/819178348 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:46.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f901cf41700 1 --2- 172.21.15.37:0/819178348 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90181595a0 0x7f90180c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f90177fe700 1 --2- 172.21.15.37:0/819178348 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90180cb590 0x7f901816d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f9017fff700 1 -- 172.21.15.37:0/819178348 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90181595a0 msgr2=0x7f90180c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f9017fff700 1 --2- 172.21.15.37:0/819178348 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90181595a0 0x7f90180c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f9017fff700 1 -- 172.21.15.37:0/819178348 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90180cb590 msgr2=0x7f901816d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f9017fff700 1 --2- 172.21.15.37:0/819178348 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90180cb590 0x7f901816d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f9017fff700 1 -- 172.21.15.37:0/819178348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9000009420 con 0x7f901806d890 2023-10-06T02:24:46.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f9017fff700 1 --2- 172.21.15.37:0/819178348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f901806d890 0x7f90180c9700 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f900800c4e0 tx=0x7f900800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:46.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f900ffff700 1 -- 172.21.15.37:0/819178348 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9008011590 con 0x7f901806d890 2023-10-06T02:24:46.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f900ffff700 1 -- 172.21.15.37:0/819178348 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9008011710 con 0x7f901806d890 2023-10-06T02:24:46.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f901e9a4700 1 -- 172.21.15.37:0/819178348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901816e4a0 con 0x7f901806d890 2023-10-06T02:24:46.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.094+0000 7f900ffff700 1 -- 172.21.15.37:0/819178348 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9008011ad0 con 0x7f901806d890 2023-10-06T02:24:46.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.095+0000 7f901e9a4700 1 -- 172.21.15.37:0/819178348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901816dbd0 con 0x7f901806d890 2023-10-06T02:24:46.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.095+0000 7f901e9a4700 1 -- 172.21.15.37:0/819178348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9018088b20 con 0x7f901806d890 2023-10-06T02:24:46.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.096+0000 7f900ffff700 1 -- 172.21.15.37:0/819178348 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f900801b3b0 con 0x7f901806d890 2023-10-06T02:24:46.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.096+0000 7f900ffff700 1 --2- 172.21.15.37:0/819178348 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8ff8066f30 0x7f8ff80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.096+0000 7f900ffff700 1 -- 172.21.15.37:0/819178348 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9008083850 con 0x7f901806d890 2023-10-06T02:24:46.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.097+0000 7f90177fe700 1 --2- 172.21.15.37:0/819178348 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8ff8066f30 0x7f8ff80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.097+0000 7f90177fe700 1 --2- 172.21.15.37:0/819178348 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8ff8066f30 0x7f8ff80693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f90000093f0 tx=0x7f9000017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:46.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.101+0000 7f900ffff700 1 -- 172.21.15.37:0/819178348 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9008050c10 con 0x7f901806d890 2023-10-06T02:24:46.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.371+0000 7f901e9a4700 1 -- 172.21.15.37:0/819178348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f901815db30 con 0x7f901806d890 2023-10-06T02:24:46.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.371+0000 7f900ffff700 1 -- 172.21.15.37:0/819178348 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f9008017020 con 0x7f901806d890 2023-10-06T02:24:46.372 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:46.372 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:24:46.372 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-10-06T02:24:46.372 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:46.372 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-10-06T02:24:46.372 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lkQF5HRAAmDbVzKumixz+mz8C9Ibu4w==", 2023-10-06T02:24:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:24:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T02:24:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T02:24:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-10-06T02:24:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lpPDVKBAAdg+chey8icfN9/u/REprEw==", 2023-10-06T02:24:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:24:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T02:24:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T02:24:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-10-06T02:24:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lSQ5oJBAAvXZ5RKQNOEujDD8kM0QU+Q==", 2023-10-06T02:24:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:24:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T02:24:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T02:24:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-10-06T02:24:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lE5adLxAAb6XIxhNYBl7FVcprFY526g==", 2023-10-06T02:24:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:24:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T02:24:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T02:24:46.376 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:46.376 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:46.376 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:46.376 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:46.376 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-10-06T02:24:46.376 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBjbx9lLEJuDRAA5astKYoPcHwja09KROk+tQ==", 2023-10-06T02:24:46.376 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:46.376 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:46.376 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:24:46.376 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:46.376 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:46.376 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:46.377 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:46.377 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-10-06T02:24:46.377 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBmbx9lwdVEDBAA5TMlEiE5UAavPJzdV22Gtw==", 2023-10-06T02:24:46.377 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:46.377 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:46.377 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:24:46.377 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:46.377 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:46.377 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:46.377 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:46.377 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-10-06T02:24:46.377 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBpbx9lF5UeChAA1fYYSrtxmm7yMS4pn/hacQ==", 2023-10-06T02:24:46.378 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:46.378 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:46.378 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:24:46.378 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:46.378 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:46.378 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:46.378 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:46.378 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-10-06T02:24:46.379 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBsbx9l3oTYCBAADYVyJ6Yt2sZfXhundjqceQ==", 2023-10-06T02:24:46.379 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:46.379 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:46.379 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:24:46.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:46.379 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:46.379 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:46.379 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:46.379 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-10-06T02:24:46.379 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBybx9lhrfuCBAA7A97uVPnZDT9ia70W5180A==", 2023-10-06T02:24:46.379 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:46.380 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:46.380 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:24:46.380 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:46.380 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:46.380 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:46.380 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:46.380 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-10-06T02:24:46.380 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQB1bx9lEntaBxAAzvIEHp4iJvnev2yuqPL3tA==", 2023-10-06T02:24:46.380 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:46.380 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:46.380 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:24:46.381 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:46.381 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:46.381 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:46.381 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:46.381 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-10-06T02:24:46.381 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQB4bx9lZaxXBxAAE+FsUplhP39hVXuZ4btCqQ==", 2023-10-06T02:24:46.381 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:46.381 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:46.381 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:24:46.381 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:46.381 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:46.381 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:46.382 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:46.382 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-10-06T02:24:46.382 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQB7bx9lAtvBBhAAZzUs75blYnu3OocrsTVHSg==", 2023-10-06T02:24:46.382 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:46.382 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:24:46.382 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:24:46.382 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:46.382 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:46.382 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:46.382 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:46.382 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-10-06T02:24:46.383 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9llHl0MxAAPrpwRuKiAcn+W0aDwzBvvQ==", 2023-10-06T02:24:46.383 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:46.383 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:24:46.383 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2023-10-06T02:24:46.383 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T02:24:46.383 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:46.383 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:46.383 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:46.383 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-10-06T02:24:46.383 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBgbx9lgp1AABAA+oAQVt7MWVsWnRxbWVLNbA==", 2023-10-06T02:24:46.383 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:46.383 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:24:46.384 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T02:24:46.384 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T02:24:46.384 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T02:24:46.384 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:46.384 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:46.384 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:46.384 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-10-06T02:24:46.384 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lByLlOBAAeTJLSorscEidED7VHIPKCg==", 2023-10-06T02:24:46.384 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:46.384 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:24:46.384 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T02:24:46.385 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T02:24:46.385 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T02:24:46.385 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:46.385 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:46.385 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:46.385 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-10-06T02:24:46.385 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBgbx9l6LuWBRAAvYfXvGvgMYDPlB4CgKaNqw==", 2023-10-06T02:24:46.385 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:46.385 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:24:46.385 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T02:24:46.385 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T02:24:46.386 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T02:24:46.386 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:46.386 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:46.386 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:46.386 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-10-06T02:24:46.386 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lgayZAhAA9VQix+78KreRH/YEeftPQA==", 2023-10-06T02:24:46.386 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:46.386 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T02:24:46.386 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T02:24:46.386 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T02:24:46.386 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:46.386 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:46.387 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:46.387 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:46.387 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-10-06T02:24:46.387 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lg7hcGhAAelKPvNX7CL80KycBGoQ8cw==", 2023-10-06T02:24:46.387 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:46.387 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T02:24:46.387 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-10-06T02:24:46.387 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:46.387 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:46.387 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:46.387 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:46.387 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-10-06T02:24:46.388 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9l5BH7FhAAotvMdV8pKCJzZUqTviL3CQ==", 2023-10-06T02:24:46.388 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:24:46.388 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T02:24:46.388 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-10-06T02:24:46.388 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:24:46.388 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:46.388 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:46.388 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-06T02:24:46.388 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:24:46.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.374+0000 7f901e9a4700 1 -- 172.21.15.37:0/819178348 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8ff8066f30 msgr2=0x7f8ff80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.374+0000 7f901e9a4700 1 --2- 172.21.15.37:0/819178348 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8ff8066f30 0x7f8ff80693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f90000093f0 tx=0x7f9000017000 comp rx=0 tx=0).stop 2023-10-06T02:24:46.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.374+0000 7f901e9a4700 1 -- 172.21.15.37:0/819178348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f901806d890 msgr2=0x7f90180c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.374+0000 7f901e9a4700 1 --2- 172.21.15.37:0/819178348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f901806d890 0x7f90180c9700 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f900800c4e0 tx=0x7f900800c7f0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.374+0000 7f901e9a4700 1 -- 172.21.15.37:0/819178348 shutdown_connections 2023-10-06T02:24:46.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.374+0000 7f901e9a4700 1 --2- 172.21.15.37:0/819178348 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90181595a0 0x7f90180c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.374+0000 7f901e9a4700 1 --2- 172.21.15.37:0/819178348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f901806d890 0x7f90180c9700 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.374+0000 7f901e9a4700 1 --2- 172.21.15.37:0/819178348 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8ff8066f30 0x7f8ff80693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.374+0000 7f901e9a4700 1 --2- 172.21.15.37:0/819178348 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90180cb590 0x7f901816d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.374+0000 7f901e9a4700 1 -- 172.21.15.37:0/819178348 >> 172.21.15.37:0/819178348 conn(0x7f90180d04d0 msgr2=0x7f90180d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:46.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.374+0000 7f901e9a4700 1 -- 172.21.15.37:0/819178348 shutdown_connections 2023-10-06T02:24:46.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.374+0000 7f901e9a4700 1 -- 172.21.15.37:0/819178348 wait complete. 2023-10-06T02:24:46.391 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:24:46.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.510+0000 7f2c5d9b6700 1 Processor -- start 2023-10-06T02:24:46.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.510+0000 7f2c5d9b6700 1 -- start start 2023-10-06T02:24:46.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.511+0000 7f2c5d9b6700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2c58159760 0x7f2c5815d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.511+0000 7f2c5d9b6700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c5815dd50 0x7f2c580cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.511+0000 7f2c5d9b6700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c5815e1d0 con 0x7f2c5815d8d0 2023-10-06T02:24:46.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.511+0000 7f2c5d9b6700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c580cc2d0 con 0x7f2c5815dd50 2023-10-06T02:24:46.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.511+0000 7f2c5d9b6700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c580cb650 con 0x7f2c58159760 2023-10-06T02:24:46.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.511+0000 7f2c577fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c5815dd50 0x7f2c580cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.511+0000 7f2c577fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c5815dd50 0x7f2c580cfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37724/0 (socket says 172.21.15.37:37724) 2023-10-06T02:24:46.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.511+0000 7f2c577fe700 1 -- 172.21.15.37:0/1204294834 learned_addr learned my addr 172.21.15.37:0/1204294834 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:46.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.511+0000 7f2c567fc700 1 --1- 172.21.15.37:0/1204294834 >> v1:172.21.15.37:6789/0 conn(0x7f2c5815d8d0 0x7f2c580c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39118/0 (socket says 172.21.15.37:39118) 2023-10-06T02:24:46.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.511+0000 7f2c56ffd700 1 --2- 172.21.15.37:0/1204294834 >> v2:172.21.15.191:3300/0 conn(0x7f2c58159760 0x7f2c5815d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.511+0000 7f2c577fe700 1 -- 172.21.15.37:0/1204294834 >> v2:172.21.15.191:3300/0 conn(0x7f2c58159760 msgr2=0x7f2c5815d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:46.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.511+0000 7f2c577fe700 1 --2- 172.21.15.37:0/1204294834 >> v2:172.21.15.191:3300/0 conn(0x7f2c58159760 0x7f2c5815d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.511+0000 7f2c577fe700 1 -- 172.21.15.37:0/1204294834 >> v1:172.21.15.37:6789/0 conn(0x7f2c5815d8d0 legacy=0x7f2c580c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.511+0000 7f2c55ffb700 1 -- 172.21.15.37:0/1204294834 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1395763307 0 0) 0x7f2c5815e1d0 con 0x7f2c5815d8d0 2023-10-06T02:24:46.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.511+0000 7f2c577fe700 1 -- 172.21.15.37:0/1204294834 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c580cb930 con 0x7f2c5815dd50 2023-10-06T02:24:46.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.511+0000 7f2c56ffd700 1 --2- 172.21.15.37:0/1204294834 >> v2:172.21.15.191:3300/0 conn(0x7f2c58159760 0x7f2c5815d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:46.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.511+0000 7f2c577fe700 1 --2- 172.21.15.37:0/1204294834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c5815dd50 0x7f2c580cfc00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2c580897f0 tx=0x7f2c50009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c74a83b0c0935e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:46.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.511+0000 7f2c55ffb700 1 -- 172.21.15.37:0/1204294834 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5000e070 con 0x7f2c5815dd50 2023-10-06T02:24:46.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.512+0000 7f2c55ffb700 1 -- 172.21.15.37:0/1204294834 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5000bae0 con 0x7f2c5815dd50 2023-10-06T02:24:46.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.512+0000 7f2c55ffb700 1 -- 172.21.15.37:0/1204294834 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c500092e0 con 0x7f2c5815dd50 2023-10-06T02:24:46.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.512+0000 7f2c5d9b6700 1 -- 172.21.15.37:0/1204294834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c5815dd50 msgr2=0x7f2c580cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.512+0000 7f2c5d9b6700 1 --2- 172.21.15.37:0/1204294834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c5815dd50 0x7f2c580cfc00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2c580897f0 tx=0x7f2c50009840 comp rx=0 tx=0).stop 2023-10-06T02:24:46.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.512+0000 7f2c5d9b6700 1 -- 172.21.15.37:0/1204294834 shutdown_connections 2023-10-06T02:24:46.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.512+0000 7f2c5d9b6700 1 --2- 172.21.15.37:0/1204294834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c5815dd50 0x7f2c580cfc00 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.512+0000 7f2c5d9b6700 1 --2- 172.21.15.37:0/1204294834 >> v2:172.21.15.191:3300/0 conn(0x7f2c58159760 0x7f2c5815d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.512+0000 7f2c5d9b6700 1 -- 172.21.15.37:0/1204294834 >> 172.21.15.37:0/1204294834 conn(0x7f2c5806c890 msgr2=0x7f2c580d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:46.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.512+0000 7f2c5d9b6700 1 -- 172.21.15.37:0/1204294834 shutdown_connections 2023-10-06T02:24:46.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.512+0000 7f2c5d9b6700 1 -- 172.21.15.37:0/1204294834 wait complete. 2023-10-06T02:24:46.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.513+0000 7f2c5d9b6700 1 Processor -- start 2023-10-06T02:24:46.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.513+0000 7f2c5d9b6700 1 -- start start 2023-10-06T02:24:46.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.514+0000 7f2c5d9b6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c58159760 0x7f2c5814d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.514+0000 7f2c5d9b6700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c5815d8d0 0x7f2c58159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.514+0000 7f2c5d9b6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c5815dd50 0x7f2c5806ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.514+0000 7f2c5d9b6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c580b62b0 con 0x7f2c5815dd50 2023-10-06T02:24:46.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.514+0000 7f2c5d9b6700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5815a810 con 0x7f2c5815d8d0 2023-10-06T02:24:46.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.514+0000 7f2c5d9b6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c580b5a10 con 0x7f2c58159760 2023-10-06T02:24:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.514+0000 7f2c577fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c5815dd50 0x7f2c5806ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.514+0000 7f2c577fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c5815dd50 0x7f2c5806ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37740/0 (socket says 172.21.15.37:37740) 2023-10-06T02:24:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.514+0000 7f2c577fe700 1 -- 172.21.15.37:0/2170153048 learned_addr learned my addr 172.21.15.37:0/2170153048 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.514+0000 7f2c56ffd700 1 --2- 172.21.15.37:0/2170153048 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c58159760 0x7f2c5814d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.514+0000 7f2c567fc700 1 --2- 172.21.15.37:0/2170153048 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c5815d8d0 0x7f2c58159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.514+0000 7f2c577fe700 1 -- 172.21.15.37:0/2170153048 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c58159760 msgr2=0x7f2c5814d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.514+0000 7f2c577fe700 1 --2- 172.21.15.37:0/2170153048 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c58159760 0x7f2c5814d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.514+0000 7f2c577fe700 1 -- 172.21.15.37:0/2170153048 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c5815d8d0 msgr2=0x7f2c58159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.514+0000 7f2c577fe700 1 --2- 172.21.15.37:0/2170153048 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c5815d8d0 0x7f2c58159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.514+0000 7f2c577fe700 1 -- 172.21.15.37:0/2170153048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c50009ae0 con 0x7f2c5815dd50 2023-10-06T02:24:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.514+0000 7f2c567fc700 1 --2- 172.21.15.37:0/2170153048 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c5815d8d0 0x7f2c58159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.514+0000 7f2c56ffd700 1 --2- 172.21.15.37:0/2170153048 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c58159760 0x7f2c5814d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.515+0000 7f2c577fe700 1 --2- 172.21.15.37:0/2170153048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c5815dd50 0x7f2c5806ea70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2c58088880 tx=0x7f2c50018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.515+0000 7f2c3effd700 1 -- 172.21.15.37:0/2170153048 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c500094e0 con 0x7f2c5815dd50 2023-10-06T02:24:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.515+0000 7f2c3effd700 1 -- 172.21.15.37:0/2170153048 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c50008e60 con 0x7f2c5815dd50 2023-10-06T02:24:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.515+0000 7f2c3effd700 1 -- 172.21.15.37:0/2170153048 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c50026690 con 0x7f2c5815dd50 2023-10-06T02:24:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.515+0000 7f2c5d9b6700 1 -- 172.21.15.37:0/2170153048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c580b5cf0 con 0x7f2c5815dd50 2023-10-06T02:24:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.515+0000 7f2c5d9b6700 1 -- 172.21.15.37:0/2170153048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c5814d810 con 0x7f2c5815dd50 2023-10-06T02:24:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.516+0000 7f2c5d9b6700 1 -- 172.21.15.37:0/2170153048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c5806fbf0 con 0x7f2c5815dd50 2023-10-06T02:24:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.516+0000 7f2c3effd700 1 -- 172.21.15.37:0/2170153048 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c50003040 con 0x7f2c5815dd50 2023-10-06T02:24:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.517+0000 7f2c3effd700 1 --2- 172.21.15.37:0/2170153048 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2c44066f30 0x7f2c440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.517+0000 7f2c3effd700 1 -- 172.21.15.37:0/2170153048 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2c500864b0 con 0x7f2c5815dd50 2023-10-06T02:24:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.517+0000 7f2c56ffd700 1 --2- 172.21.15.37:0/2170153048 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2c44066f30 0x7f2c440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.517+0000 7f2c56ffd700 1 --2- 172.21.15.37:0/2170153048 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2c44066f30 0x7f2c440693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2c48006fd0 tx=0x7f2c48008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:46.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.521+0000 7f2c3effd700 1 -- 172.21.15.37:0/2170153048 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c50053910 con 0x7f2c5815dd50 2023-10-06T02:24:46.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.717+0000 7f2c5d9b6700 1 -- 172.21.15.37:0/2170153048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c5815a950 con 0x7f2c5815dd50 2023-10-06T02:24:46.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.717+0000 7f2c3effd700 1 -- 172.21.15.37:0/2170153048 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+13650 (secure 0 0 0) 0x7f2c50056f30 con 0x7f2c5815dd50 2023-10-06T02:24:46.718 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:46.719 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":39,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:24:45.949892+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:24:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.719+0000 7f2c5d9b6700 1 -- 172.21.15.37:0/2170153048 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2c44066f30 msgr2=0x7f2c440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.719+0000 7f2c5d9b6700 1 --2- 172.21.15.37:0/2170153048 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2c44066f30 0x7f2c440693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2c48006fd0 tx=0x7f2c48008040 comp rx=0 tx=0).stop 2023-10-06T02:24:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.719+0000 7f2c5d9b6700 1 -- 172.21.15.37:0/2170153048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c5815dd50 msgr2=0x7f2c5806ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.719+0000 7f2c5d9b6700 1 --2- 172.21.15.37:0/2170153048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c5815dd50 0x7f2c5806ea70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2c58088880 tx=0x7f2c50018000 comp rx=0 tx=0).stop 2023-10-06T02:24:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.719+0000 7f2c5d9b6700 1 -- 172.21.15.37:0/2170153048 shutdown_connections 2023-10-06T02:24:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.719+0000 7f2c5d9b6700 1 --2- 172.21.15.37:0/2170153048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c5815dd50 0x7f2c5806ea70 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.719+0000 7f2c5d9b6700 1 --2- 172.21.15.37:0/2170153048 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c58159760 0x7f2c5814d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.719+0000 7f2c5d9b6700 1 --2- 172.21.15.37:0/2170153048 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2c44066f30 0x7f2c440693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.719+0000 7f2c5d9b6700 1 --2- 172.21.15.37:0/2170153048 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c5815d8d0 0x7f2c58159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.719+0000 7f2c5d9b6700 1 -- 172.21.15.37:0/2170153048 >> 172.21.15.37:0/2170153048 conn(0x7f2c5806c890 msgr2=0x7f2c5806ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:46.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.719+0000 7f2c5d9b6700 1 -- 172.21.15.37:0/2170153048 shutdown_connections 2023-10-06T02:24:46.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.719+0000 7f2c5d9b6700 1 -- 172.21.15.37:0/2170153048 wait complete. 2023-10-06T02:24:46.732 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:23:08.066048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:23:08.561964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T02:24:46.732 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:24:46.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.853+0000 7f8fd8e71700 1 Processor -- start 2023-10-06T02:24:46.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.853+0000 7f8fd8e71700 1 -- start start 2023-10-06T02:24:46.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.854+0000 7f8fd8e71700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8fd414e2a0 0x7f8fd40ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.854+0000 7f8fd8e71700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8fd40b3e80 0x7f8fd40cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.854+0000 7f8fd8e71700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd41587a0 con 0x7f8fd414e670 2023-10-06T02:24:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.854+0000 7f8fd8e71700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd4157b90 con 0x7f8fd40b3e80 2023-10-06T02:24:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.854+0000 7f8fd8e71700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd4157e70 con 0x7f8fd414e2a0 2023-10-06T02:24:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.855+0000 7f8fd2d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8fd40b3e80 0x7f8fd40cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.855+0000 7f8fd1d9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8fd414e670 0x7f8fd40b3770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39120/0 (socket says 172.21.15.37:39120) 2023-10-06T02:24:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.855+0000 7f8fd1d9b700 1 -- 172.21.15.37:0/1982659104 learned_addr learned my addr 172.21.15.37:0/1982659104 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.855+0000 7f8fd259c700 1 --2- 172.21.15.37:0/1982659104 >> v2:172.21.15.191:3300/0 conn(0x7f8fd414e2a0 0x7f8fd40ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.855+0000 7f8fd2d9d700 1 -- 172.21.15.37:0/1982659104 >> v2:172.21.15.191:3300/0 conn(0x7f8fd414e2a0 msgr2=0x7f8fd40ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.855+0000 7f8fd2d9d700 1 --2- 172.21.15.37:0/1982659104 >> v2:172.21.15.191:3300/0 conn(0x7f8fd414e2a0 0x7f8fd40ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.855+0000 7f8fd2d9d700 1 -- 172.21.15.37:0/1982659104 >> v1:172.21.15.37:6789/0 conn(0x7f8fd414e670 legacy=0x7f8fd40b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.855+0000 7f8fd2d9d700 1 -- 172.21.15.37:0/1982659104 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd4158150 con 0x7f8fd40b3e80 2023-10-06T02:24:46.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.855+0000 7f8fd159a700 1 -- 172.21.15.37:0/1982659104 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354938663 0 0) 0x7f8fd41587a0 con 0x7f8fd414e670 2023-10-06T02:24:46.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.855+0000 7f8fd259c700 1 --2- 172.21.15.37:0/1982659104 >> v2:172.21.15.191:3300/0 conn(0x7f8fd414e2a0 0x7f8fd40ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:46.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.855+0000 7f8fd2d9d700 1 --2- 172.21.15.37:0/1982659104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fd40b3e80 0x7f8fd40cc2c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8fd406cd50 tx=0x7f8fcc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b56d8d91812bb8a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:46.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.855+0000 7f8fd159a700 1 -- 172.21.15.37:0/1982659104 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc00e070 con 0x7f8fd40b3e80 2023-10-06T02:24:46.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.855+0000 7f8fd159a700 1 -- 172.21.15.37:0/1982659104 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc00bc30 con 0x7f8fd40b3e80 2023-10-06T02:24:46.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.855+0000 7f8fd159a700 1 -- 172.21.15.37:0/1982659104 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc012430 con 0x7f8fd40b3e80 2023-10-06T02:24:46.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.856+0000 7f8fd8e71700 1 -- 172.21.15.37:0/1982659104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fd40b3e80 msgr2=0x7f8fd40cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.856+0000 7f8fd8e71700 1 --2- 172.21.15.37:0/1982659104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fd40b3e80 0x7f8fd40cc2c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8fd406cd50 tx=0x7f8fcc009780 comp rx=0 tx=0).stop 2023-10-06T02:24:46.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.856+0000 7f8fd8e71700 1 -- 172.21.15.37:0/1982659104 shutdown_connections 2023-10-06T02:24:46.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.856+0000 7f8fd8e71700 1 --2- 172.21.15.37:0/1982659104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fd40b3e80 0x7f8fd40cc2c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.856+0000 7f8fd8e71700 1 --2- 172.21.15.37:0/1982659104 >> v2:172.21.15.191:3300/0 conn(0x7f8fd414e2a0 0x7f8fd40ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.856+0000 7f8fd8e71700 1 -- 172.21.15.37:0/1982659104 >> 172.21.15.37:0/1982659104 conn(0x7f8fd406c0b0 msgr2=0x7f8fd406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:46.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.856+0000 7f8fd8e71700 1 -- 172.21.15.37:0/1982659104 shutdown_connections 2023-10-06T02:24:46.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.856+0000 7f8fd8e71700 1 -- 172.21.15.37:0/1982659104 wait complete. 2023-10-06T02:24:46.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.857+0000 7f8fd8e71700 1 Processor -- start 2023-10-06T02:24:46.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.857+0000 7f8fd8e71700 1 -- start start 2023-10-06T02:24:46.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fd8e71700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8fd40b3e80 0x7f8fd4150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fd8e71700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fd414e2a0 0x7f8fd414f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fd8e71700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fd414e670 0x7f8fd414c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fd8e71700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd41591b0 con 0x7f8fd414e670 2023-10-06T02:24:46.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fd8e71700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd41518b0 con 0x7f8fd414e2a0 2023-10-06T02:24:46.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fd8e71700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd4151b90 con 0x7f8fd40b3e80 2023-10-06T02:24:46.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fd2d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fd414e670 0x7f8fd414c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fd2d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fd414e670 0x7f8fd414c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37752/0 (socket says 172.21.15.37:37752) 2023-10-06T02:24:46.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fd2d9d700 1 -- 172.21.15.37:0/1223260914 learned_addr learned my addr 172.21.15.37:0/1223260914 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:46.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fd1d9b700 1 --2- 172.21.15.37:0/1223260914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fd414e2a0 0x7f8fd414f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fd259c700 1 --2- 172.21.15.37:0/1223260914 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8fd40b3e80 0x7f8fd4150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fd2d9d700 1 -- 172.21.15.37:0/1223260914 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8fd40b3e80 msgr2=0x7f8fd4150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fd2d9d700 1 --2- 172.21.15.37:0/1223260914 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8fd40b3e80 0x7f8fd4150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fd2d9d700 1 -- 172.21.15.37:0/1223260914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fd414e2a0 msgr2=0x7f8fd414f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:46.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fd2d9d700 1 --2- 172.21.15.37:0/1223260914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fd414e2a0 0x7f8fd414f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:46.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fd2d9d700 1 -- 172.21.15.37:0/1223260914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc009a20 con 0x7f8fd414e670 2023-10-06T02:24:46.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fd1d9b700 1 --2- 172.21.15.37:0/1223260914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fd414e2a0 0x7f8fd414f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:46.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fd2d9d700 1 --2- 172.21.15.37:0/1223260914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fd414e670 0x7f8fd414c0f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc013000 tx=0x7f8fcc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:46.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fca7fc700 1 -- 172.21.15.37:0/1223260914 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc01e630 con 0x7f8fd414e670 2023-10-06T02:24:46.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fca7fc700 1 -- 172.21.15.37:0/1223260914 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc01e7f0 con 0x7f8fd414e670 2023-10-06T02:24:46.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fca7fc700 1 -- 172.21.15.37:0/1223260914 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc01ebb0 con 0x7f8fd414e670 2023-10-06T02:24:46.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fd8e71700 1 -- 172.21.15.37:0/1223260914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd4158e40 con 0x7f8fd414e670 2023-10-06T02:24:46.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.858+0000 7f8fd8e71700 1 -- 172.21.15.37:0/1223260914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd4167790 con 0x7f8fd414e670 2023-10-06T02:24:46.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.859+0000 7f8fd8e71700 1 -- 172.21.15.37:0/1223260914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd4158ca0 con 0x7f8fd414e670 2023-10-06T02:24:46.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.860+0000 7f8fca7fc700 1 -- 172.21.15.37:0/1223260914 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8fcc024070 con 0x7f8fd414e670 2023-10-06T02:24:46.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.860+0000 7f8fca7fc700 1 --2- 172.21.15.37:0/1223260914 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8fb4066f30 0x7f8fb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:46.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.860+0000 7f8fca7fc700 1 -- 172.21.15.37:0/1223260914 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8fcc086bb0 con 0x7f8fd414e670 2023-10-06T02:24:46.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.861+0000 7f8fd259c700 1 --2- 172.21.15.37:0/1223260914 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8fb4066f30 0x7f8fb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:46.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.861+0000 7f8fd259c700 1 --2- 172.21.15.37:0/1223260914 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8fb4066f30 0x7f8fb40693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4006f00 tx=0x7f8fc4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:46.865+0000 7f8fca7fc700 1 -- 172.21.15.37:0/1223260914 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8fd4158ca0 con 0x7f8fd414e670 2023-10-06T02:24:47.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.056+0000 7f8fd8e71700 1 -- 172.21.15.37:0/1223260914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8fd4158ca0 con 0x7f8fd414e670 2023-10-06T02:24:47.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.056+0000 7f8fca7fc700 1 -- 172.21.15.37:0/1223260914 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8fd4158ca0 con 0x7f8fd414e670 2023-10-06T02:24:47.057 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T02:24:47.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.058+0000 7f8fd8e71700 1 -- 172.21.15.37:0/1223260914 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8fb4066f30 msgr2=0x7f8fb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:47.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.058+0000 7f8fd8e71700 1 --2- 172.21.15.37:0/1223260914 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8fb4066f30 0x7f8fb40693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4006f00 tx=0x7f8fc4008040 comp rx=0 tx=0).stop 2023-10-06T02:24:47.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.058+0000 7f8fd8e71700 1 -- 172.21.15.37:0/1223260914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fd414e670 msgr2=0x7f8fd414c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:47.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.058+0000 7f8fd8e71700 1 --2- 172.21.15.37:0/1223260914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fd414e670 0x7f8fd414c0f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc013000 tx=0x7f8fcc019000 comp rx=0 tx=0).stop 2023-10-06T02:24:47.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.058+0000 7f8fd8e71700 1 -- 172.21.15.37:0/1223260914 shutdown_connections 2023-10-06T02:24:47.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.058+0000 7f8fd8e71700 1 --2- 172.21.15.37:0/1223260914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fd414e670 0x7f8fd414c0f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.058+0000 7f8fd8e71700 1 --2- 172.21.15.37:0/1223260914 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8fd40b3e80 0x7f8fd4150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.058+0000 7f8fd8e71700 1 --2- 172.21.15.37:0/1223260914 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8fb4066f30 0x7f8fb40693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.058+0000 7f8fd8e71700 1 --2- 172.21.15.37:0/1223260914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fd414e2a0 0x7f8fd414f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.058+0000 7f8fd8e71700 1 -- 172.21.15.37:0/1223260914 >> 172.21.15.37:0/1223260914 conn(0x7f8fd406c0b0 msgr2=0x7f8fd40ae630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:47.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.058+0000 7f8fd8e71700 1 -- 172.21.15.37:0/1223260914 shutdown_connections 2023-10-06T02:24:47.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.058+0000 7f8fd8e71700 1 -- 172.21.15.37:0/1223260914 wait complete. 2023-10-06T02:24:47.070 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:24:47.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.192+0000 7f8b114eb700 1 Processor -- start 2023-10-06T02:24:47.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.192+0000 7f8b114eb700 1 -- start start 2023-10-06T02:24:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.193+0000 7f8b114eb700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b0c156fa0 0x7f8b0c15d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.193+0000 7f8b114eb700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8b0c15a5e0 0x7f8b0c0d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.193+0000 7f8b114eb700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b0c0cb580 con 0x7f8b0c0d0940 2023-10-06T02:24:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.193+0000 7f8b114eb700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0c15d790 con 0x7f8b0c156fa0 2023-10-06T02:24:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.193+0000 7f8b114eb700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0c15da70 con 0x7f8b0c15a5e0 2023-10-06T02:24:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.193+0000 7f8b0affd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b0c156fa0 0x7f8b0c15d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.193+0000 7f8b0b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8b0c0d0940 0x7f8b0c0ccf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39128/0 (socket says 172.21.15.37:39128) 2023-10-06T02:24:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.193+0000 7f8b0b7fe700 1 -- 172.21.15.37:0/4103780713 learned_addr learned my addr 172.21.15.37:0/4103780713 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.193+0000 7f8b0a7fc700 1 --2- 172.21.15.37:0/4103780713 >> v2:172.21.15.191:3300/0 conn(0x7f8b0c15a5e0 0x7f8b0c0d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.193+0000 7f8b0affd700 1 -- 172.21.15.37:0/4103780713 >> v2:172.21.15.191:3300/0 conn(0x7f8b0c15a5e0 msgr2=0x7f8b0c0d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.193+0000 7f8b0affd700 1 --2- 172.21.15.37:0/4103780713 >> v2:172.21.15.191:3300/0 conn(0x7f8b0c15a5e0 0x7f8b0c0d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.193+0000 7f8b09ffb700 1 -- 172.21.15.37:0/4103780713 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902514137 0 0) 0x7f8b0c0cb580 con 0x7f8b0c0d0940 2023-10-06T02:24:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.193+0000 7f8b0affd700 1 -- 172.21.15.37:0/4103780713 >> v1:172.21.15.37:6789/0 conn(0x7f8b0c0d0940 legacy=0x7f8b0c0ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.193+0000 7f8b0affd700 1 -- 172.21.15.37:0/4103780713 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c15dd50 con 0x7f8b0c156fa0 2023-10-06T02:24:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.193+0000 7f8b0affd700 1 --2- 172.21.15.37:0/4103780713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c156fa0 0x7f8b0c15d1b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0b3080 tx=0x7f8afc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da8fb044b4c9f59 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.193+0000 7f8b09ffb700 1 -- 172.21.15.37:0/4103780713 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc011630 con 0x7f8b0c156fa0 2023-10-06T02:24:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.193+0000 7f8b09ffb700 1 -- 172.21.15.37:0/4103780713 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc011790 con 0x7f8b0c156fa0 2023-10-06T02:24:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.193+0000 7f8b09ffb700 1 -- 172.21.15.37:0/4103780713 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc011b30 con 0x7f8b0c156fa0 2023-10-06T02:24:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.194+0000 7f8b114eb700 1 -- 172.21.15.37:0/4103780713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c156fa0 msgr2=0x7f8b0c15d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.194+0000 7f8b114eb700 1 --2- 172.21.15.37:0/4103780713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c156fa0 0x7f8b0c15d1b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0b3080 tx=0x7f8afc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.194+0000 7f8b114eb700 1 -- 172.21.15.37:0/4103780713 shutdown_connections 2023-10-06T02:24:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.194+0000 7f8b114eb700 1 --2- 172.21.15.37:0/4103780713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c156fa0 0x7f8b0c15d1b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.194+0000 7f8b114eb700 1 --2- 172.21.15.37:0/4103780713 >> v2:172.21.15.191:3300/0 conn(0x7f8b0c15a5e0 0x7f8b0c0d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.194+0000 7f8b114eb700 1 -- 172.21.15.37:0/4103780713 >> 172.21.15.37:0/4103780713 conn(0x7f8b0c06c0b0 msgr2=0x7f8b0c06c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.194+0000 7f8b114eb700 1 -- 172.21.15.37:0/4103780713 shutdown_connections 2023-10-06T02:24:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.194+0000 7f8b114eb700 1 -- 172.21.15.37:0/4103780713 wait complete. 2023-10-06T02:24:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.195+0000 7f8b114eb700 1 Processor -- start 2023-10-06T02:24:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.195+0000 7f8b114eb700 1 -- start start 2023-10-06T02:24:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.196+0000 7f8b114eb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b0c0d0940 0x7f8b0c0b2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.196+0000 7f8b114eb700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b0c156fa0 0x7f8b0c0c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.196+0000 7f8b114eb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c15a5e0 0x7f8b0c146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.196+0000 7f8b114eb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c0c9ff0 con 0x7f8b0c15a5e0 2023-10-06T02:24:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.196+0000 7f8b114eb700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c0c9180 con 0x7f8b0c0d0940 2023-10-06T02:24:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.196+0000 7f8b114eb700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c0c93e0 con 0x7f8b0c156fa0 2023-10-06T02:24:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.196+0000 7f8b0b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c15a5e0 0x7f8b0c146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.196+0000 7f8b0b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c15a5e0 0x7f8b0c146b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37782/0 (socket says 172.21.15.37:37782) 2023-10-06T02:24:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.196+0000 7f8b0b7fe700 1 -- 172.21.15.37:0/1807551800 learned_addr learned my addr 172.21.15.37:0/1807551800 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.196+0000 7f8b0affd700 1 --2- 172.21.15.37:0/1807551800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b0c0d0940 0x7f8b0c0b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.196+0000 7f8b0a7fc700 1 --2- 172.21.15.37:0/1807551800 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b0c156fa0 0x7f8b0c0c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.196+0000 7f8b0b7fe700 1 -- 172.21.15.37:0/1807551800 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b0c156fa0 msgr2=0x7f8b0c0c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.196+0000 7f8b0b7fe700 1 --2- 172.21.15.37:0/1807551800 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b0c156fa0 0x7f8b0c0c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.196+0000 7f8b0b7fe700 1 -- 172.21.15.37:0/1807551800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b0c0d0940 msgr2=0x7f8b0c0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.196+0000 7f8b0b7fe700 1 --2- 172.21.15.37:0/1807551800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b0c0d0940 0x7f8b0c0b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.196+0000 7f8b0b7fe700 1 -- 172.21.15.37:0/1807551800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc009420 con 0x7f8b0c15a5e0 2023-10-06T02:24:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.196+0000 7f8b0a7fc700 1 --2- 172.21.15.37:0/1807551800 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b0c156fa0 0x7f8b0c0c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.197+0000 7f8b0b7fe700 1 --2- 172.21.15.37:0/1807551800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c15a5e0 0x7f8b0c146b50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400cc90 tx=0x7f8b04001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.197+0000 7f8b02ffd700 1 -- 172.21.15.37:0/1807551800 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0400a960 con 0x7f8b0c15a5e0 2023-10-06T02:24:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.197+0000 7f8b02ffd700 1 -- 172.21.15.37:0/1807551800 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0400aac0 con 0x7f8b0c15a5e0 2023-10-06T02:24:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.197+0000 7f8b114eb700 1 -- 172.21.15.37:0/1807551800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0c0c96c0 con 0x7f8b0c15a5e0 2023-10-06T02:24:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.197+0000 7f8b02ffd700 1 -- 172.21.15.37:0/1807551800 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0400ae80 con 0x7f8b0c15a5e0 2023-10-06T02:24:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.197+0000 7f8b114eb700 1 -- 172.21.15.37:0/1807551800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0c0c9d00 con 0x7f8b0c15a5e0 2023-10-06T02:24:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.198+0000 7f8b114eb700 1 -- 172.21.15.37:0/1807551800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b0c04c3c0 con 0x7f8b0c15a5e0 2023-10-06T02:24:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.198+0000 7f8b02ffd700 1 -- 172.21.15.37:0/1807551800 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b04007300 con 0x7f8b0c15a5e0 2023-10-06T02:24:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.199+0000 7f8b02ffd700 1 --2- 172.21.15.37:0/1807551800 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8aec066f30 0x7f8aec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.199+0000 7f8b02ffd700 1 -- 172.21.15.37:0/1807551800 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8b040846a0 con 0x7f8b0c15a5e0 2023-10-06T02:24:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.199+0000 7f8b0affd700 1 --2- 172.21.15.37:0/1807551800 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8aec066f30 0x7f8aec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.199+0000 7f8b0affd700 1 --2- 172.21.15.37:0/1807551800 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8aec066f30 0x7f8aec0693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0093f0 tx=0x7f8afc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:47.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.203+0000 7f8b02ffd700 1 -- 172.21.15.37:0/1807551800 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b04051b80 con 0x7f8b0c15a5e0 2023-10-06T02:24:47.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.396+0000 7f8b114eb700 1 -- 172.21.15.37:0/1807551800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b0c15e030 con 0x7f8b0c15a5e0 2023-10-06T02:24:47.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.397+0000 7f8b02ffd700 1 -- 172.21.15.37:0/1807551800 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b040551a0 con 0x7f8b0c15a5e0 2023-10-06T02:24:47.398 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T02:24:47.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.399+0000 7f8b114eb700 1 -- 172.21.15.37:0/1807551800 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8aec066f30 msgr2=0x7f8aec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:47.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.399+0000 7f8b114eb700 1 --2- 172.21.15.37:0/1807551800 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8aec066f30 0x7f8aec0693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0093f0 tx=0x7f8afc017000 comp rx=0 tx=0).stop 2023-10-06T02:24:47.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.399+0000 7f8b114eb700 1 -- 172.21.15.37:0/1807551800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c15a5e0 msgr2=0x7f8b0c146b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:47.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.399+0000 7f8b114eb700 1 --2- 172.21.15.37:0/1807551800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c15a5e0 0x7f8b0c146b50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400cc90 tx=0x7f8b04001a80 comp rx=0 tx=0).stop 2023-10-06T02:24:47.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.399+0000 7f8b114eb700 1 -- 172.21.15.37:0/1807551800 shutdown_connections 2023-10-06T02:24:47.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.399+0000 7f8b114eb700 1 --2- 172.21.15.37:0/1807551800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c15a5e0 0x7f8b0c146b50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.399+0000 7f8b114eb700 1 --2- 172.21.15.37:0/1807551800 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8aec066f30 0x7f8aec0693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.399+0000 7f8b114eb700 1 --2- 172.21.15.37:0/1807551800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b0c0d0940 0x7f8b0c0b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.399+0000 7f8b114eb700 1 --2- 172.21.15.37:0/1807551800 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b0c156fa0 0x7f8b0c0c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.399+0000 7f8b114eb700 1 -- 172.21.15.37:0/1807551800 >> 172.21.15.37:0/1807551800 conn(0x7f8b0c06c0b0 msgr2=0x7f8b0c0cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.399+0000 7f8b114eb700 1 -- 172.21.15.37:0/1807551800 shutdown_connections 2023-10-06T02:24:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.399+0000 7f8b114eb700 1 -- 172.21.15.37:0/1807551800 wait complete. 2023-10-06T02:24:47.411 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:24:47.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.530+0000 7f1122ba3700 1 Processor -- start 2023-10-06T02:24:47.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.530+0000 7f1122ba3700 1 -- start start 2023-10-06T02:24:47.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f1122ba3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f111c159760 0x7f111c15d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:47.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f1122ba3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f111c15d8d0 0x7f111c15dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:47.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f1122ba3700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f111c0c5390 0x7f111c0c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f1122ba3700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111c0cc2d0 con 0x7f111c159760 2023-10-06T02:24:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f1122ba3700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111c15e260 con 0x7f111c0c5390 2023-10-06T02:24:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f1122ba3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111c0cb650 con 0x7f111c15d8d0 2023-10-06T02:24:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f112093f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f111c159760 0x7f111c15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f112093f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f111c159760 0x7f111c15d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37788/0 (socket says 172.21.15.37:37788) 2023-10-06T02:24:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f112093f700 1 -- 172.21.15.37:0/3791777475 learned_addr learned my addr 172.21.15.37:0/3791777475 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f111bfff700 1 --2- 172.21.15.37:0/3791777475 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f111c15d8d0 0x7f111c15dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f1121140700 1 --2- 172.21.15.37:0/3791777475 >> v2:172.21.15.191:3300/0 conn(0x7f111c0c5390 0x7f111c0c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:47.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f112093f700 1 -- 172.21.15.37:0/3791777475 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f111c15d8d0 msgr2=0x7f111c15dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:47.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f112093f700 1 --2- 172.21.15.37:0/3791777475 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f111c15d8d0 0x7f111c15dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f112093f700 1 -- 172.21.15.37:0/3791777475 >> v2:172.21.15.191:3300/0 conn(0x7f111c0c5390 msgr2=0x7f111c0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:47.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f112093f700 1 --2- 172.21.15.37:0/3791777475 >> v2:172.21.15.191:3300/0 conn(0x7f111c0c5390 0x7f111c0c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f112093f700 1 -- 172.21.15.37:0/3791777475 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c0cb930 con 0x7f111c159760 2023-10-06T02:24:47.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f111bfff700 1 --2- 172.21.15.37:0/3791777475 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f111c15d8d0 0x7f111c15dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:47.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f1121140700 1 --2- 172.21.15.37:0/3791777475 >> v2:172.21.15.191:3300/0 conn(0x7f111c0c5390 0x7f111c0c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:47.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f112093f700 1 --2- 172.21.15.37:0/3791777475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f111c159760 0x7f111c15d390 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f111c089980 tx=0x7f1104009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ece2f3229c2466a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:47.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f111b7fe700 1 -- 172.21.15.37:0/3791777475 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110400b8f0 con 0x7f111c159760 2023-10-06T02:24:47.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f111b7fe700 1 -- 172.21.15.37:0/3791777475 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110400ba50 con 0x7f111c159760 2023-10-06T02:24:47.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.531+0000 7f111b7fe700 1 -- 172.21.15.37:0/3791777475 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110400bdf0 con 0x7f111c159760 2023-10-06T02:24:47.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.532+0000 7f1122ba3700 1 -- 172.21.15.37:0/3791777475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f111c159760 msgr2=0x7f111c15d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:47.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.532+0000 7f1122ba3700 1 --2- 172.21.15.37:0/3791777475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f111c159760 0x7f111c15d390 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f111c089980 tx=0x7f1104009250 comp rx=0 tx=0).stop 2023-10-06T02:24:47.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.532+0000 7f1122ba3700 1 -- 172.21.15.37:0/3791777475 shutdown_connections 2023-10-06T02:24:47.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.532+0000 7f1122ba3700 1 --2- 172.21.15.37:0/3791777475 >> v2:172.21.15.191:3300/0 conn(0x7f111c0c5390 0x7f111c0c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.532+0000 7f1122ba3700 1 --2- 172.21.15.37:0/3791777475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f111c159760 0x7f111c15d390 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.532+0000 7f1122ba3700 1 --2- 172.21.15.37:0/3791777475 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f111c15d8d0 0x7f111c15dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.532+0000 7f1122ba3700 1 -- 172.21.15.37:0/3791777475 >> 172.21.15.37:0/3791777475 conn(0x7f111c06c890 msgr2=0x7f111c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:47.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.532+0000 7f1122ba3700 1 -- 172.21.15.37:0/3791777475 shutdown_connections 2023-10-06T02:24:47.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.532+0000 7f1122ba3700 1 -- 172.21.15.37:0/3791777475 wait complete. 2023-10-06T02:24:47.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.533+0000 7f1122ba3700 1 Processor -- start 2023-10-06T02:24:47.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.533+0000 7f1122ba3700 1 -- start start 2023-10-06T02:24:47.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.534+0000 7f1122ba3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f111c0c5390 0x7f111c15c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:47.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.534+0000 7f1122ba3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f111c159760 0x7f111c15a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:47.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.534+0000 7f1122ba3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f111c15d8d0 0x7f111c0b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:47.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.534+0000 7f1122ba3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c15a1e0 con 0x7f111c15d8d0 2023-10-06T02:24:47.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.534+0000 7f1122ba3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c159bd0 con 0x7f111c159760 2023-10-06T02:24:47.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.534+0000 7f1122ba3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111c152920 con 0x7f111c0c5390 2023-10-06T02:24:47.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.534+0000 7f1121140700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f111c15d8d0 0x7f111c0b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:47.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.534+0000 7f1121140700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f111c15d8d0 0x7f111c0b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37798/0 (socket says 172.21.15.37:37798) 2023-10-06T02:24:47.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.534+0000 7f1121140700 1 -- 172.21.15.37:0/3579475698 learned_addr learned my addr 172.21.15.37:0/3579475698 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:47.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.534+0000 7f112093f700 1 --2- 172.21.15.37:0/3579475698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f111c0c5390 0x7f111c15c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:47.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.534+0000 7f111bfff700 1 --2- 172.21.15.37:0/3579475698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f111c159760 0x7f111c15a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:47.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.534+0000 7f1121140700 1 -- 172.21.15.37:0/3579475698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f111c0c5390 msgr2=0x7f111c15c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:47.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.534+0000 7f1121140700 1 --2- 172.21.15.37:0/3579475698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f111c0c5390 0x7f111c15c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.535+0000 7f1121140700 1 -- 172.21.15.37:0/3579475698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f111c159760 msgr2=0x7f111c15a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:47.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.535+0000 7f1121140700 1 --2- 172.21.15.37:0/3579475698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f111c159760 0x7f111c15a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.535+0000 7f1121140700 1 -- 172.21.15.37:0/3579475698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11040094f0 con 0x7f111c15d8d0 2023-10-06T02:24:47.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.535+0000 7f1121140700 1 --2- 172.21.15.37:0/3579475698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f111c15d8d0 0x7f111c0b3300 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f111400ce40 tx=0x7f11140077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:47.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.535+0000 7f1118ff9700 1 -- 172.21.15.37:0/3579475698 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111400ac70 con 0x7f111c15d8d0 2023-10-06T02:24:47.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.535+0000 7f1118ff9700 1 -- 172.21.15.37:0/3579475698 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111400adf0 con 0x7f111c15d8d0 2023-10-06T02:24:47.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.535+0000 7f1122ba3700 1 -- 172.21.15.37:0/3579475698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111c15c720 con 0x7f111c15d8d0 2023-10-06T02:24:47.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.535+0000 7f1118ff9700 1 -- 172.21.15.37:0/3579475698 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1114016670 con 0x7f111c15d8d0 2023-10-06T02:24:47.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.535+0000 7f1122ba3700 1 -- 172.21.15.37:0/3579475698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111c15ca80 con 0x7f111c15d8d0 2023-10-06T02:24:47.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.536+0000 7f1122ba3700 1 -- 172.21.15.37:0/3579475698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f111c15a350 con 0x7f111c15d8d0 2023-10-06T02:24:47.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.536+0000 7f1118ff9700 1 -- 172.21.15.37:0/3579475698 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f11140169e0 con 0x7f111c15d8d0 2023-10-06T02:24:47.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.537+0000 7f1118ff9700 1 --2- 172.21.15.37:0/3579475698 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f10fc066f30 0x7f10fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:47.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.537+0000 7f1118ff9700 1 -- 172.21.15.37:0/3579475698 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1114012070 con 0x7f111c15d8d0 2023-10-06T02:24:47.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.537+0000 7f112093f700 1 --2- 172.21.15.37:0/3579475698 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f10fc066f30 0x7f10fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:47.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.537+0000 7f112093f700 1 --2- 172.21.15.37:0/3579475698 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f10fc066f30 0x7f10fc0693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f111c089980 tx=0x7f1104017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:47.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.541+0000 7f1118ff9700 1 -- 172.21.15.37:0/3579475698 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f111404e5a0 con 0x7f111c15d8d0 2023-10-06T02:24:47.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.737+0000 7f1122ba3700 1 -- 172.21.15.37:0/3579475698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f111c06fbf0 con 0x7f111c15d8d0 2023-10-06T02:24:47.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.737+0000 7f1118ff9700 1 -- 172.21.15.37:0/3579475698 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v39) v1 ==== 84+0+126 (secure 0 0 0) 0x7f1114051f80 con 0x7f111c15d8d0 2023-10-06T02:24:47.738 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:47.738 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-10-06T02:24:47.738 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:47.738 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-10-06T02:24:47.738 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-10-06T02:24:47.738 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:47.738 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:47.739 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-10-06T02:24:47.739 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-10-06T02:24:47.739 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:47.739 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-10-06T02:24:47.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.739+0000 7f1122ba3700 1 -- 172.21.15.37:0/3579475698 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f10fc066f30 msgr2=0x7f10fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:47.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.739+0000 7f1122ba3700 1 --2- 172.21.15.37:0/3579475698 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f10fc066f30 0x7f10fc0693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f111c089980 tx=0x7f1104017000 comp rx=0 tx=0).stop 2023-10-06T02:24:47.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.739+0000 7f1122ba3700 1 -- 172.21.15.37:0/3579475698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f111c15d8d0 msgr2=0x7f111c0b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:47.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.739+0000 7f1122ba3700 1 --2- 172.21.15.37:0/3579475698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f111c15d8d0 0x7f111c0b3300 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f111400ce40 tx=0x7f11140077d0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.739+0000 7f1122ba3700 1 -- 172.21.15.37:0/3579475698 shutdown_connections 2023-10-06T02:24:47.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.739+0000 7f1122ba3700 1 --2- 172.21.15.37:0/3579475698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f111c15d8d0 0x7f111c0b3300 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.739+0000 7f1122ba3700 1 --2- 172.21.15.37:0/3579475698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f111c0c5390 0x7f111c15c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.739+0000 7f1122ba3700 1 --2- 172.21.15.37:0/3579475698 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f10fc066f30 0x7f10fc0693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.739+0000 7f1122ba3700 1 --2- 172.21.15.37:0/3579475698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f111c159760 0x7f111c15a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.739+0000 7f1122ba3700 1 -- 172.21.15.37:0/3579475698 >> 172.21.15.37:0/3579475698 conn(0x7f111c06c890 msgr2=0x7f111c06e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:47.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.739+0000 7f1122ba3700 1 -- 172.21.15.37:0/3579475698 shutdown_connections 2023-10-06T02:24:47.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.739+0000 7f1122ba3700 1 -- 172.21.15.37:0/3579475698 wait complete. 2023-10-06T02:24:47.751 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:24:47.752 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:24:47.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.875+0000 7fa22e078700 1 Processor -- start 2023-10-06T02:24:47.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.875+0000 7fa22e078700 1 -- start start 2023-10-06T02:24:47.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.876+0000 7fa22e078700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2281599c0 0x7fa22806d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:47.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.876+0000 7fa22e078700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22806e1b0 con 0x7fa2281595f0 2023-10-06T02:24:47.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.876+0000 7fa22e078700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22815d710 con 0x7fa22806dd70 2023-10-06T02:24:47.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.876+0000 7fa22e078700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280cb320 con 0x7fa2281599c0 2023-10-06T02:24:47.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.876+0000 7fa2277fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa2281595f0 0x7fa2280b0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39140/0 (socket says 172.21.15.37:39140) 2023-10-06T02:24:47.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.876+0000 7fa2277fe700 1 -- 172.21.15.37:0/1269413955 learned_addr learned my addr 172.21.15.37:0/1269413955 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:47.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.876+0000 7fa226ffd700 1 --2- 172.21.15.37:0/1269413955 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2281599c0 0x7fa22806d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:47.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.876+0000 7fa2267fc700 1 -- 172.21.15.37:0/1269413955 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752058139 0 0) 0x7fa22806e1b0 con 0x7fa2281595f0 2023-10-06T02:24:47.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.876+0000 7fa2267fc700 1 -- 172.21.15.37:0/1269413955 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa210003570 con 0x7fa2281595f0 2023-10-06T02:24:47.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.876+0000 7fa2267fc700 1 -- 172.21.15.37:0/1269413955 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1805759576 0 0) 0x7fa210003570 con 0x7fa2281595f0 2023-10-06T02:24:47.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.876+0000 7fa226ffd700 1 -- 172.21.15.37:0/1269413955 >> v1:172.21.15.191:6789/0 conn(0x7fa22806dd70 legacy=0x7fa2280cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:47.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.876+0000 7fa226ffd700 1 -- 172.21.15.37:0/1269413955 >> v1:172.21.15.37:6789/0 conn(0x7fa2281595f0 legacy=0x7fa2280b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:47.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.876+0000 7fa226ffd700 1 -- 172.21.15.37:0/1269413955 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22815d9f0 con 0x7fa2281599c0 2023-10-06T02:24:47.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.876+0000 7fa226ffd700 1 --2- 172.21.15.37:0/1269413955 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2281599c0 0x7fa22806d830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa21c009910 tx=0x7fa21c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fea99a6a670ef9b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:47.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.877+0000 7fa2267fc700 1 -- 172.21.15.37:0/1269413955 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa218001470 con 0x7fa2281599c0 2023-10-06T02:24:47.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.877+0000 7fa2267fc700 1 -- 172.21.15.37:0/1269413955 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21c011420 con 0x7fa2281599c0 2023-10-06T02:24:47.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.877+0000 7fa2267fc700 1 -- 172.21.15.37:0/1269413955 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c0117a0 con 0x7fa2281599c0 2023-10-06T02:24:47.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.877+0000 7fa22e078700 1 -- 172.21.15.37:0/1269413955 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2281599c0 msgr2=0x7fa22806d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:47.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.877+0000 7fa22e078700 1 --2- 172.21.15.37:0/1269413955 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2281599c0 0x7fa22806d830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa21c009910 tx=0x7fa21c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.877+0000 7fa22e078700 1 -- 172.21.15.37:0/1269413955 shutdown_connections 2023-10-06T02:24:47.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.877+0000 7fa22e078700 1 --2- 172.21.15.37:0/1269413955 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2281599c0 0x7fa22806d830 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.877+0000 7fa22e078700 1 -- 172.21.15.37:0/1269413955 >> 172.21.15.37:0/1269413955 conn(0x7fa2280ccf90 msgr2=0x7fa2280cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:47.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.877+0000 7fa22e078700 1 -- 172.21.15.37:0/1269413955 shutdown_connections 2023-10-06T02:24:47.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.877+0000 7fa22e078700 1 -- 172.21.15.37:0/1269413955 wait complete. 2023-10-06T02:24:47.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.878+0000 7fa22e078700 1 Processor -- start 2023-10-06T02:24:47.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.879+0000 7fa22e078700 1 -- start start 2023-10-06T02:24:47.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.879+0000 7fa22e078700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa22806dd70 0x7fa2280c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:47.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.879+0000 7fa22e078700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2281595f0 0x7fa22816a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:47.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.879+0000 7fa22e078700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2281599c0 0x7fa22816a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:47.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.879+0000 7fa22e078700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22815bf20 con 0x7fa2281599c0 2023-10-06T02:24:47.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.879+0000 7fa22e078700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22815b310 con 0x7fa22806dd70 2023-10-06T02:24:47.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.879+0000 7fa22e078700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22815b5f0 con 0x7fa2281595f0 2023-10-06T02:24:47.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.879+0000 7fa227fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2281599c0 0x7fa22816a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:47.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.879+0000 7fa227fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2281599c0 0x7fa22816a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37806/0 (socket says 172.21.15.37:37806) 2023-10-06T02:24:47.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.879+0000 7fa227fff700 1 -- 172.21.15.37:0/3529984711 learned_addr learned my addr 172.21.15.37:0/3529984711 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:47.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.879+0000 7fa2277fe700 1 --2- 172.21.15.37:0/3529984711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa22806dd70 0x7fa2280c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:47.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.880+0000 7fa226ffd700 1 --2- 172.21.15.37:0/3529984711 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2281595f0 0x7fa22816a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:47.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.880+0000 7fa227fff700 1 -- 172.21.15.37:0/3529984711 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2281595f0 msgr2=0x7fa22816a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:47.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.880+0000 7fa227fff700 1 --2- 172.21.15.37:0/3529984711 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2281595f0 0x7fa22816a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.880+0000 7fa227fff700 1 -- 172.21.15.37:0/3529984711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa22806dd70 msgr2=0x7fa2280c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:47.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.880+0000 7fa227fff700 1 --2- 172.21.15.37:0/3529984711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa22806dd70 0x7fa2280c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:47.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.880+0000 7fa227fff700 1 -- 172.21.15.37:0/3529984711 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c009420 con 0x7fa2281599c0 2023-10-06T02:24:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.880+0000 7fa2277fe700 1 --2- 172.21.15.37:0/3529984711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa22806dd70 0x7fa2280c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.880+0000 7fa227fff700 1 --2- 172.21.15.37:0/3529984711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2281599c0 0x7fa22816a650 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa22000c8e0 tx=0x7fa2200016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.880+0000 7fa20f7fe700 1 -- 172.21.15.37:0/3529984711 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22000ce80 con 0x7fa2281599c0 2023-10-06T02:24:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.880+0000 7fa20f7fe700 1 -- 172.21.15.37:0/3529984711 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22000a7e0 con 0x7fa2281599c0 2023-10-06T02:24:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.880+0000 7fa20f7fe700 1 -- 172.21.15.37:0/3529984711 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22000ab80 con 0x7fa2281599c0 2023-10-06T02:24:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.880+0000 7fa22e078700 1 -- 172.21.15.37:0/3529984711 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22815b8d0 con 0x7fa2281599c0 2023-10-06T02:24:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.880+0000 7fa22e078700 1 -- 172.21.15.37:0/3529984711 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22814ddc0 con 0x7fa2281599c0 2023-10-06T02:24:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.881+0000 7fa22e078700 1 -- 172.21.15.37:0/3529984711 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa22815c090 con 0x7fa2281599c0 2023-10-06T02:24:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.881+0000 7fa20f7fe700 1 -- 172.21.15.37:0/3529984711 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa220012420 con 0x7fa2281599c0 2023-10-06T02:24:47.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.882+0000 7fa20f7fe700 1 --2- 172.21.15.37:0/3529984711 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa214066f60 0x7fa214069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:47.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.882+0000 7fa20f7fe700 1 -- 172.21.15.37:0/3529984711 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa220084610 con 0x7fa2281599c0 2023-10-06T02:24:47.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.882+0000 7fa2277fe700 1 --2- 172.21.15.37:0/3529984711 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa214066f60 0x7fa214069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:47.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.882+0000 7fa2277fe700 1 --2- 172.21.15.37:0/3529984711 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa214066f60 0x7fa214069410 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa2180015a0 tx=0x7fa218000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:47.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:47.886+0000 7fa20f7fe700 1 -- 172.21.15.37:0/3529984711 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa220051a70 con 0x7fa2281599c0 2023-10-06T02:24:48.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:48.079+0000 7fa22e078700 1 -- 172.21.15.37:0/3529984711 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa22804bb80 con 0x7fa2281599c0 2023-10-06T02:24:48.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:48.963+0000 7fa20f7fe700 1 -- 172.21.15.37:0/3529984711 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v40) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa220055090 con 0x7fa2281599c0 2023-10-06T02:24:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:48.968+0000 7fa22e078700 1 -- 172.21.15.37:0/3529984711 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa214066f60 msgr2=0x7fa214069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:48.968+0000 7fa22e078700 1 --2- 172.21.15.37:0/3529984711 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa214066f60 0x7fa214069410 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa2180015a0 tx=0x7fa218000bc0 comp rx=0 tx=0).stop 2023-10-06T02:24:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:48.968+0000 7fa22e078700 1 -- 172.21.15.37:0/3529984711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2281599c0 msgr2=0x7fa22816a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:48.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:48.968+0000 7fa22e078700 1 --2- 172.21.15.37:0/3529984711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2281599c0 0x7fa22816a650 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa22000c8e0 tx=0x7fa2200016c0 comp rx=0 tx=0).stop 2023-10-06T02:24:48.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:48.968+0000 7fa22e078700 1 -- 172.21.15.37:0/3529984711 shutdown_connections 2023-10-06T02:24:48.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:48.968+0000 7fa22e078700 1 --2- 172.21.15.37:0/3529984711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2281599c0 0x7fa22816a650 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:48.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:48.968+0000 7fa22e078700 1 --2- 172.21.15.37:0/3529984711 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa214066f60 0x7fa214069410 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:48.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:48.968+0000 7fa22e078700 1 --2- 172.21.15.37:0/3529984711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa22806dd70 0x7fa2280c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:48.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:48.968+0000 7fa22e078700 1 --2- 172.21.15.37:0/3529984711 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2281595f0 0x7fa22816a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:48.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:48.968+0000 7fa22e078700 1 -- 172.21.15.37:0/3529984711 >> 172.21.15.37:0/3529984711 conn(0x7fa2280ccf90 msgr2=0x7fa2280b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:48.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:48.968+0000 7fa22e078700 1 -- 172.21.15.37:0/3529984711 shutdown_connections 2023-10-06T02:24:48.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:48.968+0000 7fa22e078700 1 -- 172.21.15.37:0/3529984711 wait complete. 2023-10-06T02:24:48.971 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-10-06T02:24:48.984 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:24:49.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.114+0000 7f2dbe5bc700 1 Processor -- start 2023-10-06T02:24:49.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.114+0000 7f2dbe5bc700 1 -- start start 2023-10-06T02:24:49.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2dbe5bc700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2db8142c60 0x7f2db80c8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:49.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2dbe5bc700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db806d910 con 0x7f2db80cc600 2023-10-06T02:24:49.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2dbe5bc700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db80cb120 con 0x7f2db8143030 2023-10-06T02:24:49.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2dbe5bc700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db80cb400 con 0x7f2db8142c60 2023-10-06T02:24:49.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2dbcb59700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2db80cc600 0x7f2db806dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39146/0 (socket says 172.21.15.37:39146) 2023-10-06T02:24:49.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2dbcb59700 1 -- 172.21.15.37:0/2924320615 learned_addr learned my addr 172.21.15.37:0/2924320615 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:49.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2db7fff700 1 --2- 172.21.15.37:0/2924320615 >> v2:172.21.15.191:3300/0 conn(0x7f2db8142c60 0x7f2db80c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:49.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2db6ffd700 1 -- 172.21.15.37:0/2924320615 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819338044 0 0) 0x7f2db806d910 con 0x7f2db80cc600 2023-10-06T02:24:49.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2db6ffd700 1 -- 172.21.15.37:0/2924320615 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da0003570 con 0x7f2db80cc600 2023-10-06T02:24:49.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2db6ffd700 1 -- 172.21.15.37:0/2924320615 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3049342557 0 0) 0x7f2da0003570 con 0x7f2db80cc600 2023-10-06T02:24:49.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2db6ffd700 1 -- 172.21.15.37:0/2924320615 >> v2:172.21.15.191:3300/0 conn(0x7f2db8142c60 msgr2=0x7f2db80c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:49.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2db6ffd700 1 --2- 172.21.15.37:0/2924320615 >> v2:172.21.15.191:3300/0 conn(0x7f2db8142c60 0x7f2db80c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:49.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2db6ffd700 1 -- 172.21.15.37:0/2924320615 >> v1:172.21.15.191:6789/0 conn(0x7f2db8143030 legacy=0x7f2db80cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:49.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2db6ffd700 1 -- 172.21.15.37:0/2924320615 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db80cb6e0 con 0x7f2db80cc600 2023-10-06T02:24:49.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2db6ffd700 1 -- 172.21.15.37:0/2924320615 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f2db00017f0 con 0x7f2db80cc600 2023-10-06T02:24:49.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2db6ffd700 1 -- 172.21.15.37:0/2924320615 >> v1:172.21.15.37:6789/0 conn(0x7f2db80cc600 legacy=0x7f2db806dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:49.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2db6ffd700 1 --2- 172.21.15.37:0/2924320615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da0003a60 0x7f2da0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:49.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2db6ffd700 1 --2- 172.21.15.37:0/2924320615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2da0004810 0x7f2da0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:49.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2db6ffd700 1 --2- 172.21.15.37:0/2924320615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2da00051c0 0x7f2da000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:49.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2db6ffd700 1 -- 172.21.15.37:0/2924320615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db80cb400 con 0x7f2da0003a60 2023-10-06T02:24:49.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2db6ffd700 1 -- 172.21.15.37:0/2924320615 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da000c0d0 con 0x7f2da0004810 2023-10-06T02:24:49.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2db6ffd700 1 -- 172.21.15.37:0/2924320615 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da000c290 con 0x7f2da00051c0 2023-10-06T02:24:49.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.115+0000 7f2db7fff700 1 --2- 172.21.15.37:0/2924320615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da0003a60 0x7f2da0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:49.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.116+0000 7f2db77fe700 1 --2- 172.21.15.37:0/2924320615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2da0004810 0x7f2da0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:49.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.116+0000 7f2dbcb59700 1 --2- 172.21.15.37:0/2924320615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2da00051c0 0x7f2da000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:49.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.116+0000 7f2db7fff700 1 -- 172.21.15.37:0/2924320615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2da00051c0 msgr2=0x7f2da000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:49.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.116+0000 7f2db7fff700 1 --2- 172.21.15.37:0/2924320615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2da00051c0 0x7f2da000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:49.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.116+0000 7f2db7fff700 1 -- 172.21.15.37:0/2924320615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2da0004810 msgr2=0x7f2da0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:49.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.116+0000 7f2db7fff700 1 --2- 172.21.15.37:0/2924320615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2da0004810 0x7f2da0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:49.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.116+0000 7f2db7fff700 1 -- 172.21.15.37:0/2924320615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da0003570 con 0x7f2da0003a60 2023-10-06T02:24:49.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.116+0000 7f2dbcb59700 1 --2- 172.21.15.37:0/2924320615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2da00051c0 0x7f2da000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:49.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.116+0000 7f2dbcb59700 1 -- 172.21.15.37:0/2924320615 reap_dead start 2023-10-06T02:24:49.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.116+0000 7f2db7fff700 1 --2- 172.21.15.37:0/2924320615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da0003a60 0x7f2da0003e70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009c00 tx=0x7f2dac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16edca964f8f6a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:49.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.116+0000 7f2db6ffd700 1 -- 172.21.15.37:0/2924320615 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac00e710 con 0x7f2da0003a60 2023-10-06T02:24:49.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.116+0000 7f2db6ffd700 1 -- 172.21.15.37:0/2924320615 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dac00e870 con 0x7f2da0003a60 2023-10-06T02:24:49.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.116+0000 7f2db6ffd700 1 -- 172.21.15.37:0/2924320615 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac00ec30 con 0x7f2da0003a60 2023-10-06T02:24:49.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.117+0000 7f2dbe5bc700 1 -- 172.21.15.37:0/2924320615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da0003a60 msgr2=0x7f2da0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:49.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.117+0000 7f2dbe5bc700 1 --2- 172.21.15.37:0/2924320615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da0003a60 0x7f2da0003e70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009c00 tx=0x7f2dac0091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:49.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.117+0000 7f2dbe5bc700 1 -- 172.21.15.37:0/2924320615 shutdown_connections 2023-10-06T02:24:49.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.117+0000 7f2dbe5bc700 1 --2- 172.21.15.37:0/2924320615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da0003a60 0x7f2da0003e70 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:49.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.117+0000 7f2dbe5bc700 1 -- 172.21.15.37:0/2924320615 >> 172.21.15.37:0/2924320615 conn(0x7f2db8067b10 msgr2=0x7f2db8067f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:49.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.117+0000 7f2dbe5bc700 1 -- 172.21.15.37:0/2924320615 shutdown_connections 2023-10-06T02:24:49.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.117+0000 7f2dbe5bc700 1 -- 172.21.15.37:0/2924320615 wait complete. 2023-10-06T02:24:49.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.118+0000 7f2dbe5bc700 1 Processor -- start 2023-10-06T02:24:49.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.118+0000 7f2dbe5bc700 1 -- start start 2023-10-06T02:24:49.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2dbe5bc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2da0003a60 0x7f2db815c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:49.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2dbe5bc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db80b1d00 0x7f2db80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:49.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2dbe5bc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2db80af480 0x7f2db80af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:49.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2dbe5bc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db80b26b0 con 0x7f2db80b1d00 2023-10-06T02:24:49.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2dbe5bc700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db813a9c0 con 0x7f2da0003a60 2023-10-06T02:24:49.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2dbe5bc700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db80b0120 con 0x7f2db80af480 2023-10-06T02:24:49.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2db77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db80b1d00 0x7f2db80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:49.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2db77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db80b1d00 0x7f2db80b2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37828/0 (socket says 172.21.15.37:37828) 2023-10-06T02:24:49.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2db77fe700 1 -- 172.21.15.37:0/2940972732 learned_addr learned my addr 172.21.15.37:0/2940972732 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:49.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2db7fff700 1 --2- 172.21.15.37:0/2940972732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2da0003a60 0x7f2db815c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:49.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2dbcb59700 1 --2- 172.21.15.37:0/2940972732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2db80af480 0x7f2db80af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:49.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2db77fe700 1 -- 172.21.15.37:0/2940972732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2db80af480 msgr2=0x7f2db80af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:49.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2db77fe700 1 --2- 172.21.15.37:0/2940972732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2db80af480 0x7f2db80af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:49.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2db77fe700 1 -- 172.21.15.37:0/2940972732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2da0003a60 msgr2=0x7f2db815c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:49.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2db77fe700 1 --2- 172.21.15.37:0/2940972732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2da0003a60 0x7f2db815c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:49.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2db77fe700 1 -- 172.21.15.37:0/2940972732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db80b0400 con 0x7f2db80b1d00 2023-10-06T02:24:49.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2db77fe700 1 --2- 172.21.15.37:0/2940972732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db80b1d00 0x7f2db80b2170 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2da8002950 tx=0x7f2da8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:49.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2d9ffff700 1 -- 172.21.15.37:0/2940972732 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da8002e90 con 0x7f2db80b1d00 2023-10-06T02:24:49.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2d9ffff700 1 -- 172.21.15.37:0/2940972732 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da800f8d0 con 0x7f2db80b1d00 2023-10-06T02:24:49.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2d9ffff700 1 -- 172.21.15.37:0/2940972732 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da800fc90 con 0x7f2db80b1d00 2023-10-06T02:24:49.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2dbe5bc700 1 -- 172.21.15.37:0/2940972732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db80b06e0 con 0x7f2db80b1d00 2023-10-06T02:24:49.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.119+0000 7f2dbe5bc700 1 -- 172.21.15.37:0/2940972732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db80afe30 con 0x7f2db80b1d00 2023-10-06T02:24:49.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.120+0000 7f2dbe5bc700 1 -- 172.21.15.37:0/2940972732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db813ab30 con 0x7f2db80b1d00 2023-10-06T02:24:49.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.121+0000 7f2d9ffff700 1 -- 172.21.15.37:0/2940972732 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2da8006a30 con 0x7f2db80b1d00 2023-10-06T02:24:49.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.121+0000 7f2d9ffff700 1 --2- 172.21.15.37:0/2940972732 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2da4066f30 0x7f2da40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:49.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.121+0000 7f2d9ffff700 1 -- 172.21.15.37:0/2940972732 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f2da80844b0 con 0x7f2db80b1d00 2023-10-06T02:24:49.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.122+0000 7f2db7fff700 1 --2- 172.21.15.37:0/2940972732 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2da4066f30 0x7f2da40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:49.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.122+0000 7f2db7fff700 1 --2- 172.21.15.37:0/2940972732 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2da4066f30 0x7f2da40693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2dac0091e0 tx=0x7f2dac01a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:49.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.126+0000 7f2d9ffff700 1 -- 172.21.15.37:0/2940972732 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2da80517a0 con 0x7f2db80b1d00 2023-10-06T02:24:49.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.318+0000 7f2dbe5bc700 1 -- 172.21.15.37:0/2940972732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2db804c3c0 con 0x7f2db80b1d00 2023-10-06T02:24:49.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.967+0000 7f2d9ffff700 1 -- 172.21.15.37:0/2940972732 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v41) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2da8054dc0 con 0x7f2db80b1d00 2023-10-06T02:24:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.972+0000 7f2dbe5bc700 1 -- 172.21.15.37:0/2940972732 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2da4066f30 msgr2=0x7f2da40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.972+0000 7f2dbe5bc700 1 --2- 172.21.15.37:0/2940972732 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2da4066f30 0x7f2da40693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2dac0091e0 tx=0x7f2dac01a000 comp rx=0 tx=0).stop 2023-10-06T02:24:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.972+0000 7f2dbe5bc700 1 -- 172.21.15.37:0/2940972732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db80b1d00 msgr2=0x7f2db80b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.972+0000 7f2dbe5bc700 1 --2- 172.21.15.37:0/2940972732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db80b1d00 0x7f2db80b2170 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2da8002950 tx=0x7f2da8007d30 comp rx=0 tx=0).stop 2023-10-06T02:24:49.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.974+0000 7f2dbe5bc700 1 -- 172.21.15.37:0/2940972732 shutdown_connections 2023-10-06T02:24:49.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.974+0000 7f2dbe5bc700 1 --2- 172.21.15.37:0/2940972732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2db80af480 0x7f2db80af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:49.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.974+0000 7f2dbe5bc700 1 --2- 172.21.15.37:0/2940972732 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2da4066f30 0x7f2da40693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:49.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.974+0000 7f2dbe5bc700 1 --2- 172.21.15.37:0/2940972732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2da0003a60 0x7f2db815c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:49.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.974+0000 7f2dbe5bc700 1 --2- 172.21.15.37:0/2940972732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db80b1d00 0x7f2db80b2170 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:49.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.974+0000 7f2dbe5bc700 1 -- 172.21.15.37:0/2940972732 >> 172.21.15.37:0/2940972732 conn(0x7f2db8067b10 msgr2=0x7f2db80b3970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:49.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.976+0000 7f2dbe5bc700 1 -- 172.21.15.37:0/2940972732 shutdown_connections 2023-10-06T02:24:49.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:49.976+0000 7f2dbe5bc700 1 -- 172.21.15.37:0/2940972732 wait complete. 2023-10-06T02:24:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-10-06T02:24:50.002 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:24:50.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.128+0000 7f9b6310b700 1 Processor -- start 2023-10-06T02:24:50.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.128+0000 7f9b6310b700 1 -- start start 2023-10-06T02:24:50.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.129+0000 7f9b6310b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9b5c14e2a0 0x7f9b5c0ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:50.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.129+0000 7f9b6310b700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5c1587a0 con 0x7f9b5c14e670 2023-10-06T02:24:50.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.129+0000 7f9b6310b700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5c157b90 con 0x7f9b5c0b3e80 2023-10-06T02:24:50.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.129+0000 7f9b6310b700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5c157e70 con 0x7f9b5c14e2a0 2023-10-06T02:24:50.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.129+0000 7f9b60ea7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9b5c14e2a0 0x7f9b5c0ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:50.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.129+0000 7f9b60ea7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9b5c14e2a0 0x7f9b5c0ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37830/0 (socket says 172.21.15.37:37830) 2023-10-06T02:24:50.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.129+0000 7f9b60ea7700 1 -- 172.21.15.37:0/4129816930 learned_addr learned my addr 172.21.15.37:0/4129816930 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:50.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.130+0000 7f9b60ea7700 1 -- 172.21.15.37:0/4129816930 >> v1:172.21.15.191:6789/0 conn(0x7f9b5c0b3e80 legacy=0x7f9b5c0cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:50.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.130+0000 7f9b60ea7700 1 -- 172.21.15.37:0/4129816930 >> v1:172.21.15.37:6789/0 conn(0x7f9b5c14e670 legacy=0x7f9b5c0b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:50.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.130+0000 7f9b60ea7700 1 -- 172.21.15.37:0/4129816930 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c158150 con 0x7f9b5c14e2a0 2023-10-06T02:24:50.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.130+0000 7f9b5b7fe700 1 -- 172.21.15.37:0/4129816930 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187475630 0 0) 0x7f9b5c1587a0 con 0x7f9b5c14e670 2023-10-06T02:24:50.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.130+0000 7f9b60ea7700 1 --2- 172.21.15.37:0/4129816930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b5c14e2a0 0x7f9b5c0ce910 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0099b0 tx=0x7f9b4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7df696c79aa5a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:50.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.130+0000 7f9b5b7fe700 1 -- 172.21.15.37:0/4129816930 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c00b820 con 0x7f9b5c14e2a0 2023-10-06T02:24:50.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.130+0000 7f9b5b7fe700 1 -- 172.21.15.37:0/4129816930 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c00b980 con 0x7f9b5c14e2a0 2023-10-06T02:24:50.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.130+0000 7f9b5b7fe700 1 -- 172.21.15.37:0/4129816930 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c00bd20 con 0x7f9b5c14e2a0 2023-10-06T02:24:50.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.131+0000 7f9b6310b700 1 -- 172.21.15.37:0/4129816930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b5c14e2a0 msgr2=0x7f9b5c0ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:50.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.131+0000 7f9b6310b700 1 --2- 172.21.15.37:0/4129816930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b5c14e2a0 0x7f9b5c0ce910 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0099b0 tx=0x7f9b4c009250 comp rx=0 tx=0).stop 2023-10-06T02:24:50.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.131+0000 7f9b6310b700 1 -- 172.21.15.37:0/4129816930 shutdown_connections 2023-10-06T02:24:50.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.131+0000 7f9b6310b700 1 --2- 172.21.15.37:0/4129816930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b5c14e2a0 0x7f9b5c0ce910 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.131+0000 7f9b6310b700 1 -- 172.21.15.37:0/4129816930 >> 172.21.15.37:0/4129816930 conn(0x7f9b5c06c0b0 msgr2=0x7f9b5c06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:50.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.131+0000 7f9b6310b700 1 -- 172.21.15.37:0/4129816930 shutdown_connections 2023-10-06T02:24:50.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.131+0000 7f9b6310b700 1 -- 172.21.15.37:0/4129816930 wait complete. 2023-10-06T02:24:50.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.132+0000 7f9b6310b700 1 Processor -- start 2023-10-06T02:24:50.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.132+0000 7f9b6310b700 1 -- start start 2023-10-06T02:24:50.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b6310b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b5c0b3e80 0x7f9b5c1511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:50.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b6310b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b5c14e2a0 0x7f9b5c158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:50.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b6310b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b5c14e670 0x7f9b5c148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:50.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b6310b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c16bc30 con 0x7f9b5c0b3e80 2023-10-06T02:24:50.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b6310b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c16b0b0 con 0x7f9b5c14e2a0 2023-10-06T02:24:50.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b6310b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c16b390 con 0x7f9b5c14e670 2023-10-06T02:24:50.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b60ea7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b5c0b3e80 0x7f9b5c1511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:50.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b60ea7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b5c0b3e80 0x7f9b5c1511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37846/0 (socket says 172.21.15.37:37846) 2023-10-06T02:24:50.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b60ea7700 1 -- 172.21.15.37:0/3672016072 learned_addr learned my addr 172.21.15.37:0/3672016072 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:50.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b616a8700 1 --2- 172.21.15.37:0/3672016072 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b5c14e670 0x7f9b5c148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:50.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b5bfff700 1 --2- 172.21.15.37:0/3672016072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b5c14e2a0 0x7f9b5c158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:50.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b60ea7700 1 -- 172.21.15.37:0/3672016072 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b5c14e670 msgr2=0x7f9b5c148e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:50.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b60ea7700 1 --2- 172.21.15.37:0/3672016072 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b5c14e670 0x7f9b5c148e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b60ea7700 1 -- 172.21.15.37:0/3672016072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b5c14e2a0 msgr2=0x7f9b5c158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:50.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b60ea7700 1 --2- 172.21.15.37:0/3672016072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b5c14e2a0 0x7f9b5c158d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:50.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b60ea7700 1 -- 172.21.15.37:0/3672016072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c0094f0 con 0x7f9b5c0b3e80 2023-10-06T02:24:50.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b60ea7700 1 --2- 172.21.15.37:0/3672016072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b5c0b3e80 0x7f9b5c1511b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009290 tx=0x7f9b4c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:50.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b58ff9700 1 -- 172.21.15.37:0/3672016072 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c00bc40 con 0x7f9b5c0b3e80 2023-10-06T02:24:50.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b58ff9700 1 -- 172.21.15.37:0/3672016072 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c020070 con 0x7f9b5c0b3e80 2023-10-06T02:24:50.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b6310b700 1 -- 172.21.15.37:0/3672016072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5c16b670 con 0x7f9b5c0b3e80 2023-10-06T02:24:50.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b58ff9700 1 -- 172.21.15.37:0/3672016072 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c01b6a0 con 0x7f9b5c0b3e80 2023-10-06T02:24:50.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.133+0000 7f9b6310b700 1 -- 172.21.15.37:0/3672016072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c16ad60 con 0x7f9b5c0b3e80 2023-10-06T02:24:50.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.134+0000 7f9b6310b700 1 -- 172.21.15.37:0/3672016072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c070d20 con 0x7f9b5c0b3e80 2023-10-06T02:24:50.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.135+0000 7f9b58ff9700 1 -- 172.21.15.37:0/3672016072 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b4c022030 con 0x7f9b5c0b3e80 2023-10-06T02:24:50.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.135+0000 7f9b58ff9700 1 --2- 172.21.15.37:0/3672016072 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9b48066f30 0x7f9b480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:50.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.135+0000 7f9b58ff9700 1 -- 172.21.15.37:0/3672016072 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f9b4c0865b0 con 0x7f9b5c0b3e80 2023-10-06T02:24:50.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.135+0000 7f9b5bfff700 1 --2- 172.21.15.37:0/3672016072 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9b48066f30 0x7f9b480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:50.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.136+0000 7f9b5bfff700 1 --2- 172.21.15.37:0/3672016072 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9b48066f30 0x7f9b480693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0cf0b0 tx=0x7f9b50009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:50.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.140+0000 7f9b58ff9700 1 -- 172.21.15.37:0/3672016072 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b4c053720 con 0x7f9b5c0b3e80 2023-10-06T02:24:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:50.378+0000 7f9b6310b700 1 -- 172.21.15.37:0/3672016072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9b5c070d20 con 0x7f9b5c0b3e80 2023-10-06T02:24:51.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.001+0000 7f9b58ff9700 1 -- 172.21.15.37:0/3672016072 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9b4c056d40 con 0x7f9b5c0b3e80 2023-10-06T02:24:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.014+0000 7f9b6310b700 1 -- 172.21.15.37:0/3672016072 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9b48066f30 msgr2=0x7f9b480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.014+0000 7f9b6310b700 1 --2- 172.21.15.37:0/3672016072 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9b48066f30 0x7f9b480693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0cf0b0 tx=0x7f9b50009040 comp rx=0 tx=0).stop 2023-10-06T02:24:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.014+0000 7f9b6310b700 1 -- 172.21.15.37:0/3672016072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b5c0b3e80 msgr2=0x7f9b5c1511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.014+0000 7f9b6310b700 1 --2- 172.21.15.37:0/3672016072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b5c0b3e80 0x7f9b5c1511b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009290 tx=0x7f9b4c016000 comp rx=0 tx=0).stop 2023-10-06T02:24:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.014+0000 7f9b6310b700 1 -- 172.21.15.37:0/3672016072 shutdown_connections 2023-10-06T02:24:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.014+0000 7f9b6310b700 1 --2- 172.21.15.37:0/3672016072 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b5c14e670 0x7f9b5c148e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.014+0000 7f9b6310b700 1 --2- 172.21.15.37:0/3672016072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b5c0b3e80 0x7f9b5c1511b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.014+0000 7f9b6310b700 1 --2- 172.21.15.37:0/3672016072 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9b48066f30 0x7f9b480693e0 secure :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0cf0b0 tx=0x7f9b50009040 comp rx=0 tx=0).stop 2023-10-06T02:24:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.014+0000 7f9b6310b700 1 --2- 172.21.15.37:0/3672016072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b5c14e2a0 0x7f9b5c158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.014+0000 7f9b6310b700 1 -- 172.21.15.37:0/3672016072 >> 172.21.15.37:0/3672016072 conn(0x7f9b5c06c0b0 msgr2=0x7f9b5c14d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.014+0000 7f9b6310b700 1 -- 172.21.15.37:0/3672016072 shutdown_connections 2023-10-06T02:24:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.015+0000 7f9b6310b700 1 -- 172.21.15.37:0/3672016072 wait complete. 2023-10-06T02:24:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 7 and data pool 8 2023-10-06T02:24:51.030 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:24:51.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.150+0000 7fb8d4612700 1 Processor -- start 2023-10-06T02:24:51.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.150+0000 7fb8d4612700 1 -- start start 2023-10-06T02:24:51.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.151+0000 7fb8d4612700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb8cc159aa0 0x7fb8cc0c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.151+0000 7fb8d4612700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8cc0c6b30 0x7fb8cc0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.151+0000 7fb8d4612700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8cc0c5300 con 0x7fb8cc1596d0 2023-10-06T02:24:51.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.151+0000 7fb8d4612700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8cc0c6160 con 0x7fb8cc0c6b30 2023-10-06T02:24:51.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.151+0000 7fb8d4612700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8cc0c5550 con 0x7fb8cc159aa0 2023-10-06T02:24:51.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.151+0000 7fb8d2baf700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8cc0c6b30 0x7fb8cc0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.151+0000 7fb8d2baf700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8cc0c6b30 0x7fb8cc0cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37858/0 (socket says 172.21.15.37:37858) 2023-10-06T02:24:51.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.151+0000 7fb8d2baf700 1 -- 172.21.15.37:0/3100691215 learned_addr learned my addr 172.21.15.37:0/3100691215 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.152+0000 7fb8d1bad700 1 --2- 172.21.15.37:0/3100691215 >> v2:172.21.15.191:3300/0 conn(0x7fb8cc159aa0 0x7fb8cc0c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.152+0000 7fb8d2baf700 1 -- 172.21.15.37:0/3100691215 >> v2:172.21.15.191:3300/0 conn(0x7fb8cc159aa0 msgr2=0x7fb8cc0c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.152+0000 7fb8d2baf700 1 --2- 172.21.15.37:0/3100691215 >> v2:172.21.15.191:3300/0 conn(0x7fb8cc159aa0 0x7fb8cc0c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.152+0000 7fb8d2baf700 1 -- 172.21.15.37:0/3100691215 >> v1:172.21.15.191:6789/0 conn(0x7fb8cc1596d0 legacy=0x7fb8cc0b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.152+0000 7fb8d2baf700 1 -- 172.21.15.37:0/3100691215 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc0c5830 con 0x7fb8cc0c6b30 2023-10-06T02:24:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.152+0000 7fb8d2baf700 1 --2- 172.21.15.37:0/3100691215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8cc0c6b30 0x7fb8cc0cf9f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc06d5f0 tx=0x7fb8bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10aa75c80bc6f36 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.152+0000 7fb8d13ac700 1 -- 172.21.15.37:0/3100691215 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc00b820 con 0x7fb8cc0c6b30 2023-10-06T02:24:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.152+0000 7fb8d13ac700 1 -- 172.21.15.37:0/3100691215 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8bc00b980 con 0x7fb8cc0c6b30 2023-10-06T02:24:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.152+0000 7fb8d13ac700 1 -- 172.21.15.37:0/3100691215 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc00bd20 con 0x7fb8cc0c6b30 2023-10-06T02:24:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.152+0000 7fb8d4612700 1 -- 172.21.15.37:0/3100691215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8cc0c6b30 msgr2=0x7fb8cc0cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.152+0000 7fb8d4612700 1 --2- 172.21.15.37:0/3100691215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8cc0c6b30 0x7fb8cc0cf9f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc06d5f0 tx=0x7fb8bc009250 comp rx=0 tx=0).stop 2023-10-06T02:24:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.153+0000 7fb8d4612700 1 -- 172.21.15.37:0/3100691215 shutdown_connections 2023-10-06T02:24:51.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.153+0000 7fb8d4612700 1 --2- 172.21.15.37:0/3100691215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8cc0c6b30 0x7fb8cc0cf9f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.153+0000 7fb8d4612700 1 --2- 172.21.15.37:0/3100691215 >> v2:172.21.15.191:3300/0 conn(0x7fb8cc159aa0 0x7fb8cc0c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.153+0000 7fb8d4612700 1 -- 172.21.15.37:0/3100691215 >> 172.21.15.37:0/3100691215 conn(0x7fb8cc06c890 msgr2=0x7fb8cc0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:51.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.153+0000 7fb8d4612700 1 -- 172.21.15.37:0/3100691215 shutdown_connections 2023-10-06T02:24:51.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.153+0000 7fb8d4612700 1 -- 172.21.15.37:0/3100691215 wait complete. 2023-10-06T02:24:51.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.154+0000 7fb8d4612700 1 Processor -- start 2023-10-06T02:24:51.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.154+0000 7fb8d4612700 1 -- start start 2023-10-06T02:24:51.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.154+0000 7fb8d4612700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8cc0c6b30 0x7fb8cc154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.154+0000 7fb8d4612700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8cc1596d0 0x7fb8cc0b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.154+0000 7fb8d4612700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8cc159aa0 0x7fb8cc0b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.154+0000 7fb8d4612700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc15a910 con 0x7fb8cc1596d0 2023-10-06T02:24:51.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.154+0000 7fb8d4612700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc15b1b0 con 0x7fb8cc159aa0 2023-10-06T02:24:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.154+0000 7fb8d4612700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc09d870 con 0x7fb8cc0c6b30 2023-10-06T02:24:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.155+0000 7fb8d1bad700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8cc1596d0 0x7fb8cc0b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.155+0000 7fb8d1bad700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8cc1596d0 0x7fb8cc0b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37874/0 (socket says 172.21.15.37:37874) 2023-10-06T02:24:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.155+0000 7fb8d1bad700 1 -- 172.21.15.37:0/581040532 learned_addr learned my addr 172.21.15.37:0/581040532 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.155+0000 7fb8d2baf700 1 --2- 172.21.15.37:0/581040532 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8cc159aa0 0x7fb8cc0b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.155+0000 7fb8d23ae700 1 --2- 172.21.15.37:0/581040532 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8cc0c6b30 0x7fb8cc154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.155+0000 7fb8d1bad700 1 -- 172.21.15.37:0/581040532 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8cc0c6b30 msgr2=0x7fb8cc154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.155+0000 7fb8d1bad700 1 --2- 172.21.15.37:0/581040532 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8cc0c6b30 0x7fb8cc154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.155+0000 7fb8d1bad700 1 -- 172.21.15.37:0/581040532 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8cc159aa0 msgr2=0x7fb8cc0b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.155+0000 7fb8d1bad700 1 --2- 172.21.15.37:0/581040532 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8cc159aa0 0x7fb8cc0b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.155+0000 7fb8d1bad700 1 -- 172.21.15.37:0/581040532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8bc0094f0 con 0x7fb8cc1596d0 2023-10-06T02:24:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.155+0000 7fb8d23ae700 1 --2- 172.21.15.37:0/581040532 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8cc0c6b30 0x7fb8cc154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.155+0000 7fb8d1bad700 1 --2- 172.21.15.37:0/581040532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8cc1596d0 0x7fb8cc0b42d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000c880 tx=0x7fb8c0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.155+0000 7fb8ca7fc700 1 -- 172.21.15.37:0/581040532 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0011600 con 0x7fb8cc1596d0 2023-10-06T02:24:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.155+0000 7fb8ca7fc700 1 -- 172.21.15.37:0/581040532 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c0011760 con 0x7fb8cc1596d0 2023-10-06T02:24:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.155+0000 7fb8d4612700 1 -- 172.21.15.37:0/581040532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8cc15ab60 con 0x7fb8cc1596d0 2023-10-06T02:24:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.155+0000 7fb8ca7fc700 1 -- 172.21.15.37:0/581040532 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0011b00 con 0x7fb8cc1596d0 2023-10-06T02:24:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.155+0000 7fb8d4612700 1 -- 172.21.15.37:0/581040532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8cc154780 con 0x7fb8cc1596d0 2023-10-06T02:24:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.156+0000 7fb8d4612700 1 -- 172.21.15.37:0/581040532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8cc15b320 con 0x7fb8cc1596d0 2023-10-06T02:24:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.157+0000 7fb8ca7fc700 1 -- 172.21.15.37:0/581040532 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8c00223a0 con 0x7fb8cc1596d0 2023-10-06T02:24:51.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.157+0000 7fb8ca7fc700 1 --2- 172.21.15.37:0/581040532 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb8b8066f30 0x7fb8b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.157+0000 7fb8ca7fc700 1 -- 172.21.15.37:0/581040532 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb8c00846d0 con 0x7fb8cc1596d0 2023-10-06T02:24:51.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.157+0000 7fb8d23ae700 1 --2- 172.21.15.37:0/581040532 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb8b8066f30 0x7fb8b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.158+0000 7fb8d23ae700 1 --2- 172.21.15.37:0/581040532 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb8b8066f30 0x7fb8b80693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4001410 tx=0x7fb8c40096a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:51.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.162+0000 7fb8ca7fc700 1 -- 172.21.15.37:0/581040532 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8c00517e0 con 0x7fb8cc1596d0 2023-10-06T02:24:51.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.357+0000 7fb8d4612700 1 -- 172.21.15.37:0/581040532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8cc06fbf0 con 0x7fb8cc1596d0 2023-10-06T02:24:51.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.358+0000 7fb8ca7fc700 1 -- 172.21.15.37:0/581040532 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16879 (secure 0 0 0) 0x7fb8c0054e00 con 0x7fb8cc1596d0 2023-10-06T02:24:51.359 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:51.359 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":42,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:24:50.379566+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:24:48.109383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T02:24:49.348527+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:24:51.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.360+0000 7fb8d4612700 1 -- 172.21.15.37:0/581040532 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb8b8066f30 msgr2=0x7fb8b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.360+0000 7fb8d4612700 1 --2- 172.21.15.37:0/581040532 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb8b8066f30 0x7fb8b80693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4001410 tx=0x7fb8c40096a0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.361+0000 7fb8d4612700 1 -- 172.21.15.37:0/581040532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8cc1596d0 msgr2=0x7fb8cc0b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.361+0000 7fb8d4612700 1 --2- 172.21.15.37:0/581040532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8cc1596d0 0x7fb8cc0b42d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000c880 tx=0x7fb8c0008040 comp rx=0 tx=0).stop 2023-10-06T02:24:51.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.361+0000 7fb8d4612700 1 -- 172.21.15.37:0/581040532 shutdown_connections 2023-10-06T02:24:51.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.361+0000 7fb8d4612700 1 --2- 172.21.15.37:0/581040532 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb8b8066f30 0x7fb8b80693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.361+0000 7fb8d4612700 1 --2- 172.21.15.37:0/581040532 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8cc159aa0 0x7fb8cc0b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.361+0000 7fb8d4612700 1 --2- 172.21.15.37:0/581040532 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8cc0c6b30 0x7fb8cc154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.361+0000 7fb8d4612700 1 --2- 172.21.15.37:0/581040532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8cc1596d0 0x7fb8cc0b42d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.361+0000 7fb8d4612700 1 -- 172.21.15.37:0/581040532 >> 172.21.15.37:0/581040532 conn(0x7fb8cc06c890 msgr2=0x7fb8cc0d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:51.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.361+0000 7fb8d4612700 1 -- 172.21.15.37:0/581040532 shutdown_connections 2023-10-06T02:24:51.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.361+0000 7fb8d4612700 1 -- 172.21.15.37:0/581040532 wait complete. 2023-10-06T02:24:51.373 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:24:51.450 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:24:51.452 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:24:51.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.493+0000 7fe5c4bb4700 1 Processor -- start 2023-10-06T02:24:51.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.493+0000 7fe5c4bb4700 1 -- start start 2023-10-06T02:24:51.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.493+0000 7fe5c4bb4700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe5c0159760 0x7fe5c015d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.493+0000 7fe5c4bb4700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe5c015dd50 0x7fe5c00cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.493+0000 7fe5c4bb4700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c015e1d0 con 0x7fe5c015d8d0 2023-10-06T02:24:51.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.493+0000 7fe5c4bb4700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c00cc2d0 con 0x7fe5c015dd50 2023-10-06T02:24:51.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.493+0000 7fe5c4bb4700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c00cb650 con 0x7fe5c0159760 2023-10-06T02:24:51.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.494+0000 7fe5bed9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe5c015dd50 0x7fe5c00cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.494+0000 7fe5b5d9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe5c015d8d0 0x7fe5c00c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39164/0 (socket says 172.21.15.37:39164) 2023-10-06T02:24:51.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.494+0000 7fe5b5d9b700 1 -- 172.21.15.37:0/195537254 learned_addr learned my addr 172.21.15.37:0/195537254 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:51.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.494+0000 7fe5be59c700 1 --2- 172.21.15.37:0/195537254 >> v2:172.21.15.191:3300/0 conn(0x7fe5c0159760 0x7fe5c015d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.494+0000 7fe5bed9d700 1 -- 172.21.15.37:0/195537254 >> v2:172.21.15.191:3300/0 conn(0x7fe5c0159760 msgr2=0x7fe5c015d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:51.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.494+0000 7fe5bed9d700 1 --2- 172.21.15.37:0/195537254 >> v2:172.21.15.191:3300/0 conn(0x7fe5c0159760 0x7fe5c015d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.494+0000 7fe5bed9d700 1 -- 172.21.15.37:0/195537254 >> v1:172.21.15.37:6789/0 conn(0x7fe5c015d8d0 legacy=0x7fe5c00c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.494+0000 7fe5bed9d700 1 -- 172.21.15.37:0/195537254 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c00cb930 con 0x7fe5c015dd50 2023-10-06T02:24:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.494+0000 7fe5bdd9b700 1 -- 172.21.15.37:0/195537254 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270720729 0 0) 0x7fe5c015e1d0 con 0x7fe5c015d8d0 2023-10-06T02:24:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.494+0000 7fe5be59c700 1 --2- 172.21.15.37:0/195537254 >> v2:172.21.15.191:3300/0 conn(0x7fe5c0159760 0x7fe5c015d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.494+0000 7fe5bed9d700 1 --2- 172.21.15.37:0/195537254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5c015dd50 0x7fe5c00cfc00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00897f0 tx=0x7fe5b8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6815b91133ff33d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.494+0000 7fe5bdd9b700 1 -- 172.21.15.37:0/195537254 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b800e070 con 0x7fe5c015dd50 2023-10-06T02:24:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.494+0000 7fe5bdd9b700 1 -- 172.21.15.37:0/195537254 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b800bcc0 con 0x7fe5c015dd50 2023-10-06T02:24:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.494+0000 7fe5bdd9b700 1 -- 172.21.15.37:0/195537254 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8012680 con 0x7fe5c015dd50 2023-10-06T02:24:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.495+0000 7fe5c4bb4700 1 -- 172.21.15.37:0/195537254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5c015dd50 msgr2=0x7fe5c00cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.495+0000 7fe5c4bb4700 1 --2- 172.21.15.37:0/195537254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5c015dd50 0x7fe5c00cfc00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00897f0 tx=0x7fe5b8009780 comp rx=0 tx=0).stop 2023-10-06T02:24:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.495+0000 7fe5c4bb4700 1 -- 172.21.15.37:0/195537254 shutdown_connections 2023-10-06T02:24:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.495+0000 7fe5c4bb4700 1 --2- 172.21.15.37:0/195537254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5c015dd50 0x7fe5c00cfc00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.495+0000 7fe5c4bb4700 1 --2- 172.21.15.37:0/195537254 >> v2:172.21.15.191:3300/0 conn(0x7fe5c0159760 0x7fe5c015d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.495+0000 7fe5c4bb4700 1 -- 172.21.15.37:0/195537254 >> 172.21.15.37:0/195537254 conn(0x7fe5c006c890 msgr2=0x7fe5c00d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:51.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.495+0000 7fe5c4bb4700 1 -- 172.21.15.37:0/195537254 shutdown_connections 2023-10-06T02:24:51.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.495+0000 7fe5c4bb4700 1 -- 172.21.15.37:0/195537254 wait complete. 2023-10-06T02:24:51.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.496+0000 7fe5c4bb4700 1 Processor -- start 2023-10-06T02:24:51.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.496+0000 7fe5c4bb4700 1 -- start start 2023-10-06T02:24:51.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.497+0000 7fe5c4bb4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5c0159760 0x7fe5c00b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.497+0000 7fe5c4bb4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5c015d8d0 0x7fe5c0151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.497+0000 7fe5c4bb4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5c015dd50 0x7fe5c0158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.497+0000 7fe5c4bb4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c0158ff0 con 0x7fe5c015d8d0 2023-10-06T02:24:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.497+0000 7fe5c4bb4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c00c95e0 con 0x7fe5c015dd50 2023-10-06T02:24:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.497+0000 7fe5c4bb4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c00c89d0 con 0x7fe5c0159760 2023-10-06T02:24:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.497+0000 7fe5b5d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5c015d8d0 0x7fe5c0151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.497+0000 7fe5b5d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5c015d8d0 0x7fe5c0151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37894/0 (socket says 172.21.15.37:37894) 2023-10-06T02:24:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.497+0000 7fe5b5d9b700 1 -- 172.21.15.37:0/2063528748 learned_addr learned my addr 172.21.15.37:0/2063528748 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.497+0000 7fe5bed9d700 1 --2- 172.21.15.37:0/2063528748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5c015dd50 0x7fe5c0158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.497+0000 7fe5be59c700 1 --2- 172.21.15.37:0/2063528748 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5c0159760 0x7fe5c00b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.497+0000 7fe5b5d9b700 1 -- 172.21.15.37:0/2063528748 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5c0159760 msgr2=0x7fe5c00b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.497+0000 7fe5b5d9b700 1 --2- 172.21.15.37:0/2063528748 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5c0159760 0x7fe5c00b5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.497+0000 7fe5b5d9b700 1 -- 172.21.15.37:0/2063528748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5c015dd50 msgr2=0x7fe5c0158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.497+0000 7fe5b5d9b700 1 --2- 172.21.15.37:0/2063528748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5c015dd50 0x7fe5c0158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.497+0000 7fe5b5d9b700 1 -- 172.21.15.37:0/2063528748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b8009a20 con 0x7fe5c015d8d0 2023-10-06T02:24:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.497+0000 7fe5be59c700 1 --2- 172.21.15.37:0/2063528748 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5c0159760 0x7fe5c00b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.497+0000 7fe5b5d9b700 1 --2- 172.21.15.37:0/2063528748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5c015d8d0 0x7fe5c0151e60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800c7e0 tx=0x7fe5a8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.498+0000 7fe5b6ffd700 1 -- 172.21.15.37:0/2063528748 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8005b30 con 0x7fe5c015d8d0 2023-10-06T02:24:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.498+0000 7fe5b6ffd700 1 -- 172.21.15.37:0/2063528748 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a8005c90 con 0x7fe5c015d8d0 2023-10-06T02:24:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.498+0000 7fe5c4bb4700 1 -- 172.21.15.37:0/2063528748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c00c8cb0 con 0x7fe5c015d8d0 2023-10-06T02:24:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.498+0000 7fe5b6ffd700 1 -- 172.21.15.37:0/2063528748 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a80072e0 con 0x7fe5c015d8d0 2023-10-06T02:24:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.498+0000 7fe5c4bb4700 1 -- 172.21.15.37:0/2063528748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c00c9270 con 0x7fe5c015d8d0 2023-10-06T02:24:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.499+0000 7fe5c4bb4700 1 -- 172.21.15.37:0/2063528748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c006fbf0 con 0x7fe5c015d8d0 2023-10-06T02:24:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.499+0000 7fe5b6ffd700 1 -- 172.21.15.37:0/2063528748 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe5a80076d0 con 0x7fe5c015d8d0 2023-10-06T02:24:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.500+0000 7fe5b6ffd700 1 --2- 172.21.15.37:0/2063528748 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe5a0066f30 0x7fe5a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.500+0000 7fe5b6ffd700 1 -- 172.21.15.37:0/2063528748 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe5a8083b00 con 0x7fe5c015d8d0 2023-10-06T02:24:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.500+0000 7fe5be59c700 1 --2- 172.21.15.37:0/2063528748 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe5a0066f30 0x7fe5a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.500+0000 7fe5be59c700 1 --2- 172.21.15.37:0/2063528748 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe5a0066f30 0x7fe5a00693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0006f00 tx=0x7fe5b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:51.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.504+0000 7fe5b6ffd700 1 -- 172.21.15.37:0/2063528748 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5a804b5a0 con 0x7fe5c015d8d0 2023-10-06T02:24:51.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.698+0000 7fe5c4bb4700 1 -- 172.21.15.37:0/2063528748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5c00c9720 con 0x7fe5c015d8d0 2023-10-06T02:24:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.699+0000 7fe5b6ffd700 1 -- 172.21.15.37:0/2063528748 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16879 (secure 0 0 0) 0x7fe5a8017090 con 0x7fe5c015d8d0 2023-10-06T02:24:51.700 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:51.700 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":42,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:24:50.379566+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:24:48.109383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T02:24:49.348527+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:24:51.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.700+0000 7fe5c4bb4700 1 -- 172.21.15.37:0/2063528748 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe5a0066f30 msgr2=0x7fe5a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.700+0000 7fe5c4bb4700 1 --2- 172.21.15.37:0/2063528748 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe5a0066f30 0x7fe5a00693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0006f00 tx=0x7fe5b0008040 comp rx=0 tx=0).stop 2023-10-06T02:24:51.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.700+0000 7fe5c4bb4700 1 -- 172.21.15.37:0/2063528748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5c015d8d0 msgr2=0x7fe5c0151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.701+0000 7fe5c4bb4700 1 --2- 172.21.15.37:0/2063528748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5c015d8d0 0x7fe5c0151e60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800c7e0 tx=0x7fe5a8007df0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.701+0000 7fe5c4bb4700 1 -- 172.21.15.37:0/2063528748 shutdown_connections 2023-10-06T02:24:51.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.701+0000 7fe5c4bb4700 1 --2- 172.21.15.37:0/2063528748 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe5a0066f30 0x7fe5a00693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.701+0000 7fe5c4bb4700 1 --2- 172.21.15.37:0/2063528748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5c015dd50 0x7fe5c0158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.701+0000 7fe5c4bb4700 1 --2- 172.21.15.37:0/2063528748 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5c0159760 0x7fe5c00b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.701+0000 7fe5c4bb4700 1 --2- 172.21.15.37:0/2063528748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5c015d8d0 0x7fe5c0151e60 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.701+0000 7fe5c4bb4700 1 -- 172.21.15.37:0/2063528748 >> 172.21.15.37:0/2063528748 conn(0x7fe5c006c890 msgr2=0x7fe5c00c6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.701+0000 7fe5c4bb4700 1 -- 172.21.15.37:0/2063528748 shutdown_connections 2023-10-06T02:24:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.701+0000 7fe5c4bb4700 1 -- 172.21.15.37:0/2063528748 wait complete. 2023-10-06T02:24:51.713 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:24:51.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.835+0000 7f1f391e9700 1 Processor -- start 2023-10-06T02:24:51.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.835+0000 7f1f391e9700 1 -- start start 2023-10-06T02:24:51.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.836+0000 7f1f391e9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1f341593c0 0x7f1f34159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.836+0000 7f1f391e9700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f1f340b2380 0x7f1f340b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.836+0000 7f1f391e9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f340ccb30 0x7f1f340ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.836+0000 7f1f391e9700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f340b07a0 con 0x7f1f341593c0 2023-10-06T02:24:51.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.836+0000 7f1f391e9700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f340cd8a0 con 0x7f1f340b2380 2023-10-06T02:24:51.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.836+0000 7f1f391e9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f340afe70 con 0x7f1f340ccb30 2023-10-06T02:24:51.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.836+0000 7f1f32d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1f341593c0 0x7f1f34159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.836+0000 7f1f32d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1f341593c0 0x7f1f34159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37904/0 (socket says 172.21.15.37:37904) 2023-10-06T02:24:51.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.836+0000 7f1f32d9d700 1 -- 172.21.15.37:0/987353465 learned_addr learned my addr 172.21.15.37:0/987353465 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:51.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.836+0000 7f1f3259c700 1 --2- 172.21.15.37:0/987353465 >> v2:172.21.15.191:3300/0 conn(0x7f1f340b2380 0x7f1f340b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.836+0000 7f1f32d9d700 1 -- 172.21.15.37:0/987353465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f340ccb30 msgr2=0x7f1f340ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:51.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.836+0000 7f1f3359e700 1 --2- 172.21.15.37:0/987353465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f340ccb30 0x7f1f340ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.836+0000 7f1f32d9d700 1 --2- 172.21.15.37:0/987353465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f340ccb30 0x7f1f340ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.836+0000 7f1f32d9d700 1 -- 172.21.15.37:0/987353465 >> v2:172.21.15.191:3300/0 conn(0x7f1f340b2380 msgr2=0x7f1f340b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:51.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.836+0000 7f1f32d9d700 1 --2- 172.21.15.37:0/987353465 >> v2:172.21.15.191:3300/0 conn(0x7f1f340b2380 0x7f1f340b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.836+0000 7f1f32d9d700 1 -- 172.21.15.37:0/987353465 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f340b0150 con 0x7f1f341593c0 2023-10-06T02:24:51.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.836+0000 7f1f3259c700 1 --2- 172.21.15.37:0/987353465 >> v2:172.21.15.191:3300/0 conn(0x7f1f340b2380 0x7f1f340b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:51.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.836+0000 7f1f3359e700 1 --2- 172.21.15.37:0/987353465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f340ccb30 0x7f1f340ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:51.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.836+0000 7f1f32d9d700 1 --2- 172.21.15.37:0/987353465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f341593c0 0x7f1f34159790 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1f340b2170 tx=0x7f1f24009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8a2dfbf37bbe8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:51.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.836+0000 7f1f31d9b700 1 -- 172.21.15.37:0/987353465 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2400e070 con 0x7f1f341593c0 2023-10-06T02:24:51.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.837+0000 7f1f31d9b700 1 -- 172.21.15.37:0/987353465 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2400ba50 con 0x7f1f341593c0 2023-10-06T02:24:51.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.837+0000 7f1f31d9b700 1 -- 172.21.15.37:0/987353465 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f240092e0 con 0x7f1f341593c0 2023-10-06T02:24:51.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.837+0000 7f1f391e9700 1 -- 172.21.15.37:0/987353465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f341593c0 msgr2=0x7f1f34159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.837+0000 7f1f391e9700 1 --2- 172.21.15.37:0/987353465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f341593c0 0x7f1f34159790 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1f340b2170 tx=0x7f1f24009840 comp rx=0 tx=0).stop 2023-10-06T02:24:51.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.837+0000 7f1f391e9700 1 -- 172.21.15.37:0/987353465 shutdown_connections 2023-10-06T02:24:51.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.837+0000 7f1f391e9700 1 --2- 172.21.15.37:0/987353465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f340ccb30 0x7f1f340ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.837+0000 7f1f391e9700 1 --2- 172.21.15.37:0/987353465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f341593c0 0x7f1f34159790 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.837+0000 7f1f391e9700 1 --2- 172.21.15.37:0/987353465 >> v2:172.21.15.191:3300/0 conn(0x7f1f340b2380 0x7f1f340b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.837+0000 7f1f391e9700 1 -- 172.21.15.37:0/987353465 >> 172.21.15.37:0/987353465 conn(0x7f1f3406c0b0 msgr2=0x7f1f3406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:51.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.837+0000 7f1f391e9700 1 -- 172.21.15.37:0/987353465 shutdown_connections 2023-10-06T02:24:51.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.837+0000 7f1f391e9700 1 -- 172.21.15.37:0/987353465 wait complete. 2023-10-06T02:24:51.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.838+0000 7f1f391e9700 1 Processor -- start 2023-10-06T02:24:51.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.838+0000 7f1f391e9700 1 -- start start 2023-10-06T02:24:51.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.839+0000 7f1f391e9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f340b2380 0x7f1f34156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.839+0000 7f1f391e9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f340ccb30 0x7f1f3415d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.839+0000 7f1f391e9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f341593c0 0x7f1f3414a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.839+0000 7f1f391e9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f34169f70 con 0x7f1f341593c0 2023-10-06T02:24:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.839+0000 7f1f391e9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3416a250 con 0x7f1f340ccb30 2023-10-06T02:24:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.839+0000 7f1f391e9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3416a530 con 0x7f1f340b2380 2023-10-06T02:24:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.839+0000 7f1f3359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f341593c0 0x7f1f3414a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.839+0000 7f1f3359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f341593c0 0x7f1f3414a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37910/0 (socket says 172.21.15.37:37910) 2023-10-06T02:24:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.839+0000 7f1f3359e700 1 -- 172.21.15.37:0/3190418201 learned_addr learned my addr 172.21.15.37:0/3190418201 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.839+0000 7f1f3259c700 1 --2- 172.21.15.37:0/3190418201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f340ccb30 0x7f1f3415d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.839+0000 7f1f32d9d700 1 --2- 172.21.15.37:0/3190418201 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f340b2380 0x7f1f34156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.840+0000 7f1f3359e700 1 -- 172.21.15.37:0/3190418201 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f340b2380 msgr2=0x7f1f34156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.840+0000 7f1f3359e700 1 --2- 172.21.15.37:0/3190418201 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f340b2380 0x7f1f34156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.840+0000 7f1f3359e700 1 -- 172.21.15.37:0/3190418201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f340ccb30 msgr2=0x7f1f3415d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:51.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.840+0000 7f1f3359e700 1 --2- 172.21.15.37:0/3190418201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f340ccb30 0x7f1f3415d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:51.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.840+0000 7f1f3359e700 1 -- 172.21.15.37:0/3190418201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f24009ae0 con 0x7f1f341593c0 2023-10-06T02:24:51.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.840+0000 7f1f3259c700 1 --2- 172.21.15.37:0/3190418201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f340ccb30 0x7f1f3415d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:51.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.840+0000 7f1f3359e700 1 --2- 172.21.15.37:0/3190418201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f341593c0 0x7f1f3414a7c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00c880 tx=0x7f1f2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:51.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.840+0000 7f1f2affd700 1 -- 172.21.15.37:0/3190418201 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c011600 con 0x7f1f341593c0 2023-10-06T02:24:51.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.840+0000 7f1f2affd700 1 -- 172.21.15.37:0/3190418201 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c011760 con 0x7f1f341593c0 2023-10-06T02:24:51.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.840+0000 7f1f391e9700 1 -- 172.21.15.37:0/3190418201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3416a810 con 0x7f1f341593c0 2023-10-06T02:24:51.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.840+0000 7f1f2affd700 1 -- 172.21.15.37:0/3190418201 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c011b20 con 0x7f1f341593c0 2023-10-06T02:24:51.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.840+0000 7f1f391e9700 1 -- 172.21.15.37:0/3190418201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3414ad00 con 0x7f1f341593c0 2023-10-06T02:24:51.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.841+0000 7f1f391e9700 1 -- 172.21.15.37:0/3190418201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3416aa30 con 0x7f1f341593c0 2023-10-06T02:24:51.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.841+0000 7f1f2affd700 1 -- 172.21.15.37:0/3190418201 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f2c0193b0 con 0x7f1f341593c0 2023-10-06T02:24:51.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.842+0000 7f1f2affd700 1 --2- 172.21.15.37:0/3190418201 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1f14066f30 0x7f1f140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:51.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.842+0000 7f1f2affd700 1 -- 172.21.15.37:0/3190418201 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1f2c0847b0 con 0x7f1f341593c0 2023-10-06T02:24:51.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.842+0000 7f1f32d9d700 1 --2- 172.21.15.37:0/3190418201 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1f14066f30 0x7f1f140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:51.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.842+0000 7f1f32d9d700 1 --2- 172.21.15.37:0/3190418201 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1f14066f30 0x7f1f140693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009880 tx=0x7f1f24018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:51.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:51.846+0000 7f1f2affd700 1 -- 172.21.15.37:0/3190418201 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f2c0552b0 con 0x7f1f341593c0 2023-10-06T02:24:52.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:52.090+0000 7f1f391e9700 1 -- 172.21.15.37:0/3190418201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1f340b0430 con 0x7f1f341593c0 2023-10-06T02:24:53.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.017+0000 7f1f2affd700 1 -- 172.21.15.37:0/3190418201 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1f2c054e40 con 0x7f1f341593c0 2023-10-06T02:24:53.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.020+0000 7f1f391e9700 1 -- 172.21.15.37:0/3190418201 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1f14066f30 msgr2=0x7f1f140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:53.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.020+0000 7f1f391e9700 1 --2- 172.21.15.37:0/3190418201 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1f14066f30 0x7f1f140693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009880 tx=0x7f1f24018000 comp rx=0 tx=0).stop 2023-10-06T02:24:53.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.020+0000 7f1f391e9700 1 -- 172.21.15.37:0/3190418201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f341593c0 msgr2=0x7f1f3414a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:53.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.020+0000 7f1f391e9700 1 --2- 172.21.15.37:0/3190418201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f341593c0 0x7f1f3414a7c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00c880 tx=0x7f1f2c008040 comp rx=0 tx=0).stop 2023-10-06T02:24:53.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.020+0000 7f1f391e9700 1 -- 172.21.15.37:0/3190418201 shutdown_connections 2023-10-06T02:24:53.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.020+0000 7f1f391e9700 1 --2- 172.21.15.37:0/3190418201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f341593c0 0x7f1f3414a7c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:53.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.020+0000 7f1f391e9700 1 --2- 172.21.15.37:0/3190418201 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f340b2380 0x7f1f34156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:53.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.020+0000 7f1f391e9700 1 --2- 172.21.15.37:0/3190418201 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1f14066f30 0x7f1f140693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:53.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.020+0000 7f1f391e9700 1 --2- 172.21.15.37:0/3190418201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f340ccb30 0x7f1f3415d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:53.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.020+0000 7f1f391e9700 1 -- 172.21.15.37:0/3190418201 >> 172.21.15.37:0/3190418201 conn(0x7f1f3406c0b0 msgr2=0x7f1f34158860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:53.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.020+0000 7f1f391e9700 1 -- 172.21.15.37:0/3190418201 shutdown_connections 2023-10-06T02:24:53.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.020+0000 7f1f391e9700 1 -- 172.21.15.37:0/3190418201 wait complete. 2023-10-06T02:24:53.035 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:24:53.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.164+0000 7f044b92a700 1 Processor -- start 2023-10-06T02:24:53.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.164+0000 7f044b92a700 1 -- start start 2023-10-06T02:24:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.165+0000 7f044b92a700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0444159580 0x7f04440b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.165+0000 7f044b92a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04440cc450 0x7f0444159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.165+0000 7f044b92a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04440b2590 0x7f04440d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.165+0000 7f044b92a700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04440cb440 con 0x7f04440cc450 2023-10-06T02:24:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.165+0000 7f044b92a700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04440cbfc0 con 0x7f0444159580 2023-10-06T02:24:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.165+0000 7f044b92a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04440cb690 con 0x7f04440b2590 2023-10-06T02:24:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.165+0000 7f0448ec5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04440cc450 0x7f0444159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.165+0000 7f0448ec5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04440cc450 0x7f0444159950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37922/0 (socket says 172.21.15.37:37922) 2023-10-06T02:24:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.165+0000 7f0448ec5700 1 -- 172.21.15.37:0/3835678146 learned_addr learned my addr 172.21.15.37:0/3835678146 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.165+0000 7f0449ec7700 1 --2- 172.21.15.37:0/3835678146 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04440b2590 0x7f04440d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.165+0000 7f04496c6700 1 --2- 172.21.15.37:0/3835678146 >> v2:172.21.15.191:3300/0 conn(0x7f0444159580 0x7f04440b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.165+0000 7f0448ec5700 1 -- 172.21.15.37:0/3835678146 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04440b2590 msgr2=0x7f04440d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.165+0000 7f0448ec5700 1 --2- 172.21.15.37:0/3835678146 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04440b2590 0x7f04440d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.165+0000 7f0448ec5700 1 -- 172.21.15.37:0/3835678146 >> v2:172.21.15.191:3300/0 conn(0x7f0444159580 msgr2=0x7f04440b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.165+0000 7f0448ec5700 1 --2- 172.21.15.37:0/3835678146 >> v2:172.21.15.191:3300/0 conn(0x7f0444159580 0x7f04440b0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.165+0000 7f0448ec5700 1 -- 172.21.15.37:0/3835678146 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04440cb970 con 0x7f04440cc450 2023-10-06T02:24:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.165+0000 7f0448ec5700 1 --2- 172.21.15.37:0/3835678146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440cc450 0x7f0444159950 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f04440afee0 tx=0x7f0434009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3b46b24a52e561 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.166+0000 7f043bfff700 1 -- 172.21.15.37:0/3835678146 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043400b860 con 0x7f04440cc450 2023-10-06T02:24:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.166+0000 7f043bfff700 1 -- 172.21.15.37:0/3835678146 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043400b9c0 con 0x7f04440cc450 2023-10-06T02:24:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.166+0000 7f043bfff700 1 -- 172.21.15.37:0/3835678146 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043400bd60 con 0x7f04440cc450 2023-10-06T02:24:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.166+0000 7f044b92a700 1 -- 172.21.15.37:0/3835678146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440cc450 msgr2=0x7f0444159950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.166+0000 7f044b92a700 1 --2- 172.21.15.37:0/3835678146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440cc450 0x7f0444159950 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f04440afee0 tx=0x7f0434009250 comp rx=0 tx=0).stop 2023-10-06T02:24:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.166+0000 7f044b92a700 1 -- 172.21.15.37:0/3835678146 shutdown_connections 2023-10-06T02:24:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.166+0000 7f044b92a700 1 --2- 172.21.15.37:0/3835678146 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04440b2590 0x7f04440d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.166+0000 7f044b92a700 1 --2- 172.21.15.37:0/3835678146 >> v2:172.21.15.191:3300/0 conn(0x7f0444159580 0x7f04440b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.166+0000 7f044b92a700 1 --2- 172.21.15.37:0/3835678146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440cc450 0x7f0444159950 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.166+0000 7f044b92a700 1 -- 172.21.15.37:0/3835678146 >> 172.21.15.37:0/3835678146 conn(0x7f044406c0b0 msgr2=0x7f044406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.166+0000 7f044b92a700 1 -- 172.21.15.37:0/3835678146 shutdown_connections 2023-10-06T02:24:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.166+0000 7f044b92a700 1 -- 172.21.15.37:0/3835678146 wait complete. 2023-10-06T02:24:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.167+0000 7f044b92a700 1 Processor -- start 2023-10-06T02:24:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.167+0000 7f044b92a700 1 -- start start 2023-10-06T02:24:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.168+0000 7f044b92a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440b2590 0x7f0444156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.168+0000 7f044b92a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04440cc450 0x7f044415a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.168+0000 7f044b92a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0444159580 0x7f04440b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.168+0000 7f044b92a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04440c7830 con 0x7f04440b2590 2023-10-06T02:24:53.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.168+0000 7f044b92a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044415acd0 con 0x7f04440cc450 2023-10-06T02:24:53.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.168+0000 7f044b92a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044415afb0 con 0x7f0444159580 2023-10-06T02:24:53.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.168+0000 7f04496c6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440b2590 0x7f0444156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:53.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.168+0000 7f04496c6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440b2590 0x7f0444156ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37938/0 (socket says 172.21.15.37:37938) 2023-10-06T02:24:53.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.168+0000 7f04496c6700 1 -- 172.21.15.37:0/2839738781 learned_addr learned my addr 172.21.15.37:0/2839738781 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:53.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.169+0000 7f0448ec5700 1 --2- 172.21.15.37:0/2839738781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04440cc450 0x7f044415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:53.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.169+0000 7f04496c6700 1 -- 172.21.15.37:0/2839738781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0444159580 msgr2=0x7f04440b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:53.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.169+0000 7f04496c6700 1 --2- 172.21.15.37:0/2839738781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0444159580 0x7f04440b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.169+0000 7f04496c6700 1 -- 172.21.15.37:0/2839738781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04440cc450 msgr2=0x7f044415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.169+0000 7f04496c6700 1 --2- 172.21.15.37:0/2839738781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04440cc450 0x7f044415a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.169+0000 7f04496c6700 1 -- 172.21.15.37:0/2839738781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04340094f0 con 0x7f04440b2590 2023-10-06T02:24:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.169+0000 7f04496c6700 1 --2- 172.21.15.37:0/2839738781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440b2590 0x7f0444156ab0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f044000d860 tx=0x7f0440008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.169+0000 7f04397fa700 1 -- 172.21.15.37:0/2839738781 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0440009610 con 0x7f04440b2590 2023-10-06T02:24:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.169+0000 7f04397fa700 1 -- 172.21.15.37:0/2839738781 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0440009770 con 0x7f04440b2590 2023-10-06T02:24:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.169+0000 7f044b92a700 1 -- 172.21.15.37:0/2839738781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f044415b290 con 0x7f04440b2590 2023-10-06T02:24:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.169+0000 7f04397fa700 1 -- 172.21.15.37:0/2839738781 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0440009b30 con 0x7f04440b2590 2023-10-06T02:24:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.169+0000 7f044b92a700 1 -- 172.21.15.37:0/2839738781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044415b570 con 0x7f04440b2590 2023-10-06T02:24:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.170+0000 7f044b92a700 1 -- 172.21.15.37:0/2839738781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04440c7600 con 0x7f04440b2590 2023-10-06T02:24:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.170+0000 7f04397fa700 1 -- 172.21.15.37:0/2839738781 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f044001e460 con 0x7f04440b2590 2023-10-06T02:24:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.171+0000 7f04397fa700 1 --2- 172.21.15.37:0/2839738781 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0428066f30 0x7f04280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.171+0000 7f04397fa700 1 -- 172.21.15.37:0/2839738781 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0440084cf0 con 0x7f04440b2590 2023-10-06T02:24:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.171+0000 7f0448ec5700 1 --2- 172.21.15.37:0/2839738781 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0428066f30 0x7f04280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.171+0000 7f0448ec5700 1 --2- 172.21.15.37:0/2839738781 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0428066f30 0x7f04280693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f04440afee0 tx=0x7f0434017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.175+0000 7f04397fa700 1 -- 172.21.15.37:0/2839738781 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04440c7600 con 0x7f04440b2590 2023-10-06T02:24:53.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:53.412+0000 7f044b92a700 1 -- 172.21.15.37:0/2839738781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f04440c7600 con 0x7f04440b2590 2023-10-06T02:24:54.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.023+0000 7f04397fa700 1 -- 172.21.15.37:0/2839738781 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v23) v1 ==== 122+0+0 (secure 0 0 0) 0x7f04440c7600 con 0x7f04440b2590 2023-10-06T02:24:54.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.026+0000 7f044b92a700 1 -- 172.21.15.37:0/2839738781 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0428066f30 msgr2=0x7f04280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.026+0000 7f044b92a700 1 --2- 172.21.15.37:0/2839738781 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0428066f30 0x7f04280693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f04440afee0 tx=0x7f0434017000 comp rx=0 tx=0).stop 2023-10-06T02:24:54.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.026+0000 7f044b92a700 1 -- 172.21.15.37:0/2839738781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440b2590 msgr2=0x7f0444156ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.026+0000 7f044b92a700 1 --2- 172.21.15.37:0/2839738781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440b2590 0x7f0444156ab0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f044000d860 tx=0x7f0440008040 comp rx=0 tx=0).stop 2023-10-06T02:24:54.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.026+0000 7f044b92a700 1 -- 172.21.15.37:0/2839738781 shutdown_connections 2023-10-06T02:24:54.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.026+0000 7f044b92a700 1 --2- 172.21.15.37:0/2839738781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0444159580 0x7f04440b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.026+0000 7f044b92a700 1 --2- 172.21.15.37:0/2839738781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440b2590 0x7f0444156ab0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.026+0000 7f044b92a700 1 --2- 172.21.15.37:0/2839738781 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0428066f30 0x7f04280693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.026+0000 7f044b92a700 1 --2- 172.21.15.37:0/2839738781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04440cc450 0x7f044415a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.026+0000 7f044b92a700 1 -- 172.21.15.37:0/2839738781 >> 172.21.15.37:0/2839738781 conn(0x7f044406c0b0 msgr2=0x7f04440cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:54.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.026+0000 7f044b92a700 1 -- 172.21.15.37:0/2839738781 shutdown_connections 2023-10-06T02:24:54.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.026+0000 7f044b92a700 1 -- 172.21.15.37:0/2839738781 wait complete. 2023-10-06T02:24:54.040 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:54.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.162+0000 7f52c1d94700 1 Processor -- start 2023-10-06T02:24:54.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.162+0000 7f52c1d94700 1 -- start start 2023-10-06T02:24:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.163+0000 7f52c1d94700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52bc159760 0x7f52bc15d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.163+0000 7f52c1d94700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f52bc15d8d0 0x7f52bc15dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.163+0000 7f52c1d94700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f52bc0c5390 0x7f52bc0c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.163+0000 7f52c1d94700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52bc0cc2d0 con 0x7f52bc15d8d0 2023-10-06T02:24:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.163+0000 7f52c1d94700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52bc15e260 con 0x7f52bc0c5390 2023-10-06T02:24:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.163+0000 7f52c1d94700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0cb650 con 0x7f52bc159760 2023-10-06T02:24:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.163+0000 7f52baffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f52bc15d8d0 0x7f52bc15dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.163+0000 7f52baffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f52bc15d8d0 0x7f52bc15dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37940/0 (socket says 172.21.15.37:37940) 2023-10-06T02:24:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.163+0000 7f52baffd700 1 -- 172.21.15.37:0/1910932555 learned_addr learned my addr 172.21.15.37:0/1910932555 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.163+0000 7f52bb7fe700 1 --2- 172.21.15.37:0/1910932555 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52bc159760 0x7f52bc15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.163+0000 7f52bbfff700 1 --2- 172.21.15.37:0/1910932555 >> v2:172.21.15.191:3300/0 conn(0x7f52bc0c5390 0x7f52bc0c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.163+0000 7f52baffd700 1 -- 172.21.15.37:0/1910932555 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52bc159760 msgr2=0x7f52bc15d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.163+0000 7f52baffd700 1 --2- 172.21.15.37:0/1910932555 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52bc159760 0x7f52bc15d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.163+0000 7f52baffd700 1 -- 172.21.15.37:0/1910932555 >> v2:172.21.15.191:3300/0 conn(0x7f52bc0c5390 msgr2=0x7f52bc0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.163+0000 7f52baffd700 1 --2- 172.21.15.37:0/1910932555 >> v2:172.21.15.191:3300/0 conn(0x7f52bc0c5390 0x7f52bc0c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.163+0000 7f52baffd700 1 -- 172.21.15.37:0/1910932555 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc0cb930 con 0x7f52bc15d8d0 2023-10-06T02:24:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.164+0000 7f52baffd700 1 --2- 172.21.15.37:0/1910932555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52bc15d8d0 0x7f52bc15dd20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f52bc089980 tx=0x7f52b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d85e3814c20d0ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.164+0000 7f52ba7fc700 1 -- 172.21.15.37:0/1910932555 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b000b8f0 con 0x7f52bc15d8d0 2023-10-06T02:24:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.164+0000 7f52ba7fc700 1 -- 172.21.15.37:0/1910932555 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b000ba50 con 0x7f52bc15d8d0 2023-10-06T02:24:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.164+0000 7f52ba7fc700 1 -- 172.21.15.37:0/1910932555 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b000bdf0 con 0x7f52bc15d8d0 2023-10-06T02:24:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.164+0000 7f52c1d94700 1 -- 172.21.15.37:0/1910932555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52bc15d8d0 msgr2=0x7f52bc15dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.164+0000 7f52c1d94700 1 --2- 172.21.15.37:0/1910932555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52bc15d8d0 0x7f52bc15dd20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f52bc089980 tx=0x7f52b0009250 comp rx=0 tx=0).stop 2023-10-06T02:24:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.164+0000 7f52c1d94700 1 -- 172.21.15.37:0/1910932555 shutdown_connections 2023-10-06T02:24:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.164+0000 7f52c1d94700 1 --2- 172.21.15.37:0/1910932555 >> v2:172.21.15.191:3300/0 conn(0x7f52bc0c5390 0x7f52bc0c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.164+0000 7f52c1d94700 1 --2- 172.21.15.37:0/1910932555 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52bc159760 0x7f52bc15d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.164+0000 7f52c1d94700 1 --2- 172.21.15.37:0/1910932555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52bc15d8d0 0x7f52bc15dd20 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.164+0000 7f52c1d94700 1 -- 172.21.15.37:0/1910932555 >> 172.21.15.37:0/1910932555 conn(0x7f52bc06c890 msgr2=0x7f52bc0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.164+0000 7f52c1d94700 1 -- 172.21.15.37:0/1910932555 shutdown_connections 2023-10-06T02:24:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.164+0000 7f52c1d94700 1 -- 172.21.15.37:0/1910932555 wait complete. 2023-10-06T02:24:54.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.166+0000 7f52c1d94700 1 Processor -- start 2023-10-06T02:24:54.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.166+0000 7f52c1d94700 1 -- start start 2023-10-06T02:24:54.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.166+0000 7f52c1d94700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52bc0c5390 0x7f52bc155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.166+0000 7f52c1d94700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52bc159760 0x7f52bc152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.166+0000 7f52c1d94700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52bc15d8d0 0x7f52bc15c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.166+0000 7f52c1d94700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc15bbe0 con 0x7f52bc0c5390 2023-10-06T02:24:54.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.166+0000 7f52c1d94700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc15b750 con 0x7f52bc15d8d0 2023-10-06T02:24:54.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.166+0000 7f52c1d94700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc15ab40 con 0x7f52bc159760 2023-10-06T02:24:54.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.166+0000 7f52bb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52bc0c5390 0x7f52bc155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.167+0000 7f52bb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52bc0c5390 0x7f52bc155130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37950/0 (socket says 172.21.15.37:37950) 2023-10-06T02:24:54.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.167+0000 7f52bb7fe700 1 -- 172.21.15.37:0/816303892 learned_addr learned my addr 172.21.15.37:0/816303892 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:54.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.167+0000 7f52bbfff700 1 --2- 172.21.15.37:0/816303892 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52bc15d8d0 0x7f52bc15c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.167+0000 7f52baffd700 1 --2- 172.21.15.37:0/816303892 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52bc159760 0x7f52bc152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.167+0000 7f52bb7fe700 1 -- 172.21.15.37:0/816303892 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52bc159760 msgr2=0x7f52bc152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.167+0000 7f52bb7fe700 1 --2- 172.21.15.37:0/816303892 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52bc159760 0x7f52bc152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.167+0000 7f52bb7fe700 1 -- 172.21.15.37:0/816303892 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52bc15d8d0 msgr2=0x7f52bc15c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.167+0000 7f52bb7fe700 1 --2- 172.21.15.37:0/816303892 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52bc15d8d0 0x7f52bc15c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.167+0000 7f52bb7fe700 1 -- 172.21.15.37:0/816303892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b00094f0 con 0x7f52bc0c5390 2023-10-06T02:24:54.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.167+0000 7f52bbfff700 1 --2- 172.21.15.37:0/816303892 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52bc15d8d0 0x7f52bc15c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:54.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.167+0000 7f52bb7fe700 1 --2- 172.21.15.37:0/816303892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52bc0c5390 0x7f52bc155130 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00d8c0 tx=0x7f52ac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.167+0000 7f52a37fe700 1 -- 172.21.15.37:0/816303892 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac00de60 con 0x7f52bc0c5390 2023-10-06T02:24:54.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.167+0000 7f52a37fe700 1 -- 172.21.15.37:0/816303892 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ac00b780 con 0x7f52bc0c5390 2023-10-06T02:24:54.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.167+0000 7f52c1d94700 1 -- 172.21.15.37:0/816303892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52bc15ae20 con 0x7f52bc0c5390 2023-10-06T02:24:54.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.167+0000 7f52a37fe700 1 -- 172.21.15.37:0/816303892 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac00bb20 con 0x7f52bc0c5390 2023-10-06T02:24:54.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.167+0000 7f52c1d94700 1 -- 172.21.15.37:0/816303892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52bc15b3e0 con 0x7f52bc0c5390 2023-10-06T02:24:54.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.168+0000 7f52c1d94700 1 -- 172.21.15.37:0/816303892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52bc06fbf0 con 0x7f52bc0c5390 2023-10-06T02:24:54.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.169+0000 7f52a37fe700 1 -- 172.21.15.37:0/816303892 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52ac01e460 con 0x7f52bc0c5390 2023-10-06T02:24:54.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.169+0000 7f52a37fe700 1 --2- 172.21.15.37:0/816303892 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f52a8066f30 0x7f52a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.169+0000 7f52a37fe700 1 -- 172.21.15.37:0/816303892 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f52ac084d20 con 0x7f52bc0c5390 2023-10-06T02:24:54.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.169+0000 7f52baffd700 1 --2- 172.21.15.37:0/816303892 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f52a8066f30 0x7f52a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.170+0000 7f52baffd700 1 --2- 172.21.15.37:0/816303892 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f52a8066f30 0x7f52a80693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f52bc089980 tx=0x7f52b0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.173+0000 7f52a37fe700 1 -- 172.21.15.37:0/816303892 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52ac051e30 con 0x7f52bc0c5390 2023-10-06T02:24:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.414+0000 7f52c1d94700 1 -- 172.21.15.37:0/816303892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52bc04bb80 con 0x7f52bc0c5390 2023-10-06T02:24:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.415+0000 7f52a37fe700 1 -- 172.21.15.37:0/816303892 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f52ac055450 con 0x7f52bc0c5390 2023-10-06T02:24:54.415 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:54.416 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2341182274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2341182274},{"type":"v1","addr":"172.21.15.191:6837","nonce":2341182274}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5385,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/562500386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":562500386},{"type":"v1","addr":"172.21.15.37:6834","nonce":562500386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1403086996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1403086996},{"type":"v1","addr":"172.21.15.37:6835","nonce":1403086996}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:50.379875+0000","modified":"2023-10-06T02:24:54.014513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5400":{"gid":5400,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6836/2931117635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2931117635},{"type":"v1","addr":"172.21.15.191:6836","nonce":2931117635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:24:54.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.417+0000 7f52c1d94700 1 -- 172.21.15.37:0/816303892 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f52a8066f30 msgr2=0x7f52a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.417+0000 7f52c1d94700 1 --2- 172.21.15.37:0/816303892 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f52a8066f30 0x7f52a80693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f52bc089980 tx=0x7f52b0017000 comp rx=0 tx=0).stop 2023-10-06T02:24:54.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.417+0000 7f52c1d94700 1 -- 172.21.15.37:0/816303892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52bc0c5390 msgr2=0x7f52bc155130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.417+0000 7f52c1d94700 1 --2- 172.21.15.37:0/816303892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52bc0c5390 0x7f52bc155130 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00d8c0 tx=0x7f52ac008040 comp rx=0 tx=0).stop 2023-10-06T02:24:54.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.417+0000 7f52c1d94700 1 -- 172.21.15.37:0/816303892 shutdown_connections 2023-10-06T02:24:54.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.417+0000 7f52c1d94700 1 --2- 172.21.15.37:0/816303892 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f52a8066f30 0x7f52a80693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.417+0000 7f52c1d94700 1 --2- 172.21.15.37:0/816303892 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52bc15d8d0 0x7f52bc15c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.417+0000 7f52c1d94700 1 --2- 172.21.15.37:0/816303892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52bc0c5390 0x7f52bc155130 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.417+0000 7f52c1d94700 1 --2- 172.21.15.37:0/816303892 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52bc159760 0x7f52bc152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.417+0000 7f52c1d94700 1 -- 172.21.15.37:0/816303892 >> 172.21.15.37:0/816303892 conn(0x7f52bc06c890 msgr2=0x7f52bc0c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:54.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.417+0000 7f52c1d94700 1 -- 172.21.15.37:0/816303892 shutdown_connections 2023-10-06T02:24:54.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.417+0000 7f52c1d94700 1 -- 172.21.15.37:0/816303892 wait complete. 2023-10-06T02:24:54.419 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 23 2023-10-06T02:24:54.430 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:24:54.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.549+0000 7fb8e167e700 1 Processor -- start 2023-10-06T02:24:54.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.549+0000 7fb8e167e700 1 -- start start 2023-10-06T02:24:54.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.549+0000 7fb8e167e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8dc1595a0 0x7fb8dc0b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.549+0000 7fb8e167e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8dc0cc5a0 0x7fb8dc06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.549+0000 7fb8e167e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8dc06e240 con 0x7fb8dc06d890 2023-10-06T02:24:54.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.549+0000 7fb8e167e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8dc15e180 con 0x7fb8dc0cc5a0 2023-10-06T02:24:54.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.550+0000 7fb8e167e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc0b1000 con 0x7fb8dc1595a0 2023-10-06T02:24:54.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.550+0000 7fb8db7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8dc0cc5a0 0x7fb8dc06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.550+0000 7fb8db7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8dc0cc5a0 0x7fb8dc06dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37958/0 (socket says 172.21.15.37:37958) 2023-10-06T02:24:54.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.550+0000 7fb8db7fe700 1 -- 172.21.15.37:0/2535644856 learned_addr learned my addr 172.21.15.37:0/2535644856 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:54.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.550+0000 7fb8daffd700 1 --2- 172.21.15.37:0/2535644856 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8dc1595a0 0x7fb8dc0b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.550+0000 7fb8db7fe700 1 -- 172.21.15.37:0/2535644856 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8dc1595a0 msgr2=0x7fb8dc0b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:54.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.550+0000 7fb8db7fe700 1 --2- 172.21.15.37:0/2535644856 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8dc1595a0 0x7fb8dc0b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.550+0000 7fb8db7fe700 1 -- 172.21.15.37:0/2535644856 >> v1:172.21.15.191:6789/0 conn(0x7fb8dc06d890 legacy=0x7fb8dc06c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:54.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.550+0000 7fb8db7fe700 1 -- 172.21.15.37:0/2535644856 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc15d570 con 0x7fb8dc0cc5a0 2023-10-06T02:24:54.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.550+0000 7fb8db7fe700 1 --2- 172.21.15.37:0/2535644856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8dc0cc5a0 0x7fb8dc06dd00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40099b0 tx=0x7fb8d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d303cc5070a9a9b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.550+0000 7fb8d9ffb700 1 -- 172.21.15.37:0/2535644856 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d400b860 con 0x7fb8dc0cc5a0 2023-10-06T02:24:54.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.550+0000 7fb8d9ffb700 1 -- 172.21.15.37:0/2535644856 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d400b9c0 con 0x7fb8dc0cc5a0 2023-10-06T02:24:54.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.550+0000 7fb8d9ffb700 1 -- 172.21.15.37:0/2535644856 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d400bd80 con 0x7fb8dc0cc5a0 2023-10-06T02:24:54.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.551+0000 7fb8e167e700 1 -- 172.21.15.37:0/2535644856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8dc0cc5a0 msgr2=0x7fb8dc06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.551+0000 7fb8e167e700 1 --2- 172.21.15.37:0/2535644856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8dc0cc5a0 0x7fb8dc06dd00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40099b0 tx=0x7fb8d4009250 comp rx=0 tx=0).stop 2023-10-06T02:24:54.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.551+0000 7fb8e167e700 1 -- 172.21.15.37:0/2535644856 shutdown_connections 2023-10-06T02:24:54.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.551+0000 7fb8e167e700 1 --2- 172.21.15.37:0/2535644856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8dc0cc5a0 0x7fb8dc06dd00 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.551+0000 7fb8e167e700 1 --2- 172.21.15.37:0/2535644856 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8dc1595a0 0x7fb8dc0b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.551+0000 7fb8e167e700 1 -- 172.21.15.37:0/2535644856 >> 172.21.15.37:0/2535644856 conn(0x7fb8dc0d04d0 msgr2=0x7fb8dc0d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:54.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.551+0000 7fb8e167e700 1 -- 172.21.15.37:0/2535644856 shutdown_connections 2023-10-06T02:24:54.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.551+0000 7fb8e167e700 1 -- 172.21.15.37:0/2535644856 wait complete. 2023-10-06T02:24:54.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.552+0000 7fb8e167e700 1 Processor -- start 2023-10-06T02:24:54.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.552+0000 7fb8e167e700 1 -- start start 2023-10-06T02:24:54.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.553+0000 7fb8e167e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8dc06d890 0x7fb8dc15a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.553+0000 7fb8e167e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8dc0cc5a0 0x7fb8dc15bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.553+0000 7fb8e167e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8dc1595a0 0x7fb8dc14a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.553+0000 7fb8e167e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc15c580 con 0x7fb8dc0cc5a0 2023-10-06T02:24:54.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.553+0000 7fb8e167e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc15c860 con 0x7fb8dc06d890 2023-10-06T02:24:54.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.553+0000 7fb8e167e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc15cb40 con 0x7fb8dc1595a0 2023-10-06T02:24:54.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.553+0000 7fb8da7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8dc0cc5a0 0x7fb8dc15bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.553+0000 7fb8da7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8dc0cc5a0 0x7fb8dc15bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37974/0 (socket says 172.21.15.37:37974) 2023-10-06T02:24:54.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.553+0000 7fb8da7fc700 1 -- 172.21.15.37:0/3890347289 learned_addr learned my addr 172.21.15.37:0/3890347289 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:54.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.553+0000 7fb8db7fe700 1 --2- 172.21.15.37:0/3890347289 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8dc1595a0 0x7fb8dc14a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.553+0000 7fb8daffd700 1 --2- 172.21.15.37:0/3890347289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8dc06d890 0x7fb8dc15a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.553+0000 7fb8da7fc700 1 -- 172.21.15.37:0/3890347289 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8dc1595a0 msgr2=0x7fb8dc14a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.553+0000 7fb8da7fc700 1 --2- 172.21.15.37:0/3890347289 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8dc1595a0 0x7fb8dc14a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.553+0000 7fb8da7fc700 1 -- 172.21.15.37:0/3890347289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8dc06d890 msgr2=0x7fb8dc15a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.553+0000 7fb8da7fc700 1 --2- 172.21.15.37:0/3890347289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8dc06d890 0x7fb8dc15a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.553+0000 7fb8da7fc700 1 -- 172.21.15.37:0/3890347289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d40094f0 con 0x7fb8dc0cc5a0 2023-10-06T02:24:54.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.554+0000 7fb8da7fc700 1 --2- 172.21.15.37:0/3890347289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8dc0cc5a0 0x7fb8dc15bc70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb8c400c590 tx=0x7fb8c400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.554+0000 7fb8d2ffd700 1 -- 172.21.15.37:0/3890347289 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4011590 con 0x7fb8dc0cc5a0 2023-10-06T02:24:54.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.554+0000 7fb8d2ffd700 1 -- 172.21.15.37:0/3890347289 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c40116f0 con 0x7fb8dc0cc5a0 2023-10-06T02:24:54.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.554+0000 7fb8e167e700 1 -- 172.21.15.37:0/3890347289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8dc15ce20 con 0x7fb8dc0cc5a0 2023-10-06T02:24:54.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.554+0000 7fb8d2ffd700 1 -- 172.21.15.37:0/3890347289 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4011ab0 con 0x7fb8dc0cc5a0 2023-10-06T02:24:54.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.554+0000 7fb8e167e700 1 -- 172.21.15.37:0/3890347289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8dc14ad30 con 0x7fb8dc0cc5a0 2023-10-06T02:24:54.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.555+0000 7fb8e167e700 1 -- 172.21.15.37:0/3890347289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8dc15d130 con 0x7fb8dc0cc5a0 2023-10-06T02:24:54.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.555+0000 7fb8d2ffd700 1 -- 172.21.15.37:0/3890347289 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8c401b3b0 con 0x7fb8dc0cc5a0 2023-10-06T02:24:54.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.555+0000 7fb8d2ffd700 1 --2- 172.21.15.37:0/3890347289 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb8bc066f30 0x7fb8bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.556+0000 7fb8d2ffd700 1 -- 172.21.15.37:0/3890347289 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb8c4083c40 con 0x7fb8dc0cc5a0 2023-10-06T02:24:54.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.556+0000 7fb8daffd700 1 --2- 172.21.15.37:0/3890347289 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb8bc066f30 0x7fb8bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.556+0000 7fb8daffd700 1 --2- 172.21.15.37:0/3890347289 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb8bc066f30 0x7fb8bc0693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0074f0 tx=0x7fb8cc009700 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.560+0000 7fb8d2ffd700 1 -- 172.21.15.37:0/3890347289 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8c4050d50 con 0x7fb8dc0cc5a0 2023-10-06T02:24:54.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.753+0000 7fb8e167e700 1 -- 172.21.15.37:0/3890347289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8dc15d850 con 0x7fb8dc0cc5a0 2023-10-06T02:24:54.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.754+0000 7fb8d2ffd700 1 -- 172.21.15.37:0/3890347289 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fb8c4017070 con 0x7fb8dc0cc5a0 2023-10-06T02:24:54.755 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:54.755 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":43,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:24:51.995307+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:24:48.109383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T02:24:49.348527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:24:54.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.756+0000 7fb8e167e700 1 -- 172.21.15.37:0/3890347289 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb8bc066f30 msgr2=0x7fb8bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.756+0000 7fb8e167e700 1 --2- 172.21.15.37:0/3890347289 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb8bc066f30 0x7fb8bc0693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0074f0 tx=0x7fb8cc009700 comp rx=0 tx=0).stop 2023-10-06T02:24:54.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.756+0000 7fb8e167e700 1 -- 172.21.15.37:0/3890347289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8dc0cc5a0 msgr2=0x7fb8dc15bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.756+0000 7fb8e167e700 1 --2- 172.21.15.37:0/3890347289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8dc0cc5a0 0x7fb8dc15bc70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb8c400c590 tx=0x7fb8c400c950 comp rx=0 tx=0).stop 2023-10-06T02:24:54.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.756+0000 7fb8e167e700 1 -- 172.21.15.37:0/3890347289 shutdown_connections 2023-10-06T02:24:54.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.756+0000 7fb8e167e700 1 --2- 172.21.15.37:0/3890347289 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8dc1595a0 0x7fb8dc14a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.756+0000 7fb8e167e700 1 --2- 172.21.15.37:0/3890347289 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb8bc066f30 0x7fb8bc0693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.756+0000 7fb8e167e700 1 --2- 172.21.15.37:0/3890347289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8dc06d890 0x7fb8dc15a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.756+0000 7fb8e167e700 1 --2- 172.21.15.37:0/3890347289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8dc0cc5a0 0x7fb8dc15bc70 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.756+0000 7fb8e167e700 1 -- 172.21.15.37:0/3890347289 >> 172.21.15.37:0/3890347289 conn(0x7fb8dc0d04d0 msgr2=0x7fb8dc1566f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:54.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.756+0000 7fb8e167e700 1 -- 172.21.15.37:0/3890347289 shutdown_connections 2023-10-06T02:24:54.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.756+0000 7fb8e167e700 1 -- 172.21.15.37:0/3890347289 wait complete. 2023-10-06T02:24:54.769 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:24:54.769 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:24:54.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.888+0000 7f332759e700 1 Processor -- start 2023-10-06T02:24:54.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.888+0000 7f332759e700 1 -- start start 2023-10-06T02:24:54.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.889+0000 7f332759e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3328159370 0x7f3328159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.889+0000 7f332759e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f33280b2270 0x7f332815db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.889+0000 7f332759e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33280cb200 con 0x7f33280aff10 2023-10-06T02:24:54.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.889+0000 7f332759e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33280b5c00 con 0x7f3328159370 2023-10-06T02:24:54.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.889+0000 7f332759e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33280cb7c0 con 0x7f33280b2270 2023-10-06T02:24:54.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.889+0000 7f332659c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3328159370 0x7f3328159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.889+0000 7f3326d9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f33280aff10 0x7f33280b0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39170/0 (socket says 172.21.15.37:39170) 2023-10-06T02:24:54.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.889+0000 7f3326d9d700 1 -- 172.21.15.37:0/668229035 learned_addr learned my addr 172.21.15.37:0/668229035 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:54.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.889+0000 7f3325d9b700 1 --2- 172.21.15.37:0/668229035 >> v2:172.21.15.191:3300/0 conn(0x7f33280b2270 0x7f332815db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.889+0000 7f332659c700 1 -- 172.21.15.37:0/668229035 >> v2:172.21.15.191:3300/0 conn(0x7f33280b2270 msgr2=0x7f332815db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:54.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.889+0000 7f332659c700 1 --2- 172.21.15.37:0/668229035 >> v2:172.21.15.191:3300/0 conn(0x7f33280b2270 0x7f332815db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.889+0000 7f332659c700 1 -- 172.21.15.37:0/668229035 >> v1:172.21.15.37:6789/0 conn(0x7f33280aff10 legacy=0x7f33280b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.889+0000 7f332659c700 1 -- 172.21.15.37:0/668229035 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332815e0d0 con 0x7f3328159370 2023-10-06T02:24:54.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.889+0000 7f332559a700 1 -- 172.21.15.37:0/668229035 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615947835 0 0) 0x7f33280cb200 con 0x7f33280aff10 2023-10-06T02:24:54.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.890+0000 7f332659c700 1 --2- 172.21.15.37:0/668229035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3328159370 0x7f3328159740 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f332815d130 tx=0x7f3318009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5112c26b88ea8f55 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.890+0000 7f332559a700 1 -- 172.21.15.37:0/668229035 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331800e070 con 0x7f3328159370 2023-10-06T02:24:54.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.890+0000 7f332559a700 1 -- 172.21.15.37:0/668229035 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331800bc30 con 0x7f3328159370 2023-10-06T02:24:54.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.890+0000 7f332559a700 1 -- 172.21.15.37:0/668229035 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318012430 con 0x7f3328159370 2023-10-06T02:24:54.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.890+0000 7f332759e700 1 -- 172.21.15.37:0/668229035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3328159370 msgr2=0x7f3328159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.890+0000 7f332759e700 1 --2- 172.21.15.37:0/668229035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3328159370 0x7f3328159740 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f332815d130 tx=0x7f3318009780 comp rx=0 tx=0).stop 2023-10-06T02:24:54.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.890+0000 7f332759e700 1 -- 172.21.15.37:0/668229035 shutdown_connections 2023-10-06T02:24:54.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.890+0000 7f332759e700 1 --2- 172.21.15.37:0/668229035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3328159370 0x7f3328159740 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.890+0000 7f332759e700 1 --2- 172.21.15.37:0/668229035 >> v2:172.21.15.191:3300/0 conn(0x7f33280b2270 0x7f332815db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.890+0000 7f332759e700 1 -- 172.21.15.37:0/668229035 >> 172.21.15.37:0/668229035 conn(0x7f332806c0b0 msgr2=0x7f332806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:54.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.890+0000 7f332759e700 1 -- 172.21.15.37:0/668229035 shutdown_connections 2023-10-06T02:24:54.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.890+0000 7f332759e700 1 -- 172.21.15.37:0/668229035 wait complete. 2023-10-06T02:24:54.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.891+0000 7f332759e700 1 Processor -- start 2023-10-06T02:24:54.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.891+0000 7f332759e700 1 -- start start 2023-10-06T02:24:54.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.892+0000 7f332759e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33280aff10 0x7f3328169b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.892+0000 7f332759e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33280b2270 0x7f33280cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.892+0000 7f332759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3328159370 0x7f33280cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.892+0000 7f332759e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33280d02c0 con 0x7f3328159370 2023-10-06T02:24:54.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.892+0000 7f332759e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332816d310 con 0x7f33280aff10 2023-10-06T02:24:54.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.892+0000 7f332759e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332816ab10 con 0x7f33280b2270 2023-10-06T02:24:54.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.892+0000 7f3326d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3328159370 0x7f33280cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.892+0000 7f3326d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3328159370 0x7f33280cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37978/0 (socket says 172.21.15.37:37978) 2023-10-06T02:24:54.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.892+0000 7f3326d9d700 1 -- 172.21.15.37:0/2199957776 learned_addr learned my addr 172.21.15.37:0/2199957776 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:54.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.892+0000 7f3325d9b700 1 --2- 172.21.15.37:0/2199957776 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33280b2270 0x7f33280cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.892+0000 7f332659c700 1 --2- 172.21.15.37:0/2199957776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33280aff10 0x7f3328169b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.893+0000 7f3326d9d700 1 -- 172.21.15.37:0/2199957776 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33280b2270 msgr2=0x7f33280cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.893+0000 7f3326d9d700 1 --2- 172.21.15.37:0/2199957776 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33280b2270 0x7f33280cfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.893+0000 7f3326d9d700 1 -- 172.21.15.37:0/2199957776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33280aff10 msgr2=0x7f3328169b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:54.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.893+0000 7f3326d9d700 1 --2- 172.21.15.37:0/2199957776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33280aff10 0x7f3328169b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:54.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.893+0000 7f3326d9d700 1 -- 172.21.15.37:0/2199957776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3318009a20 con 0x7f3328159370 2023-10-06T02:24:54.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.893+0000 7f332659c700 1 --2- 172.21.15.37:0/2199957776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33280aff10 0x7f3328169b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:54.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.893+0000 7f3326d9d700 1 --2- 172.21.15.37:0/2199957776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3328159370 0x7f33280cec90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f33200011e0 tx=0x7f3320007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.893+0000 7f331e7fc700 1 -- 172.21.15.37:0/2199957776 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3320005b30 con 0x7f3328159370 2023-10-06T02:24:54.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.893+0000 7f331e7fc700 1 -- 172.21.15.37:0/2199957776 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3320005c90 con 0x7f3328159370 2023-10-06T02:24:54.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.893+0000 7f332759e700 1 -- 172.21.15.37:0/2199957776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332816a270 con 0x7f3328159370 2023-10-06T02:24:54.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.893+0000 7f331e7fc700 1 -- 172.21.15.37:0/2199957776 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3320007320 con 0x7f3328159370 2023-10-06T02:24:54.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.893+0000 7f332759e700 1 -- 172.21.15.37:0/2199957776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332816a830 con 0x7f3328159370 2023-10-06T02:24:54.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.894+0000 7f332759e700 1 -- 172.21.15.37:0/2199957776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332816d480 con 0x7f3328159370 2023-10-06T02:24:54.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.894+0000 7f331e7fc700 1 -- 172.21.15.37:0/2199957776 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3320007690 con 0x7f3328159370 2023-10-06T02:24:54.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.895+0000 7f331e7fc700 1 --2- 172.21.15.37:0/2199957776 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3308066f30 0x7f33080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:54.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.895+0000 7f331e7fc700 1 -- 172.21.15.37:0/2199957776 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3320083b60 con 0x7f3328159370 2023-10-06T02:24:54.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.895+0000 7f332659c700 1 --2- 172.21.15.37:0/2199957776 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3308066f30 0x7f33080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:54.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.896+0000 7f332659c700 1 --2- 172.21.15.37:0/2199957776 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3308066f30 0x7f33080693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f332815d130 tx=0x7f3318019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:54.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:54.899+0000 7f331e7fc700 1 -- 172.21.15.37:0/2199957776 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f332816d480 con 0x7f3328159370 2023-10-06T02:24:55.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.089+0000 7f332759e700 1 -- 172.21.15.37:0/2199957776 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f332816d480 con 0x7f3308066f30 2023-10-06T02:24:55.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.098+0000 7f331e7fc700 1 -- 172.21.15.37:0/2199957776 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311653 (secure 0 0 0) 0x7f332816d480 con 0x7f3308066f30 2023-10-06T02:24:55.103 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:55.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.102+0000 7f332759e700 1 -- 172.21.15.37:0/2199957776 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3308066f30 msgr2=0x7f33080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.102+0000 7f332759e700 1 --2- 172.21.15.37:0/2199957776 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3308066f30 0x7f33080693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f332815d130 tx=0x7f3318019000 comp rx=0 tx=0).stop 2023-10-06T02:24:55.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.102+0000 7f332759e700 1 -- 172.21.15.37:0/2199957776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3328159370 msgr2=0x7f33280cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.102+0000 7f332759e700 1 --2- 172.21.15.37:0/2199957776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3328159370 0x7f33280cec90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f33200011e0 tx=0x7f3320007d30 comp rx=0 tx=0).stop 2023-10-06T02:24:55.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.102+0000 7f332759e700 1 -- 172.21.15.37:0/2199957776 shutdown_connections 2023-10-06T02:24:55.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.102+0000 7f332759e700 1 --2- 172.21.15.37:0/2199957776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3328159370 0x7f33280cec90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.102+0000 7f332759e700 1 --2- 172.21.15.37:0/2199957776 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3308066f30 0x7f33080693e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.102+0000 7f332759e700 1 --2- 172.21.15.37:0/2199957776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33280aff10 0x7f3328169b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.102+0000 7f332759e700 1 --2- 172.21.15.37:0/2199957776 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33280b2270 0x7f33280cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.102+0000 7f332759e700 1 -- 172.21.15.37:0/2199957776 >> 172.21.15.37:0/2199957776 conn(0x7f332806c0b0 msgr2=0x7f3328157d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.102+0000 7f332759e700 1 -- 172.21.15.37:0/2199957776 shutdown_connections 2023-10-06T02:24:55.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.102+0000 7f332759e700 1 -- 172.21.15.37:0/2199957776 wait complete. 2023-10-06T02:24:55.106 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:24:55.115 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2023-10-06T02:24:54.532844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383452,"kb_used_data":5148,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591268,"statfs":{"total":773094113280,"available":770653458432,"internally_reserved":0,"allocated":5271552,"data_stored":2891225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.568890"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.005243+0000","last_change":"2023-10-06T02:24:50.996307+0000","last_active":"2023-10-06T02:24:51.005243+0000","last_peered":"2023-10-06T02:24:51.005243+0000","last_clean":"2023-10-06T02:24:51.005243+0000","last_became_active":"2023-10-06T02:24:50.995980+0000","last_became_peered":"2023-10-06T02:24:50.995980+0000","last_unstale":"2023-10-06T02:24:51.005243+0000","last_undegraded":"2023-10-06T02:24:51.005243+0000","last_fullsized":"2023-10-06T02:24:51.005243+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:46.955345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.005412+0000","last_change":"2023-10-06T02:24:50.998128+0000","last_active":"2023-10-06T02:24:51.005412+0000","last_peered":"2023-10-06T02:24:51.005412+0000","last_clean":"2023-10-06T02:24:51.005412+0000","last_became_active":"2023-10-06T02:24:50.997464+0000","last_became_peered":"2023-10-06T02:24:50.997464+0000","last_unstale":"2023-10-06T02:24:51.005412+0000","last_undegraded":"2023-10-06T02:24:51.005412+0000","last_fullsized":"2023-10-06T02:24:51.005412+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:47:19.163652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.016574+0000","last_change":"2023-10-06T02:24:51.008563+0000","last_active":"2023-10-06T02:24:51.016574+0000","last_peered":"2023-10-06T02:24:51.016574+0000","last_clean":"2023-10-06T02:24:51.016574+0000","last_became_active":"2023-10-06T02:24:51.008309+0000","last_became_peered":"2023-10-06T02:24:51.008309+0000","last_unstale":"2023-10-06T02:24:51.016574+0000","last_undegraded":"2023-10-06T02:24:51.016574+0000","last_fullsized":"2023-10-06T02:24:51.016574+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:00.696318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.011304+0000","last_change":"2023-10-06T02:24:51.004571+0000","last_active":"2023-10-06T02:24:51.011304+0000","last_peered":"2023-10-06T02:24:51.011304+0000","last_clean":"2023-10-06T02:24:51.011304+0000","last_became_active":"2023-10-06T02:24:51.004250+0000","last_became_peered":"2023-10-06T02:24:51.004250+0000","last_unstale":"2023-10-06T02:24:51.011304+0000","last_undegraded":"2023-10-06T02:24:51.011304+0000","last_fullsized":"2023-10-06T02:24:51.011304+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:54.233111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.011246+0000","last_change":"2023-10-06T02:24:51.009187+0000","last_active":"2023-10-06T02:24:51.011246+0000","last_peered":"2023-10-06T02:24:51.011246+0000","last_clean":"2023-10-06T02:24:51.011246+0000","last_became_active":"2023-10-06T02:24:51.008943+0000","last_became_peered":"2023-10-06T02:24:51.008943+0000","last_unstale":"2023-10-06T02:24:51.011246+0000","last_undegraded":"2023-10-06T02:24:51.011246+0000","last_fullsized":"2023-10-06T02:24:51.011246+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:56.115437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.005731+0000","last_change":"2023-10-06T02:24:51.000067+0000","last_active":"2023-10-06T02:24:51.005731+0000","last_peered":"2023-10-06T02:24:51.005731+0000","last_clean":"2023-10-06T02:24:51.005731+0000","last_became_active":"2023-10-06T02:24:50.999767+0000","last_became_peered":"2023-10-06T02:24:50.999767+0000","last_unstale":"2023-10-06T02:24:51.005731+0000","last_undegraded":"2023-10-06T02:24:51.005731+0000","last_fullsized":"2023-10-06T02:24:51.005731+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:07.053582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.006952+0000","last_change":"2023-10-06T02:24:51.004734+0000","last_active":"2023-10-06T02:24:51.006952+0000","last_peered":"2023-10-06T02:24:51.006952+0000","last_clean":"2023-10-06T02:24:51.006952+0000","last_became_active":"2023-10-06T02:24:51.003939+0000","last_became_peered":"2023-10-06T02:24:51.003939+0000","last_unstale":"2023-10-06T02:24:51.006952+0000","last_undegraded":"2023-10-06T02:24:51.006952+0000","last_fullsized":"2023-10-06T02:24:51.006952+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:35.062384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.010508+0000","last_change":"2023-10-06T02:24:51.004108+0000","last_active":"2023-10-06T02:24:51.010508+0000","last_peered":"2023-10-06T02:24:51.010508+0000","last_clean":"2023-10-06T02:24:51.010508+0000","last_became_active":"2023-10-06T02:24:51.003848+0000","last_became_peered":"2023-10-06T02:24:51.003848+0000","last_unstale":"2023-10-06T02:24:51.010508+0000","last_undegraded":"2023-10-06T02:24:51.010508+0000","last_fullsized":"2023-10-06T02:24:51.010508+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:21.258337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.011947+0000","last_change":"2023-10-06T02:24:51.003419+0000","last_active":"2023-10-06T02:24:51.011947+0000","last_peered":"2023-10-06T02:24:51.011947+0000","last_clean":"2023-10-06T02:24:51.011947+0000","last_became_active":"2023-10-06T02:24:51.002704+0000","last_became_peered":"2023-10-06T02:24:51.002704+0000","last_unstale":"2023-10-06T02:24:51.011947+0000","last_undegraded":"2023-10-06T02:24:51.011947+0000","last_fullsized":"2023-10-06T02:24:51.011947+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:00.696318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.007937+0000","last_change":"2023-10-06T02:24:51.004238+0000","last_active":"2023-10-06T02:24:51.007937+0000","last_peered":"2023-10-06T02:24:51.007937+0000","last_clean":"2023-10-06T02:24:51.007937+0000","last_became_active":"2023-10-06T02:24:51.003948+0000","last_became_peered":"2023-10-06T02:24:51.003948+0000","last_unstale":"2023-10-06T02:24:51.007937+0000","last_undegraded":"2023-10-06T02:24:51.007937+0000","last_fullsized":"2023-10-06T02:24:51.007937+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:13.870180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.004719+0000","last_change":"2023-10-06T02:24:50.998274+0000","last_active":"2023-10-06T02:24:51.004719+0000","last_peered":"2023-10-06T02:24:51.004719+0000","last_clean":"2023-10-06T02:24:51.004719+0000","last_became_active":"2023-10-06T02:24:50.998017+0000","last_became_peered":"2023-10-06T02:24:50.998017+0000","last_unstale":"2023-10-06T02:24:51.004719+0000","last_undegraded":"2023-10-06T02:24:51.004719+0000","last_fullsized":"2023-10-06T02:24:51.004719+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:46.571692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.004950+0000","last_change":"2023-10-06T02:24:50.998268+0000","last_active":"2023-10-06T02:24:51.004950+0000","last_peered":"2023-10-06T02:24:51.004950+0000","last_clean":"2023-10-06T02:24:51.004950+0000","last_became_active":"2023-10-06T02:24:50.998014+0000","last_became_peered":"2023-10-06T02:24:50.998014+0000","last_unstale":"2023-10-06T02:24:51.004950+0000","last_undegraded":"2023-10-06T02:24:51.004950+0000","last_fullsized":"2023-10-06T02:24:51.004950+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:35.062384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.008479+0000","last_change":"2023-10-06T02:24:51.004330+0000","last_active":"2023-10-06T02:24:51.008479+0000","last_peered":"2023-10-06T02:24:51.008479+0000","last_clean":"2023-10-06T02:24:51.008479+0000","last_became_active":"2023-10-06T02:24:51.004026+0000","last_became_peered":"2023-10-06T02:24:51.004026+0000","last_unstale":"2023-10-06T02:24:51.008479+0000","last_undegraded":"2023-10-06T02:24:51.008479+0000","last_fullsized":"2023-10-06T02:24:51.008479+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:13.591761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.016514+0000","last_change":"2023-10-06T02:24:51.008202+0000","last_active":"2023-10-06T02:24:51.016514+0000","last_peered":"2023-10-06T02:24:51.016514+0000","last_clean":"2023-10-06T02:24:51.016514+0000","last_became_active":"2023-10-06T02:24:51.007970+0000","last_became_peered":"2023-10-06T02:24:51.007970+0000","last_unstale":"2023-10-06T02:24:51.016514+0000","last_undegraded":"2023-10-06T02:24:51.016514+0000","last_fullsized":"2023-10-06T02:24:51.016514+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:49.845589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.011351+0000","last_change":"2023-10-06T02:24:51.006160+0000","last_active":"2023-10-06T02:24:51.011351+0000","last_peered":"2023-10-06T02:24:51.011351+0000","last_clean":"2023-10-06T02:24:51.011351+0000","last_became_active":"2023-10-06T02:24:51.005626+0000","last_became_peered":"2023-10-06T02:24:51.005626+0000","last_unstale":"2023-10-06T02:24:51.011351+0000","last_undegraded":"2023-10-06T02:24:51.011351+0000","last_fullsized":"2023-10-06T02:24:51.011351+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:18.481052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.008738+0000","last_change":"2023-10-06T02:24:51.004776+0000","last_active":"2023-10-06T02:24:51.008738+0000","last_peered":"2023-10-06T02:24:51.008738+0000","last_clean":"2023-10-06T02:24:51.008738+0000","last_became_active":"2023-10-06T02:24:51.004486+0000","last_became_peered":"2023-10-06T02:24:51.004486+0000","last_unstale":"2023-10-06T02:24:51.008738+0000","last_undegraded":"2023-10-06T02:24:51.008738+0000","last_fullsized":"2023-10-06T02:24:51.008738+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:31.400935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.009745+0000","last_change":"2023-10-06T02:24:51.004377+0000","last_active":"2023-10-06T02:24:51.009745+0000","last_peered":"2023-10-06T02:24:51.009745+0000","last_clean":"2023-10-06T02:24:51.009745+0000","last_became_active":"2023-10-06T02:24:51.003744+0000","last_became_peered":"2023-10-06T02:24:51.003744+0000","last_unstale":"2023-10-06T02:24:51.009745+0000","last_undegraded":"2023-10-06T02:24:51.009745+0000","last_fullsized":"2023-10-06T02:24:51.009745+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:30.985680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.005433+0000","last_change":"2023-10-06T02:24:50.998286+0000","last_active":"2023-10-06T02:24:51.005433+0000","last_peered":"2023-10-06T02:24:51.005433+0000","last_clean":"2023-10-06T02:24:51.005433+0000","last_became_active":"2023-10-06T02:24:50.997857+0000","last_became_peered":"2023-10-06T02:24:50.997857+0000","last_unstale":"2023-10-06T02:24:51.005433+0000","last_undegraded":"2023-10-06T02:24:51.005433+0000","last_fullsized":"2023-10-06T02:24:51.005433+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:54.461599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.006838+0000","last_change":"2023-10-06T02:24:51.003283+0000","last_active":"2023-10-06T02:24:51.006838+0000","last_peered":"2023-10-06T02:24:51.006838+0000","last_clean":"2023-10-06T02:24:51.006838+0000","last_became_active":"2023-10-06T02:24:51.002979+0000","last_became_peered":"2023-10-06T02:24:51.002979+0000","last_unstale":"2023-10-06T02:24:51.006838+0000","last_undegraded":"2023-10-06T02:24:51.006838+0000","last_fullsized":"2023-10-06T02:24:51.006838+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:07.077399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.007246+0000","last_change":"2023-10-06T02:24:51.002703+0000","last_active":"2023-10-06T02:24:51.007246+0000","last_peered":"2023-10-06T02:24:51.007246+0000","last_clean":"2023-10-06T02:24:51.007246+0000","last_became_active":"2023-10-06T02:24:51.002479+0000","last_became_peered":"2023-10-06T02:24:51.002479+0000","last_unstale":"2023-10-06T02:24:51.007246+0000","last_undegraded":"2023-10-06T02:24:51.007246+0000","last_fullsized":"2023-10-06T02:24:51.007246+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:31.400935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.009931+0000","last_change":"2023-10-06T02:24:51.006837+0000","last_active":"2023-10-06T02:24:51.009931+0000","last_peered":"2023-10-06T02:24:51.009931+0000","last_clean":"2023-10-06T02:24:51.009931+0000","last_became_active":"2023-10-06T02:24:51.006553+0000","last_became_peered":"2023-10-06T02:24:51.006553+0000","last_unstale":"2023-10-06T02:24:51.009931+0000","last_undegraded":"2023-10-06T02:24:51.009931+0000","last_fullsized":"2023-10-06T02:24:51.009931+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:24.183544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.007322+0000","last_change":"2023-10-06T02:24:51.002587+0000","last_active":"2023-10-06T02:24:51.007322+0000","last_peered":"2023-10-06T02:24:51.007322+0000","last_clean":"2023-10-06T02:24:51.007322+0000","last_became_active":"2023-10-06T02:24:51.002276+0000","last_became_peered":"2023-10-06T02:24:51.002276+0000","last_unstale":"2023-10-06T02:24:51.007322+0000","last_undegraded":"2023-10-06T02:24:51.007322+0000","last_fullsized":"2023-10-06T02:24:51.007322+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:13.475431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.010138+0000","last_change":"2023-10-06T02:24:51.005203+0000","last_active":"2023-10-06T02:24:51.010138+0000","last_peered":"2023-10-06T02:24:51.010138+0000","last_clean":"2023-10-06T02:24:51.010138+0000","last_became_active":"2023-10-06T02:24:51.004943+0000","last_became_peered":"2023-10-06T02:24:51.004943+0000","last_unstale":"2023-10-06T02:24:51.010138+0000","last_undegraded":"2023-10-06T02:24:51.010138+0000","last_fullsized":"2023-10-06T02:24:51.010138+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:38.080796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.016552+0000","last_change":"2023-10-06T02:24:51.008558+0000","last_active":"2023-10-06T02:24:51.016552+0000","last_peered":"2023-10-06T02:24:51.016552+0000","last_clean":"2023-10-06T02:24:51.016552+0000","last_became_active":"2023-10-06T02:24:51.008250+0000","last_became_peered":"2023-10-06T02:24:51.008250+0000","last_unstale":"2023-10-06T02:24:51.016552+0000","last_undegraded":"2023-10-06T02:24:51.016552+0000","last_fullsized":"2023-10-06T02:24:51.016552+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:01.772133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.016664+0000","last_change":"2023-10-06T02:24:51.010972+0000","last_active":"2023-10-06T02:24:51.016664+0000","last_peered":"2023-10-06T02:24:51.016664+0000","last_clean":"2023-10-06T02:24:51.016664+0000","last_became_active":"2023-10-06T02:24:51.010702+0000","last_became_peered":"2023-10-06T02:24:51.010702+0000","last_unstale":"2023-10-06T02:24:51.016664+0000","last_undegraded":"2023-10-06T02:24:51.016664+0000","last_fullsized":"2023-10-06T02:24:51.016664+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:10.468877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.006145+0000","last_change":"2023-10-06T02:24:51.002186+0000","last_active":"2023-10-06T02:24:51.006145+0000","last_peered":"2023-10-06T02:24:51.006145+0000","last_clean":"2023-10-06T02:24:51.006145+0000","last_became_active":"2023-10-06T02:24:51.001908+0000","last_became_peered":"2023-10-06T02:24:51.001908+0000","last_unstale":"2023-10-06T02:24:51.006145+0000","last_undegraded":"2023-10-06T02:24:51.006145+0000","last_fullsized":"2023-10-06T02:24:51.006145+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:07.077399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.009091+0000","last_change":"2023-10-06T02:24:51.005403+0000","last_active":"2023-10-06T02:24:51.009091+0000","last_peered":"2023-10-06T02:24:51.009091+0000","last_clean":"2023-10-06T02:24:51.009091+0000","last_became_active":"2023-10-06T02:24:51.001142+0000","last_became_peered":"2023-10-06T02:24:51.001142+0000","last_unstale":"2023-10-06T02:24:51.009091+0000","last_undegraded":"2023-10-06T02:24:51.009091+0000","last_fullsized":"2023-10-06T02:24:51.009091+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:15.138213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.000831+0000","last_change":"2023-10-06T02:24:50.994189+0000","last_active":"2023-10-06T02:24:51.000831+0000","last_peered":"2023-10-06T02:24:51.000831+0000","last_clean":"2023-10-06T02:24:51.000831+0000","last_became_active":"2023-10-06T02:24:50.993934+0000","last_became_peered":"2023-10-06T02:24:50.993934+0000","last_unstale":"2023-10-06T02:24:51.000831+0000","last_undegraded":"2023-10-06T02:24:51.000831+0000","last_fullsized":"2023-10-06T02:24:51.000831+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:34.741977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.000943+0000","last_change":"2023-10-06T02:24:50.998481+0000","last_active":"2023-10-06T02:24:51.000943+0000","last_peered":"2023-10-06T02:24:51.000943+0000","last_clean":"2023-10-06T02:24:51.000943+0000","last_became_active":"2023-10-06T02:24:50.998245+0000","last_became_peered":"2023-10-06T02:24:50.998245+0000","last_unstale":"2023-10-06T02:24:51.000943+0000","last_undegraded":"2023-10-06T02:24:51.000943+0000","last_fullsized":"2023-10-06T02:24:51.000943+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:24.063459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.012027+0000","last_change":"2023-10-06T02:24:51.006557+0000","last_active":"2023-10-06T02:24:51.012027+0000","last_peered":"2023-10-06T02:24:51.012027+0000","last_clean":"2023-10-06T02:24:51.012027+0000","last_became_active":"2023-10-06T02:24:51.006288+0000","last_became_peered":"2023-10-06T02:24:51.006288+0000","last_unstale":"2023-10-06T02:24:51.012027+0000","last_undegraded":"2023-10-06T02:24:51.012027+0000","last_fullsized":"2023-10-06T02:24:51.012027+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:46.025692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.006932+0000","last_change":"2023-10-06T02:24:51.004607+0000","last_active":"2023-10-06T02:24:51.006932+0000","last_peered":"2023-10-06T02:24:51.006932+0000","last_clean":"2023-10-06T02:24:51.006932+0000","last_became_active":"2023-10-06T02:24:51.004333+0000","last_became_peered":"2023-10-06T02:24:51.004333+0000","last_unstale":"2023-10-06T02:24:51.006932+0000","last_undegraded":"2023-10-06T02:24:51.006932+0000","last_fullsized":"2023-10-06T02:24:51.006932+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:13.475431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.003234+0000","last_change":"2023-10-06T02:24:50.996900+0000","last_active":"2023-10-06T02:24:51.003234+0000","last_peered":"2023-10-06T02:24:51.003234+0000","last_clean":"2023-10-06T02:24:51.003234+0000","last_became_active":"2023-10-06T02:24:50.996279+0000","last_became_peered":"2023-10-06T02:24:50.996279+0000","last_unstale":"2023-10-06T02:24:51.003234+0000","last_undegraded":"2023-10-06T02:24:51.003234+0000","last_fullsized":"2023-10-06T02:24:51.003234+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:56.115437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.010060+0000","last_change":"2023-10-06T02:24:50.999150+0000","last_active":"2023-10-06T02:24:51.010060+0000","last_peered":"2023-10-06T02:24:51.010060+0000","last_clean":"2023-10-06T02:24:51.010060+0000","last_became_active":"2023-10-06T02:24:50.998874+0000","last_became_peered":"2023-10-06T02:24:50.998874+0000","last_unstale":"2023-10-06T02:24:51.010060+0000","last_undegraded":"2023-10-06T02:24:51.010060+0000","last_fullsized":"2023-10-06T02:24:51.010060+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:47.650860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"42'4","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.014072+0000","last_change":"2023-10-06T02:24:49.975288+0000","last_active":"2023-10-06T02:24:51.014072+0000","last_peered":"2023-10-06T02:24:51.014072+0000","last_clean":"2023-10-06T02:24:51.014072+0000","last_became_active":"2023-10-06T02:24:49.975032+0000","last_became_peered":"2023-10-06T02:24:49.975032+0000","last_unstale":"2023-10-06T02:24:51.014072+0000","last_undegraded":"2023-10-06T02:24:51.014072+0000","last_fullsized":"2023-10-06T02:24:51.014072+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:40.520860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.011514+0000","last_change":"2023-10-06T02:24:51.004780+0000","last_active":"2023-10-06T02:24:51.011514+0000","last_peered":"2023-10-06T02:24:51.011514+0000","last_clean":"2023-10-06T02:24:51.011514+0000","last_became_active":"2023-10-06T02:24:51.004469+0000","last_became_peered":"2023-10-06T02:24:51.004469+0000","last_unstale":"2023-10-06T02:24:51.011514+0000","last_undegraded":"2023-10-06T02:24:51.011514+0000","last_fullsized":"2023-10-06T02:24:51.011514+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:01.772133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"42'1","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.013638+0000","last_change":"2023-10-06T02:24:49.987659+0000","last_active":"2023-10-06T02:24:51.013638+0000","last_peered":"2023-10-06T02:24:51.013638+0000","last_clean":"2023-10-06T02:24:51.013638+0000","last_became_active":"2023-10-06T02:24:49.987336+0000","last_became_peered":"2023-10-06T02:24:49.987336+0000","last_unstale":"2023-10-06T02:24:51.013638+0000","last_undegraded":"2023-10-06T02:24:51.013638+0000","last_fullsized":"2023-10-06T02:24:51.013638+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:40:17.443956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.000998+0000","last_change":"2023-10-06T02:24:50.996239+0000","last_active":"2023-10-06T02:24:51.000998+0000","last_peered":"2023-10-06T02:24:51.000998+0000","last_clean":"2023-10-06T02:24:51.000998+0000","last_became_active":"2023-10-06T02:24:50.995941+0000","last_became_peered":"2023-10-06T02:24:50.995941+0000","last_unstale":"2023-10-06T02:24:51.000998+0000","last_undegraded":"2023-10-06T02:24:51.000998+0000","last_fullsized":"2023-10-06T02:24:51.000998+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:44.538350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"42'2","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.014174+0000","last_change":"2023-10-06T02:24:49.991069+0000","last_active":"2023-10-06T02:24:51.014174+0000","last_peered":"2023-10-06T02:24:51.014174+0000","last_clean":"2023-10-06T02:24:51.014174+0000","last_became_active":"2023-10-06T02:24:49.990806+0000","last_became_peered":"2023-10-06T02:24:49.990806+0000","last_unstale":"2023-10-06T02:24:51.014174+0000","last_undegraded":"2023-10-06T02:24:51.014174+0000","last_fullsized":"2023-10-06T02:24:51.014174+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:11.794453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.006674+0000","last_change":"2023-10-06T02:24:51.001739+0000","last_active":"2023-10-06T02:24:51.006674+0000","last_peered":"2023-10-06T02:24:51.006674+0000","last_clean":"2023-10-06T02:24:51.006674+0000","last_became_active":"2023-10-06T02:24:51.001427+0000","last_became_peered":"2023-10-06T02:24:51.001427+0000","last_unstale":"2023-10-06T02:24:51.006674+0000","last_undegraded":"2023-10-06T02:24:51.006674+0000","last_fullsized":"2023-10-06T02:24:51.006674+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:30.985680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"42'2","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.012524+0000","last_change":"2023-10-06T02:24:49.985191+0000","last_active":"2023-10-06T02:24:51.012524+0000","last_peered":"2023-10-06T02:24:51.012524+0000","last_clean":"2023-10-06T02:24:51.012524+0000","last_became_active":"2023-10-06T02:24:49.984908+0000","last_became_peered":"2023-10-06T02:24:49.984908+0000","last_unstale":"2023-10-06T02:24:51.012524+0000","last_undegraded":"2023-10-06T02:24:51.012524+0000","last_fullsized":"2023-10-06T02:24:51.012524+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:11.441778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.010599+0000","last_change":"2023-10-06T02:24:51.002616+0000","last_active":"2023-10-06T02:24:51.010599+0000","last_peered":"2023-10-06T02:24:51.010599+0000","last_clean":"2023-10-06T02:24:51.010599+0000","last_became_active":"2023-10-06T02:24:51.002290+0000","last_became_peered":"2023-10-06T02:24:51.002290+0000","last_unstale":"2023-10-06T02:24:51.010599+0000","last_undegraded":"2023-10-06T02:24:51.010599+0000","last_fullsized":"2023-10-06T02:24:51.010599+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:01.772133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"42'1","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.016595+0000","last_change":"2023-10-06T02:24:49.989044+0000","last_active":"2023-10-06T02:24:51.016595+0000","last_peered":"2023-10-06T02:24:51.016595+0000","last_clean":"2023-10-06T02:24:51.016595+0000","last_became_active":"2023-10-06T02:24:49.988768+0000","last_became_peered":"2023-10-06T02:24:49.988768+0000","last_unstale":"2023-10-06T02:24:51.016595+0000","last_undegraded":"2023-10-06T02:24:51.016595+0000","last_fullsized":"2023-10-06T02:24:51.016595+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:26:28.394729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.012354+0000","last_change":"2023-10-06T02:24:51.006616+0000","last_active":"2023-10-06T02:24:51.012354+0000","last_peered":"2023-10-06T02:24:51.012354+0000","last_clean":"2023-10-06T02:24:51.012354+0000","last_became_active":"2023-10-06T02:24:51.005696+0000","last_became_peered":"2023-10-06T02:24:51.005696+0000","last_unstale":"2023-10-06T02:24:51.012354+0000","last_undegraded":"2023-10-06T02:24:51.012354+0000","last_fullsized":"2023-10-06T02:24:51.012354+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:17.070816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"42'1","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.010670+0000","last_change":"2023-10-06T02:24:49.980137+0000","last_active":"2023-10-06T02:24:51.010670+0000","last_peered":"2023-10-06T02:24:51.010670+0000","last_clean":"2023-10-06T02:24:51.010670+0000","last_became_active":"2023-10-06T02:24:49.979841+0000","last_became_peered":"2023-10-06T02:24:49.979841+0000","last_unstale":"2023-10-06T02:24:51.010670+0000","last_undegraded":"2023-10-06T02:24:51.010670+0000","last_fullsized":"2023-10-06T02:24:51.010670+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:25.722081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.010429+0000","last_change":"2023-10-06T02:24:51.003526+0000","last_active":"2023-10-06T02:24:51.010429+0000","last_peered":"2023-10-06T02:24:51.010429+0000","last_clean":"2023-10-06T02:24:51.010429+0000","last_became_active":"2023-10-06T02:24:51.003188+0000","last_became_peered":"2023-10-06T02:24:51.003188+0000","last_unstale":"2023-10-06T02:24:51.010429+0000","last_undegraded":"2023-10-06T02:24:51.010429+0000","last_fullsized":"2023-10-06T02:24:51.010429+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:38.532658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.987313+0000","last_change":"2023-10-06T02:24:49.976741+0000","last_active":"2023-10-06T02:24:50.987313+0000","last_peered":"2023-10-06T02:24:50.987313+0000","last_clean":"2023-10-06T02:24:50.987313+0000","last_became_active":"2023-10-06T02:24:49.976474+0000","last_became_peered":"2023-10-06T02:24:49.976474+0000","last_unstale":"2023-10-06T02:24:50.987313+0000","last_undegraded":"2023-10-06T02:24:50.987313+0000","last_fullsized":"2023-10-06T02:24:50.987313+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:16.691116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.010309+0000","last_change":"2023-10-06T02:24:51.002095+0000","last_active":"2023-10-06T02:24:51.010309+0000","last_peered":"2023-10-06T02:24:51.010309+0000","last_clean":"2023-10-06T02:24:51.010309+0000","last_became_active":"2023-10-06T02:24:51.001815+0000","last_became_peered":"2023-10-06T02:24:51.001815+0000","last_unstale":"2023-10-06T02:24:51.010309+0000","last_undegraded":"2023-10-06T02:24:51.010309+0000","last_fullsized":"2023-10-06T02:24:51.010309+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:56.115437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.994867+0000","last_change":"2023-10-06T02:24:49.982864+0000","last_active":"2023-10-06T02:24:50.994867+0000","last_peered":"2023-10-06T02:24:50.994867+0000","last_clean":"2023-10-06T02:24:50.994867+0000","last_became_active":"2023-10-06T02:24:49.982568+0000","last_became_peered":"2023-10-06T02:24:49.982568+0000","last_unstale":"2023-10-06T02:24:50.994867+0000","last_undegraded":"2023-10-06T02:24:50.994867+0000","last_fullsized":"2023-10-06T02:24:50.994867+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:45.950194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.011232+0000","last_change":"2023-10-06T02:24:51.008932+0000","last_active":"2023-10-06T02:24:51.011232+0000","last_peered":"2023-10-06T02:24:51.011232+0000","last_clean":"2023-10-06T02:24:51.011232+0000","last_became_active":"2023-10-06T02:24:51.008633+0000","last_became_peered":"2023-10-06T02:24:51.008633+0000","last_unstale":"2023-10-06T02:24:51.011232+0000","last_undegraded":"2023-10-06T02:24:51.011232+0000","last_fullsized":"2023-10-06T02:24:51.011232+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:47.650860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.991786+0000","last_change":"2023-10-06T02:24:49.979546+0000","last_active":"2023-10-06T02:24:50.991786+0000","last_peered":"2023-10-06T02:24:50.991786+0000","last_clean":"2023-10-06T02:24:50.991786+0000","last_became_active":"2023-10-06T02:24:49.979280+0000","last_became_peered":"2023-10-06T02:24:49.979280+0000","last_unstale":"2023-10-06T02:24:50.991786+0000","last_undegraded":"2023-10-06T02:24:50.991786+0000","last_fullsized":"2023-10-06T02:24:50.991786+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:31.682427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.004673+0000","last_change":"2023-10-06T02:24:51.001933+0000","last_active":"2023-10-06T02:24:51.004673+0000","last_peered":"2023-10-06T02:24:51.004673+0000","last_clean":"2023-10-06T02:24:51.004673+0000","last_became_active":"2023-10-06T02:24:51.001671+0000","last_became_peered":"2023-10-06T02:24:51.001671+0000","last_unstale":"2023-10-06T02:24:51.004673+0000","last_undegraded":"2023-10-06T02:24:51.004673+0000","last_fullsized":"2023-10-06T02:24:51.004673+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:50.282307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.990527+0000","last_change":"2023-10-06T02:24:49.986190+0000","last_active":"2023-10-06T02:24:50.990527+0000","last_peered":"2023-10-06T02:24:50.990527+0000","last_clean":"2023-10-06T02:24:50.990527+0000","last_became_active":"2023-10-06T02:24:49.986006+0000","last_became_peered":"2023-10-06T02:24:49.986006+0000","last_unstale":"2023-10-06T02:24:50.990527+0000","last_undegraded":"2023-10-06T02:24:50.990527+0000","last_fullsized":"2023-10-06T02:24:50.990527+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:11.441778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.006960+0000","last_change":"2023-10-06T02:24:51.001062+0000","last_active":"2023-10-06T02:24:51.006960+0000","last_peered":"2023-10-06T02:24:51.006960+0000","last_clean":"2023-10-06T02:24:51.006960+0000","last_became_active":"2023-10-06T02:24:51.000665+0000","last_became_peered":"2023-10-06T02:24:51.000665+0000","last_unstale":"2023-10-06T02:24:51.006960+0000","last_undegraded":"2023-10-06T02:24:51.006960+0000","last_fullsized":"2023-10-06T02:24:51.006960+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:03.313825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"42'3","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.028159+0000","last_change":"2023-10-06T02:24:49.983584+0000","last_active":"2023-10-06T02:24:51.028159+0000","last_peered":"2023-10-06T02:24:51.028159+0000","last_clean":"2023-10-06T02:24:51.028159+0000","last_became_active":"2023-10-06T02:24:49.983310+0000","last_became_peered":"2023-10-06T02:24:49.983310+0000","last_unstale":"2023-10-06T02:24:51.028159+0000","last_undegraded":"2023-10-06T02:24:51.028159+0000","last_fullsized":"2023-10-06T02:24:51.028159+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:12.865029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.009740+0000","last_change":"2023-10-06T02:24:51.001223+0000","last_active":"2023-10-06T02:24:51.009740+0000","last_peered":"2023-10-06T02:24:51.009740+0000","last_clean":"2023-10-06T02:24:51.009740+0000","last_became_active":"2023-10-06T02:24:51.000813+0000","last_became_peered":"2023-10-06T02:24:51.000813+0000","last_unstale":"2023-10-06T02:24:51.009740+0000","last_undegraded":"2023-10-06T02:24:51.009740+0000","last_fullsized":"2023-10-06T02:24:51.009740+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:17.070816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"42'6","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.022639+0000","last_change":"2023-10-06T02:24:49.981179+0000","last_active":"2023-10-06T02:24:51.022639+0000","last_peered":"2023-10-06T02:24:51.022639+0000","last_clean":"2023-10-06T02:24:51.022639+0000","last_became_active":"2023-10-06T02:24:49.980903+0000","last_became_peered":"2023-10-06T02:24:49.980903+0000","last_unstale":"2023-10-06T02:24:51.022639+0000","last_undegraded":"2023-10-06T02:24:51.022639+0000","last_fullsized":"2023-10-06T02:24:51.022639+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:48:10.742855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.012578+0000","last_change":"2023-10-06T02:24:51.007115+0000","last_active":"2023-10-06T02:24:51.012578+0000","last_peered":"2023-10-06T02:24:51.012578+0000","last_clean":"2023-10-06T02:24:51.012578+0000","last_became_active":"2023-10-06T02:24:51.006900+0000","last_became_peered":"2023-10-06T02:24:51.006900+0000","last_unstale":"2023-10-06T02:24:51.012578+0000","last_undegraded":"2023-10-06T02:24:51.012578+0000","last_fullsized":"2023-10-06T02:24:51.012578+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:21.981316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"42'2","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.016704+0000","last_change":"2023-10-06T02:24:49.989115+0000","last_active":"2023-10-06T02:24:51.016704+0000","last_peered":"2023-10-06T02:24:51.016704+0000","last_clean":"2023-10-06T02:24:51.016704+0000","last_became_active":"2023-10-06T02:24:49.988860+0000","last_became_peered":"2023-10-06T02:24:49.988860+0000","last_unstale":"2023-10-06T02:24:51.016704+0000","last_undegraded":"2023-10-06T02:24:51.016704+0000","last_fullsized":"2023-10-06T02:24:51.016704+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:12.865029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.001240+0000","last_change":"2023-10-06T02:24:50.998065+0000","last_active":"2023-10-06T02:24:51.001240+0000","last_peered":"2023-10-06T02:24:51.001240+0000","last_clean":"2023-10-06T02:24:51.001240+0000","last_became_active":"2023-10-06T02:24:50.997750+0000","last_became_peered":"2023-10-06T02:24:50.997750+0000","last_unstale":"2023-10-06T02:24:51.001240+0000","last_undegraded":"2023-10-06T02:24:51.001240+0000","last_fullsized":"2023-10-06T02:24:51.001240+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:49.342773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.986833+0000","last_change":"2023-10-06T02:24:49.984698+0000","last_active":"2023-10-06T02:24:50.986833+0000","last_peered":"2023-10-06T02:24:50.986833+0000","last_clean":"2023-10-06T02:24:50.986833+0000","last_became_active":"2023-10-06T02:24:49.984450+0000","last_became_peered":"2023-10-06T02:24:49.984450+0000","last_unstale":"2023-10-06T02:24:50.986833+0000","last_undegraded":"2023-10-06T02:24:50.986833+0000","last_fullsized":"2023-10-06T02:24:50.986833+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:56.372414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.010450+0000","last_change":"2023-10-06T02:24:51.005593+0000","last_active":"2023-10-06T02:24:51.010450+0000","last_peered":"2023-10-06T02:24:51.010450+0000","last_clean":"2023-10-06T02:24:51.010450+0000","last_became_active":"2023-10-06T02:24:51.005330+0000","last_became_peered":"2023-10-06T02:24:51.005330+0000","last_unstale":"2023-10-06T02:24:51.010450+0000","last_undegraded":"2023-10-06T02:24:51.010450+0000","last_fullsized":"2023-10-06T02:24:51.010450+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:49.845589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.996111+0000","last_change":"2023-10-06T02:24:49.982689+0000","last_active":"2023-10-06T02:24:50.996111+0000","last_peered":"2023-10-06T02:24:50.996111+0000","last_clean":"2023-10-06T02:24:50.996111+0000","last_became_active":"2023-10-06T02:24:49.982345+0000","last_became_peered":"2023-10-06T02:24:49.982345+0000","last_unstale":"2023-10-06T02:24:50.996111+0000","last_undegraded":"2023-10-06T02:24:50.996111+0000","last_fullsized":"2023-10-06T02:24:50.996111+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:42:52.427042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.009761+0000","last_change":"2023-10-06T02:24:51.004555+0000","last_active":"2023-10-06T02:24:51.009761+0000","last_peered":"2023-10-06T02:24:51.009761+0000","last_clean":"2023-10-06T02:24:51.009761+0000","last_became_active":"2023-10-06T02:24:51.004075+0000","last_became_peered":"2023-10-06T02:24:51.004075+0000","last_unstale":"2023-10-06T02:24:51.009761+0000","last_undegraded":"2023-10-06T02:24:51.009761+0000","last_fullsized":"2023-10-06T02:24:51.009761+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:37.641976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"42'8","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.020707+0000","last_change":"2023-10-06T02:24:49.982030+0000","last_active":"2023-10-06T02:24:51.020707+0000","last_peered":"2023-10-06T02:24:51.020707+0000","last_clean":"2023-10-06T02:24:51.020707+0000","last_became_active":"2023-10-06T02:24:49.981771+0000","last_became_peered":"2023-10-06T02:24:49.981771+0000","last_unstale":"2023-10-06T02:24:51.020707+0000","last_undegraded":"2023-10-06T02:24:51.020707+0000","last_fullsized":"2023-10-06T02:24:51.020707+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:17.475901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.006176+0000","last_change":"2023-10-06T02:24:50.999637+0000","last_active":"2023-10-06T02:24:51.006176+0000","last_peered":"2023-10-06T02:24:51.006176+0000","last_clean":"2023-10-06T02:24:51.006176+0000","last_became_active":"2023-10-06T02:24:50.999350+0000","last_became_peered":"2023-10-06T02:24:50.999350+0000","last_unstale":"2023-10-06T02:24:51.006176+0000","last_undegraded":"2023-10-06T02:24:51.006176+0000","last_fullsized":"2023-10-06T02:24:51.006176+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:37.641976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"42'1","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.018662+0000","last_change":"2023-10-06T02:24:49.991069+0000","last_active":"2023-10-06T02:24:51.018662+0000","last_peered":"2023-10-06T02:24:51.018662+0000","last_clean":"2023-10-06T02:24:51.018662+0000","last_became_active":"2023-10-06T02:24:49.990774+0000","last_became_peered":"2023-10-06T02:24:49.990774+0000","last_unstale":"2023-10-06T02:24:51.018662+0000","last_undegraded":"2023-10-06T02:24:51.018662+0000","last_fullsized":"2023-10-06T02:24:51.018662+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:31.682427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.005982+0000","last_change":"2023-10-06T02:24:51.002082+0000","last_active":"2023-10-06T02:24:51.005982+0000","last_peered":"2023-10-06T02:24:51.005982+0000","last_clean":"2023-10-06T02:24:51.005982+0000","last_became_active":"2023-10-06T02:24:51.001820+0000","last_became_peered":"2023-10-06T02:24:51.001820+0000","last_unstale":"2023-10-06T02:24:51.005982+0000","last_undegraded":"2023-10-06T02:24:51.005982+0000","last_fullsized":"2023-10-06T02:24:51.005982+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:38.608355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"42'2","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.019636+0000","last_change":"2023-10-06T02:24:49.982626+0000","last_active":"2023-10-06T02:24:51.019636+0000","last_peered":"2023-10-06T02:24:51.019636+0000","last_clean":"2023-10-06T02:24:51.019636+0000","last_became_active":"2023-10-06T02:24:49.982132+0000","last_became_peered":"2023-10-06T02:24:49.982132+0000","last_unstale":"2023-10-06T02:24:51.019636+0000","last_undegraded":"2023-10-06T02:24:51.019636+0000","last_fullsized":"2023-10-06T02:24:51.019636+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:42.140150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.010640+0000","last_change":"2023-10-06T02:24:51.002627+0000","last_active":"2023-10-06T02:24:51.010640+0000","last_peered":"2023-10-06T02:24:51.010640+0000","last_clean":"2023-10-06T02:24:51.010640+0000","last_became_active":"2023-10-06T02:24:51.002305+0000","last_became_peered":"2023-10-06T02:24:51.002305+0000","last_unstale":"2023-10-06T02:24:51.010640+0000","last_undegraded":"2023-10-06T02:24:51.010640+0000","last_fullsized":"2023-10-06T02:24:51.010640+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:21.981316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"42'1","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.014277+0000","last_change":"2023-10-06T02:24:49.981318+0000","last_active":"2023-10-06T02:24:51.014277+0000","last_peered":"2023-10-06T02:24:51.014277+0000","last_clean":"2023-10-06T02:24:51.014277+0000","last_became_active":"2023-10-06T02:24:49.981099+0000","last_became_peered":"2023-10-06T02:24:49.981099+0000","last_unstale":"2023-10-06T02:24:51.014277+0000","last_undegraded":"2023-10-06T02:24:51.014277+0000","last_fullsized":"2023-10-06T02:24:51.014277+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:54.990891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.005820+0000","last_change":"2023-10-06T02:24:50.997842+0000","last_active":"2023-10-06T02:24:51.005820+0000","last_peered":"2023-10-06T02:24:51.005820+0000","last_clean":"2023-10-06T02:24:51.005820+0000","last_became_active":"2023-10-06T02:24:50.997556+0000","last_became_peered":"2023-10-06T02:24:50.997556+0000","last_unstale":"2023-10-06T02:24:51.005820+0000","last_undegraded":"2023-10-06T02:24:51.005820+0000","last_fullsized":"2023-10-06T02:24:51.005820+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:26:29.399880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.987151+0000","last_change":"2023-10-06T02:24:49.972659+0000","last_active":"2023-10-06T02:24:50.987151+0000","last_peered":"2023-10-06T02:24:50.987151+0000","last_clean":"2023-10-06T02:24:50.987151+0000","last_became_active":"2023-10-06T02:24:49.972383+0000","last_became_peered":"2023-10-06T02:24:49.972383+0000","last_unstale":"2023-10-06T02:24:50.987151+0000","last_undegraded":"2023-10-06T02:24:50.987151+0000","last_fullsized":"2023-10-06T02:24:50.987151+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:45.566541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.004434+0000","last_change":"2023-10-06T02:24:51.002683+0000","last_active":"2023-10-06T02:24:51.004434+0000","last_peered":"2023-10-06T02:24:51.004434+0000","last_clean":"2023-10-06T02:24:51.004434+0000","last_became_active":"2023-10-06T02:24:51.001354+0000","last_became_peered":"2023-10-06T02:24:51.001354+0000","last_unstale":"2023-10-06T02:24:51.004434+0000","last_undegraded":"2023-10-06T02:24:51.004434+0000","last_fullsized":"2023-10-06T02:24:51.004434+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:56.202940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"42'2","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.014023+0000","last_change":"2023-10-06T02:24:49.983408+0000","last_active":"2023-10-06T02:24:51.014023+0000","last_peered":"2023-10-06T02:24:51.014023+0000","last_clean":"2023-10-06T02:24:51.014023+0000","last_became_active":"2023-10-06T02:24:49.983079+0000","last_became_peered":"2023-10-06T02:24:49.983079+0000","last_unstale":"2023-10-06T02:24:51.014023+0000","last_undegraded":"2023-10-06T02:24:51.014023+0000","last_fullsized":"2023-10-06T02:24:51.014023+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:40.520860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.007353+0000","last_change":"2023-10-06T02:24:51.002206+0000","last_active":"2023-10-06T02:24:51.007353+0000","last_peered":"2023-10-06T02:24:51.007353+0000","last_clean":"2023-10-06T02:24:51.007353+0000","last_became_active":"2023-10-06T02:24:51.001937+0000","last_became_peered":"2023-10-06T02:24:51.001937+0000","last_unstale":"2023-10-06T02:24:51.007353+0000","last_undegraded":"2023-10-06T02:24:51.007353+0000","last_fullsized":"2023-10-06T02:24:51.007353+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:16.135102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.989092+0000","last_change":"2023-10-06T02:24:49.980636+0000","last_active":"2023-10-06T02:24:50.989092+0000","last_peered":"2023-10-06T02:24:50.989092+0000","last_clean":"2023-10-06T02:24:50.989092+0000","last_became_active":"2023-10-06T02:24:49.980337+0000","last_became_peered":"2023-10-06T02:24:49.980337+0000","last_unstale":"2023-10-06T02:24:50.989092+0000","last_undegraded":"2023-10-06T02:24:50.989092+0000","last_fullsized":"2023-10-06T02:24:50.989092+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:25.722081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.005406+0000","last_change":"2023-10-06T02:24:50.999068+0000","last_active":"2023-10-06T02:24:51.005406+0000","last_peered":"2023-10-06T02:24:51.005406+0000","last_clean":"2023-10-06T02:24:51.005406+0000","last_became_active":"2023-10-06T02:24:50.998816+0000","last_became_peered":"2023-10-06T02:24:50.998816+0000","last_unstale":"2023-10-06T02:24:51.005406+0000","last_undegraded":"2023-10-06T02:24:51.005406+0000","last_fullsized":"2023-10-06T02:24:51.005406+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:57.890276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.989782+0000","last_change":"2023-10-06T02:24:49.987583+0000","last_active":"2023-10-06T02:24:50.989782+0000","last_peered":"2023-10-06T02:24:50.989782+0000","last_clean":"2023-10-06T02:24:50.989782+0000","last_became_active":"2023-10-06T02:24:49.987217+0000","last_became_peered":"2023-10-06T02:24:49.987217+0000","last_unstale":"2023-10-06T02:24:50.989782+0000","last_undegraded":"2023-10-06T02:24:50.989782+0000","last_fullsized":"2023-10-06T02:24:50.989782+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:37.603204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.006113+0000","last_change":"2023-10-06T02:24:51.001347+0000","last_active":"2023-10-06T02:24:51.006113+0000","last_peered":"2023-10-06T02:24:51.006113+0000","last_clean":"2023-10-06T02:24:51.006113+0000","last_became_active":"2023-10-06T02:24:51.001090+0000","last_became_peered":"2023-10-06T02:24:51.001090+0000","last_unstale":"2023-10-06T02:24:51.006113+0000","last_undegraded":"2023-10-06T02:24:51.006113+0000","last_fullsized":"2023-10-06T02:24:51.006113+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:32.687578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.984633+0000","last_change":"2023-10-06T02:24:49.982457+0000","last_active":"2023-10-06T02:24:50.984633+0000","last_peered":"2023-10-06T02:24:50.984633+0000","last_clean":"2023-10-06T02:24:50.984633+0000","last_became_active":"2023-10-06T02:24:49.982182+0000","last_became_peered":"2023-10-06T02:24:49.982182+0000","last_unstale":"2023-10-06T02:24:50.984633+0000","last_undegraded":"2023-10-06T02:24:50.984633+0000","last_fullsized":"2023-10-06T02:24:50.984633+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:22.320332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.008836+0000","last_change":"2023-10-06T02:24:51.002072+0000","last_active":"2023-10-06T02:24:51.008836+0000","last_peered":"2023-10-06T02:24:51.008836+0000","last_clean":"2023-10-06T02:24:51.008836+0000","last_became_active":"2023-10-06T02:24:51.001276+0000","last_became_peered":"2023-10-06T02:24:51.001276+0000","last_unstale":"2023-10-06T02:24:51.008836+0000","last_undegraded":"2023-10-06T02:24:51.008836+0000","last_fullsized":"2023-10-06T02:24:51.008836+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:05:48.077342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.991020+0000","last_change":"2023-10-06T02:24:49.980641+0000","last_active":"2023-10-06T02:24:50.991020+0000","last_peered":"2023-10-06T02:24:50.991020+0000","last_clean":"2023-10-06T02:24:50.991020+0000","last_became_active":"2023-10-06T02:24:49.980344+0000","last_became_peered":"2023-10-06T02:24:49.980344+0000","last_unstale":"2023-10-06T02:24:50.991020+0000","last_undegraded":"2023-10-06T02:24:50.991020+0000","last_fullsized":"2023-10-06T02:24:50.991020+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:11.441778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.994745+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:24:50.994745+0000","last_peered":"2023-10-06T02:24:50.994745+0000","last_clean":"2023-10-06T02:24:50.994745+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:24:50.994745+0000","last_undegraded":"2023-10-06T02:24:50.994745+0000","last_fullsized":"2023-10-06T02:24:50.994745+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.004461+0000","last_change":"2023-10-06T02:24:50.999252+0000","last_active":"2023-10-06T02:24:51.004461+0000","last_peered":"2023-10-06T02:24:51.004461+0000","last_clean":"2023-10-06T02:24:51.004461+0000","last_became_active":"2023-10-06T02:24:50.998964+0000","last_became_peered":"2023-10-06T02:24:50.998964+0000","last_unstale":"2023-10-06T02:24:51.004461+0000","last_undegraded":"2023-10-06T02:24:51.004461+0000","last_fullsized":"2023-10-06T02:24:51.004461+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:03.313825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.989196+0000","last_change":"2023-10-06T02:24:49.980022+0000","last_active":"2023-10-06T02:24:50.989196+0000","last_peered":"2023-10-06T02:24:50.989196+0000","last_clean":"2023-10-06T02:24:50.989196+0000","last_became_active":"2023-10-06T02:24:49.979744+0000","last_became_peered":"2023-10-06T02:24:49.979744+0000","last_unstale":"2023-10-06T02:24:50.989196+0000","last_undegraded":"2023-10-06T02:24:50.989196+0000","last_fullsized":"2023-10-06T02:24:50.989196+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:14.133062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.991204+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:24:50.991204+0000","last_peered":"2023-10-06T02:24:50.991204+0000","last_clean":"2023-10-06T02:24:50.991204+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:24:50.991204+0000","last_undegraded":"2023-10-06T02:24:50.991204+0000","last_fullsized":"2023-10-06T02:24:50.991204+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.005711+0000","last_change":"2023-10-06T02:24:50.999171+0000","last_active":"2023-10-06T02:24:51.005711+0000","last_peered":"2023-10-06T02:24:51.005711+0000","last_clean":"2023-10-06T02:24:51.005711+0000","last_became_active":"2023-10-06T02:24:50.998806+0000","last_became_peered":"2023-10-06T02:24:50.998806+0000","last_unstale":"2023-10-06T02:24:51.005711+0000","last_undegraded":"2023-10-06T02:24:51.005711+0000","last_fullsized":"2023-10-06T02:24:51.005711+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:34.741977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.993741+0000","last_change":"2023-10-06T02:24:49.983248+0000","last_active":"2023-10-06T02:24:50.993741+0000","last_peered":"2023-10-06T02:24:50.993741+0000","last_clean":"2023-10-06T02:24:50.993741+0000","last_became_active":"2023-10-06T02:24:49.982971+0000","last_became_peered":"2023-10-06T02:24:49.982971+0000","last_unstale":"2023-10-06T02:24:50.993741+0000","last_undegraded":"2023-10-06T02:24:50.993741+0000","last_fullsized":"2023-10-06T02:24:50.993741+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:56:14.738878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":30,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.991826+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:24:50.991826+0000","last_peered":"2023-10-06T02:24:50.991826+0000","last_clean":"2023-10-06T02:24:50.991826+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:24:50.991826+0000","last_undegraded":"2023-10-06T02:24:50.991826+0000","last_fullsized":"2023-10-06T02:24:50.991826+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":181,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.991092+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:24:50.991092+0000","last_peered":"2023-10-06T02:24:50.991092+0000","last_clean":"2023-10-06T02:24:50.991092+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:24:50.991092+0000","last_undegraded":"2023-10-06T02:24:50.991092+0000","last_fullsized":"2023-10-06T02:24:50.991092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.010893+0000","last_change":"2023-10-06T02:24:51.008020+0000","last_active":"2023-10-06T02:24:51.010893+0000","last_peered":"2023-10-06T02:24:51.010893+0000","last_clean":"2023-10-06T02:24:51.010893+0000","last_became_active":"2023-10-06T02:24:51.007768+0000","last_became_peered":"2023-10-06T02:24:51.007768+0000","last_unstale":"2023-10-06T02:24:51.010893+0000","last_undegraded":"2023-10-06T02:24:51.010893+0000","last_fullsized":"2023-10-06T02:24:51.010893+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:57.890276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.990300+0000","last_change":"2023-10-06T02:24:49.991755+0000","last_active":"2023-10-06T02:24:50.990300+0000","last_peered":"2023-10-06T02:24:50.990300+0000","last_clean":"2023-10-06T02:24:50.990300+0000","last_became_active":"2023-10-06T02:24:49.991514+0000","last_became_peered":"2023-10-06T02:24:49.991514+0000","last_unstale":"2023-10-06T02:24:50.990300+0000","last_undegraded":"2023-10-06T02:24:50.990300+0000","last_fullsized":"2023-10-06T02:24:50.990300+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:06.048431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.993525+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:24:50.993525+0000","last_peered":"2023-10-06T02:24:50.993525+0000","last_clean":"2023-10-06T02:24:50.993525+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:24:50.993525+0000","last_undegraded":"2023-10-06T02:24:50.993525+0000","last_fullsized":"2023-10-06T02:24:50.993525+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.000899+0000","last_change":"2023-10-06T02:24:50.994859+0000","last_active":"2023-10-06T02:24:51.000899+0000","last_peered":"2023-10-06T02:24:51.000899+0000","last_clean":"2023-10-06T02:24:51.000899+0000","last_became_active":"2023-10-06T02:24:50.994607+0000","last_became_peered":"2023-10-06T02:24:50.994607+0000","last_unstale":"2023-10-06T02:24:51.000899+0000","last_undegraded":"2023-10-06T02:24:51.000899+0000","last_fullsized":"2023-10-06T02:24:51.000899+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:42:53.432193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.993702+0000","last_change":"2023-10-06T02:24:49.990777+0000","last_active":"2023-10-06T02:24:50.993702+0000","last_peered":"2023-10-06T02:24:50.993702+0000","last_clean":"2023-10-06T02:24:50.993702+0000","last_became_active":"2023-10-06T02:24:49.990447+0000","last_became_peered":"2023-10-06T02:24:49.990447+0000","last_unstale":"2023-10-06T02:24:50.993702+0000","last_undegraded":"2023-10-06T02:24:50.993702+0000","last_fullsized":"2023-10-06T02:24:50.993702+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:12.586610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.990956+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:24:50.990956+0000","last_peered":"2023-10-06T02:24:50.990956+0000","last_clean":"2023-10-06T02:24:50.990956+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:24:50.990956+0000","last_undegraded":"2023-10-06T02:24:50.990956+0000","last_fullsized":"2023-10-06T02:24:50.990956+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.003258+0000","last_change":"2023-10-06T02:24:50.997029+0000","last_active":"2023-10-06T02:24:51.003258+0000","last_peered":"2023-10-06T02:24:51.003258+0000","last_clean":"2023-10-06T02:24:51.003258+0000","last_became_active":"2023-10-06T02:24:50.995962+0000","last_became_peered":"2023-10-06T02:24:50.995962+0000","last_unstale":"2023-10-06T02:24:51.003258+0000","last_undegraded":"2023-10-06T02:24:51.003258+0000","last_fullsized":"2023-10-06T02:24:51.003258+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:17.070816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"42'2","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.016921+0000","last_change":"2023-10-06T02:24:49.984890+0000","last_active":"2023-10-06T02:24:51.016921+0000","last_peered":"2023-10-06T02:24:51.016921+0000","last_clean":"2023-10-06T02:24:51.016921+0000","last_became_active":"2023-10-06T02:24:49.984491+0000","last_became_peered":"2023-10-06T02:24:49.984491+0000","last_unstale":"2023-10-06T02:24:51.016921+0000","last_undegraded":"2023-10-06T02:24:51.016921+0000","last_fullsized":"2023-10-06T02:24:51.016921+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:24.708807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":35,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.988109+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:24:50.988109+0000","last_peered":"2023-10-06T02:24:50.988109+0000","last_clean":"2023-10-06T02:24:50.988109+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:24:50.988109+0000","last_undegraded":"2023-10-06T02:24:50.988109+0000","last_fullsized":"2023-10-06T02:24:50.988109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.008742+0000","last_change":"2023-10-06T02:24:51.003248+0000","last_active":"2023-10-06T02:24:51.008742+0000","last_peered":"2023-10-06T02:24:51.008742+0000","last_clean":"2023-10-06T02:24:51.008742+0000","last_became_active":"2023-10-06T02:24:51.002277+0000","last_became_peered":"2023-10-06T02:24:51.002277+0000","last_unstale":"2023-10-06T02:24:51.008742+0000","last_undegraded":"2023-10-06T02:24:51.008742+0000","last_fullsized":"2023-10-06T02:24:51.008742+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:24.063459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.988309+0000","last_change":"2023-10-06T02:24:49.983424+0000","last_active":"2023-10-06T02:24:50.988309+0000","last_peered":"2023-10-06T02:24:50.988309+0000","last_clean":"2023-10-06T02:24:50.988309+0000","last_became_active":"2023-10-06T02:24:49.983101+0000","last_became_peered":"2023-10-06T02:24:49.983101+0000","last_unstale":"2023-10-06T02:24:50.988309+0000","last_undegraded":"2023-10-06T02:24:50.988309+0000","last_fullsized":"2023-10-06T02:24:50.988309+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:14.133062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.985842+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:24:50.985842+0000","last_peered":"2023-10-06T02:24:50.985842+0000","last_clean":"2023-10-06T02:24:50.985842+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:24:50.985842+0000","last_undegraded":"2023-10-06T02:24:50.985842+0000","last_fullsized":"2023-10-06T02:24:50.985842+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.016485+0000","last_change":"2023-10-06T02:24:51.008043+0000","last_active":"2023-10-06T02:24:51.016485+0000","last_peered":"2023-10-06T02:24:51.016485+0000","last_clean":"2023-10-06T02:24:51.016485+0000","last_became_active":"2023-10-06T02:24:51.007783+0000","last_became_peered":"2023-10-06T02:24:51.007783+0000","last_unstale":"2023-10-06T02:24:51.016485+0000","last_undegraded":"2023-10-06T02:24:51.016485+0000","last_fullsized":"2023-10-06T02:24:51.016485+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:21.258337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.992771+0000","last_change":"2023-10-06T02:24:49.980240+0000","last_active":"2023-10-06T02:24:50.992771+0000","last_peered":"2023-10-06T02:24:50.992771+0000","last_clean":"2023-10-06T02:24:50.992771+0000","last_became_active":"2023-10-06T02:24:49.979985+0000","last_became_peered":"2023-10-06T02:24:49.979985+0000","last_unstale":"2023-10-06T02:24:50.992771+0000","last_undegraded":"2023-10-06T02:24:50.992771+0000","last_fullsized":"2023-10-06T02:24:50.992771+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:14.133062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.986051+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:24:50.986051+0000","last_peered":"2023-10-06T02:24:50.986051+0000","last_clean":"2023-10-06T02:24:50.986051+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:24:50.986051+0000","last_undegraded":"2023-10-06T02:24:50.986051+0000","last_fullsized":"2023-10-06T02:24:50.986051+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298368,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073472,"statfs":{"total":96636764160,"available":96331235328,"internally_reserved":0,"allocated":1105920,"data_stored":804234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.45900000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.498},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.34200000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54000000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.59299999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.51300000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.625}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":213013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":5.859,"5min":5.859,"15min":5.859},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.63900000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.55400000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.628},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.442}]},{"osd":5,"last update":"Fri Oct 6 02:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46400000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298368,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073472,"statfs":{"total":96636764160,"available":96331235328,"internally_reserved":0,"allocated":1105920,"data_stored":804270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":7.6900000000000004,"5min":7.6900000000000004,"15min":7.6900000000000004},"last":0.441}]},{"osd":2,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":7.3639999999999999,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":7.758,"5min":7.758,"15min":7.758},"last":0.35299999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":7.7869999999999999,"5min":7.7869999999999999,"15min":7.7869999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.41599999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":11.678000000000001,"5min":11.678000000000001,"15min":11.678000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":7.6529999999999996,"5min":7.6529999999999996,"15min":7.6529999999999996},"last":0.68400000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":7.508,"5min":7.508,"15min":7.508},"last":0.65000000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":7.7270000000000003,"5min":7.7270000000000003,"15min":7.7270000000000003},"last":0.626},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.72599999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":7.4619999999999997,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.749}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":212445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.38}]},{"osd":3,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.498}]},{"osd":5,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.61099999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48999999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297792,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074048,"statfs":{"total":96636764160,"available":96331825152,"internally_reserved":0,"allocated":516096,"data_stored":215278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.46999999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.38500000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.35099999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.68000000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297792,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074048,"statfs":{"total":96636764160,"available":96331825152,"internally_reserved":0,"allocated":516096,"data_stored":213947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":10.164999999999999,"5min":10.164999999999999,"15min":10.164999999999999},"last":0.247},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.432}]},{"osd":1,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.36899999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.40600000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.72499999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.77900000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.63},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.71099999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.68600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":214296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.53300000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61199999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.495},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.59599999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.623},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.65000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297780,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074060,"statfs":{"total":96636764160,"available":96331837440,"internally_reserved":0,"allocated":503808,"data_stored":213742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.46800000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.373},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.52000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.50700000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.436}]},{"osd":4,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.58799999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.59999999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.57599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:24:55.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:24:55.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.274+0000 7f8275c88700 1 Processor -- start 2023-10-06T02:24:55.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.274+0000 7f8275c88700 1 -- start start 2023-10-06T02:24:55.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.275+0000 7f8275c88700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8270159760 0x7f827015d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.275+0000 7f8275c88700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827015e1a0 con 0x7f827015dd20 2023-10-06T02:24:55.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.275+0000 7f8275c88700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82700cb650 con 0x7f827015d8d0 2023-10-06T02:24:55.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.275+0000 7f8275c88700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82700cc2d0 con 0x7f8270159760 2023-10-06T02:24:55.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.275+0000 7f826ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f827015dd20 0x7f82700cfc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56556/0 (socket says 172.21.15.37:56556) 2023-10-06T02:24:55.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.275+0000 7f826ffff700 1 -- 172.21.15.37:0/2154853338 learned_addr learned my addr 172.21.15.37:0/2154853338 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:55.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826e7fc700 1 -- 172.21.15.37:0/2154853338 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575947421 0 0) 0x7f827015e1a0 con 0x7f827015dd20 2023-10-06T02:24:55.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826f7fe700 1 --2- 172.21.15.37:0/2154853338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8270159760 0x7f827015d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826e7fc700 1 -- 172.21.15.37:0/2154853338 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8258003570 con 0x7f827015dd20 2023-10-06T02:24:55.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826e7fc700 1 -- 172.21.15.37:0/2154853338 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 929266498 0 0) 0x7f8258003570 con 0x7f827015dd20 2023-10-06T02:24:55.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826e7fc700 1 -- 172.21.15.37:0/2154853338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8270159760 msgr2=0x7f827015d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826e7fc700 1 --2- 172.21.15.37:0/2154853338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8270159760 0x7f827015d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826e7fc700 1 -- 172.21.15.37:0/2154853338 >> v1:172.21.15.191:6789/0 conn(0x7f827015d8d0 legacy=0x7f82700c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826e7fc700 1 -- 172.21.15.37:0/2154853338 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82700cb930 con 0x7f827015dd20 2023-10-06T02:24:55.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826e7fc700 1 -- 172.21.15.37:0/2154853338 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f82680017f0 con 0x7f827015dd20 2023-10-06T02:24:55.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826e7fc700 1 -- 172.21.15.37:0/2154853338 >> v1:172.21.15.37:6789/0 conn(0x7f827015dd20 legacy=0x7f82700cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826e7fc700 1 --2- 172.21.15.37:0/2154853338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8258003a90 0x7f8258003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826e7fc700 1 --2- 172.21.15.37:0/2154853338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8270159760 0x7f8258004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826e7fc700 1 --2- 172.21.15.37:0/2154853338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8258004d50 0x7f82580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826e7fc700 1 -- 172.21.15.37:0/2154853338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82700cc2d0 con 0x7f8258003a90 2023-10-06T02:24:55.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826e7fc700 1 -- 172.21.15.37:0/2154853338 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825800bb70 con 0x7f8258004d50 2023-10-06T02:24:55.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826e7fc700 1 -- 172.21.15.37:0/2154853338 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825800bd30 con 0x7f8270159760 2023-10-06T02:24:55.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826f7fe700 1 --2- 172.21.15.37:0/2154853338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8258003a90 0x7f8258003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826effd700 1 --2- 172.21.15.37:0/2154853338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8270159760 0x7f8258004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826ffff700 1 --2- 172.21.15.37:0/2154853338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8258004d50 0x7f82580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826f7fe700 1 -- 172.21.15.37:0/2154853338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8270159760 msgr2=0x7f8258004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826f7fe700 1 --2- 172.21.15.37:0/2154853338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8270159760 0x7f8258004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826f7fe700 1 -- 172.21.15.37:0/2154853338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8258004d50 msgr2=0x7f82580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826f7fe700 1 --2- 172.21.15.37:0/2154853338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8258004d50 0x7f82580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826f7fe700 1 -- 172.21.15.37:0/2154853338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8258003570 con 0x7f8258003a90 2023-10-06T02:24:55.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826effd700 1 --2- 172.21.15.37:0/2154853338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8270159760 0x7f8258004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:55.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.276+0000 7f826f7fe700 1 --2- 172.21.15.37:0/2154853338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8258003a90 0x7f8258003ea0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8260009c00 tx=0x7f82600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81427f56e46462a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.277+0000 7f826e7fc700 1 -- 172.21.15.37:0/2154853338 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826000e710 con 0x7f8258003a90 2023-10-06T02:24:55.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.277+0000 7f826e7fc700 1 -- 172.21.15.37:0/2154853338 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826000e870 con 0x7f8258003a90 2023-10-06T02:24:55.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.277+0000 7f826e7fc700 1 -- 172.21.15.37:0/2154853338 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826000ec30 con 0x7f8258003a90 2023-10-06T02:24:55.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.277+0000 7f8275c88700 1 -- 172.21.15.37:0/2154853338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8258003a90 msgr2=0x7f8258003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.277+0000 7f8275c88700 1 --2- 172.21.15.37:0/2154853338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8258003a90 0x7f8258003ea0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8260009c00 tx=0x7f82600091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.277+0000 7f826ffff700 1 -- 172.21.15.37:0/2154853338 reap_dead start 2023-10-06T02:24:55.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.277+0000 7f8275c88700 1 -- 172.21.15.37:0/2154853338 shutdown_connections 2023-10-06T02:24:55.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.277+0000 7f8275c88700 1 -- 172.21.15.37:0/2154853338 >> 172.21.15.37:0/2154853338 conn(0x7f827006c890 msgr2=0x7f82700d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.277+0000 7f8275c88700 1 -- 172.21.15.37:0/2154853338 shutdown_connections 2023-10-06T02:24:55.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.277+0000 7f8275c88700 1 -- 172.21.15.37:0/2154853338 wait complete. 2023-10-06T02:24:55.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.278+0000 7f8275c88700 1 Processor -- start 2023-10-06T02:24:55.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.279+0000 7f8275c88700 1 -- start start 2023-10-06T02:24:55.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.279+0000 7f8275c88700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8258003a90 0x7f8270153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.279+0000 7f8275c88700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82700b3300 0x7f8270147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.279+0000 7f8275c88700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82700b3770 0x7f82701481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.279+0000 7f8275c88700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82700b4920 con 0x7f82700b3770 2023-10-06T02:24:55.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.279+0000 7f8275c88700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82700b3d10 con 0x7f8258003a90 2023-10-06T02:24:55.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.279+0000 7f8275c88700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82700b3ff0 con 0x7f82700b3300 2023-10-06T02:24:55.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.279+0000 7f826ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82700b3770 0x7f82701481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.279+0000 7f826ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82700b3770 0x7f82701481b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58988/0 (socket says 172.21.15.37:58988) 2023-10-06T02:24:55.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.279+0000 7f826ffff700 1 -- 172.21.15.37:0/1021594204 learned_addr learned my addr 172.21.15.37:0/1021594204 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:55.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.280+0000 7f826effd700 1 --2- 172.21.15.37:0/1021594204 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82700b3300 0x7f8270147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.280+0000 7f826f7fe700 1 --2- 172.21.15.37:0/1021594204 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8258003a90 0x7f8270153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.280+0000 7f826ffff700 1 -- 172.21.15.37:0/1021594204 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82700b3300 msgr2=0x7f8270147c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.280+0000 7f826ffff700 1 --2- 172.21.15.37:0/1021594204 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82700b3300 0x7f8270147c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.280+0000 7f826ffff700 1 -- 172.21.15.37:0/1021594204 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8258003a90 msgr2=0x7f8270153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.280+0000 7f826ffff700 1 --2- 172.21.15.37:0/1021594204 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8258003a90 0x7f8270153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.280+0000 7f826ffff700 1 -- 172.21.15.37:0/1021594204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82700b42d0 con 0x7f82700b3770 2023-10-06T02:24:55.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.280+0000 7f826effd700 1 --2- 172.21.15.37:0/1021594204 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82700b3300 0x7f8270147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:55.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.280+0000 7f826f7fe700 1 --2- 172.21.15.37:0/1021594204 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8258003a90 0x7f8270153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:55.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.280+0000 7f826ffff700 1 --2- 172.21.15.37:0/1021594204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82700b3770 0x7f82701481b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f82700897a0 tx=0x7f8268001350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.280+0000 7f82577fe700 1 -- 172.21.15.37:0/1021594204 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826800ebc0 con 0x7f82700b3770 2023-10-06T02:24:55.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.280+0000 7f82577fe700 1 -- 172.21.15.37:0/1021594204 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826800ed40 con 0x7f82700b3770 2023-10-06T02:24:55.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.280+0000 7f8275c88700 1 -- 172.21.15.37:0/1021594204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82700b45b0 con 0x7f82700b3770 2023-10-06T02:24:55.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.280+0000 7f82577fe700 1 -- 172.21.15.37:0/1021594204 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268013670 con 0x7f82700b3770 2023-10-06T02:24:55.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.280+0000 7f8275c88700 1 -- 172.21.15.37:0/1021594204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8270154350 con 0x7f82700b3770 2023-10-06T02:24:55.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.281+0000 7f8275c88700 1 -- 172.21.15.37:0/1021594204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8270154570 con 0x7f82700b3770 2023-10-06T02:24:55.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.281+0000 7f82577fe700 1 -- 172.21.15.37:0/1021594204 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8268013a20 con 0x7f82700b3770 2023-10-06T02:24:55.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.282+0000 7f82577fe700 1 --2- 172.21.15.37:0/1021594204 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f825c066f30 0x7f825c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.282+0000 7f82577fe700 1 -- 172.21.15.37:0/1021594204 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8268084db0 con 0x7f82700b3770 2023-10-06T02:24:55.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.282+0000 7f826f7fe700 1 --2- 172.21.15.37:0/1021594204 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f825c066f30 0x7f825c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.282+0000 7f826f7fe700 1 --2- 172.21.15.37:0/1021594204 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f825c066f30 0x7f825c0693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f82600091e0 tx=0x7f826001a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.286+0000 7f82577fe700 1 -- 172.21.15.37:0/1021594204 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8268051ec0 con 0x7f82700b3770 2023-10-06T02:24:55.289 INFO:tasks.ceph.mds.d.smithi191.stderr:2023-10-06T02:24:55.288+0000 7fbf116d4700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:24:55.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.476+0000 7f8275c88700 1 -- 172.21.15.37:0/1021594204 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f827015aa40 con 0x7f825c066f30 2023-10-06T02:24:55.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.486+0000 7f82577fe700 1 -- 172.21.15.37:0/1021594204 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311653 (secure 0 0 0) 0x7f827015aa40 con 0x7f825c066f30 2023-10-06T02:24:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:55.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.489+0000 7f8275c88700 1 -- 172.21.15.37:0/1021594204 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f825c066f30 msgr2=0x7f825c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.489+0000 7f8275c88700 1 --2- 172.21.15.37:0/1021594204 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f825c066f30 0x7f825c0693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f82600091e0 tx=0x7f826001a000 comp rx=0 tx=0).stop 2023-10-06T02:24:55.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.489+0000 7f8275c88700 1 -- 172.21.15.37:0/1021594204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82700b3770 msgr2=0x7f82701481b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.489+0000 7f8275c88700 1 --2- 172.21.15.37:0/1021594204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82700b3770 0x7f82701481b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f82700897a0 tx=0x7f8268001350 comp rx=0 tx=0).stop 2023-10-06T02:24:55.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.489+0000 7f8275c88700 1 -- 172.21.15.37:0/1021594204 shutdown_connections 2023-10-06T02:24:55.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.489+0000 7f8275c88700 1 --2- 172.21.15.37:0/1021594204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82700b3770 0x7f82701481b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.489+0000 7f8275c88700 1 --2- 172.21.15.37:0/1021594204 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f825c066f30 0x7f825c0693e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.489+0000 7f8275c88700 1 --2- 172.21.15.37:0/1021594204 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8258003a90 0x7f8270153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.489+0000 7f8275c88700 1 --2- 172.21.15.37:0/1021594204 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82700b3300 0x7f8270147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.489+0000 7f8275c88700 1 -- 172.21.15.37:0/1021594204 >> 172.21.15.37:0/1021594204 conn(0x7f827006c890 msgr2=0x7f8270158300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.489+0000 7f8275c88700 1 -- 172.21.15.37:0/1021594204 shutdown_connections 2023-10-06T02:24:55.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.489+0000 7f8275c88700 1 -- 172.21.15.37:0/1021594204 wait complete. 2023-10-06T02:24:55.493 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:24:55.502 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2023-10-06T02:24:54.532844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383452,"kb_used_data":5148,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591268,"statfs":{"total":773094113280,"available":770653458432,"internally_reserved":0,"allocated":5271552,"data_stored":2891225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.568890"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.005243+0000","last_change":"2023-10-06T02:24:50.996307+0000","last_active":"2023-10-06T02:24:51.005243+0000","last_peered":"2023-10-06T02:24:51.005243+0000","last_clean":"2023-10-06T02:24:51.005243+0000","last_became_active":"2023-10-06T02:24:50.995980+0000","last_became_peered":"2023-10-06T02:24:50.995980+0000","last_unstale":"2023-10-06T02:24:51.005243+0000","last_undegraded":"2023-10-06T02:24:51.005243+0000","last_fullsized":"2023-10-06T02:24:51.005243+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:46.955345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.005412+0000","last_change":"2023-10-06T02:24:50.998128+0000","last_active":"2023-10-06T02:24:51.005412+0000","last_peered":"2023-10-06T02:24:51.005412+0000","last_clean":"2023-10-06T02:24:51.005412+0000","last_became_active":"2023-10-06T02:24:50.997464+0000","last_became_peered":"2023-10-06T02:24:50.997464+0000","last_unstale":"2023-10-06T02:24:51.005412+0000","last_undegraded":"2023-10-06T02:24:51.005412+0000","last_fullsized":"2023-10-06T02:24:51.005412+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:47:19.163652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.016574+0000","last_change":"2023-10-06T02:24:51.008563+0000","last_active":"2023-10-06T02:24:51.016574+0000","last_peered":"2023-10-06T02:24:51.016574+0000","last_clean":"2023-10-06T02:24:51.016574+0000","last_became_active":"2023-10-06T02:24:51.008309+0000","last_became_peered":"2023-10-06T02:24:51.008309+0000","last_unstale":"2023-10-06T02:24:51.016574+0000","last_undegraded":"2023-10-06T02:24:51.016574+0000","last_fullsized":"2023-10-06T02:24:51.016574+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:00.696318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.011304+0000","last_change":"2023-10-06T02:24:51.004571+0000","last_active":"2023-10-06T02:24:51.011304+0000","last_peered":"2023-10-06T02:24:51.011304+0000","last_clean":"2023-10-06T02:24:51.011304+0000","last_became_active":"2023-10-06T02:24:51.004250+0000","last_became_peered":"2023-10-06T02:24:51.004250+0000","last_unstale":"2023-10-06T02:24:51.011304+0000","last_undegraded":"2023-10-06T02:24:51.011304+0000","last_fullsized":"2023-10-06T02:24:51.011304+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:54.233111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.011246+0000","last_change":"2023-10-06T02:24:51.009187+0000","last_active":"2023-10-06T02:24:51.011246+0000","last_peered":"2023-10-06T02:24:51.011246+0000","last_clean":"2023-10-06T02:24:51.011246+0000","last_became_active":"2023-10-06T02:24:51.008943+0000","last_became_peered":"2023-10-06T02:24:51.008943+0000","last_unstale":"2023-10-06T02:24:51.011246+0000","last_undegraded":"2023-10-06T02:24:51.011246+0000","last_fullsized":"2023-10-06T02:24:51.011246+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:56.115437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.005731+0000","last_change":"2023-10-06T02:24:51.000067+0000","last_active":"2023-10-06T02:24:51.005731+0000","last_peered":"2023-10-06T02:24:51.005731+0000","last_clean":"2023-10-06T02:24:51.005731+0000","last_became_active":"2023-10-06T02:24:50.999767+0000","last_became_peered":"2023-10-06T02:24:50.999767+0000","last_unstale":"2023-10-06T02:24:51.005731+0000","last_undegraded":"2023-10-06T02:24:51.005731+0000","last_fullsized":"2023-10-06T02:24:51.005731+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:07.053582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.006952+0000","last_change":"2023-10-06T02:24:51.004734+0000","last_active":"2023-10-06T02:24:51.006952+0000","last_peered":"2023-10-06T02:24:51.006952+0000","last_clean":"2023-10-06T02:24:51.006952+0000","last_became_active":"2023-10-06T02:24:51.003939+0000","last_became_peered":"2023-10-06T02:24:51.003939+0000","last_unstale":"2023-10-06T02:24:51.006952+0000","last_undegraded":"2023-10-06T02:24:51.006952+0000","last_fullsized":"2023-10-06T02:24:51.006952+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:35.062384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.010508+0000","last_change":"2023-10-06T02:24:51.004108+0000","last_active":"2023-10-06T02:24:51.010508+0000","last_peered":"2023-10-06T02:24:51.010508+0000","last_clean":"2023-10-06T02:24:51.010508+0000","last_became_active":"2023-10-06T02:24:51.003848+0000","last_became_peered":"2023-10-06T02:24:51.003848+0000","last_unstale":"2023-10-06T02:24:51.010508+0000","last_undegraded":"2023-10-06T02:24:51.010508+0000","last_fullsized":"2023-10-06T02:24:51.010508+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:21.258337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.011947+0000","last_change":"2023-10-06T02:24:51.003419+0000","last_active":"2023-10-06T02:24:51.011947+0000","last_peered":"2023-10-06T02:24:51.011947+0000","last_clean":"2023-10-06T02:24:51.011947+0000","last_became_active":"2023-10-06T02:24:51.002704+0000","last_became_peered":"2023-10-06T02:24:51.002704+0000","last_unstale":"2023-10-06T02:24:51.011947+0000","last_undegraded":"2023-10-06T02:24:51.011947+0000","last_fullsized":"2023-10-06T02:24:51.011947+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:00.696318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.007937+0000","last_change":"2023-10-06T02:24:51.004238+0000","last_active":"2023-10-06T02:24:51.007937+0000","last_peered":"2023-10-06T02:24:51.007937+0000","last_clean":"2023-10-06T02:24:51.007937+0000","last_became_active":"2023-10-06T02:24:51.003948+0000","last_became_peered":"2023-10-06T02:24:51.003948+0000","last_unstale":"2023-10-06T02:24:51.007937+0000","last_undegraded":"2023-10-06T02:24:51.007937+0000","last_fullsized":"2023-10-06T02:24:51.007937+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:13.870180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.004719+0000","last_change":"2023-10-06T02:24:50.998274+0000","last_active":"2023-10-06T02:24:51.004719+0000","last_peered":"2023-10-06T02:24:51.004719+0000","last_clean":"2023-10-06T02:24:51.004719+0000","last_became_active":"2023-10-06T02:24:50.998017+0000","last_became_peered":"2023-10-06T02:24:50.998017+0000","last_unstale":"2023-10-06T02:24:51.004719+0000","last_undegraded":"2023-10-06T02:24:51.004719+0000","last_fullsized":"2023-10-06T02:24:51.004719+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:46.571692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.004950+0000","last_change":"2023-10-06T02:24:50.998268+0000","last_active":"2023-10-06T02:24:51.004950+0000","last_peered":"2023-10-06T02:24:51.004950+0000","last_clean":"2023-10-06T02:24:51.004950+0000","last_became_active":"2023-10-06T02:24:50.998014+0000","last_became_peered":"2023-10-06T02:24:50.998014+0000","last_unstale":"2023-10-06T02:24:51.004950+0000","last_undegraded":"2023-10-06T02:24:51.004950+0000","last_fullsized":"2023-10-06T02:24:51.004950+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:35.062384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.008479+0000","last_change":"2023-10-06T02:24:51.004330+0000","last_active":"2023-10-06T02:24:51.008479+0000","last_peered":"2023-10-06T02:24:51.008479+0000","last_clean":"2023-10-06T02:24:51.008479+0000","last_became_active":"2023-10-06T02:24:51.004026+0000","last_became_peered":"2023-10-06T02:24:51.004026+0000","last_unstale":"2023-10-06T02:24:51.008479+0000","last_undegraded":"2023-10-06T02:24:51.008479+0000","last_fullsized":"2023-10-06T02:24:51.008479+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:13.591761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.016514+0000","last_change":"2023-10-06T02:24:51.008202+0000","last_active":"2023-10-06T02:24:51.016514+0000","last_peered":"2023-10-06T02:24:51.016514+0000","last_clean":"2023-10-06T02:24:51.016514+0000","last_became_active":"2023-10-06T02:24:51.007970+0000","last_became_peered":"2023-10-06T02:24:51.007970+0000","last_unstale":"2023-10-06T02:24:51.016514+0000","last_undegraded":"2023-10-06T02:24:51.016514+0000","last_fullsized":"2023-10-06T02:24:51.016514+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:49.845589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.011351+0000","last_change":"2023-10-06T02:24:51.006160+0000","last_active":"2023-10-06T02:24:51.011351+0000","last_peered":"2023-10-06T02:24:51.011351+0000","last_clean":"2023-10-06T02:24:51.011351+0000","last_became_active":"2023-10-06T02:24:51.005626+0000","last_became_peered":"2023-10-06T02:24:51.005626+0000","last_unstale":"2023-10-06T02:24:51.011351+0000","last_undegraded":"2023-10-06T02:24:51.011351+0000","last_fullsized":"2023-10-06T02:24:51.011351+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:18.481052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.008738+0000","last_change":"2023-10-06T02:24:51.004776+0000","last_active":"2023-10-06T02:24:51.008738+0000","last_peered":"2023-10-06T02:24:51.008738+0000","last_clean":"2023-10-06T02:24:51.008738+0000","last_became_active":"2023-10-06T02:24:51.004486+0000","last_became_peered":"2023-10-06T02:24:51.004486+0000","last_unstale":"2023-10-06T02:24:51.008738+0000","last_undegraded":"2023-10-06T02:24:51.008738+0000","last_fullsized":"2023-10-06T02:24:51.008738+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:31.400935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.009745+0000","last_change":"2023-10-06T02:24:51.004377+0000","last_active":"2023-10-06T02:24:51.009745+0000","last_peered":"2023-10-06T02:24:51.009745+0000","last_clean":"2023-10-06T02:24:51.009745+0000","last_became_active":"2023-10-06T02:24:51.003744+0000","last_became_peered":"2023-10-06T02:24:51.003744+0000","last_unstale":"2023-10-06T02:24:51.009745+0000","last_undegraded":"2023-10-06T02:24:51.009745+0000","last_fullsized":"2023-10-06T02:24:51.009745+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:30.985680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.005433+0000","last_change":"2023-10-06T02:24:50.998286+0000","last_active":"2023-10-06T02:24:51.005433+0000","last_peered":"2023-10-06T02:24:51.005433+0000","last_clean":"2023-10-06T02:24:51.005433+0000","last_became_active":"2023-10-06T02:24:50.997857+0000","last_became_peered":"2023-10-06T02:24:50.997857+0000","last_unstale":"2023-10-06T02:24:51.005433+0000","last_undegraded":"2023-10-06T02:24:51.005433+0000","last_fullsized":"2023-10-06T02:24:51.005433+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:54.461599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.006838+0000","last_change":"2023-10-06T02:24:51.003283+0000","last_active":"2023-10-06T02:24:51.006838+0000","last_peered":"2023-10-06T02:24:51.006838+0000","last_clean":"2023-10-06T02:24:51.006838+0000","last_became_active":"2023-10-06T02:24:51.002979+0000","last_became_peered":"2023-10-06T02:24:51.002979+0000","last_unstale":"2023-10-06T02:24:51.006838+0000","last_undegraded":"2023-10-06T02:24:51.006838+0000","last_fullsized":"2023-10-06T02:24:51.006838+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:07.077399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.007246+0000","last_change":"2023-10-06T02:24:51.002703+0000","last_active":"2023-10-06T02:24:51.007246+0000","last_peered":"2023-10-06T02:24:51.007246+0000","last_clean":"2023-10-06T02:24:51.007246+0000","last_became_active":"2023-10-06T02:24:51.002479+0000","last_became_peered":"2023-10-06T02:24:51.002479+0000","last_unstale":"2023-10-06T02:24:51.007246+0000","last_undegraded":"2023-10-06T02:24:51.007246+0000","last_fullsized":"2023-10-06T02:24:51.007246+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:31.400935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.009931+0000","last_change":"2023-10-06T02:24:51.006837+0000","last_active":"2023-10-06T02:24:51.009931+0000","last_peered":"2023-10-06T02:24:51.009931+0000","last_clean":"2023-10-06T02:24:51.009931+0000","last_became_active":"2023-10-06T02:24:51.006553+0000","last_became_peered":"2023-10-06T02:24:51.006553+0000","last_unstale":"2023-10-06T02:24:51.009931+0000","last_undegraded":"2023-10-06T02:24:51.009931+0000","last_fullsized":"2023-10-06T02:24:51.009931+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:24.183544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.007322+0000","last_change":"2023-10-06T02:24:51.002587+0000","last_active":"2023-10-06T02:24:51.007322+0000","last_peered":"2023-10-06T02:24:51.007322+0000","last_clean":"2023-10-06T02:24:51.007322+0000","last_became_active":"2023-10-06T02:24:51.002276+0000","last_became_peered":"2023-10-06T02:24:51.002276+0000","last_unstale":"2023-10-06T02:24:51.007322+0000","last_undegraded":"2023-10-06T02:24:51.007322+0000","last_fullsized":"2023-10-06T02:24:51.007322+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:13.475431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.010138+0000","last_change":"2023-10-06T02:24:51.005203+0000","last_active":"2023-10-06T02:24:51.010138+0000","last_peered":"2023-10-06T02:24:51.010138+0000","last_clean":"2023-10-06T02:24:51.010138+0000","last_became_active":"2023-10-06T02:24:51.004943+0000","last_became_peered":"2023-10-06T02:24:51.004943+0000","last_unstale":"2023-10-06T02:24:51.010138+0000","last_undegraded":"2023-10-06T02:24:51.010138+0000","last_fullsized":"2023-10-06T02:24:51.010138+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:38.080796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.016552+0000","last_change":"2023-10-06T02:24:51.008558+0000","last_active":"2023-10-06T02:24:51.016552+0000","last_peered":"2023-10-06T02:24:51.016552+0000","last_clean":"2023-10-06T02:24:51.016552+0000","last_became_active":"2023-10-06T02:24:51.008250+0000","last_became_peered":"2023-10-06T02:24:51.008250+0000","last_unstale":"2023-10-06T02:24:51.016552+0000","last_undegraded":"2023-10-06T02:24:51.016552+0000","last_fullsized":"2023-10-06T02:24:51.016552+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:01.772133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.016664+0000","last_change":"2023-10-06T02:24:51.010972+0000","last_active":"2023-10-06T02:24:51.016664+0000","last_peered":"2023-10-06T02:24:51.016664+0000","last_clean":"2023-10-06T02:24:51.016664+0000","last_became_active":"2023-10-06T02:24:51.010702+0000","last_became_peered":"2023-10-06T02:24:51.010702+0000","last_unstale":"2023-10-06T02:24:51.016664+0000","last_undegraded":"2023-10-06T02:24:51.016664+0000","last_fullsized":"2023-10-06T02:24:51.016664+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:10.468877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.006145+0000","last_change":"2023-10-06T02:24:51.002186+0000","last_active":"2023-10-06T02:24:51.006145+0000","last_peered":"2023-10-06T02:24:51.006145+0000","last_clean":"2023-10-06T02:24:51.006145+0000","last_became_active":"2023-10-06T02:24:51.001908+0000","last_became_peered":"2023-10-06T02:24:51.001908+0000","last_unstale":"2023-10-06T02:24:51.006145+0000","last_undegraded":"2023-10-06T02:24:51.006145+0000","last_fullsized":"2023-10-06T02:24:51.006145+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:07.077399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.009091+0000","last_change":"2023-10-06T02:24:51.005403+0000","last_active":"2023-10-06T02:24:51.009091+0000","last_peered":"2023-10-06T02:24:51.009091+0000","last_clean":"2023-10-06T02:24:51.009091+0000","last_became_active":"2023-10-06T02:24:51.001142+0000","last_became_peered":"2023-10-06T02:24:51.001142+0000","last_unstale":"2023-10-06T02:24:51.009091+0000","last_undegraded":"2023-10-06T02:24:51.009091+0000","last_fullsized":"2023-10-06T02:24:51.009091+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:15.138213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.000831+0000","last_change":"2023-10-06T02:24:50.994189+0000","last_active":"2023-10-06T02:24:51.000831+0000","last_peered":"2023-10-06T02:24:51.000831+0000","last_clean":"2023-10-06T02:24:51.000831+0000","last_became_active":"2023-10-06T02:24:50.993934+0000","last_became_peered":"2023-10-06T02:24:50.993934+0000","last_unstale":"2023-10-06T02:24:51.000831+0000","last_undegraded":"2023-10-06T02:24:51.000831+0000","last_fullsized":"2023-10-06T02:24:51.000831+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:34.741977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.000943+0000","last_change":"2023-10-06T02:24:50.998481+0000","last_active":"2023-10-06T02:24:51.000943+0000","last_peered":"2023-10-06T02:24:51.000943+0000","last_clean":"2023-10-06T02:24:51.000943+0000","last_became_active":"2023-10-06T02:24:50.998245+0000","last_became_peered":"2023-10-06T02:24:50.998245+0000","last_unstale":"2023-10-06T02:24:51.000943+0000","last_undegraded":"2023-10-06T02:24:51.000943+0000","last_fullsized":"2023-10-06T02:24:51.000943+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:24.063459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.012027+0000","last_change":"2023-10-06T02:24:51.006557+0000","last_active":"2023-10-06T02:24:51.012027+0000","last_peered":"2023-10-06T02:24:51.012027+0000","last_clean":"2023-10-06T02:24:51.012027+0000","last_became_active":"2023-10-06T02:24:51.006288+0000","last_became_peered":"2023-10-06T02:24:51.006288+0000","last_unstale":"2023-10-06T02:24:51.012027+0000","last_undegraded":"2023-10-06T02:24:51.012027+0000","last_fullsized":"2023-10-06T02:24:51.012027+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:46.025692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.006932+0000","last_change":"2023-10-06T02:24:51.004607+0000","last_active":"2023-10-06T02:24:51.006932+0000","last_peered":"2023-10-06T02:24:51.006932+0000","last_clean":"2023-10-06T02:24:51.006932+0000","last_became_active":"2023-10-06T02:24:51.004333+0000","last_became_peered":"2023-10-06T02:24:51.004333+0000","last_unstale":"2023-10-06T02:24:51.006932+0000","last_undegraded":"2023-10-06T02:24:51.006932+0000","last_fullsized":"2023-10-06T02:24:51.006932+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:13.475431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.003234+0000","last_change":"2023-10-06T02:24:50.996900+0000","last_active":"2023-10-06T02:24:51.003234+0000","last_peered":"2023-10-06T02:24:51.003234+0000","last_clean":"2023-10-06T02:24:51.003234+0000","last_became_active":"2023-10-06T02:24:50.996279+0000","last_became_peered":"2023-10-06T02:24:50.996279+0000","last_unstale":"2023-10-06T02:24:51.003234+0000","last_undegraded":"2023-10-06T02:24:51.003234+0000","last_fullsized":"2023-10-06T02:24:51.003234+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:56.115437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.010060+0000","last_change":"2023-10-06T02:24:50.999150+0000","last_active":"2023-10-06T02:24:51.010060+0000","last_peered":"2023-10-06T02:24:51.010060+0000","last_clean":"2023-10-06T02:24:51.010060+0000","last_became_active":"2023-10-06T02:24:50.998874+0000","last_became_peered":"2023-10-06T02:24:50.998874+0000","last_unstale":"2023-10-06T02:24:51.010060+0000","last_undegraded":"2023-10-06T02:24:51.010060+0000","last_fullsized":"2023-10-06T02:24:51.010060+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:47.650860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"42'4","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.014072+0000","last_change":"2023-10-06T02:24:49.975288+0000","last_active":"2023-10-06T02:24:51.014072+0000","last_peered":"2023-10-06T02:24:51.014072+0000","last_clean":"2023-10-06T02:24:51.014072+0000","last_became_active":"2023-10-06T02:24:49.975032+0000","last_became_peered":"2023-10-06T02:24:49.975032+0000","last_unstale":"2023-10-06T02:24:51.014072+0000","last_undegraded":"2023-10-06T02:24:51.014072+0000","last_fullsized":"2023-10-06T02:24:51.014072+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:40.520860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.011514+0000","last_change":"2023-10-06T02:24:51.004780+0000","last_active":"2023-10-06T02:24:51.011514+0000","last_peered":"2023-10-06T02:24:51.011514+0000","last_clean":"2023-10-06T02:24:51.011514+0000","last_became_active":"2023-10-06T02:24:51.004469+0000","last_became_peered":"2023-10-06T02:24:51.004469+0000","last_unstale":"2023-10-06T02:24:51.011514+0000","last_undegraded":"2023-10-06T02:24:51.011514+0000","last_fullsized":"2023-10-06T02:24:51.011514+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:01.772133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"42'1","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.013638+0000","last_change":"2023-10-06T02:24:49.987659+0000","last_active":"2023-10-06T02:24:51.013638+0000","last_peered":"2023-10-06T02:24:51.013638+0000","last_clean":"2023-10-06T02:24:51.013638+0000","last_became_active":"2023-10-06T02:24:49.987336+0000","last_became_peered":"2023-10-06T02:24:49.987336+0000","last_unstale":"2023-10-06T02:24:51.013638+0000","last_undegraded":"2023-10-06T02:24:51.013638+0000","last_fullsized":"2023-10-06T02:24:51.013638+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:40:17.443956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.000998+0000","last_change":"2023-10-06T02:24:50.996239+0000","last_active":"2023-10-06T02:24:51.000998+0000","last_peered":"2023-10-06T02:24:51.000998+0000","last_clean":"2023-10-06T02:24:51.000998+0000","last_became_active":"2023-10-06T02:24:50.995941+0000","last_became_peered":"2023-10-06T02:24:50.995941+0000","last_unstale":"2023-10-06T02:24:51.000998+0000","last_undegraded":"2023-10-06T02:24:51.000998+0000","last_fullsized":"2023-10-06T02:24:51.000998+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:44.538350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"42'2","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.014174+0000","last_change":"2023-10-06T02:24:49.991069+0000","last_active":"2023-10-06T02:24:51.014174+0000","last_peered":"2023-10-06T02:24:51.014174+0000","last_clean":"2023-10-06T02:24:51.014174+0000","last_became_active":"2023-10-06T02:24:49.990806+0000","last_became_peered":"2023-10-06T02:24:49.990806+0000","last_unstale":"2023-10-06T02:24:51.014174+0000","last_undegraded":"2023-10-06T02:24:51.014174+0000","last_fullsized":"2023-10-06T02:24:51.014174+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:11.794453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.006674+0000","last_change":"2023-10-06T02:24:51.001739+0000","last_active":"2023-10-06T02:24:51.006674+0000","last_peered":"2023-10-06T02:24:51.006674+0000","last_clean":"2023-10-06T02:24:51.006674+0000","last_became_active":"2023-10-06T02:24:51.001427+0000","last_became_peered":"2023-10-06T02:24:51.001427+0000","last_unstale":"2023-10-06T02:24:51.006674+0000","last_undegraded":"2023-10-06T02:24:51.006674+0000","last_fullsized":"2023-10-06T02:24:51.006674+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:21:30.985680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"42'2","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.012524+0000","last_change":"2023-10-06T02:24:49.985191+0000","last_active":"2023-10-06T02:24:51.012524+0000","last_peered":"2023-10-06T02:24:51.012524+0000","last_clean":"2023-10-06T02:24:51.012524+0000","last_became_active":"2023-10-06T02:24:49.984908+0000","last_became_peered":"2023-10-06T02:24:49.984908+0000","last_unstale":"2023-10-06T02:24:51.012524+0000","last_undegraded":"2023-10-06T02:24:51.012524+0000","last_fullsized":"2023-10-06T02:24:51.012524+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:11.441778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.010599+0000","last_change":"2023-10-06T02:24:51.002616+0000","last_active":"2023-10-06T02:24:51.010599+0000","last_peered":"2023-10-06T02:24:51.010599+0000","last_clean":"2023-10-06T02:24:51.010599+0000","last_became_active":"2023-10-06T02:24:51.002290+0000","last_became_peered":"2023-10-06T02:24:51.002290+0000","last_unstale":"2023-10-06T02:24:51.010599+0000","last_undegraded":"2023-10-06T02:24:51.010599+0000","last_fullsized":"2023-10-06T02:24:51.010599+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:01.772133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"42'1","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.016595+0000","last_change":"2023-10-06T02:24:49.989044+0000","last_active":"2023-10-06T02:24:51.016595+0000","last_peered":"2023-10-06T02:24:51.016595+0000","last_clean":"2023-10-06T02:24:51.016595+0000","last_became_active":"2023-10-06T02:24:49.988768+0000","last_became_peered":"2023-10-06T02:24:49.988768+0000","last_unstale":"2023-10-06T02:24:51.016595+0000","last_undegraded":"2023-10-06T02:24:51.016595+0000","last_fullsized":"2023-10-06T02:24:51.016595+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:26:28.394729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.012354+0000","last_change":"2023-10-06T02:24:51.006616+0000","last_active":"2023-10-06T02:24:51.012354+0000","last_peered":"2023-10-06T02:24:51.012354+0000","last_clean":"2023-10-06T02:24:51.012354+0000","last_became_active":"2023-10-06T02:24:51.005696+0000","last_became_peered":"2023-10-06T02:24:51.005696+0000","last_unstale":"2023-10-06T02:24:51.012354+0000","last_undegraded":"2023-10-06T02:24:51.012354+0000","last_fullsized":"2023-10-06T02:24:51.012354+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:17.070816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"42'1","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.010670+0000","last_change":"2023-10-06T02:24:49.980137+0000","last_active":"2023-10-06T02:24:51.010670+0000","last_peered":"2023-10-06T02:24:51.010670+0000","last_clean":"2023-10-06T02:24:51.010670+0000","last_became_active":"2023-10-06T02:24:49.979841+0000","last_became_peered":"2023-10-06T02:24:49.979841+0000","last_unstale":"2023-10-06T02:24:51.010670+0000","last_undegraded":"2023-10-06T02:24:51.010670+0000","last_fullsized":"2023-10-06T02:24:51.010670+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:25.722081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.010429+0000","last_change":"2023-10-06T02:24:51.003526+0000","last_active":"2023-10-06T02:24:51.010429+0000","last_peered":"2023-10-06T02:24:51.010429+0000","last_clean":"2023-10-06T02:24:51.010429+0000","last_became_active":"2023-10-06T02:24:51.003188+0000","last_became_peered":"2023-10-06T02:24:51.003188+0000","last_unstale":"2023-10-06T02:24:51.010429+0000","last_undegraded":"2023-10-06T02:24:51.010429+0000","last_fullsized":"2023-10-06T02:24:51.010429+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:38.532658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.987313+0000","last_change":"2023-10-06T02:24:49.976741+0000","last_active":"2023-10-06T02:24:50.987313+0000","last_peered":"2023-10-06T02:24:50.987313+0000","last_clean":"2023-10-06T02:24:50.987313+0000","last_became_active":"2023-10-06T02:24:49.976474+0000","last_became_peered":"2023-10-06T02:24:49.976474+0000","last_unstale":"2023-10-06T02:24:50.987313+0000","last_undegraded":"2023-10-06T02:24:50.987313+0000","last_fullsized":"2023-10-06T02:24:50.987313+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:16.691116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.010309+0000","last_change":"2023-10-06T02:24:51.002095+0000","last_active":"2023-10-06T02:24:51.010309+0000","last_peered":"2023-10-06T02:24:51.010309+0000","last_clean":"2023-10-06T02:24:51.010309+0000","last_became_active":"2023-10-06T02:24:51.001815+0000","last_became_peered":"2023-10-06T02:24:51.001815+0000","last_unstale":"2023-10-06T02:24:51.010309+0000","last_undegraded":"2023-10-06T02:24:51.010309+0000","last_fullsized":"2023-10-06T02:24:51.010309+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:56.115437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.994867+0000","last_change":"2023-10-06T02:24:49.982864+0000","last_active":"2023-10-06T02:24:50.994867+0000","last_peered":"2023-10-06T02:24:50.994867+0000","last_clean":"2023-10-06T02:24:50.994867+0000","last_became_active":"2023-10-06T02:24:49.982568+0000","last_became_peered":"2023-10-06T02:24:49.982568+0000","last_unstale":"2023-10-06T02:24:50.994867+0000","last_undegraded":"2023-10-06T02:24:50.994867+0000","last_fullsized":"2023-10-06T02:24:50.994867+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:45.950194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.011232+0000","last_change":"2023-10-06T02:24:51.008932+0000","last_active":"2023-10-06T02:24:51.011232+0000","last_peered":"2023-10-06T02:24:51.011232+0000","last_clean":"2023-10-06T02:24:51.011232+0000","last_became_active":"2023-10-06T02:24:51.008633+0000","last_became_peered":"2023-10-06T02:24:51.008633+0000","last_unstale":"2023-10-06T02:24:51.011232+0000","last_undegraded":"2023-10-06T02:24:51.011232+0000","last_fullsized":"2023-10-06T02:24:51.011232+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:47.650860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.991786+0000","last_change":"2023-10-06T02:24:49.979546+0000","last_active":"2023-10-06T02:24:50.991786+0000","last_peered":"2023-10-06T02:24:50.991786+0000","last_clean":"2023-10-06T02:24:50.991786+0000","last_became_active":"2023-10-06T02:24:49.979280+0000","last_became_peered":"2023-10-06T02:24:49.979280+0000","last_unstale":"2023-10-06T02:24:50.991786+0000","last_undegraded":"2023-10-06T02:24:50.991786+0000","last_fullsized":"2023-10-06T02:24:50.991786+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:31.682427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.004673+0000","last_change":"2023-10-06T02:24:51.001933+0000","last_active":"2023-10-06T02:24:51.004673+0000","last_peered":"2023-10-06T02:24:51.004673+0000","last_clean":"2023-10-06T02:24:51.004673+0000","last_became_active":"2023-10-06T02:24:51.001671+0000","last_became_peered":"2023-10-06T02:24:51.001671+0000","last_unstale":"2023-10-06T02:24:51.004673+0000","last_undegraded":"2023-10-06T02:24:51.004673+0000","last_fullsized":"2023-10-06T02:24:51.004673+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:50.282307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.990527+0000","last_change":"2023-10-06T02:24:49.986190+0000","last_active":"2023-10-06T02:24:50.990527+0000","last_peered":"2023-10-06T02:24:50.990527+0000","last_clean":"2023-10-06T02:24:50.990527+0000","last_became_active":"2023-10-06T02:24:49.986006+0000","last_became_peered":"2023-10-06T02:24:49.986006+0000","last_unstale":"2023-10-06T02:24:50.990527+0000","last_undegraded":"2023-10-06T02:24:50.990527+0000","last_fullsized":"2023-10-06T02:24:50.990527+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:11.441778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.006960+0000","last_change":"2023-10-06T02:24:51.001062+0000","last_active":"2023-10-06T02:24:51.006960+0000","last_peered":"2023-10-06T02:24:51.006960+0000","last_clean":"2023-10-06T02:24:51.006960+0000","last_became_active":"2023-10-06T02:24:51.000665+0000","last_became_peered":"2023-10-06T02:24:51.000665+0000","last_unstale":"2023-10-06T02:24:51.006960+0000","last_undegraded":"2023-10-06T02:24:51.006960+0000","last_fullsized":"2023-10-06T02:24:51.006960+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:03.313825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"42'3","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.028159+0000","last_change":"2023-10-06T02:24:49.983584+0000","last_active":"2023-10-06T02:24:51.028159+0000","last_peered":"2023-10-06T02:24:51.028159+0000","last_clean":"2023-10-06T02:24:51.028159+0000","last_became_active":"2023-10-06T02:24:49.983310+0000","last_became_peered":"2023-10-06T02:24:49.983310+0000","last_unstale":"2023-10-06T02:24:51.028159+0000","last_undegraded":"2023-10-06T02:24:51.028159+0000","last_fullsized":"2023-10-06T02:24:51.028159+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:12.865029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.009740+0000","last_change":"2023-10-06T02:24:51.001223+0000","last_active":"2023-10-06T02:24:51.009740+0000","last_peered":"2023-10-06T02:24:51.009740+0000","last_clean":"2023-10-06T02:24:51.009740+0000","last_became_active":"2023-10-06T02:24:51.000813+0000","last_became_peered":"2023-10-06T02:24:51.000813+0000","last_unstale":"2023-10-06T02:24:51.009740+0000","last_undegraded":"2023-10-06T02:24:51.009740+0000","last_fullsized":"2023-10-06T02:24:51.009740+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:17.070816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"42'6","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.022639+0000","last_change":"2023-10-06T02:24:49.981179+0000","last_active":"2023-10-06T02:24:51.022639+0000","last_peered":"2023-10-06T02:24:51.022639+0000","last_clean":"2023-10-06T02:24:51.022639+0000","last_became_active":"2023-10-06T02:24:49.980903+0000","last_became_peered":"2023-10-06T02:24:49.980903+0000","last_unstale":"2023-10-06T02:24:51.022639+0000","last_undegraded":"2023-10-06T02:24:51.022639+0000","last_fullsized":"2023-10-06T02:24:51.022639+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:48:10.742855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.012578+0000","last_change":"2023-10-06T02:24:51.007115+0000","last_active":"2023-10-06T02:24:51.012578+0000","last_peered":"2023-10-06T02:24:51.012578+0000","last_clean":"2023-10-06T02:24:51.012578+0000","last_became_active":"2023-10-06T02:24:51.006900+0000","last_became_peered":"2023-10-06T02:24:51.006900+0000","last_unstale":"2023-10-06T02:24:51.012578+0000","last_undegraded":"2023-10-06T02:24:51.012578+0000","last_fullsized":"2023-10-06T02:24:51.012578+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:21.981316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"42'2","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.016704+0000","last_change":"2023-10-06T02:24:49.989115+0000","last_active":"2023-10-06T02:24:51.016704+0000","last_peered":"2023-10-06T02:24:51.016704+0000","last_clean":"2023-10-06T02:24:51.016704+0000","last_became_active":"2023-10-06T02:24:49.988860+0000","last_became_peered":"2023-10-06T02:24:49.988860+0000","last_unstale":"2023-10-06T02:24:51.016704+0000","last_undegraded":"2023-10-06T02:24:51.016704+0000","last_fullsized":"2023-10-06T02:24:51.016704+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:00:12.865029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.001240+0000","last_change":"2023-10-06T02:24:50.998065+0000","last_active":"2023-10-06T02:24:51.001240+0000","last_peered":"2023-10-06T02:24:51.001240+0000","last_clean":"2023-10-06T02:24:51.001240+0000","last_became_active":"2023-10-06T02:24:50.997750+0000","last_became_peered":"2023-10-06T02:24:50.997750+0000","last_unstale":"2023-10-06T02:24:51.001240+0000","last_undegraded":"2023-10-06T02:24:51.001240+0000","last_fullsized":"2023-10-06T02:24:51.001240+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:49.342773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.986833+0000","last_change":"2023-10-06T02:24:49.984698+0000","last_active":"2023-10-06T02:24:50.986833+0000","last_peered":"2023-10-06T02:24:50.986833+0000","last_clean":"2023-10-06T02:24:50.986833+0000","last_became_active":"2023-10-06T02:24:49.984450+0000","last_became_peered":"2023-10-06T02:24:49.984450+0000","last_unstale":"2023-10-06T02:24:50.986833+0000","last_undegraded":"2023-10-06T02:24:50.986833+0000","last_fullsized":"2023-10-06T02:24:50.986833+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:23:56.372414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.010450+0000","last_change":"2023-10-06T02:24:51.005593+0000","last_active":"2023-10-06T02:24:51.010450+0000","last_peered":"2023-10-06T02:24:51.010450+0000","last_clean":"2023-10-06T02:24:51.010450+0000","last_became_active":"2023-10-06T02:24:51.005330+0000","last_became_peered":"2023-10-06T02:24:51.005330+0000","last_unstale":"2023-10-06T02:24:51.010450+0000","last_undegraded":"2023-10-06T02:24:51.010450+0000","last_fullsized":"2023-10-06T02:24:51.010450+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:49.845589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.996111+0000","last_change":"2023-10-06T02:24:49.982689+0000","last_active":"2023-10-06T02:24:50.996111+0000","last_peered":"2023-10-06T02:24:50.996111+0000","last_clean":"2023-10-06T02:24:50.996111+0000","last_became_active":"2023-10-06T02:24:49.982345+0000","last_became_peered":"2023-10-06T02:24:49.982345+0000","last_unstale":"2023-10-06T02:24:50.996111+0000","last_undegraded":"2023-10-06T02:24:50.996111+0000","last_fullsized":"2023-10-06T02:24:50.996111+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:42:52.427042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.009761+0000","last_change":"2023-10-06T02:24:51.004555+0000","last_active":"2023-10-06T02:24:51.009761+0000","last_peered":"2023-10-06T02:24:51.009761+0000","last_clean":"2023-10-06T02:24:51.009761+0000","last_became_active":"2023-10-06T02:24:51.004075+0000","last_became_peered":"2023-10-06T02:24:51.004075+0000","last_unstale":"2023-10-06T02:24:51.009761+0000","last_undegraded":"2023-10-06T02:24:51.009761+0000","last_fullsized":"2023-10-06T02:24:51.009761+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:37.641976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"42'8","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.020707+0000","last_change":"2023-10-06T02:24:49.982030+0000","last_active":"2023-10-06T02:24:51.020707+0000","last_peered":"2023-10-06T02:24:51.020707+0000","last_clean":"2023-10-06T02:24:51.020707+0000","last_became_active":"2023-10-06T02:24:49.981771+0000","last_became_peered":"2023-10-06T02:24:49.981771+0000","last_unstale":"2023-10-06T02:24:51.020707+0000","last_undegraded":"2023-10-06T02:24:51.020707+0000","last_fullsized":"2023-10-06T02:24:51.020707+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:17.475901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.006176+0000","last_change":"2023-10-06T02:24:50.999637+0000","last_active":"2023-10-06T02:24:51.006176+0000","last_peered":"2023-10-06T02:24:51.006176+0000","last_clean":"2023-10-06T02:24:51.006176+0000","last_became_active":"2023-10-06T02:24:50.999350+0000","last_became_peered":"2023-10-06T02:24:50.999350+0000","last_unstale":"2023-10-06T02:24:51.006176+0000","last_undegraded":"2023-10-06T02:24:51.006176+0000","last_fullsized":"2023-10-06T02:24:51.006176+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:37.641976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"42'1","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.018662+0000","last_change":"2023-10-06T02:24:49.991069+0000","last_active":"2023-10-06T02:24:51.018662+0000","last_peered":"2023-10-06T02:24:51.018662+0000","last_clean":"2023-10-06T02:24:51.018662+0000","last_became_active":"2023-10-06T02:24:49.990774+0000","last_became_peered":"2023-10-06T02:24:49.990774+0000","last_unstale":"2023-10-06T02:24:51.018662+0000","last_undegraded":"2023-10-06T02:24:51.018662+0000","last_fullsized":"2023-10-06T02:24:51.018662+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:31.682427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.005982+0000","last_change":"2023-10-06T02:24:51.002082+0000","last_active":"2023-10-06T02:24:51.005982+0000","last_peered":"2023-10-06T02:24:51.005982+0000","last_clean":"2023-10-06T02:24:51.005982+0000","last_became_active":"2023-10-06T02:24:51.001820+0000","last_became_peered":"2023-10-06T02:24:51.001820+0000","last_unstale":"2023-10-06T02:24:51.005982+0000","last_undegraded":"2023-10-06T02:24:51.005982+0000","last_fullsized":"2023-10-06T02:24:51.005982+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:38.608355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"42'2","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.019636+0000","last_change":"2023-10-06T02:24:49.982626+0000","last_active":"2023-10-06T02:24:51.019636+0000","last_peered":"2023-10-06T02:24:51.019636+0000","last_clean":"2023-10-06T02:24:51.019636+0000","last_became_active":"2023-10-06T02:24:49.982132+0000","last_became_peered":"2023-10-06T02:24:49.982132+0000","last_unstale":"2023-10-06T02:24:51.019636+0000","last_undegraded":"2023-10-06T02:24:51.019636+0000","last_fullsized":"2023-10-06T02:24:51.019636+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:42.140150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.010640+0000","last_change":"2023-10-06T02:24:51.002627+0000","last_active":"2023-10-06T02:24:51.010640+0000","last_peered":"2023-10-06T02:24:51.010640+0000","last_clean":"2023-10-06T02:24:51.010640+0000","last_became_active":"2023-10-06T02:24:51.002305+0000","last_became_peered":"2023-10-06T02:24:51.002305+0000","last_unstale":"2023-10-06T02:24:51.010640+0000","last_undegraded":"2023-10-06T02:24:51.010640+0000","last_fullsized":"2023-10-06T02:24:51.010640+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:21.981316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"42'1","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.014277+0000","last_change":"2023-10-06T02:24:49.981318+0000","last_active":"2023-10-06T02:24:51.014277+0000","last_peered":"2023-10-06T02:24:51.014277+0000","last_clean":"2023-10-06T02:24:51.014277+0000","last_became_active":"2023-10-06T02:24:49.981099+0000","last_became_peered":"2023-10-06T02:24:49.981099+0000","last_unstale":"2023-10-06T02:24:51.014277+0000","last_undegraded":"2023-10-06T02:24:51.014277+0000","last_fullsized":"2023-10-06T02:24:51.014277+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:54.990891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.005820+0000","last_change":"2023-10-06T02:24:50.997842+0000","last_active":"2023-10-06T02:24:51.005820+0000","last_peered":"2023-10-06T02:24:51.005820+0000","last_clean":"2023-10-06T02:24:51.005820+0000","last_became_active":"2023-10-06T02:24:50.997556+0000","last_became_peered":"2023-10-06T02:24:50.997556+0000","last_unstale":"2023-10-06T02:24:51.005820+0000","last_undegraded":"2023-10-06T02:24:51.005820+0000","last_fullsized":"2023-10-06T02:24:51.005820+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:26:29.399880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.987151+0000","last_change":"2023-10-06T02:24:49.972659+0000","last_active":"2023-10-06T02:24:50.987151+0000","last_peered":"2023-10-06T02:24:50.987151+0000","last_clean":"2023-10-06T02:24:50.987151+0000","last_became_active":"2023-10-06T02:24:49.972383+0000","last_became_peered":"2023-10-06T02:24:49.972383+0000","last_unstale":"2023-10-06T02:24:50.987151+0000","last_undegraded":"2023-10-06T02:24:50.987151+0000","last_fullsized":"2023-10-06T02:24:50.987151+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:45.566541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.004434+0000","last_change":"2023-10-06T02:24:51.002683+0000","last_active":"2023-10-06T02:24:51.004434+0000","last_peered":"2023-10-06T02:24:51.004434+0000","last_clean":"2023-10-06T02:24:51.004434+0000","last_became_active":"2023-10-06T02:24:51.001354+0000","last_became_peered":"2023-10-06T02:24:51.001354+0000","last_unstale":"2023-10-06T02:24:51.004434+0000","last_undegraded":"2023-10-06T02:24:51.004434+0000","last_fullsized":"2023-10-06T02:24:51.004434+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:56.202940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"42'2","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.014023+0000","last_change":"2023-10-06T02:24:49.983408+0000","last_active":"2023-10-06T02:24:51.014023+0000","last_peered":"2023-10-06T02:24:51.014023+0000","last_clean":"2023-10-06T02:24:51.014023+0000","last_became_active":"2023-10-06T02:24:49.983079+0000","last_became_peered":"2023-10-06T02:24:49.983079+0000","last_unstale":"2023-10-06T02:24:51.014023+0000","last_undegraded":"2023-10-06T02:24:51.014023+0000","last_fullsized":"2023-10-06T02:24:51.014023+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:40.520860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.007353+0000","last_change":"2023-10-06T02:24:51.002206+0000","last_active":"2023-10-06T02:24:51.007353+0000","last_peered":"2023-10-06T02:24:51.007353+0000","last_clean":"2023-10-06T02:24:51.007353+0000","last_became_active":"2023-10-06T02:24:51.001937+0000","last_became_peered":"2023-10-06T02:24:51.001937+0000","last_unstale":"2023-10-06T02:24:51.007353+0000","last_undegraded":"2023-10-06T02:24:51.007353+0000","last_fullsized":"2023-10-06T02:24:51.007353+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:16.135102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.989092+0000","last_change":"2023-10-06T02:24:49.980636+0000","last_active":"2023-10-06T02:24:50.989092+0000","last_peered":"2023-10-06T02:24:50.989092+0000","last_clean":"2023-10-06T02:24:50.989092+0000","last_became_active":"2023-10-06T02:24:49.980337+0000","last_became_peered":"2023-10-06T02:24:49.980337+0000","last_unstale":"2023-10-06T02:24:50.989092+0000","last_undegraded":"2023-10-06T02:24:50.989092+0000","last_fullsized":"2023-10-06T02:24:50.989092+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:25.722081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.005406+0000","last_change":"2023-10-06T02:24:50.999068+0000","last_active":"2023-10-06T02:24:51.005406+0000","last_peered":"2023-10-06T02:24:51.005406+0000","last_clean":"2023-10-06T02:24:51.005406+0000","last_became_active":"2023-10-06T02:24:50.998816+0000","last_became_peered":"2023-10-06T02:24:50.998816+0000","last_unstale":"2023-10-06T02:24:51.005406+0000","last_undegraded":"2023-10-06T02:24:51.005406+0000","last_fullsized":"2023-10-06T02:24:51.005406+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:57.890276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.989782+0000","last_change":"2023-10-06T02:24:49.987583+0000","last_active":"2023-10-06T02:24:50.989782+0000","last_peered":"2023-10-06T02:24:50.989782+0000","last_clean":"2023-10-06T02:24:50.989782+0000","last_became_active":"2023-10-06T02:24:49.987217+0000","last_became_peered":"2023-10-06T02:24:49.987217+0000","last_unstale":"2023-10-06T02:24:50.989782+0000","last_undegraded":"2023-10-06T02:24:50.989782+0000","last_fullsized":"2023-10-06T02:24:50.989782+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:37.603204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.006113+0000","last_change":"2023-10-06T02:24:51.001347+0000","last_active":"2023-10-06T02:24:51.006113+0000","last_peered":"2023-10-06T02:24:51.006113+0000","last_clean":"2023-10-06T02:24:51.006113+0000","last_became_active":"2023-10-06T02:24:51.001090+0000","last_became_peered":"2023-10-06T02:24:51.001090+0000","last_unstale":"2023-10-06T02:24:51.006113+0000","last_undegraded":"2023-10-06T02:24:51.006113+0000","last_fullsized":"2023-10-06T02:24:51.006113+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:32.687578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.984633+0000","last_change":"2023-10-06T02:24:49.982457+0000","last_active":"2023-10-06T02:24:50.984633+0000","last_peered":"2023-10-06T02:24:50.984633+0000","last_clean":"2023-10-06T02:24:50.984633+0000","last_became_active":"2023-10-06T02:24:49.982182+0000","last_became_peered":"2023-10-06T02:24:49.982182+0000","last_unstale":"2023-10-06T02:24:50.984633+0000","last_undegraded":"2023-10-06T02:24:50.984633+0000","last_fullsized":"2023-10-06T02:24:50.984633+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:22.320332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.008836+0000","last_change":"2023-10-06T02:24:51.002072+0000","last_active":"2023-10-06T02:24:51.008836+0000","last_peered":"2023-10-06T02:24:51.008836+0000","last_clean":"2023-10-06T02:24:51.008836+0000","last_became_active":"2023-10-06T02:24:51.001276+0000","last_became_peered":"2023-10-06T02:24:51.001276+0000","last_unstale":"2023-10-06T02:24:51.008836+0000","last_undegraded":"2023-10-06T02:24:51.008836+0000","last_fullsized":"2023-10-06T02:24:51.008836+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:05:48.077342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.991020+0000","last_change":"2023-10-06T02:24:49.980641+0000","last_active":"2023-10-06T02:24:50.991020+0000","last_peered":"2023-10-06T02:24:50.991020+0000","last_clean":"2023-10-06T02:24:50.991020+0000","last_became_active":"2023-10-06T02:24:49.980344+0000","last_became_peered":"2023-10-06T02:24:49.980344+0000","last_unstale":"2023-10-06T02:24:50.991020+0000","last_undegraded":"2023-10-06T02:24:50.991020+0000","last_fullsized":"2023-10-06T02:24:50.991020+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:11.441778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.994745+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:24:50.994745+0000","last_peered":"2023-10-06T02:24:50.994745+0000","last_clean":"2023-10-06T02:24:50.994745+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:24:50.994745+0000","last_undegraded":"2023-10-06T02:24:50.994745+0000","last_fullsized":"2023-10-06T02:24:50.994745+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.004461+0000","last_change":"2023-10-06T02:24:50.999252+0000","last_active":"2023-10-06T02:24:51.004461+0000","last_peered":"2023-10-06T02:24:51.004461+0000","last_clean":"2023-10-06T02:24:51.004461+0000","last_became_active":"2023-10-06T02:24:50.998964+0000","last_became_peered":"2023-10-06T02:24:50.998964+0000","last_unstale":"2023-10-06T02:24:51.004461+0000","last_undegraded":"2023-10-06T02:24:51.004461+0000","last_fullsized":"2023-10-06T02:24:51.004461+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:03.313825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.989196+0000","last_change":"2023-10-06T02:24:49.980022+0000","last_active":"2023-10-06T02:24:50.989196+0000","last_peered":"2023-10-06T02:24:50.989196+0000","last_clean":"2023-10-06T02:24:50.989196+0000","last_became_active":"2023-10-06T02:24:49.979744+0000","last_became_peered":"2023-10-06T02:24:49.979744+0000","last_unstale":"2023-10-06T02:24:50.989196+0000","last_undegraded":"2023-10-06T02:24:50.989196+0000","last_fullsized":"2023-10-06T02:24:50.989196+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:14.133062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.991204+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:24:50.991204+0000","last_peered":"2023-10-06T02:24:50.991204+0000","last_clean":"2023-10-06T02:24:50.991204+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:24:50.991204+0000","last_undegraded":"2023-10-06T02:24:50.991204+0000","last_fullsized":"2023-10-06T02:24:50.991204+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.005711+0000","last_change":"2023-10-06T02:24:50.999171+0000","last_active":"2023-10-06T02:24:51.005711+0000","last_peered":"2023-10-06T02:24:51.005711+0000","last_clean":"2023-10-06T02:24:51.005711+0000","last_became_active":"2023-10-06T02:24:50.998806+0000","last_became_peered":"2023-10-06T02:24:50.998806+0000","last_unstale":"2023-10-06T02:24:51.005711+0000","last_undegraded":"2023-10-06T02:24:51.005711+0000","last_fullsized":"2023-10-06T02:24:51.005711+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:34.741977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.993741+0000","last_change":"2023-10-06T02:24:49.983248+0000","last_active":"2023-10-06T02:24:50.993741+0000","last_peered":"2023-10-06T02:24:50.993741+0000","last_clean":"2023-10-06T02:24:50.993741+0000","last_became_active":"2023-10-06T02:24:49.982971+0000","last_became_peered":"2023-10-06T02:24:49.982971+0000","last_unstale":"2023-10-06T02:24:50.993741+0000","last_undegraded":"2023-10-06T02:24:50.993741+0000","last_fullsized":"2023-10-06T02:24:50.993741+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:56:14.738878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":30,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.991826+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:24:50.991826+0000","last_peered":"2023-10-06T02:24:50.991826+0000","last_clean":"2023-10-06T02:24:50.991826+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:24:50.991826+0000","last_undegraded":"2023-10-06T02:24:50.991826+0000","last_fullsized":"2023-10-06T02:24:50.991826+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":181,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.991092+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:24:50.991092+0000","last_peered":"2023-10-06T02:24:50.991092+0000","last_clean":"2023-10-06T02:24:50.991092+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:24:50.991092+0000","last_undegraded":"2023-10-06T02:24:50.991092+0000","last_fullsized":"2023-10-06T02:24:50.991092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.010893+0000","last_change":"2023-10-06T02:24:51.008020+0000","last_active":"2023-10-06T02:24:51.010893+0000","last_peered":"2023-10-06T02:24:51.010893+0000","last_clean":"2023-10-06T02:24:51.010893+0000","last_became_active":"2023-10-06T02:24:51.007768+0000","last_became_peered":"2023-10-06T02:24:51.007768+0000","last_unstale":"2023-10-06T02:24:51.010893+0000","last_undegraded":"2023-10-06T02:24:51.010893+0000","last_fullsized":"2023-10-06T02:24:51.010893+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:57.890276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.990300+0000","last_change":"2023-10-06T02:24:49.991755+0000","last_active":"2023-10-06T02:24:50.990300+0000","last_peered":"2023-10-06T02:24:50.990300+0000","last_clean":"2023-10-06T02:24:50.990300+0000","last_became_active":"2023-10-06T02:24:49.991514+0000","last_became_peered":"2023-10-06T02:24:49.991514+0000","last_unstale":"2023-10-06T02:24:50.990300+0000","last_undegraded":"2023-10-06T02:24:50.990300+0000","last_fullsized":"2023-10-06T02:24:50.990300+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:06.048431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.993525+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:24:50.993525+0000","last_peered":"2023-10-06T02:24:50.993525+0000","last_clean":"2023-10-06T02:24:50.993525+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:24:50.993525+0000","last_undegraded":"2023-10-06T02:24:50.993525+0000","last_fullsized":"2023-10-06T02:24:50.993525+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.000899+0000","last_change":"2023-10-06T02:24:50.994859+0000","last_active":"2023-10-06T02:24:51.000899+0000","last_peered":"2023-10-06T02:24:51.000899+0000","last_clean":"2023-10-06T02:24:51.000899+0000","last_became_active":"2023-10-06T02:24:50.994607+0000","last_became_peered":"2023-10-06T02:24:50.994607+0000","last_unstale":"2023-10-06T02:24:51.000899+0000","last_undegraded":"2023-10-06T02:24:51.000899+0000","last_fullsized":"2023-10-06T02:24:51.000899+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:42:53.432193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.993702+0000","last_change":"2023-10-06T02:24:49.990777+0000","last_active":"2023-10-06T02:24:50.993702+0000","last_peered":"2023-10-06T02:24:50.993702+0000","last_clean":"2023-10-06T02:24:50.993702+0000","last_became_active":"2023-10-06T02:24:49.990447+0000","last_became_peered":"2023-10-06T02:24:49.990447+0000","last_unstale":"2023-10-06T02:24:50.993702+0000","last_undegraded":"2023-10-06T02:24:50.993702+0000","last_fullsized":"2023-10-06T02:24:50.993702+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:12.586610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.990956+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:24:50.990956+0000","last_peered":"2023-10-06T02:24:50.990956+0000","last_clean":"2023-10-06T02:24:50.990956+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:24:50.990956+0000","last_undegraded":"2023-10-06T02:24:50.990956+0000","last_fullsized":"2023-10-06T02:24:50.990956+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.003258+0000","last_change":"2023-10-06T02:24:50.997029+0000","last_active":"2023-10-06T02:24:51.003258+0000","last_peered":"2023-10-06T02:24:51.003258+0000","last_clean":"2023-10-06T02:24:51.003258+0000","last_became_active":"2023-10-06T02:24:50.995962+0000","last_became_peered":"2023-10-06T02:24:50.995962+0000","last_unstale":"2023-10-06T02:24:51.003258+0000","last_undegraded":"2023-10-06T02:24:51.003258+0000","last_fullsized":"2023-10-06T02:24:51.003258+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:17.070816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"42'2","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.016921+0000","last_change":"2023-10-06T02:24:49.984890+0000","last_active":"2023-10-06T02:24:51.016921+0000","last_peered":"2023-10-06T02:24:51.016921+0000","last_clean":"2023-10-06T02:24:51.016921+0000","last_became_active":"2023-10-06T02:24:49.984491+0000","last_became_peered":"2023-10-06T02:24:49.984491+0000","last_unstale":"2023-10-06T02:24:51.016921+0000","last_undegraded":"2023-10-06T02:24:51.016921+0000","last_fullsized":"2023-10-06T02:24:51.016921+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:24.708807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":35,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.988109+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:24:50.988109+0000","last_peered":"2023-10-06T02:24:50.988109+0000","last_clean":"2023-10-06T02:24:50.988109+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:24:50.988109+0000","last_undegraded":"2023-10-06T02:24:50.988109+0000","last_fullsized":"2023-10-06T02:24:50.988109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.008742+0000","last_change":"2023-10-06T02:24:51.003248+0000","last_active":"2023-10-06T02:24:51.008742+0000","last_peered":"2023-10-06T02:24:51.008742+0000","last_clean":"2023-10-06T02:24:51.008742+0000","last_became_active":"2023-10-06T02:24:51.002277+0000","last_became_peered":"2023-10-06T02:24:51.002277+0000","last_unstale":"2023-10-06T02:24:51.008742+0000","last_undegraded":"2023-10-06T02:24:51.008742+0000","last_fullsized":"2023-10-06T02:24:51.008742+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:24.063459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.988309+0000","last_change":"2023-10-06T02:24:49.983424+0000","last_active":"2023-10-06T02:24:50.988309+0000","last_peered":"2023-10-06T02:24:50.988309+0000","last_clean":"2023-10-06T02:24:50.988309+0000","last_became_active":"2023-10-06T02:24:49.983101+0000","last_became_peered":"2023-10-06T02:24:49.983101+0000","last_unstale":"2023-10-06T02:24:50.988309+0000","last_undegraded":"2023-10-06T02:24:50.988309+0000","last_fullsized":"2023-10-06T02:24:50.988309+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:14.133062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.985842+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:24:50.985842+0000","last_peered":"2023-10-06T02:24:50.985842+0000","last_clean":"2023-10-06T02:24:50.985842+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:24:50.985842+0000","last_undegraded":"2023-10-06T02:24:50.985842+0000","last_fullsized":"2023-10-06T02:24:50.985842+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:51.016485+0000","last_change":"2023-10-06T02:24:51.008043+0000","last_active":"2023-10-06T02:24:51.016485+0000","last_peered":"2023-10-06T02:24:51.016485+0000","last_clean":"2023-10-06T02:24:51.016485+0000","last_became_active":"2023-10-06T02:24:51.007783+0000","last_became_peered":"2023-10-06T02:24:51.007783+0000","last_unstale":"2023-10-06T02:24:51.016485+0000","last_undegraded":"2023-10-06T02:24:51.016485+0000","last_fullsized":"2023-10-06T02:24:51.016485+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:49.961899+0000","last_clean_scrub_stamp":"2023-10-06T02:24:49.961899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:21.258337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.992771+0000","last_change":"2023-10-06T02:24:49.980240+0000","last_active":"2023-10-06T02:24:50.992771+0000","last_peered":"2023-10-06T02:24:50.992771+0000","last_clean":"2023-10-06T02:24:50.992771+0000","last_became_active":"2023-10-06T02:24:49.979985+0000","last_became_peered":"2023-10-06T02:24:49.979985+0000","last_unstale":"2023-10-06T02:24:50.992771+0000","last_undegraded":"2023-10-06T02:24:50.992771+0000","last_fullsized":"2023-10-06T02:24:50.992771+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:24:48.956748+0000","last_clean_scrub_stamp":"2023-10-06T02:24:48.956748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:46:14.133062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:24:50.986051+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:24:50.986051+0000","last_peered":"2023-10-06T02:24:50.986051+0000","last_clean":"2023-10-06T02:24:50.986051+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:24:50.986051+0000","last_undegraded":"2023-10-06T02:24:50.986051+0000","last_fullsized":"2023-10-06T02:24:50.986051+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298368,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073472,"statfs":{"total":96636764160,"available":96331235328,"internally_reserved":0,"allocated":1105920,"data_stored":804234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.45900000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.498},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.34200000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54000000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.59299999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.51300000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.625}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":213013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":5.859,"5min":5.859,"15min":5.859},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.63900000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.55400000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.628},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.442}]},{"osd":5,"last update":"Fri Oct 6 02:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46400000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:24:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298368,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073472,"statfs":{"total":96636764160,"available":96331235328,"internally_reserved":0,"allocated":1105920,"data_stored":804270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":7.6900000000000004,"5min":7.6900000000000004,"15min":7.6900000000000004},"last":0.441}]},{"osd":2,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":7.3639999999999999,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":7.758,"5min":7.758,"15min":7.758},"last":0.35299999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":7.7869999999999999,"5min":7.7869999999999999,"15min":7.7869999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.41599999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":11.678000000000001,"5min":11.678000000000001,"15min":11.678000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":7.6529999999999996,"5min":7.6529999999999996,"15min":7.6529999999999996},"last":0.68400000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":7.508,"5min":7.508,"15min":7.508},"last":0.65000000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":7.7270000000000003,"5min":7.7270000000000003,"15min":7.7270000000000003},"last":0.626},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.72599999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":7.4619999999999997,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.749}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":212445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.38}]},{"osd":3,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.498}]},{"osd":5,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.61099999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48999999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297792,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074048,"statfs":{"total":96636764160,"available":96331825152,"internally_reserved":0,"allocated":516096,"data_stored":215278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.46999999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.38500000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.35099999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.68000000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297792,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074048,"statfs":{"total":96636764160,"available":96331825152,"internally_reserved":0,"allocated":516096,"data_stored":213947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":10.164999999999999,"5min":10.164999999999999,"15min":10.164999999999999},"last":0.247},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.432}]},{"osd":1,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.36899999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.40600000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.72499999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.77900000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.63},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.71099999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.68600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297784,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074056,"statfs":{"total":96636764160,"available":96331833344,"internally_reserved":0,"allocated":507904,"data_stored":214296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.53300000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61199999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.495},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.59599999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:24:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.623},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.65000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297780,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074060,"statfs":{"total":96636764160,"available":96331837440,"internally_reserved":0,"allocated":503808,"data_stored":213742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.46800000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.373},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.52000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.50700000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.436}]},{"osd":4,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.58799999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.59999999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.57599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:24:55.509 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:24:55.510 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:24:55.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.667+0000 7f9c3370f700 1 Processor -- start 2023-10-06T02:24:55.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.668+0000 7f9c3370f700 1 -- start start 2023-10-06T02:24:55.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.668+0000 7f9c3370f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c2c0b1ca0 0x7f9c2c164560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.668+0000 7f9c3370f700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2c15e070 con 0x7f9c2c150380 2023-10-06T02:24:55.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.668+0000 7f9c3370f700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2c15d1c0 con 0x7f9c2c150750 2023-10-06T02:24:55.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.668+0000 7f9c3370f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c15d460 con 0x7f9c2c0b1ca0 2023-10-06T02:24:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c314ab700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9c2c150380 0x7f9c2c0b3c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56558/0 (socket says 172.21.15.37:56558) 2023-10-06T02:24:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c314ab700 1 -- 172.21.15.37:0/474235261 learned_addr learned my addr 172.21.15.37:0/474235261 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c31cac700 1 --2- 172.21.15.37:0/474235261 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c2c0b1ca0 0x7f9c2c164560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c2bfff700 1 -- 172.21.15.37:0/474235261 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513913500 0 0) 0x7f9c2c15e070 con 0x7f9c2c150380 2023-10-06T02:24:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c2bfff700 1 -- 172.21.15.37:0/474235261 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c14003570 con 0x7f9c2c150380 2023-10-06T02:24:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c2bfff700 1 -- 172.21.15.37:0/474235261 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2554536557 0 0) 0x7f9c14003570 con 0x7f9c2c150380 2023-10-06T02:24:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c2bfff700 1 -- 172.21.15.37:0/474235261 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c2c0b1ca0 msgr2=0x7f9c2c164560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c2bfff700 1 --2- 172.21.15.37:0/474235261 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c2c0b1ca0 0x7f9c2c164560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c2bfff700 1 -- 172.21.15.37:0/474235261 >> v1:172.21.15.191:6789/0 conn(0x7f9c2c150750 legacy=0x7f9c2c0b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c2bfff700 1 -- 172.21.15.37:0/474235261 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c15d740 con 0x7f9c2c150380 2023-10-06T02:24:55.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c2bfff700 1 -- 172.21.15.37:0/474235261 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f9c1c0017f0 con 0x7f9c2c150380 2023-10-06T02:24:55.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c2bfff700 1 -- 172.21.15.37:0/474235261 >> v1:172.21.15.37:6789/0 conn(0x7f9c2c150380 legacy=0x7f9c2c0b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c2bfff700 1 --2- 172.21.15.37:0/474235261 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c2c0b1ca0 0x7f9c14003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c2bfff700 1 --2- 172.21.15.37:0/474235261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c14003fd0 0x7f9c14004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c2bfff700 1 --2- 172.21.15.37:0/474235261 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c14004d50 0x7f9c140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c2bfff700 1 -- 172.21.15.37:0/474235261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c15d460 con 0x7f9c14003fd0 2023-10-06T02:24:55.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c2bfff700 1 -- 172.21.15.37:0/474235261 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1400bb40 con 0x7f9c14004d50 2023-10-06T02:24:55.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c2bfff700 1 -- 172.21.15.37:0/474235261 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1400bd00 con 0x7f9c2c0b1ca0 2023-10-06T02:24:55.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c30caa700 1 --2- 172.21.15.37:0/474235261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c14003fd0 0x7f9c14004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c314ab700 1 --2- 172.21.15.37:0/474235261 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c2c0b1ca0 0x7f9c14003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.669+0000 7f9c31cac700 1 --2- 172.21.15.37:0/474235261 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c14004d50 0x7f9c140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.670+0000 7f9c30caa700 1 -- 172.21.15.37:0/474235261 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c2c0b1ca0 msgr2=0x7f9c14003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.670+0000 7f9c30caa700 1 --2- 172.21.15.37:0/474235261 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c2c0b1ca0 0x7f9c14003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.670+0000 7f9c30caa700 1 -- 172.21.15.37:0/474235261 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c14004d50 msgr2=0x7f9c140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:55.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.670+0000 7f9c30caa700 1 --2- 172.21.15.37:0/474235261 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c14004d50 0x7f9c140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.670+0000 7f9c30caa700 1 -- 172.21.15.37:0/474235261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c14003570 con 0x7f9c14003fd0 2023-10-06T02:24:55.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.670+0000 7f9c30caa700 1 --2- 172.21.15.37:0/474235261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c14003fd0 0x7f9c14004810 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9c200019a0 tx=0x7f9c20007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3ec29d11bd46de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.670+0000 7f9c2bfff700 1 -- 172.21.15.37:0/474235261 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2000c5d0 con 0x7f9c14003fd0 2023-10-06T02:24:55.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.670+0000 7f9c2bfff700 1 -- 172.21.15.37:0/474235261 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2000c750 con 0x7f9c14003fd0 2023-10-06T02:24:55.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.670+0000 7f9c2bfff700 1 -- 172.21.15.37:0/474235261 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2000cb10 con 0x7f9c14003fd0 2023-10-06T02:24:55.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.670+0000 7f9c3370f700 1 -- 172.21.15.37:0/474235261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c14003fd0 msgr2=0x7f9c14004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.670+0000 7f9c3370f700 1 --2- 172.21.15.37:0/474235261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c14003fd0 0x7f9c14004810 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9c200019a0 tx=0x7f9c20007d10 comp rx=0 tx=0).stop 2023-10-06T02:24:55.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.670+0000 7f9c31cac700 1 -- 172.21.15.37:0/474235261 reap_dead start 2023-10-06T02:24:55.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.670+0000 7f9c3370f700 1 -- 172.21.15.37:0/474235261 shutdown_connections 2023-10-06T02:24:55.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.670+0000 7f9c3370f700 1 -- 172.21.15.37:0/474235261 >> 172.21.15.37:0/474235261 conn(0x7f9c2c06c0b0 msgr2=0x7f9c2c06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.671+0000 7f9c3370f700 1 -- 172.21.15.37:0/474235261 shutdown_connections 2023-10-06T02:24:55.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.671+0000 7f9c3370f700 1 -- 172.21.15.37:0/474235261 wait complete. 2023-10-06T02:24:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.672+0000 7f9c3370f700 1 Processor -- start 2023-10-06T02:24:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.672+0000 7f9c3370f700 1 -- start start 2023-10-06T02:24:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.672+0000 7f9c3370f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c14003fd0 0x7f9c2c16b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.672+0000 7f9c3370f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c2c16a200 0x7f9c2c13ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.672+0000 7f9c3370f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c2c15b4f0 0x7f9c2c15b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.672+0000 7f9c3370f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c15beb0 con 0x7f9c2c16a200 2023-10-06T02:24:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.672+0000 7f9c3370f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c16c5c0 con 0x7f9c14003fd0 2023-10-06T02:24:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.672+0000 7f9c3370f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c13b3a0 con 0x7f9c2c15b4f0 2023-10-06T02:24:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.673+0000 7f9c30caa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c2c16a200 0x7f9c2c13ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.673+0000 7f9c30caa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c2c16a200 0x7f9c2c13ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59006/0 (socket says 172.21.15.37:59006) 2023-10-06T02:24:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.673+0000 7f9c30caa700 1 -- 172.21.15.37:0/823995442 learned_addr learned my addr 172.21.15.37:0/823995442 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.673+0000 7f9c314ab700 1 --2- 172.21.15.37:0/823995442 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c14003fd0 0x7f9c2c16b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.673+0000 7f9c31cac700 1 --2- 172.21.15.37:0/823995442 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c2c15b4f0 0x7f9c2c15b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.673+0000 7f9c30caa700 1 -- 172.21.15.37:0/823995442 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c2c15b4f0 msgr2=0x7f9c2c15b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.673+0000 7f9c30caa700 1 --2- 172.21.15.37:0/823995442 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c2c15b4f0 0x7f9c2c15b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.673+0000 7f9c30caa700 1 -- 172.21.15.37:0/823995442 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c14003fd0 msgr2=0x7f9c2c16b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.673+0000 7f9c30caa700 1 --2- 172.21.15.37:0/823995442 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c14003fd0 0x7f9c2c16b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.673+0000 7f9c30caa700 1 -- 172.21.15.37:0/823995442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c16a670 con 0x7f9c2c16a200 2023-10-06T02:24:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.673+0000 7f9c30caa700 1 --2- 172.21.15.37:0/823995442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c2c16a200 0x7f9c2c13ae60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9c20012f40 tx=0x7f9c20015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.673+0000 7f9c297fa700 1 -- 172.21.15.37:0/823995442 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2000c5d0 con 0x7f9c2c16a200 2023-10-06T02:24:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.673+0000 7f9c297fa700 1 -- 172.21.15.37:0/823995442 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2000ce80 con 0x7f9c2c16a200 2023-10-06T02:24:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.673+0000 7f9c3370f700 1 -- 172.21.15.37:0/823995442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c2c16ca50 con 0x7f9c2c16a200 2023-10-06T02:24:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.673+0000 7f9c297fa700 1 -- 172.21.15.37:0/823995442 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2000cb10 con 0x7f9c2c16a200 2023-10-06T02:24:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.673+0000 7f9c3370f700 1 -- 172.21.15.37:0/823995442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c2c16bc90 con 0x7f9c2c16a200 2023-10-06T02:24:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.674+0000 7f9c3370f700 1 -- 172.21.15.37:0/823995442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2c16c750 con 0x7f9c2c16a200 2023-10-06T02:24:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.675+0000 7f9c297fa700 1 -- 172.21.15.37:0/823995442 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c20019030 con 0x7f9c2c16a200 2023-10-06T02:24:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.675+0000 7f9c297fa700 1 --2- 172.21.15.37:0/823995442 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9c18066f30 0x7f9c180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.675+0000 7f9c297fa700 1 -- 172.21.15.37:0/823995442 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9c200859d0 con 0x7f9c2c16a200 2023-10-06T02:24:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.675+0000 7f9c314ab700 1 --2- 172.21.15.37:0/823995442 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9c18066f30 0x7f9c180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.676+0000 7f9c314ab700 1 --2- 172.21.15.37:0/823995442 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9c18066f30 0x7f9c180693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c001580 tx=0x7f9c1c006040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:55.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.679+0000 7f9c297fa700 1 -- 172.21.15.37:0/823995442 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c20052ba0 con 0x7f9c2c16a200 2023-10-06T02:24:55.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.951+0000 7f9c3370f700 1 -- 172.21.15.37:0/823995442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9c2c15da20 con 0x7f9c2c16a200 2023-10-06T02:24:55.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.955+0000 7f9c297fa700 1 -- 172.21.15.37:0/823995442 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9c200170e0 con 0x7f9c2c16a200 2023-10-06T02:24:55.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.957+0000 7f9c3370f700 1 -- 172.21.15.37:0/823995442 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9c18066f30 msgr2=0x7f9c180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.957+0000 7f9c3370f700 1 --2- 172.21.15.37:0/823995442 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9c18066f30 0x7f9c180693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c001580 tx=0x7f9c1c006040 comp rx=0 tx=0).stop 2023-10-06T02:24:55.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.957+0000 7f9c3370f700 1 -- 172.21.15.37:0/823995442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c2c16a200 msgr2=0x7f9c2c13ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:55.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.957+0000 7f9c3370f700 1 --2- 172.21.15.37:0/823995442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c2c16a200 0x7f9c2c13ae60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9c20012f40 tx=0x7f9c20015000 comp rx=0 tx=0).stop 2023-10-06T02:24:55.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.957+0000 7f9c3370f700 1 -- 172.21.15.37:0/823995442 shutdown_connections 2023-10-06T02:24:55.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.957+0000 7f9c3370f700 1 --2- 172.21.15.37:0/823995442 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c2c15b4f0 0x7f9c2c15b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.957+0000 7f9c3370f700 1 --2- 172.21.15.37:0/823995442 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9c18066f30 0x7f9c180693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.957+0000 7f9c3370f700 1 --2- 172.21.15.37:0/823995442 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c14003fd0 0x7f9c2c16b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.957+0000 7f9c3370f700 1 --2- 172.21.15.37:0/823995442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c2c16a200 0x7f9c2c13ae60 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:55.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.957+0000 7f9c3370f700 1 -- 172.21.15.37:0/823995442 >> 172.21.15.37:0/823995442 conn(0x7f9c2c06c0b0 msgr2=0x7f9c2c15c150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:55.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.957+0000 7f9c3370f700 1 -- 172.21.15.37:0/823995442 shutdown_connections 2023-10-06T02:24:55.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:55.957+0000 7f9c3370f700 1 -- 172.21.15.37:0/823995442 wait complete. 2023-10-06T02:24:55.959 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-10-06T02:24:55.969 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:56.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.088+0000 7f2cec605700 1 Processor -- start 2023-10-06T02:24:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.088+0000 7f2cec605700 1 -- start start 2023-10-06T02:24:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.089+0000 7f2cec605700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ce4155a80 0x7f2ce40ab190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.089+0000 7f2cec605700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2ce40ab6d0 0x7f2ce4159800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.089+0000 7f2cec605700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce40aa740 con 0x7f2ce4155e50 2023-10-06T02:24:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.089+0000 7f2cec605700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce415a2c0 con 0x7f2ce4155a80 2023-10-06T02:24:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.089+0000 7f2cec605700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce415a5a0 con 0x7f2ce40ab6d0 2023-10-06T02:24:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.089+0000 7f2cea3a1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ce4155a80 0x7f2ce40ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.089+0000 7f2cea3a1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ce4155a80 0x7f2ce40ab190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59022/0 (socket says 172.21.15.37:59022) 2023-10-06T02:24:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.089+0000 7f2cea3a1700 1 -- 172.21.15.37:0/3585013463 learned_addr learned my addr 172.21.15.37:0/3585013463 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.089+0000 7f2ce9ba0700 1 --2- 172.21.15.37:0/3585013463 >> v2:172.21.15.191:3300/0 conn(0x7f2ce40ab6d0 0x7f2ce4159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.089+0000 7f2cea3a1700 1 -- 172.21.15.37:0/3585013463 >> v2:172.21.15.191:3300/0 conn(0x7f2ce40ab6d0 msgr2=0x7f2ce4159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.089+0000 7f2cea3a1700 1 --2- 172.21.15.37:0/3585013463 >> v2:172.21.15.191:3300/0 conn(0x7f2ce40ab6d0 0x7f2ce4159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.089+0000 7f2cea3a1700 1 -- 172.21.15.37:0/3585013463 >> v1:172.21.15.191:6789/0 conn(0x7f2ce4155e50 legacy=0x7f2ce40abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.090+0000 7f2cea3a1700 1 -- 172.21.15.37:0/3585013463 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce40aa990 con 0x7f2ce4155a80 2023-10-06T02:24:56.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.090+0000 7f2cea3a1700 1 --2- 172.21.15.37:0/3585013463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce4155a80 0x7f2ce40ab190 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400d1a0 tx=0x7f2cd400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1f28591cab4c26 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.090+0000 7f2ce939f700 1 -- 172.21.15.37:0/3585013463 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4010070 con 0x7f2ce4155a80 2023-10-06T02:24:56.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.090+0000 7f2ce939f700 1 -- 172.21.15.37:0/3585013463 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd400de80 con 0x7f2ce4155a80 2023-10-06T02:24:56.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.090+0000 7f2ce939f700 1 -- 172.21.15.37:0/3585013463 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd400b320 con 0x7f2ce4155a80 2023-10-06T02:24:56.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.090+0000 7f2cec605700 1 -- 172.21.15.37:0/3585013463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce4155a80 msgr2=0x7f2ce40ab190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.090+0000 7f2cec605700 1 --2- 172.21.15.37:0/3585013463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce4155a80 0x7f2ce40ab190 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400d1a0 tx=0x7f2cd400ba50 comp rx=0 tx=0).stop 2023-10-06T02:24:56.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.090+0000 7f2cec605700 1 -- 172.21.15.37:0/3585013463 shutdown_connections 2023-10-06T02:24:56.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.090+0000 7f2cec605700 1 --2- 172.21.15.37:0/3585013463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce4155a80 0x7f2ce40ab190 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.090+0000 7f2cec605700 1 --2- 172.21.15.37:0/3585013463 >> v2:172.21.15.191:3300/0 conn(0x7f2ce40ab6d0 0x7f2ce4159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.090+0000 7f2cec605700 1 -- 172.21.15.37:0/3585013463 >> 172.21.15.37:0/3585013463 conn(0x7f2ce40cc120 msgr2=0x7f2ce40cc520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.090+0000 7f2cec605700 1 -- 172.21.15.37:0/3585013463 shutdown_connections 2023-10-06T02:24:56.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.091+0000 7f2cec605700 1 -- 172.21.15.37:0/3585013463 wait complete. 2023-10-06T02:24:56.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.092+0000 7f2cec605700 1 Processor -- start 2023-10-06T02:24:56.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.092+0000 7f2cec605700 1 -- start start 2023-10-06T02:24:56.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.092+0000 7f2cec605700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ce40ab6d0 0x7f2ce413f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.092+0000 7f2cec605700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce4155a80 0x7f2ce40b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.092+0000 7f2cec605700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2ce4155e50 0x7f2ce4154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.092+0000 7f2cec605700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40b1230 con 0x7f2ce4155a80 2023-10-06T02:24:56.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.092+0000 7f2cec605700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40b0900 con 0x7f2ce40ab6d0 2023-10-06T02:24:56.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.092+0000 7f2cec605700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40b0be0 con 0x7f2ce4155e50 2023-10-06T02:24:56.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.092+0000 7f2ce9ba0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce4155a80 0x7f2ce40b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.092+0000 7f2ce9ba0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce4155a80 0x7f2ce40b16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59034/0 (socket says 172.21.15.37:59034) 2023-10-06T02:24:56.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.092+0000 7f2ce9ba0700 1 -- 172.21.15.37:0/2588087861 learned_addr learned my addr 172.21.15.37:0/2588087861 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:56.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.092+0000 7f2cea3a1700 1 --2- 172.21.15.37:0/2588087861 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ce40ab6d0 0x7f2ce413f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.093+0000 7f2ceaba2700 1 --2- 172.21.15.37:0/2588087861 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2ce4155e50 0x7f2ce4154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.093+0000 7f2ce9ba0700 1 -- 172.21.15.37:0/2588087861 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2ce4155e50 msgr2=0x7f2ce4154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.093+0000 7f2ce9ba0700 1 --2- 172.21.15.37:0/2588087861 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2ce4155e50 0x7f2ce4154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.093+0000 7f2ce9ba0700 1 -- 172.21.15.37:0/2588087861 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ce40ab6d0 msgr2=0x7f2ce413f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.093+0000 7f2ce9ba0700 1 --2- 172.21.15.37:0/2588087861 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ce40ab6d0 0x7f2ce413f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.093+0000 7f2ce9ba0700 1 -- 172.21.15.37:0/2588087861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd400bcf0 con 0x7f2ce4155a80 2023-10-06T02:24:56.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.093+0000 7f2ce9ba0700 1 --2- 172.21.15.37:0/2588087861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce4155a80 0x7f2ce40b16c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800d860 tx=0x7f2cd8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.093+0000 7f2ce27fc700 1 -- 172.21.15.37:0/2588087861 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8011590 con 0x7f2ce4155a80 2023-10-06T02:24:56.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.093+0000 7f2ce27fc700 1 -- 172.21.15.37:0/2588087861 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd80116f0 con 0x7f2ce4155a80 2023-10-06T02:24:56.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.093+0000 7f2cec605700 1 -- 172.21.15.37:0/2588087861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce40b0ec0 con 0x7f2ce4155a80 2023-10-06T02:24:56.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.093+0000 7f2ce27fc700 1 -- 172.21.15.37:0/2588087861 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8011a90 con 0x7f2ce4155a80 2023-10-06T02:24:56.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.093+0000 7f2cec605700 1 -- 172.21.15.37:0/2588087861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce40b1c00 con 0x7f2ce4155a80 2023-10-06T02:24:56.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.094+0000 7f2cec605700 1 -- 172.21.15.37:0/2588087861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce40b13a0 con 0x7f2ce4155a80 2023-10-06T02:24:56.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.095+0000 7f2ce27fc700 1 -- 172.21.15.37:0/2588087861 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2cd801c460 con 0x7f2ce4155a80 2023-10-06T02:24:56.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.095+0000 7f2ce27fc700 1 --2- 172.21.15.37:0/2588087861 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2cd0066f30 0x7f2cd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.095+0000 7f2ce27fc700 1 -- 172.21.15.37:0/2588087861 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2cd8084650 con 0x7f2ce4155a80 2023-10-06T02:24:56.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.095+0000 7f2cea3a1700 1 --2- 172.21.15.37:0/2588087861 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2cd0066f30 0x7f2cd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.096+0000 7f2cea3a1700 1 --2- 172.21.15.37:0/2588087861 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2cd0066f30 0x7f2cd00693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ba90 tx=0x7f2cd401a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.100+0000 7f2ce27fc700 1 -- 172.21.15.37:0/2588087861 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2cd80551f0 con 0x7f2ce4155a80 2023-10-06T02:24:56.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.338+0000 7f2cec605700 1 -- 172.21.15.37:0/2588087861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ce404bb80 con 0x7f2ce4155a80 2023-10-06T02:24:56.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.338+0000 7f2ce27fc700 1 -- 172.21.15.37:0/2588087861 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f2cd8054d80 con 0x7f2ce4155a80 2023-10-06T02:24:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:56.339 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2341182274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2341182274},{"type":"v1","addr":"172.21.15.191:6837","nonce":2341182274}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5385,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/562500386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":562500386},{"type":"v1","addr":"172.21.15.37:6834","nonce":562500386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1403086996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1403086996},{"type":"v1","addr":"172.21.15.37:6835","nonce":1403086996}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:50.379875+0000","modified":"2023-10-06T02:24:54.014513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5400":{"gid":5400,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6836/2931117635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2931117635},{"type":"v1","addr":"172.21.15.191:6836","nonce":2931117635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:24:56.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.340+0000 7f2cec605700 1 -- 172.21.15.37:0/2588087861 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2cd0066f30 msgr2=0x7f2cd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.340+0000 7f2cec605700 1 --2- 172.21.15.37:0/2588087861 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2cd0066f30 0x7f2cd00693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ba90 tx=0x7f2cd401a000 comp rx=0 tx=0).stop 2023-10-06T02:24:56.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.340+0000 7f2cec605700 1 -- 172.21.15.37:0/2588087861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce4155a80 msgr2=0x7f2ce40b16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.340+0000 7f2cec605700 1 --2- 172.21.15.37:0/2588087861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce4155a80 0x7f2ce40b16c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800d860 tx=0x7f2cd8008040 comp rx=0 tx=0).stop 2023-10-06T02:24:56.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.340+0000 7f2cec605700 1 -- 172.21.15.37:0/2588087861 shutdown_connections 2023-10-06T02:24:56.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.340+0000 7f2cec605700 1 --2- 172.21.15.37:0/2588087861 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2ce4155e50 0x7f2ce4154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.340+0000 7f2cec605700 1 --2- 172.21.15.37:0/2588087861 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2cd0066f30 0x7f2cd00693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.340+0000 7f2cec605700 1 --2- 172.21.15.37:0/2588087861 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ce40ab6d0 0x7f2ce413f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.340+0000 7f2cec605700 1 --2- 172.21.15.37:0/2588087861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce4155a80 0x7f2ce40b16c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.340+0000 7f2cec605700 1 -- 172.21.15.37:0/2588087861 >> 172.21.15.37:0/2588087861 conn(0x7f2ce40cc120 msgr2=0x7f2ce4069490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.340+0000 7f2cec605700 1 -- 172.21.15.37:0/2588087861 shutdown_connections 2023-10-06T02:24:56.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.341+0000 7f2cec605700 1 -- 172.21.15.37:0/2588087861 wait complete. 2023-10-06T02:24:56.342 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 23 2023-10-06T02:24:56.755 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:24:50.379875+0000', 'modified': '2023-10-06T02:24:54.014513+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5400}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5400': {'gid': 5400, 'name': 'd', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.191:6836/2931117635', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6834', 'nonce': 2931117635}, {'type': 'v1', 'addr': '172.21.15.191:6836', 'nonce': 2931117635}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:24:56.755 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:24:56.756 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T02:24:56.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.881+0000 7ff9c5443700 1 Processor -- start 2023-10-06T02:24:56.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.881+0000 7ff9c5443700 1 -- start start 2023-10-06T02:24:56.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.881+0000 7ff9c5443700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff9c006dab0 0x7ff9c00cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.881+0000 7ff9c5443700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9c006de80 0x7ff9c00b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.881+0000 7ff9c5443700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c00cc250 con 0x7ff9c00cb080 2023-10-06T02:24:56.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.881+0000 7ff9c5443700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c00b0e00 con 0x7ff9c006de80 2023-10-06T02:24:56.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.881+0000 7ff9c5443700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c00ccc20 con 0x7ff9c006dab0 2023-10-06T02:24:56.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.882+0000 7ff9bf7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9c006de80 0x7ff9c00b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.882+0000 7ff9bf7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9c006de80 0x7ff9c00b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59044/0 (socket says 172.21.15.37:59044) 2023-10-06T02:24:56.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.882+0000 7ff9bf7fe700 1 -- 172.21.15.37:0/2034678845 learned_addr learned my addr 172.21.15.37:0/2034678845 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:56.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.882+0000 7ff9beffd700 1 --2- 172.21.15.37:0/2034678845 >> v2:172.21.15.191:3300/0 conn(0x7ff9c006dab0 0x7ff9c00cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.882+0000 7ff9bf7fe700 1 -- 172.21.15.37:0/2034678845 >> v2:172.21.15.191:3300/0 conn(0x7ff9c006dab0 msgr2=0x7ff9c00cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.882+0000 7ff9bf7fe700 1 --2- 172.21.15.37:0/2034678845 >> v2:172.21.15.191:3300/0 conn(0x7ff9c006dab0 0x7ff9c00cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.882+0000 7ff9bf7fe700 1 -- 172.21.15.37:0/2034678845 >> v1:172.21.15.191:6789/0 conn(0x7ff9c00cb080 legacy=0x7ff9c00b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.882+0000 7ff9bf7fe700 1 -- 172.21.15.37:0/2034678845 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c00cb640 con 0x7ff9c006de80 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.882+0000 7ff9bf7fe700 1 --2- 172.21.15.37:0/2034678845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9c006de80 0x7ff9c00b08c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff9c006e760 tx=0x7ff9b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b2114bbc564b8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.882+0000 7ff9bdffb700 1 -- 172.21.15.37:0/2034678845 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b800b820 con 0x7ff9c006de80 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.882+0000 7ff9bdffb700 1 -- 172.21.15.37:0/2034678845 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b800b980 con 0x7ff9c006de80 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.882+0000 7ff9bdffb700 1 -- 172.21.15.37:0/2034678845 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b800bd20 con 0x7ff9c006de80 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.883+0000 7ff9c5443700 1 -- 172.21.15.37:0/2034678845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9c006de80 msgr2=0x7ff9c00b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.883+0000 7ff9c5443700 1 --2- 172.21.15.37:0/2034678845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9c006de80 0x7ff9c00b08c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff9c006e760 tx=0x7ff9b8009250 comp rx=0 tx=0).stop 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.883+0000 7ff9c5443700 1 -- 172.21.15.37:0/2034678845 shutdown_connections 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.883+0000 7ff9c5443700 1 --2- 172.21.15.37:0/2034678845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9c006de80 0x7ff9c00b08c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.883+0000 7ff9c5443700 1 --2- 172.21.15.37:0/2034678845 >> v2:172.21.15.191:3300/0 conn(0x7ff9c006dab0 0x7ff9c00cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.883+0000 7ff9c5443700 1 -- 172.21.15.37:0/2034678845 >> 172.21.15.37:0/2034678845 conn(0x7ff9c00d0510 msgr2=0x7ff9c00d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.883+0000 7ff9c5443700 1 -- 172.21.15.37:0/2034678845 shutdown_connections 2023-10-06T02:24:56.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.883+0000 7ff9c5443700 1 -- 172.21.15.37:0/2034678845 wait complete. 2023-10-06T02:24:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.884+0000 7ff9c5443700 1 Processor -- start 2023-10-06T02:24:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.884+0000 7ff9c5443700 1 -- start start 2023-10-06T02:24:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.885+0000 7ff9c5443700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9c006dab0 0x7ff9c0159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.885+0000 7ff9c5443700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9c006de80 0x7ff9c01696d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.885+0000 7ff9c5443700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9c00cb080 0x7ff9c0169c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.885+0000 7ff9c5443700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c00b5bd0 con 0x7ff9c006de80 2023-10-06T02:24:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.885+0000 7ff9c5443700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c00b4fc0 con 0x7ff9c00cb080 2023-10-06T02:24:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.885+0000 7ff9c5443700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c00b52a0 con 0x7ff9c006dab0 2023-10-06T02:24:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.885+0000 7ff9be7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9c006de80 0x7ff9c01696d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.885+0000 7ff9be7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9c006de80 0x7ff9c01696d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59058/0 (socket says 172.21.15.37:59058) 2023-10-06T02:24:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.885+0000 7ff9be7fc700 1 -- 172.21.15.37:0/1564296731 learned_addr learned my addr 172.21.15.37:0/1564296731 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.885+0000 7ff9beffd700 1 --2- 172.21.15.37:0/1564296731 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9c006dab0 0x7ff9c0159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.885+0000 7ff9bf7fe700 1 --2- 172.21.15.37:0/1564296731 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9c00cb080 0x7ff9c0169c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.885+0000 7ff9be7fc700 1 -- 172.21.15.37:0/1564296731 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9c006dab0 msgr2=0x7ff9c0159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.885+0000 7ff9be7fc700 1 --2- 172.21.15.37:0/1564296731 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9c006dab0 0x7ff9c0159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.885+0000 7ff9be7fc700 1 -- 172.21.15.37:0/1564296731 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9c00cb080 msgr2=0x7ff9c0169c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.885+0000 7ff9be7fc700 1 --2- 172.21.15.37:0/1564296731 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9c00cb080 0x7ff9c0169c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.885+0000 7ff9be7fc700 1 -- 172.21.15.37:0/1564296731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b80094f0 con 0x7ff9c006de80 2023-10-06T02:24:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.885+0000 7ff9bf7fe700 1 --2- 172.21.15.37:0/1564296731 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9c00cb080 0x7ff9c0169c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.885+0000 7ff9beffd700 1 --2- 172.21.15.37:0/1564296731 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9c006dab0 0x7ff9c0159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.886+0000 7ff9be7fc700 1 --2- 172.21.15.37:0/1564296731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9c006de80 0x7ff9c01696d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400b5e0 tx=0x7ff9b4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.886+0000 7ff9a6ffd700 1 -- 172.21.15.37:0/1564296731 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b400f510 con 0x7ff9c006de80 2023-10-06T02:24:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.886+0000 7ff9a6ffd700 1 -- 172.21.15.37:0/1564296731 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b400f670 con 0x7ff9c006de80 2023-10-06T02:24:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.886+0000 7ff9c5443700 1 -- 172.21.15.37:0/1564296731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c00b5580 con 0x7ff9c006de80 2023-10-06T02:24:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.886+0000 7ff9a6ffd700 1 -- 172.21.15.37:0/1564296731 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b400fa30 con 0x7ff9c006de80 2023-10-06T02:24:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.886+0000 7ff9c5443700 1 -- 172.21.15.37:0/1564296731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c0159fa0 con 0x7ff9c006de80 2023-10-06T02:24:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.887+0000 7ff9a6ffd700 1 -- 172.21.15.37:0/1564296731 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff9b401a400 con 0x7ff9c006de80 2023-10-06T02:24:56.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.887+0000 7ff9a6ffd700 1 --2- 172.21.15.37:0/1564296731 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff9ac066f30 0x7ff9ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.888+0000 7ff9a6ffd700 1 -- 172.21.15.37:0/1564296731 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff9b4084300 con 0x7ff9c006de80 2023-10-06T02:24:56.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.888+0000 7ff9beffd700 1 --2- 172.21.15.37:0/1564296731 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff9ac066f30 0x7ff9ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.888+0000 7ff9beffd700 1 --2- 172.21.15.37:0/1564296731 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff9ac066f30 0x7ff9ac0693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff9c01578f0 tx=0x7ff9b0009800 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.889+0000 7ff9ce73bb80 1 Processor -- start 2023-10-06T02:24:56.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.890+0000 7ff9ce73bb80 1 -- start start 2023-10-06T02:24:56.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.890+0000 7ff9ce73bb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abb94840 0x5555abb94c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.890+0000 7ff9ce73bb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abb95cc0 0x5555abbe46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.890+0000 7ff9ce73bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abbe4c00 0x5555abbe5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.890+0000 7ff9ce73bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555abaeba70 con 0x5555abbe4c00 2023-10-06T02:24:56.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.890+0000 7ff9ce73bb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555abae9270 con 0x5555abb95cc0 2023-10-06T02:24:56.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.890+0000 7ff9ce73bb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555abae5060 con 0x5555abb94840 2023-10-06T02:24:56.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.890+0000 7ff9bf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abbe4c00 0x5555abbe5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.890+0000 7ff9bf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abbe4c00 0x5555abbe5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59068/0 (socket says 172.21.15.37:59068) 2023-10-06T02:24:56.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.890+0000 7ff9beffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abb94840 0x5555abb94c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.890+0000 7ff9bf7fe700 1 -- 172.21.15.37:0/2931812499 learned_addr learned my addr 172.21.15.37:0/2931812499 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:56.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.891+0000 7ff9be7fc700 1 --2- 172.21.15.37:0/2931812499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abb95cc0 0x5555abbe46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.891+0000 7ff9bf7fe700 1 -- 172.21.15.37:0/2931812499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abb94840 msgr2=0x5555abb94c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.891+0000 7ff9bf7fe700 1 --2- 172.21.15.37:0/2931812499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abb94840 0x5555abb94c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.891+0000 7ff9bf7fe700 1 -- 172.21.15.37:0/2931812499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abb95cc0 msgr2=0x5555abbe46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.891+0000 7ff9bf7fe700 1 --2- 172.21.15.37:0/2931812499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abb95cc0 0x5555abbe46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.891+0000 7ff9bf7fe700 1 -- 172.21.15.37:0/2931812499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555ab97f270 con 0x5555abbe4c00 2023-10-06T02:24:56.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.891+0000 7ff9bf7fe700 1 --2- 172.21.15.37:0/2931812499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abbe4c00 0x5555abbe5050 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8006fd0 tx=0x7ff9b8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27acafd4d5e53ceb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.891+0000 7ff99ffff700 1 -- 172.21.15.37:0/2931812499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b800baf0 con 0x5555abbe4c00 2023-10-06T02:24:56.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.891+0000 7ff99ffff700 1 -- 172.21.15.37:0/2931812499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b800bc50 con 0x5555abbe4c00 2023-10-06T02:24:56.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.891+0000 7ff99ffff700 1 -- 172.21.15.37:0/2931812499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8011860 con 0x5555abbe4c00 2023-10-06T02:24:56.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.892+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/2931812499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abbe4c00 msgr2=0x5555abbe5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.892+0000 7ff9ce73bb80 1 --2- 172.21.15.37:0/2931812499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abbe4c00 0x5555abbe5050 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8006fd0 tx=0x7ff9b8016000 comp rx=0 tx=0).stop 2023-10-06T02:24:56.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.892+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/2931812499 shutdown_connections 2023-10-06T02:24:56.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.892+0000 7ff9ce73bb80 1 --2- 172.21.15.37:0/2931812499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abbe4c00 0x5555abbe5050 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.892+0000 7ff9ce73bb80 1 --2- 172.21.15.37:0/2931812499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abb94840 0x5555abb94c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.892+0000 7ff9ce73bb80 1 --2- 172.21.15.37:0/2931812499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abb95cc0 0x5555abbe46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.892+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/2931812499 >> 172.21.15.37:0/2931812499 conn(0x5555abb96160 msgr2=0x5555abb96530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.892+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/2931812499 shutdown_connections 2023-10-06T02:24:56.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.892+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/2931812499 wait complete. 2023-10-06T02:24:56.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.893+0000 7ff9ce73bb80 1 -- start start 2023-10-06T02:24:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.893+0000 7ff9ce73bb80 1 Processor -- start 2023-10-06T02:24:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.894+0000 7ff9ce73bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 0x5555abbd5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.894+0000 7ff9ce73bb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abb95cc0 0x5555abbb9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.894+0000 7ff9ce73bb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abbe4c00 0x5555abbd2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.894+0000 7ff9ce73bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555aba90890 con 0x5555abb94840 2023-10-06T02:24:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.894+0000 7ff9ce73bb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555abaabea0 con 0x5555abb95cc0 2023-10-06T02:24:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.894+0000 7ff9ce73bb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555ab967e30 con 0x5555abbe4c00 2023-10-06T02:24:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.894+0000 7ff9beffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 0x5555abbd5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.894+0000 7ff9ce73bb80 10 client.0 _ll_register_callbacks cb 0x5555abb57e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:24:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.894+0000 7ff9beffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 0x5555abbd5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59074/0 (socket says 172.21.15.37:59074) 2023-10-06T02:24:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.894+0000 7ff9beffd700 1 -- 172.21.15.37:0/3555168987 learned_addr learned my addr 172.21.15.37:0/3555168987 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.894+0000 7ff9be7fc700 1 --2- 172.21.15.37:0/3555168987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abb95cc0 0x5555abbb9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.894+0000 7ff9bf7fe700 1 --2- 172.21.15.37:0/3555168987 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abbe4c00 0x5555abbd2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.894+0000 7ff9beffd700 1 -- 172.21.15.37:0/3555168987 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abbe4c00 msgr2=0x5555abbd2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.894+0000 7ff9beffd700 1 --2- 172.21.15.37:0/3555168987 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abbe4c00 0x5555abbd2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.894+0000 7ff9beffd700 1 -- 172.21.15.37:0/3555168987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abb95cc0 msgr2=0x5555abbb9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.894+0000 7ff9beffd700 1 --2- 172.21.15.37:0/3555168987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abb95cc0 0x5555abbb9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.894+0000 7ff9beffd700 1 -- 172.21.15.37:0/3555168987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c00cb640 con 0x5555abb94840 2023-10-06T02:24:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.894+0000 7ff9be7fc700 1 --2- 172.21.15.37:0/3555168987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abb95cc0 0x5555abbb9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.894+0000 7ff9beffd700 1 --2- 172.21.15.37:0/3555168987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 0x5555abbd5750 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0016e60 tx=0x7ff9b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ce255068afb856 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.894+0000 7ff99d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:24:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.895+0000 7ff99d7fa700 1 -- 172.21.15.37:0/3555168987 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0014e00 con 0x5555abb94840 2023-10-06T02:24:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.895+0000 7ff99d7fa700 1 -- 172.21.15.37:0/3555168987 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff9b00223f0 con 0x5555abb94840 2023-10-06T02:24:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.895+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/3555168987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5555abb89940 con 0x5555abb94840 2023-10-06T02:24:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.895+0000 7ff99d7fa700 1 -- 172.21.15.37:0/3555168987 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9b0022800 con 0x5555abb94840 2023-10-06T02:24:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.895+0000 7ff9ce73bb80 10 client.5553 fetch_fsmap learned FSMap version 23 2023-10-06T02:24:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.895+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/3555168987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5555ab921fe0 con 0x5555abb94840 2023-10-06T02:24:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.895+0000 7ff99d7fa700 1 -- 172.21.15.37:0/3555168987 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5555abb89940 con 0x5555abb94840 2023-10-06T02:24:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.895+0000 7ff99d7fa700 1 -- 172.21.15.37:0/3555168987 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff9b0021070 con 0x5555abb94840 2023-10-06T02:24:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.895+0000 7ff9ce73bb80 10 client.5553 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T02:24:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.895+0000 7ff9ce73bb80 10 client.5553 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T02:24:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.895+0000 7ff9ce73bb80 20 client.5553 populate_metadata read hostname 'smithi037' 2023-10-06T02:24:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.895+0000 7ff9ce73bb80 1 --2- 172.21.15.37:0/3555168987 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x5555abbdc3f0 0x5555abbdc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.895+0000 7ff9ce73bb80 4 client.5553 mds_command: new command op to 5400 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:24:56.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.895+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/3555168987 --> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5555abb66870 con 0x5555abbdc3f0 2023-10-06T02:24:56.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.895+0000 7ff9be7fc700 1 --2- 172.21.15.37:0/3555168987 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x5555abbdc3f0 0x5555abbdc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.896+0000 7ff99d7fa700 10 client.5553 ms_handle_connect on v2:172.21.15.191:6834/2931117635 2023-10-06T02:24:56.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.896+0000 7ff9be7fc700 1 --2- 172.21.15.37:0/3555168987 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x5555abbdc3f0 0x5555abbdc7c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=679b6af27aa8b41e server_cookie=f391546e463abf6b in_seq=0 out_seq=0 2023-10-06T02:24:56.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.896+0000 7ff99d7fa700 1 -- 172.21.15.37:0/3555168987 <== mds.0 v2:172.21.15.191:6834/2931117635 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5555abb66870 con 0x5555abbdc3f0 2023-10-06T02:24:56.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.896+0000 7ff99d7fa700 10 client.5553 handle_command_reply: tid=0 2023-10-06T02:24:56.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.896+0000 7ff9ce73bb80 1 client.5553 shutdown 2023-10-06T02:24:56.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.896+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/3555168987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 msgr2=0x5555abbd5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.896+0000 7ff9ce73bb80 1 --2- 172.21.15.37:0/3555168987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 0x5555abbd5750 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0016e60 tx=0x7ff9b0016000 comp rx=0 tx=0).stop 2023-10-06T02:24:56.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.897+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/3555168987 shutdown_connections 2023-10-06T02:24:56.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.897+0000 7ff9ce73bb80 1 --2- 172.21.15.37:0/3555168987 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abbe4c00 0x5555abbd2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.897+0000 7ff9ce73bb80 1 --2- 172.21.15.37:0/3555168987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 0x5555abbd5750 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.897+0000 7ff9ce73bb80 1 --2- 172.21.15.37:0/3555168987 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x5555abbdc3f0 0x5555abbdc7c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.897+0000 7ff9ce73bb80 1 --2- 172.21.15.37:0/3555168987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abb95cc0 0x5555abbb9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.897+0000 7ff99d7fa700 0 client.5553 ms_handle_reset on v2:172.21.15.191:6834/2931117635 2023-10-06T02:24:56.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.897+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/3555168987 >> 172.21.15.37:0/3555168987 conn(0x5555abb96160 msgr2=0x5555abb951b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.897+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/3555168987 shutdown_connections 2023-10-06T02:24:56.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.897+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/3555168987 wait complete. 2023-10-06T02:24:56.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.897+0000 7ff9ce73bb80 20 client.5553 trim_cache size 0 max 16384 2023-10-06T02:24:56.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.914+0000 7ff9ce73bb80 1 Processor -- start 2023-10-06T02:24:56.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.914+0000 7ff9ce73bb80 1 -- start start 2023-10-06T02:24:56.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9ce73bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 0x5555abbd1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9ce73bb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abb95cc0 0x5555abbd8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9ce73bb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abbe4c00 0x5555abb91670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9ce73bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555abbde100 con 0x5555abb94840 2023-10-06T02:24:56.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9ce73bb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555abbb97b0 con 0x5555abbe4c00 2023-10-06T02:24:56.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9ce73bb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555abbd7d50 con 0x5555abb95cc0 2023-10-06T02:24:56.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9beffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 0x5555abbd1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9beffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 0x5555abbd1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59080/0 (socket says 172.21.15.37:59080) 2023-10-06T02:24:56.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9beffd700 1 -- 172.21.15.37:0/1268492052 learned_addr learned my addr 172.21.15.37:0/1268492052 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:56.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9bf7fe700 1 --2- 172.21.15.37:0/1268492052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abbe4c00 0x5555abb91670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9be7fc700 1 --2- 172.21.15.37:0/1268492052 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abb95cc0 0x5555abbd8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9beffd700 1 -- 172.21.15.37:0/1268492052 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abb95cc0 msgr2=0x5555abbd8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9beffd700 1 --2- 172.21.15.37:0/1268492052 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abb95cc0 0x5555abbd8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9beffd700 1 -- 172.21.15.37:0/1268492052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abbe4c00 msgr2=0x5555abb91670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9beffd700 1 --2- 172.21.15.37:0/1268492052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abbe4c00 0x5555abb91670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9beffd700 1 -- 172.21.15.37:0/1268492052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555abab3780 con 0x5555abb94840 2023-10-06T02:24:56.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9bf7fe700 1 --2- 172.21.15.37:0/1268492052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abbe4c00 0x5555abb91670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:56.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9beffd700 1 --2- 172.21.15.37:0/1268492052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 0x5555abbd1700 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0007fd0 tx=0x7ff9b0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832db1934d15df97 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9a4ff9700 1 -- 172.21.15.37:0/1268492052 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b00223f0 con 0x5555abb94840 2023-10-06T02:24:56.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9a4ff9700 1 -- 172.21.15.37:0/1268492052 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b0022800 con 0x5555abb94840 2023-10-06T02:24:56.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.915+0000 7ff9a4ff9700 1 -- 172.21.15.37:0/1268492052 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0022b80 con 0x5555abb94840 2023-10-06T02:24:56.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.916+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/1268492052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 msgr2=0x5555abbd1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.916+0000 7ff9ce73bb80 1 --2- 172.21.15.37:0/1268492052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 0x5555abbd1700 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0007fd0 tx=0x7ff9b0019000 comp rx=0 tx=0).stop 2023-10-06T02:24:56.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.916+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/1268492052 shutdown_connections 2023-10-06T02:24:56.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.916+0000 7ff9ce73bb80 1 --2- 172.21.15.37:0/1268492052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abbe4c00 0x5555abb91670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.916+0000 7ff9ce73bb80 1 --2- 172.21.15.37:0/1268492052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 0x5555abbd1700 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.916+0000 7ff9ce73bb80 1 --2- 172.21.15.37:0/1268492052 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abb95cc0 0x5555abbd8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.916+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/1268492052 >> 172.21.15.37:0/1268492052 conn(0x5555abb96160 msgr2=0x5555abb951b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.916+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/1268492052 shutdown_connections 2023-10-06T02:24:56.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.916+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/1268492052 wait complete. 2023-10-06T02:24:56.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.916+0000 7ff9ce73bb80 1 -- start start 2023-10-06T02:24:56.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.917+0000 7ff9ce73bb80 1 Processor -- start 2023-10-06T02:24:56.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.917+0000 7ff9ce73bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 0x5555abc29b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.917+0000 7ff9ce73bb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abb95cc0 0x5555abb96960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.917+0000 7ff9ce73bb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abbe4c00 0x5555abc410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.917+0000 7ff9ce73bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555abb90ac0 con 0x5555abb94840 2023-10-06T02:24:56.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.917+0000 7ff9ce73bb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555abc44400 con 0x5555abbe4c00 2023-10-06T02:24:56.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.917+0000 7ff9ce73bb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555abc40c10 con 0x5555abb95cc0 2023-10-06T02:24:56.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff9ce73bb80 10 client.0 _ll_register_callbacks cb 0x5555abb57e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:24:56.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff9beffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 0x5555abc29b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff9beffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 0x5555abc29b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59082/0 (socket says 172.21.15.37:59082) 2023-10-06T02:24:56.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff9beffd700 1 -- 172.21.15.37:0/2404466380 learned_addr learned my addr 172.21.15.37:0/2404466380 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:56.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff9bf7fe700 1 --2- 172.21.15.37:0/2404466380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abbe4c00 0x5555abc410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff9be7fc700 1 --2- 172.21.15.37:0/2404466380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abb95cc0 0x5555abb96960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff9beffd700 1 -- 172.21.15.37:0/2404466380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abb95cc0 msgr2=0x5555abb96960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff9beffd700 1 --2- 172.21.15.37:0/2404466380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abb95cc0 0x5555abb96960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff9beffd700 1 -- 172.21.15.37:0/2404466380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abbe4c00 msgr2=0x5555abc410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:56.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff9beffd700 1 --2- 172.21.15.37:0/2404466380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abbe4c00 0x5555abc410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff9beffd700 1 -- 172.21.15.37:0/2404466380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5555ab921fe0 con 0x5555abb94840 2023-10-06T02:24:56.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff9bf7fe700 1 --2- 172.21.15.37:0/2404466380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abbe4c00 0x5555abc410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:56.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff9be7fc700 1 --2- 172.21.15.37:0/2404466380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abb95cc0 0x5555abb96960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:56.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff9beffd700 1 --2- 172.21.15.37:0/2404466380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 0x5555abc29b70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00165e0 tx=0x7ff9b0035040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212cebc713a3a1da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:56.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff99d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:24:56.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff99d7fa700 1 -- 172.21.15.37:0/2404466380 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b003d410 con 0x5555abb94840 2023-10-06T02:24:56.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff99d7fa700 1 -- 172.21.15.37:0/2404466380 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff9b003d570 con 0x5555abb94840 2023-10-06T02:24:56.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/2404466380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff9b800bc50 con 0x5555abb94840 2023-10-06T02:24:56.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff99d7fa700 1 -- 172.21.15.37:0/2404466380 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9b003d940 con 0x5555abb94840 2023-10-06T02:24:56.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff9ce73bb80 10 client.5559 fetch_fsmap learned FSMap version 23 2023-10-06T02:24:56.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/2404466380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5555aba9a470 con 0x5555abb94840 2023-10-06T02:24:56.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.918+0000 7ff99d7fa700 1 -- 172.21.15.37:0/2404466380 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b800bc50 con 0x5555abb94840 2023-10-06T02:24:56.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.919+0000 7ff99d7fa700 1 -- 172.21.15.37:0/2404466380 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff9b003daa0 con 0x5555abb94840 2023-10-06T02:24:56.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.919+0000 7ff9ce73bb80 10 client.5559 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T02:24:56.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.919+0000 7ff9ce73bb80 10 client.5559 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T02:24:56.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.919+0000 7ff9ce73bb80 20 client.5559 populate_metadata read hostname 'smithi037' 2023-10-06T02:24:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.919+0000 7ff9ce73bb80 1 --2- 172.21.15.37:0/2404466380 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x5555abc41740 0x5555abbdc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.919+0000 7ff9ce73bb80 4 client.5559 mds_command: new command op to 5400 tid=0[{"prefix": "status"}] 2023-10-06T02:24:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.919+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/2404466380 --> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5555aba87e00 con 0x5555abc41740 2023-10-06T02:24:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.919+0000 7ff9be7fc700 1 --2- 172.21.15.37:0/2404466380 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x5555abc41740 0x5555abbdc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.919+0000 7ff99d7fa700 10 client.5559 ms_handle_connect on v2:172.21.15.191:6834/2931117635 2023-10-06T02:24:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.919+0000 7ff9be7fc700 1 --2- 172.21.15.37:0/2404466380 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x5555abc41740 0x5555abbdc7c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=220681ffaa67f88e server_cookie=f1e508541f7b2e8a in_seq=0 out_seq=0 2023-10-06T02:24:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.919+0000 7ff99d7fa700 1 -- 172.21.15.37:0/2404466380 <== mds.0 v2:172.21.15.191:6834/2931117635 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5555aba87e00 con 0x5555abc41740 2023-10-06T02:24:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.919+0000 7ff99d7fa700 10 client.5559 handle_command_reply: tid=0 2023-10-06T02:24:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.919+0000 7ff9ce73bb80 1 client.5559 shutdown 2023-10-06T02:24:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/2404466380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 msgr2=0x5555abc29b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9ce73bb80 1 --2- 172.21.15.37:0/2404466380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 0x5555abc29b70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00165e0 tx=0x7ff9b0035040 comp rx=0 tx=0).stop 2023-10-06T02:24:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/2404466380 shutdown_connections 2023-10-06T02:24:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9ce73bb80 1 --2- 172.21.15.37:0/2404466380 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x5555abc41740 0x5555abbdc7c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9ce73bb80 1 --2- 172.21.15.37:0/2404466380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5555abbe4c00 0x5555abc410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff99d7fa700 0 client.5559 ms_handle_reset on v2:172.21.15.191:6834/2931117635 2023-10-06T02:24:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9ce73bb80 1 --2- 172.21.15.37:0/2404466380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555abb94840 0x5555abc29b70 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9ce73bb80 1 --2- 172.21.15.37:0/2404466380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5555abb95cc0 0x5555abb96960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/2404466380 >> 172.21.15.37:0/2404466380 conn(0x5555abb96160 msgr2=0x5555abbda5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/2404466380 shutdown_connections 2023-10-06T02:24:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9ce73bb80 1 -- 172.21.15.37:0/2404466380 wait complete. 2023-10-06T02:24:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9ce73bb80 20 client.5559 trim_cache size 0 max 16384 2023-10-06T02:24:56.932 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:24:56.932 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "d1f292a2-fd8c-430a-be88-f44de408e77c", 2023-10-06T02:24:56.932 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-10-06T02:24:56.932 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5400, 2023-10-06T02:24:56.932 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-10-06T02:24:56.932 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-10-06T02:24:56.932 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-10-06T02:24:56.933 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 5.9246170630000003, 2023-10-06T02:24:56.933 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 23, 2023-10-06T02:24:56.933 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 43, 2023-10-06T02:24:56.933 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 43, 2023-10-06T02:24:56.933 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 12.021904241 2023-10-06T02:24:56.933 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:24:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9c5443700 1 -- 172.21.15.37:0/1564296731 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff9ac066f30 msgr2=0x7ff9ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9c5443700 1 --2- 172.21.15.37:0/1564296731 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff9ac066f30 0x7ff9ac0693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff9c01578f0 tx=0x7ff9b0009800 comp rx=0 tx=0).stop 2023-10-06T02:24:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9c5443700 1 -- 172.21.15.37:0/1564296731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9c006de80 msgr2=0x7ff9c01696d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9c5443700 1 --2- 172.21.15.37:0/1564296731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9c006de80 0x7ff9c01696d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400b5e0 tx=0x7ff9b4009120 comp rx=0 tx=0).stop 2023-10-06T02:24:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9c5443700 1 -- 172.21.15.37:0/1564296731 shutdown_connections 2023-10-06T02:24:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9c5443700 1 --2- 172.21.15.37:0/1564296731 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff9ac066f30 0x7ff9ac0693e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9c5443700 1 --2- 172.21.15.37:0/1564296731 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9c00cb080 0x7ff9c0169c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9c5443700 1 --2- 172.21.15.37:0/1564296731 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9c006dab0 0x7ff9c0159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9c5443700 1 --2- 172.21.15.37:0/1564296731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9c006de80 0x7ff9c01696d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9c5443700 1 -- 172.21.15.37:0/1564296731 >> 172.21.15.37:0/1564296731 conn(0x7ff9c00d0510 msgr2=0x7ff9c00c6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9c5443700 1 -- 172.21.15.37:0/1564296731 shutdown_connections 2023-10-06T02:24:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:56.920+0000 7ff9c5443700 1 -- 172.21.15.37:0/1564296731 wait complete. 2023-10-06T02:24:56.936 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:24:57.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.056+0000 7f3c0e209700 1 Processor -- start 2023-10-06T02:24:57.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.056+0000 7f3c0e209700 1 -- start start 2023-10-06T02:24:57.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.057+0000 7f3c0e209700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3c080cf9f0 0x7f3c080cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.057+0000 7f3c0e209700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c080c5300 con 0x7f3c081596d0 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.057+0000 7f3c0e209700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c080c6160 con 0x7f3c08159aa0 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.057+0000 7f3c0e209700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c080d0370 con 0x7f3c080cf9f0 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.057+0000 7f3c07fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3c080cf9f0 0x7f3c080cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.057+0000 7f3c077fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3c081596d0 0x7f3c080b3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56568/0 (socket says 172.21.15.37:56568) 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.057+0000 7f3c07fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3c080cf9f0 0x7f3c080cfe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59096/0 (socket says 172.21.15.37:59096) 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.057+0000 7f3c077fe700 1 -- 172.21.15.37:0/2285166115 learned_addr learned my addr 172.21.15.37:0/2285166115 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.057+0000 7f3c07fff700 1 -- 172.21.15.37:0/2285166115 >> v1:172.21.15.191:6789/0 conn(0x7f3c08159aa0 legacy=0x7f3c080c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.057+0000 7f3c07fff700 1 -- 172.21.15.37:0/2285166115 >> v1:172.21.15.37:6789/0 conn(0x7f3c081596d0 legacy=0x7f3c080b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.057+0000 7f3c07fff700 1 -- 172.21.15.37:0/2285166115 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c080c5550 con 0x7f3c080cf9f0 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.057+0000 7f3c07fff700 1 --2- 172.21.15.37:0/2285166115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c080cf9f0 0x7f3c080cfe30 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009e60 tx=0x7f3c00009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a50e42da025ec5b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.057+0000 7f3c067fc700 1 -- 172.21.15.37:0/2285166115 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0000e070 con 0x7f3c080cf9f0 2023-10-06T02:24:57.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.057+0000 7f3c067fc700 1 -- 172.21.15.37:0/2285166115 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0000bbf0 con 0x7f3c080cf9f0 2023-10-06T02:24:57.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.057+0000 7f3c067fc700 1 -- 172.21.15.37:0/2285166115 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00012430 con 0x7f3c080cf9f0 2023-10-06T02:24:57.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.058+0000 7f3c0e209700 1 -- 172.21.15.37:0/2285166115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c080cf9f0 msgr2=0x7f3c080cfe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.058+0000 7f3c0e209700 1 --2- 172.21.15.37:0/2285166115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c080cf9f0 0x7f3c080cfe30 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009e60 tx=0x7f3c00009780 comp rx=0 tx=0).stop 2023-10-06T02:24:57.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.058+0000 7f3c0e209700 1 -- 172.21.15.37:0/2285166115 shutdown_connections 2023-10-06T02:24:57.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.058+0000 7f3c0e209700 1 --2- 172.21.15.37:0/2285166115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c080cf9f0 0x7f3c080cfe30 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.058+0000 7f3c0e209700 1 -- 172.21.15.37:0/2285166115 >> 172.21.15.37:0/2285166115 conn(0x7f3c0806c890 msgr2=0x7f3c080d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.058+0000 7f3c0e209700 1 -- 172.21.15.37:0/2285166115 shutdown_connections 2023-10-06T02:24:57.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.058+0000 7f3c0e209700 1 -- 172.21.15.37:0/2285166115 wait complete. 2023-10-06T02:24:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.059+0000 7f3c0e209700 1 Processor -- start 2023-10-06T02:24:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.059+0000 7f3c0e209700 1 -- start start 2023-10-06T02:24:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.060+0000 7f3c0e209700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3c080cf9f0 0x7f3c08152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.060+0000 7f3c0e209700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c081596d0 0x7f3c08159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.060+0000 7f3c0e209700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c08159aa0 0x7f3c0815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.060+0000 7f3c0e209700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c080b61a0 con 0x7f3c081596d0 2023-10-06T02:24:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.060+0000 7f3c0e209700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0815b6a0 con 0x7f3c08159aa0 2023-10-06T02:24:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.060+0000 7f3c0e209700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0815aa90 con 0x7f3c080cf9f0 2023-10-06T02:24:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.060+0000 7f3c06ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c081596d0 0x7f3c08159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.060+0000 7f3c06ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c081596d0 0x7f3c08159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59102/0 (socket says 172.21.15.37:59102) 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.060+0000 7f3c06ffd700 1 -- 172.21.15.37:0/2276580537 learned_addr learned my addr 172.21.15.37:0/2276580537 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.060+0000 7f3c077fe700 1 --2- 172.21.15.37:0/2276580537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3c080cf9f0 0x7f3c08152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.060+0000 7f3c07fff700 1 --2- 172.21.15.37:0/2276580537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c08159aa0 0x7f3c0815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.060+0000 7f3c06ffd700 1 -- 172.21.15.37:0/2276580537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3c080cf9f0 msgr2=0x7f3c08152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.060+0000 7f3c06ffd700 1 --2- 172.21.15.37:0/2276580537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3c080cf9f0 0x7f3c08152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.060+0000 7f3c06ffd700 1 -- 172.21.15.37:0/2276580537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c08159aa0 msgr2=0x7f3c0815a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.060+0000 7f3c06ffd700 1 --2- 172.21.15.37:0/2276580537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c08159aa0 0x7f3c0815a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.060+0000 7f3c06ffd700 1 -- 172.21.15.37:0/2276580537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c00009a20 con 0x7f3c081596d0 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.060+0000 7f3c07fff700 1 --2- 172.21.15.37:0/2276580537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c08159aa0 0x7f3c0815a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.060+0000 7f3c06ffd700 1 --2- 172.21.15.37:0/2276580537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c081596d0 0x7f3c08159eb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000c5d0 tx=0x7f3bf0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.061+0000 7f3bff7fe700 1 -- 172.21.15.37:0/2276580537 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0011590 con 0x7f3c081596d0 2023-10-06T02:24:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.061+0000 7f3bff7fe700 1 -- 172.21.15.37:0/2276580537 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf0011710 con 0x7f3c081596d0 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.061+0000 7f3c0e209700 1 -- 172.21.15.37:0/2276580537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0815ad70 con 0x7f3c081596d0 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.061+0000 7f3bff7fe700 1 -- 172.21.15.37:0/2276580537 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0011ad0 con 0x7f3c081596d0 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.061+0000 7f3c0e209700 1 -- 172.21.15.37:0/2276580537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0815b330 con 0x7f3c081596d0 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.062+0000 7f3c0e209700 1 -- 172.21.15.37:0/2276580537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0806fbf0 con 0x7f3c081596d0 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.062+0000 7f3bff7fe700 1 -- 172.21.15.37:0/2276580537 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bf001c460 con 0x7f3c081596d0 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.062+0000 7f3bff7fe700 1 --2- 172.21.15.37:0/2276580537 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3be8066f30 0x7f3be80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.062+0000 7f3bff7fe700 1 -- 172.21.15.37:0/2276580537 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3bf0084490 con 0x7f3c081596d0 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.063+0000 7f3c077fe700 1 --2- 172.21.15.37:0/2276580537 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3be8066f30 0x7f3be80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.063+0000 7f3c077fe700 1 --2- 172.21.15.37:0/2276580537 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3be8066f30 0x7f3be80693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3c0806e630 tx=0x7f3bf8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:57.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.067+0000 7f3bff7fe700 1 -- 172.21.15.37:0/2276580537 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bf00515a0 con 0x7f3c081596d0 2023-10-06T02:24:57.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.308+0000 7f3c0e209700 1 -- 172.21.15.37:0/2276580537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3c080d13e0 con 0x7f3c081596d0 2023-10-06T02:24:57.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.308+0000 7f3bff7fe700 1 -- 172.21.15.37:0/2276580537 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3bf0054bc0 con 0x7f3c081596d0 2023-10-06T02:24:57.309 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:24:57.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.310+0000 7f3c0e209700 1 -- 172.21.15.37:0/2276580537 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3be8066f30 msgr2=0x7f3be80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.310+0000 7f3c0e209700 1 --2- 172.21.15.37:0/2276580537 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3be8066f30 0x7f3be80693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3c0806e630 tx=0x7f3bf8009040 comp rx=0 tx=0).stop 2023-10-06T02:24:57.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.310+0000 7f3c0e209700 1 -- 172.21.15.37:0/2276580537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c081596d0 msgr2=0x7f3c08159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:57.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.310+0000 7f3c0e209700 1 --2- 172.21.15.37:0/2276580537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c081596d0 0x7f3c08159eb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000c5d0 tx=0x7f3bf0007f60 comp rx=0 tx=0).stop 2023-10-06T02:24:57.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.310+0000 7f3c0e209700 1 -- 172.21.15.37:0/2276580537 shutdown_connections 2023-10-06T02:24:57.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.310+0000 7f3c0e209700 1 --2- 172.21.15.37:0/2276580537 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3be8066f30 0x7f3be80693e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.310+0000 7f3c0e209700 1 --2- 172.21.15.37:0/2276580537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c08159aa0 0x7f3c0815a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.310+0000 7f3c0e209700 1 --2- 172.21.15.37:0/2276580537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3c080cf9f0 0x7f3c08152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.310+0000 7f3c0e209700 1 --2- 172.21.15.37:0/2276580537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c081596d0 0x7f3c08159eb0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:57.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.310+0000 7f3c0e209700 1 -- 172.21.15.37:0/2276580537 >> 172.21.15.37:0/2276580537 conn(0x7f3c0806c890 msgr2=0x7f3c0815d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:57.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.311+0000 7f3c0e209700 1 -- 172.21.15.37:0/2276580537 shutdown_connections 2023-10-06T02:24:57.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:57.311+0000 7f3c0e209700 1 -- 172.21.15.37:0/2276580537 wait complete. 2023-10-06T02:24:57.323 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:24:57.323 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:24:57.323 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-10-06T02:24:57.323 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:24:57.323 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:57.324 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:24:57.324 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:24:57.324 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:24:57.324 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:24:57.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:57.325 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-10-06T02:24:57.341 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:24:57.341 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:24:57.341 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:24:57.341 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:57.341 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T02:24:57.341 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:57.341 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:24:57.341 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:24:57.341 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-10-06T02:24:57.341 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:24:57.342 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:24:57.342 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-10-06T02:24:57.342 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:24:57.342 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42385sec preferred_lft 42385sec 2023-10-06T02:24:57.342 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-10-06T02:24:57.342 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:57.342 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:24:57.342 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:24:57.342 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-10-06T02:24:57.342 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:24:57.342 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:24:57.343 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-10-06T02:24:57.343 INFO:teuthology.orchestra.run.smithi037.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:24:57.343 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 26:84:4a:aa:8b:b5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:24:57.343 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:24:57.343 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:57.343 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::a0fb:38ff:fe90:57e1/64 scope link 2023-10-06T02:24:57.343 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:57.343 INFO:teuthology.orchestra.run.smithi037.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:24:57.343 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 36:fb:a9:50:59:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:24:57.343 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::34fb:a9ff:fe50:5976/64 scope link 2023-10-06T02:24:57.343 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:57.343 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:24:57.344 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 26:84:4a:aa:8b:b5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:24:57.344 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::2484:4aff:feaa:8bb5/64 scope link 2023-10-06T02:24:57.344 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:24:57.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:57.344 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:24:57.404 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T02:24:57.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:57.406 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-10-06T02:24:57.462 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-10-06T02:24:57.462 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:24:57.462 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:24:57.462 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:24:57.463 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:24:57.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:57.463 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T02:24:57.463 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T02:24:57.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:24:57.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:24:57.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:24:57.463 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T02:24:57.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:57.564 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T02:24:57.579 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:24:57.579 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:24:57.579 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:24:57.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:24:57.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-10-06T02:24:57.644 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:24:57.644 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:24:57.644 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:57.699 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:24:57.699 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:24:57.699 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:57.754 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T02:24:57.819 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:24:57.819 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:24:57.883 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:24:57.884 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:24:57.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:57.885 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T02:24:57.940 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:24:57.940 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:24:57.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T02:24:58.008 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:24:58.008 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:24:58.066 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-10-06T02:24:58.065+0000 7f846b587540 -1 init, newargv = 0x55ca045bc1c0 newargc=15 2023-10-06T02:24:58.066 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[106631]: starting ceph client 2023-10-06T02:24:58.071 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[106631]: starting fuse 2023-10-06T02:24:58.074 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:24:58.076 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:24:58.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:58.076 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T02:24:58.131 INFO:teuthology.orchestra.run.smithi037.stdout:46 2023-10-06T02:24:58.131 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T02:24:58.131 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:24:58.132 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-10-06T02:24:58.132 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-10-06T02:24:58.132 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:24:58.132 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-10-06T02:24:58.132 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:24:58.132 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-10-06T02:24:58.132 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:24:58.132 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-10-06T02:24:58.132 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:24:58.132 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:24:58.132 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-10-06T02:24:58.132 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-10-06T02:24:58.133 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-10-06T02:24:58.133 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-10-06T02:24:58.133 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:24:58.133 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-10-06T02:24:58.133 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:24:58.133 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:24:58.133 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:24:58.133 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-10-06T02:24:58.133 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-10-06T02:24:58.133 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-10-06T02:24:58.133 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:24:58.133 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:24:58.133 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-10-06T02:24:58.133 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:24:58.254 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.106631.asok 2023-10-06T02:24:58.436 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.106631.asok 2023-10-06T02:24:58.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:58.437 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.106631.asok status 2023-10-06T02:24:58.592 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:24:58.592 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-10-06T02:24:58.592 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:24:58.593 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:24:58.593 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-10-06T02:24:58.593 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-10-06T02:24:58.593 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:24:58.593 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "106631", 2023-10-06T02:24:58.593 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-10-06T02:24:58.593 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:58.593 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-10-06T02:24:58.593 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-10-06T02:24:58.593 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5574, 2023-10-06T02:24:58.593 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-10-06T02:24:58.593 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-10-06T02:24:58.594 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-10-06T02:24:58.594 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 5574 2023-10-06T02:24:58.594 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:58.594 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T02:24:58.594 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T02:24:58.594 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:24:58.594 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 4065343273 2023-10-06T02:24:58.594 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:58.594 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:58.594 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T02:24:58.594 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T02:24:58.594 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:24:58.595 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 4065343273 2023-10-06T02:24:58.595 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:58.595 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.5574 192.168.0.1:0/4065343273", 2023-10-06T02:24:58.595 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/4065343273", 2023-10-06T02:24:58.595 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-10-06T02:24:58.595 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 23, 2023-10-06T02:24:58.595 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 43, 2023-10-06T02:24:58.595 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:24:58.595 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-10-06T02:24:58.595 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-10-06T02:24:58.595 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:24:58.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:58.602 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-10-06T02:24:58.603 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:58.618 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-10-06T02:24:58.618 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:58.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:58.619 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:24:58.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:58.685 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2023-10-06T02:24:58.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:24:58.747 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2023-10-06T02:24:58.805 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:24:58.806 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:24:58.806 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:24:58.806 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:24:58.806 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2023-10-06T02:24:58.806 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:24:58.912 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627777 2023-10-06T02:24:59.101 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:24:59.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.260+0000 7f2d78dda700 1 Processor -- start 2023-10-06T02:24:59.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.260+0000 7f2d78dda700 1 -- start start 2023-10-06T02:24:59.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.261+0000 7f2d78dda700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2d740b17a0 0x7f2d74159040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.261+0000 7f2d78dda700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d740a8cf0 0x7f2d74159580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.261+0000 7f2d78dda700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d7415d1f0 con 0x7f2d740a8920 2023-10-06T02:24:59.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.261+0000 7f2d78dda700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d740b4150 con 0x7f2d740a8cf0 2023-10-06T02:24:59.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.261+0000 7f2d78dda700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d740b1ce0 con 0x7f2d740b17a0 2023-10-06T02:24:59.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.262+0000 7f2d72d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d740a8cf0 0x7f2d74159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.262+0000 7f2d72d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d740a8cf0 0x7f2d74159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59114/0 (socket says 172.21.15.37:59114) 2023-10-06T02:24:59.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.262+0000 7f2d72d9d700 1 -- 172.21.15.37:0/2549735196 learned_addr learned my addr 172.21.15.37:0/2549735196 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:59.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.262+0000 7f2d71d9b700 1 --2- 172.21.15.37:0/2549735196 >> v2:172.21.15.191:3300/0 conn(0x7f2d740b17a0 0x7f2d74159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.262+0000 7f2d72d9d700 1 -- 172.21.15.37:0/2549735196 >> v2:172.21.15.191:3300/0 conn(0x7f2d740b17a0 msgr2=0x7f2d74159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.262+0000 7f2d72d9d700 1 --2- 172.21.15.37:0/2549735196 >> v2:172.21.15.191:3300/0 conn(0x7f2d740b17a0 0x7f2d74159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.262+0000 7f2d72d9d700 1 -- 172.21.15.37:0/2549735196 >> v1:172.21.15.191:6789/0 conn(0x7f2d740a8920 legacy=0x7f2d740b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.262+0000 7f2d72d9d700 1 -- 172.21.15.37:0/2549735196 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7415dd70 con 0x7f2d740a8cf0 2023-10-06T02:24:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.262+0000 7f2d72d9d700 1 --2- 172.21.15.37:0/2549735196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740a8cf0 0x7f2d74159580 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2d74068b30 tx=0x7f2d64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69fdc5437f4f4ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.262+0000 7f2d7159a700 1 -- 172.21.15.37:0/2549735196 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6400e070 con 0x7f2d740a8cf0 2023-10-06T02:24:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.262+0000 7f2d7159a700 1 -- 172.21.15.37:0/2549735196 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6400b990 con 0x7f2d740a8cf0 2023-10-06T02:24:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.262+0000 7f2d7159a700 1 -- 172.21.15.37:0/2549735196 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d640092e0 con 0x7f2d740a8cf0 2023-10-06T02:24:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.263+0000 7f2d78dda700 1 -- 172.21.15.37:0/2549735196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740a8cf0 msgr2=0x7f2d74159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.263+0000 7f2d78dda700 1 --2- 172.21.15.37:0/2549735196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740a8cf0 0x7f2d74159580 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2d74068b30 tx=0x7f2d64009840 comp rx=0 tx=0).stop 2023-10-06T02:24:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.263+0000 7f2d78dda700 1 -- 172.21.15.37:0/2549735196 shutdown_connections 2023-10-06T02:24:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.263+0000 7f2d78dda700 1 --2- 172.21.15.37:0/2549735196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740a8cf0 0x7f2d74159580 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.263+0000 7f2d78dda700 1 --2- 172.21.15.37:0/2549735196 >> v2:172.21.15.191:3300/0 conn(0x7f2d740b17a0 0x7f2d74159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.263+0000 7f2d78dda700 1 -- 172.21.15.37:0/2549735196 >> 172.21.15.37:0/2549735196 conn(0x7f2d74067b30 msgr2=0x7f2d74067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.263+0000 7f2d78dda700 1 -- 172.21.15.37:0/2549735196 shutdown_connections 2023-10-06T02:24:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.263+0000 7f2d78dda700 1 -- 172.21.15.37:0/2549735196 wait complete. 2023-10-06T02:24:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.264+0000 7f2d78dda700 1 Processor -- start 2023-10-06T02:24:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.264+0000 7f2d78dda700 1 -- start start 2023-10-06T02:24:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d78dda700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d740a8920 0x7f2d741508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d78dda700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740a8cf0 0x7f2d7414ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d78dda700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d740b17a0 0x7f2d74154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d78dda700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d74150e20 con 0x7f2d740a8cf0 2023-10-06T02:24:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d78dda700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d74156bb0 con 0x7f2d740a8920 2023-10-06T02:24:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d78dda700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d74151060 con 0x7f2d740b17a0 2023-10-06T02:24:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d71d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740a8cf0 0x7f2d7414ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d71d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740a8cf0 0x7f2d7414ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59120/0 (socket says 172.21.15.37:59120) 2023-10-06T02:24:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d71d9b700 1 -- 172.21.15.37:0/2187813897 learned_addr learned my addr 172.21.15.37:0/2187813897 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d7259c700 1 --2- 172.21.15.37:0/2187813897 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d740a8920 0x7f2d741508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d72d9d700 1 --2- 172.21.15.37:0/2187813897 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d740b17a0 0x7f2d74154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d71d9b700 1 -- 172.21.15.37:0/2187813897 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d740b17a0 msgr2=0x7f2d74154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d71d9b700 1 --2- 172.21.15.37:0/2187813897 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d740b17a0 0x7f2d74154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d71d9b700 1 -- 172.21.15.37:0/2187813897 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d740a8920 msgr2=0x7f2d741508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d71d9b700 1 --2- 172.21.15.37:0/2187813897 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d740a8920 0x7f2d741508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d71d9b700 1 -- 172.21.15.37:0/2187813897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d64009ae0 con 0x7f2d740a8cf0 2023-10-06T02:24:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d72d9d700 1 --2- 172.21.15.37:0/2187813897 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d740b17a0 0x7f2d74154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:24:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d71d9b700 1 --2- 172.21.15.37:0/2187813897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740a8cf0 0x7f2d7414ef50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00e930 tx=0x7f2d5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d6a7fc700 1 -- 172.21.15.37:0/2187813897 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c00eed0 con 0x7f2d740a8cf0 2023-10-06T02:24:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d6a7fc700 1 -- 172.21.15.37:0/2187813897 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5c00c7f0 con 0x7f2d740a8cf0 2023-10-06T02:24:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.265+0000 7f2d78dda700 1 -- 172.21.15.37:0/2187813897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d74151340 con 0x7f2d740a8cf0 2023-10-06T02:24:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.266+0000 7f2d6a7fc700 1 -- 172.21.15.37:0/2187813897 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c00cb90 con 0x7f2d740a8cf0 2023-10-06T02:24:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.266+0000 7f2d78dda700 1 -- 172.21.15.37:0/2187813897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d74151900 con 0x7f2d740a8cf0 2023-10-06T02:24:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.266+0000 7f2d78dda700 1 -- 172.21.15.37:0/2187813897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d740b0ba0 con 0x7f2d740a8cf0 2023-10-06T02:24:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.267+0000 7f2d6a7fc700 1 -- 172.21.15.37:0/2187813897 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d5c013470 con 0x7f2d740a8cf0 2023-10-06T02:24:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.267+0000 7f2d6a7fc700 1 --2- 172.21.15.37:0/2187813897 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2d54066f30 0x7f2d540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.267+0000 7f2d6a7fc700 1 -- 172.21.15.37:0/2187813897 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2d5c084940 con 0x7f2d740a8cf0 2023-10-06T02:24:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.267+0000 7f2d7259c700 1 --2- 172.21.15.37:0/2187813897 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2d54066f30 0x7f2d540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.268+0000 7f2d7259c700 1 --2- 172.21.15.37:0/2187813897 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2d54066f30 0x7f2d540693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c003890 tx=0x7f2d6c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:59.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.272+0000 7f2d6a7fc700 1 -- 172.21.15.37:0/2187813897 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d5c0519b0 con 0x7f2d740a8cf0 2023-10-06T02:24:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.509+0000 7f2d78dda700 1 -- 172.21.15.37:0/2187813897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d74156cf0 con 0x7f2d740a8cf0 2023-10-06T02:24:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.509+0000 7f2d6a7fc700 1 -- 172.21.15.37:0/2187813897 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f2d5c054fd0 con 0x7f2d740a8cf0 2023-10-06T02:24:59.511 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:59.511 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2341182274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2341182274},{"type":"v1","addr":"172.21.15.191:6837","nonce":2341182274}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5385,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/562500386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":562500386},{"type":"v1","addr":"172.21.15.37:6834","nonce":562500386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1403086996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1403086996},{"type":"v1","addr":"172.21.15.37:6835","nonce":1403086996}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:50.379875+0000","modified":"2023-10-06T02:24:54.014513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5400":{"gid":5400,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6836/2931117635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2931117635},{"type":"v1","addr":"172.21.15.191:6836","nonce":2931117635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:24:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.512+0000 7f2d78dda700 1 -- 172.21.15.37:0/2187813897 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2d54066f30 msgr2=0x7f2d540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.512+0000 7f2d78dda700 1 --2- 172.21.15.37:0/2187813897 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2d54066f30 0x7f2d540693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c003890 tx=0x7f2d6c009040 comp rx=0 tx=0).stop 2023-10-06T02:24:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.512+0000 7f2d78dda700 1 -- 172.21.15.37:0/2187813897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740a8cf0 msgr2=0x7f2d7414ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.512+0000 7f2d78dda700 1 --2- 172.21.15.37:0/2187813897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740a8cf0 0x7f2d7414ef50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00e930 tx=0x7f2d5c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.512+0000 7f2d78dda700 1 -- 172.21.15.37:0/2187813897 shutdown_connections 2023-10-06T02:24:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.512+0000 7f2d78dda700 1 --2- 172.21.15.37:0/2187813897 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d740b17a0 0x7f2d74154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.512+0000 7f2d78dda700 1 --2- 172.21.15.37:0/2187813897 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2d54066f30 0x7f2d540693e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.512+0000 7f2d78dda700 1 --2- 172.21.15.37:0/2187813897 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d740a8920 0x7f2d741508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.512+0000 7f2d78dda700 1 --2- 172.21.15.37:0/2187813897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d740a8cf0 0x7f2d7414ef50 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.512+0000 7f2d78dda700 1 -- 172.21.15.37:0/2187813897 >> 172.21.15.37:0/2187813897 conn(0x7f2d74067b30 msgr2=0x7f2d740b0490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.512+0000 7f2d78dda700 1 -- 172.21.15.37:0/2187813897 shutdown_connections 2023-10-06T02:24:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.512+0000 7f2d78dda700 1 -- 172.21.15.37:0/2187813897 wait complete. 2023-10-06T02:24:59.515 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 23 2023-10-06T02:24:59.525 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2023-10-06T02:24:59.679 INFO:teuthology.orchestra.run.smithi191.stdout:{"message":"","return_code":0} 2023-10-06T02:24:59.679 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T02:24:59.679 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-10-06T02:24:59.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.717+0000 7fb894fcf000 1 Processor -- start 2023-10-06T02:24:59.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.717+0000 7fb894fcf000 1 -- start start 2023-10-06T02:24:59.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.718+0000 7fb894fcf000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55609674a9d0 0x556096775f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.718+0000 7fb894fcf000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55609674c8f0 0x55609681a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.718+0000 7fb894fcf000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556096777300 0x55609681c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.718+0000 7fb894fcf000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x556096694980 con 0x556096777300 2023-10-06T02:24:59.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.718+0000 7fb894fcf000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x556096694620 con 0x55609674a9d0 2023-10-06T02:24:59.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.718+0000 7fb894fcf000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55609668b400 con 0x55609674c8f0 2023-10-06T02:24:59.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.718+0000 7fb88ea0b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556096777300 0x55609681c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.718+0000 7fb88ea0b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556096777300 0x55609681c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59148/0 (socket says 172.21.15.37:59148) 2023-10-06T02:24:59.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.718+0000 7fb88ea0b700 1 -- 172.21.15.37:0/1682731705 learned_addr learned my addr 172.21.15.37:0/1682731705 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:59.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.718+0000 7fb88da09700 1 --2- 172.21.15.37:0/1682731705 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55609674c8f0 0x55609681a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.718+0000 7fb88e20a700 1 --2- 172.21.15.37:0/1682731705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55609674a9d0 0x556096775f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.718+0000 7fb88ea0b700 1 -- 172.21.15.37:0/1682731705 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55609674c8f0 msgr2=0x55609681a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:59.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.718+0000 7fb88ea0b700 1 --2- 172.21.15.37:0/1682731705 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55609674c8f0 0x55609681a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.718+0000 7fb88ea0b700 1 -- 172.21.15.37:0/1682731705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55609674a9d0 msgr2=0x556096775f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:59.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.718+0000 7fb88ea0b700 1 --2- 172.21.15.37:0/1682731705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55609674a9d0 0x556096775f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.718+0000 7fb88ea0b700 1 -- 172.21.15.37:0/1682731705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88800a180 con 0x556096777300 2023-10-06T02:24:59.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.719+0000 7fb88ea0b700 1 --2- 172.21.15.37:0/1682731705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556096777300 0x55609681c570 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb88800ad90 tx=0x7fb888015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3857c2f4b22276ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:59.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.719+0000 7fb88ca07700 1 -- 172.21.15.37:0/1682731705 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88800f680 con 0x556096777300 2023-10-06T02:24:59.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.719+0000 7fb88ca07700 1 -- 172.21.15.37:0/1682731705 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8880032f0 con 0x556096777300 2023-10-06T02:24:59.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.719+0000 7fb88ca07700 1 -- 172.21.15.37:0/1682731705 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb888005b30 con 0x556096777300 2023-10-06T02:24:59.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.719+0000 7fb894fcf000 1 -- 172.21.15.37:0/1682731705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556096777300 msgr2=0x55609681c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.719+0000 7fb894fcf000 1 --2- 172.21.15.37:0/1682731705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556096777300 0x55609681c570 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb88800ad90 tx=0x7fb888015000 comp rx=0 tx=0).stop 2023-10-06T02:24:59.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.719+0000 7fb894fcf000 1 -- 172.21.15.37:0/1682731705 shutdown_connections 2023-10-06T02:24:59.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.719+0000 7fb894fcf000 1 --2- 172.21.15.37:0/1682731705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556096777300 0x55609681c570 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.719+0000 7fb894fcf000 1 --2- 172.21.15.37:0/1682731705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55609674a9d0 0x556096775f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.719+0000 7fb894fcf000 1 --2- 172.21.15.37:0/1682731705 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55609674c8f0 0x55609681a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.719+0000 7fb894fcf000 1 -- 172.21.15.37:0/1682731705 >> 172.21.15.37:0/1682731705 conn(0x556096792af0 msgr2=0x556096748fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:59.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.719+0000 7fb894fcf000 1 -- 172.21.15.37:0/1682731705 shutdown_connections 2023-10-06T02:24:59.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.719+0000 7fb894fcf000 1 -- 172.21.15.37:0/1682731705 wait complete. 2023-10-06T02:24:59.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.720+0000 7fb894fcf000 1 Processor -- start 2023-10-06T02:24:59.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.720+0000 7fb894fcf000 1 -- start start 2023-10-06T02:24:59.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb894fcf000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55609674a9d0 0x556096748140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb894fcf000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55609674c8f0 0x556096748ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb894fcf000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x556096777300 0x5560968240e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb894fcf000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x556096816af0 con 0x55609674a9d0 2023-10-06T02:24:59.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb894fcf000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560967902a0 con 0x55609674c8f0 2023-10-06T02:24:59.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb894fcf000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x556096790540 con 0x556096777300 2023-10-06T02:24:59.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb88e20a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55609674a9d0 0x556096748140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb88e20a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55609674a9d0 0x556096748140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59164/0 (socket says 172.21.15.37:59164) 2023-10-06T02:24:59.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb88e20a700 1 -- 172.21.15.37:0/1220349216 learned_addr learned my addr 172.21.15.37:0/1220349216 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:59.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb88ea0b700 1 --2- 172.21.15.37:0/1220349216 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x556096777300 0x5560968240e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb88da09700 1 --2- 172.21.15.37:0/1220349216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55609674c8f0 0x556096748ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb88e20a700 1 -- 172.21.15.37:0/1220349216 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x556096777300 msgr2=0x5560968240e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb88e20a700 1 --2- 172.21.15.37:0/1220349216 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x556096777300 0x5560968240e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb88e20a700 1 -- 172.21.15.37:0/1220349216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55609674c8f0 msgr2=0x556096748ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb88e20a700 1 --2- 172.21.15.37:0/1220349216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55609674c8f0 0x556096748ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb88e20a700 1 -- 172.21.15.37:0/1220349216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560966bd1c0 con 0x55609674a9d0 2023-10-06T02:24:59.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb88e20a700 1 --2- 172.21.15.37:0/1220349216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55609674a9d0 0x556096748140 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb878003e10 tx=0x7fb878000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:59.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb886ffd700 1 -- 172.21.15.37:0/1220349216 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87800bd40 con 0x55609674a9d0 2023-10-06T02:24:59.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb886ffd700 1 -- 172.21.15.37:0/1220349216 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb878008040 con 0x55609674a9d0 2023-10-06T02:24:59.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb894fcf000 1 -- 172.21.15.37:0/1220349216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5560966a33d0 con 0x55609674a9d0 2023-10-06T02:24:59.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb886ffd700 1 -- 172.21.15.37:0/1220349216 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87800bea0 con 0x55609674a9d0 2023-10-06T02:24:59.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.721+0000 7fb894fcf000 1 -- 172.21.15.37:0/1220349216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556096696ae0 con 0x55609674a9d0 2023-10-06T02:24:59.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.723+0000 7fb886ffd700 1 -- 172.21.15.37:0/1220349216 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb878001610 con 0x55609674a9d0 2023-10-06T02:24:59.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.723+0000 7fb886ffd700 1 --2- 172.21.15.37:0/1220349216 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb8700658c0 0x7fb870067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.723+0000 7fb886ffd700 1 -- 172.21.15.37:0/1220349216 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb878083130 con 0x55609674a9d0 2023-10-06T02:24:59.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.723+0000 7fb88da09700 1 --2- 172.21.15.37:0/1220349216 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb8700658c0 0x7fb870067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.723+0000 7fb894fcf000 1 --2- 172.21.15.37:0/1220349216 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x556096819180 0x5560968179a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.723+0000 7fb894fcf000 1 -- 172.21.15.37:0/1220349216 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43) v8 -- 0x556096749400 con 0x556096819180 2023-10-06T02:24:59.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.724+0000 7fb88ea0b700 1 --2- 172.21.15.37:0/1220349216 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x556096819180 0x5560968179a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.724+0000 7fb88da09700 1 --2- 172.21.15.37:0/1220349216 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb8700658c0 0x7fb870067d70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb880009a30 tx=0x7fb880005bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:59.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.724+0000 7fb88ea0b700 1 --2- 172.21.15.37:0/1220349216 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x556096819180 0x5560968179a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:59.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.724+0000 7fb88ea0b700 1 -- 172.21.15.37:0/1220349216 <== osd.1 v2:172.21.15.37:6808/90617 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7fb888021030 con 0x556096819180 2023-10-06T02:24:59.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.724+0000 7fb894fcf000 1 -- 172.21.15.37:0/1220349216 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x556096819180 msgr2=0x5560968179a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.724+0000 7fb894fcf000 1 --2- 172.21.15.37:0/1220349216 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x556096819180 0x5560968179a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.724+0000 7fb894fcf000 1 -- 172.21.15.37:0/1220349216 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb8700658c0 msgr2=0x7fb870067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.724+0000 7fb894fcf000 1 --2- 172.21.15.37:0/1220349216 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb8700658c0 0x7fb870067d70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb880009a30 tx=0x7fb880005bc0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.724+0000 7fb894fcf000 1 -- 172.21.15.37:0/1220349216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55609674a9d0 msgr2=0x556096748140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.724+0000 7fb894fcf000 1 --2- 172.21.15.37:0/1220349216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55609674a9d0 0x556096748140 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb878003e10 tx=0x7fb878000bc0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.724+0000 7fb88ea0b700 1 -- 172.21.15.37:0/1220349216 reap_dead start 2023-10-06T02:24:59.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.724+0000 7fb894fcf000 1 -- 172.21.15.37:0/1220349216 shutdown_connections 2023-10-06T02:24:59.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.724+0000 7fb894fcf000 1 -- 172.21.15.37:0/1220349216 >> 172.21.15.37:0/1220349216 conn(0x556096792af0 msgr2=0x55609681a550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:59.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.724+0000 7fb894fcf000 1 -- 172.21.15.37:0/1220349216 shutdown_connections 2023-10-06T02:24:59.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.724+0000 7fb894fcf000 1 -- 172.21.15.37:0/1220349216 wait complete. 2023-10-06T02:24:59.731 INFO:teuthology.orchestra.run.smithi037.stdout:Yalphaparent_a 2023-10-06T02:24:59.732 DEBUG:teuthology.orchestra.run.smithi037:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-10-06T02:24:59.880 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:24:59.881 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 1099511627777, 2023-10-06T02:24:59.881 INFO:teuthology.orchestra.run.smithi037.stdout: "ancestors": [ 2023-10-06T02:24:59.881 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:59.881 INFO:teuthology.orchestra.run.smithi037.stdout: "dirino": 1099511627776, 2023-10-06T02:24:59.881 INFO:teuthology.orchestra.run.smithi037.stdout: "dname": "alpha", 2023-10-06T02:24:59.881 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 2 2023-10-06T02:24:59.881 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:24:59.881 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:24:59.881 INFO:teuthology.orchestra.run.smithi037.stdout: "dirino": 1, 2023-10-06T02:24:59.881 INFO:teuthology.orchestra.run.smithi037.stdout: "dname": "parent_a", 2023-10-06T02:24:59.881 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 4 2023-10-06T02:24:59.882 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:24:59.882 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-06T02:24:59.882 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 8, 2023-10-06T02:24:59.882 INFO:teuthology.orchestra.run.smithi037.stdout: "old_pools": [] 2023-10-06T02:24:59.882 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:24:59.882 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:24:59.883 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2023-10-06T02:24:59.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.921+0000 7ff0146f1000 1 Processor -- start 2023-10-06T02:24:59.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.921+0000 7ff0146f1000 1 -- start start 2023-10-06T02:24:59.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.922+0000 7ff0146f1000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5602bd116330 0x5602bd1ece10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.922+0000 7ff0146f1000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5602bd1ea010 0x5602bd1ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.922+0000 7ff0146f1000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602bd1ea3e0 0x5602bd1ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.922+0000 7ff0146f1000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602bd061980 con 0x5602bd1ea3e0 2023-10-06T02:24:59.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.922+0000 7ff0146f1000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602bd061620 con 0x5602bd116330 2023-10-06T02:24:59.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.922+0000 7ff0146f1000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5602bd058400 con 0x5602bd1ea010 2023-10-06T02:24:59.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.922+0000 7ff00e12d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602bd1ea3e0 0x5602bd1ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.922+0000 7ff00d12b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5602bd1ea010 0x5602bd1ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.922+0000 7ff00d92c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5602bd116330 0x5602bd1ece10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.922+0000 7ff00d12b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5602bd1ea010 0x5602bd1ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:58530/0 (socket says 172.21.15.37:58530) 2023-10-06T02:24:59.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.922+0000 7ff00d12b700 1 -- 172.21.15.37:0/731850089 learned_addr learned my addr 172.21.15.37:0/731850089 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:59.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.922+0000 7ff00e12d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602bd1ea3e0 0x5602bd1ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59190/0 (socket says 172.21.15.37:59190) 2023-10-06T02:24:59.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.923+0000 7ff00e12d700 1 -- 172.21.15.37:0/731850089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5602bd1ea010 msgr2=0x5602bd1ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:59.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.923+0000 7ff00e12d700 1 --2- 172.21.15.37:0/731850089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5602bd1ea010 0x5602bd1ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.923+0000 7ff00e12d700 1 -- 172.21.15.37:0/731850089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5602bd116330 msgr2=0x5602bd1ece10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:24:59.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.923+0000 7ff00e12d700 1 --2- 172.21.15.37:0/731850089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5602bd116330 0x5602bd1ece10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.923+0000 7ff00e12d700 1 -- 172.21.15.37:0/731850089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff004005db0 con 0x5602bd1ea3e0 2023-10-06T02:24:59.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.923+0000 7ff00d12b700 1 --2- 172.21.15.37:0/731850089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5602bd1ea010 0x5602bd1ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:24:59.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.923+0000 7ff00e12d700 1 --2- 172.21.15.37:0/731850089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602bd1ea3e0 0x5602bd1ce840 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff008001d40 tx=0x7ff0080017e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985730cd272fabb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:59.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.923+0000 7feffffff700 1 -- 172.21.15.37:0/731850089 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008014070 con 0x5602bd1ea3e0 2023-10-06T02:24:59.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.923+0000 7feffffff700 1 -- 172.21.15.37:0/731850089 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff008008070 con 0x5602bd1ea3e0 2023-10-06T02:24:59.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.923+0000 7feffffff700 1 -- 172.21.15.37:0/731850089 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008001ea0 con 0x5602bd1ea3e0 2023-10-06T02:24:59.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.923+0000 7ff0146f1000 1 -- 172.21.15.37:0/731850089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602bd1ea3e0 msgr2=0x5602bd1ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.923+0000 7ff0146f1000 1 --2- 172.21.15.37:0/731850089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602bd1ea3e0 0x5602bd1ce840 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff008001d40 tx=0x7ff0080017e0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.923+0000 7ff0146f1000 1 -- 172.21.15.37:0/731850089 shutdown_connections 2023-10-06T02:24:59.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.923+0000 7ff0146f1000 1 --2- 172.21.15.37:0/731850089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602bd1ea3e0 0x5602bd1ce840 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.923+0000 7ff0146f1000 1 --2- 172.21.15.37:0/731850089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5602bd116330 0x5602bd1ece10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.923+0000 7ff0146f1000 1 --2- 172.21.15.37:0/731850089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5602bd1ea010 0x5602bd1ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.923+0000 7ff0146f1000 1 -- 172.21.15.37:0/731850089 >> 172.21.15.37:0/731850089 conn(0x5602bd15fae0 msgr2=0x5602bd114610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:59.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.923+0000 7ff0146f1000 1 -- 172.21.15.37:0/731850089 shutdown_connections 2023-10-06T02:24:59.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.923+0000 7ff0146f1000 1 -- 172.21.15.37:0/731850089 wait complete. 2023-10-06T02:24:59.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.924+0000 7ff0146f1000 1 Processor -- start 2023-10-06T02:24:59.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.924+0000 7ff0146f1000 1 -- start start 2023-10-06T02:24:59.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.925+0000 7ff0146f1000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5602bd116330 0x5602bd1f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.925+0000 7ff0146f1000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602bd1ea010 0x5602bd1e6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.925+0000 7ff0146f1000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5602bd1ea3e0 0x5602bd1f0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.925+0000 7ff0146f1000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602bd1cddb0 con 0x5602bd1ea010 2023-10-06T02:24:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.925+0000 7ff0146f1000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602bd1f4fa0 con 0x5602bd1ea3e0 2023-10-06T02:24:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.925+0000 7ff0146f1000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5602bd1ce010 con 0x5602bd116330 2023-10-06T02:24:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.925+0000 7ff00d12b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602bd1ea010 0x5602bd1e6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.925+0000 7ff00d12b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602bd1ea010 0x5602bd1e6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59206/0 (socket says 172.21.15.37:59206) 2023-10-06T02:24:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.925+0000 7ff00d12b700 1 -- 172.21.15.37:0/1018851186 learned_addr learned my addr 172.21.15.37:0/1018851186 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:24:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.925+0000 7ff00d92c700 1 --2- 172.21.15.37:0/1018851186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5602bd116330 0x5602bd1f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.925+0000 7ff00e12d700 1 --2- 172.21.15.37:0/1018851186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5602bd1ea3e0 0x5602bd1f0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.925+0000 7ff00d12b700 1 -- 172.21.15.37:0/1018851186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5602bd116330 msgr2=0x5602bd1f2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.925+0000 7ff00d12b700 1 --2- 172.21.15.37:0/1018851186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5602bd116330 0x5602bd1f2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.925+0000 7ff00d12b700 1 -- 172.21.15.37:0/1018851186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5602bd1ea3e0 msgr2=0x5602bd1f0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.925+0000 7ff00d12b700 1 --2- 172.21.15.37:0/1018851186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5602bd1ea3e0 0x5602bd1f0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.925+0000 7ff00d12b700 1 -- 172.21.15.37:0/1018851186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602bd08a1c0 con 0x5602bd1ea010 2023-10-06T02:24:59.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.925+0000 7ff00d12b700 1 --2- 172.21.15.37:0/1018851186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602bd1ea010 0x5602bd1e6900 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff0040088e0 tx=0x7ff004019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:59.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.925+0000 7feffe7fc700 1 -- 172.21.15.37:0/1018851186 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff004008cc0 con 0x5602bd1ea010 2023-10-06T02:24:59.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.926+0000 7feffe7fc700 1 -- 172.21.15.37:0/1018851186 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff004022070 con 0x5602bd1ea010 2023-10-06T02:24:59.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.926+0000 7ff0146f1000 1 -- 172.21.15.37:0/1018851186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff00800a040 con 0x5602bd1ea010 2023-10-06T02:24:59.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.926+0000 7feffe7fc700 1 -- 172.21.15.37:0/1018851186 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff004027690 con 0x5602bd1ea010 2023-10-06T02:24:59.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.926+0000 7ff0146f1000 1 -- 172.21.15.37:0/1018851186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5602bd0703d0 con 0x5602bd1ea010 2023-10-06T02:24:59.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.927+0000 7feffe7fc700 1 -- 172.21.15.37:0/1018851186 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff004024030 con 0x5602bd1ea010 2023-10-06T02:24:59.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.927+0000 7feffe7fc700 1 --2- 172.21.15.37:0/1018851186 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7feff0065890 0x7feff0067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.927+0000 7feffe7fc700 1 -- 172.21.15.37:0/1018851186 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff004086690 con 0x5602bd1ea010 2023-10-06T02:24:59.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.927+0000 7ff00d92c700 1 --2- 172.21.15.37:0/1018851186 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7feff0065890 0x7feff0067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.927+0000 7ff0146f1000 1 --2- 172.21.15.37:0/1018851186 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5602bd1f4af0 0x5602bd205ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:24:59.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.927+0000 7ff0146f1000 1 -- 172.21.15.37:0/1018851186 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43) v8 -- 0x5602bd1cf760 con 0x5602bd1f4af0 2023-10-06T02:24:59.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.928+0000 7ff00e12d700 1 --2- 172.21.15.37:0/1018851186 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5602bd1f4af0 0x5602bd205ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:24:59.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.928+0000 7ff00d92c700 1 --2- 172.21.15.37:0/1018851186 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7feff0065890 0x7feff0067d40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff00000ad70 tx=0x7ff000007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:59.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.928+0000 7ff00e12d700 1 --2- 172.21.15.37:0/1018851186 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5602bd1f4af0 0x5602bd205ea0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:24:59.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.929+0000 7ff00e12d700 1 -- 172.21.15.37:0/1018851186 <== osd.1 v2:172.21.15.37:6808/90617 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v43'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7ff008016070 con 0x5602bd1f4af0 2023-10-06T02:24:59.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.929+0000 7ff0146f1000 1 -- 172.21.15.37:0/1018851186 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5602bd1f4af0 msgr2=0x5602bd205ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.929+0000 7ff0146f1000 1 --2- 172.21.15.37:0/1018851186 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5602bd1f4af0 0x5602bd205ea0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:24:59.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.929+0000 7ff0146f1000 1 -- 172.21.15.37:0/1018851186 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7feff0065890 msgr2=0x7feff0067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.929+0000 7ff0146f1000 1 --2- 172.21.15.37:0/1018851186 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7feff0065890 0x7feff0067d40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff00000ad70 tx=0x7ff000007040 comp rx=0 tx=0).stop 2023-10-06T02:24:59.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.929+0000 7ff0146f1000 1 -- 172.21.15.37:0/1018851186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602bd1ea010 msgr2=0x5602bd1e6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:24:59.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.929+0000 7ff0146f1000 1 --2- 172.21.15.37:0/1018851186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602bd1ea010 0x5602bd1e6900 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff0040088e0 tx=0x7ff004019000 comp rx=0 tx=0).stop 2023-10-06T02:24:59.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.929+0000 7ff00e12d700 1 -- 172.21.15.37:0/1018851186 reap_dead start 2023-10-06T02:24:59.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.929+0000 7ff0146f1000 1 -- 172.21.15.37:0/1018851186 shutdown_connections 2023-10-06T02:24:59.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.929+0000 7ff0146f1000 1 -- 172.21.15.37:0/1018851186 >> 172.21.15.37:0/1018851186 conn(0x5602bd15fae0 msgr2=0x5602bd160600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:24:59.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.929+0000 7ff0146f1000 1 -- 172.21.15.37:0/1018851186 shutdown_connections 2023-10-06T02:24:59.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:24:59.929+0000 7ff0146f1000 1 -- 172.21.15.37:0/1018851186 wait complete. 2023-10-06T02:24:59.936 DEBUG:teuthology.orchestra.run.smithi037:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-06T02:24:59.978 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2023-10-06T02:25:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.101+0000 7f64ca463700 1 Processor -- start 2023-10-06T02:25:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.101+0000 7f64ca463700 1 -- start start 2023-10-06T02:25:00.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.102+0000 7f64ca463700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f64c4142f70 0x7f64c40b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.102+0000 7f64ca463700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64c4143340 0x7f64c4067990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.102+0000 7f64ca463700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64c4067ed0 0x7f64c4068ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.102+0000 7f64ca463700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c4068370 con 0x7f64c4143340 2023-10-06T02:25:00.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.102+0000 7f64ca463700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c415e3f0 con 0x7f64c4142f70 2023-10-06T02:25:00.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.102+0000 7f64ca463700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40b13c0 con 0x7f64c4067ed0 2023-10-06T02:25:00.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.102+0000 7f64c37fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64c4143340 0x7f64c4067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.102+0000 7f64c37fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64c4143340 0x7f64c4067990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59216/0 (socket says 172.21.15.37:59216) 2023-10-06T02:25:00.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.102+0000 7f64c37fe700 1 -- 172.21.15.37:0/1885412900 learned_addr learned my addr 172.21.15.37:0/1885412900 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:00.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.102+0000 7f64c3fff700 1 --2- 172.21.15.37:0/1885412900 >> v2:172.21.15.191:3300/0 conn(0x7f64c4142f70 0x7f64c40b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.102+0000 7f64c8a00700 1 --2- 172.21.15.37:0/1885412900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64c4067ed0 0x7f64c4068ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.102+0000 7f64c37fe700 1 -- 172.21.15.37:0/1885412900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64c4067ed0 msgr2=0x7f64c4068ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.102+0000 7f64c37fe700 1 --2- 172.21.15.37:0/1885412900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64c4067ed0 0x7f64c4068ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.102+0000 7f64c37fe700 1 -- 172.21.15.37:0/1885412900 >> v2:172.21.15.191:3300/0 conn(0x7f64c4142f70 msgr2=0x7f64c40b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.102+0000 7f64c37fe700 1 --2- 172.21.15.37:0/1885412900 >> v2:172.21.15.191:3300/0 conn(0x7f64c4142f70 0x7f64c40b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.102+0000 7f64c37fe700 1 -- 172.21.15.37:0/1885412900 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c415d7e0 con 0x7f64c4143340 2023-10-06T02:25:00.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.102+0000 7f64c37fe700 1 --2- 172.21.15.37:0/1885412900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c4143340 0x7f64c4067990 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f64c40b0d70 tx=0x7f64b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941571c1476b49e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:00.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.102+0000 7f64c2ffd700 1 -- 172.21.15.37:0/1885412900 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b800b640 con 0x7f64c4143340 2023-10-06T02:25:00.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.103+0000 7f64c2ffd700 1 -- 172.21.15.37:0/1885412900 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b800b7a0 con 0x7f64c4143340 2023-10-06T02:25:00.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.103+0000 7f64c2ffd700 1 -- 172.21.15.37:0/1885412900 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b800bb60 con 0x7f64c4143340 2023-10-06T02:25:00.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.103+0000 7f64ca463700 1 -- 172.21.15.37:0/1885412900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c4143340 msgr2=0x7f64c4067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.103+0000 7f64ca463700 1 --2- 172.21.15.37:0/1885412900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c4143340 0x7f64c4067990 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f64c40b0d70 tx=0x7f64b8009250 comp rx=0 tx=0).stop 2023-10-06T02:25:00.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.103+0000 7f64ca463700 1 -- 172.21.15.37:0/1885412900 shutdown_connections 2023-10-06T02:25:00.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.103+0000 7f64ca463700 1 --2- 172.21.15.37:0/1885412900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64c4067ed0 0x7f64c4068ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.103+0000 7f64ca463700 1 --2- 172.21.15.37:0/1885412900 >> v2:172.21.15.191:3300/0 conn(0x7f64c4142f70 0x7f64c40b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.103+0000 7f64ca463700 1 --2- 172.21.15.37:0/1885412900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c4143340 0x7f64c4067990 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.103+0000 7f64ca463700 1 -- 172.21.15.37:0/1885412900 >> 172.21.15.37:0/1885412900 conn(0x7f64c40ce360 msgr2=0x7f64c40ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:00.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.103+0000 7f64ca463700 1 -- 172.21.15.37:0/1885412900 shutdown_connections 2023-10-06T02:25:00.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.103+0000 7f64ca463700 1 -- 172.21.15.37:0/1885412900 wait complete. 2023-10-06T02:25:00.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.105+0000 7f64ca463700 1 Processor -- start 2023-10-06T02:25:00.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.105+0000 7f64ca463700 1 -- start start 2023-10-06T02:25:00.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.106+0000 7f64ca463700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64c4067ed0 0x7f64c41590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.107+0000 7f64ca463700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c4142f70 0x7f64c40aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.107+0000 7f64ca463700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64c4143340 0x7f64c40af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.107+0000 7f64ca463700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40c75b0 con 0x7f64c4142f70 2023-10-06T02:25:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.107+0000 7f64ca463700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40c85e0 con 0x7f64c4067ed0 2023-10-06T02:25:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.107+0000 7f64ca463700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40c7820 con 0x7f64c4143340 2023-10-06T02:25:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.107+0000 7f64c37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c4142f70 0x7f64c40aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.107+0000 7f64c37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c4142f70 0x7f64c40aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59228/0 (socket says 172.21.15.37:59228) 2023-10-06T02:25:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.107+0000 7f64c37fe700 1 -- 172.21.15.37:0/3191020488 learned_addr learned my addr 172.21.15.37:0/3191020488 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.107+0000 7f64c3fff700 1 --2- 172.21.15.37:0/3191020488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64c4067ed0 0x7f64c41590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.107+0000 7f64c8a00700 1 --2- 172.21.15.37:0/3191020488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64c4143340 0x7f64c40af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.107+0000 7f64c37fe700 1 -- 172.21.15.37:0/3191020488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64c4143340 msgr2=0x7f64c40af4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.107+0000 7f64c37fe700 1 --2- 172.21.15.37:0/3191020488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64c4143340 0x7f64c40af4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.107+0000 7f64c37fe700 1 -- 172.21.15.37:0/3191020488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64c4067ed0 msgr2=0x7f64c41590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.107+0000 7f64c37fe700 1 --2- 172.21.15.37:0/3191020488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64c4067ed0 0x7f64c41590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.107+0000 7f64c37fe700 1 -- 172.21.15.37:0/3191020488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b80094f0 con 0x7f64c4142f70 2023-10-06T02:25:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.107+0000 7f64c37fe700 1 --2- 172.21.15.37:0/3191020488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c4142f70 0x7f64c40aef70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f64c40b0e20 tx=0x7f64b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.107+0000 7f64abfff700 1 -- 172.21.15.37:0/3191020488 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b800b910 con 0x7f64c4142f70 2023-10-06T02:25:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.108+0000 7f64abfff700 1 -- 172.21.15.37:0/3191020488 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b800ba70 con 0x7f64c4142f70 2023-10-06T02:25:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.108+0000 7f64ca463700 1 -- 172.21.15.37:0/3191020488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c40c7b00 con 0x7f64c4142f70 2023-10-06T02:25:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.108+0000 7f64abfff700 1 -- 172.21.15.37:0/3191020488 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8011630 con 0x7f64c4142f70 2023-10-06T02:25:00.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.108+0000 7f64ca463700 1 -- 172.21.15.37:0/3191020488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c40c80c0 con 0x7f64c4142f70 2023-10-06T02:25:00.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.109+0000 7f64abfff700 1 -- 172.21.15.37:0/3191020488 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64b80119a0 con 0x7f64c4142f70 2023-10-06T02:25:00.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.110+0000 7f64abfff700 1 --2- 172.21.15.37:0/3191020488 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f64b0066f30 0x7f64b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.110+0000 7f64abfff700 1 -- 172.21.15.37:0/3191020488 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f64b8085c90 con 0x7f64c4142f70 2023-10-06T02:25:00.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.110+0000 7f64c3fff700 1 --2- 172.21.15.37:0/3191020488 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f64b0066f30 0x7f64b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.110+0000 7f64c3fff700 1 --2- 172.21.15.37:0/3191020488 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f64b0066f30 0x7f64b00693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009d90 tx=0x7f64b40091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:00.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.111+0000 7f64d375bb80 1 Processor -- start 2023-10-06T02:25:00.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.112+0000 7f64d375bb80 1 -- start start 2023-10-06T02:25:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.112+0000 7f64d375bb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d043e910 0x55e0d043ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.112+0000 7f64d375bb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e0d043fd90 0x55e0d048e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.112+0000 7f64d375bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d048ecd0 0x55e0d048f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.112+0000 7f64d375bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d0395b40 con 0x55e0d048ecd0 2023-10-06T02:25:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.112+0000 7f64d375bb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d0393340 con 0x55e0d043e910 2023-10-06T02:25:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.112+0000 7f64d375bb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0d038f130 con 0x55e0d043fd90 2023-10-06T02:25:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.113+0000 7f64c8a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d048ecd0 0x55e0d048f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.113+0000 7f64c3fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d043e910 0x55e0d043ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.113+0000 7f64c3fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d043e910 0x55e0d043ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:50884/0 (socket says 172.21.15.37:50884) 2023-10-06T02:25:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.113+0000 7f64c8a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d048ecd0 0x55e0d048f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59232/0 (socket says 172.21.15.37:59232) 2023-10-06T02:25:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.113+0000 7f64c8a00700 1 -- 172.21.15.37:0/989390705 learned_addr learned my addr 172.21.15.37:0/989390705 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:00.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.113+0000 7f64c37fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e0d043fd90 0x55e0d048e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.113+0000 7f64c3fff700 1 -- 172.21.15.37:0/989390705 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e0d043fd90 msgr2=0x55e0d048e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.113+0000 7f64c3fff700 1 --2- 172.21.15.37:0/989390705 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e0d043fd90 0x55e0d048e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.113+0000 7f64c3fff700 1 -- 172.21.15.37:0/989390705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d048ecd0 msgr2=0x55e0d048f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.113+0000 7f64c3fff700 1 --2- 172.21.15.37:0/989390705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d048ecd0 0x55e0d048f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.113+0000 7f64c3fff700 1 -- 172.21.15.37:0/989390705 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0d0229340 con 0x55e0d043e910 2023-10-06T02:25:00.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.113+0000 7f64c8a00700 1 --2- 172.21.15.37:0/989390705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d048ecd0 0x55e0d048f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:25:00.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.113+0000 7f64c3fff700 1 --2- 172.21.15.37:0/989390705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d043e910 0x55e0d043ece0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f64b4011de0 tx=0x7f64b4016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d42f693998b1d94 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:00.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.113+0000 7f64a97fa700 1 -- 172.21.15.37:0/989390705 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4014bb0 con 0x55e0d043e910 2023-10-06T02:25:00.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.113+0000 7f64a97fa700 1 -- 172.21.15.37:0/989390705 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b4014d10 con 0x55e0d043e910 2023-10-06T02:25:00.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.113+0000 7f64a97fa700 1 -- 172.21.15.37:0/989390705 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4021630 con 0x55e0d043e910 2023-10-06T02:25:00.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.114+0000 7f64d375bb80 1 -- 172.21.15.37:0/989390705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d043e910 msgr2=0x55e0d043ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.114+0000 7f64d375bb80 1 --2- 172.21.15.37:0/989390705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d043e910 0x55e0d043ece0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f64b4011de0 tx=0x7f64b4016000 comp rx=0 tx=0).stop 2023-10-06T02:25:00.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.114+0000 7f64d375bb80 1 -- 172.21.15.37:0/989390705 shutdown_connections 2023-10-06T02:25:00.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.114+0000 7f64d375bb80 1 --2- 172.21.15.37:0/989390705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d048ecd0 0x55e0d048f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.114+0000 7f64d375bb80 1 --2- 172.21.15.37:0/989390705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d043e910 0x55e0d043ece0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.114+0000 7f64d375bb80 1 --2- 172.21.15.37:0/989390705 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e0d043fd90 0x55e0d048e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.114+0000 7f64d375bb80 1 -- 172.21.15.37:0/989390705 >> 172.21.15.37:0/989390705 conn(0x55e0d0440230 msgr2=0x55e0d0440600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.114+0000 7f64d375bb80 1 -- 172.21.15.37:0/989390705 shutdown_connections 2023-10-06T02:25:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.114+0000 7f64d375bb80 1 -- 172.21.15.37:0/989390705 wait complete. 2023-10-06T02:25:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.115+0000 7f64d375bb80 1 -- start start 2023-10-06T02:25:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.115+0000 7f64d375bb80 1 Processor -- start 2023-10-06T02:25:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64d375bb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e0d043e910 0x55e0d0497d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64d375bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d043fd90 0x55e0d0495870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64d375bb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d048ecd0 0x55e0d0439ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64d375bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d033a960 con 0x55e0d043fd90 2023-10-06T02:25:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64d375bb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d0355f70 con 0x55e0d048ecd0 2023-10-06T02:25:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64d375bb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0d0211f00 con 0x55e0d043e910 2023-10-06T02:25:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64d375bb80 10 client.0 _ll_register_callbacks cb 0x55e0d0401f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:25:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64c37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d043fd90 0x55e0d0495870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64c37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d043fd90 0x55e0d0495870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59236/0 (socket says 172.21.15.37:59236) 2023-10-06T02:25:00.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64c37fe700 1 -- 172.21.15.37:0/636634656 learned_addr learned my addr 172.21.15.37:0/636634656 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:00.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64c3fff700 1 --2- 172.21.15.37:0/636634656 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e0d043e910 0x55e0d0497d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64c8a00700 1 --2- 172.21.15.37:0/636634656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d048ecd0 0x55e0d0439ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64c37fe700 1 -- 172.21.15.37:0/636634656 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e0d043e910 msgr2=0x55e0d0497d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64c37fe700 1 --2- 172.21.15.37:0/636634656 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e0d043e910 0x55e0d0497d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64c37fe700 1 -- 172.21.15.37:0/636634656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d048ecd0 msgr2=0x55e0d0439ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64c37fe700 1 --2- 172.21.15.37:0/636634656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d048ecd0 0x55e0d0439ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64c37fe700 1 -- 172.21.15.37:0/636634656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64bc011250 con 0x55e0d043fd90 2023-10-06T02:25:00.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64c37fe700 1 --2- 172.21.15.37:0/636634656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d043fd90 0x55e0d0495870 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009f70 tx=0x7f64b8003040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41fbba0ae32136f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:00.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64a27fc700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:25:00.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64a27fc700 1 -- 172.21.15.37:0/636634656 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8059cb0 con 0x55e0d043fd90 2023-10-06T02:25:00.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64a27fc700 1 -- 172.21.15.37:0/636634656 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f64b805da00 con 0x55e0d043fd90 2023-10-06T02:25:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.116+0000 7f64d375bb80 1 -- 172.21.15.37:0/636634656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0d0433a10 con 0x55e0d043fd90 2023-10-06T02:25:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.117+0000 7f64a27fc700 1 -- 172.21.15.37:0/636634656 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64b8056160 con 0x55e0d043fd90 2023-10-06T02:25:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.117+0000 7f64d375bb80 10 client.5610 fetch_fsmap learned FSMap version 23 2023-10-06T02:25:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.117+0000 7f64d375bb80 1 -- 172.21.15.37:0/636634656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x7f64b4011a90 con 0x55e0d043fd90 2023-10-06T02:25:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.117+0000 7f64a27fc700 1 -- 172.21.15.37:0/636634656 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e0d0433a10 con 0x55e0d043fd90 2023-10-06T02:25:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.117+0000 7f64a27fc700 1 -- 172.21.15.37:0/636634656 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f64b806a030 con 0x55e0d043fd90 2023-10-06T02:25:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.117+0000 7f64d375bb80 10 client.5610 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T02:25:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.117+0000 7f64d375bb80 10 client.5610 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2023-10-06T02:25:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.117+0000 7f64d375bb80 20 client.5610 populate_metadata read hostname 'smithi037' 2023-10-06T02:25:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.117+0000 7f64d375bb80 1 --2- 172.21.15.37:0/636634656 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55e0d04863f0 0x55e0d04867f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.117+0000 7f64d375bb80 4 client.5610 mds_command: new command op to 5400 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:25:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.117+0000 7f64d375bb80 1 -- 172.21.15.37:0/636634656 --> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0d0410940 con 0x55e0d04863f0 2023-10-06T02:25:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.117+0000 7f64c3fff700 1 --2- 172.21.15.37:0/636634656 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55e0d04863f0 0x55e0d04867f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.117+0000 7f64a27fc700 10 client.5610 ms_handle_connect on v2:172.21.15.191:6834/2931117635 2023-10-06T02:25:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.117+0000 7f64c3fff700 1 --2- 172.21.15.37:0/636634656 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55e0d04863f0 0x55e0d04867f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6c3cb3005961b21 server_cookie=4556936e58793584 in_seq=0 out_seq=0 2023-10-06T02:25:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.118+0000 7f64a27fc700 1 -- 172.21.15.37:0/636634656 <== mds.0 v2:172.21.15.191:6834/2931117635 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e0d0410940 con 0x55e0d04863f0 2023-10-06T02:25:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.118+0000 7f64a27fc700 10 client.5610 handle_command_reply: tid=0 2023-10-06T02:25:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.118+0000 7f64d375bb80 1 client.5610 shutdown 2023-10-06T02:25:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.118+0000 7f64d375bb80 1 -- 172.21.15.37:0/636634656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d043fd90 msgr2=0x55e0d0495870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.118+0000 7f64d375bb80 1 --2- 172.21.15.37:0/636634656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d043fd90 0x55e0d0495870 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009f70 tx=0x7f64b8003040 comp rx=0 tx=0).stop 2023-10-06T02:25:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.118+0000 7f64d375bb80 1 -- 172.21.15.37:0/636634656 shutdown_connections 2023-10-06T02:25:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.118+0000 7f64d375bb80 1 --2- 172.21.15.37:0/636634656 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55e0d04863f0 0x55e0d04867f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.118+0000 7f64d375bb80 1 --2- 172.21.15.37:0/636634656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d048ecd0 0x55e0d0439ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.118+0000 7f64d375bb80 1 --2- 172.21.15.37:0/636634656 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e0d043e910 0x55e0d0497d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.118+0000 7f64a27fc700 0 client.5610 ms_handle_reset on v2:172.21.15.191:6834/2931117635 2023-10-06T02:25:00.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.118+0000 7f64d375bb80 1 --2- 172.21.15.37:0/636634656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d043fd90 0x55e0d0495870 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.118+0000 7f64d375bb80 1 -- 172.21.15.37:0/636634656 >> 172.21.15.37:0/636634656 conn(0x55e0d0440230 msgr2=0x55e0d043f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:00.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.118+0000 7f64d375bb80 1 -- 172.21.15.37:0/636634656 shutdown_connections 2023-10-06T02:25:00.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.118+0000 7f64d375bb80 1 -- 172.21.15.37:0/636634656 wait complete. 2023-10-06T02:25:00.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.118+0000 7f64d375bb80 20 client.5610 trim_cache size 0 max 16384 2023-10-06T02:25:00.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.126+0000 7fef49bfa700 1 Processor -- start 2023-10-06T02:25:00.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.126+0000 7fef49bfa700 1 -- start start 2023-10-06T02:25:00.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.127+0000 7fef49bfa700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fef44159620 0x7fef440ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.127+0000 7fef49bfa700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef441599f0 0x7fef440cb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.127+0000 7fef49bfa700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef440ccb50 con 0x7fef440cbba0 2023-10-06T02:25:00.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.127+0000 7fef49bfa700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef4415a1c0 con 0x7fef441599f0 2023-10-06T02:25:00.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.127+0000 7fef49bfa700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef4415a4a0 con 0x7fef44159620 2023-10-06T02:25:00.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.127+0000 7fef42ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef441599f0 0x7fef440cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.127+0000 7fef42ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef441599f0 0x7fef440cb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59250/0 (socket says 172.21.15.37:59250) 2023-10-06T02:25:00.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.127+0000 7fef42ffd700 1 -- 172.21.15.37:0/2601516406 learned_addr learned my addr 172.21.15.37:0/2601516406 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:00.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.127+0000 7fef437fe700 1 --2- 172.21.15.37:0/2601516406 >> v2:172.21.15.191:3300/0 conn(0x7fef44159620 0x7fef440ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.127+0000 7fef42ffd700 1 -- 172.21.15.37:0/2601516406 >> v2:172.21.15.191:3300/0 conn(0x7fef44159620 msgr2=0x7fef440ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.127+0000 7fef42ffd700 1 --2- 172.21.15.37:0/2601516406 >> v2:172.21.15.191:3300/0 conn(0x7fef44159620 0x7fef440ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.127+0000 7fef42ffd700 1 -- 172.21.15.37:0/2601516406 >> v1:172.21.15.191:6789/0 conn(0x7fef440cbba0 legacy=0x7fef440d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.127+0000 7fef42ffd700 1 -- 172.21.15.37:0/2601516406 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4415a780 con 0x7fef441599f0 2023-10-06T02:25:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.128+0000 7fef42ffd700 1 --2- 172.21.15.37:0/2601516406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef441599f0 0x7fef440cb660 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fef4406e8a0 tx=0x7fef34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e47dd2387187f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.128+0000 7fef427fc700 1 -- 172.21.15.37:0/2601516406 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef34009e70 con 0x7fef441599f0 2023-10-06T02:25:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.128+0000 7fef427fc700 1 -- 172.21.15.37:0/2601516406 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3400b860 con 0x7fef441599f0 2023-10-06T02:25:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.128+0000 7fef427fc700 1 -- 172.21.15.37:0/2601516406 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3400bc00 con 0x7fef441599f0 2023-10-06T02:25:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.128+0000 7fef49bfa700 1 -- 172.21.15.37:0/2601516406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef441599f0 msgr2=0x7fef440cb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.128+0000 7fef49bfa700 1 --2- 172.21.15.37:0/2601516406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef441599f0 0x7fef440cb660 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fef4406e8a0 tx=0x7fef34009250 comp rx=0 tx=0).stop 2023-10-06T02:25:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.128+0000 7fef49bfa700 1 -- 172.21.15.37:0/2601516406 shutdown_connections 2023-10-06T02:25:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.128+0000 7fef49bfa700 1 --2- 172.21.15.37:0/2601516406 >> v2:172.21.15.191:3300/0 conn(0x7fef44159620 0x7fef440ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.128+0000 7fef49bfa700 1 --2- 172.21.15.37:0/2601516406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef441599f0 0x7fef440cb660 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.128+0000 7fef49bfa700 1 -- 172.21.15.37:0/2601516406 >> 172.21.15.37:0/2601516406 conn(0x7fef4406c0b0 msgr2=0x7fef4406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.128+0000 7fef49bfa700 1 -- 172.21.15.37:0/2601516406 shutdown_connections 2023-10-06T02:25:00.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.128+0000 7fef49bfa700 1 -- 172.21.15.37:0/2601516406 wait complete. 2023-10-06T02:25:00.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.130+0000 7fef49bfa700 1 Processor -- start 2023-10-06T02:25:00.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.130+0000 7fef49bfa700 1 -- start start 2023-10-06T02:25:00.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.130+0000 7fef49bfa700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef440cbba0 0x7fef44149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.130+0000 7fef49bfa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef44159620 0x7fef440c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.130+0000 7fef49bfa700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef441599f0 0x7fef440c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.130+0000 7fef49bfa700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4416a600 con 0x7fef44159620 2023-10-06T02:25:00.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.130+0000 7fef49bfa700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef44169cd0 con 0x7fef441599f0 2023-10-06T02:25:00.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.130+0000 7fef49bfa700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef44169fb0 con 0x7fef440cbba0 2023-10-06T02:25:00.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.130+0000 7fef42ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef44159620 0x7fef440c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.130+0000 7fef42ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef44159620 0x7fef440c56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59266/0 (socket says 172.21.15.37:59266) 2023-10-06T02:25:00.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.130+0000 7fef42ffd700 1 -- 172.21.15.37:0/1754955944 learned_addr learned my addr 172.21.15.37:0/1754955944 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:00.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.131+0000 7fef43fff700 1 --2- 172.21.15.37:0/1754955944 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef441599f0 0x7fef440c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.131+0000 7fef42ffd700 1 -- 172.21.15.37:0/1754955944 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef440cbba0 msgr2=0x7fef44149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.131+0000 7fef437fe700 1 --2- 172.21.15.37:0/1754955944 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef440cbba0 0x7fef44149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.131+0000 7fef42ffd700 1 --2- 172.21.15.37:0/1754955944 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef440cbba0 0x7fef44149f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.131+0000 7fef42ffd700 1 -- 172.21.15.37:0/1754955944 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef441599f0 msgr2=0x7fef440c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.131+0000 7fef42ffd700 1 --2- 172.21.15.37:0/1754955944 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef441599f0 0x7fef440c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.131+0000 7fef42ffd700 1 -- 172.21.15.37:0/1754955944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef340094f0 con 0x7fef44159620 2023-10-06T02:25:00.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.131+0000 7fef43fff700 1 --2- 172.21.15.37:0/1754955944 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef441599f0 0x7fef440c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:00.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.131+0000 7fef42ffd700 1 --2- 172.21.15.37:0/1754955944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef44159620 0x7fef440c56f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fef44089510 tx=0x7fef34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:00.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.131+0000 7fef3b7fe700 1 -- 172.21.15.37:0/1754955944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef34011420 con 0x7fef44159620 2023-10-06T02:25:00.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.131+0000 7fef3b7fe700 1 -- 172.21.15.37:0/1754955944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef34011580 con 0x7fef44159620 2023-10-06T02:25:00.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.131+0000 7fef49bfa700 1 -- 172.21.15.37:0/1754955944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4416a290 con 0x7fef44159620 2023-10-06T02:25:00.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.131+0000 7fef3b7fe700 1 -- 172.21.15.37:0/1754955944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef34011940 con 0x7fef44159620 2023-10-06T02:25:00.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.131+0000 7fef49bfa700 1 -- 172.21.15.37:0/1754955944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef44169970 con 0x7fef44159620 2023-10-06T02:25:00.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.132+0000 7fef49bfa700 1 -- 172.21.15.37:0/1754955944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fef44063de0 con 0x7fef44159620 2023-10-06T02:25:00.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.133+0000 7fef3b7fe700 1 -- 172.21.15.37:0/1754955944 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef340253f0 con 0x7fef44159620 2023-10-06T02:25:00.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.133+0000 7fef3b7fe700 1 --2- 172.21.15.37:0/1754955944 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fef24066f30 0x7fef240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.134+0000 7fef3b7fe700 1 -- 172.21.15.37:0/1754955944 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fef34086ba0 con 0x7fef44159620 2023-10-06T02:25:00.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.134+0000 7fef437fe700 1 --2- 172.21.15.37:0/1754955944 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fef24066f30 0x7fef240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.134+0000 7fef3b7fe700 1 -- 172.21.15.37:0/1754955944 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+507 (secure 0 0 0) 0x7fef340872d0 con 0x7fef44159620 2023-10-06T02:25:00.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.134+0000 7fef49bfa700 1 -- 172.21.15.37:0/1754955944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fef4416a770 con 0x7fef44159620 2023-10-06T02:25:00.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.134+0000 7fef437fe700 1 --2- 172.21.15.37:0/1754955944 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fef24066f30 0x7fef240693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0093f0 tx=0x7fef2c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:00.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.137+0000 7f64d375bb80 1 Processor -- start 2023-10-06T02:25:00.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.137+0000 7f64d375bb80 1 -- start start 2023-10-06T02:25:00.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.137+0000 7f64d375bb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d048e0c0 0x55e0d0487900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.137+0000 7f64d375bb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e0d0440230 0x55e0d0487e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.137+0000 7f64d375bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d043e910 0x55e0d043ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.137+0000 7f64d375bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d048e830 con 0x55e0d043e910 2023-10-06T02:25:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.137+0000 7f64d375bb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d0417350 con 0x55e0d048e0c0 2023-10-06T02:25:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.137+0000 7f64d375bb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0d046ed50 con 0x55e0d0440230 2023-10-06T02:25:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.138+0000 7f64c8a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d043e910 0x55e0d043ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.138+0000 7f64c8a00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d043e910 0x55e0d043ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59274/0 (socket says 172.21.15.37:59274) 2023-10-06T02:25:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.138+0000 7f64c8a00700 1 -- 172.21.15.37:0/2219047062 learned_addr learned my addr 172.21.15.37:0/2219047062 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.138+0000 7f64c3fff700 1 --2- 172.21.15.37:0/2219047062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d048e0c0 0x55e0d0487900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.138+0000 7f64c37fe700 1 --2- 172.21.15.37:0/2219047062 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e0d0440230 0x55e0d0487e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.138+0000 7f64c8a00700 1 -- 172.21.15.37:0/2219047062 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e0d0440230 msgr2=0x55e0d0487e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.138+0000 7f64c8a00700 1 --2- 172.21.15.37:0/2219047062 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e0d0440230 0x55e0d0487e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.138+0000 7f64c8a00700 1 -- 172.21.15.37:0/2219047062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d048e0c0 msgr2=0x55e0d0487900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.138+0000 7f64c8a00700 1 --2- 172.21.15.37:0/2219047062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d048e0c0 0x55e0d0487900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.138+0000 7f64c8a00700 1 -- 172.21.15.37:0/2219047062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0d01cc0b0 con 0x55e0d043e910 2023-10-06T02:25:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.138+0000 7f64c8a00700 1 --2- 172.21.15.37:0/2219047062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d043e910 0x55e0d043ee10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f64bc011a20 tx=0x7f64bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae7ebc934b40b10 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.138+0000 7f64a9ffb700 1 -- 172.21.15.37:0/2219047062 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc00e040 con 0x55e0d043e910 2023-10-06T02:25:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.138+0000 7f64a9ffb700 1 -- 172.21.15.37:0/2219047062 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64bc00f040 con 0x55e0d043e910 2023-10-06T02:25:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.138+0000 7f64a9ffb700 1 -- 172.21.15.37:0/2219047062 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc017a60 con 0x55e0d043e910 2023-10-06T02:25:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.139+0000 7f64d375bb80 1 -- 172.21.15.37:0/2219047062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d043e910 msgr2=0x55e0d043ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.139+0000 7f64d375bb80 1 --2- 172.21.15.37:0/2219047062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d043e910 0x55e0d043ee10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f64bc011a20 tx=0x7f64bc00b040 comp rx=0 tx=0).stop 2023-10-06T02:25:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.139+0000 7f64d375bb80 1 -- 172.21.15.37:0/2219047062 shutdown_connections 2023-10-06T02:25:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.139+0000 7f64d375bb80 1 --2- 172.21.15.37:0/2219047062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d043e910 0x55e0d043ee10 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.139+0000 7f64d375bb80 1 --2- 172.21.15.37:0/2219047062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d048e0c0 0x55e0d0487900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.139+0000 7f64d375bb80 1 --2- 172.21.15.37:0/2219047062 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e0d0440230 0x55e0d0487e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.139+0000 7f64d375bb80 1 -- 172.21.15.37:0/2219047062 >> 172.21.15.37:0/2219047062 conn(0x55e0d04411a0 msgr2=0x55e0d0437350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.139+0000 7f64d375bb80 1 -- 172.21.15.37:0/2219047062 shutdown_connections 2023-10-06T02:25:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.139+0000 7f64d375bb80 1 -- 172.21.15.37:0/2219047062 wait complete. 2023-10-06T02:25:00.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.140+0000 7f64d375bb80 1 -- start start 2023-10-06T02:25:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.140+0000 7f64d375bb80 1 Processor -- start 2023-10-06T02:25:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.140+0000 7f64d375bb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e0d043e910 0x55e0d0487900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.140+0000 7f64d375bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0440230 0x55e0d0487e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.140+0000 7f64d375bb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d048e0c0 0x55e0d043ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.140+0000 7f64d375bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d043c260 con 0x55e0d0440230 2023-10-06T02:25:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.140+0000 7f64d375bb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d043b6c0 con 0x55e0d048e0c0 2023-10-06T02:25:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.140+0000 7f64d375bb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0d0485130 con 0x55e0d043e910 2023-10-06T02:25:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.141+0000 7f64d375bb80 10 client.0 _ll_register_callbacks cb 0x55e0d048ad20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:25:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.141+0000 7f64c37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0440230 0x55e0d0487e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.141+0000 7f64c37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0440230 0x55e0d0487e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59280/0 (socket says 172.21.15.37:59280) 2023-10-06T02:25:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.141+0000 7f64c37fe700 1 -- 172.21.15.37:0/4255530712 learned_addr learned my addr 172.21.15.37:0/4255530712 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.141+0000 7f64c3fff700 1 --2- 172.21.15.37:0/4255530712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e0d043e910 0x55e0d0487900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.141+0000 7f64c8a00700 1 --2- 172.21.15.37:0/4255530712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d048e0c0 0x55e0d043ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.141+0000 7f64c37fe700 1 -- 172.21.15.37:0/4255530712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e0d043e910 msgr2=0x55e0d0487900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.141+0000 7f64c37fe700 1 --2- 172.21.15.37:0/4255530712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e0d043e910 0x55e0d0487900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.141+0000 7f64c37fe700 1 -- 172.21.15.37:0/4255530712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d048e0c0 msgr2=0x55e0d043ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.141+0000 7f64c37fe700 1 --2- 172.21.15.37:0/4255530712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d048e0c0 0x55e0d043ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.141+0000 7f64c37fe700 1 -- 172.21.15.37:0/4255530712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64bc011780 con 0x55e0d0440230 2023-10-06T02:25:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.141+0000 7f64c37fe700 1 --2- 172.21.15.37:0/4255530712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0440230 0x55e0d0487e40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009290 tx=0x7f64b802f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d53499098e3685 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.141+0000 7f64a27fc700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:25:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.141+0000 7f64a27fc700 1 -- 172.21.15.37:0/4255530712 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8059cb0 con 0x55e0d0440230 2023-10-06T02:25:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.141+0000 7f64d375bb80 1 -- 172.21.15.37:0/4255530712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f64b4014d10 con 0x55e0d0440230 2023-10-06T02:25:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.141+0000 7f64a27fc700 1 -- 172.21.15.37:0/4255530712 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f64b805da00 con 0x55e0d0440230 2023-10-06T02:25:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.141+0000 7f64a27fc700 1 -- 172.21.15.37:0/4255530712 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64b8006bc0 con 0x55e0d0440230 2023-10-06T02:25:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.141+0000 7f64d375bb80 10 client.5622 fetch_fsmap learned FSMap version 23 2023-10-06T02:25:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.141+0000 7f64d375bb80 1 -- 172.21.15.37:0/4255530712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55e0d035d850 con 0x55e0d0440230 2023-10-06T02:25:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.141+0000 7f64a27fc700 1 -- 172.21.15.37:0/4255530712 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b4014d10 con 0x55e0d0440230 2023-10-06T02:25:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.142+0000 7f64a27fc700 1 -- 172.21.15.37:0/4255530712 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f64b8053170 con 0x55e0d0440230 2023-10-06T02:25:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.142+0000 7f64d375bb80 10 client.5622 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T02:25:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.142+0000 7f64d375bb80 10 client.5622 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2023-10-06T02:25:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.142+0000 7f64d375bb80 20 client.5622 populate_metadata read hostname 'smithi037' 2023-10-06T02:25:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.142+0000 7f64d375bb80 1 --2- 172.21.15.37:0/4255530712 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55e0d043fd90 0x55e0d043f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.142+0000 7f64d375bb80 4 client.5622 mds_command: new command op to 5400 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2023-10-06T02:25:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.142+0000 7f64d375bb80 1 -- 172.21.15.37:0/4255530712 --> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x55e0d0331ed0 con 0x55e0d043fd90 2023-10-06T02:25:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.142+0000 7f64c3fff700 1 --2- 172.21.15.37:0/4255530712 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55e0d043fd90 0x55e0d043f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.142+0000 7f64a27fc700 10 client.5622 ms_handle_connect on v2:172.21.15.191:6834/2931117635 2023-10-06T02:25:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.142+0000 7f64c3fff700 1 --2- 172.21.15.37:0/4255530712 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55e0d043fd90 0x55e0d043f220 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bf5e0d64722daf7 server_cookie=cae6a7e6ae9adcbe in_seq=0 out_seq=0 2023-10-06T02:25:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.143+0000 7f64a27fc700 1 -- 172.21.15.37:0/4255530712 <== mds.0 v2:172.21.15.191:6834/2931117635 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e0d0331ed0 con 0x55e0d043fd90 2023-10-06T02:25:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.143+0000 7f64a27fc700 10 client.5622 handle_command_reply: tid=0 2023-10-06T02:25:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.143+0000 7f64d375bb80 1 client.5622 shutdown 2023-10-06T02:25:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.143+0000 7f64d375bb80 1 -- 172.21.15.37:0/4255530712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0440230 msgr2=0x55e0d0487e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.143+0000 7f64d375bb80 1 --2- 172.21.15.37:0/4255530712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0440230 0x55e0d0487e40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009290 tx=0x7f64b802f000 comp rx=0 tx=0).stop 2023-10-06T02:25:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.143+0000 7f64d375bb80 1 -- 172.21.15.37:0/4255530712 shutdown_connections 2023-10-06T02:25:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.143+0000 7f64d375bb80 1 --2- 172.21.15.37:0/4255530712 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55e0d043fd90 0x55e0d043f220 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.143+0000 7f64d375bb80 1 --2- 172.21.15.37:0/4255530712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e0d048e0c0 0x55e0d043ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.143+0000 7f64d375bb80 1 --2- 172.21.15.37:0/4255530712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e0d043e910 0x55e0d0487900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.143+0000 7f64a27fc700 0 client.5622 ms_handle_reset on v2:172.21.15.191:6834/2931117635 2023-10-06T02:25:00.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.143+0000 7f64d375bb80 1 --2- 172.21.15.37:0/4255530712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0440230 0x55e0d0487e40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.143+0000 7f64d375bb80 1 -- 172.21.15.37:0/4255530712 >> 172.21.15.37:0/4255530712 conn(0x55e0d04411a0 msgr2=0x55e0d04867c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:00.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.143+0000 7f64d375bb80 1 -- 172.21.15.37:0/4255530712 shutdown_connections 2023-10-06T02:25:00.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.143+0000 7f64d375bb80 1 -- 172.21.15.37:0/4255530712 wait complete. 2023-10-06T02:25:00.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.143+0000 7f64d375bb80 20 client.5622 trim_cache size 0 max 16384 2023-10-06T02:25:00.151 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:25:00.151 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2023-10-06T02:25:00.151 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "246568c4-756e-40a4-957d-e8a138c0144a", 2023-10-06T02:25:00.152 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2023-10-06T02:25:00.152 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:25:00.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.144+0000 7f64ca463700 1 -- 172.21.15.37:0/3191020488 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f64b0066f30 msgr2=0x7f64b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.144+0000 7f64ca463700 1 --2- 172.21.15.37:0/3191020488 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f64b0066f30 0x7f64b00693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009d90 tx=0x7f64b40091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.144+0000 7f64ca463700 1 -- 172.21.15.37:0/3191020488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c4142f70 msgr2=0x7f64c40aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.144+0000 7f64ca463700 1 --2- 172.21.15.37:0/3191020488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c4142f70 0x7f64c40aef70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f64c40b0e20 tx=0x7f64b8017000 comp rx=0 tx=0).stop 2023-10-06T02:25:00.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.144+0000 7f64ca463700 1 -- 172.21.15.37:0/3191020488 shutdown_connections 2023-10-06T02:25:00.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.144+0000 7f64ca463700 1 --2- 172.21.15.37:0/3191020488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64c4143340 0x7f64c40af4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.144+0000 7f64ca463700 1 --2- 172.21.15.37:0/3191020488 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f64b0066f30 0x7f64b00693e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.144+0000 7f64ca463700 1 --2- 172.21.15.37:0/3191020488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64c4067ed0 0x7f64c41590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.144+0000 7f64ca463700 1 --2- 172.21.15.37:0/3191020488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64c4142f70 0x7f64c40aef70 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.144+0000 7f64ca463700 1 -- 172.21.15.37:0/3191020488 >> 172.21.15.37:0/3191020488 conn(0x7f64c40ce360 msgr2=0x7f64c40aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:00.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.144+0000 7f64ca463700 1 -- 172.21.15.37:0/3191020488 shutdown_connections 2023-10-06T02:25:00.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.144+0000 7f64ca463700 1 -- 172.21.15.37:0/3191020488 wait complete. 2023-10-06T02:25:00.154 INFO:tasks.ceph.mds.d.smithi191.stderr:2023-10-06T02:25:00.143+0000 7fbf0decd700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5574=0-4194304@1} caps={5574=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5574 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55f6f61f5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-06T02:25:00.157 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-10-06T02:25:00.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.276+0000 7f654b299700 1 Processor -- start 2023-10-06T02:25:00.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.276+0000 7f654b299700 1 -- start start 2023-10-06T02:25:00.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.277+0000 7f654b299700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65440af8a0 0x7f65440d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.277+0000 7f654b299700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f65440b2b80 0x7f65440d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.277+0000 7f654b299700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65440b40a0 con 0x7f65440af4d0 2023-10-06T02:25:00.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.277+0000 7f654b299700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65440b1a60 con 0x7f65440af8a0 2023-10-06T02:25:00.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.277+0000 7f654b299700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65440b31b0 con 0x7f65440b2b80 2023-10-06T02:25:00.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.277+0000 7f6549a96700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65440af8a0 0x7f65440d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.277+0000 7f6549a96700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65440af8a0 0x7f65440d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59292/0 (socket says 172.21.15.37:59292) 2023-10-06T02:25:00.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.277+0000 7f6549a96700 1 -- 172.21.15.37:0/502945217 learned_addr learned my addr 172.21.15.37:0/502945217 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:00.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.277+0000 7f654aa98700 1 --2- 172.21.15.37:0/502945217 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f65440b2b80 0x7f65440d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.277+0000 7f6549295700 1 -- 172.21.15.37:0/502945217 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029462048 0 0) 0x7f65440b40a0 con 0x7f65440af4d0 2023-10-06T02:25:00.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.277+0000 7f6549a96700 1 -- 172.21.15.37:0/502945217 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f65440b2b80 msgr2=0x7f65440d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.277+0000 7f6549a96700 1 --2- 172.21.15.37:0/502945217 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f65440b2b80 0x7f65440d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.277+0000 7f6549a96700 1 -- 172.21.15.37:0/502945217 >> v1:172.21.15.191:6789/0 conn(0x7f65440af4d0 legacy=0x7f65440b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.277+0000 7f6549a96700 1 -- 172.21.15.37:0/502945217 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65440b3490 con 0x7f65440af8a0 2023-10-06T02:25:00.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.278+0000 7f6549a96700 1 --2- 172.21.15.37:0/502945217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65440af8a0 0x7f65440d0340 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f65380099b0 tx=0x7f6538009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c88c5d75cc727c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:00.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.278+0000 7f6549295700 1 -- 172.21.15.37:0/502945217 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538009ea0 con 0x7f65440af8a0 2023-10-06T02:25:00.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.278+0000 7f6549295700 1 -- 172.21.15.37:0/502945217 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653800b860 con 0x7f65440af8a0 2023-10-06T02:25:00.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.278+0000 7f6549295700 1 -- 172.21.15.37:0/502945217 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653800bc00 con 0x7f65440af8a0 2023-10-06T02:25:00.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.278+0000 7f654b299700 1 -- 172.21.15.37:0/502945217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65440af8a0 msgr2=0x7f65440d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.278+0000 7f654b299700 1 --2- 172.21.15.37:0/502945217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65440af8a0 0x7f65440d0340 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f65380099b0 tx=0x7f6538009250 comp rx=0 tx=0).stop 2023-10-06T02:25:00.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.278+0000 7f654b299700 1 -- 172.21.15.37:0/502945217 shutdown_connections 2023-10-06T02:25:00.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.278+0000 7f654b299700 1 --2- 172.21.15.37:0/502945217 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f65440b2b80 0x7f65440d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.278+0000 7f654b299700 1 --2- 172.21.15.37:0/502945217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65440af8a0 0x7f65440d0340 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.278+0000 7f654b299700 1 -- 172.21.15.37:0/502945217 >> 172.21.15.37:0/502945217 conn(0x7f654406c0b0 msgr2=0x7f654406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:00.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.278+0000 7f654b299700 1 -- 172.21.15.37:0/502945217 shutdown_connections 2023-10-06T02:25:00.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.278+0000 7f654b299700 1 -- 172.21.15.37:0/502945217 wait complete. 2023-10-06T02:25:00.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.280+0000 7f654b299700 1 Processor -- start 2023-10-06T02:25:00.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.280+0000 7f654b299700 1 -- start start 2023-10-06T02:25:00.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.280+0000 7f654b299700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65440af4d0 0x7f6544157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.280+0000 7f654b299700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f65440af8a0 0x7f65441468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.280+0000 7f654b299700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6544155e60 0x7f65440ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.280+0000 7f654b299700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65441550e0 con 0x7f6544155e60 2023-10-06T02:25:00.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.280+0000 7f654b299700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65440c74b0 con 0x7f65440af4d0 2023-10-06T02:25:00.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.280+0000 7f654b299700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6544157c70 con 0x7f65440af8a0 2023-10-06T02:25:00.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.280+0000 7f654aa98700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6544155e60 0x7f65440ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.280+0000 7f654aa98700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6544155e60 0x7f65440ceee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59306/0 (socket says 172.21.15.37:59306) 2023-10-06T02:25:00.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.280+0000 7f654aa98700 1 -- 172.21.15.37:0/2224468426 learned_addr learned my addr 172.21.15.37:0/2224468426 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:00.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.280+0000 7f654a297700 1 --2- 172.21.15.37:0/2224468426 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65440af4d0 0x7f6544157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.280+0000 7f6549a96700 1 --2- 172.21.15.37:0/2224468426 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f65440af8a0 0x7f65441468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.281+0000 7f654aa98700 1 -- 172.21.15.37:0/2224468426 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f65440af8a0 msgr2=0x7f65441468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.281+0000 7f654aa98700 1 --2- 172.21.15.37:0/2224468426 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f65440af8a0 0x7f65441468c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.281+0000 7f654aa98700 1 -- 172.21.15.37:0/2224468426 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65440af4d0 msgr2=0x7f6544157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.281+0000 7f654aa98700 1 --2- 172.21.15.37:0/2224468426 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65440af4d0 0x7f6544157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.281+0000 7f654aa98700 1 -- 172.21.15.37:0/2224468426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65380094f0 con 0x7f6544155e60 2023-10-06T02:25:00.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.281+0000 7f654aa98700 1 --2- 172.21.15.37:0/2224468426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6544155e60 0x7f65440ceee0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f653c009d70 tx=0x7f653c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:00.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.281+0000 7f65427fc700 1 -- 172.21.15.37:0/2224468426 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c00caa0 con 0x7f6544155e60 2023-10-06T02:25:00.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.281+0000 7f65427fc700 1 -- 172.21.15.37:0/2224468426 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653c00f040 con 0x7f6544155e60 2023-10-06T02:25:00.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.281+0000 7f654b299700 1 -- 172.21.15.37:0/2224468426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6544157ec0 con 0x7f6544155e60 2023-10-06T02:25:00.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.281+0000 7f65427fc700 1 -- 172.21.15.37:0/2224468426 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c00ce50 con 0x7f6544155e60 2023-10-06T02:25:00.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.281+0000 7f654b299700 1 -- 172.21.15.37:0/2224468426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6544158480 con 0x7f6544155e60 2023-10-06T02:25:00.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.283+0000 7f65427fc700 1 -- 172.21.15.37:0/2224468426 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f653c014690 con 0x7f6544155e60 2023-10-06T02:25:00.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.283+0000 7f65427fc700 1 --2- 172.21.15.37:0/2224468426 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6530066f30 0x7f65300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.283+0000 7f65427fc700 1 -- 172.21.15.37:0/2224468426 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f653c0851b0 con 0x7f6544155e60 2023-10-06T02:25:00.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.283+0000 7f654a297700 1 --2- 172.21.15.37:0/2224468426 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6530066f30 0x7f65300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.284+0000 7f654a297700 1 --2- 172.21.15.37:0/2224468426 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6530066f30 0x7f65300693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6534007fd0 tx=0x7f6534007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:00.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.285+0000 7f65557f3b80 1 Processor -- start 2023-10-06T02:25:00.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.285+0000 7f65557f3b80 1 -- start start 2023-10-06T02:25:00.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f65557f3b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcddea0 0x55e26bcb8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f65557f3b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e26bcbe310 0x55e26bcb9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f65557f3b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcbfa60 0x55e26bcb9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f65557f3b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e26bc13ac0 con 0x55e26bcddea0 2023-10-06T02:25:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f65557f3b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e26bc112c0 con 0x55e26bcbfa60 2023-10-06T02:25:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f65557f3b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e26bc0d0b0 con 0x55e26bcbe310 2023-10-06T02:25:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f654a297700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcddea0 0x55e26bcb8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f6549a96700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e26bcbe310 0x55e26bcb9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f654a297700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcddea0 0x55e26bcb8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59316/0 (socket says 172.21.15.37:59316) 2023-10-06T02:25:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f654a297700 1 -- 172.21.15.37:0/1482286090 learned_addr learned my addr 172.21.15.37:0/1482286090 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f654aa98700 1 --2- 172.21.15.37:0/1482286090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcbfa60 0x55e26bcb9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f654a297700 1 -- 172.21.15.37:0/1482286090 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e26bcbe310 msgr2=0x55e26bcb9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f654a297700 1 --2- 172.21.15.37:0/1482286090 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e26bcbe310 0x55e26bcb9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f654a297700 1 -- 172.21.15.37:0/1482286090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcbfa60 msgr2=0x55e26bcb9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f654a297700 1 --2- 172.21.15.37:0/1482286090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcbfa60 0x55e26bcb9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f654a297700 1 -- 172.21.15.37:0/1482286090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e26baa72c0 con 0x55e26bcddea0 2023-10-06T02:25:00.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f654aa98700 1 --2- 172.21.15.37:0/1482286090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcbfa60 0x55e26bcb9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:25:00.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f654a297700 1 --2- 172.21.15.37:0/1482286090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcddea0 0x55e26bcb8d10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6534002c50 tx=0x7f6534015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270d4a3f16d65e91 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:00.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f652b7fe700 1 -- 172.21.15.37:0/1482286090 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65340147e0 con 0x55e26bcddea0 2023-10-06T02:25:00.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f652b7fe700 1 -- 172.21.15.37:0/1482286090 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6534014940 con 0x55e26bcddea0 2023-10-06T02:25:00.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.286+0000 7f652b7fe700 1 -- 172.21.15.37:0/1482286090 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534014d00 con 0x55e26bcddea0 2023-10-06T02:25:00.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.287+0000 7f65557f3b80 1 -- 172.21.15.37:0/1482286090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcddea0 msgr2=0x55e26bcb8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.287+0000 7f65557f3b80 1 --2- 172.21.15.37:0/1482286090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcddea0 0x55e26bcb8d10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6534002c50 tx=0x7f6534015000 comp rx=0 tx=0).stop 2023-10-06T02:25:00.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.287+0000 7f65557f3b80 1 -- 172.21.15.37:0/1482286090 shutdown_connections 2023-10-06T02:25:00.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.287+0000 7f65557f3b80 1 --2- 172.21.15.37:0/1482286090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcbfa60 0x55e26bcb9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.287+0000 7f65557f3b80 1 --2- 172.21.15.37:0/1482286090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcddea0 0x55e26bcb8d10 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.287+0000 7f65557f3b80 1 --2- 172.21.15.37:0/1482286090 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e26bcbe310 0x55e26bcb9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.287+0000 7f65557f3b80 1 -- 172.21.15.37:0/1482286090 >> 172.21.15.37:0/1482286090 conn(0x55e26bcbded0 msgr2=0x55e26bcbe700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:00.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.287+0000 7f65557f3b80 1 -- 172.21.15.37:0/1482286090 shutdown_connections 2023-10-06T02:25:00.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.287+0000 7f65557f3b80 1 -- 172.21.15.37:0/1482286090 wait complete. 2023-10-06T02:25:00.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.288+0000 7f65557f3b80 1 -- start start 2023-10-06T02:25:00.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.288+0000 7f65557f3b80 1 Processor -- start 2023-10-06T02:25:00.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.289+0000 7f65557f3b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e26bcbe310 0x55e26bd15df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.289+0000 7f65557f3b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcbfa60 0x55e26bd04cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.289+0000 7f65557f3b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcddea0 0x55e26bd07030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.289+0000 7f65557f3b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e26bbb88e0 con 0x55e26bcbfa60 2023-10-06T02:25:00.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.289+0000 7f65557f3b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e26bbd3ef0 con 0x55e26bcddea0 2023-10-06T02:25:00.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.289+0000 7f65557f3b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e26ba8fe80 con 0x55e26bcbe310 2023-10-06T02:25:00.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.289+0000 7f65557f3b80 10 client.0 _ll_register_callbacks cb 0x55e26bc80070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:25:00.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.289+0000 7f6549a96700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcbfa60 0x55e26bd04cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.289+0000 7f6549a96700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcbfa60 0x55e26bd04cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59320/0 (socket says 172.21.15.37:59320) 2023-10-06T02:25:00.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.289+0000 7f6549a96700 1 -- 172.21.15.37:0/88458101 learned_addr learned my addr 172.21.15.37:0/88458101 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:00.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.289+0000 7f654a297700 1 --2- 172.21.15.37:0/88458101 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e26bcbe310 0x55e26bd15df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.289+0000 7f654aa98700 1 --2- 172.21.15.37:0/88458101 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcddea0 0x55e26bd07030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.289+0000 7f6549a96700 1 -- 172.21.15.37:0/88458101 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e26bcbe310 msgr2=0x55e26bd15df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.289+0000 7f6549a96700 1 --2- 172.21.15.37:0/88458101 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e26bcbe310 0x55e26bd15df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.289+0000 7f6549a96700 1 -- 172.21.15.37:0/88458101 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcddea0 msgr2=0x55e26bd07030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.289+0000 7f6549a96700 1 --2- 172.21.15.37:0/88458101 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcddea0 0x55e26bd07030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.289+0000 7f6549a96700 1 -- 172.21.15.37:0/88458101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6544158480 con 0x55e26bcbfa60 2023-10-06T02:25:00.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.289+0000 7f6549a96700 1 --2- 172.21.15.37:0/88458101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcbfa60 0x55e26bd04cc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6544089290 tx=0x7f6538017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c82e5cf19a68a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:00.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.289+0000 7f6528ff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:25:00.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.290+0000 7f6528ff9700 1 -- 172.21.15.37:0/88458101 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538021050 con 0x55e26bcbfa60 2023-10-06T02:25:00.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.290+0000 7f65557f3b80 1 -- 172.21.15.37:0/88458101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e26bcb1990 con 0x55e26bcbfa60 2023-10-06T02:25:00.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.290+0000 7f6528ff9700 1 -- 172.21.15.37:0/88458101 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f653801a420 con 0x55e26bcbfa60 2023-10-06T02:25:00.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.290+0000 7f6528ff9700 1 -- 172.21.15.37:0/88458101 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f653801a7f0 con 0x55e26bcbfa60 2023-10-06T02:25:00.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.290+0000 7f65557f3b80 10 client.5634 fetch_fsmap learned FSMap version 23 2023-10-06T02:25:00.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.290+0000 7f65557f3b80 1 -- 172.21.15.37:0/88458101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x7f6534002860 con 0x55e26bcbfa60 2023-10-06T02:25:00.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.290+0000 7f6528ff9700 1 -- 172.21.15.37:0/88458101 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e26bcb1990 con 0x55e26bcbfa60 2023-10-06T02:25:00.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.290+0000 7f6528ff9700 1 -- 172.21.15.37:0/88458101 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f653801a950 con 0x55e26bcbfa60 2023-10-06T02:25:00.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.290+0000 7f65557f3b80 10 client.5634 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T02:25:00.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.290+0000 7f65557f3b80 10 client.5634 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2023-10-06T02:25:00.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.290+0000 7f65557f3b80 20 client.5634 populate_metadata read hostname 'smithi037' 2023-10-06T02:25:00.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.290+0000 7f65557f3b80 1 --2- 172.21.15.37:0/88458101 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55e26bd07570 0x55e26bd05fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.290+0000 7f65557f3b80 4 client.5634 mds_command: new command op to 5400 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:25:00.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.290+0000 7f65557f3b80 1 -- 172.21.15.37:0/88458101 --> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e26bc8e8c0 con 0x55e26bd07570 2023-10-06T02:25:00.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.290+0000 7f654a297700 1 --2- 172.21.15.37:0/88458101 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55e26bd07570 0x55e26bd05fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.291+0000 7f6528ff9700 10 client.5634 ms_handle_connect on v2:172.21.15.191:6834/2931117635 2023-10-06T02:25:00.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.291+0000 7f654a297700 1 --2- 172.21.15.37:0/88458101 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55e26bd07570 0x55e26bd05fa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99a981982852e8bf server_cookie=957767c74ea40b9 in_seq=0 out_seq=0 2023-10-06T02:25:00.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.291+0000 7f6528ff9700 1 -- 172.21.15.37:0/88458101 <== mds.0 v2:172.21.15.191:6834/2931117635 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e26bc8e8c0 con 0x55e26bd07570 2023-10-06T02:25:00.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.291+0000 7f6528ff9700 10 client.5634 handle_command_reply: tid=0 2023-10-06T02:25:00.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.291+0000 7f65557f3b80 1 client.5634 shutdown 2023-10-06T02:25:00.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.291+0000 7f65557f3b80 1 -- 172.21.15.37:0/88458101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcbfa60 msgr2=0x55e26bd04cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.291+0000 7f65557f3b80 1 --2- 172.21.15.37:0/88458101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcbfa60 0x55e26bd04cc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6544089290 tx=0x7f6538017000 comp rx=0 tx=0).stop 2023-10-06T02:25:00.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.291+0000 7f65557f3b80 1 -- 172.21.15.37:0/88458101 shutdown_connections 2023-10-06T02:25:00.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.291+0000 7f65557f3b80 1 --2- 172.21.15.37:0/88458101 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55e26bd07570 0x55e26bd05fa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.291+0000 7f65557f3b80 1 --2- 172.21.15.37:0/88458101 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcddea0 0x55e26bd07030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.291+0000 7f6528ff9700 0 client.5634 ms_handle_reset on v2:172.21.15.191:6834/2931117635 2023-10-06T02:25:00.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.291+0000 7f65557f3b80 1 --2- 172.21.15.37:0/88458101 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e26bcbe310 0x55e26bd15df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.291+0000 7f65557f3b80 1 --2- 172.21.15.37:0/88458101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcbfa60 0x55e26bd04cc0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.291+0000 7f65557f3b80 1 -- 172.21.15.37:0/88458101 >> 172.21.15.37:0/88458101 conn(0x55e26bcbded0 msgr2=0x55e26bcbcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:00.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.291+0000 7f65557f3b80 1 -- 172.21.15.37:0/88458101 shutdown_connections 2023-10-06T02:25:00.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.291+0000 7f65557f3b80 1 -- 172.21.15.37:0/88458101 wait complete. 2023-10-06T02:25:00.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.292+0000 7f65557f3b80 20 client.5634 trim_cache size 0 max 16384 2023-10-06T02:25:00.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.307+0000 7f65557f3b80 1 Processor -- start 2023-10-06T02:25:00.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.307+0000 7f65557f3b80 1 -- start start 2023-10-06T02:25:00.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.308+0000 7f65557f3b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcbe310 0x55e26bcdd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.308+0000 7f65557f3b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e26bcbfa60 0x55e26bd123d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.308+0000 7f65557f3b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcddea0 0x55e26bcbe8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.308+0000 7f65557f3b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e26bcdf750 con 0x55e26bcbe310 2023-10-06T02:25:00.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.308+0000 7f65557f3b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e26bd13d00 con 0x55e26bcddea0 2023-10-06T02:25:00.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.308+0000 7f65557f3b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e26bd072e0 con 0x55e26bcbfa60 2023-10-06T02:25:00.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.308+0000 7f654a297700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcbe310 0x55e26bcdd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.308+0000 7f654a297700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcbe310 0x55e26bcdd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59330/0 (socket says 172.21.15.37:59330) 2023-10-06T02:25:00.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.308+0000 7f654a297700 1 -- 172.21.15.37:0/228530691 learned_addr learned my addr 172.21.15.37:0/228530691 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:00.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.308+0000 7f654aa98700 1 --2- 172.21.15.37:0/228530691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcddea0 0x55e26bcbe8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.308+0000 7f6549a96700 1 --2- 172.21.15.37:0/228530691 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e26bcbfa60 0x55e26bd123d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.309+0000 7f654a297700 1 -- 172.21.15.37:0/228530691 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e26bcbfa60 msgr2=0x55e26bd123d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.309+0000 7f654a297700 1 --2- 172.21.15.37:0/228530691 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e26bcbfa60 0x55e26bd123d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.309+0000 7f654a297700 1 -- 172.21.15.37:0/228530691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcddea0 msgr2=0x55e26bcbe8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.309+0000 7f654a297700 1 --2- 172.21.15.37:0/228530691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcddea0 0x55e26bcbe8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.309+0000 7f654a297700 1 -- 172.21.15.37:0/228530691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e26ba4a030 con 0x55e26bcbe310 2023-10-06T02:25:00.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.309+0000 7f654a297700 1 --2- 172.21.15.37:0/228530691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcbe310 0x55e26bcdd600 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6534020000 tx=0x7f6534002f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac99ed1928d51276 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:00.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.309+0000 7f652bfff700 1 -- 172.21.15.37:0/228530691 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65340147e0 con 0x55e26bcbe310 2023-10-06T02:25:00.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.309+0000 7f652bfff700 1 -- 172.21.15.37:0/228530691 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6534014ab0 con 0x55e26bcbe310 2023-10-06T02:25:00.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.309+0000 7f652bfff700 1 -- 172.21.15.37:0/228530691 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534014c20 con 0x55e26bcbe310 2023-10-06T02:25:00.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.309+0000 7f65557f3b80 1 -- 172.21.15.37:0/228530691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcbe310 msgr2=0x55e26bcdd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.309+0000 7f65557f3b80 1 --2- 172.21.15.37:0/228530691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcbe310 0x55e26bcdd600 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6534020000 tx=0x7f6534002f90 comp rx=0 tx=0).stop 2023-10-06T02:25:00.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.309+0000 7f65557f3b80 1 -- 172.21.15.37:0/228530691 shutdown_connections 2023-10-06T02:25:00.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.309+0000 7f65557f3b80 1 --2- 172.21.15.37:0/228530691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcddea0 0x55e26bcbe8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.309+0000 7f65557f3b80 1 --2- 172.21.15.37:0/228530691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcbe310 0x55e26bcdd600 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.309+0000 7f65557f3b80 1 --2- 172.21.15.37:0/228530691 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e26bcbfa60 0x55e26bd123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.309+0000 7f65557f3b80 1 -- 172.21.15.37:0/228530691 >> 172.21.15.37:0/228530691 conn(0x55e26bcbded0 msgr2=0x55e26bcba330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.309+0000 7f65557f3b80 1 -- 172.21.15.37:0/228530691 shutdown_connections 2023-10-06T02:25:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.309+0000 7f65557f3b80 1 -- 172.21.15.37:0/228530691 wait complete. 2023-10-06T02:25:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.310+0000 7f65557f3b80 1 -- start start 2023-10-06T02:25:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.310+0000 7f65557f3b80 1 Processor -- start 2023-10-06T02:25:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f65557f3b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e26bcbe310 0x55e26bd228c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f65557f3b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcbfa60 0x55e26bce9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f65557f3b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcddea0 0x55e26bcec0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f65557f3b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e26bd22e00 con 0x55e26bcddea0 2023-10-06T02:25:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f65557f3b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e26bd22fa0 con 0x55e26bcbfa60 2023-10-06T02:25:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f65557f3b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e26bd25470 con 0x55e26bcbe310 2023-10-06T02:25:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f65557f3b80 10 client.0 _ll_register_callbacks cb 0x55e26bc80070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:25:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f654aa98700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcddea0 0x55e26bcec0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f6549a96700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcbfa60 0x55e26bce9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f654a297700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e26bcbe310 0x55e26bd228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f6549a96700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcbfa60 0x55e26bce9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:50982/0 (socket says 172.21.15.37:50982) 2023-10-06T02:25:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f6549a96700 1 -- 172.21.15.37:0/1822044017 learned_addr learned my addr 172.21.15.37:0/1822044017 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f654aa98700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcddea0 0x55e26bcec0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59342/0 (socket says 172.21.15.37:59342) 2023-10-06T02:25:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f654aa98700 1 -- 172.21.15.37:0/1822044017 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e26bcbe310 msgr2=0x55e26bd228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f654aa98700 1 --2- 172.21.15.37:0/1822044017 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e26bcbe310 0x55e26bd228c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f654aa98700 1 -- 172.21.15.37:0/1822044017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcbfa60 msgr2=0x55e26bce9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f654aa98700 1 --2- 172.21.15.37:0/1822044017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcbfa60 0x55e26bce9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f654aa98700 1 -- 172.21.15.37:0/1822044017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e26baa72c0 con 0x55e26bcddea0 2023-10-06T02:25:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f6549a96700 1 --2- 172.21.15.37:0/1822044017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcbfa60 0x55e26bce9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:25:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f654aa98700 1 --2- 172.21.15.37:0/1822044017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcddea0 0x55e26bcec0d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f653c083650 tx=0x7f653c01f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843def7eeb774941 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.311+0000 7f6528ff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:25:00.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.312+0000 7f6528ff9700 1 -- 172.21.15.37:0/1822044017 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c05cf20 con 0x55e26bcddea0 2023-10-06T02:25:00.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.312+0000 7f6528ff9700 1 -- 172.21.15.37:0/1822044017 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f653c06c1e0 con 0x55e26bcddea0 2023-10-06T02:25:00.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.312+0000 7f65557f3b80 1 -- 172.21.15.37:0/1822044017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6534014940 con 0x55e26bcddea0 2023-10-06T02:25:00.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.312+0000 7f6528ff9700 1 -- 172.21.15.37:0/1822044017 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f653c06c3a0 con 0x55e26bcddea0 2023-10-06T02:25:00.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.312+0000 7f65557f3b80 10 client.5640 fetch_fsmap learned FSMap version 23 2023-10-06T02:25:00.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.312+0000 7f65557f3b80 1 -- 172.21.15.37:0/1822044017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55e26bbdb7d0 con 0x55e26bcddea0 2023-10-06T02:25:00.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.312+0000 7f6528ff9700 1 -- 172.21.15.37:0/1822044017 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6534014940 con 0x55e26bcddea0 2023-10-06T02:25:00.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.312+0000 7f6528ff9700 1 -- 172.21.15.37:0/1822044017 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f653c083170 con 0x55e26bcddea0 2023-10-06T02:25:00.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.312+0000 7f65557f3b80 10 client.5640 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T02:25:00.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.312+0000 7f65557f3b80 10 client.5640 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2023-10-06T02:25:00.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.312+0000 7f65557f3b80 20 client.5640 populate_metadata read hostname 'smithi037' 2023-10-06T02:25:00.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.312+0000 7f65557f3b80 1 --2- 172.21.15.37:0/1822044017 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55e26bd03620 0x55e26bcec610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:00.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.312+0000 7f65557f3b80 4 client.5640 mds_command: new command op to 5400 tid=0[{"prefix": "scrub status"}] 2023-10-06T02:25:00.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.312+0000 7f65557f3b80 1 -- 172.21.15.37:0/1822044017 --> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e26bbafe50 con 0x55e26bd03620 2023-10-06T02:25:00.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.312+0000 7f654a297700 1 --2- 172.21.15.37:0/1822044017 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55e26bd03620 0x55e26bcec610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:00.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.313+0000 7f654a297700 1 --2- 172.21.15.37:0/1822044017 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55e26bd03620 0x55e26bcec610 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b82c8bec887d41f8 server_cookie=bda478cb7b5ddd0a in_seq=0 out_seq=0 2023-10-06T02:25:00.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.313+0000 7f6528ff9700 10 client.5640 ms_handle_connect on v2:172.21.15.191:6834/2931117635 2023-10-06T02:25:00.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.313+0000 7f6528ff9700 1 -- 172.21.15.37:0/1822044017 <== mds.0 v2:172.21.15.191:6834/2931117635 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x55e26bbafe50 con 0x55e26bd03620 2023-10-06T02:25:00.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.313+0000 7f6528ff9700 10 client.5640 handle_command_reply: tid=0 2023-10-06T02:25:00.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.313+0000 7f65557f3b80 1 client.5640 shutdown 2023-10-06T02:25:00.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.313+0000 7f65557f3b80 1 -- 172.21.15.37:0/1822044017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcddea0 msgr2=0x55e26bcec0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.313+0000 7f65557f3b80 1 --2- 172.21.15.37:0/1822044017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcddea0 0x55e26bcec0d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f653c083650 tx=0x7f653c01f040 comp rx=0 tx=0).stop 2023-10-06T02:25:00.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.313+0000 7f65557f3b80 1 -- 172.21.15.37:0/1822044017 shutdown_connections 2023-10-06T02:25:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.313+0000 7f65557f3b80 1 --2- 172.21.15.37:0/1822044017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e26bcddea0 0x55e26bcec0d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.313+0000 7f65557f3b80 1 --2- 172.21.15.37:0/1822044017 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e26bcbe310 0x55e26bd228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.313+0000 7f65557f3b80 1 --2- 172.21.15.37:0/1822044017 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55e26bd03620 0x55e26bcec610 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.313+0000 7f65557f3b80 1 --2- 172.21.15.37:0/1822044017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e26bcbfa60 0x55e26bce9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.313+0000 7f6528ff9700 0 client.5640 ms_handle_reset on v2:172.21.15.191:6834/2931117635 2023-10-06T02:25:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.313+0000 7f65557f3b80 1 -- 172.21.15.37:0/1822044017 >> 172.21.15.37:0/1822044017 conn(0x55e26bcbded0 msgr2=0x55e26bcba330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.313+0000 7f65557f3b80 1 -- 172.21.15.37:0/1822044017 shutdown_connections 2023-10-06T02:25:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.313+0000 7f65557f3b80 1 -- 172.21.15.37:0/1822044017 wait complete. 2023-10-06T02:25:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.313+0000 7f65557f3b80 20 client.5640 trim_cache size 0 max 16384 2023-10-06T02:25:00.323 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:25:00.323 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T02:25:00.323 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2023-10-06T02:25:00.323 INFO:teuthology.orchestra.run.smithi037.stdout: "246568c4-756e-40a4-957d-e8a138c0144a": { 2023-10-06T02:25:00.323 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2023-10-06T02:25:00.323 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "246568c4-756e-40a4-957d-e8a138c0144a", 2023-10-06T02:25:00.323 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,repair" 2023-10-06T02:25:00.323 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:00.323 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:00.323 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:25:00.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.314+0000 7f654b299700 1 -- 172.21.15.37:0/2224468426 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6530066f30 msgr2=0x7f65300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.314+0000 7f654b299700 1 --2- 172.21.15.37:0/2224468426 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6530066f30 0x7f65300693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6534007fd0 tx=0x7f6534007d30 comp rx=0 tx=0).stop 2023-10-06T02:25:00.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.314+0000 7f654b299700 1 -- 172.21.15.37:0/2224468426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6544155e60 msgr2=0x7f65440ceee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:00.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.314+0000 7f654b299700 1 --2- 172.21.15.37:0/2224468426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6544155e60 0x7f65440ceee0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f653c009d70 tx=0x7f653c00b040 comp rx=0 tx=0).stop 2023-10-06T02:25:00.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.314+0000 7f654b299700 1 -- 172.21.15.37:0/2224468426 shutdown_connections 2023-10-06T02:25:00.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.314+0000 7f654b299700 1 --2- 172.21.15.37:0/2224468426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6544155e60 0x7f65440ceee0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.314+0000 7f654b299700 1 --2- 172.21.15.37:0/2224468426 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6530066f30 0x7f65300693e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.314+0000 7f654b299700 1 --2- 172.21.15.37:0/2224468426 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65440af4d0 0x7f6544157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.314+0000 7f654b299700 1 --2- 172.21.15.37:0/2224468426 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f65440af8a0 0x7f65441468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:00.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.314+0000 7f654b299700 1 -- 172.21.15.37:0/2224468426 >> 172.21.15.37:0/2224468426 conn(0x7f654406c0b0 msgr2=0x7f65440b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:00.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.314+0000 7f654b299700 1 -- 172.21.15.37:0/2224468426 shutdown_connections 2023-10-06T02:25:00.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:00.314+0000 7f654b299700 1 -- 172.21.15.37:0/2224468426 wait complete. 2023-10-06T02:25:00.326 INFO:tasks.cephfs.filesystem:scrub status for tag:246568c4-756e-40a4-957d-e8a138c0144a - {'path': '/', 'tag': '246568c4-756e-40a4-957d-e8a138c0144a', 'options': 'recursive,repair'} 2023-10-06T02:25:01.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:01.051+0000 7fef3b7fe700 1 -- 172.21.15.37:0/1754955944 <== mon.0 v2:172.21.15.37:3300/0 7 ==== log(6 entries from seq 1 at 2023-10-06T02:25:00.144364+0000) v1 ==== 1078+0+0 (secure 0 0 0) 0x7fef34058070 con 0x7fef44159620 2023-10-06T02:25:01.053 INFO:teuthology.orchestra.run.smithi037.stdout: cluster: 2023-10-06T02:25:01.054 INFO:teuthology.orchestra.run.smithi037.stdout: id: d1f292a2-fd8c-430a-be88-f44de408e77c 2023-10-06T02:25:01.054 INFO:teuthology.orchestra.run.smithi037.stdout: health: HEALTH_OK 2023-10-06T02:25:01.054 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:01.054 INFO:teuthology.orchestra.run.smithi037.stdout: services: 2023-10-06T02:25:01.054 INFO:teuthology.orchestra.run.smithi037.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2023-10-06T02:25:01.054 INFO:teuthology.orchestra.run.smithi037.stdout: mgr: x(active, since 117s), standbys: y 2023-10-06T02:25:01.054 INFO:teuthology.orchestra.run.smithi037.stdout: mds: 1/1 daemons up, 3 standby 2023-10-06T02:25:01.054 INFO:teuthology.orchestra.run.smithi037.stdout: osd: 8 osds: 8 up (since 112s), 8 in (since 2m) 2023-10-06T02:25:01.054 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:01.054 INFO:teuthology.orchestra.run.smithi037.stdout: data: 2023-10-06T02:25:01.055 INFO:teuthology.orchestra.run.smithi037.stdout: volumes: 1/1 healthy 2023-10-06T02:25:01.055 INFO:teuthology.orchestra.run.smithi037.stdout: pools: 4 pools, 105 pgs 2023-10-06T02:25:01.055 INFO:teuthology.orchestra.run.smithi037.stdout: objects: 23 objects, 579 KiB 2023-10-06T02:25:01.055 INFO:teuthology.orchestra.run.smithi037.stdout: usage: 2.3 GiB used, 718 GiB / 720 GiB avail 2023-10-06T02:25:01.055 INFO:teuthology.orchestra.run.smithi037.stdout: pgs: 105 active+clean 2023-10-06T02:25:01.055 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:01.055 INFO:teuthology.orchestra.run.smithi037.stdout: io: 2023-10-06T02:25:01.055 INFO:teuthology.orchestra.run.smithi037.stdout: client: 1.6 KiB/s wr, 0 op/s rd, 5 op/s wr 2023-10-06T02:25:01.055 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:01.055 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:01.055 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:25:00.144364+0000 mds.d [INF] scrub queued for path: / 2023-10-06T02:25:01.055 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:25:00.144367+0000 mds.d [INF] scrub summary: idle+waiting paths [/] 2023-10-06T02:25:01.056 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:25:00.144372+0000 mds.d [INF] scrub summary: active paths [/] 2023-10-06T02:25:01.056 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:25:00.145126+0000 mds.d [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2023-10-06T02:25:01.056 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:25:00.145131+0000 mds.d [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2023-10-06T02:25:01.056 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:25:00.145388+0000 mds.d [INF] scrub summary: idle+waiting paths [/] 2023-10-06T02:25:02.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:02.632+0000 7fef3b7fe700 1 -- 172.21.15.37:0/1754955944 <== mon.0 v2:172.21.15.37:3300/0 8 ==== log(4 entries from seq 120 at 2023-10-06T02:25:02.529430+0000) v1 ==== 1112+0+0 (secure 0 0 0) 0x7fef34057970 con 0x7fef44159620 2023-10-06T02:25:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:03.642+0000 7fef3b7fe700 1 -- 172.21.15.37:0/1754955944 <== mon.0 v2:172.21.15.37:3300/0 9 ==== log(2 entries from seq 399 at 2023-10-06T02:25:02.638298+0000) v1 ==== 558+0+0 (secure 0 0 0) 0x7fef3405abc0 con 0x7fef44159620 2023-10-06T02:25:05.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:05.648+0000 7fef3b7fe700 1 -- 172.21.15.37:0/1754955944 <== mon.0 v2:172.21.15.37:3300/0 10 ==== log(1 entries from seq 7 at 2023-10-06T02:25:04.901055+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7fef3405e910 con 0x7fef44159620 2023-10-06T02:25:05.650 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:25:04.901055+0000 mds.d [INF] scrub summary: idle 2023-10-06T02:25:21.543 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:25:21.546 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:25:30.327 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-10-06T02:25:30.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.461+0000 7ffbaf3bd700 1 Processor -- start 2023-10-06T02:25:30.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.461+0000 7ffbaf3bd700 1 -- start start 2023-10-06T02:25:30.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.462+0000 7ffbaf3bd700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ffba815d960 0x7ffba815a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.462+0000 7ffbaf3bd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba80d0e90 0x7ffba80ce900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.462+0000 7ffbaf3bd700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba80af720 con 0x7ffba80d0ac0 2023-10-06T02:25:30.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.462+0000 7ffbaf3bd700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba815de10 con 0x7ffba815d960 2023-10-06T02:25:30.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.462+0000 7ffbaf3bd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba815e0f0 con 0x7ffba80d0e90 2023-10-06T02:25:30.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.462+0000 7ffbac958700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ffba815d960 0x7ffba815a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.462+0000 7ffbad95a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba80d0e90 0x7ffba80ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.462+0000 7ffbad95a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba80d0e90 0x7ffba80ce900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:60548/0 (socket says 172.21.15.37:60548) 2023-10-06T02:25:30.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.462+0000 7ffbad159700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7ffba80d0ac0 0x7ffba815d250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:38362/0 (socket says 172.21.15.37:38362) 2023-10-06T02:25:30.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.462+0000 7ffbac958700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ffba815d960 0x7ffba815a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:36934/0 (socket says 172.21.15.37:36934) 2023-10-06T02:25:30.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.462+0000 7ffbad95a700 1 -- 172.21.15.37:0/2988229859 learned_addr learned my addr 172.21.15.37:0/2988229859 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:30.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.462+0000 7ffbad95a700 1 -- 172.21.15.37:0/2988229859 >> v2:172.21.15.191:3300/0 conn(0x7ffba815d960 msgr2=0x7ffba815a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:30.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.462+0000 7ffbad95a700 1 --2- 172.21.15.37:0/2988229859 >> v2:172.21.15.191:3300/0 conn(0x7ffba815d960 0x7ffba815a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.462+0000 7ffbad95a700 1 -- 172.21.15.37:0/2988229859 >> v1:172.21.15.191:6789/0 conn(0x7ffba80d0ac0 legacy=0x7ffba815d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.462+0000 7ffbad95a700 1 -- 172.21.15.37:0/2988229859 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba8159d60 con 0x7ffba80d0e90 2023-10-06T02:25:30.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.462+0000 7ffbac958700 1 --2- 172.21.15.37:0/2988229859 >> v2:172.21.15.191:3300/0 conn(0x7ffba815d960 0x7ffba815a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:25:30.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.463+0000 7ffbad95a700 1 --2- 172.21.15.37:0/2988229859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba80d0e90 0x7ffba80ce900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009f20 tx=0x7ffba0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99d415c17e72b7c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.463+0000 7ffb9ffff700 1 -- 172.21.15.37:0/2988229859 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba000e070 con 0x7ffba80d0e90 2023-10-06T02:25:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.463+0000 7ffb9ffff700 1 -- 172.21.15.37:0/2988229859 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba000b9d0 con 0x7ffba80d0e90 2023-10-06T02:25:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.463+0000 7ffb9ffff700 1 -- 172.21.15.37:0/2988229859 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba00092e0 con 0x7ffba80d0e90 2023-10-06T02:25:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.463+0000 7ffbaf3bd700 1 -- 172.21.15.37:0/2988229859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba80d0e90 msgr2=0x7ffba80ce900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.463+0000 7ffbaf3bd700 1 --2- 172.21.15.37:0/2988229859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba80d0e90 0x7ffba80ce900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009f20 tx=0x7ffba0009840 comp rx=0 tx=0).stop 2023-10-06T02:25:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.463+0000 7ffbaf3bd700 1 -- 172.21.15.37:0/2988229859 shutdown_connections 2023-10-06T02:25:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.463+0000 7ffbaf3bd700 1 --2- 172.21.15.37:0/2988229859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba80d0e90 0x7ffba80ce900 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.463+0000 7ffbaf3bd700 1 --2- 172.21.15.37:0/2988229859 >> v2:172.21.15.191:3300/0 conn(0x7ffba815d960 0x7ffba815a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.463+0000 7ffbaf3bd700 1 -- 172.21.15.37:0/2988229859 >> 172.21.15.37:0/2988229859 conn(0x7ffba806c0b0 msgr2=0x7ffba806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.464+0000 7ffbaf3bd700 1 -- 172.21.15.37:0/2988229859 shutdown_connections 2023-10-06T02:25:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.464+0000 7ffbaf3bd700 1 -- 172.21.15.37:0/2988229859 wait complete. 2023-10-06T02:25:30.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.465+0000 7ffbaf3bd700 1 Processor -- start 2023-10-06T02:25:30.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.465+0000 7ffbaf3bd700 1 -- start start 2023-10-06T02:25:30.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.466+0000 7ffbaf3bd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba80d0ac0 0x7ffba80c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.466+0000 7ffbaf3bd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba80d0e90 0x7ffba815bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.466+0000 7ffbaf3bd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffba815d960 0x7ffba8169d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.466+0000 7ffbaf3bd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba80b3380 con 0x7ffba80d0ac0 2023-10-06T02:25:30.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.466+0000 7ffbaf3bd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba80b3620 con 0x7ffba815d960 2023-10-06T02:25:30.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.466+0000 7ffbaf3bd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba80b3900 con 0x7ffba80d0e90 2023-10-06T02:25:30.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.466+0000 7ffbad159700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba80d0ac0 0x7ffba80c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.466+0000 7ffbad159700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba80d0ac0 0x7ffba80c7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35326/0 (socket says 172.21.15.37:35326) 2023-10-06T02:25:30.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.466+0000 7ffbad159700 1 -- 172.21.15.37:0/816242263 learned_addr learned my addr 172.21.15.37:0/816242263 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:30.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.466+0000 7ffbac958700 1 --2- 172.21.15.37:0/816242263 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba80d0e90 0x7ffba815bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.466+0000 7ffbad95a700 1 --2- 172.21.15.37:0/816242263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffba815d960 0x7ffba8169d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.466+0000 7ffbad159700 1 -- 172.21.15.37:0/816242263 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba80d0e90 msgr2=0x7ffba815bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.466+0000 7ffbad159700 1 --2- 172.21.15.37:0/816242263 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba80d0e90 0x7ffba815bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.466+0000 7ffbad159700 1 -- 172.21.15.37:0/816242263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffba815d960 msgr2=0x7ffba8169d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.466+0000 7ffbad159700 1 --2- 172.21.15.37:0/816242263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffba815d960 0x7ffba8169d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.466+0000 7ffbad159700 1 -- 172.21.15.37:0/816242263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb98009420 con 0x7ffba80d0ac0 2023-10-06T02:25:30.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.466+0000 7ffbad159700 1 --2- 172.21.15.37:0/816242263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba80d0ac0 0x7ffba80c7a30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ffba400c7c0 tx=0x7ffba4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:30.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.466+0000 7ffb9d7fa700 1 -- 172.21.15.37:0/816242263 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba4005a70 con 0x7ffba80d0ac0 2023-10-06T02:25:30.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.466+0000 7ffb9d7fa700 1 -- 172.21.15.37:0/816242263 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba4005bf0 con 0x7ffba80d0ac0 2023-10-06T02:25:30.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.467+0000 7ffbaf3bd700 1 -- 172.21.15.37:0/816242263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba0009ae0 con 0x7ffba80d0ac0 2023-10-06T02:25:30.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.467+0000 7ffb9d7fa700 1 -- 172.21.15.37:0/816242263 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba40070f0 con 0x7ffba80d0ac0 2023-10-06T02:25:30.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.467+0000 7ffbaf3bd700 1 -- 172.21.15.37:0/816242263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba80b5df0 con 0x7ffba80d0ac0 2023-10-06T02:25:30.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.468+0000 7ffb9d7fa700 1 -- 172.21.15.37:0/816242263 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffba4007460 con 0x7ffba80d0ac0 2023-10-06T02:25:30.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.469+0000 7ffb9d7fa700 1 --2- 172.21.15.37:0/816242263 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ffb8c066f30 0x7ffb8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.469+0000 7ffb9d7fa700 1 -- 172.21.15.37:0/816242263 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6116+0+0 (secure 0 0 0) 0x7ffba4084190 con 0x7ffba80d0ac0 2023-10-06T02:25:30.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.469+0000 7ffbac958700 1 --2- 172.21.15.37:0/816242263 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ffb8c066f30 0x7ffb8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.469+0000 7ffbac958700 1 --2- 172.21.15.37:0/816242263 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ffb8c066f30 0x7ffb8c0693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ffb980093f0 tx=0x7ffb98008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:30.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.471+0000 7ffbb86b5b80 1 Processor -- start 2023-10-06T02:25:30.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.471+0000 7ffbb86b5b80 1 -- start start 2023-10-06T02:25:30.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.471+0000 7ffbb86b5b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479ad0890 0x55c479ad0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.471+0000 7ffbb86b5b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad1d10 0x55c479b20710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.471+0000 7ffbb86b5b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479b20c50 0x55c479b210a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.471+0000 7ffbb86b5b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c479a27ac0 con 0x55c479ad0890 2023-10-06T02:25:30.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.471+0000 7ffbb86b5b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c479a252c0 con 0x55c479b20c50 2023-10-06T02:25:30.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.471+0000 7ffbb86b5b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c479a210b0 con 0x55c479ad1d10 2023-10-06T02:25:30.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.471+0000 7ffbad159700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479ad0890 0x55c479ad0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.472+0000 7ffbad159700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479ad0890 0x55c479ad0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35338/0 (socket says 172.21.15.37:35338) 2023-10-06T02:25:30.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.472+0000 7ffbad159700 1 -- 172.21.15.37:0/866386751 learned_addr learned my addr 172.21.15.37:0/866386751 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:30.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.472+0000 7ffbac958700 1 --2- 172.21.15.37:0/866386751 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad1d10 0x55c479b20710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.472+0000 7ffbad95a700 1 --2- 172.21.15.37:0/866386751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479b20c50 0x55c479b210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.472+0000 7ffbad159700 1 -- 172.21.15.37:0/866386751 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad1d10 msgr2=0x55c479b20710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:30.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.472+0000 7ffbad159700 1 --2- 172.21.15.37:0/866386751 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad1d10 0x55c479b20710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.472+0000 7ffbad159700 1 -- 172.21.15.37:0/866386751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479b20c50 msgr2=0x55c479b210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:30.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.472+0000 7ffbad159700 1 --2- 172.21.15.37:0/866386751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479b20c50 0x55c479b210a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.472+0000 7ffbad159700 1 -- 172.21.15.37:0/866386751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4798bb2c0 con 0x55c479ad0890 2023-10-06T02:25:30.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.472+0000 7ffbad159700 1 --2- 172.21.15.37:0/866386751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479ad0890 0x55c479ad0c60 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ffba4001050 tx=0x7ffba4082470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f70fdfbe8a9b3e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:30.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.472+0000 7ffb927fc700 1 -- 172.21.15.37:0/866386751 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba4058170 con 0x55c479ad0890 2023-10-06T02:25:30.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.472+0000 7ffb927fc700 1 -- 172.21.15.37:0/866386751 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba405bec0 con 0x55c479ad0890 2023-10-06T02:25:30.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.472+0000 7ffb927fc700 1 -- 172.21.15.37:0/866386751 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba40532c0 con 0x55c479ad0890 2023-10-06T02:25:30.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.473+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/866386751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479ad0890 msgr2=0x55c479ad0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.473+0000 7ffbb86b5b80 1 --2- 172.21.15.37:0/866386751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479ad0890 0x55c479ad0c60 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ffba4001050 tx=0x7ffba4082470 comp rx=0 tx=0).stop 2023-10-06T02:25:30.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.473+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/866386751 shutdown_connections 2023-10-06T02:25:30.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.473+0000 7ffbb86b5b80 1 --2- 172.21.15.37:0/866386751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479b20c50 0x55c479b210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.473+0000 7ffbb86b5b80 1 --2- 172.21.15.37:0/866386751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479ad0890 0x55c479ad0c60 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.473+0000 7ffbb86b5b80 1 --2- 172.21.15.37:0/866386751 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad1d10 0x55c479b20710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.473+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/866386751 >> 172.21.15.37:0/866386751 conn(0x55c479ad21b0 msgr2=0x55c479ad2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:30.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.473+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/866386751 shutdown_connections 2023-10-06T02:25:30.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.473+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/866386751 wait complete. 2023-10-06T02:25:30.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.473+0000 7ffbb86b5b80 1 -- start start 2023-10-06T02:25:30.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.474+0000 7ffbb86b5b80 1 Processor -- start 2023-10-06T02:25:30.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.474+0000 7ffbb86b5b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad0890 0x55c479b2a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.474+0000 7ffbb86b5b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479ad1d10 0x55c479b2a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.474+0000 7ffbb86b5b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 0x55c479b12470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.474+0000 7ffbb86b5b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4799cc8e0 con 0x55c479b20c50 2023-10-06T02:25:30.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.474+0000 7ffbb86b5b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4799e7ef0 con 0x55c479ad1d10 2023-10-06T02:25:30.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.474+0000 7ffbb86b5b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4798a3e80 con 0x55c479ad0890 2023-10-06T02:25:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.474+0000 7ffbb86b5b80 10 client.0 _ll_register_callbacks cb 0x55c479a93ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:25:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.474+0000 7ffbad95a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 0x55c479b12470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.475+0000 7ffbad95a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 0x55c479b12470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35352/0 (socket says 172.21.15.37:35352) 2023-10-06T02:25:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.475+0000 7ffbad95a700 1 -- 172.21.15.37:0/670001678 learned_addr learned my addr 172.21.15.37:0/670001678 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.475+0000 7ffbad159700 1 --2- 172.21.15.37:0/670001678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad0890 0x55c479b2a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.475+0000 7ffbac958700 1 --2- 172.21.15.37:0/670001678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479ad1d10 0x55c479b2a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.475+0000 7ffbad95a700 1 -- 172.21.15.37:0/670001678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad0890 msgr2=0x55c479b2a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.475+0000 7ffbad95a700 1 --2- 172.21.15.37:0/670001678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad0890 0x55c479b2a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.475+0000 7ffbad95a700 1 -- 172.21.15.37:0/670001678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479ad1d10 msgr2=0x55c479b2a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.475+0000 7ffbad95a700 1 --2- 172.21.15.37:0/670001678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479ad1d10 0x55c479b2a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.475+0000 7ffbad95a700 1 -- 172.21.15.37:0/670001678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba80b5df0 con 0x55c479b20c50 2023-10-06T02:25:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.475+0000 7ffbad95a700 1 --2- 172.21.15.37:0/670001678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 0x55c479b12470 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ffba815e230 tx=0x7ffba0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffeaf9e137d41ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:30.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.475+0000 7ffb877fe700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:25:30.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.475+0000 7ffb877fe700 1 -- 172.21.15.37:0/670001678 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba0023070 con 0x55c479b20c50 2023-10-06T02:25:30.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.475+0000 7ffb877fe700 1 -- 172.21.15.37:0/670001678 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 6116+0+0 (secure 0 0 0) 0x7ffba001d630 con 0x55c479b20c50 2023-10-06T02:25:30.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.475+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/670001678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c479ac5990 con 0x55c479b20c50 2023-10-06T02:25:30.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.475+0000 7ffb877fe700 1 -- 172.21.15.37:0/670001678 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffba000bc10 con 0x55c479b20c50 2023-10-06T02:25:30.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.475+0000 7ffbb86b5b80 10 client.5649 fetch_fsmap learned FSMap version 23 2023-10-06T02:25:30.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.475+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/670001678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55c47985e030 con 0x55c479b20c50 2023-10-06T02:25:30.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.475+0000 7ffb877fe700 1 -- 172.21.15.37:0/670001678 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c479ac5990 con 0x55c479b20c50 2023-10-06T02:25:30.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.476+0000 7ffb877fe700 1 -- 172.21.15.37:0/670001678 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffba000b050 con 0x55c479b20c50 2023-10-06T02:25:30.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.476+0000 7ffbb86b5b80 10 client.5649 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T02:25:30.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.476+0000 7ffbb86b5b80 10 client.5649 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2023-10-06T02:25:30.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.476+0000 7ffbb86b5b80 20 client.5649 populate_metadata read hostname 'smithi037' 2023-10-06T02:25:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.476+0000 7ffbb86b5b80 1 --2- 172.21.15.37:0/670001678 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55c479b26d30 0x55c479b27130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.476+0000 7ffbb86b5b80 4 client.5649 mds_command: new command op to 5400 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:25:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.476+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/670001678 --> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c479aa28c0 con 0x55c479b26d30 2023-10-06T02:25:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.476+0000 7ffbad159700 1 --2- 172.21.15.37:0/670001678 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55c479b26d30 0x55c479b27130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.476+0000 7ffb877fe700 10 client.5649 ms_handle_connect on v2:172.21.15.191:6834/2931117635 2023-10-06T02:25:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.476+0000 7ffbad159700 1 --2- 172.21.15.37:0/670001678 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55c479b26d30 0x55c479b27130 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a13c717a898d2f7d server_cookie=bd35cdb5b9d467e2 in_seq=0 out_seq=0 2023-10-06T02:25:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.477+0000 7ffb877fe700 1 -- 172.21.15.37:0/670001678 <== mds.0 v2:172.21.15.191:6834/2931117635 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c479aa28c0 con 0x55c479b26d30 2023-10-06T02:25:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.477+0000 7ffb877fe700 10 client.5649 handle_command_reply: tid=0 2023-10-06T02:25:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.477+0000 7ffbb86b5b80 1 client.5649 shutdown 2023-10-06T02:25:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.477+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/670001678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 msgr2=0x55c479b12470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.477+0000 7ffbb86b5b80 1 --2- 172.21.15.37:0/670001678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 0x55c479b12470 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ffba815e230 tx=0x7ffba0018000 comp rx=0 tx=0).stop 2023-10-06T02:25:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.477+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/670001678 shutdown_connections 2023-10-06T02:25:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.477+0000 7ffbb86b5b80 1 --2- 172.21.15.37:0/670001678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 0x55c479b12470 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.477+0000 7ffbb86b5b80 1 --2- 172.21.15.37:0/670001678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad0890 0x55c479b2a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.477+0000 7ffbb86b5b80 1 --2- 172.21.15.37:0/670001678 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55c479b26d30 0x55c479b27130 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.477+0000 7ffbb86b5b80 1 --2- 172.21.15.37:0/670001678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479ad1d10 0x55c479b2a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.477+0000 7ffb877fe700 0 client.5649 ms_handle_reset on v2:172.21.15.191:6834/2931117635 2023-10-06T02:25:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.477+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/670001678 >> 172.21.15.37:0/670001678 conn(0x55c479ad21b0 msgr2=0x55c479af6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.477+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/670001678 shutdown_connections 2023-10-06T02:25:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.477+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/670001678 wait complete. 2023-10-06T02:25:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.477+0000 7ffbb86b5b80 20 client.5649 trim_cache size 0 max 16384 2023-10-06T02:25:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.493+0000 7ffbb86b5b80 1 Processor -- start 2023-10-06T02:25:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.494+0000 7ffbb86b5b80 1 -- start start 2023-10-06T02:25:30.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.494+0000 7ffbb86b5b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479ad0890 0x55c479b1a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.494+0000 7ffbb86b5b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad1d10 0x55c479b1a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.494+0000 7ffbb86b5b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 0x55c479b29e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.494+0000 7ffbb86b5b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c479acefc0 con 0x55c479b20c50 2023-10-06T02:25:30.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.494+0000 7ffbb86b5b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c479acb670 con 0x55c479ad0890 2023-10-06T02:25:30.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.494+0000 7ffbb86b5b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c479b15970 con 0x55c479ad1d10 2023-10-06T02:25:30.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.494+0000 7ffbad95a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 0x55c479b29e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.494+0000 7ffbad95a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 0x55c479b29e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35360/0 (socket says 172.21.15.37:35360) 2023-10-06T02:25:30.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.494+0000 7ffbad95a700 1 -- 172.21.15.37:0/3416295238 learned_addr learned my addr 172.21.15.37:0/3416295238 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:30.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.494+0000 7ffbac958700 1 --2- 172.21.15.37:0/3416295238 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad1d10 0x55c479b1a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.494+0000 7ffbad159700 1 --2- 172.21.15.37:0/3416295238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479ad0890 0x55c479b1a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.495+0000 7ffbad95a700 1 -- 172.21.15.37:0/3416295238 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad1d10 msgr2=0x55c479b1a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:30.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.495+0000 7ffbad95a700 1 --2- 172.21.15.37:0/3416295238 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad1d10 0x55c479b1a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.495+0000 7ffbad95a700 1 -- 172.21.15.37:0/3416295238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479ad0890 msgr2=0x55c479b1a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:30.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.495+0000 7ffbad95a700 1 --2- 172.21.15.37:0/3416295238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479ad0890 0x55c479b1a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.495+0000 7ffbad95a700 1 -- 172.21.15.37:0/3416295238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4799ef7d0 con 0x55c479b20c50 2023-10-06T02:25:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.495+0000 7ffbad159700 1 --2- 172.21.15.37:0/3416295238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479ad0890 0x55c479b1a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.495+0000 7ffbac958700 1 --2- 172.21.15.37:0/3416295238 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad1d10 0x55c479b1a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.495+0000 7ffbad95a700 1 --2- 172.21.15.37:0/3416295238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 0x55c479b29e10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ffba001db40 tx=0x7ffba0023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd234dffbd54a4f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.495+0000 7ffb92ffd700 1 -- 172.21.15.37:0/3416295238 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba001d630 con 0x55c479b20c50 2023-10-06T02:25:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.495+0000 7ffb92ffd700 1 -- 172.21.15.37:0/3416295238 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba000b030 con 0x55c479b20c50 2023-10-06T02:25:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.495+0000 7ffb92ffd700 1 -- 172.21.15.37:0/3416295238 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba000bd90 con 0x55c479b20c50 2023-10-06T02:25:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.495+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/3416295238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 msgr2=0x55c479b29e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.495+0000 7ffbb86b5b80 1 --2- 172.21.15.37:0/3416295238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 0x55c479b29e10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ffba001db40 tx=0x7ffba0023000 comp rx=0 tx=0).stop 2023-10-06T02:25:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.495+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/3416295238 shutdown_connections 2023-10-06T02:25:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.495+0000 7ffbb86b5b80 1 --2- 172.21.15.37:0/3416295238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 0x55c479b29e10 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.495+0000 7ffbb86b5b80 1 --2- 172.21.15.37:0/3416295238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479ad0890 0x55c479b1a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.496+0000 7ffbb86b5b80 1 --2- 172.21.15.37:0/3416295238 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad1d10 0x55c479b1a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.496+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/3416295238 >> 172.21.15.37:0/3416295238 conn(0x55c479ad21b0 msgr2=0x55c479ad2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:30.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.496+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/3416295238 shutdown_connections 2023-10-06T02:25:30.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.496+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/3416295238 wait complete. 2023-10-06T02:25:30.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.496+0000 7ffbb86b5b80 1 -- start start 2023-10-06T02:25:30.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.496+0000 7ffbb86b5b80 1 Processor -- start 2023-10-06T02:25:30.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.497+0000 7ffbb86b5b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad0890 0x55c479b1af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.497+0000 7ffbb86b5b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479ad1d10 0x55c479b7c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.497+0000 7ffbb86b5b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 0x55c479b1a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.497+0000 7ffbb86b5b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c479b1ff90 con 0x55c479b20c50 2023-10-06T02:25:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.497+0000 7ffbb86b5b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c479b2ac30 con 0x55c479ad1d10 2023-10-06T02:25:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.497+0000 7ffbb86b5b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c479b2a950 con 0x55c479ad0890 2023-10-06T02:25:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.497+0000 7ffbb86b5b80 10 client.0 _ll_register_callbacks cb 0x55c479a93ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:25:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.497+0000 7ffbad95a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 0x55c479b1a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.497+0000 7ffbad95a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 0x55c479b1a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35374/0 (socket says 172.21.15.37:35374) 2023-10-06T02:25:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.497+0000 7ffbad95a700 1 -- 172.21.15.37:0/4150361272 learned_addr learned my addr 172.21.15.37:0/4150361272 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.497+0000 7ffbac958700 1 --2- 172.21.15.37:0/4150361272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479ad1d10 0x55c479b7c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.497+0000 7ffbad159700 1 --2- 172.21.15.37:0/4150361272 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad0890 0x55c479b1af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.497+0000 7ffbad95a700 1 -- 172.21.15.37:0/4150361272 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad0890 msgr2=0x55c479b1af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.497+0000 7ffbad95a700 1 --2- 172.21.15.37:0/4150361272 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad0890 0x55c479b1af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.497+0000 7ffbad95a700 1 -- 172.21.15.37:0/4150361272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479ad1d10 msgr2=0x55c479b7c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.497+0000 7ffbad95a700 1 --2- 172.21.15.37:0/4150361272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479ad1d10 0x55c479b7c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.497+0000 7ffbad95a700 1 -- 172.21.15.37:0/4150361272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c47985e030 con 0x55c479b20c50 2023-10-06T02:25:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.498+0000 7ffbad95a700 1 --2- 172.21.15.37:0/4150361272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 0x55c479b1a190 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffba000b810 tx=0x7ffba0035040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3433aafb879cbf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.498+0000 7ffb877fe700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:25:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.498+0000 7ffb877fe700 1 -- 172.21.15.37:0/4150361272 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba0023040 con 0x55c479b20c50 2023-10-06T02:25:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.498+0000 7ffb877fe700 1 -- 172.21.15.37:0/4150361272 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 6116+0+0 (secure 0 0 0) 0x7ffba001d670 con 0x55c479b20c50 2023-10-06T02:25:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.498+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/4150361272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffba405bec0 con 0x55c479b20c50 2023-10-06T02:25:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.498+0000 7ffb877fe700 1 -- 172.21.15.37:0/4150361272 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffba003c480 con 0x55c479b20c50 2023-10-06T02:25:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.498+0000 7ffbb86b5b80 10 client.5655 fetch_fsmap learned FSMap version 23 2023-10-06T02:25:30.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.498+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/4150361272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55c4799d64c0 con 0x55c479b20c50 2023-10-06T02:25:30.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.498+0000 7ffb877fe700 1 -- 172.21.15.37:0/4150361272 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba405bec0 con 0x55c479b20c50 2023-10-06T02:25:30.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.498+0000 7ffb877fe700 1 -- 172.21.15.37:0/4150361272 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffba003c5e0 con 0x55c479b20c50 2023-10-06T02:25:30.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.498+0000 7ffbb86b5b80 10 client.5655 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T02:25:30.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.498+0000 7ffbb86b5b80 10 client.5655 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2023-10-06T02:25:30.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.498+0000 7ffbb86b5b80 20 client.5655 populate_metadata read hostname 'smithi037' 2023-10-06T02:25:30.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.498+0000 7ffbb86b5b80 1 --2- 172.21.15.37:0/4150361272 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55c479b00920 0x55c479b1a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.498+0000 7ffbb86b5b80 4 client.5655 mds_command: new command op to 5400 tid=0[{"prefix": "scrub status"}] 2023-10-06T02:25:30.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.498+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/4150361272 --> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c4799c3e50 con 0x55c479b00920 2023-10-06T02:25:30.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.498+0000 7ffbad159700 1 --2- 172.21.15.37:0/4150361272 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55c479b00920 0x55c479b1a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.499+0000 7ffb877fe700 10 client.5655 ms_handle_connect on v2:172.21.15.191:6834/2931117635 2023-10-06T02:25:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.499+0000 7ffbad159700 1 --2- 172.21.15.37:0/4150361272 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55c479b00920 0x55c479b1a6d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53bf657ca64367fd server_cookie=27c23762e07c160d in_seq=0 out_seq=0 2023-10-06T02:25:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.499+0000 7ffb877fe700 1 -- 172.21.15.37:0/4150361272 <== mds.0 v2:172.21.15.191:6834/2931117635 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c4799c3e50 con 0x55c479b00920 2023-10-06T02:25:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.499+0000 7ffb877fe700 10 client.5655 handle_command_reply: tid=0 2023-10-06T02:25:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.499+0000 7ffbb86b5b80 1 client.5655 shutdown 2023-10-06T02:25:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.499+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/4150361272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 msgr2=0x55c479b1a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.499+0000 7ffbb86b5b80 1 --2- 172.21.15.37:0/4150361272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 0x55c479b1a190 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffba000b810 tx=0x7ffba0035040 comp rx=0 tx=0).stop 2023-10-06T02:25:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.499+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/4150361272 shutdown_connections 2023-10-06T02:25:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.499+0000 7ffbb86b5b80 1 --2- 172.21.15.37:0/4150361272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c479b20c50 0x55c479b1a190 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.499+0000 7ffbb86b5b80 1 --2- 172.21.15.37:0/4150361272 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c479ad0890 0x55c479b1af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.499+0000 7ffbb86b5b80 1 --2- 172.21.15.37:0/4150361272 >> [v2:172.21.15.191:6834/2931117635,v1:172.21.15.191:6836/2931117635] conn(0x55c479b00920 0x55c479b1a6d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.499+0000 7ffbb86b5b80 1 --2- 172.21.15.37:0/4150361272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c479ad1d10 0x55c479b7c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.499+0000 7ffb877fe700 0 client.5655 ms_handle_reset on v2:172.21.15.191:6834/2931117635 2023-10-06T02:25:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.499+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/4150361272 >> 172.21.15.37:0/4150361272 conn(0x55c479ad21b0 msgr2=0x55c479ad2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.499+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/4150361272 shutdown_connections 2023-10-06T02:25:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.499+0000 7ffbb86b5b80 1 -- 172.21.15.37:0/4150361272 wait complete. 2023-10-06T02:25:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.499+0000 7ffbb86b5b80 20 client.5655 trim_cache size 0 max 16384 2023-10-06T02:25:30.508 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:25:30.508 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2023-10-06T02:25:30.508 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2023-10-06T02:25:30.508 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:25:30.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.500+0000 7ffbaf3bd700 1 -- 172.21.15.37:0/816242263 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ffb8c066f30 msgr2=0x7ffb8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.500+0000 7ffbaf3bd700 1 --2- 172.21.15.37:0/816242263 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ffb8c066f30 0x7ffb8c0693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ffb980093f0 tx=0x7ffb98008040 comp rx=0 tx=0).stop 2023-10-06T02:25:30.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.500+0000 7ffbaf3bd700 1 -- 172.21.15.37:0/816242263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba80d0ac0 msgr2=0x7ffba80c7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.500+0000 7ffbaf3bd700 1 --2- 172.21.15.37:0/816242263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba80d0ac0 0x7ffba80c7a30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ffba400c7c0 tx=0x7ffba4007f70 comp rx=0 tx=0).stop 2023-10-06T02:25:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.500+0000 7ffbaf3bd700 1 -- 172.21.15.37:0/816242263 shutdown_connections 2023-10-06T02:25:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.500+0000 7ffbaf3bd700 1 --2- 172.21.15.37:0/816242263 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ffb8c066f30 0x7ffb8c0693e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.500+0000 7ffbaf3bd700 1 --2- 172.21.15.37:0/816242263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffba815d960 0x7ffba8169d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.500+0000 7ffbaf3bd700 1 --2- 172.21.15.37:0/816242263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba80d0ac0 0x7ffba80c7a30 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.500+0000 7ffbaf3bd700 1 --2- 172.21.15.37:0/816242263 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba80d0e90 0x7ffba815bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.500+0000 7ffbaf3bd700 1 -- 172.21.15.37:0/816242263 >> 172.21.15.37:0/816242263 conn(0x7ffba806c0b0 msgr2=0x7ffba8156e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.500+0000 7ffbaf3bd700 1 -- 172.21.15.37:0/816242263 shutdown_connections 2023-10-06T02:25:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.500+0000 7ffbaf3bd700 1 -- 172.21.15.37:0/816242263 wait complete. 2023-10-06T02:25:30.513 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T02:25:30.614 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:30.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.732+0000 7fb6dce19700 1 Processor -- start 2023-10-06T02:25:30.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.732+0000 7fb6dce19700 1 -- start start 2023-10-06T02:25:30.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.733+0000 7fb6dce19700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb6d80aedf0 0x7fb6d81577a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.733+0000 7fb6dce19700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb6d8157ce0 0x7fb6d806b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.733+0000 7fb6dce19700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d80b1c70 con 0x7fb6d81573d0 2023-10-06T02:25:30.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.733+0000 7fb6dce19700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d80af340 con 0x7fb6d80aedf0 2023-10-06T02:25:30.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.733+0000 7fb6dce19700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d80af620 con 0x7fb6d8157ce0 2023-10-06T02:25:30.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.733+0000 7fb6d5d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb6d80aedf0 0x7fb6d81577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.733+0000 7fb6d659c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb6d81573d0 0x7fb6d815bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43054/0 (socket says 172.21.15.37:43054) 2023-10-06T02:25:30.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.733+0000 7fb6d659c700 1 -- 172.21.15.37:0/1358713471 learned_addr learned my addr 172.21.15.37:0/1358713471 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:30.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.734+0000 7fb6d5d9b700 1 -- 172.21.15.37:0/1358713471 >> v2:172.21.15.191:3300/0 conn(0x7fb6d8157ce0 msgr2=0x7fb6d806b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:30.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.734+0000 7fb6d6d9d700 1 --2- 172.21.15.37:0/1358713471 >> v2:172.21.15.191:3300/0 conn(0x7fb6d8157ce0 0x7fb6d806b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.734+0000 7fb6d5d9b700 1 --2- 172.21.15.37:0/1358713471 >> v2:172.21.15.191:3300/0 conn(0x7fb6d8157ce0 0x7fb6d806b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.734+0000 7fb6d559a700 1 -- 172.21.15.37:0/1358713471 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3874376208 0 0) 0x7fb6d80b1c70 con 0x7fb6d81573d0 2023-10-06T02:25:30.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.734+0000 7fb6d5d9b700 1 -- 172.21.15.37:0/1358713471 >> v1:172.21.15.37:6789/0 conn(0x7fb6d81573d0 legacy=0x7fb6d815bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.734+0000 7fb6d5d9b700 1 -- 172.21.15.37:0/1358713471 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d80b1900 con 0x7fb6d80aedf0 2023-10-06T02:25:30.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.734+0000 7fb6d5d9b700 1 --2- 172.21.15.37:0/1358713471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d80aedf0 0x7fb6d81577a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80afd60 tx=0x7fb6c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b3edcbf6b2de6e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:30.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.734+0000 7fb6d559a700 1 -- 172.21.15.37:0/1358713471 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c000b6b0 con 0x7fb6d80aedf0 2023-10-06T02:25:30.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.734+0000 7fb6d559a700 1 -- 172.21.15.37:0/1358713471 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c000b810 con 0x7fb6d80aedf0 2023-10-06T02:25:30.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.734+0000 7fb6d559a700 1 -- 172.21.15.37:0/1358713471 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c000bbb0 con 0x7fb6d80aedf0 2023-10-06T02:25:30.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.735+0000 7fb6dce19700 1 -- 172.21.15.37:0/1358713471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d80aedf0 msgr2=0x7fb6d81577a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.735+0000 7fb6dce19700 1 --2- 172.21.15.37:0/1358713471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d80aedf0 0x7fb6d81577a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80afd60 tx=0x7fb6c00091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.735+0000 7fb6dce19700 1 -- 172.21.15.37:0/1358713471 shutdown_connections 2023-10-06T02:25:30.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.735+0000 7fb6dce19700 1 --2- 172.21.15.37:0/1358713471 >> v2:172.21.15.191:3300/0 conn(0x7fb6d8157ce0 0x7fb6d806b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.735+0000 7fb6dce19700 1 --2- 172.21.15.37:0/1358713471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d80aedf0 0x7fb6d81577a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.735+0000 7fb6dce19700 1 -- 172.21.15.37:0/1358713471 >> 172.21.15.37:0/1358713471 conn(0x7fb6d806dc40 msgr2=0x7fb6d8067660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:30.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.735+0000 7fb6dce19700 1 -- 172.21.15.37:0/1358713471 shutdown_connections 2023-10-06T02:25:30.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.735+0000 7fb6dce19700 1 -- 172.21.15.37:0/1358713471 wait complete. 2023-10-06T02:25:30.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.736+0000 7fb6dce19700 1 Processor -- start 2023-10-06T02:25:30.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.736+0000 7fb6dce19700 1 -- start start 2023-10-06T02:25:30.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6dce19700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6d80aedf0 0x7fb6d815cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6dce19700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d81573d0 0x7fb6d813bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6dce19700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb6d8157ce0 0x7fb6d813b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6dce19700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d815d0d0 con 0x7fb6d81573d0 2023-10-06T02:25:30.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6dce19700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d814d3d0 con 0x7fb6d80aedf0 2023-10-06T02:25:30.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6dce19700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d80ad0a0 con 0x7fb6d8157ce0 2023-10-06T02:25:30.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6d5d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d81573d0 0x7fb6d813bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6d5d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d81573d0 0x7fb6d813bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35394/0 (socket says 172.21.15.37:35394) 2023-10-06T02:25:30.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6d5d9b700 1 -- 172.21.15.37:0/3204163724 learned_addr learned my addr 172.21.15.37:0/3204163724 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:30.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6d659c700 1 --2- 172.21.15.37:0/3204163724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6d80aedf0 0x7fb6d815cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6d6d9d700 1 --2- 172.21.15.37:0/3204163724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb6d8157ce0 0x7fb6d813b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6d5d9b700 1 -- 172.21.15.37:0/3204163724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb6d8157ce0 msgr2=0x7fb6d813b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6d5d9b700 1 --2- 172.21.15.37:0/3204163724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb6d8157ce0 0x7fb6d813b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6d5d9b700 1 -- 172.21.15.37:0/3204163724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6d80aedf0 msgr2=0x7fb6d815cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6d5d9b700 1 --2- 172.21.15.37:0/3204163724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6d80aedf0 0x7fb6d815cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6d5d9b700 1 -- 172.21.15.37:0/3204163724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c0009420 con 0x7fb6d81573d0 2023-10-06T02:25:30.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6d659c700 1 --2- 172.21.15.37:0/3204163724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6d80aedf0 0x7fb6d815cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:30.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6d5d9b700 1 --2- 172.21.15.37:0/3204163724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d81573d0 0x7fb6d813bf40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb6d806eed0 tx=0x7fb6c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:30.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6ce7fc700 1 -- 172.21.15.37:0/3204163724 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0011420 con 0x7fb6d81573d0 2023-10-06T02:25:30.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6ce7fc700 1 -- 172.21.15.37:0/3204163724 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c00115a0 con 0x7fb6d81573d0 2023-10-06T02:25:30.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6dce19700 1 -- 172.21.15.37:0/3204163724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d80ad380 con 0x7fb6d81573d0 2023-10-06T02:25:30.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6ce7fc700 1 -- 172.21.15.37:0/3204163724 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0011960 con 0x7fb6d81573d0 2023-10-06T02:25:30.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.737+0000 7fb6dce19700 1 -- 172.21.15.37:0/3204163724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d80ad710 con 0x7fb6d81573d0 2023-10-06T02:25:30.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.738+0000 7fb6dce19700 1 -- 172.21.15.37:0/3204163724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d80ad510 con 0x7fb6d81573d0 2023-10-06T02:25:30.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.739+0000 7fb6ce7fc700 1 -- 172.21.15.37:0/3204163724 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb6c0011d50 con 0x7fb6d81573d0 2023-10-06T02:25:30.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.739+0000 7fb6ce7fc700 1 --2- 172.21.15.37:0/3204163724 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb6b8066f30 0x7fb6b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:30.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.739+0000 7fb6ce7fc700 1 -- 172.21.15.37:0/3204163724 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fb6c00861c0 con 0x7fb6d81573d0 2023-10-06T02:25:30.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.739+0000 7fb6d659c700 1 --2- 172.21.15.37:0/3204163724 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb6b8066f30 0x7fb6b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:30.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.740+0000 7fb6d659c700 1 --2- 172.21.15.37:0/3204163724 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb6b8066f30 0x7fb6b80693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00018d0 tx=0x7fb6d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:30.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.744+0000 7fb6ce7fc700 1 -- 172.21.15.37:0/3204163724 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6c0053290 con 0x7fb6d81573d0 2023-10-06T02:25:30.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.982+0000 7fb6dce19700 1 -- 172.21.15.37:0/3204163724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6d8070c30 con 0x7fb6d81573d0 2023-10-06T02:25:30.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.983+0000 7fb6ce7fc700 1 -- 172.21.15.37:0/3204163724 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fb6c00568b0 con 0x7fb6d81573d0 2023-10-06T02:25:30.984 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:30.984 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2341182274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2341182274},{"type":"v1","addr":"172.21.15.191:6837","nonce":2341182274}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5385,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/562500386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":562500386},{"type":"v1","addr":"172.21.15.37:6834","nonce":562500386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1403086996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1403086996},{"type":"v1","addr":"172.21.15.37:6835","nonce":1403086996}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:50.379875+0000","modified":"2023-10-06T02:24:54.014513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5400":{"gid":5400,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6836/2931117635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2931117635},{"type":"v1","addr":"172.21.15.191:6836","nonce":2931117635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:25:30.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.984+0000 7fb6dce19700 1 -- 172.21.15.37:0/3204163724 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb6b8066f30 msgr2=0x7fb6b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.984+0000 7fb6dce19700 1 --2- 172.21.15.37:0/3204163724 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb6b8066f30 0x7fb6b80693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00018d0 tx=0x7fb6d0009040 comp rx=0 tx=0).stop 2023-10-06T02:25:30.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.985+0000 7fb6dce19700 1 -- 172.21.15.37:0/3204163724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d81573d0 msgr2=0x7fb6d813bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:30.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.985+0000 7fb6dce19700 1 --2- 172.21.15.37:0/3204163724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d81573d0 0x7fb6d813bf40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb6d806eed0 tx=0x7fb6c0017000 comp rx=0 tx=0).stop 2023-10-06T02:25:30.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.985+0000 7fb6dce19700 1 -- 172.21.15.37:0/3204163724 shutdown_connections 2023-10-06T02:25:30.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.985+0000 7fb6dce19700 1 --2- 172.21.15.37:0/3204163724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb6d8157ce0 0x7fb6d813b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.985+0000 7fb6dce19700 1 --2- 172.21.15.37:0/3204163724 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb6b8066f30 0x7fb6b80693e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.985+0000 7fb6dce19700 1 --2- 172.21.15.37:0/3204163724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6d80aedf0 0x7fb6d815cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.985+0000 7fb6dce19700 1 --2- 172.21.15.37:0/3204163724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d81573d0 0x7fb6d813bf40 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:30.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.985+0000 7fb6dce19700 1 -- 172.21.15.37:0/3204163724 >> 172.21.15.37:0/3204163724 conn(0x7fb6d806dc40 msgr2=0x7fb6d80cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:30.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.985+0000 7fb6dce19700 1 -- 172.21.15.37:0/3204163724 shutdown_connections 2023-10-06T02:25:30.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:30.985+0000 7fb6dce19700 1 -- 172.21.15.37:0/3204163724 wait complete. 2023-10-06T02:25:30.988 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 23 2023-10-06T02:25:30.998 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2023-10-06T02:25:31.146 INFO:teuthology.orchestra.run.smithi191.stdout:{"message":"","return_code":0} 2023-10-06T02:25:31.146 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T02:25:31.147 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-10-06T02:25:31.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.184+0000 7fcd70f19000 1 Processor -- start 2023-10-06T02:25:31.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.184+0000 7fcd70f19000 1 -- start start 2023-10-06T02:25:31.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.185+0000 7fcd70f19000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559bde299d0 0x5559bdee1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.185+0000 7fcd70f19000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559bdee3a80 0x5559bdee2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.185+0000 7fcd70f19000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559bde55080 0x5559bdedebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.185+0000 7fcd70f19000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559bdd71980 con 0x5559bdee3a80 2023-10-06T02:25:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.185+0000 7fcd70f19000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559bdd71620 con 0x5559bde299d0 2023-10-06T02:25:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.185+0000 7fcd70f19000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5559bdd68400 con 0x5559bde55080 2023-10-06T02:25:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.185+0000 7fcd69953700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559bdee3a80 0x5559bdee2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.185+0000 7fcd69953700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559bdee3a80 0x5559bdee2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35404/0 (socket says 172.21.15.37:35404) 2023-10-06T02:25:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.185+0000 7fcd69953700 1 -- 172.21.15.37:0/332858380 learned_addr learned my addr 172.21.15.37:0/332858380 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd6a154700 1 --2- 172.21.15.37:0/332858380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559bde299d0 0x5559bdee1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd6a955700 1 --2- 172.21.15.37:0/332858380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559bde55080 0x5559bdedebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd69953700 1 -- 172.21.15.37:0/332858380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559bde55080 msgr2=0x5559bdedebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd69953700 1 --2- 172.21.15.37:0/332858380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559bde55080 0x5559bdedebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd69953700 1 -- 172.21.15.37:0/332858380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559bde299d0 msgr2=0x5559bdee1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:31.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd69953700 1 --2- 172.21.15.37:0/332858380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559bde299d0 0x5559bdee1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd69953700 1 -- 172.21.15.37:0/332858380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd64005cf0 con 0x5559bdee3a80 2023-10-06T02:25:31.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd6a154700 1 --2- 172.21.15.37:0/332858380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559bde299d0 0x5559bdee1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:31.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd69953700 1 --2- 172.21.15.37:0/332858380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559bdee3a80 0x5559bdee2c10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400b3d0 tx=0x7fcd540017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7618368a06ea2345 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:31.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd68951700 1 -- 172.21.15.37:0/332858380 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5400be90 con 0x5559bdee3a80 2023-10-06T02:25:31.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd68951700 1 -- 172.21.15.37:0/332858380 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5400e470 con 0x5559bdee3a80 2023-10-06T02:25:31.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd68951700 1 -- 172.21.15.37:0/332858380 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5400e810 con 0x5559bdee3a80 2023-10-06T02:25:31.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd70f19000 1 -- 172.21.15.37:0/332858380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559bdee3a80 msgr2=0x5559bdee2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd70f19000 1 --2- 172.21.15.37:0/332858380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559bdee3a80 0x5559bdee2c10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400b3d0 tx=0x7fcd540017f0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd70f19000 1 -- 172.21.15.37:0/332858380 shutdown_connections 2023-10-06T02:25:31.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd70f19000 1 --2- 172.21.15.37:0/332858380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559bde55080 0x5559bdedebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd70f19000 1 --2- 172.21.15.37:0/332858380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559bde299d0 0x5559bdee1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd70f19000 1 --2- 172.21.15.37:0/332858380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559bdee3a80 0x5559bdee2c10 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd70f19000 1 -- 172.21.15.37:0/332858380 >> 172.21.15.37:0/332858380 conn(0x5559bde6faf0 msgr2=0x5559bdf00420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:31.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd70f19000 1 -- 172.21.15.37:0/332858380 shutdown_connections 2023-10-06T02:25:31.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.186+0000 7fcd70f19000 1 -- 172.21.15.37:0/332858380 wait complete. 2023-10-06T02:25:31.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.187+0000 7fcd70f19000 1 Processor -- start 2023-10-06T02:25:31.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.187+0000 7fcd70f19000 1 -- start start 2023-10-06T02:25:31.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.188+0000 7fcd70f19000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559bde299d0 0x5559bde6d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.188+0000 7fcd70f19000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559bde55080 0x5559bdee0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.188+0000 7fcd70f19000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559bdee3a80 0x5559bde49930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.188+0000 7fcd70f19000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559bde4a390 con 0x5559bdee3a80 2023-10-06T02:25:31.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.188+0000 7fcd70f19000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559bde6c7c0 con 0x5559bde55080 2023-10-06T02:25:31.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.188+0000 7fcd70f19000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5559bde6ca60 con 0x5559bde299d0 2023-10-06T02:25:31.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.188+0000 7fcd6a955700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559bdee3a80 0x5559bde49930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.188+0000 7fcd6a955700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559bdee3a80 0x5559bde49930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35410/0 (socket says 172.21.15.37:35410) 2023-10-06T02:25:31.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.188+0000 7fcd6a955700 1 -- 172.21.15.37:0/4148046934 learned_addr learned my addr 172.21.15.37:0/4148046934 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:31.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.188+0000 7fcd69953700 1 --2- 172.21.15.37:0/4148046934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559bde55080 0x5559bdee0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.188+0000 7fcd6a154700 1 --2- 172.21.15.37:0/4148046934 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559bde299d0 0x5559bde6d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.188+0000 7fcd6a955700 1 -- 172.21.15.37:0/4148046934 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559bde299d0 msgr2=0x5559bde6d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.188+0000 7fcd6a955700 1 --2- 172.21.15.37:0/4148046934 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559bde299d0 0x5559bde6d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.188+0000 7fcd6a955700 1 -- 172.21.15.37:0/4148046934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559bde55080 msgr2=0x5559bdee0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.188+0000 7fcd6a955700 1 --2- 172.21.15.37:0/4148046934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559bde55080 0x5559bdee0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.188+0000 7fcd6a955700 1 -- 172.21.15.37:0/4148046934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd54001ad0 con 0x5559bdee3a80 2023-10-06T02:25:31.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.188+0000 7fcd6a955700 1 --2- 172.21.15.37:0/4148046934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559bdee3a80 0x5559bde49930 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x5559bdf00fa0 tx=0x7fcd5c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:31.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.188+0000 7fcd62ffd700 1 -- 172.21.15.37:0/4148046934 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c0032f0 con 0x5559bdee3a80 2023-10-06T02:25:31.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.189+0000 7fcd62ffd700 1 -- 172.21.15.37:0/4148046934 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5c00fa70 con 0x5559bdee3a80 2023-10-06T02:25:31.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.189+0000 7fcd70f19000 1 -- 172.21.15.37:0/4148046934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5c00a0e0 con 0x5559bdee3a80 2023-10-06T02:25:31.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.189+0000 7fcd62ffd700 1 -- 172.21.15.37:0/4148046934 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c00fe00 con 0x5559bdee3a80 2023-10-06T02:25:31.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.189+0000 7fcd70f19000 1 -- 172.21.15.37:0/4148046934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559bdd803d0 con 0x5559bdee3a80 2023-10-06T02:25:31.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.190+0000 7fcd62ffd700 1 -- 172.21.15.37:0/4148046934 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd5c022070 con 0x5559bdee3a80 2023-10-06T02:25:31.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.190+0000 7fcd62ffd700 1 --2- 172.21.15.37:0/4148046934 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcd4c0658c0 0x7fcd4c067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.190+0000 7fcd62ffd700 1 -- 172.21.15.37:0/4148046934 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fcd5c005e40 con 0x5559bdee3a80 2023-10-06T02:25:31.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.190+0000 7fcd6a154700 1 --2- 172.21.15.37:0/4148046934 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcd4c0658c0 0x7fcd4c067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.190+0000 7fcd70f19000 1 --2- 172.21.15.37:0/4148046934 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5559bde49e70 0x5559bdf0d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.190+0000 7fcd70f19000 1 -- 172.21.15.37:0/4148046934 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45) v8 -- 0x5559bdf0def0 con 0x5559bde49e70 2023-10-06T02:25:31.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.191+0000 7fcd69953700 1 --2- 172.21.15.37:0/4148046934 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5559bde49e70 0x5559bdf0d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.191+0000 7fcd6a154700 1 --2- 172.21.15.37:0/4148046934 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcd4c0658c0 0x7fcd4c067d70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcd64009d60 tx=0x7fcd64005a50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.191+0000 7fcd69953700 1 --2- 172.21.15.37:0/4148046934 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5559bde49e70 0x5559bdf0d9b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.191+0000 7fcd69953700 1 -- 172.21.15.37:0/4148046934 <== osd.1 v2:172.21.15.37:6808/90617 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7fcd54022070 con 0x5559bde49e70 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.191+0000 7fcd70f19000 1 -- 172.21.15.37:0/4148046934 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5559bde49e70 msgr2=0x5559bdf0d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.191+0000 7fcd70f19000 1 --2- 172.21.15.37:0/4148046934 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5559bde49e70 0x5559bdf0d9b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.191+0000 7fcd70f19000 1 -- 172.21.15.37:0/4148046934 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcd4c0658c0 msgr2=0x7fcd4c067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.191+0000 7fcd70f19000 1 --2- 172.21.15.37:0/4148046934 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcd4c0658c0 0x7fcd4c067d70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcd64009d60 tx=0x7fcd64005a50 comp rx=0 tx=0).stop 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.191+0000 7fcd70f19000 1 -- 172.21.15.37:0/4148046934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559bdee3a80 msgr2=0x5559bde49930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.191+0000 7fcd70f19000 1 --2- 172.21.15.37:0/4148046934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559bdee3a80 0x5559bde49930 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x5559bdf00fa0 tx=0x7fcd5c015000 comp rx=0 tx=0).stop 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.191+0000 7fcd6a955700 1 -- 172.21.15.37:0/4148046934 reap_dead start 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.191+0000 7fcd70f19000 1 -- 172.21.15.37:0/4148046934 shutdown_connections 2023-10-06T02:25:31.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.191+0000 7fcd70f19000 1 -- 172.21.15.37:0/4148046934 >> 172.21.15.37:0/4148046934 conn(0x5559bde6faf0 msgr2=0x5559bdefcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:31.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.191+0000 7fcd70f19000 1 -- 172.21.15.37:0/4148046934 shutdown_connections 2023-10-06T02:25:31.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.192+0000 7fcd70f19000 1 -- 172.21.15.37:0/4148046934 wait complete. 2023-10-06T02:25:31.199 INFO:teuthology.orchestra.run.smithi037.stdout:Yalphaparent_a 2023-10-06T02:25:31.200 DEBUG:teuthology.orchestra.run.smithi037:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-10-06T02:25:31.292 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:25:31.292 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 1099511627777, 2023-10-06T02:25:31.293 INFO:teuthology.orchestra.run.smithi037.stdout: "ancestors": [ 2023-10-06T02:25:31.293 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:31.293 INFO:teuthology.orchestra.run.smithi037.stdout: "dirino": 1099511627776, 2023-10-06T02:25:31.293 INFO:teuthology.orchestra.run.smithi037.stdout: "dname": "alpha", 2023-10-06T02:25:31.293 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 4 2023-10-06T02:25:31.293 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:25:31.293 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:31.293 INFO:teuthology.orchestra.run.smithi037.stdout: "dirino": 1, 2023-10-06T02:25:31.293 INFO:teuthology.orchestra.run.smithi037.stdout: "dname": "parent_a", 2023-10-06T02:25:31.294 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 7 2023-10-06T02:25:31.294 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:31.294 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-06T02:25:31.294 INFO:teuthology.orchestra.run.smithi037.stdout: "pool": 8, 2023-10-06T02:25:31.294 INFO:teuthology.orchestra.run.smithi037.stdout: "old_pools": [] 2023-10-06T02:25:31.295 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:25:31.295 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:31.296 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:25:31.296 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:25:31.373 DEBUG:teuthology.orchestra.run.smithi191:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:25:31.411 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:25:31.412 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-10-06T02:25:31.412 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:25:31.412 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:31.446 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[106631]: fuse finished with error 0 and tester_r 0 2023-10-06T02:25:31.449 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:25:31.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:31.450 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:25:31.505 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:25:31.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:31.505 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:25:31.519 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:25:31.520 INFO:teuthology.orchestra.run.smithi191.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T02:25:31.520 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:25:31.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:31.520 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T02:25:31.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:25:31.560 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T02:25:31.560 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:25:31.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:31.560 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T02:25:31.574 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:25:31.575 INFO:teuthology.orchestra.run.smithi191.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T02:25:31.575 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:31.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.718+0000 7f8c5a8fa700 1 Processor -- start 2023-10-06T02:25:31.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.718+0000 7f8c5a8fa700 1 -- start start 2023-10-06T02:25:31.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.719+0000 7f8c5a8fa700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c540cf9f0 0x7f8c540cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.719+0000 7f8c5a8fa700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c540c5300 con 0x7f8c541596d0 2023-10-06T02:25:31.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.719+0000 7f8c5a8fa700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c540c6160 con 0x7f8c54159aa0 2023-10-06T02:25:31.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.719+0000 7f8c5a8fa700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c540d0370 con 0x7f8c540cf9f0 2023-10-06T02:25:31.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.719+0000 7f8c58e97700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c540cf9f0 0x7f8c540cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.719+0000 7f8c53fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8c541596d0 0x7f8c540b3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43068/0 (socket says 172.21.15.37:43068) 2023-10-06T02:25:31.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.719+0000 7f8c53fff700 1 -- 172.21.15.37:0/3233530015 learned_addr learned my addr 172.21.15.37:0/3233530015 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:31.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.719+0000 7f8c58e97700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c540cf9f0 0x7f8c540cfe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35412/0 (socket says 172.21.15.37:35412) 2023-10-06T02:25:31.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.719+0000 7f8c58e97700 1 -- 172.21.15.37:0/3233530015 >> v1:172.21.15.191:6789/0 conn(0x7f8c54159aa0 legacy=0x7f8c540c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.719+0000 7f8c58e97700 1 -- 172.21.15.37:0/3233530015 >> v1:172.21.15.37:6789/0 conn(0x7f8c541596d0 legacy=0x7f8c540b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.719+0000 7f8c58e97700 1 -- 172.21.15.37:0/3233530015 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c540c5550 con 0x7f8c540cf9f0 2023-10-06T02:25:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.719+0000 7f8c52ffd700 1 -- 172.21.15.37:0/3233530015 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694307669 0 0) 0x7f8c540c5300 con 0x7f8c541596d0 2023-10-06T02:25:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.719+0000 7f8c58e97700 1 --2- 172.21.15.37:0/3233530015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c540cf9f0 0x7f8c540cfe30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009e60 tx=0x7f8c4c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24ac06baa15553c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.719+0000 7f8c52ffd700 1 -- 172.21.15.37:0/3233530015 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c00e070 con 0x7f8c540cf9f0 2023-10-06T02:25:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.719+0000 7f8c52ffd700 1 -- 172.21.15.37:0/3233530015 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4c00bc30 con 0x7f8c540cf9f0 2023-10-06T02:25:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.719+0000 7f8c52ffd700 1 -- 172.21.15.37:0/3233530015 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c012430 con 0x7f8c540cf9f0 2023-10-06T02:25:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.720+0000 7f8c5a8fa700 1 -- 172.21.15.37:0/3233530015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c540cf9f0 msgr2=0x7f8c540cfe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.720+0000 7f8c5a8fa700 1 --2- 172.21.15.37:0/3233530015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c540cf9f0 0x7f8c540cfe30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009e60 tx=0x7f8c4c009780 comp rx=0 tx=0).stop 2023-10-06T02:25:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.720+0000 7f8c5a8fa700 1 -- 172.21.15.37:0/3233530015 shutdown_connections 2023-10-06T02:25:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.720+0000 7f8c5a8fa700 1 --2- 172.21.15.37:0/3233530015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c540cf9f0 0x7f8c540cfe30 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.720+0000 7f8c5a8fa700 1 -- 172.21.15.37:0/3233530015 >> 172.21.15.37:0/3233530015 conn(0x7f8c5406c890 msgr2=0x7f8c540d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.720+0000 7f8c5a8fa700 1 -- 172.21.15.37:0/3233530015 shutdown_connections 2023-10-06T02:25:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.720+0000 7f8c5a8fa700 1 -- 172.21.15.37:0/3233530015 wait complete. 2023-10-06T02:25:31.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.721+0000 7f8c5a8fa700 1 Processor -- start 2023-10-06T02:25:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.721+0000 7f8c5a8fa700 1 -- start start 2023-10-06T02:25:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.722+0000 7f8c5a8fa700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c540cf9f0 0x7f8c5413c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.722+0000 7f8c5a8fa700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c541596d0 0x7f8c540b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.722+0000 7f8c5a8fa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c54159aa0 0x7f8c540b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.722+0000 7f8c5a8fa700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c540b54a0 con 0x7f8c54159aa0 2023-10-06T02:25:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.722+0000 7f8c5a8fa700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5416b4d0 con 0x7f8c541596d0 2023-10-06T02:25:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.722+0000 7f8c5a8fa700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5416aea0 con 0x7f8c540cf9f0 2023-10-06T02:25:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.722+0000 7f8c58e97700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c54159aa0 0x7f8c540b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.722+0000 7f8c58e97700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c54159aa0 0x7f8c540b49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35424/0 (socket says 172.21.15.37:35424) 2023-10-06T02:25:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.722+0000 7f8c58e97700 1 -- 172.21.15.37:0/2743955164 learned_addr learned my addr 172.21.15.37:0/2743955164 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.722+0000 7f8c537fe700 1 --2- 172.21.15.37:0/2743955164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c541596d0 0x7f8c540b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.722+0000 7f8c53fff700 1 --2- 172.21.15.37:0/2743955164 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c540cf9f0 0x7f8c5413c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.722+0000 7f8c58e97700 1 -- 172.21.15.37:0/2743955164 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c540cf9f0 msgr2=0x7f8c5413c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.722+0000 7f8c58e97700 1 --2- 172.21.15.37:0/2743955164 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c540cf9f0 0x7f8c5413c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.722+0000 7f8c58e97700 1 -- 172.21.15.37:0/2743955164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c541596d0 msgr2=0x7f8c540b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.722+0000 7f8c58e97700 1 --2- 172.21.15.37:0/2743955164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c541596d0 0x7f8c540b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.722+0000 7f8c58e97700 1 -- 172.21.15.37:0/2743955164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c009a20 con 0x7f8c54159aa0 2023-10-06T02:25:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.722+0000 7f8c537fe700 1 --2- 172.21.15.37:0/2743955164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c541596d0 0x7f8c540b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.722+0000 7f8c53fff700 1 --2- 172.21.15.37:0/2743955164 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c540cf9f0 0x7f8c5413c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.722+0000 7f8c58e97700 1 --2- 172.21.15.37:0/2743955164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c54159aa0 0x7f8c540b49c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c013000 tx=0x7f8c4c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.723+0000 7f8c3bfff700 1 -- 172.21.15.37:0/2743955164 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c01b630 con 0x7f8c54159aa0 2023-10-06T02:25:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.723+0000 7f8c3bfff700 1 -- 172.21.15.37:0/2743955164 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4c01b790 con 0x7f8c54159aa0 2023-10-06T02:25:31.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.723+0000 7f8c5a8fa700 1 -- 172.21.15.37:0/2743955164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c5416a900 con 0x7f8c54159aa0 2023-10-06T02:25:31.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.723+0000 7f8c3bfff700 1 -- 172.21.15.37:0/2743955164 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c01bb10 con 0x7f8c54159aa0 2023-10-06T02:25:31.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.723+0000 7f8c5a8fa700 1 -- 172.21.15.37:0/2743955164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5413cba0 con 0x7f8c54159aa0 2023-10-06T02:25:31.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.723+0000 7f8c5a8fa700 1 -- 172.21.15.37:0/2743955164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c5416b660 con 0x7f8c54159aa0 2023-10-06T02:25:31.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.725+0000 7f8c3bfff700 1 -- 172.21.15.37:0/2743955164 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c4c01c400 con 0x7f8c54159aa0 2023-10-06T02:25:31.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.725+0000 7f8c3bfff700 1 --2- 172.21.15.37:0/2743955164 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8c40066f30 0x7f8c400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:31.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.725+0000 7f8c3bfff700 1 -- 172.21.15.37:0/2743955164 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f8c4c086a90 con 0x7f8c54159aa0 2023-10-06T02:25:31.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.725+0000 7f8c53fff700 1 --2- 172.21.15.37:0/2743955164 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8c40066f30 0x7f8c400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:31.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.726+0000 7f8c53fff700 1 --2- 172.21.15.37:0/2743955164 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8c40066f30 0x7f8c400693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8c44007fd0 tx=0x7f8c44009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:31.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.729+0000 7f8c3bfff700 1 -- 172.21.15.37:0/2743955164 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c4c053c90 con 0x7f8c54159aa0 2023-10-06T02:25:31.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.969+0000 7f8c5a8fa700 1 -- 172.21.15.37:0/2743955164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c5406fbf0 con 0x7f8c54159aa0 2023-10-06T02:25:31.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.970+0000 7f8c3bfff700 1 -- 172.21.15.37:0/2743955164 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f8c4c02a090 con 0x7f8c54159aa0 2023-10-06T02:25:31.971 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:31.972 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2341182274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2341182274},{"type":"v1","addr":"172.21.15.191:6837","nonce":2341182274}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5385,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/562500386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":562500386},{"type":"v1","addr":"172.21.15.37:6834","nonce":562500386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1403086996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1403086996},{"type":"v1","addr":"172.21.15.37:6835","nonce":1403086996}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:50.379875+0000","modified":"2023-10-06T02:24:54.014513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5400":{"gid":5400,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6836/2931117635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2931117635},{"type":"v1","addr":"172.21.15.191:6836","nonce":2931117635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:25:31.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.972+0000 7f8c5a8fa700 1 -- 172.21.15.37:0/2743955164 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8c40066f30 msgr2=0x7f8c400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.972+0000 7f8c5a8fa700 1 --2- 172.21.15.37:0/2743955164 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8c40066f30 0x7f8c400693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8c44007fd0 tx=0x7f8c44009040 comp rx=0 tx=0).stop 2023-10-06T02:25:31.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.972+0000 7f8c5a8fa700 1 -- 172.21.15.37:0/2743955164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c54159aa0 msgr2=0x7f8c540b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:31.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.972+0000 7f8c5a8fa700 1 --2- 172.21.15.37:0/2743955164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c54159aa0 0x7f8c540b49c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c013000 tx=0x7f8c4c019000 comp rx=0 tx=0).stop 2023-10-06T02:25:31.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.972+0000 7f8c5a8fa700 1 -- 172.21.15.37:0/2743955164 shutdown_connections 2023-10-06T02:25:31.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.972+0000 7f8c5a8fa700 1 --2- 172.21.15.37:0/2743955164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c54159aa0 0x7f8c540b49c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.972+0000 7f8c5a8fa700 1 --2- 172.21.15.37:0/2743955164 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c540cf9f0 0x7f8c5413c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.972+0000 7f8c5a8fa700 1 --2- 172.21.15.37:0/2743955164 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8c40066f30 0x7f8c400693e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.972+0000 7f8c5a8fa700 1 --2- 172.21.15.37:0/2743955164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c541596d0 0x7f8c540b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:31.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.972+0000 7f8c5a8fa700 1 -- 172.21.15.37:0/2743955164 >> 172.21.15.37:0/2743955164 conn(0x7f8c5406c890 msgr2=0x7f8c540cb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:31.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.972+0000 7f8c5a8fa700 1 -- 172.21.15.37:0/2743955164 shutdown_connections 2023-10-06T02:25:31.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:31.972+0000 7f8c5a8fa700 1 -- 172.21.15.37:0/2743955164 wait complete. 2023-10-06T02:25:31.976 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 23 2023-10-06T02:25:31.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:25:32.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.103+0000 7f57fc066700 1 Processor -- start 2023-10-06T02:25:32.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.104+0000 7f57fc066700 1 -- start start 2023-10-06T02:25:32.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.104+0000 7f57fc066700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f57f4159760 0x7f57f415d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.104+0000 7f57fc066700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f415e1d0 con 0x7f57f415dd50 2023-10-06T02:25:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.104+0000 7f57fc066700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f40cb650 con 0x7f57f415d8d0 2023-10-06T02:25:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.104+0000 7f57fc066700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f40cc2d0 con 0x7f57f4159760 2023-10-06T02:25:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.105+0000 7f57f9601700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f57f415d8d0 0x7f57f40c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:38382/0 (socket says 172.21.15.37:38382) 2023-10-06T02:25:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.105+0000 7f57f9601700 1 -- 172.21.15.37:0/940689718 learned_addr learned my addr 172.21.15.37:0/940689718 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.105+0000 7f57f9e02700 1 --2- 172.21.15.37:0/940689718 >> v2:172.21.15.191:3300/0 conn(0x7f57f4159760 0x7f57f415d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.105+0000 7f57f8e00700 1 -- 172.21.15.37:0/940689718 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1813297460 0 0) 0x7f57f40cb650 con 0x7f57f415d8d0 2023-10-06T02:25:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.105+0000 7f57f8e00700 1 -- 172.21.15.37:0/940689718 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57dc003570 con 0x7f57f415d8d0 2023-10-06T02:25:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.105+0000 7f57f8e00700 1 -- 172.21.15.37:0/940689718 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371136921 0 0) 0x7f57f415e1d0 con 0x7f57f415dd50 2023-10-06T02:25:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.105+0000 7f57f8e00700 1 -- 172.21.15.37:0/940689718 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57f40cb650 con 0x7f57f415dd50 2023-10-06T02:25:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.105+0000 7f57f9e02700 1 -- 172.21.15.37:0/940689718 >> v1:172.21.15.191:6789/0 conn(0x7f57f415d8d0 legacy=0x7f57f40c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.105+0000 7f57f9e02700 1 -- 172.21.15.37:0/940689718 >> v1:172.21.15.37:6789/0 conn(0x7f57f415dd50 legacy=0x7f57f40cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.105+0000 7f57f9e02700 1 -- 172.21.15.37:0/940689718 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f40cb930 con 0x7f57f4159760 2023-10-06T02:25:32.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.105+0000 7f57f9e02700 1 --2- 172.21.15.37:0/940689718 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57f4159760 0x7f57f415d390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f57e4009e60 tx=0x7f57e4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f95e5d675f1e79d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:32.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.106+0000 7f57f8e00700 1 -- 172.21.15.37:0/940689718 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e400e070 con 0x7f57f4159760 2023-10-06T02:25:32.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.106+0000 7f57f8e00700 1 -- 172.21.15.37:0/940689718 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e400bb40 con 0x7f57f4159760 2023-10-06T02:25:32.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.106+0000 7f57f8e00700 1 -- 172.21.15.37:0/940689718 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e4012430 con 0x7f57f4159760 2023-10-06T02:25:32.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.106+0000 7f57fc066700 1 -- 172.21.15.37:0/940689718 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57f4159760 msgr2=0x7f57f415d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.106+0000 7f57fc066700 1 --2- 172.21.15.37:0/940689718 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57f4159760 0x7f57f415d390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f57e4009e60 tx=0x7f57e4009780 comp rx=0 tx=0).stop 2023-10-06T02:25:32.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.106+0000 7f57fc066700 1 -- 172.21.15.37:0/940689718 shutdown_connections 2023-10-06T02:25:32.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.106+0000 7f57fc066700 1 --2- 172.21.15.37:0/940689718 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57f4159760 0x7f57f415d390 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.106+0000 7f57fc066700 1 -- 172.21.15.37:0/940689718 >> 172.21.15.37:0/940689718 conn(0x7f57f406c890 msgr2=0x7f57f40d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:32.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.106+0000 7f57fc066700 1 -- 172.21.15.37:0/940689718 shutdown_connections 2023-10-06T02:25:32.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.106+0000 7f57fc066700 1 -- 172.21.15.37:0/940689718 wait complete. 2023-10-06T02:25:32.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.107+0000 7f57fc066700 1 Processor -- start 2023-10-06T02:25:32.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.108+0000 7f57fc066700 1 -- start start 2023-10-06T02:25:32.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.108+0000 7f57fc066700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57f4159760 0x7f57f4146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.108+0000 7f57fc066700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f415d8d0 0x7f57f4159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.108+0000 7f57fc066700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57f415dd50 0x7f57f41539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.108+0000 7f57fc066700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f415b120 con 0x7f57f415d8d0 2023-10-06T02:25:32.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.108+0000 7f57fc066700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f415a510 con 0x7f57f415dd50 2023-10-06T02:25:32.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.108+0000 7f57fc066700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f415a7f0 con 0x7f57f4159760 2023-10-06T02:25:32.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.108+0000 7f57f9601700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f415d8d0 0x7f57f4159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.108+0000 7f57f9601700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f415d8d0 0x7f57f4159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35430/0 (socket says 172.21.15.37:35430) 2023-10-06T02:25:32.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.108+0000 7f57f9601700 1 -- 172.21.15.37:0/3173885235 learned_addr learned my addr 172.21.15.37:0/3173885235 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:32.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.109+0000 7f57fa603700 1 --2- 172.21.15.37:0/3173885235 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57f415dd50 0x7f57f41539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.109+0000 7f57f9e02700 1 --2- 172.21.15.37:0/3173885235 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57f4159760 0x7f57f4146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.109+0000 7f57f9601700 1 -- 172.21.15.37:0/3173885235 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57f4159760 msgr2=0x7f57f4146e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.109+0000 7f57f9601700 1 --2- 172.21.15.37:0/3173885235 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57f4159760 0x7f57f4146e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.109+0000 7f57f9601700 1 -- 172.21.15.37:0/3173885235 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57f415dd50 msgr2=0x7f57f41539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.109+0000 7f57f9601700 1 --2- 172.21.15.37:0/3173885235 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57f415dd50 0x7f57f41539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.109+0000 7f57f9601700 1 -- 172.21.15.37:0/3173885235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e4009a20 con 0x7f57f415d8d0 2023-10-06T02:25:32.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.109+0000 7f57fa603700 1 --2- 172.21.15.37:0/3173885235 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57f415dd50 0x7f57f41539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:32.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.109+0000 7f57f9601700 1 --2- 172.21.15.37:0/3173885235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f415d8d0 0x7f57f4159b30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f57e800c790 tx=0x7f57e8007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:32.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.109+0000 7f57f1ffb700 1 -- 172.21.15.37:0/3173885235 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e8005b30 con 0x7f57f415d8d0 2023-10-06T02:25:32.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.109+0000 7f57f1ffb700 1 -- 172.21.15.37:0/3173885235 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e8005c90 con 0x7f57f415d8d0 2023-10-06T02:25:32.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.109+0000 7f57f1ffb700 1 -- 172.21.15.37:0/3173885235 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e8007300 con 0x7f57f415d8d0 2023-10-06T02:25:32.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.109+0000 7f57fc066700 1 -- 172.21.15.37:0/3173885235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f415aad0 con 0x7f57f415d8d0 2023-10-06T02:25:32.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.109+0000 7f57fc066700 1 -- 172.21.15.37:0/3173885235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f40b5b40 con 0x7f57f415d8d0 2023-10-06T02:25:32.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.110+0000 7f57fc066700 1 -- 172.21.15.37:0/3173885235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f406fbf0 con 0x7f57f415d8d0 2023-10-06T02:25:32.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.110+0000 7f57f1ffb700 1 -- 172.21.15.37:0/3173885235 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57e801b400 con 0x7f57f415d8d0 2023-10-06T02:25:32.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.111+0000 7f57f1ffb700 1 --2- 172.21.15.37:0/3173885235 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f57e0066f30 0x7f57e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.111+0000 7f57f1ffb700 1 -- 172.21.15.37:0/3173885235 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f57e80841d0 con 0x7f57f415d8d0 2023-10-06T02:25:32.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.111+0000 7f57f9e02700 1 --2- 172.21.15.37:0/3173885235 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f57e0066f30 0x7f57e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.111+0000 7f57f9e02700 1 --2- 172.21.15.37:0/3173885235 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f57e0066f30 0x7f57e00693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f57e40099f0 tx=0x7f57e4019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:32.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.115+0000 7f57f1ffb700 1 -- 172.21.15.37:0/3173885235 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57e8054e60 con 0x7f57f415d8d0 2023-10-06T02:25:32.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.307+0000 7f57fc066700 1 -- 172.21.15.37:0/3173885235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57f415b260 con 0x7f57f415d8d0 2023-10-06T02:25:32.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.308+0000 7f57f1ffb700 1 -- 172.21.15.37:0/3173885235 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16962 (secure 0 0 0) 0x7f57f415b260 con 0x7f57f415d8d0 2023-10-06T02:25:32.310 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:32.310 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":45,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:25:03.636645+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:24:48.109383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T02:24:49.348527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.25","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:25:32.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.310+0000 7f57fc066700 1 -- 172.21.15.37:0/3173885235 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f57e0066f30 msgr2=0x7f57e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.310+0000 7f57fc066700 1 --2- 172.21.15.37:0/3173885235 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f57e0066f30 0x7f57e00693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f57e40099f0 tx=0x7f57e4019000 comp rx=0 tx=0).stop 2023-10-06T02:25:32.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.310+0000 7f57fc066700 1 -- 172.21.15.37:0/3173885235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f415d8d0 msgr2=0x7f57f4159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.310+0000 7f57fc066700 1 --2- 172.21.15.37:0/3173885235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f415d8d0 0x7f57f4159b30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f57e800c790 tx=0x7f57e8007ea0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.310+0000 7f57fc066700 1 -- 172.21.15.37:0/3173885235 shutdown_connections 2023-10-06T02:25:32.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.310+0000 7f57fc066700 1 --2- 172.21.15.37:0/3173885235 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f57e0066f30 0x7f57e00693e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.310+0000 7f57fc066700 1 --2- 172.21.15.37:0/3173885235 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57f415dd50 0x7f57f41539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.310+0000 7f57fc066700 1 --2- 172.21.15.37:0/3173885235 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57f4159760 0x7f57f4146e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.310+0000 7f57fc066700 1 --2- 172.21.15.37:0/3173885235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f415d8d0 0x7f57f4159b30 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.310+0000 7f57fc066700 1 -- 172.21.15.37:0/3173885235 >> 172.21.15.37:0/3173885235 conn(0x7f57f406c890 msgr2=0x7f57f40c9620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:32.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.311+0000 7f57fc066700 1 -- 172.21.15.37:0/3173885235 shutdown_connections 2023-10-06T02:25:32.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.311+0000 7f57fc066700 1 -- 172.21.15.37:0/3173885235 wait complete. 2023-10-06T02:25:32.324 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:23:08.066048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:23:08.561964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:24:48.109383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:24:49.348527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:25:32.325 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:25:32.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.445+0000 7f1e30a56700 1 Processor -- start 2023-10-06T02:25:32.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.445+0000 7f1e30a56700 1 -- start start 2023-10-06T02:25:32.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.446+0000 7f1e30a56700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f1e2c06ae00 0x7f1e2c06b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.446+0000 7f1e30a56700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e2c1578e0 0x7f1e2c097230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.446+0000 7f1e30a56700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e2c096da0 con 0x7f1e2c06e710 2023-10-06T02:25:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.446+0000 7f1e30a56700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2c06f140 con 0x7f1e2c06ae00 2023-10-06T02:25:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.446+0000 7f1e30a56700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c06f420 con 0x7f1e2c1578e0 2023-10-06T02:25:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.446+0000 7f1e2ad9d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e2c1578e0 0x7f1e2c097230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.446+0000 7f1e2a59c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f1e2c06ae00 0x7f1e2c06b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.446+0000 7f1e29d9b700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f1e2c06e710 0x7f1e2c1571d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:38398/0 (socket says 172.21.15.37:38398) 2023-10-06T02:25:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.446+0000 7f1e2a59c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f1e2c06ae00 0x7f1e2c06b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:37030/0 (socket says 172.21.15.37:37030) 2023-10-06T02:25:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.446+0000 7f1e29d9b700 1 -- 172.21.15.37:0/560351909 learned_addr learned my addr 172.21.15.37:0/560351909 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.446+0000 7f1e2ad9d700 1 -- 172.21.15.37:0/560351909 >> v2:172.21.15.191:3300/0 conn(0x7f1e2c06ae00 msgr2=0x7f1e2c06b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:32.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.446+0000 7f1e2ad9d700 1 --2- 172.21.15.37:0/560351909 >> v2:172.21.15.191:3300/0 conn(0x7f1e2c06ae00 0x7f1e2c06b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.446+0000 7f1e2ad9d700 1 -- 172.21.15.37:0/560351909 >> v1:172.21.15.191:6789/0 conn(0x7f1e2c06e710 legacy=0x7f1e2c1571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.446+0000 7f1e2ad9d700 1 -- 172.21.15.37:0/560351909 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c06f700 con 0x7f1e2c1578e0 2023-10-06T02:25:32.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.446+0000 7f1e2a59c700 1 --2- 172.21.15.37:0/560351909 >> v2:172.21.15.191:3300/0 conn(0x7f1e2c06ae00 0x7f1e2c06b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:25:32.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.447+0000 7f1e2ad9d700 1 --2- 172.21.15.37:0/560351909 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e2c1578e0 0x7f1e2c097230 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009e60 tx=0x7f1e24009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f183efeb53eca672 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:32.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.447+0000 7f1e2959a700 1 -- 172.21.15.37:0/560351909 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2400e070 con 0x7f1e2c1578e0 2023-10-06T02:25:32.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.447+0000 7f1e2959a700 1 -- 172.21.15.37:0/560351909 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2400bb60 con 0x7f1e2c1578e0 2023-10-06T02:25:32.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.447+0000 7f1e2959a700 1 -- 172.21.15.37:0/560351909 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24012430 con 0x7f1e2c1578e0 2023-10-06T02:25:32.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.447+0000 7f1e30a56700 1 -- 172.21.15.37:0/560351909 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e2c1578e0 msgr2=0x7f1e2c097230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.447+0000 7f1e30a56700 1 --2- 172.21.15.37:0/560351909 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e2c1578e0 0x7f1e2c097230 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009e60 tx=0x7f1e24009780 comp rx=0 tx=0).stop 2023-10-06T02:25:32.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.447+0000 7f1e30a56700 1 -- 172.21.15.37:0/560351909 shutdown_connections 2023-10-06T02:25:32.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.447+0000 7f1e30a56700 1 --2- 172.21.15.37:0/560351909 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e2c1578e0 0x7f1e2c097230 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.447+0000 7f1e30a56700 1 --2- 172.21.15.37:0/560351909 >> v2:172.21.15.191:3300/0 conn(0x7f1e2c06ae00 0x7f1e2c06b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.447+0000 7f1e30a56700 1 -- 172.21.15.37:0/560351909 >> 172.21.15.37:0/560351909 conn(0x7f1e2c0cc100 msgr2=0x7f1e2c0cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:32.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.447+0000 7f1e30a56700 1 -- 172.21.15.37:0/560351909 shutdown_connections 2023-10-06T02:25:32.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.447+0000 7f1e30a56700 1 -- 172.21.15.37:0/560351909 wait complete. 2023-10-06T02:25:32.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.448+0000 7f1e30a56700 1 Processor -- start 2023-10-06T02:25:32.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.448+0000 7f1e30a56700 1 -- start start 2023-10-06T02:25:32.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.449+0000 7f1e30a56700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e2c06ae00 0x7f1e2c144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.449+0000 7f1e30a56700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e2c06e710 0x7f1e2c0ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.449+0000 7f1e30a56700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e2c1578e0 0x7f1e2c0ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.449+0000 7f1e30a56700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c0adf30 con 0x7f1e2c06ae00 2023-10-06T02:25:32.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.449+0000 7f1e30a56700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c144b90 con 0x7f1e2c1578e0 2023-10-06T02:25:32.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.449+0000 7f1e30a56700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c0ae900 con 0x7f1e2c06e710 2023-10-06T02:25:32.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.449+0000 7f1e2a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e2c06ae00 0x7f1e2c144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.449+0000 7f1e2a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e2c06ae00 0x7f1e2c144650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35446/0 (socket says 172.21.15.37:35446) 2023-10-06T02:25:32.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.449+0000 7f1e2a59c700 1 -- 172.21.15.37:0/1021624499 learned_addr learned my addr 172.21.15.37:0/1021624499 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:32.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.449+0000 7f1e2ad9d700 1 --2- 172.21.15.37:0/1021624499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e2c1578e0 0x7f1e2c0ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.449+0000 7f1e29d9b700 1 --2- 172.21.15.37:0/1021624499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e2c06e710 0x7f1e2c0ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.450+0000 7f1e2a59c700 1 -- 172.21.15.37:0/1021624499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e2c06e710 msgr2=0x7f1e2c0ae3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.450+0000 7f1e2a59c700 1 --2- 172.21.15.37:0/1021624499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e2c06e710 0x7f1e2c0ae3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.450+0000 7f1e2a59c700 1 -- 172.21.15.37:0/1021624499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e2c1578e0 msgr2=0x7f1e2c0ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.450+0000 7f1e2a59c700 1 --2- 172.21.15.37:0/1021624499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e2c1578e0 0x7f1e2c0ac860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.450+0000 7f1e2a59c700 1 -- 172.21.15.37:0/1021624499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c009420 con 0x7f1e2c06ae00 2023-10-06T02:25:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.450+0000 7f1e2a59c700 1 --2- 172.21.15.37:0/1021624499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e2c06ae00 0x7f1e2c144650 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00ec80 tx=0x7f1e1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.450+0000 7f1e1a7fc700 1 -- 172.21.15.37:0/1021624499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c00c850 con 0x7f1e2c06ae00 2023-10-06T02:25:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.450+0000 7f1e1a7fc700 1 -- 172.21.15.37:0/1021624499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c00c9b0 con 0x7f1e2c06ae00 2023-10-06T02:25:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.450+0000 7f1e30a56700 1 -- 172.21.15.37:0/1021624499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e24009a20 con 0x7f1e2c06ae00 2023-10-06T02:25:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.450+0000 7f1e1a7fc700 1 -- 172.21.15.37:0/1021624499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c00cd30 con 0x7f1e2c06ae00 2023-10-06T02:25:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.450+0000 7f1e30a56700 1 -- 172.21.15.37:0/1021624499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2c0ad680 con 0x7f1e2c06ae00 2023-10-06T02:25:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.451+0000 7f1e30a56700 1 -- 172.21.15.37:0/1021624499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2c0ae210 con 0x7f1e2c06ae00 2023-10-06T02:25:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.451+0000 7f1e1a7fc700 1 -- 172.21.15.37:0/1021624499 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e1c013680 con 0x7f1e2c06ae00 2023-10-06T02:25:32.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.452+0000 7f1e1a7fc700 1 --2- 172.21.15.37:0/1021624499 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1e0c066f30 0x7f1e0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.452+0000 7f1e1a7fc700 1 -- 172.21.15.37:0/1021624499 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f1e1c084c70 con 0x7f1e2c06ae00 2023-10-06T02:25:32.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.452+0000 7f1e29d9b700 1 --2- 172.21.15.37:0/1021624499 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1e0c066f30 0x7f1e0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.453+0000 7f1e29d9b700 1 --2- 172.21.15.37:0/1021624499 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1e0c066f30 0x7f1e0c0693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c16a7d0 tx=0x7f1e20007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:32.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.456+0000 7f1e1a7fc700 1 -- 172.21.15.37:0/1021624499 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e1c051d40 con 0x7f1e2c06ae00 2023-10-06T02:25:32.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.647+0000 7f1e30a56700 1 -- 172.21.15.37:0/1021624499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1e2c070c30 con 0x7f1e2c06ae00 2023-10-06T02:25:32.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.648+0000 7f1e1a7fc700 1 -- 172.21.15.37:0/1021624499 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v45) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1e1c0170a0 con 0x7f1e2c06ae00 2023-10-06T02:25:32.649 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T02:25:32.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.650+0000 7f1e30a56700 1 -- 172.21.15.37:0/1021624499 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1e0c066f30 msgr2=0x7f1e0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.650+0000 7f1e30a56700 1 --2- 172.21.15.37:0/1021624499 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1e0c066f30 0x7f1e0c0693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c16a7d0 tx=0x7f1e20007eb0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.650+0000 7f1e30a56700 1 -- 172.21.15.37:0/1021624499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e2c06ae00 msgr2=0x7f1e2c144650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.650+0000 7f1e30a56700 1 --2- 172.21.15.37:0/1021624499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e2c06ae00 0x7f1e2c144650 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00ec80 tx=0x7f1e1c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.650+0000 7f1e30a56700 1 -- 172.21.15.37:0/1021624499 shutdown_connections 2023-10-06T02:25:32.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.650+0000 7f1e30a56700 1 --2- 172.21.15.37:0/1021624499 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1e0c066f30 0x7f1e0c0693e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.650+0000 7f1e30a56700 1 --2- 172.21.15.37:0/1021624499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e2c1578e0 0x7f1e2c0ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.650+0000 7f1e30a56700 1 --2- 172.21.15.37:0/1021624499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e2c06ae00 0x7f1e2c144650 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.650+0000 7f1e30a56700 1 --2- 172.21.15.37:0/1021624499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e2c06e710 0x7f1e2c0ae3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.650+0000 7f1e30a56700 1 -- 172.21.15.37:0/1021624499 >> 172.21.15.37:0/1021624499 conn(0x7f1e2c0cc100 msgr2=0x7f1e2c0c25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:32.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.650+0000 7f1e30a56700 1 -- 172.21.15.37:0/1021624499 shutdown_connections 2023-10-06T02:25:32.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.650+0000 7f1e30a56700 1 -- 172.21.15.37:0/1021624499 wait complete. 2023-10-06T02:25:32.663 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:25:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.784+0000 7fcb409dd700 1 Processor -- start 2023-10-06T02:25:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.784+0000 7fcb409dd700 1 -- start start 2023-10-06T02:25:32.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.785+0000 7fcb409dd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcb3c0b2a90 0x7fcb3c159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.785+0000 7fcb409dd700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb3c0b07a0 con 0x7fcb3c1593c0 2023-10-06T02:25:32.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.785+0000 7fcb409dd700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb3c0cd8a0 con 0x7fcb3c0ccb30 2023-10-06T02:25:32.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.785+0000 7fcb409dd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0cd6c0 con 0x7fcb3c0b2a90 2023-10-06T02:25:32.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.785+0000 7fcb3a59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcb3c1593c0 0x7fcb3c0b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43078/0 (socket says 172.21.15.37:43078) 2023-10-06T02:25:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.785+0000 7fcb3a59c700 1 -- 172.21.15.37:0/2674653430 learned_addr learned my addr 172.21.15.37:0/2674653430 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3959a700 1 -- 172.21.15.37:0/2674653430 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070258076 0 0) 0x7fcb3c0b07a0 con 0x7fcb3c1593c0 2023-10-06T02:25:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb39d9b700 1 --2- 172.21.15.37:0/2674653430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcb3c0b2a90 0x7fcb3c159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3959a700 1 -- 172.21.15.37:0/2674653430 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb28003570 con 0x7fcb3c1593c0 2023-10-06T02:25:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3959a700 1 -- 172.21.15.37:0/2674653430 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 75077731 0 0) 0x7fcb28003570 con 0x7fcb3c1593c0 2023-10-06T02:25:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3959a700 1 -- 172.21.15.37:0/2674653430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcb3c0b2a90 msgr2=0x7fcb3c159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3959a700 1 --2- 172.21.15.37:0/2674653430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcb3c0b2a90 0x7fcb3c159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3959a700 1 -- 172.21.15.37:0/2674653430 >> v1:172.21.15.191:6789/0 conn(0x7fcb3c0ccb30 legacy=0x7fcb3c0ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3959a700 1 -- 172.21.15.37:0/2674653430 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c0afe70 con 0x7fcb3c1593c0 2023-10-06T02:25:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3959a700 1 -- 172.21.15.37:0/2674653430 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7fcb34001470 con 0x7fcb3c1593c0 2023-10-06T02:25:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3959a700 1 -- 172.21.15.37:0/2674653430 >> v1:172.21.15.37:6789/0 conn(0x7fcb3c1593c0 legacy=0x7fcb3c0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3959a700 1 --2- 172.21.15.37:0/2674653430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb28003a90 0x7fcb28003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3959a700 1 --2- 172.21.15.37:0/2674653430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb28004810 0x7fcb28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3959a700 1 --2- 172.21.15.37:0/2674653430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcb3c0b2a90 0x7fcb280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3959a700 1 -- 172.21.15.37:0/2674653430 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0cd6c0 con 0x7fcb28003a90 2023-10-06T02:25:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3959a700 1 -- 172.21.15.37:0/2674653430 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2800bb10 con 0x7fcb28004810 2023-10-06T02:25:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3959a700 1 -- 172.21.15.37:0/2674653430 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2800bcd0 con 0x7fcb3c0b2a90 2023-10-06T02:25:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3a59c700 1 --2- 172.21.15.37:0/2674653430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb28003a90 0x7fcb28003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb39d9b700 1 --2- 172.21.15.37:0/2674653430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb28004810 0x7fcb28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3ad9d700 1 --2- 172.21.15.37:0/2674653430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcb3c0b2a90 0x7fcb280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3a59c700 1 -- 172.21.15.37:0/2674653430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcb3c0b2a90 msgr2=0x7fcb280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3a59c700 1 --2- 172.21.15.37:0/2674653430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcb3c0b2a90 0x7fcb280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3a59c700 1 -- 172.21.15.37:0/2674653430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb28004810 msgr2=0x7fcb28004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3a59c700 1 --2- 172.21.15.37:0/2674653430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb28004810 0x7fcb28004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.786+0000 7fcb3a59c700 1 -- 172.21.15.37:0/2674653430 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb28003570 con 0x7fcb28003a90 2023-10-06T02:25:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.787+0000 7fcb3a59c700 1 --2- 172.21.15.37:0/2674653430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb28003a90 0x7fcb28003e60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400c3c0 tx=0x7fcb34001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47bcf60d6e895896 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.787+0000 7fcb3959a700 1 -- 172.21.15.37:0/2674653430 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3400cc90 con 0x7fcb28003a90 2023-10-06T02:25:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.787+0000 7fcb3959a700 1 -- 172.21.15.37:0/2674653430 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3400ce10 con 0x7fcb28003a90 2023-10-06T02:25:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.787+0000 7fcb3959a700 1 -- 172.21.15.37:0/2674653430 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb34005b70 con 0x7fcb28003a90 2023-10-06T02:25:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.787+0000 7fcb409dd700 1 -- 172.21.15.37:0/2674653430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb28003a90 msgr2=0x7fcb28003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.787+0000 7fcb409dd700 1 --2- 172.21.15.37:0/2674653430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb28003a90 0x7fcb28003e60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400c3c0 tx=0x7fcb34001e70 comp rx=0 tx=0).stop 2023-10-06T02:25:32.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.787+0000 7fcb3ad9d700 1 -- 172.21.15.37:0/2674653430 reap_dead start 2023-10-06T02:25:32.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.787+0000 7fcb409dd700 1 -- 172.21.15.37:0/2674653430 shutdown_connections 2023-10-06T02:25:32.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.787+0000 7fcb409dd700 1 -- 172.21.15.37:0/2674653430 >> 172.21.15.37:0/2674653430 conn(0x7fcb3c06c0b0 msgr2=0x7fcb3c06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:32.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.787+0000 7fcb409dd700 1 -- 172.21.15.37:0/2674653430 shutdown_connections 2023-10-06T02:25:32.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.787+0000 7fcb409dd700 1 -- 172.21.15.37:0/2674653430 wait complete. 2023-10-06T02:25:32.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.788+0000 7fcb409dd700 1 Processor -- start 2023-10-06T02:25:32.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.788+0000 7fcb409dd700 1 -- start start 2023-10-06T02:25:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.789+0000 7fcb409dd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb28003a90 0x7fcb3c159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.789+0000 7fcb409dd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb3c15f150 0x7fcb3c15f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.789+0000 7fcb409dd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcb3c169f60 0x7fcb3c16a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.789+0000 7fcb409dd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c15fb00 con 0x7fcb28003a90 2023-10-06T02:25:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.789+0000 7fcb409dd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c16b6a0 con 0x7fcb3c15f150 2023-10-06T02:25:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.789+0000 7fcb409dd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c16ad70 con 0x7fcb3c169f60 2023-10-06T02:25:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.789+0000 7fcb3a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb28003a90 0x7fcb3c159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.789+0000 7fcb3a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb28003a90 0x7fcb3c159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35466/0 (socket says 172.21.15.37:35466) 2023-10-06T02:25:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.789+0000 7fcb3a59c700 1 -- 172.21.15.37:0/3105182974 learned_addr learned my addr 172.21.15.37:0/3105182974 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.789+0000 7fcb39d9b700 1 --2- 172.21.15.37:0/3105182974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb3c15f150 0x7fcb3c15f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.789+0000 7fcb3ad9d700 1 --2- 172.21.15.37:0/3105182974 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcb3c169f60 0x7fcb3c16a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.790+0000 7fcb3a59c700 1 -- 172.21.15.37:0/3105182974 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcb3c169f60 msgr2=0x7fcb3c16a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.790+0000 7fcb3a59c700 1 --2- 172.21.15.37:0/3105182974 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcb3c169f60 0x7fcb3c16a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.790+0000 7fcb3a59c700 1 -- 172.21.15.37:0/3105182974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb3c15f150 msgr2=0x7fcb3c15f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.790+0000 7fcb3a59c700 1 --2- 172.21.15.37:0/3105182974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb3c15f150 0x7fcb3c15f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.790+0000 7fcb3a59c700 1 -- 172.21.15.37:0/3105182974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c16b050 con 0x7fcb28003a90 2023-10-06T02:25:32.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.790+0000 7fcb3a59c700 1 --2- 172.21.15.37:0/3105182974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb28003a90 0x7fcb3c159d10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fcb34001ed0 tx=0x7fcb34015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:32.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.790+0000 7fcb327fc700 1 -- 172.21.15.37:0/3105182974 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb340072e0 con 0x7fcb28003a90 2023-10-06T02:25:32.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.790+0000 7fcb327fc700 1 -- 172.21.15.37:0/3105182974 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb34007440 con 0x7fcb28003a90 2023-10-06T02:25:32.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.790+0000 7fcb409dd700 1 -- 172.21.15.37:0/3105182974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3c16b330 con 0x7fcb28003a90 2023-10-06T02:25:32.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.790+0000 7fcb327fc700 1 -- 172.21.15.37:0/3105182974 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb340077e0 con 0x7fcb28003a90 2023-10-06T02:25:32.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.790+0000 7fcb409dd700 1 -- 172.21.15.37:0/3105182974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3c15a250 con 0x7fcb28003a90 2023-10-06T02:25:32.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.791+0000 7fcb409dd700 1 -- 172.21.15.37:0/3105182974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3c088bb0 con 0x7fcb28003a90 2023-10-06T02:25:32.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.791+0000 7fcb327fc700 1 -- 172.21.15.37:0/3105182974 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb34019030 con 0x7fcb28003a90 2023-10-06T02:25:32.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.792+0000 7fcb327fc700 1 --2- 172.21.15.37:0/3105182974 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcb1c066f30 0x7fcb1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:32.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.792+0000 7fcb327fc700 1 -- 172.21.15.37:0/3105182974 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fcb34085fb0 con 0x7fcb28003a90 2023-10-06T02:25:32.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.792+0000 7fcb39d9b700 1 --2- 172.21.15.37:0/3105182974 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcb1c066f30 0x7fcb1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:32.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.792+0000 7fcb39d9b700 1 --2- 172.21.15.37:0/3105182974 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcb1c066f30 0x7fcb1c0693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcb24006f00 tx=0x7fcb240091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:32.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.796+0000 7fcb327fc700 1 -- 172.21.15.37:0/3105182974 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb340b75a0 con 0x7fcb28003a90 2023-10-06T02:25:32.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.987+0000 7fcb409dd700 1 -- 172.21.15.37:0/3105182974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcb3c0b0150 con 0x7fcb28003a90 2023-10-06T02:25:32.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.987+0000 7fcb327fc700 1 -- 172.21.15.37:0/3105182974 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcb34053080 con 0x7fcb28003a90 2023-10-06T02:25:32.989 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T02:25:32.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.989+0000 7fcb409dd700 1 -- 172.21.15.37:0/3105182974 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcb1c066f30 msgr2=0x7fcb1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.989+0000 7fcb409dd700 1 --2- 172.21.15.37:0/3105182974 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcb1c066f30 0x7fcb1c0693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcb24006f00 tx=0x7fcb240091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.989+0000 7fcb409dd700 1 -- 172.21.15.37:0/3105182974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb28003a90 msgr2=0x7fcb3c159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:32.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.989+0000 7fcb409dd700 1 --2- 172.21.15.37:0/3105182974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb28003a90 0x7fcb3c159d10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fcb34001ed0 tx=0x7fcb34015000 comp rx=0 tx=0).stop 2023-10-06T02:25:32.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.989+0000 7fcb409dd700 1 -- 172.21.15.37:0/3105182974 shutdown_connections 2023-10-06T02:25:32.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.989+0000 7fcb409dd700 1 --2- 172.21.15.37:0/3105182974 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcb3c169f60 0x7fcb3c16a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.989+0000 7fcb409dd700 1 --2- 172.21.15.37:0/3105182974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb28003a90 0x7fcb3c159d10 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.989+0000 7fcb409dd700 1 --2- 172.21.15.37:0/3105182974 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcb1c066f30 0x7fcb1c0693e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.989+0000 7fcb409dd700 1 --2- 172.21.15.37:0/3105182974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb3c15f150 0x7fcb3c15f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:32.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.989+0000 7fcb409dd700 1 -- 172.21.15.37:0/3105182974 >> 172.21.15.37:0/3105182974 conn(0x7fcb3c06c0b0 msgr2=0x7fcb3c0cc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:32.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.990+0000 7fcb409dd700 1 -- 172.21.15.37:0/3105182974 shutdown_connections 2023-10-06T02:25:32.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:32.990+0000 7fcb409dd700 1 -- 172.21.15.37:0/3105182974 wait complete. 2023-10-06T02:25:33.003 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:25:33.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.124+0000 7f9e01405700 1 Processor -- start 2023-10-06T02:25:33.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.124+0000 7f9e01405700 1 -- start start 2023-10-06T02:25:33.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.125+0000 7f9e01405700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9dfc1593c0 0x7f9dfc159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:33.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.125+0000 7f9e01405700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dfc0ccb30 0x7f9dfc0ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:33.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.125+0000 7f9e01405700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dfc0b07a0 con 0x7f9dfc0b2380 2023-10-06T02:25:33.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.125+0000 7f9e01405700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dfc0cd8a0 con 0x7f9dfc1593c0 2023-10-06T02:25:33.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.125+0000 7f9e01405700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0afe70 con 0x7f9dfc0ccb30 2023-10-06T02:25:33.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.125+0000 7f9dfaffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9dfc1593c0 0x7f9dfc159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:33.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.125+0000 7f9dfaffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9dfc1593c0 0x7f9dfc159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35480/0 (socket says 172.21.15.37:35480) 2023-10-06T02:25:33.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.125+0000 7f9dfaffd700 1 -- 172.21.15.37:0/2126934927 learned_addr learned my addr 172.21.15.37:0/2126934927 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:33.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.125+0000 7f9dfb7fe700 1 --2- 172.21.15.37:0/2126934927 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dfc0ccb30 0x7f9dfc0ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:33.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.126+0000 7f9dfaffd700 1 -- 172.21.15.37:0/2126934927 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dfc0ccb30 msgr2=0x7f9dfc0ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:33.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.126+0000 7f9dfaffd700 1 --2- 172.21.15.37:0/2126934927 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dfc0ccb30 0x7f9dfc0ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.126+0000 7f9dfaffd700 1 -- 172.21.15.37:0/2126934927 >> v1:172.21.15.191:6789/0 conn(0x7f9dfc0b2380 legacy=0x7f9dfc0b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:33.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.126+0000 7f9dfaffd700 1 -- 172.21.15.37:0/2126934927 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc0b0150 con 0x7f9dfc1593c0 2023-10-06T02:25:33.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.126+0000 7f9dfaffd700 1 --2- 172.21.15.37:0/2126934927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc1593c0 0x7f9dfc159790 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009f20 tx=0x7f9dec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134dcf05e56e3f30 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:33.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.126+0000 7f9df9ffb700 1 -- 172.21.15.37:0/2126934927 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec00e070 con 0x7f9dfc1593c0 2023-10-06T02:25:33.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.126+0000 7f9df9ffb700 1 -- 172.21.15.37:0/2126934927 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec00b9d0 con 0x7f9dfc1593c0 2023-10-06T02:25:33.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.126+0000 7f9df9ffb700 1 -- 172.21.15.37:0/2126934927 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec0092e0 con 0x7f9dfc1593c0 2023-10-06T02:25:33.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.126+0000 7f9e01405700 1 -- 172.21.15.37:0/2126934927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc1593c0 msgr2=0x7f9dfc159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:33.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.126+0000 7f9e01405700 1 --2- 172.21.15.37:0/2126934927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc1593c0 0x7f9dfc159790 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009f20 tx=0x7f9dec009840 comp rx=0 tx=0).stop 2023-10-06T02:25:33.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.126+0000 7f9e01405700 1 -- 172.21.15.37:0/2126934927 shutdown_connections 2023-10-06T02:25:33.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.126+0000 7f9e01405700 1 --2- 172.21.15.37:0/2126934927 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dfc0ccb30 0x7f9dfc0ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.126+0000 7f9e01405700 1 --2- 172.21.15.37:0/2126934927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc1593c0 0x7f9dfc159790 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.126+0000 7f9e01405700 1 -- 172.21.15.37:0/2126934927 >> 172.21.15.37:0/2126934927 conn(0x7f9dfc06c0b0 msgr2=0x7f9dfc06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:33.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.126+0000 7f9e01405700 1 -- 172.21.15.37:0/2126934927 shutdown_connections 2023-10-06T02:25:33.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.126+0000 7f9e01405700 1 -- 172.21.15.37:0/2126934927 wait complete. 2023-10-06T02:25:33.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.128+0000 7f9e01405700 1 Processor -- start 2023-10-06T02:25:33.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.128+0000 7f9e01405700 1 -- start start 2023-10-06T02:25:33.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.128+0000 7f9e01405700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dfc0b2380 0x7f9dfc0c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:33.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.128+0000 7f9e01405700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc0ccb30 0x7f9dfc154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:33.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.128+0000 7f9e01405700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dfc1593c0 0x7f9dfc0c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:33.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.128+0000 7f9e01405700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0c8ce0 con 0x7f9dfc0ccb30 2023-10-06T02:25:33.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.128+0000 7f9e01405700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0b4410 con 0x7f9dfc0b2380 2023-10-06T02:25:33.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.129+0000 7f9e01405700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0b46f0 con 0x7f9dfc1593c0 2023-10-06T02:25:33.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.129+0000 7f9dfa7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc0ccb30 0x7f9dfc154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:33.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.129+0000 7f9dfa7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc0ccb30 0x7f9dfc154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35490/0 (socket says 172.21.15.37:35490) 2023-10-06T02:25:33.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.129+0000 7f9dfa7fc700 1 -- 172.21.15.37:0/483677670 learned_addr learned my addr 172.21.15.37:0/483677670 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:33.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.129+0000 7f9dfaffd700 1 --2- 172.21.15.37:0/483677670 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dfc0b2380 0x7f9dfc0c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:33.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.129+0000 7f9dfb7fe700 1 --2- 172.21.15.37:0/483677670 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dfc1593c0 0x7f9dfc0c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:33.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.129+0000 7f9dfa7fc700 1 -- 172.21.15.37:0/483677670 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dfc1593c0 msgr2=0x7f9dfc0c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:33.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.129+0000 7f9dfa7fc700 1 --2- 172.21.15.37:0/483677670 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dfc1593c0 0x7f9dfc0c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.129+0000 7f9dfa7fc700 1 -- 172.21.15.37:0/483677670 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dfc0b2380 msgr2=0x7f9dfc0c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:33.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.129+0000 7f9dfa7fc700 1 --2- 172.21.15.37:0/483677670 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dfc0b2380 0x7f9dfc0c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.129+0000 7f9dfa7fc700 1 -- 172.21.15.37:0/483677670 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec009ae0 con 0x7f9dfc0ccb30 2023-10-06T02:25:33.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.129+0000 7f9dfa7fc700 1 --2- 172.21.15.37:0/483677670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc0ccb30 0x7f9dfc154a20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9de400c590 tx=0x7f9de400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:33.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.129+0000 7f9df2ffd700 1 -- 172.21.15.37:0/483677670 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4011590 con 0x7f9dfc0ccb30 2023-10-06T02:25:33.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.129+0000 7f9df2ffd700 1 -- 172.21.15.37:0/483677670 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de4011710 con 0x7f9dfc0ccb30 2023-10-06T02:25:33.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.129+0000 7f9e01405700 1 -- 172.21.15.37:0/483677670 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dfc0b49d0 con 0x7f9dfc0ccb30 2023-10-06T02:25:33.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.129+0000 7f9df2ffd700 1 -- 172.21.15.37:0/483677670 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4011ad0 con 0x7f9dfc0ccb30 2023-10-06T02:25:33.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.129+0000 7f9e01405700 1 -- 172.21.15.37:0/483677670 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc0c89e0 con 0x7f9dfc0ccb30 2023-10-06T02:25:33.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.130+0000 7f9e01405700 1 -- 172.21.15.37:0/483677670 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dfc0b4ef0 con 0x7f9dfc0ccb30 2023-10-06T02:25:33.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.131+0000 7f9df2ffd700 1 -- 172.21.15.37:0/483677670 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9de401b3b0 con 0x7f9dfc0ccb30 2023-10-06T02:25:33.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.131+0000 7f9df2ffd700 1 --2- 172.21.15.37:0/483677670 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ddc066f30 0x7f9ddc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:33.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.131+0000 7f9df2ffd700 1 -- 172.21.15.37:0/483677670 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f9de4083b00 con 0x7f9dfc0ccb30 2023-10-06T02:25:33.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.131+0000 7f9dfaffd700 1 --2- 172.21.15.37:0/483677670 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ddc066f30 0x7f9ddc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:33.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.132+0000 7f9dfaffd700 1 --2- 172.21.15.37:0/483677670 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ddc066f30 0x7f9ddc0693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009880 tx=0x7f9dec018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:33.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.135+0000 7f9df2ffd700 1 -- 172.21.15.37:0/483677670 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9dfc0b4ef0 con 0x7f9dfc0ccb30 2023-10-06T02:25:33.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.330+0000 7f9e01405700 1 -- 172.21.15.37:0/483677670 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9dfc0b4ec0 con 0x7f9dfc0ccb30 2023-10-06T02:25:33.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.330+0000 7f9df2ffd700 1 -- 172.21.15.37:0/483677670 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v45) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9de4017020 con 0x7f9dfc0ccb30 2023-10-06T02:25:33.332 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T02:25:33.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.332+0000 7f9e01405700 1 -- 172.21.15.37:0/483677670 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ddc066f30 msgr2=0x7f9ddc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:33.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.332+0000 7f9e01405700 1 --2- 172.21.15.37:0/483677670 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ddc066f30 0x7f9ddc0693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009880 tx=0x7f9dec018000 comp rx=0 tx=0).stop 2023-10-06T02:25:33.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.332+0000 7f9e01405700 1 -- 172.21.15.37:0/483677670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc0ccb30 msgr2=0x7f9dfc154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:33.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.332+0000 7f9e01405700 1 --2- 172.21.15.37:0/483677670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc0ccb30 0x7f9dfc154a20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9de400c590 tx=0x7f9de400c8a0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.332+0000 7f9e01405700 1 -- 172.21.15.37:0/483677670 shutdown_connections 2023-10-06T02:25:33.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.332+0000 7f9e01405700 1 --2- 172.21.15.37:0/483677670 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dfc1593c0 0x7f9dfc0c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.332+0000 7f9e01405700 1 --2- 172.21.15.37:0/483677670 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ddc066f30 0x7f9ddc0693e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.332+0000 7f9e01405700 1 --2- 172.21.15.37:0/483677670 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dfc0b2380 0x7f9dfc0c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.332+0000 7f9e01405700 1 --2- 172.21.15.37:0/483677670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc0ccb30 0x7f9dfc154a20 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.332+0000 7f9e01405700 1 -- 172.21.15.37:0/483677670 >> 172.21.15.37:0/483677670 conn(0x7f9dfc06c0b0 msgr2=0x7f9dfc0d0500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:33.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.332+0000 7f9e01405700 1 -- 172.21.15.37:0/483677670 shutdown_connections 2023-10-06T02:25:33.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.332+0000 7f9e01405700 1 -- 172.21.15.37:0/483677670 wait complete. 2023-10-06T02:25:33.406 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:25:33.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.527+0000 7fbc27031700 1 Processor -- start 2023-10-06T02:25:33.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.527+0000 7fbc27031700 1 -- start start 2023-10-06T02:25:33.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.527+0000 7fbc27031700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbc201593c0 0x7fbc20159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:33.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.527+0000 7fbc27031700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbc200b2380 0x7fbc200b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:33.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.527+0000 7fbc27031700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc200b07a0 con 0x7fbc200ccb30 2023-10-06T02:25:33.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.527+0000 7fbc27031700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc200cd6a0 con 0x7fbc201593c0 2023-10-06T02:25:33.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.527+0000 7fbc27031700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc200cd8a0 con 0x7fbc200b2380 2023-10-06T02:25:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.528+0000 7fbc24dcd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbc201593c0 0x7fbc20159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.528+0000 7fbc24dcd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbc201593c0 0x7fbc20159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35494/0 (socket says 172.21.15.37:35494) 2023-10-06T02:25:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.528+0000 7fbc24dcd700 1 -- 172.21.15.37:0/2616199383 learned_addr learned my addr 172.21.15.37:0/2616199383 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.528+0000 7fbc1ffff700 1 --2- 172.21.15.37:0/2616199383 >> v2:172.21.15.191:3300/0 conn(0x7fbc200b2380 0x7fbc200b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.528+0000 7fbc24dcd700 1 -- 172.21.15.37:0/2616199383 >> v2:172.21.15.191:3300/0 conn(0x7fbc200b2380 msgr2=0x7fbc200b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.528+0000 7fbc24dcd700 1 --2- 172.21.15.37:0/2616199383 >> v2:172.21.15.191:3300/0 conn(0x7fbc200b2380 0x7fbc200b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.528+0000 7fbc24dcd700 1 -- 172.21.15.37:0/2616199383 >> v1:172.21.15.191:6789/0 conn(0x7fbc200ccb30 legacy=0x7fbc200ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.528+0000 7fbc24dcd700 1 -- 172.21.15.37:0/2616199383 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc200afe70 con 0x7fbc201593c0 2023-10-06T02:25:33.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.528+0000 7fbc24dcd700 1 --2- 172.21.15.37:0/2616199383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc201593c0 0x7fbc20159790 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbc200b2170 tx=0x7fbc10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9be9499975ce88 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:33.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.528+0000 7fbc1f7fe700 1 -- 172.21.15.37:0/2616199383 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1000b860 con 0x7fbc201593c0 2023-10-06T02:25:33.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.528+0000 7fbc1f7fe700 1 -- 172.21.15.37:0/2616199383 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1000b9c0 con 0x7fbc201593c0 2023-10-06T02:25:33.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.528+0000 7fbc1f7fe700 1 -- 172.21.15.37:0/2616199383 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1000bd60 con 0x7fbc201593c0 2023-10-06T02:25:33.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.529+0000 7fbc27031700 1 -- 172.21.15.37:0/2616199383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc201593c0 msgr2=0x7fbc20159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:33.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.529+0000 7fbc27031700 1 --2- 172.21.15.37:0/2616199383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc201593c0 0x7fbc20159790 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbc200b2170 tx=0x7fbc10009250 comp rx=0 tx=0).stop 2023-10-06T02:25:33.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.529+0000 7fbc27031700 1 -- 172.21.15.37:0/2616199383 shutdown_connections 2023-10-06T02:25:33.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.529+0000 7fbc27031700 1 --2- 172.21.15.37:0/2616199383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc201593c0 0x7fbc20159790 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.529+0000 7fbc27031700 1 --2- 172.21.15.37:0/2616199383 >> v2:172.21.15.191:3300/0 conn(0x7fbc200b2380 0x7fbc200b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.529+0000 7fbc27031700 1 -- 172.21.15.37:0/2616199383 >> 172.21.15.37:0/2616199383 conn(0x7fbc2006c0b0 msgr2=0x7fbc2006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.529+0000 7fbc27031700 1 -- 172.21.15.37:0/2616199383 shutdown_connections 2023-10-06T02:25:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.529+0000 7fbc27031700 1 -- 172.21.15.37:0/2616199383 wait complete. 2023-10-06T02:25:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.530+0000 7fbc27031700 1 Processor -- start 2023-10-06T02:25:33.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.530+0000 7fbc27031700 1 -- start start 2023-10-06T02:25:33.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.531+0000 7fbc27031700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc200b2380 0x7fbc200c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:33.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.531+0000 7fbc27031700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc200ccb30 0x7fbc20158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:33.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.531+0000 7fbc27031700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc201593c0 0x7fbc200c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.531+0000 7fbc27031700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200c7dc0 con 0x7fbc200b2380 2023-10-06T02:25:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.531+0000 7fbc27031700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200c5500 con 0x7fbc201593c0 2023-10-06T02:25:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.531+0000 7fbc27031700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200ca330 con 0x7fbc200ccb30 2023-10-06T02:25:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.531+0000 7fbc24dcd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc200b2380 0x7fbc200c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.531+0000 7fbc24dcd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc200b2380 0x7fbc200c9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35496/0 (socket says 172.21.15.37:35496) 2023-10-06T02:25:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.531+0000 7fbc24dcd700 1 -- 172.21.15.37:0/921109171 learned_addr learned my addr 172.21.15.37:0/921109171 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.531+0000 7fbc255ce700 1 --2- 172.21.15.37:0/921109171 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc201593c0 0x7fbc200c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.531+0000 7fbc1ffff700 1 --2- 172.21.15.37:0/921109171 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc200ccb30 0x7fbc20158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.531+0000 7fbc24dcd700 1 -- 172.21.15.37:0/921109171 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc200ccb30 msgr2=0x7fbc20158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.531+0000 7fbc24dcd700 1 --2- 172.21.15.37:0/921109171 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc200ccb30 0x7fbc20158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.531+0000 7fbc24dcd700 1 -- 172.21.15.37:0/921109171 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc201593c0 msgr2=0x7fbc200c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.531+0000 7fbc24dcd700 1 --2- 172.21.15.37:0/921109171 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc201593c0 0x7fbc200c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.531+0000 7fbc24dcd700 1 -- 172.21.15.37:0/921109171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc100094f0 con 0x7fbc200b2380 2023-10-06T02:25:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.531+0000 7fbc24dcd700 1 --2- 172.21.15.37:0/921109171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc200b2380 0x7fbc200c9ca0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fbc200894a0 tx=0x7fbc10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.532+0000 7fbc1cff9700 1 -- 172.21.15.37:0/921109171 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10024440 con 0x7fbc200b2380 2023-10-06T02:25:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.532+0000 7fbc1cff9700 1 -- 172.21.15.37:0/921109171 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc100245a0 con 0x7fbc200b2380 2023-10-06T02:25:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.532+0000 7fbc27031700 1 -- 172.21.15.37:0/921109171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc200ca610 con 0x7fbc200b2380 2023-10-06T02:25:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.532+0000 7fbc1cff9700 1 -- 172.21.15.37:0/921109171 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10024960 con 0x7fbc200b2380 2023-10-06T02:25:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.532+0000 7fbc27031700 1 -- 172.21.15.37:0/921109171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc200c5120 con 0x7fbc200b2380 2023-10-06T02:25:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.533+0000 7fbc27031700 1 -- 172.21.15.37:0/921109171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc20088bb0 con 0x7fbc200b2380 2023-10-06T02:25:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.533+0000 7fbc1cff9700 1 -- 172.21.15.37:0/921109171 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc10024d50 con 0x7fbc200b2380 2023-10-06T02:25:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.533+0000 7fbc1cff9700 1 --2- 172.21.15.37:0/921109171 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbc0c066f30 0x7fbc0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.533+0000 7fbc1cff9700 1 -- 172.21.15.37:0/921109171 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fbc10086130 con 0x7fbc200b2380 2023-10-06T02:25:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.533+0000 7fbc1ffff700 1 --2- 172.21.15.37:0/921109171 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbc0c066f30 0x7fbc0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.534+0000 7fbc1ffff700 1 --2- 172.21.15.37:0/921109171 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbc0c066f30 0x7fbc0c0693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbc14006fd0 tx=0x7fbc14008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.537+0000 7fbc1cff9700 1 -- 172.21.15.37:0/921109171 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc10053200 con 0x7fbc200b2380 2023-10-06T02:25:33.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.731+0000 7fbc27031700 1 -- 172.21.15.37:0/921109171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc200b0150 con 0x7fbc200b2380 2023-10-06T02:25:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.731+0000 7fbc1cff9700 1 -- 172.21.15.37:0/921109171 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v45) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc1002b340 con 0x7fbc200b2380 2023-10-06T02:25:33.913 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T02:25:33.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.733+0000 7fbc27031700 1 -- 172.21.15.37:0/921109171 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbc0c066f30 msgr2=0x7fbc0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:33.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.733+0000 7fbc27031700 1 --2- 172.21.15.37:0/921109171 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbc0c066f30 0x7fbc0c0693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbc14006fd0 tx=0x7fbc14008040 comp rx=0 tx=0).stop 2023-10-06T02:25:33.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.733+0000 7fbc27031700 1 -- 172.21.15.37:0/921109171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc200b2380 msgr2=0x7fbc200c9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:33.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.733+0000 7fbc27031700 1 --2- 172.21.15.37:0/921109171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc200b2380 0x7fbc200c9ca0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fbc200894a0 tx=0x7fbc10017000 comp rx=0 tx=0).stop 2023-10-06T02:25:33.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.733+0000 7fbc27031700 1 -- 172.21.15.37:0/921109171 shutdown_connections 2023-10-06T02:25:33.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.733+0000 7fbc27031700 1 --2- 172.21.15.37:0/921109171 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbc0c066f30 0x7fbc0c0693e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.733+0000 7fbc27031700 1 --2- 172.21.15.37:0/921109171 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc201593c0 0x7fbc200c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.733+0000 7fbc27031700 1 --2- 172.21.15.37:0/921109171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc200b2380 0x7fbc200c9ca0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.733+0000 7fbc27031700 1 --2- 172.21.15.37:0/921109171 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc200ccb30 0x7fbc20158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:33.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.733+0000 7fbc27031700 1 -- 172.21.15.37:0/921109171 >> 172.21.15.37:0/921109171 conn(0x7fbc2006c0b0 msgr2=0x7fbc200b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:33.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.734+0000 7fbc27031700 1 -- 172.21.15.37:0/921109171 shutdown_connections 2023-10-06T02:25:33.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:33.734+0000 7fbc27031700 1 -- 172.21.15.37:0/921109171 wait complete. 2023-10-06T02:25:33.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.037+0000 7f354bd44700 1 Processor -- start 2023-10-06T02:25:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.037+0000 7f354bd44700 1 -- start start 2023-10-06T02:25:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.038+0000 7f354bd44700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35440a8920 0x7f35440b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.038+0000 7f354bd44700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f35440a8cf0 0x7f35440b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.038+0000 7f354bd44700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354415d1f0 con 0x7f3544159040 2023-10-06T02:25:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.038+0000 7f354bd44700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3544159ba0 con 0x7f35440a8cf0 2023-10-06T02:25:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.038+0000 7f354bd44700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35440b4150 con 0x7f35440a8920 2023-10-06T02:25:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.038+0000 7f354a2e1700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3544159040 0x7f3544159490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43094/0 (socket says 172.21.15.37:43094) 2023-10-06T02:25:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.038+0000 7f354a2e1700 1 -- 172.21.15.37:0/1192163796 learned_addr learned my addr 172.21.15.37:0/1192163796 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.038+0000 7f3549ae0700 1 --2- 172.21.15.37:0/1192163796 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35440a8920 0x7f35440b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.038+0000 7f35492df700 1 --2- 172.21.15.37:0/1192163796 >> v2:172.21.15.191:3300/0 conn(0x7f35440a8cf0 0x7f35440b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.038+0000 7f3548ade700 1 -- 172.21.15.37:0/1192163796 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121484400 0 0) 0x7f354415d1f0 con 0x7f3544159040 2023-10-06T02:25:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.038+0000 7f3548ade700 1 -- 172.21.15.37:0/1192163796 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f352c003570 con 0x7f3544159040 2023-10-06T02:25:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.038+0000 7f35492df700 1 -- 172.21.15.37:0/1192163796 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35440a8920 msgr2=0x7f35440b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.038+0000 7f35492df700 1 --2- 172.21.15.37:0/1192163796 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35440a8920 0x7f35440b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.038+0000 7f35492df700 1 -- 172.21.15.37:0/1192163796 >> v1:172.21.15.37:6789/0 conn(0x7f3544159040 legacy=0x7f3544159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.038+0000 7f35492df700 1 -- 172.21.15.37:0/1192163796 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354415dd70 con 0x7f35440a8cf0 2023-10-06T02:25:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.039+0000 7f35492df700 1 --2- 172.21.15.37:0/1192163796 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35440a8cf0 0x7f35440b15d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f35380098e0 tx=0x7f35380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cce9a7b8cc781a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.039+0000 7f3548ade700 1 -- 172.21.15.37:0/1192163796 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538011630 con 0x7f35440a8cf0 2023-10-06T02:25:34.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.039+0000 7f3548ade700 1 -- 172.21.15.37:0/1192163796 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3538011790 con 0x7f35440a8cf0 2023-10-06T02:25:34.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.039+0000 7f3548ade700 1 -- 172.21.15.37:0/1192163796 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538011b30 con 0x7f35440a8cf0 2023-10-06T02:25:34.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.039+0000 7f354bd44700 1 -- 172.21.15.37:0/1192163796 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35440a8cf0 msgr2=0x7f35440b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:34.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.039+0000 7f354bd44700 1 --2- 172.21.15.37:0/1192163796 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35440a8cf0 0x7f35440b15d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f35380098e0 tx=0x7f35380091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.039+0000 7f354bd44700 1 -- 172.21.15.37:0/1192163796 shutdown_connections 2023-10-06T02:25:34.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.039+0000 7f354bd44700 1 --2- 172.21.15.37:0/1192163796 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35440a8920 0x7f35440b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.039+0000 7f354bd44700 1 --2- 172.21.15.37:0/1192163796 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35440a8cf0 0x7f35440b15d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.039+0000 7f354bd44700 1 -- 172.21.15.37:0/1192163796 >> 172.21.15.37:0/1192163796 conn(0x7f3544067b30 msgr2=0x7f3544067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:34.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.039+0000 7f354bd44700 1 -- 172.21.15.37:0/1192163796 shutdown_connections 2023-10-06T02:25:34.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.039+0000 7f354bd44700 1 -- 172.21.15.37:0/1192163796 wait complete. 2023-10-06T02:25:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.040+0000 7f354bd44700 1 Processor -- start 2023-10-06T02:25:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.041+0000 7f354bd44700 1 -- start start 2023-10-06T02:25:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.041+0000 7f354bd44700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35440a8920 0x7f35441556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.041+0000 7f354bd44700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35440a8cf0 0x7f354414bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.041+0000 7f354bd44700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3544159040 0x7f3544154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.041+0000 7f354bd44700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3544155c20 con 0x7f35440a8cf0 2023-10-06T02:25:34.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.041+0000 7f354bd44700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3544156a40 con 0x7f35440a8920 2023-10-06T02:25:34.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.041+0000 7f354bd44700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3544155ec0 con 0x7f3544159040 2023-10-06T02:25:34.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.041+0000 7f35492df700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35440a8cf0 0x7f354414bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.041+0000 7f35492df700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35440a8cf0 0x7f354414bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35508/0 (socket says 172.21.15.37:35508) 2023-10-06T02:25:34.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.041+0000 7f35492df700 1 -- 172.21.15.37:0/3605589731 learned_addr learned my addr 172.21.15.37:0/3605589731 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:34.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.042+0000 7f3549ae0700 1 --2- 172.21.15.37:0/3605589731 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35440a8920 0x7f35441556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.042+0000 7f35492df700 1 -- 172.21.15.37:0/3605589731 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3544159040 msgr2=0x7f3544154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:34.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.042+0000 7f354a2e1700 1 --2- 172.21.15.37:0/3605589731 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3544159040 0x7f3544154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.042+0000 7f35492df700 1 --2- 172.21.15.37:0/3605589731 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3544159040 0x7f3544154770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.042+0000 7f35492df700 1 -- 172.21.15.37:0/3605589731 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35440a8920 msgr2=0x7f35441556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.042+0000 7f35492df700 1 --2- 172.21.15.37:0/3605589731 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35440a8920 0x7f35441556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.042+0000 7f35492df700 1 -- 172.21.15.37:0/3605589731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3538009420 con 0x7f35440a8cf0 2023-10-06T02:25:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.042+0000 7f35492df700 1 --2- 172.21.15.37:0/3605589731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35440a8cf0 0x7f354414bb40 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f35440ad850 tx=0x7f3538017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.042+0000 7f3541ffb700 1 -- 172.21.15.37:0/3605589731 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538011b10 con 0x7f35440a8cf0 2023-10-06T02:25:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.042+0000 7f3541ffb700 1 -- 172.21.15.37:0/3605589731 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35380253f0 con 0x7f35440a8cf0 2023-10-06T02:25:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.042+0000 7f354bd44700 1 -- 172.21.15.37:0/3605589731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35441561a0 con 0x7f35440a8cf0 2023-10-06T02:25:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.042+0000 7f3541ffb700 1 -- 172.21.15.37:0/3605589731 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35380257b0 con 0x7f35440a8cf0 2023-10-06T02:25:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.042+0000 7f354bd44700 1 -- 172.21.15.37:0/3605589731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3544156760 con 0x7f35440a8cf0 2023-10-06T02:25:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.043+0000 7f354bd44700 1 -- 172.21.15.37:0/3605589731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35440ad980 con 0x7f35440a8cf0 2023-10-06T02:25:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.044+0000 7f3541ffb700 1 -- 172.21.15.37:0/3605589731 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3538025ba0 con 0x7f35440a8cf0 2023-10-06T02:25:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.044+0000 7f3541ffb700 1 --2- 172.21.15.37:0/3605589731 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3530066f30 0x7f35300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.044+0000 7f3541ffb700 1 -- 172.21.15.37:0/3605589731 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f3538086070 con 0x7f35440a8cf0 2023-10-06T02:25:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.044+0000 7f3549ae0700 1 --2- 172.21.15.37:0/3605589731 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3530066f30 0x7f35300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.045+0000 7f3549ae0700 1 --2- 172.21.15.37:0/3605589731 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3530066f30 0x7f35300693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3534009390 tx=0x7f3534008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.049+0000 7f3541ffb700 1 -- 172.21.15.37:0/3605589731 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35380531c0 con 0x7f35440a8cf0 2023-10-06T02:25:34.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.286+0000 7f354bd44700 1 -- 172.21.15.37:0/3605589731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f354404bb80 con 0x7f35440a8cf0 2023-10-06T02:25:34.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.287+0000 7f3541ffb700 1 -- 172.21.15.37:0/3605589731 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f35380567e0 con 0x7f35440a8cf0 2023-10-06T02:25:34.292 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:34.293 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2341182274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2341182274},{"type":"v1","addr":"172.21.15.191:6837","nonce":2341182274}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5385,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/562500386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":562500386},{"type":"v1","addr":"172.21.15.37:6834","nonce":562500386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1403086996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1403086996},{"type":"v1","addr":"172.21.15.37:6835","nonce":1403086996}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:50.379875+0000","modified":"2023-10-06T02:24:54.014513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5400":{"gid":5400,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6836/2931117635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2931117635},{"type":"v1","addr":"172.21.15.191:6836","nonce":2931117635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:25:34.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.289+0000 7f354bd44700 1 -- 172.21.15.37:0/3605589731 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3530066f30 msgr2=0x7f35300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:34.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.289+0000 7f354bd44700 1 --2- 172.21.15.37:0/3605589731 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3530066f30 0x7f35300693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3534009390 tx=0x7f3534008040 comp rx=0 tx=0).stop 2023-10-06T02:25:34.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.289+0000 7f354bd44700 1 -- 172.21.15.37:0/3605589731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35440a8cf0 msgr2=0x7f354414bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:34.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.289+0000 7f354bd44700 1 --2- 172.21.15.37:0/3605589731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35440a8cf0 0x7f354414bb40 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f35440ad850 tx=0x7f3538017000 comp rx=0 tx=0).stop 2023-10-06T02:25:34.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.289+0000 7f354bd44700 1 -- 172.21.15.37:0/3605589731 shutdown_connections 2023-10-06T02:25:34.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.289+0000 7f354bd44700 1 --2- 172.21.15.37:0/3605589731 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3544159040 0x7f3544154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.289+0000 7f354bd44700 1 --2- 172.21.15.37:0/3605589731 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3530066f30 0x7f35300693e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.289+0000 7f354bd44700 1 --2- 172.21.15.37:0/3605589731 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35440a8920 0x7f35441556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.289+0000 7f354bd44700 1 --2- 172.21.15.37:0/3605589731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35440a8cf0 0x7f354414bb40 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.289+0000 7f354bd44700 1 -- 172.21.15.37:0/3605589731 >> 172.21.15.37:0/3605589731 conn(0x7f3544067b30 msgr2=0x7f35440af5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:34.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.289+0000 7f354bd44700 1 -- 172.21.15.37:0/3605589731 shutdown_connections 2023-10-06T02:25:34.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.289+0000 7f354bd44700 1 -- 172.21.15.37:0/3605589731 wait complete. 2023-10-06T02:25:34.295 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 23 2023-10-06T02:25:34.302 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:25:34.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.463+0000 7f4deed75700 1 Processor -- start 2023-10-06T02:25:34.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.463+0000 7f4deed75700 1 -- start start 2023-10-06T02:25:34.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.464+0000 7f4deed75700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4de80cf9f0 0x7f4de80cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.464+0000 7f4deed75700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de80c5300 con 0x7f4de81596d0 2023-10-06T02:25:34.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.464+0000 7f4deed75700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de80c6160 con 0x7f4de8159aa0 2023-10-06T02:25:34.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.464+0000 7f4deed75700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de80d03b0 con 0x7f4de80cf9f0 2023-10-06T02:25:34.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.464+0000 7f4decb11700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4de81596d0 0x7f4de80b3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43110/0 (socket says 172.21.15.37:43110) 2023-10-06T02:25:34.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.464+0000 7f4decb11700 1 -- 172.21.15.37:0/2500458979 learned_addr learned my addr 172.21.15.37:0/2500458979 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:34.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.464+0000 7f4ded312700 1 --2- 172.21.15.37:0/2500458979 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4de80cf9f0 0x7f4de80cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.464+0000 7f4de77fe700 1 -- 172.21.15.37:0/2500458979 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545190534 0 0) 0x7f4de80c5300 con 0x7f4de81596d0 2023-10-06T02:25:34.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.464+0000 7f4de77fe700 1 -- 172.21.15.37:0/2500458979 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dd4003570 con 0x7f4de81596d0 2023-10-06T02:25:34.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4de77fe700 1 -- 172.21.15.37:0/2500458979 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2144432212 0 0) 0x7f4dd4003570 con 0x7f4de81596d0 2023-10-06T02:25:34.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4de77fe700 1 -- 172.21.15.37:0/2500458979 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4de80cf9f0 msgr2=0x7f4de80cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:34.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4de77fe700 1 --2- 172.21.15.37:0/2500458979 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4de80cf9f0 0x7f4de80cfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4de77fe700 1 -- 172.21.15.37:0/2500458979 >> v1:172.21.15.191:6789/0 conn(0x7f4de8159aa0 legacy=0x7f4de80c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:34.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4de77fe700 1 -- 172.21.15.37:0/2500458979 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de80c5550 con 0x7f4de81596d0 2023-10-06T02:25:34.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4de77fe700 1 -- 172.21.15.37:0/2500458979 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f4de00017f0 con 0x7f4de81596d0 2023-10-06T02:25:34.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4de77fe700 1 -- 172.21.15.37:0/2500458979 >> v1:172.21.15.37:6789/0 conn(0x7f4de81596d0 legacy=0x7f4de80b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:34.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4de77fe700 1 --2- 172.21.15.37:0/2500458979 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4de80cf9f0 0x7f4dd4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4de77fe700 1 --2- 172.21.15.37:0/2500458979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dd4003fd0 0x7f4dd4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4de77fe700 1 --2- 172.21.15.37:0/2500458979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4dd4004d50 0x7f4dd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4de77fe700 1 -- 172.21.15.37:0/2500458979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de80d03b0 con 0x7f4dd4003fd0 2023-10-06T02:25:34.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4de77fe700 1 -- 172.21.15.37:0/2500458979 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd400bb40 con 0x7f4dd4004d50 2023-10-06T02:25:34.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4de77fe700 1 -- 172.21.15.37:0/2500458979 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd400bd00 con 0x7f4de80cf9f0 2023-10-06T02:25:34.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4de7fff700 1 --2- 172.21.15.37:0/2500458979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dd4003fd0 0x7f4dd4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4decb11700 1 --2- 172.21.15.37:0/2500458979 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4de80cf9f0 0x7f4dd4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4ded312700 1 --2- 172.21.15.37:0/2500458979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4dd4004d50 0x7f4dd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4de7fff700 1 -- 172.21.15.37:0/2500458979 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4de80cf9f0 msgr2=0x7f4dd4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:34.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4de7fff700 1 --2- 172.21.15.37:0/2500458979 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4de80cf9f0 0x7f4dd4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4de7fff700 1 -- 172.21.15.37:0/2500458979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4dd4004d50 msgr2=0x7f4dd40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:34.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4de7fff700 1 --2- 172.21.15.37:0/2500458979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4dd4004d50 0x7f4dd40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.465+0000 7f4de7fff700 1 -- 172.21.15.37:0/2500458979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd4003570 con 0x7f4dd4003fd0 2023-10-06T02:25:34.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.466+0000 7f4de7fff700 1 --2- 172.21.15.37:0/2500458979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dd4003fd0 0x7f4dd4004810 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8001960 tx=0x7f4dd8007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe2f8f53d03b4f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:34.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.466+0000 7f4de77fe700 1 -- 172.21.15.37:0/2500458979 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd800c5d0 con 0x7f4dd4003fd0 2023-10-06T02:25:34.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.466+0000 7f4de77fe700 1 -- 172.21.15.37:0/2500458979 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd800c750 con 0x7f4dd4003fd0 2023-10-06T02:25:34.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.466+0000 7f4de77fe700 1 -- 172.21.15.37:0/2500458979 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd800cb10 con 0x7f4dd4003fd0 2023-10-06T02:25:34.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.466+0000 7f4deed75700 1 -- 172.21.15.37:0/2500458979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dd4003fd0 msgr2=0x7f4dd4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:34.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.466+0000 7f4deed75700 1 --2- 172.21.15.37:0/2500458979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dd4003fd0 0x7f4dd4004810 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8001960 tx=0x7f4dd8007d10 comp rx=0 tx=0).stop 2023-10-06T02:25:34.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.466+0000 7f4ded312700 1 -- 172.21.15.37:0/2500458979 reap_dead start 2023-10-06T02:25:34.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.466+0000 7f4deed75700 1 -- 172.21.15.37:0/2500458979 shutdown_connections 2023-10-06T02:25:34.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.466+0000 7f4deed75700 1 -- 172.21.15.37:0/2500458979 >> 172.21.15.37:0/2500458979 conn(0x7f4de806c890 msgr2=0x7f4de80d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:34.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.466+0000 7f4deed75700 1 -- 172.21.15.37:0/2500458979 shutdown_connections 2023-10-06T02:25:34.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.466+0000 7f4deed75700 1 -- 172.21.15.37:0/2500458979 wait complete. 2023-10-06T02:25:34.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.467+0000 7f4deed75700 1 Processor -- start 2023-10-06T02:25:34.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.467+0000 7f4deed75700 1 -- start start 2023-10-06T02:25:34.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.468+0000 7f4deed75700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4de814bbd0 0x7f4de815c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.468+0000 7f4deed75700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4de814bfa0 0x7f4de815c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.468+0000 7f4deed75700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4de814d750 0x7f4de814dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.468+0000 7f4deed75700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de8138a60 con 0x7f4de814bbd0 2023-10-06T02:25:34.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.468+0000 7f4deed75700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de80b3f20 con 0x7f4de814d750 2023-10-06T02:25:34.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.468+0000 7f4deed75700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de814e4c0 con 0x7f4de814bfa0 2023-10-06T02:25:34.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.468+0000 7f4decb11700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4de814bbd0 0x7f4de815c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.468+0000 7f4decb11700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4de814bbd0 0x7f4de815c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35522/0 (socket says 172.21.15.37:35522) 2023-10-06T02:25:34.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.468+0000 7f4decb11700 1 -- 172.21.15.37:0/1995284806 learned_addr learned my addr 172.21.15.37:0/1995284806 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:34.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.468+0000 7f4ded312700 1 --2- 172.21.15.37:0/1995284806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4de814d750 0x7f4de814dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.468+0000 7f4de7fff700 1 --2- 172.21.15.37:0/1995284806 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4de814bfa0 0x7f4de815c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.469+0000 7f4decb11700 1 -- 172.21.15.37:0/1995284806 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4de814bfa0 msgr2=0x7f4de815c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:34.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.469+0000 7f4decb11700 1 --2- 172.21.15.37:0/1995284806 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4de814bfa0 0x7f4de815c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.469+0000 7f4decb11700 1 -- 172.21.15.37:0/1995284806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4de814d750 msgr2=0x7f4de814dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:34.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.469+0000 7f4decb11700 1 --2- 172.21.15.37:0/1995284806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4de814d750 0x7f4de814dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.469+0000 7f4decb11700 1 -- 172.21.15.37:0/1995284806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de80b41e0 con 0x7f4de814bbd0 2023-10-06T02:25:34.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.469+0000 7f4ded312700 1 --2- 172.21.15.37:0/1995284806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4de814d750 0x7f4de814dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:34.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.469+0000 7f4de7fff700 1 --2- 172.21.15.37:0/1995284806 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4de814bfa0 0x7f4de815c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:34.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.469+0000 7f4decb11700 1 --2- 172.21.15.37:0/1995284806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4de814bbd0 0x7f4de815c020 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4de000a380 tx=0x7f4de00021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:34.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.469+0000 7f4de4ff9700 1 -- 172.21.15.37:0/1995284806 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de000ae10 con 0x7f4de814bbd0 2023-10-06T02:25:34.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.469+0000 7f4de4ff9700 1 -- 172.21.15.37:0/1995284806 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de0013600 con 0x7f4de814bbd0 2023-10-06T02:25:34.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.469+0000 7f4deed75700 1 -- 172.21.15.37:0/1995284806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de80b44c0 con 0x7f4de814bbd0 2023-10-06T02:25:34.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.469+0000 7f4de4ff9700 1 -- 172.21.15.37:0/1995284806 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de00139c0 con 0x7f4de814bbd0 2023-10-06T02:25:34.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.469+0000 7f4deed75700 1 -- 172.21.15.37:0/1995284806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de814e110 con 0x7f4de814bbd0 2023-10-06T02:25:34.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.470+0000 7f4deed75700 1 -- 172.21.15.37:0/1995284806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de806fbf0 con 0x7f4de814bbd0 2023-10-06T02:25:34.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.470+0000 7f4de4ff9700 1 -- 172.21.15.37:0/1995284806 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4de0013d30 con 0x7f4de814bbd0 2023-10-06T02:25:34.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.471+0000 7f4de4ff9700 1 --2- 172.21.15.37:0/1995284806 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4dc8066f30 0x7f4dc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:34.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.471+0000 7f4de4ff9700 1 -- 172.21.15.37:0/1995284806 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f4de0085900 con 0x7f4de814bbd0 2023-10-06T02:25:34.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.471+0000 7f4de7fff700 1 --2- 172.21.15.37:0/1995284806 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4dc8066f30 0x7f4dc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:34.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.472+0000 7f4de7fff700 1 --2- 172.21.15.37:0/1995284806 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4dc8066f30 0x7f4dc80693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4de8066dc0 tx=0x7f4dd8015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:34.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.475+0000 7f4de4ff9700 1 -- 172.21.15.37:0/1995284806 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4de00529d0 con 0x7f4de814bbd0 2023-10-06T02:25:34.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.669+0000 7f4deed75700 1 -- 172.21.15.37:0/1995284806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4de80d13e0 con 0x7f4de814bbd0 2023-10-06T02:25:34.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.670+0000 7f4de4ff9700 1 -- 172.21.15.37:0/1995284806 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16962 (secure 0 0 0) 0x7f4de0055ff0 con 0x7f4de814bbd0 2023-10-06T02:25:34.914 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:34.915 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":45,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:25:03.636645+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:24:48.109383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T02:24:49.348527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.25","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:25:34.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.672+0000 7f4deed75700 1 -- 172.21.15.37:0/1995284806 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4dc8066f30 msgr2=0x7f4dc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:34.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.672+0000 7f4deed75700 1 --2- 172.21.15.37:0/1995284806 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4dc8066f30 0x7f4dc80693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4de8066dc0 tx=0x7f4dd8015000 comp rx=0 tx=0).stop 2023-10-06T02:25:34.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.672+0000 7f4deed75700 1 -- 172.21.15.37:0/1995284806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4de814bbd0 msgr2=0x7f4de815c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:34.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.672+0000 7f4deed75700 1 --2- 172.21.15.37:0/1995284806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4de814bbd0 0x7f4de815c020 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4de000a380 tx=0x7f4de00021f0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.672+0000 7f4deed75700 1 -- 172.21.15.37:0/1995284806 shutdown_connections 2023-10-06T02:25:34.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.672+0000 7f4deed75700 1 --2- 172.21.15.37:0/1995284806 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4dc8066f30 0x7f4dc80693e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.672+0000 7f4deed75700 1 --2- 172.21.15.37:0/1995284806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4de814d750 0x7f4de814dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.672+0000 7f4deed75700 1 --2- 172.21.15.37:0/1995284806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4de814bbd0 0x7f4de815c020 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.672+0000 7f4deed75700 1 --2- 172.21.15.37:0/1995284806 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4de814bfa0 0x7f4de815c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:34.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.672+0000 7f4deed75700 1 -- 172.21.15.37:0/1995284806 >> 172.21.15.37:0/1995284806 conn(0x7f4de806c890 msgr2=0x7f4de806e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:34.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.672+0000 7f4deed75700 1 -- 172.21.15.37:0/1995284806 shutdown_connections 2023-10-06T02:25:34.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:34.672+0000 7f4deed75700 1 -- 172.21.15.37:0/1995284806 wait complete. 2023-10-06T02:25:34.927 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:25:34.927 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:35.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.046+0000 7fa50d663700 1 Processor -- start 2023-10-06T02:25:35.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.046+0000 7fa50d663700 1 -- start start 2023-10-06T02:25:35.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.047+0000 7fa50d663700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa5081596d0 0x7fa5080b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.047+0000 7fa50d663700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa5080b3840 0x7fa5080c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.047+0000 7fa50d663700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5080c5300 con 0x7fa508159aa0 2023-10-06T02:25:35.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.047+0000 7fa50d663700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5080c6160 con 0x7fa5081596d0 2023-10-06T02:25:35.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.047+0000 7fa50d663700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5080c5550 con 0x7fa5080b3840 2023-10-06T02:25:35.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.047+0000 7fa506ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa5081596d0 0x7fa5080b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.047+0000 7fa506ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa5081596d0 0x7fa5080b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35528/0 (socket says 172.21.15.37:35528) 2023-10-06T02:25:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.047+0000 7fa506ffd700 1 -- 172.21.15.37:0/1450103197 learned_addr learned my addr 172.21.15.37:0/1450103197 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.048+0000 7fa5067fc700 1 --2- 172.21.15.37:0/1450103197 >> v2:172.21.15.191:3300/0 conn(0x7fa5080b3840 0x7fa5080c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.048+0000 7fa506ffd700 1 -- 172.21.15.37:0/1450103197 >> v2:172.21.15.191:3300/0 conn(0x7fa5080b3840 msgr2=0x7fa5080c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.048+0000 7fa506ffd700 1 --2- 172.21.15.37:0/1450103197 >> v2:172.21.15.191:3300/0 conn(0x7fa5080b3840 0x7fa5080c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.048+0000 7fa506ffd700 1 -- 172.21.15.37:0/1450103197 >> v1:172.21.15.191:6789/0 conn(0x7fa508159aa0 legacy=0x7fa5080caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.048+0000 7fa506ffd700 1 -- 172.21.15.37:0/1450103197 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5080c5830 con 0x7fa5081596d0 2023-10-06T02:25:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.048+0000 7fa506ffd700 1 --2- 172.21.15.37:0/1450103197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5081596d0 0x7fa5080b3300 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa50806d5f0 tx=0x7fa4f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f033d1b7f361418 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.048+0000 7fa505ffb700 1 -- 172.21.15.37:0/1450103197 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f800b820 con 0x7fa5081596d0 2023-10-06T02:25:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.048+0000 7fa505ffb700 1 -- 172.21.15.37:0/1450103197 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f800b980 con 0x7fa5081596d0 2023-10-06T02:25:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.048+0000 7fa505ffb700 1 -- 172.21.15.37:0/1450103197 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f800bd20 con 0x7fa5081596d0 2023-10-06T02:25:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.048+0000 7fa50d663700 1 -- 172.21.15.37:0/1450103197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5081596d0 msgr2=0x7fa5080b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.048+0000 7fa50d663700 1 --2- 172.21.15.37:0/1450103197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5081596d0 0x7fa5080b3300 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa50806d5f0 tx=0x7fa4f8009250 comp rx=0 tx=0).stop 2023-10-06T02:25:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.049+0000 7fa50d663700 1 -- 172.21.15.37:0/1450103197 shutdown_connections 2023-10-06T02:25:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.049+0000 7fa50d663700 1 --2- 172.21.15.37:0/1450103197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5081596d0 0x7fa5080b3300 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.049+0000 7fa50d663700 1 --2- 172.21.15.37:0/1450103197 >> v2:172.21.15.191:3300/0 conn(0x7fa5080b3840 0x7fa5080c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.049+0000 7fa50d663700 1 -- 172.21.15.37:0/1450103197 >> 172.21.15.37:0/1450103197 conn(0x7fa50806c890 msgr2=0x7fa5080d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:35.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.049+0000 7fa50d663700 1 -- 172.21.15.37:0/1450103197 shutdown_connections 2023-10-06T02:25:35.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.049+0000 7fa50d663700 1 -- 172.21.15.37:0/1450103197 wait complete. 2023-10-06T02:25:35.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.050+0000 7fa50d663700 1 Processor -- start 2023-10-06T02:25:35.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.050+0000 7fa50d663700 1 -- start start 2023-10-06T02:25:35.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa50d663700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5080b3840 0x7fa50809db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa50d663700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa5081596d0 0x7fa5081544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa50d663700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa508159aa0 0x7fa508099fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa50d663700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50815a2d0 con 0x7fa5080b3840 2023-10-06T02:25:35.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa50d663700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50815a5b0 con 0x7fa508159aa0 2023-10-06T02:25:35.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa50d663700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50815a890 con 0x7fa5081596d0 2023-10-06T02:25:35.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa506ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5080b3840 0x7fa50809db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa506ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5080b3840 0x7fa50809db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35540/0 (socket says 172.21.15.37:35540) 2023-10-06T02:25:35.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa506ffd700 1 -- 172.21.15.37:0/3403299541 learned_addr learned my addr 172.21.15.37:0/3403299541 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:35.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa5067fc700 1 --2- 172.21.15.37:0/3403299541 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa5081596d0 0x7fa5081544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa5077fe700 1 --2- 172.21.15.37:0/3403299541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa508159aa0 0x7fa508099fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa506ffd700 1 -- 172.21.15.37:0/3403299541 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa5081596d0 msgr2=0x7fa5081544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa506ffd700 1 --2- 172.21.15.37:0/3403299541 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa5081596d0 0x7fa5081544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa506ffd700 1 -- 172.21.15.37:0/3403299541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa508159aa0 msgr2=0x7fa508099fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa506ffd700 1 --2- 172.21.15.37:0/3403299541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa508159aa0 0x7fa508099fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa506ffd700 1 -- 172.21.15.37:0/3403299541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f80094f0 con 0x7fa5080b3840 2023-10-06T02:25:35.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa5067fc700 1 --2- 172.21.15.37:0/3403299541 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa5081596d0 0x7fa5081544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa5077fe700 1 --2- 172.21.15.37:0/3403299541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa508159aa0 0x7fa508099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa506ffd700 1 --2- 172.21.15.37:0/3403299541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5080b3840 0x7fa50809db70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80030c0 tx=0x7fa4f8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa4feffd700 1 -- 172.21.15.37:0/3403299541 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8011e60 con 0x7fa5080b3840 2023-10-06T02:25:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa4feffd700 1 -- 172.21.15.37:0/3403299541 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f8020070 con 0x7fa5080b3840 2023-10-06T02:25:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa50d663700 1 -- 172.21.15.37:0/3403299541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50815ab70 con 0x7fa5080b3840 2023-10-06T02:25:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa4feffd700 1 -- 172.21.15.37:0/3403299541 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f801b6a0 con 0x7fa5080b3840 2023-10-06T02:25:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.051+0000 7fa50d663700 1 -- 172.21.15.37:0/3403299541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50809e0b0 con 0x7fa5080b3840 2023-10-06T02:25:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.052+0000 7fa50d663700 1 -- 172.21.15.37:0/3403299541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5080c9380 con 0x7fa5080b3840 2023-10-06T02:25:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.053+0000 7fa4feffd700 1 -- 172.21.15.37:0/3403299541 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4f8022030 con 0x7fa5080b3840 2023-10-06T02:25:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.053+0000 7fa4feffd700 1 --2- 172.21.15.37:0/3403299541 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa4e8066f30 0x7fa4e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.053+0000 7fa4feffd700 1 -- 172.21.15.37:0/3403299541 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fa4f80866f0 con 0x7fa5080b3840 2023-10-06T02:25:35.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.054+0000 7fa5067fc700 1 --2- 172.21.15.37:0/3403299541 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa4e8066f30 0x7fa4e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.054+0000 7fa5067fc700 1 --2- 172.21.15.37:0/3403299541 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa4e8066f30 0x7fa4e80693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0006fd0 tx=0x7fa4f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.058+0000 7fa4feffd700 1 -- 172.21.15.37:0/3403299541 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5080c9380 con 0x7fa5080b3840 2023-10-06T02:25:35.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.296+0000 7fa50d663700 1 -- 172.21.15.37:0/3403299541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5080c9380 con 0x7fa5080b3840 2023-10-06T02:25:35.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.297+0000 7fa4feffd700 1 -- 172.21.15.37:0/3403299541 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fa5080c9380 con 0x7fa5080b3840 2023-10-06T02:25:35.298 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:35.298 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2341182274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2341182274},{"type":"v1","addr":"172.21.15.191:6837","nonce":2341182274}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5385,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/562500386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":562500386},{"type":"v1","addr":"172.21.15.37:6834","nonce":562500386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1403086996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1403086996},{"type":"v1","addr":"172.21.15.37:6835","nonce":1403086996}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:50.379875+0000","modified":"2023-10-06T02:24:54.014513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5400":{"gid":5400,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6836/2931117635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2931117635},{"type":"v1","addr":"172.21.15.191:6836","nonce":2931117635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:25:35.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.299+0000 7fa50d663700 1 -- 172.21.15.37:0/3403299541 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa4e8066f30 msgr2=0x7fa4e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.299+0000 7fa50d663700 1 --2- 172.21.15.37:0/3403299541 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa4e8066f30 0x7fa4e80693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0006fd0 tx=0x7fa4f0008040 comp rx=0 tx=0).stop 2023-10-06T02:25:35.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.299+0000 7fa50d663700 1 -- 172.21.15.37:0/3403299541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5080b3840 msgr2=0x7fa50809db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.299+0000 7fa50d663700 1 --2- 172.21.15.37:0/3403299541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5080b3840 0x7fa50809db70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80030c0 tx=0x7fa4f8016000 comp rx=0 tx=0).stop 2023-10-06T02:25:35.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.299+0000 7fa50d663700 1 -- 172.21.15.37:0/3403299541 shutdown_connections 2023-10-06T02:25:35.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.299+0000 7fa50d663700 1 --2- 172.21.15.37:0/3403299541 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa4e8066f30 0x7fa4e80693e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.299+0000 7fa50d663700 1 --2- 172.21.15.37:0/3403299541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa508159aa0 0x7fa508099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.299+0000 7fa50d663700 1 --2- 172.21.15.37:0/3403299541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5080b3840 0x7fa50809db70 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.299+0000 7fa50d663700 1 --2- 172.21.15.37:0/3403299541 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa5081596d0 0x7fa5081544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.299+0000 7fa50d663700 1 -- 172.21.15.37:0/3403299541 >> 172.21.15.37:0/3403299541 conn(0x7fa50806c890 msgr2=0x7fa50806e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:35.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.299+0000 7fa50d663700 1 -- 172.21.15.37:0/3403299541 shutdown_connections 2023-10-06T02:25:35.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.299+0000 7fa50d663700 1 -- 172.21.15.37:0/3403299541 wait complete. 2023-10-06T02:25:35.380 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 23 2023-10-06T02:25:35.381 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.498+0000 7f9e01185700 1 Processor -- start 2023-10-06T02:25:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.499+0000 7f9e01185700 1 -- start start 2023-10-06T02:25:35.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.499+0000 7f9e01185700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9dfc1596d0 0x7f9dfc0b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.499+0000 7f9e01185700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dfc0c5300 con 0x7f9dfc0b3840 2023-10-06T02:25:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.499+0000 7f9e01185700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dfc0c6160 con 0x7f9dfc159aa0 2023-10-06T02:25:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.499+0000 7f9e01185700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dfc0c5550 con 0x7f9dfc1596d0 2023-10-06T02:25:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.500+0000 7f9dfad9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9dfc1596d0 0x7f9dfc0b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.500+0000 7f9dfa59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9dfc0b3840 0x7f9dfc0c65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41714/0 (socket says 172.21.15.37:41714) 2023-10-06T02:25:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.500+0000 7f9dfa59c700 1 -- 172.21.15.37:0/3330984333 learned_addr learned my addr 172.21.15.37:0/3330984333 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.500+0000 7f9dfad9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9dfc1596d0 0x7f9dfc0b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33796/0 (socket says 172.21.15.37:33796) 2023-10-06T02:25:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.500+0000 7f9dfad9d700 1 -- 172.21.15.37:0/3330984333 >> v1:172.21.15.191:6789/0 conn(0x7f9dfc159aa0 legacy=0x7f9dfc0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.500+0000 7f9dfad9d700 1 -- 172.21.15.37:0/3330984333 >> v1:172.21.15.37:6789/0 conn(0x7f9dfc0b3840 legacy=0x7f9dfc0c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.500+0000 7f9dfad9d700 1 -- 172.21.15.37:0/3330984333 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc0c5830 con 0x7f9dfc1596d0 2023-10-06T02:25:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.500+0000 7f9df9d9b700 1 -- 172.21.15.37:0/3330984333 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 642861263 0 0) 0x7f9dfc0c5300 con 0x7f9dfc0b3840 2023-10-06T02:25:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.500+0000 7f9dfad9d700 1 --2- 172.21.15.37:0/3330984333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc1596d0 0x7f9dfc0b3300 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0098e0 tx=0x7f9dec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d221025c21c32a9f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.500+0000 7f9df9d9b700 1 -- 172.21.15.37:0/3330984333 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec009e80 con 0x7f9dfc1596d0 2023-10-06T02:25:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.500+0000 7f9df9d9b700 1 -- 172.21.15.37:0/3330984333 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec00b820 con 0x7f9dfc1596d0 2023-10-06T02:25:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.500+0000 7f9df9d9b700 1 -- 172.21.15.37:0/3330984333 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec00bba0 con 0x7f9dfc1596d0 2023-10-06T02:25:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.501+0000 7f9e01185700 1 -- 172.21.15.37:0/3330984333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc1596d0 msgr2=0x7f9dfc0b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.501+0000 7f9e01185700 1 --2- 172.21.15.37:0/3330984333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc1596d0 0x7f9dfc0b3300 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0098e0 tx=0x7f9dec0091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.501+0000 7f9e01185700 1 -- 172.21.15.37:0/3330984333 shutdown_connections 2023-10-06T02:25:35.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.501+0000 7f9e01185700 1 --2- 172.21.15.37:0/3330984333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc1596d0 0x7f9dfc0b3300 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.501+0000 7f9e01185700 1 -- 172.21.15.37:0/3330984333 >> 172.21.15.37:0/3330984333 conn(0x7f9dfc06c890 msgr2=0x7f9dfc0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:35.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.501+0000 7f9e01185700 1 -- 172.21.15.37:0/3330984333 shutdown_connections 2023-10-06T02:25:35.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.501+0000 7f9e01185700 1 -- 172.21.15.37:0/3330984333 wait complete. 2023-10-06T02:25:35.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.502+0000 7f9e01185700 1 Processor -- start 2023-10-06T02:25:35.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.502+0000 7f9e01185700 1 -- start start 2023-10-06T02:25:35.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.503+0000 7f9e01185700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc0b3840 0x7f9dfc15a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.503+0000 7f9e01185700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dfc1596d0 0x7f9dfc09c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.503+0000 7f9e01185700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dfc159aa0 0x7f9dfc154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.503+0000 7f9e01185700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0b3c30 con 0x7f9dfc0b3840 2023-10-06T02:25:35.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.503+0000 7f9e01185700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc15a5c0 con 0x7f9dfc159aa0 2023-10-06T02:25:35.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.503+0000 7f9e01185700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc09cd90 con 0x7f9dfc1596d0 2023-10-06T02:25:35.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.503+0000 7f9dfad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc0b3840 0x7f9dfc15a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.503+0000 7f9dfad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc0b3840 0x7f9dfc15a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33810/0 (socket says 172.21.15.37:33810) 2023-10-06T02:25:35.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.503+0000 7f9dfad9d700 1 -- 172.21.15.37:0/1876547661 learned_addr learned my addr 172.21.15.37:0/1876547661 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:35.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.503+0000 7f9dfa59c700 1 --2- 172.21.15.37:0/1876547661 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dfc1596d0 0x7f9dfc09c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.503+0000 7f9dfb59e700 1 --2- 172.21.15.37:0/1876547661 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dfc159aa0 0x7f9dfc154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.503+0000 7f9dfad9d700 1 -- 172.21.15.37:0/1876547661 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dfc1596d0 msgr2=0x7f9dfc09c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.503+0000 7f9dfad9d700 1 --2- 172.21.15.37:0/1876547661 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dfc1596d0 0x7f9dfc09c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.503+0000 7f9dfad9d700 1 -- 172.21.15.37:0/1876547661 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dfc159aa0 msgr2=0x7f9dfc154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.503+0000 7f9dfad9d700 1 --2- 172.21.15.37:0/1876547661 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dfc159aa0 0x7f9dfc154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.503+0000 7f9dfad9d700 1 -- 172.21.15.37:0/1876547661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec009420 con 0x7f9dfc0b3840 2023-10-06T02:25:35.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.503+0000 7f9dfad9d700 1 --2- 172.21.15.37:0/1876547661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc0b3840 0x7f9dfc15a080 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc088950 tx=0x7f9dec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.504+0000 7f9df2ffd700 1 -- 172.21.15.37:0/1876547661 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec00ba10 con 0x7f9dfc0b3840 2023-10-06T02:25:35.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.504+0000 7f9df2ffd700 1 -- 172.21.15.37:0/1876547661 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec020070 con 0x7f9dfc0b3840 2023-10-06T02:25:35.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.504+0000 7f9e01185700 1 -- 172.21.15.37:0/1876547661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dfc0b3e80 con 0x7f9dfc0b3840 2023-10-06T02:25:35.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.504+0000 7f9df2ffd700 1 -- 172.21.15.37:0/1876547661 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec01b6a0 con 0x7f9dfc0b3840 2023-10-06T02:25:35.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.504+0000 7f9e01185700 1 -- 172.21.15.37:0/1876547661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc0b4440 con 0x7f9dfc0b3840 2023-10-06T02:25:35.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.505+0000 7f9e01185700 1 -- 172.21.15.37:0/1876547661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dfc0b4630 con 0x7f9dfc0b3840 2023-10-06T02:25:35.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.505+0000 7f9df2ffd700 1 -- 172.21.15.37:0/1876547661 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9dec022030 con 0x7f9dfc0b3840 2023-10-06T02:25:35.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.505+0000 7f9df2ffd700 1 --2- 172.21.15.37:0/1876547661 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ddc066f30 0x7f9ddc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.505+0000 7f9df2ffd700 1 -- 172.21.15.37:0/1876547661 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f9dec0866c0 con 0x7f9dfc0b3840 2023-10-06T02:25:35.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.506+0000 7f9dfa59c700 1 --2- 172.21.15.37:0/1876547661 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ddc066f30 0x7f9ddc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.506+0000 7f9dfa59c700 1 --2- 172.21.15.37:0/1876547661 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ddc066f30 0x7f9ddc0693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0cb9d0 tx=0x7f9de4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.510+0000 7f9df2ffd700 1 -- 172.21.15.37:0/1876547661 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9dec053790 con 0x7f9dfc0b3840 2023-10-06T02:25:35.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.749+0000 7f9e01185700 1 -- 172.21.15.37:0/1876547661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9dfc0b4630 con 0x7f9dfc0b3840 2023-10-06T02:25:35.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.750+0000 7f9df2ffd700 1 -- 172.21.15.37:0/1876547661 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f9dec056db0 con 0x7f9dfc0b3840 2023-10-06T02:25:35.751 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:35.751 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2341182274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2341182274},{"type":"v1","addr":"172.21.15.191:6837","nonce":2341182274}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5385,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/562500386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":562500386},{"type":"v1","addr":"172.21.15.37:6834","nonce":562500386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1403086996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1403086996},{"type":"v1","addr":"172.21.15.37:6835","nonce":1403086996}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:24:50.379875+0000","modified":"2023-10-06T02:24:54.014513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5400":{"gid":5400,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6836/2931117635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2931117635},{"type":"v1","addr":"172.21.15.191:6836","nonce":2931117635}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:25:35.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.752+0000 7f9e01185700 1 -- 172.21.15.37:0/1876547661 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ddc066f30 msgr2=0x7f9ddc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.752+0000 7f9e01185700 1 --2- 172.21.15.37:0/1876547661 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ddc066f30 0x7f9ddc0693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0cb9d0 tx=0x7f9de4009040 comp rx=0 tx=0).stop 2023-10-06T02:25:35.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.752+0000 7f9e01185700 1 -- 172.21.15.37:0/1876547661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc0b3840 msgr2=0x7f9dfc15a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.752+0000 7f9e01185700 1 --2- 172.21.15.37:0/1876547661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc0b3840 0x7f9dfc15a080 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc088950 tx=0x7f9dec016000 comp rx=0 tx=0).stop 2023-10-06T02:25:35.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.752+0000 7f9e01185700 1 -- 172.21.15.37:0/1876547661 shutdown_connections 2023-10-06T02:25:35.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.752+0000 7f9e01185700 1 --2- 172.21.15.37:0/1876547661 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ddc066f30 0x7f9ddc0693e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.752+0000 7f9e01185700 1 --2- 172.21.15.37:0/1876547661 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dfc159aa0 0x7f9dfc154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.752+0000 7f9e01185700 1 --2- 172.21.15.37:0/1876547661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc0b3840 0x7f9dfc15a080 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.752+0000 7f9e01185700 1 --2- 172.21.15.37:0/1876547661 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dfc1596d0 0x7f9dfc09c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.752+0000 7f9e01185700 1 -- 172.21.15.37:0/1876547661 >> 172.21.15.37:0/1876547661 conn(0x7f9dfc06c890 msgr2=0x7f9dfc0d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:35.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.752+0000 7f9e01185700 1 -- 172.21.15.37:0/1876547661 shutdown_connections 2023-10-06T02:25:35.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.752+0000 7f9e01185700 1 -- 172.21.15.37:0/1876547661 wait complete. 2023-10-06T02:25:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 23 2023-10-06T02:25:35.765 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:25:35.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.883+0000 7fcbb6421700 1 Processor -- start 2023-10-06T02:25:35.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.883+0000 7fcbb6421700 1 -- start start 2023-10-06T02:25:35.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.883+0000 7fcbb6421700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fcbb01596d0 0x7fcbb00b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.883+0000 7fcbb6421700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcbb00b3840 0x7fcbb00c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.883+0000 7fcbb6421700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb00c5300 con 0x7fcbb0159aa0 2023-10-06T02:25:35.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.884+0000 7fcbb6421700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb00c6160 con 0x7fcbb00b3840 2023-10-06T02:25:35.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.884+0000 7fcbb6421700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb00c5550 con 0x7fcbb01596d0 2023-10-06T02:25:35.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.884+0000 7fcbaf7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcbb00b3840 0x7fcbb00c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.884+0000 7fcbb49be700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcbb0159aa0 0x7fcbb00caba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41716/0 (socket says 172.21.15.37:41716) 2023-10-06T02:25:35.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.884+0000 7fcbb49be700 1 -- 172.21.15.37:0/1468522925 learned_addr learned my addr 172.21.15.37:0/1468522925 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:35.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.884+0000 7fcbaffff700 1 --2- 172.21.15.37:0/1468522925 >> v2:172.21.15.191:3300/0 conn(0x7fcbb01596d0 0x7fcbb00b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.884+0000 7fcbaf7fe700 1 -- 172.21.15.37:0/1468522925 >> v2:172.21.15.191:3300/0 conn(0x7fcbb01596d0 msgr2=0x7fcbb00b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.884+0000 7fcbaf7fe700 1 --2- 172.21.15.37:0/1468522925 >> v2:172.21.15.191:3300/0 conn(0x7fcbb01596d0 0x7fcbb00b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.884+0000 7fcbaf7fe700 1 -- 172.21.15.37:0/1468522925 >> v1:172.21.15.37:6789/0 conn(0x7fcbb0159aa0 legacy=0x7fcbb00caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.884+0000 7fcbaf7fe700 1 -- 172.21.15.37:0/1468522925 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb00c5830 con 0x7fcbb00b3840 2023-10-06T02:25:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.884+0000 7fcbaeffd700 1 -- 172.21.15.37:0/1468522925 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2180118890 0 0) 0x7fcbb00c5300 con 0x7fcbb0159aa0 2023-10-06T02:25:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.884+0000 7fcbaffff700 1 --2- 172.21.15.37:0/1468522925 >> v2:172.21.15.191:3300/0 conn(0x7fcbb01596d0 0x7fcbb00b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.884+0000 7fcbaf7fe700 1 --2- 172.21.15.37:0/1468522925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbb00b3840 0x7fcbb00c65f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00896e0 tx=0x7fcba40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30d72c843a2de60 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.884+0000 7fcbaeffd700 1 -- 172.21.15.37:0/1468522925 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba400b6b0 con 0x7fcbb00b3840 2023-10-06T02:25:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.884+0000 7fcbaeffd700 1 -- 172.21.15.37:0/1468522925 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba400b810 con 0x7fcbb00b3840 2023-10-06T02:25:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.884+0000 7fcbaeffd700 1 -- 172.21.15.37:0/1468522925 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba400bbb0 con 0x7fcbb00b3840 2023-10-06T02:25:35.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.885+0000 7fcbb6421700 1 -- 172.21.15.37:0/1468522925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbb00b3840 msgr2=0x7fcbb00c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.885+0000 7fcbb6421700 1 --2- 172.21.15.37:0/1468522925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbb00b3840 0x7fcbb00c65f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00896e0 tx=0x7fcba40091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.885+0000 7fcbb6421700 1 -- 172.21.15.37:0/1468522925 shutdown_connections 2023-10-06T02:25:35.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.885+0000 7fcbb6421700 1 --2- 172.21.15.37:0/1468522925 >> v2:172.21.15.191:3300/0 conn(0x7fcbb01596d0 0x7fcbb00b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.885+0000 7fcbb6421700 1 --2- 172.21.15.37:0/1468522925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbb00b3840 0x7fcbb00c65f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.885+0000 7fcbb6421700 1 -- 172.21.15.37:0/1468522925 >> 172.21.15.37:0/1468522925 conn(0x7fcbb006c890 msgr2=0x7fcbb00d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:35.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.885+0000 7fcbb6421700 1 -- 172.21.15.37:0/1468522925 shutdown_connections 2023-10-06T02:25:35.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.885+0000 7fcbb6421700 1 -- 172.21.15.37:0/1468522925 wait complete. 2023-10-06T02:25:35.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.886+0000 7fcbb6421700 1 Processor -- start 2023-10-06T02:25:35.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.886+0000 7fcbb6421700 1 -- start start 2023-10-06T02:25:35.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.887+0000 7fcbb6421700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbb00b3840 0x7fcbb0154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.887+0000 7fcbb6421700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcbb01596d0 0x7fcbb00b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.887+0000 7fcbb6421700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcbb0159aa0 0x7fcbb00b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.887+0000 7fcbb6421700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb009a360 con 0x7fcbb00b3840 2023-10-06T02:25:35.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.887+0000 7fcbb6421700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb009cf50 con 0x7fcbb01596d0 2023-10-06T02:25:35.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.887+0000 7fcbb6421700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb009d230 con 0x7fcbb0159aa0 2023-10-06T02:25:35.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.887+0000 7fcbaffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbb00b3840 0x7fcbb0154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.887+0000 7fcbaffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbb00b3840 0x7fcbb0154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33826/0 (socket says 172.21.15.37:33826) 2023-10-06T02:25:35.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.887+0000 7fcbaffff700 1 -- 172.21.15.37:0/4086047405 learned_addr learned my addr 172.21.15.37:0/4086047405 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:35.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.887+0000 7fcbaffff700 1 -- 172.21.15.37:0/4086047405 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcbb0159aa0 msgr2=0x7fcbb00b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.887+0000 7fcbaffff700 1 --2- 172.21.15.37:0/4086047405 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcbb0159aa0 0x7fcbb00b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.887+0000 7fcbaffff700 1 -- 172.21.15.37:0/4086047405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcbb01596d0 msgr2=0x7fcbb00b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:35.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.887+0000 7fcbaffff700 1 --2- 172.21.15.37:0/4086047405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcbb01596d0 0x7fcbb00b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:35.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.887+0000 7fcbaffff700 1 -- 172.21.15.37:0/4086047405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba4009420 con 0x7fcbb00b3840 2023-10-06T02:25:35.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.887+0000 7fcbaffff700 1 --2- 172.21.15.37:0/4086047405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbb00b3840 0x7fcbb0154250 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fcba000c830 tx=0x7fcba0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.888+0000 7fcb97fff700 1 -- 172.21.15.37:0/4086047405 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0011600 con 0x7fcbb00b3840 2023-10-06T02:25:35.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.888+0000 7fcb97fff700 1 -- 172.21.15.37:0/4086047405 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba0011760 con 0x7fcbb00b3840 2023-10-06T02:25:35.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.888+0000 7fcbb6421700 1 -- 172.21.15.37:0/4086047405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb009d510 con 0x7fcbb00b3840 2023-10-06T02:25:35.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.888+0000 7fcb97fff700 1 -- 172.21.15.37:0/4086047405 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0011b20 con 0x7fcbb00b3840 2023-10-06T02:25:35.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.888+0000 7fcbb6421700 1 -- 172.21.15.37:0/4086047405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb009dad0 con 0x7fcbb00b3840 2023-10-06T02:25:35.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.889+0000 7fcbb6421700 1 -- 172.21.15.37:0/4086047405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb009dcf0 con 0x7fcbb00b3840 2023-10-06T02:25:35.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.889+0000 7fcb97fff700 1 -- 172.21.15.37:0/4086047405 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcba000a3e0 con 0x7fcbb00b3840 2023-10-06T02:25:35.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.889+0000 7fcb97fff700 1 --2- 172.21.15.37:0/4086047405 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcb9c066f30 0x7fcb9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:35.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.889+0000 7fcb97fff700 1 -- 172.21.15.37:0/4086047405 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fcba0084be0 con 0x7fcbb00b3840 2023-10-06T02:25:35.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.890+0000 7fcbaf7fe700 1 --2- 172.21.15.37:0/4086047405 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcb9c066f30 0x7fcb9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:35.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.890+0000 7fcbaf7fe700 1 --2- 172.21.15.37:0/4086047405 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcb9c066f30 0x7fcb9c0693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcbb015d150 tx=0x7fcba4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:35.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:35.894+0000 7fcb97fff700 1 -- 172.21.15.37:0/4086047405 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcba0051cb0 con 0x7fcbb00b3840 2023-10-06T02:25:36.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.087+0000 7fcbb6421700 1 -- 172.21.15.37:0/4086047405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbb006fbf0 con 0x7fcbb00b3840 2023-10-06T02:25:36.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.088+0000 7fcb97fff700 1 -- 172.21.15.37:0/4086047405 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16962 (secure 0 0 0) 0x7fcba0015090 con 0x7fcbb00b3840 2023-10-06T02:25:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:36.089 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":45,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:25:03.636645+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:24:48.109383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T02:24:49.348527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.25","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:25:36.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.090+0000 7fcbb6421700 1 -- 172.21.15.37:0/4086047405 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcb9c066f30 msgr2=0x7fcb9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:36.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.090+0000 7fcbb6421700 1 --2- 172.21.15.37:0/4086047405 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcb9c066f30 0x7fcb9c0693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcbb015d150 tx=0x7fcba4017000 comp rx=0 tx=0).stop 2023-10-06T02:25:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.090+0000 7fcbb6421700 1 -- 172.21.15.37:0/4086047405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbb00b3840 msgr2=0x7fcbb0154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.090+0000 7fcbb6421700 1 --2- 172.21.15.37:0/4086047405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbb00b3840 0x7fcbb0154250 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fcba000c830 tx=0x7fcba0008040 comp rx=0 tx=0).stop 2023-10-06T02:25:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.090+0000 7fcbb6421700 1 -- 172.21.15.37:0/4086047405 shutdown_connections 2023-10-06T02:25:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.090+0000 7fcbb6421700 1 --2- 172.21.15.37:0/4086047405 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcbb0159aa0 0x7fcbb00b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.090+0000 7fcbb6421700 1 --2- 172.21.15.37:0/4086047405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbb00b3840 0x7fcbb0154250 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.090+0000 7fcbb6421700 1 --2- 172.21.15.37:0/4086047405 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcb9c066f30 0x7fcb9c0693e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.090+0000 7fcbb6421700 1 --2- 172.21.15.37:0/4086047405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcbb01596d0 0x7fcbb00b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.090+0000 7fcbb6421700 1 -- 172.21.15.37:0/4086047405 >> 172.21.15.37:0/4086047405 conn(0x7fcbb006c890 msgr2=0x7fcbb00cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.090+0000 7fcbb6421700 1 -- 172.21.15.37:0/4086047405 shutdown_connections 2023-10-06T02:25:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.090+0000 7fcbb6421700 1 -- 172.21.15.37:0/4086047405 wait complete. 2023-10-06T02:25:36.104 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:25:36.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.222+0000 7fe8dd950700 1 Processor -- start 2023-10-06T02:25:36.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.222+0000 7fe8dd950700 1 -- start start 2023-10-06T02:25:36.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.223+0000 7fe8dd950700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe8d806eeb0 0x7fe8d806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:36.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.223+0000 7fe8dd950700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe8d806ab50 0x7fe8d80ac450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:36.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.223+0000 7fe8dd950700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d8069570 con 0x7fe8d806eae0 2023-10-06T02:25:36.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.223+0000 7fe8dd950700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d8069850 con 0x7fe8d806eeb0 2023-10-06T02:25:36.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.223+0000 7fe8dd950700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d8069b30 con 0x7fe8d806ab50 2023-10-06T02:25:36.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.223+0000 7fe8d7fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe8d806eeb0 0x7fe8d806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:36.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.223+0000 7fe8d7fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe8d806eeb0 0x7fe8d806a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33836/0 (socket says 172.21.15.37:33836) 2023-10-06T02:25:36.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.223+0000 7fe8d7fff700 1 -- 172.21.15.37:0/2901190060 learned_addr learned my addr 172.21.15.37:0/2901190060 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:36.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.223+0000 7fe8dd14f700 1 --2- 172.21.15.37:0/2901190060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe8d806ab50 0x7fe8d80ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:36.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.223+0000 7fe8d7fff700 1 -- 172.21.15.37:0/2901190060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe8d806ab50 msgr2=0x7fe8d80ac450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:36.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.223+0000 7fe8d7fff700 1 --2- 172.21.15.37:0/2901190060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe8d806ab50 0x7fe8d80ac450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.223+0000 7fe8d7fff700 1 -- 172.21.15.37:0/2901190060 >> v1:172.21.15.191:6789/0 conn(0x7fe8d806eae0 legacy=0x7fe8d80c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:36.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.223+0000 7fe8d7fff700 1 -- 172.21.15.37:0/2901190060 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d8069e10 con 0x7fe8d806eeb0 2023-10-06T02:25:36.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.223+0000 7fe8d7fff700 1 --2- 172.21.15.37:0/2901190060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8d806eeb0 0x7fe8d806a610 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0099e0 tx=0x7fe8cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721e1c28e51edc27 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:36.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.224+0000 7fe8d77fe700 1 -- 172.21.15.37:0/2901190060 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc00b820 con 0x7fe8d806eeb0 2023-10-06T02:25:36.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.224+0000 7fe8d77fe700 1 -- 172.21.15.37:0/2901190060 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc00b980 con 0x7fe8d806eeb0 2023-10-06T02:25:36.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.224+0000 7fe8d77fe700 1 -- 172.21.15.37:0/2901190060 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc00bd20 con 0x7fe8d806eeb0 2023-10-06T02:25:36.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.224+0000 7fe8dd950700 1 -- 172.21.15.37:0/2901190060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8d806eeb0 msgr2=0x7fe8d806a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:36.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.224+0000 7fe8dd950700 1 --2- 172.21.15.37:0/2901190060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8d806eeb0 0x7fe8d806a610 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0099e0 tx=0x7fe8cc009250 comp rx=0 tx=0).stop 2023-10-06T02:25:36.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.224+0000 7fe8dd950700 1 -- 172.21.15.37:0/2901190060 shutdown_connections 2023-10-06T02:25:36.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.224+0000 7fe8dd950700 1 --2- 172.21.15.37:0/2901190060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe8d806ab50 0x7fe8d80ac450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.224+0000 7fe8dd950700 1 --2- 172.21.15.37:0/2901190060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8d806eeb0 0x7fe8d806a610 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.224+0000 7fe8dd950700 1 -- 172.21.15.37:0/2901190060 >> 172.21.15.37:0/2901190060 conn(0x7fe8d80cc9d0 msgr2=0x7fe8d80c8970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:36.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.224+0000 7fe8dd950700 1 -- 172.21.15.37:0/2901190060 shutdown_connections 2023-10-06T02:25:36.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.224+0000 7fe8dd950700 1 -- 172.21.15.37:0/2901190060 wait complete. 2023-10-06T02:25:36.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.225+0000 7fe8dd950700 1 Processor -- start 2023-10-06T02:25:36.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.225+0000 7fe8dd950700 1 -- start start 2023-10-06T02:25:36.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.226+0000 7fe8dd950700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe8d806ab50 0x7fe8d81514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:36.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.226+0000 7fe8dd950700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8d806eae0 0x7fe8d80aae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:36.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.226+0000 7fe8dd950700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8d806eeb0 0x7fe8d806d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:36.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.226+0000 7fe8dd950700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d816dec0 con 0x7fe8d806eae0 2023-10-06T02:25:36.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.226+0000 7fe8dd950700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d8151ce0 con 0x7fe8d806eeb0 2023-10-06T02:25:36.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.226+0000 7fe8dd950700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d816d240 con 0x7fe8d806ab50 2023-10-06T02:25:36.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.226+0000 7fe8d7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8d806eae0 0x7fe8d80aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:36.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.226+0000 7fe8d7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8d806eae0 0x7fe8d80aae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33848/0 (socket says 172.21.15.37:33848) 2023-10-06T02:25:36.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.226+0000 7fe8d7fff700 1 -- 172.21.15.37:0/1206080618 learned_addr learned my addr 172.21.15.37:0/1206080618 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:36.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.227+0000 7fe8dd14f700 1 --2- 172.21.15.37:0/1206080618 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8d806eeb0 0x7fe8d806d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:36.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.227+0000 7fe8dc94e700 1 --2- 172.21.15.37:0/1206080618 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe8d806ab50 0x7fe8d81514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:36.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.227+0000 7fe8d7fff700 1 -- 172.21.15.37:0/1206080618 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe8d806ab50 msgr2=0x7fe8d81514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:36.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.227+0000 7fe8d7fff700 1 --2- 172.21.15.37:0/1206080618 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe8d806ab50 0x7fe8d81514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.227+0000 7fe8d7fff700 1 -- 172.21.15.37:0/1206080618 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8d806eeb0 msgr2=0x7fe8d806d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:36.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.227+0000 7fe8d7fff700 1 --2- 172.21.15.37:0/1206080618 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8d806eeb0 0x7fe8d806d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.227+0000 7fe8d7fff700 1 -- 172.21.15.37:0/1206080618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8cc0094f0 con 0x7fe8d806eae0 2023-10-06T02:25:36.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.227+0000 7fe8d7fff700 1 --2- 172.21.15.37:0/1206080618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8d806eae0 0x7fe8d80aae40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009290 tx=0x7fe8cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:36.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.227+0000 7fe8d4ff9700 1 -- 172.21.15.37:0/1206080618 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc01a450 con 0x7fe8d806eae0 2023-10-06T02:25:36.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.227+0000 7fe8d4ff9700 1 -- 172.21.15.37:0/1206080618 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc01a5b0 con 0x7fe8d806eae0 2023-10-06T02:25:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.227+0000 7fe8dd950700 1 -- 172.21.15.37:0/1206080618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d816d520 con 0x7fe8d806eae0 2023-10-06T02:25:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.227+0000 7fe8d4ff9700 1 -- 172.21.15.37:0/1206080618 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc01a970 con 0x7fe8d806eae0 2023-10-06T02:25:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.227+0000 7fe8dd950700 1 -- 172.21.15.37:0/1206080618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d816dae0 con 0x7fe8d806eae0 2023-10-06T02:25:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.228+0000 7fe8dd950700 1 -- 172.21.15.37:0/1206080618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d816e000 con 0x7fe8d806eae0 2023-10-06T02:25:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.228+0000 7fe8d4ff9700 1 -- 172.21.15.37:0/1206080618 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe8cc025440 con 0x7fe8d806eae0 2023-10-06T02:25:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.229+0000 7fe8d4ff9700 1 --2- 172.21.15.37:0/1206080618 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe8c4066f30 0x7fe8c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.229+0000 7fe8d4ff9700 1 -- 172.21.15.37:0/1206080618 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fe8cc086220 con 0x7fe8d806eae0 2023-10-06T02:25:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.229+0000 7fe8dc94e700 1 --2- 172.21.15.37:0/1206080618 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe8c4066f30 0x7fe8c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.229+0000 7fe8dc94e700 1 --2- 172.21.15.37:0/1206080618 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe8c4066f30 0x7fe8c40693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8159a60 tx=0x7fe8c8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:36.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.234+0000 7fe8d4ff9700 1 -- 172.21.15.37:0/1206080618 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8d816e000 con 0x7fe8d806eae0 2023-10-06T02:25:36.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.472+0000 7fe8dd950700 1 -- 172.21.15.37:0/1206080618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe8d816e000 con 0x7fe8d806eae0 2023-10-06T02:25:36.473 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-10-06T02:25:36.472+0000 7f292cc58700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:25:36.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.476+0000 7fe8d4ff9700 1 -- 172.21.15.37:0/1206080618 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe8d816e000 con 0x7fe8d806eae0 2023-10-06T02:25:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.479+0000 7fe8dd950700 1 -- 172.21.15.37:0/1206080618 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe8c4066f30 msgr2=0x7fe8c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.479+0000 7fe8dd950700 1 --2- 172.21.15.37:0/1206080618 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe8c4066f30 0x7fe8c40693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8159a60 tx=0x7fe8c8009040 comp rx=0 tx=0).stop 2023-10-06T02:25:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.479+0000 7fe8dd950700 1 -- 172.21.15.37:0/1206080618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8d806eae0 msgr2=0x7fe8d80aae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.479+0000 7fe8dd950700 1 --2- 172.21.15.37:0/1206080618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8d806eae0 0x7fe8d80aae40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009290 tx=0x7fe8cc017000 comp rx=0 tx=0).stop 2023-10-06T02:25:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.479+0000 7fe8dd950700 1 -- 172.21.15.37:0/1206080618 shutdown_connections 2023-10-06T02:25:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.479+0000 7fe8dd950700 1 --2- 172.21.15.37:0/1206080618 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe8c4066f30 0x7fe8c40693e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.479+0000 7fe8dd950700 1 --2- 172.21.15.37:0/1206080618 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8d806eeb0 0x7fe8d806d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.479+0000 7fe8dd950700 1 --2- 172.21.15.37:0/1206080618 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe8d806ab50 0x7fe8d81514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.479+0000 7fe8dd950700 1 --2- 172.21.15.37:0/1206080618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8d806eae0 0x7fe8d80aae40 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.479+0000 7fe8dd950700 1 -- 172.21.15.37:0/1206080618 >> 172.21.15.37:0/1206080618 conn(0x7fe8d80cc9d0 msgr2=0x7fe8d81584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.479+0000 7fe8dd950700 1 -- 172.21.15.37:0/1206080618 shutdown_connections 2023-10-06T02:25:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.479+0000 7fe8dd950700 1 -- 172.21.15.37:0/1206080618 wait complete. 2023-10-06T02:25:36.481 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:25:36.481 INFO:tasks.ceph.mds.d.smithi191.stderr: -4416> 2023-10-06T02:24:55.288+0000 7fbf116d4700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:25:36.483 INFO:tasks.ceph.mds.d.smithi191.stderr: -2855> 2023-10-06T02:25:00.143+0000 7fbf0decd700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5574=0-4194304@1} caps={5574=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5574 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55f6f61f5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-06T02:25:36.491 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:25:36.508 INFO:tasks.ceph.mds.d.smithi191.stdout:starting mds.d at 2023-10-06T02:25:36.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.611+0000 7f0f15042700 1 Processor -- start 2023-10-06T02:25:36.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.611+0000 7f0f15042700 1 -- start start 2023-10-06T02:25:36.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.612+0000 7f0f15042700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f100b2a90 0x7f0f10159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.612+0000 7f0f15042700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f100b07a0 con 0x7f0f101593c0 2023-10-06T02:25:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.612+0000 7f0f15042700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f100cd8a0 con 0x7f0f100ccb30 2023-10-06T02:25:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.612+0000 7f0f15042700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f100cd6c0 con 0x7f0f100b2a90 2023-10-06T02:25:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.612+0000 7f0f0ed9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0f101593c0 0x7f0f100b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41722/0 (socket says 172.21.15.37:41722) 2023-10-06T02:25:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.612+0000 7f0f0ed9d700 1 -- 172.21.15.37:0/779124587 learned_addr learned my addr 172.21.15.37:0/779124587 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.612+0000 7f0f0e59c700 1 --2- 172.21.15.37:0/779124587 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f100b2a90 0x7f0f10159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.612+0000 7f0f0dd9b700 1 -- 172.21.15.37:0/779124587 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654849360 0 0) 0x7f0f100b07a0 con 0x7f0f101593c0 2023-10-06T02:25:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.612+0000 7f0f0dd9b700 1 -- 172.21.15.37:0/779124587 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ef8003570 con 0x7f0f101593c0 2023-10-06T02:25:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.612+0000 7f0f0dd9b700 1 -- 172.21.15.37:0/779124587 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342693492 0 0) 0x7f0f100cd8a0 con 0x7f0f100ccb30 2023-10-06T02:25:36.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.612+0000 7f0f0dd9b700 1 -- 172.21.15.37:0/779124587 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f100b07a0 con 0x7f0f100ccb30 2023-10-06T02:25:36.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.612+0000 7f0f0e59c700 1 -- 172.21.15.37:0/779124587 >> v1:172.21.15.191:6789/0 conn(0x7f0f100ccb30 legacy=0x7f0f100ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:36.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.612+0000 7f0f0dd9b700 1 -- 172.21.15.37:0/779124587 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 315572297 0 0) 0x7f0ef8003570 con 0x7f0f101593c0 2023-10-06T02:25:36.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.612+0000 7f0f0e59c700 1 -- 172.21.15.37:0/779124587 >> v1:172.21.15.37:6789/0 conn(0x7f0f101593c0 legacy=0x7f0f100b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:36.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.612+0000 7f0f0e59c700 1 -- 172.21.15.37:0/779124587 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f100afe70 con 0x7f0f100b2a90 2023-10-06T02:25:36.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.613+0000 7f0f0e59c700 1 --2- 172.21.15.37:0/779124587 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f100b2a90 0x7f0f10159790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009910 tx=0x7f0f040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1b3e5f52cb03f69 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:36.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.613+0000 7f0f0dd9b700 1 -- 172.21.15.37:0/779124587 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f00001470 con 0x7f0f100b2a90 2023-10-06T02:25:36.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.613+0000 7f0f0dd9b700 1 -- 172.21.15.37:0/779124587 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f04011420 con 0x7f0f100b2a90 2023-10-06T02:25:36.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.613+0000 7f0f0dd9b700 1 -- 172.21.15.37:0/779124587 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f040117c0 con 0x7f0f100b2a90 2023-10-06T02:25:36.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.613+0000 7f0f15042700 1 -- 172.21.15.37:0/779124587 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f100b2a90 msgr2=0x7f0f10159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:36.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.613+0000 7f0f15042700 1 --2- 172.21.15.37:0/779124587 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f100b2a90 0x7f0f10159790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009910 tx=0x7f0f040091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.613+0000 7f0f15042700 1 -- 172.21.15.37:0/779124587 shutdown_connections 2023-10-06T02:25:36.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.613+0000 7f0f15042700 1 --2- 172.21.15.37:0/779124587 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f100b2a90 0x7f0f10159790 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.613+0000 7f0f15042700 1 -- 172.21.15.37:0/779124587 >> 172.21.15.37:0/779124587 conn(0x7f0f1006c0b0 msgr2=0x7f0f1006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:36.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.613+0000 7f0f15042700 1 -- 172.21.15.37:0/779124587 shutdown_connections 2023-10-06T02:25:36.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.613+0000 7f0f15042700 1 -- 172.21.15.37:0/779124587 wait complete. 2023-10-06T02:25:36.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.615+0000 7f0f15042700 1 Processor -- start 2023-10-06T02:25:36.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.615+0000 7f0f15042700 1 -- start start 2023-10-06T02:25:36.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.615+0000 7f0f15042700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f100b2a90 0x7f0f1015d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.615+0000 7f0f15042700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f100ccb30 0x7f0f100c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.615+0000 7f0f15042700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f101593c0 0x7f0f1015d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.615+0000 7f0f15042700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1015d540 con 0x7f0f100b2a90 2023-10-06T02:25:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.615+0000 7f0f15042700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1015cb70 con 0x7f0f101593c0 2023-10-06T02:25:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.615+0000 7f0f15042700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1016ae30 con 0x7f0f100ccb30 2023-10-06T02:25:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.615+0000 7f0f0ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f100b2a90 0x7f0f1015d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.616+0000 7f0f0ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f100b2a90 0x7f0f1015d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33854/0 (socket says 172.21.15.37:33854) 2023-10-06T02:25:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.616+0000 7f0f0ed9d700 1 -- 172.21.15.37:0/646328033 learned_addr learned my addr 172.21.15.37:0/646328033 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.616+0000 7f0f0e59c700 1 --2- 172.21.15.37:0/646328033 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f100ccb30 0x7f0f100c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.616+0000 7f0f0f59e700 1 --2- 172.21.15.37:0/646328033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f101593c0 0x7f0f1015d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.616+0000 7f0f0ed9d700 1 -- 172.21.15.37:0/646328033 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f100ccb30 msgr2=0x7f0f100c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.616+0000 7f0f0ed9d700 1 --2- 172.21.15.37:0/646328033 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f100ccb30 0x7f0f100c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.616+0000 7f0f0ed9d700 1 -- 172.21.15.37:0/646328033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f101593c0 msgr2=0x7f0f1015d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.616+0000 7f0f0ed9d700 1 --2- 172.21.15.37:0/646328033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f101593c0 0x7f0f1015d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.616+0000 7f0f0ed9d700 1 -- 172.21.15.37:0/646328033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f04009420 con 0x7f0f100b2a90 2023-10-06T02:25:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.616+0000 7f0f0ed9d700 1 --2- 172.21.15.37:0/646328033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f100b2a90 0x7f0f1015d000 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000cb70 tx=0x7f0f00001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.616+0000 7f0ef6ffd700 1 -- 172.21.15.37:0/646328033 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f00007e90 con 0x7f0f100b2a90 2023-10-06T02:25:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.616+0000 7f0ef6ffd700 1 -- 172.21.15.37:0/646328033 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f00007360 con 0x7f0f100b2a90 2023-10-06T02:25:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.616+0000 7f0ef6ffd700 1 -- 172.21.15.37:0/646328033 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f00004830 con 0x7f0f100b2a90 2023-10-06T02:25:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.616+0000 7f0f15042700 1 -- 172.21.15.37:0/646328033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f1015c240 con 0x7f0f100b2a90 2023-10-06T02:25:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.616+0000 7f0f15042700 1 -- 172.21.15.37:0/646328033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1015c800 con 0x7f0f100b2a90 2023-10-06T02:25:36.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.617+0000 7f0f15042700 1 -- 172.21.15.37:0/646328033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f1015ce50 con 0x7f0f100b2a90 2023-10-06T02:25:36.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.617+0000 7f0ef6ffd700 1 -- 172.21.15.37:0/646328033 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f00004ba0 con 0x7f0f100b2a90 2023-10-06T02:25:36.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.618+0000 7f0ef6ffd700 1 --2- 172.21.15.37:0/646328033 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0efc066f60 0x7f0efc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:36.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.618+0000 7f0ef6ffd700 1 -- 172.21.15.37:0/646328033 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f0f00083bb0 con 0x7f0f100b2a90 2023-10-06T02:25:36.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.618+0000 7f0f0e59c700 1 --2- 172.21.15.37:0/646328033 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0efc066f60 0x7f0efc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:36.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.619+0000 7f0f0e59c700 1 --2- 172.21.15.37:0/646328033 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0efc066f60 0x7f0efc069410 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0f040030c0 tx=0x7f0f04016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.623+0000 7f0ef6ffd700 1 -- 172.21.15.37:0/646328033 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f00050cb0 con 0x7f0f100b2a90 2023-10-06T02:25:36.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:36.859+0000 7f0f15042700 1 -- 172.21.15.37:0/646328033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0f100b33f0 con 0x7f0f100b2a90 2023-10-06T02:25:37.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.479+0000 7f0ef6ffd700 1 -- 172.21.15.37:0/646328033 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0f000180a0 con 0x7f0f100b2a90 2023-10-06T02:25:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.483+0000 7f0f15042700 1 -- 172.21.15.37:0/646328033 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0efc066f60 msgr2=0x7f0efc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.483+0000 7f0f15042700 1 --2- 172.21.15.37:0/646328033 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0efc066f60 0x7f0efc069410 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0f040030c0 tx=0x7f0f04016000 comp rx=0 tx=0).stop 2023-10-06T02:25:37.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.483+0000 7f0f15042700 1 -- 172.21.15.37:0/646328033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f100b2a90 msgr2=0x7f0f1015d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.483+0000 7f0f15042700 1 --2- 172.21.15.37:0/646328033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f100b2a90 0x7f0f1015d000 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000cb70 tx=0x7f0f00001b50 comp rx=0 tx=0).stop 2023-10-06T02:25:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.483+0000 7f0f15042700 1 -- 172.21.15.37:0/646328033 shutdown_connections 2023-10-06T02:25:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.483+0000 7f0f15042700 1 --2- 172.21.15.37:0/646328033 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0efc066f60 0x7f0efc069410 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.483+0000 7f0f15042700 1 --2- 172.21.15.37:0/646328033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f101593c0 0x7f0f1015d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.483+0000 7f0f15042700 1 --2- 172.21.15.37:0/646328033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f100b2a90 0x7f0f1015d000 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.483+0000 7f0f15042700 1 --2- 172.21.15.37:0/646328033 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f100ccb30 0x7f0f100c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.483+0000 7f0f15042700 1 -- 172.21.15.37:0/646328033 >> 172.21.15.37:0/646328033 conn(0x7f0f1006c0b0 msgr2=0x7f0f1006c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.483+0000 7f0f15042700 1 -- 172.21.15.37:0/646328033 shutdown_connections 2023-10-06T02:25:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.483+0000 7f0f15042700 1 -- 172.21.15.37:0/646328033 wait complete. 2023-10-06T02:25:37.498 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:25:37.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.626+0000 7f57ee7a9700 1 Processor -- start 2023-10-06T02:25:37.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.626+0000 7f57ee7a9700 1 -- start start 2023-10-06T02:25:37.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.626+0000 7f57ee7a9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57e8159550 0x7f57e8159920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:37.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.626+0000 7f57ee7a9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f57e80b24d0 0x7f57e815ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:37.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.626+0000 7f57ee7a9700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e815e300 con 0x7f57e806c0b0 2023-10-06T02:25:37.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.627+0000 7f57ee7a9700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e80b29b0 con 0x7f57e80b24d0 2023-10-06T02:25:37.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.627+0000 7f57ee7a9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e80b2c90 con 0x7f57e8159550 2023-10-06T02:25:37.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.627+0000 7f57e77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f57e80b24d0 0x7f57e815ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:37.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.627+0000 7f57ecd46700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f57e806c0b0 0x7f57e806c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41726/0 (socket says 172.21.15.37:41726) 2023-10-06T02:25:37.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.627+0000 7f57ecd46700 1 -- 172.21.15.37:0/2722130915 learned_addr learned my addr 172.21.15.37:0/2722130915 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:37.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.627+0000 7f57e7fff700 1 --2- 172.21.15.37:0/2722130915 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57e8159550 0x7f57e8159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:37.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.627+0000 7f57e77fe700 1 -- 172.21.15.37:0/2722130915 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57e8159550 msgr2=0x7f57e8159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:37.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.627+0000 7f57e77fe700 1 --2- 172.21.15.37:0/2722130915 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57e8159550 0x7f57e8159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:37.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.627+0000 7f57e77fe700 1 -- 172.21.15.37:0/2722130915 >> v1:172.21.15.37:6789/0 conn(0x7f57e806c0b0 legacy=0x7f57e806c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.627+0000 7f57e77fe700 1 -- 172.21.15.37:0/2722130915 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e80cb620 con 0x7f57e80b24d0 2023-10-06T02:25:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.627+0000 7f57e6ffd700 1 -- 172.21.15.37:0/2722130915 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2824358151 0 0) 0x7f57e815e300 con 0x7f57e806c0b0 2023-10-06T02:25:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.627+0000 7f57e7fff700 1 --2- 172.21.15.37:0/2722130915 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57e8159550 0x7f57e8159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.627+0000 7f57e77fe700 1 --2- 172.21.15.37:0/2722130915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e80b24d0 0x7f57e815ddc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f57d00098e0 tx=0x7f57d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5f01b8c5593fd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.627+0000 7f57e6ffd700 1 -- 172.21.15.37:0/2722130915 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d0009e80 con 0x7f57e80b24d0 2023-10-06T02:25:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.627+0000 7f57e6ffd700 1 -- 172.21.15.37:0/2722130915 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d000b860 con 0x7f57e80b24d0 2023-10-06T02:25:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.627+0000 7f57e6ffd700 1 -- 172.21.15.37:0/2722130915 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d000bbe0 con 0x7f57e80b24d0 2023-10-06T02:25:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.628+0000 7f57ee7a9700 1 -- 172.21.15.37:0/2722130915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e80b24d0 msgr2=0x7f57e815ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.628+0000 7f57ee7a9700 1 --2- 172.21.15.37:0/2722130915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e80b24d0 0x7f57e815ddc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f57d00098e0 tx=0x7f57d00091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.628+0000 7f57ee7a9700 1 -- 172.21.15.37:0/2722130915 shutdown_connections 2023-10-06T02:25:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.628+0000 7f57ee7a9700 1 --2- 172.21.15.37:0/2722130915 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57e8159550 0x7f57e8159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:37.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.628+0000 7f57ee7a9700 1 --2- 172.21.15.37:0/2722130915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e80b24d0 0x7f57e815ddc0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:37.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.628+0000 7f57ee7a9700 1 -- 172.21.15.37:0/2722130915 >> 172.21.15.37:0/2722130915 conn(0x7f57e806d900 msgr2=0x7f57e806dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:37.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.628+0000 7f57ee7a9700 1 -- 172.21.15.37:0/2722130915 shutdown_connections 2023-10-06T02:25:37.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.628+0000 7f57ee7a9700 1 -- 172.21.15.37:0/2722130915 wait complete. 2023-10-06T02:25:37.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.629+0000 7f57ee7a9700 1 Processor -- start 2023-10-06T02:25:37.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.629+0000 7f57ee7a9700 1 -- start start 2023-10-06T02:25:37.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.630+0000 7f57ee7a9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57e806c0b0 0x7f57e8156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:37.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.630+0000 7f57ee7a9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e80b24d0 0x7f57e80a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:37.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.630+0000 7f57ee7a9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57e8159550 0x7f57e80a8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:37.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.630+0000 7f57ee7a9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e8157180 con 0x7f57e80b24d0 2023-10-06T02:25:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.630+0000 7f57ee7a9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e80c8580 con 0x7f57e806c0b0 2023-10-06T02:25:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.630+0000 7f57ee7a9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e80c8860 con 0x7f57e8159550 2023-10-06T02:25:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.630+0000 7f57e77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e80b24d0 0x7f57e80a85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.630+0000 7f57e77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e80b24d0 0x7f57e80a85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33870/0 (socket says 172.21.15.37:33870) 2023-10-06T02:25:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.630+0000 7f57e77fe700 1 -- 172.21.15.37:0/2235086021 learned_addr learned my addr 172.21.15.37:0/2235086021 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.630+0000 7f57e77fe700 1 -- 172.21.15.37:0/2235086021 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57e8159550 msgr2=0x7f57e80a8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.630+0000 7f57e77fe700 1 --2- 172.21.15.37:0/2235086021 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57e8159550 0x7f57e80a8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.630+0000 7f57e77fe700 1 -- 172.21.15.37:0/2235086021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57e806c0b0 msgr2=0x7f57e8156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.630+0000 7f57e77fe700 1 --2- 172.21.15.37:0/2235086021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57e806c0b0 0x7f57e8156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.630+0000 7f57e77fe700 1 -- 172.21.15.37:0/2235086021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d0009420 con 0x7f57e80b24d0 2023-10-06T02:25:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.630+0000 7f57e77fe700 1 --2- 172.21.15.37:0/2235086021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e80b24d0 0x7f57e80a85c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f57d0013000 tx=0x7f57d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:37.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.631+0000 7f57dffff700 1 -- 172.21.15.37:0/2235086021 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d000bbe0 con 0x7f57e80b24d0 2023-10-06T02:25:37.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.631+0000 7f57dffff700 1 -- 172.21.15.37:0/2235086021 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d0011420 con 0x7f57e80b24d0 2023-10-06T02:25:37.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.631+0000 7f57dffff700 1 -- 172.21.15.37:0/2235086021 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d00117c0 con 0x7f57e80b24d0 2023-10-06T02:25:37.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.631+0000 7f57ee7a9700 1 -- 172.21.15.37:0/2235086021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e80c8b40 con 0x7f57e80b24d0 2023-10-06T02:25:37.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.631+0000 7f57ee7a9700 1 -- 172.21.15.37:0/2235086021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e80c77e0 con 0x7f57e80b24d0 2023-10-06T02:25:37.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.632+0000 7f57ee7a9700 1 -- 172.21.15.37:0/2235086021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e8088b20 con 0x7f57e80b24d0 2023-10-06T02:25:37.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.632+0000 7f57dffff700 1 -- 172.21.15.37:0/2235086021 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57d0011bb0 con 0x7f57e80b24d0 2023-10-06T02:25:37.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.632+0000 7f57dffff700 1 --2- 172.21.15.37:0/2235086021 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f57c8066f30 0x7f57c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:37.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.633+0000 7f57dffff700 1 -- 172.21.15.37:0/2235086021 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f57d0085ef0 con 0x7f57e80b24d0 2023-10-06T02:25:37.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.633+0000 7f57e7fff700 1 --2- 172.21.15.37:0/2235086021 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f57c8066f30 0x7f57c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:37.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.633+0000 7f57e7fff700 1 --2- 172.21.15.37:0/2235086021 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f57c8066f30 0x7f57c80693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f57d8006fd0 tx=0x7f57d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:37.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.638+0000 7f57dffff700 1 -- 172.21.15.37:0/2235086021 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57d0052f70 con 0x7f57e80b24d0 2023-10-06T02:25:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:37.833+0000 7f57ee7a9700 1 -- 172.21.15.37:0/2235086021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f57e804bb80 con 0x7f57e80b24d0 2023-10-06T02:25:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.720+0000 7f57dffff700 1 -- 172.21.15.37:0/2235086021 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v47) v1 ==== 181+0+0 (secure 0 0 0) 0x7f57d0011e60 con 0x7f57e80b24d0 2023-10-06T02:25:38.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.724+0000 7f57ee7a9700 1 -- 172.21.15.37:0/2235086021 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f57c8066f30 msgr2=0x7f57c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.724+0000 7f57ee7a9700 1 --2- 172.21.15.37:0/2235086021 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f57c8066f30 0x7f57c80693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f57d8006fd0 tx=0x7f57d8008040 comp rx=0 tx=0).stop 2023-10-06T02:25:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.724+0000 7f57ee7a9700 1 -- 172.21.15.37:0/2235086021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e80b24d0 msgr2=0x7f57e80a85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.724+0000 7f57ee7a9700 1 --2- 172.21.15.37:0/2235086021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e80b24d0 0x7f57e80a85c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f57d0013000 tx=0x7f57d0017000 comp rx=0 tx=0).stop 2023-10-06T02:25:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.724+0000 7f57ee7a9700 1 -- 172.21.15.37:0/2235086021 shutdown_connections 2023-10-06T02:25:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.724+0000 7f57ee7a9700 1 --2- 172.21.15.37:0/2235086021 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57e8159550 0x7f57e80a8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.724+0000 7f57ee7a9700 1 --2- 172.21.15.37:0/2235086021 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f57c8066f30 0x7f57c80693e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.724+0000 7f57ee7a9700 1 --2- 172.21.15.37:0/2235086021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57e806c0b0 0x7f57e8156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.724+0000 7f57ee7a9700 1 --2- 172.21.15.37:0/2235086021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e80b24d0 0x7f57e80a85c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.724+0000 7f57ee7a9700 1 -- 172.21.15.37:0/2235086021 >> 172.21.15.37:0/2235086021 conn(0x7f57e806d900 msgr2=0x7f57e8157960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.724+0000 7f57ee7a9700 1 -- 172.21.15.37:0/2235086021 shutdown_connections 2023-10-06T02:25:38.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.724+0000 7f57ee7a9700 1 -- 172.21.15.37:0/2235086021 wait complete. 2023-10-06T02:25:38.726 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:25:38.740 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:25:38.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.869+0000 7fe575491700 1 Processor -- start 2023-10-06T02:25:38.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.869+0000 7fe575491700 1 -- start start 2023-10-06T02:25:38.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.870+0000 7fe575491700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe570153920 0x7fe5700ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.870+0000 7fe575491700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5700ce920 con 0x7fe5700cb960 2023-10-06T02:25:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.870+0000 7fe575491700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5700cdc50 con 0x7fe570153cf0 2023-10-06T02:25:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.870+0000 7fe575491700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5700cd690 con 0x7fe570153920 2023-10-06T02:25:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.870+0000 7fe56f7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe5700cb960 0x7fe5700cedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41734/0 (socket says 172.21.15.37:41734) 2023-10-06T02:25:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.870+0000 7fe56f7fe700 1 -- 172.21.15.37:0/2356984033 learned_addr learned my addr 172.21.15.37:0/2356984033 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.870+0000 7fe56effd700 1 --2- 172.21.15.37:0/2356984033 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe570153920 0x7fe5700ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.870+0000 7fe56dffb700 1 -- 172.21.15.37:0/2356984033 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460016577 0 0) 0x7fe5700ce920 con 0x7fe5700cb960 2023-10-06T02:25:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.870+0000 7fe56dffb700 1 -- 172.21.15.37:0/2356984033 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe55c003570 con 0x7fe5700cb960 2023-10-06T02:25:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56dffb700 1 -- 172.21.15.37:0/2356984033 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782459860 0 0) 0x7fe5700cdc50 con 0x7fe570153cf0 2023-10-06T02:25:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56dffb700 1 -- 172.21.15.37:0/2356984033 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5700ce920 con 0x7fe570153cf0 2023-10-06T02:25:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56dffb700 1 -- 172.21.15.37:0/2356984033 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2718441343 0 0) 0x7fe55c003570 con 0x7fe5700cb960 2023-10-06T02:25:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56dffb700 1 -- 172.21.15.37:0/2356984033 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe570153920 msgr2=0x7fe5700ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56dffb700 1 --2- 172.21.15.37:0/2356984033 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe570153920 0x7fe5700ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56dffb700 1 -- 172.21.15.37:0/2356984033 >> v1:172.21.15.191:6789/0 conn(0x7fe570153cf0 legacy=0x7fe5700cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56dffb700 1 -- 172.21.15.37:0/2356984033 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5700cd970 con 0x7fe5700cb960 2023-10-06T02:25:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56dffb700 1 -- 172.21.15.37:0/2356984033 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7fe568001470 con 0x7fe5700cb960 2023-10-06T02:25:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56dffb700 1 -- 172.21.15.37:0/2356984033 >> v1:172.21.15.37:6789/0 conn(0x7fe5700cb960 legacy=0x7fe5700cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56dffb700 1 --2- 172.21.15.37:0/2356984033 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe570153920 0x7fe55c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56dffb700 1 --2- 172.21.15.37:0/2356984033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe55c004180 0x7fe55c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56dffb700 1 --2- 172.21.15.37:0/2356984033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe55c004d50 0x7fe55c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56dffb700 1 -- 172.21.15.37:0/2356984033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5700cd690 con 0x7fe55c004d50 2023-10-06T02:25:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56dffb700 1 -- 172.21.15.37:0/2356984033 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c00bba0 con 0x7fe55c004180 2023-10-06T02:25:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56dffb700 1 -- 172.21.15.37:0/2356984033 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c00bd60 con 0x7fe570153920 2023-10-06T02:25:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56f7fe700 1 --2- 172.21.15.37:0/2356984033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe55c004d50 0x7fe55c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56effd700 1 --2- 172.21.15.37:0/2356984033 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe570153920 0x7fe55c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56e7fc700 1 --2- 172.21.15.37:0/2356984033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe55c004180 0x7fe55c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56f7fe700 1 -- 172.21.15.37:0/2356984033 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe570153920 msgr2=0x7fe55c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56f7fe700 1 --2- 172.21.15.37:0/2356984033 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe570153920 0x7fe55c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56f7fe700 1 -- 172.21.15.37:0/2356984033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe55c004180 msgr2=0x7fe55c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56f7fe700 1 --2- 172.21.15.37:0/2356984033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe55c004180 0x7fe55c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56f7fe700 1 -- 172.21.15.37:0/2356984033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c003570 con 0x7fe55c004d50 2023-10-06T02:25:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.871+0000 7fe56f7fe700 1 --2- 172.21.15.37:0/2356984033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe55c004d50 0x7fe55c0051c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe5700cbd60 tx=0x7fe568001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b53b9a8fe682a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.872+0000 7fe56dffb700 1 -- 172.21.15.37:0/2356984033 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56800cb60 con 0x7fe55c004d50 2023-10-06T02:25:38.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.872+0000 7fe56dffb700 1 -- 172.21.15.37:0/2356984033 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56800ccc0 con 0x7fe55c004d50 2023-10-06T02:25:38.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.872+0000 7fe56dffb700 1 -- 172.21.15.37:0/2356984033 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe568005b70 con 0x7fe55c004d50 2023-10-06T02:25:38.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.872+0000 7fe575491700 1 -- 172.21.15.37:0/2356984033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe55c004d50 msgr2=0x7fe55c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:38.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.872+0000 7fe575491700 1 --2- 172.21.15.37:0/2356984033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe55c004d50 0x7fe55c0051c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe5700cbd60 tx=0x7fe568001e10 comp rx=0 tx=0).stop 2023-10-06T02:25:38.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.872+0000 7fe56f7fe700 1 -- 172.21.15.37:0/2356984033 reap_dead start 2023-10-06T02:25:38.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.872+0000 7fe575491700 1 -- 172.21.15.37:0/2356984033 shutdown_connections 2023-10-06T02:25:38.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.872+0000 7fe575491700 1 -- 172.21.15.37:0/2356984033 >> 172.21.15.37:0/2356984033 conn(0x7fe57006c0b0 msgr2=0x7fe57006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:38.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.872+0000 7fe575491700 1 -- 172.21.15.37:0/2356984033 shutdown_connections 2023-10-06T02:25:38.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.872+0000 7fe575491700 1 -- 172.21.15.37:0/2356984033 wait complete. 2023-10-06T02:25:38.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.873+0000 7fe575491700 1 Processor -- start 2023-10-06T02:25:38.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.873+0000 7fe575491700 1 -- start start 2023-10-06T02:25:38.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.874+0000 7fe575491700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe570156840 0x7fe5700b3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:38.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.874+0000 7fe575491700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe570169c40 0x7fe57016acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:38.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.874+0000 7fe575491700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe57016b200 0x7fe5701589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:38.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.874+0000 7fe575491700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57016d220 con 0x7fe57016b200 2023-10-06T02:25:38.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.874+0000 7fe575491700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5700b33f0 con 0x7fe570156840 2023-10-06T02:25:38.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.874+0000 7fe575491700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57016a140 con 0x7fe570169c40 2023-10-06T02:25:38.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.874+0000 7fe56f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe57016b200 0x7fe5701589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:38.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.874+0000 7fe56f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe57016b200 0x7fe5701589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33886/0 (socket says 172.21.15.37:33886) 2023-10-06T02:25:38.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.874+0000 7fe56f7fe700 1 -- 172.21.15.37:0/182620554 learned_addr learned my addr 172.21.15.37:0/182620554 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:38.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.874+0000 7fe56e7fc700 1 --2- 172.21.15.37:0/182620554 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe570169c40 0x7fe57016acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:38.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.874+0000 7fe56effd700 1 --2- 172.21.15.37:0/182620554 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe570156840 0x7fe5700b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:38.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.875+0000 7fe56f7fe700 1 -- 172.21.15.37:0/182620554 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe570169c40 msgr2=0x7fe57016acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:38.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.875+0000 7fe56f7fe700 1 --2- 172.21.15.37:0/182620554 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe570169c40 0x7fe57016acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:38.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.875+0000 7fe56f7fe700 1 -- 172.21.15.37:0/182620554 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe570156840 msgr2=0x7fe5700b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:38.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.875+0000 7fe56f7fe700 1 --2- 172.21.15.37:0/182620554 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe570156840 0x7fe5700b3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:38.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.875+0000 7fe56f7fe700 1 -- 172.21.15.37:0/182620554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57016a420 con 0x7fe57016b200 2023-10-06T02:25:38.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.875+0000 7fe56f7fe700 1 --2- 172.21.15.37:0/182620554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe57016b200 0x7fe5701589c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe56800c860 tx=0x7fe568015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.875+0000 7fe566ffd700 1 -- 172.21.15.37:0/182620554 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe568001760 con 0x7fe57016b200 2023-10-06T02:25:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.875+0000 7fe566ffd700 1 -- 172.21.15.37:0/182620554 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe568004b00 con 0x7fe57016b200 2023-10-06T02:25:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.875+0000 7fe575491700 1 -- 172.21.15.37:0/182620554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57016a700 con 0x7fe57016b200 2023-10-06T02:25:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.875+0000 7fe566ffd700 1 -- 172.21.15.37:0/182620554 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5680070d0 con 0x7fe57016b200 2023-10-06T02:25:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.875+0000 7fe575491700 1 -- 172.21.15.37:0/182620554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5700b3cb0 con 0x7fe57016b200 2023-10-06T02:25:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.876+0000 7fe575491700 1 -- 172.21.15.37:0/182620554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe57016d3d0 con 0x7fe57016b200 2023-10-06T02:25:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.876+0000 7fe566ffd700 1 -- 172.21.15.37:0/182620554 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe568007500 con 0x7fe57016b200 2023-10-06T02:25:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.877+0000 7fe566ffd700 1 --2- 172.21.15.37:0/182620554 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe550066f30 0x7fe5500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.877+0000 7fe566ffd700 1 -- 172.21.15.37:0/182620554 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5764+0+0 (secure 0 0 0) 0x7fe568084fc0 con 0x7fe57016b200 2023-10-06T02:25:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.877+0000 7fe56effd700 1 --2- 172.21.15.37:0/182620554 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe550066f30 0x7fe5500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.877+0000 7fe56effd700 1 --2- 172.21.15.37:0/182620554 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe550066f30 0x7fe5500693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe5700ca450 tx=0x7fe56000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:38.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:38.881+0000 7fe566ffd700 1 -- 172.21.15.37:0/182620554 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe57016d3d0 con 0x7fe57016b200 2023-10-06T02:25:39.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.079+0000 7fe575491700 1 -- 172.21.15.37:0/182620554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe57016d3d0 con 0x7fe57016b200 2023-10-06T02:25:39.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.732+0000 7fe566ffd700 1 -- 172.21.15.37:0/182620554 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v48) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe57016d3d0 con 0x7fe57016b200 2023-10-06T02:25:39.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.735+0000 7fe575491700 1 -- 172.21.15.37:0/182620554 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe550066f30 msgr2=0x7fe5500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.735+0000 7fe575491700 1 --2- 172.21.15.37:0/182620554 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe550066f30 0x7fe5500693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe5700ca450 tx=0x7fe56000b040 comp rx=0 tx=0).stop 2023-10-06T02:25:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.735+0000 7fe575491700 1 -- 172.21.15.37:0/182620554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe57016b200 msgr2=0x7fe5701589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.735+0000 7fe575491700 1 --2- 172.21.15.37:0/182620554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe57016b200 0x7fe5701589c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe56800c860 tx=0x7fe568015000 comp rx=0 tx=0).stop 2023-10-06T02:25:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.735+0000 7fe575491700 1 -- 172.21.15.37:0/182620554 shutdown_connections 2023-10-06T02:25:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.735+0000 7fe575491700 1 --2- 172.21.15.37:0/182620554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe57016b200 0x7fe5701589c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.735+0000 7fe575491700 1 --2- 172.21.15.37:0/182620554 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe550066f30 0x7fe5500693e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.735+0000 7fe575491700 1 --2- 172.21.15.37:0/182620554 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe570156840 0x7fe5700b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.735+0000 7fe575491700 1 --2- 172.21.15.37:0/182620554 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe570169c40 0x7fe57016acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.735+0000 7fe575491700 1 -- 172.21.15.37:0/182620554 >> 172.21.15.37:0/182620554 conn(0x7fe57006c0b0 msgr2=0x7fe57015b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.735+0000 7fe575491700 1 -- 172.21.15.37:0/182620554 shutdown_connections 2023-10-06T02:25:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.735+0000 7fe575491700 1 -- 172.21.15.37:0/182620554 wait complete. 2023-10-06T02:25:39.737 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-10-06T02:25:39.752 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:25:39.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.885+0000 7f6c3b287700 1 Processor -- start 2023-10-06T02:25:39.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.885+0000 7f6c3b287700 1 -- start start 2023-10-06T02:25:39.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.886+0000 7f6c3b287700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6c34157260 0x7f6c340af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:39.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.886+0000 7f6c3b287700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c340af630 0x7f6c340b2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:39.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.886+0000 7f6c3b287700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c3415ba50 con 0x7f6c340b26b0 2023-10-06T02:25:39.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.886+0000 7f6c3b287700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c3415af10 con 0x7f6c34157260 2023-10-06T02:25:39.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.886+0000 7f6c3b287700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340b2af0 con 0x7f6c340af630 2023-10-06T02:25:39.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.886+0000 7f6c3a285700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6c34157260 0x7f6c340af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:39.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.886+0000 7f6c39a84700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c340af630 0x7f6c340b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:39.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.887+0000 7f6c3aa86700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f6c340b26b0 0x7f6c3406c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:43194/0 (socket says 172.21.15.37:43194) 2023-10-06T02:25:39.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.887+0000 7f6c3aa86700 1 -- 172.21.15.37:0/3581935019 learned_addr learned my addr 172.21.15.37:0/3581935019 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:39.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.887+0000 7f6c39a84700 1 -- 172.21.15.37:0/3581935019 >> v2:172.21.15.191:3300/0 conn(0x7f6c34157260 msgr2=0x7f6c340af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:39.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.887+0000 7f6c39a84700 1 --2- 172.21.15.37:0/3581935019 >> v2:172.21.15.191:3300/0 conn(0x7f6c34157260 0x7f6c340af0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:39.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.887+0000 7f6c39a84700 1 -- 172.21.15.37:0/3581935019 >> v1:172.21.15.191:6789/0 conn(0x7f6c340b26b0 legacy=0x7f6c3406c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:39.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.887+0000 7f6c39a84700 1 -- 172.21.15.37:0/3581935019 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c34158cf0 con 0x7f6c340af630 2023-10-06T02:25:39.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.887+0000 7f6c3a285700 1 --2- 172.21.15.37:0/3581935019 >> v2:172.21.15.191:3300/0 conn(0x7f6c34157260 0x7f6c340af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:25:39.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.887+0000 7f6c39a84700 1 --2- 172.21.15.37:0/3581935019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c340af630 0x7f6c340b2170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6c280098e0 tx=0x7f6c280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4f0a916141a7cdc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:39.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.887+0000 7f6c39283700 1 -- 172.21.15.37:0/3581935019 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2800b640 con 0x7f6c340af630 2023-10-06T02:25:39.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.887+0000 7f6c39283700 1 -- 172.21.15.37:0/3581935019 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2800b7a0 con 0x7f6c340af630 2023-10-06T02:25:39.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.887+0000 7f6c39283700 1 -- 172.21.15.37:0/3581935019 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2800bb40 con 0x7f6c340af630 2023-10-06T02:25:39.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.888+0000 7f6c3b287700 1 -- 172.21.15.37:0/3581935019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c340af630 msgr2=0x7f6c340b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:39.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.888+0000 7f6c3b287700 1 --2- 172.21.15.37:0/3581935019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c340af630 0x7f6c340b2170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6c280098e0 tx=0x7f6c280091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:39.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.888+0000 7f6c3b287700 1 -- 172.21.15.37:0/3581935019 shutdown_connections 2023-10-06T02:25:39.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.888+0000 7f6c3b287700 1 --2- 172.21.15.37:0/3581935019 >> v2:172.21.15.191:3300/0 conn(0x7f6c34157260 0x7f6c340af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:39.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.888+0000 7f6c3b287700 1 --2- 172.21.15.37:0/3581935019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c340af630 0x7f6c340b2170 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:39.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.888+0000 7f6c3b287700 1 -- 172.21.15.37:0/3581935019 >> 172.21.15.37:0/3581935019 conn(0x7f6c3406d1c0 msgr2=0x7f6c3406d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:39.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.888+0000 7f6c3b287700 1 -- 172.21.15.37:0/3581935019 shutdown_connections 2023-10-06T02:25:39.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.888+0000 7f6c3b287700 1 -- 172.21.15.37:0/3581935019 wait complete. 2023-10-06T02:25:39.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.889+0000 7f6c3b287700 1 Processor -- start 2023-10-06T02:25:39.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.889+0000 7f6c3b287700 1 -- start start 2023-10-06T02:25:39.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.890+0000 7f6c3b287700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c340af630 0x7f6c340abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:39.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.890+0000 7f6c3b287700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c340b26b0 0x7f6c340ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:39.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.890+0000 7f6c3b287700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c34157260 0x7f6c340cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:39.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.890+0000 7f6c3b287700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c341558c0 con 0x7f6c340af630 2023-10-06T02:25:39.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.890+0000 7f6c3b287700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34155ba0 con 0x7f6c340b26b0 2023-10-06T02:25:39.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.890+0000 7f6c3b287700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34155e80 con 0x7f6c34157260 2023-10-06T02:25:39.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.890+0000 7f6c3a285700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c340af630 0x7f6c340abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:39.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.890+0000 7f6c3a285700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c340af630 0x7f6c340abaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33896/0 (socket says 172.21.15.37:33896) 2023-10-06T02:25:39.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.890+0000 7f6c3a285700 1 -- 172.21.15.37:0/3820561597 learned_addr learned my addr 172.21.15.37:0/3820561597 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:39.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.890+0000 7f6c39a84700 1 --2- 172.21.15.37:0/3820561597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c340b26b0 0x7f6c340ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:39.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.890+0000 7f6c3aa86700 1 --2- 172.21.15.37:0/3820561597 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c34157260 0x7f6c340cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:39.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.890+0000 7f6c3a285700 1 -- 172.21.15.37:0/3820561597 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c34157260 msgr2=0x7f6c340cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:39.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.890+0000 7f6c3a285700 1 --2- 172.21.15.37:0/3820561597 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c34157260 0x7f6c340cd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:39.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.890+0000 7f6c3a285700 1 -- 172.21.15.37:0/3820561597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c340b26b0 msgr2=0x7f6c340ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:39.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.890+0000 7f6c3a285700 1 --2- 172.21.15.37:0/3820561597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c340b26b0 0x7f6c340ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:39.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.890+0000 7f6c3a285700 1 -- 172.21.15.37:0/3820561597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c009420 con 0x7f6c340af630 2023-10-06T02:25:39.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.890+0000 7f6c3a285700 1 --2- 172.21.15.37:0/3820561597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c340af630 0x7f6c340abaf0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00ec80 tx=0x7f6c2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:39.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.891+0000 7f6c327fc700 1 -- 172.21.15.37:0/3820561597 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c00c9d0 con 0x7f6c340af630 2023-10-06T02:25:39.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.891+0000 7f6c327fc700 1 -- 172.21.15.37:0/3820561597 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c00cb30 con 0x7f6c340af630 2023-10-06T02:25:39.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.891+0000 7f6c3b287700 1 -- 172.21.15.37:0/3820561597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c28009420 con 0x7f6c340af630 2023-10-06T02:25:39.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.891+0000 7f6c327fc700 1 -- 172.21.15.37:0/3820561597 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c00ceb0 con 0x7f6c340af630 2023-10-06T02:25:39.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.891+0000 7f6c3b287700 1 -- 172.21.15.37:0/3820561597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c34156440 con 0x7f6c340af630 2023-10-06T02:25:39.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.892+0000 7f6c3b287700 1 -- 172.21.15.37:0/3820561597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c340b21d0 con 0x7f6c340af630 2023-10-06T02:25:39.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.892+0000 7f6c327fc700 1 -- 172.21.15.37:0/3820561597 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c2c013680 con 0x7f6c340af630 2023-10-06T02:25:39.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.892+0000 7f6c327fc700 1 --2- 172.21.15.37:0/3820561597 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6c20066f30 0x7f6c200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:39.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.893+0000 7f6c327fc700 1 -- 172.21.15.37:0/3820561597 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f6c2c084730 con 0x7f6c340af630 2023-10-06T02:25:39.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.893+0000 7f6c39a84700 1 --2- 172.21.15.37:0/3820561597 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6c20066f30 0x7f6c200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:39.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.893+0000 7f6c39a84700 1 --2- 172.21.15.37:0/3820561597 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6c20066f30 0x7f6c200693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6c34150860 tx=0x7f6c28017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:39.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:39.897+0000 7f6c327fc700 1 -- 172.21.15.37:0/3820561597 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c2c051b40 con 0x7f6c340af630 2023-10-06T02:25:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.089+0000 7f6c3b287700 1 -- 172.21.15.37:0/3820561597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6c34064b00 con 0x7f6c340af630 2023-10-06T02:25:40.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.093+0000 7f6c327fc700 1 -- 172.21.15.37:0/3820561597 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6c2c055160 con 0x7f6c340af630 2023-10-06T02:25:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.095+0000 7f6c3b287700 1 -- 172.21.15.37:0/3820561597 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6c20066f30 msgr2=0x7f6c200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.095+0000 7f6c3b287700 1 --2- 172.21.15.37:0/3820561597 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6c20066f30 0x7f6c200693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6c34150860 tx=0x7f6c28017000 comp rx=0 tx=0).stop 2023-10-06T02:25:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.095+0000 7f6c3b287700 1 -- 172.21.15.37:0/3820561597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c340af630 msgr2=0x7f6c340abaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.095+0000 7f6c3b287700 1 --2- 172.21.15.37:0/3820561597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c340af630 0x7f6c340abaf0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00ec80 tx=0x7f6c2c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.095+0000 7f6c3b287700 1 -- 172.21.15.37:0/3820561597 shutdown_connections 2023-10-06T02:25:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.095+0000 7f6c3b287700 1 --2- 172.21.15.37:0/3820561597 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c34157260 0x7f6c340cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.095+0000 7f6c3b287700 1 --2- 172.21.15.37:0/3820561597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c340af630 0x7f6c340abaf0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.095+0000 7f6c3b287700 1 --2- 172.21.15.37:0/3820561597 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6c20066f30 0x7f6c200693e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.095+0000 7f6c3b287700 1 --2- 172.21.15.37:0/3820561597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c340b26b0 0x7f6c340ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.095+0000 7f6c3b287700 1 -- 172.21.15.37:0/3820561597 >> 172.21.15.37:0/3820561597 conn(0x7f6c3406d1c0 msgr2=0x7f6c3406ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.095+0000 7f6c3b287700 1 -- 172.21.15.37:0/3820561597 shutdown_connections 2023-10-06T02:25:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.095+0000 7f6c3b287700 1 -- 172.21.15.37:0/3820561597 wait complete. 2023-10-06T02:25:40.107 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2023-10-06T02:25:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.225+0000 7f3b9ff22700 1 Processor -- start 2023-10-06T02:25:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.226+0000 7f3b9ff22700 1 -- start start 2023-10-06T02:25:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.226+0000 7f3b9ff22700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f3b980c63a0 0x7f3b9815daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.226+0000 7f3b9ff22700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b9815dfe0 0x7f3b980cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.226+0000 7f3b9ff22700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b980cb650 con 0x7f3b98159760 2023-10-06T02:25:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.226+0000 7f3b9ff22700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b980cc2d0 con 0x7f3b9815dfe0 2023-10-06T02:25:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.226+0000 7f3b9ff22700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b980cb930 con 0x7f3b980c63a0 2023-10-06T02:25:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.227+0000 7f3b9dcbe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3b98159760 0x7f3b9815d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41750/0 (socket says 172.21.15.37:41750) 2023-10-06T02:25:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.227+0000 7f3b9dcbe700 1 -- 172.21.15.37:0/1550337429 learned_addr learned my addr 172.21.15.37:0/1550337429 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.227+0000 7f3b9e4bf700 1 --2- 172.21.15.37:0/1550337429 >> v2:172.21.15.37:3300/0 conn(0x7f3b9815dfe0 0x7f3b980cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.227+0000 7f3b9d4bd700 1 --2- 172.21.15.37:0/1550337429 >> v2:172.21.15.191:3300/0 conn(0x7f3b980c63a0 0x7f3b9815daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.227+0000 7f3b9ccbc700 1 -- 172.21.15.37:0/1550337429 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331053459 0 0) 0x7f3b980cb650 con 0x7f3b98159760 2023-10-06T02:25:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.227+0000 7f3b9ccbc700 1 -- 172.21.15.37:0/1550337429 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b80003570 con 0x7f3b98159760 2023-10-06T02:25:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.227+0000 7f3b9e4bf700 1 -- 172.21.15.37:0/1550337429 >> v2:172.21.15.191:3300/0 conn(0x7f3b980c63a0 msgr2=0x7f3b9815daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.227+0000 7f3b9e4bf700 1 --2- 172.21.15.37:0/1550337429 >> v2:172.21.15.191:3300/0 conn(0x7f3b980c63a0 0x7f3b9815daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.227+0000 7f3b9e4bf700 1 -- 172.21.15.37:0/1550337429 >> v1:172.21.15.37:6789/0 conn(0x7f3b98159760 legacy=0x7f3b9815d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.227+0000 7f3b9e4bf700 1 -- 172.21.15.37:0/1550337429 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b980cbc10 con 0x7f3b9815dfe0 2023-10-06T02:25:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.227+0000 7f3b9e4bf700 1 --2- 172.21.15.37:0/1550337429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9815dfe0 0x7f3b980cebf0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3b980887b0 tx=0x7f3b88009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d92eea7bc9b61bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.227+0000 7f3b9ccbc700 1 -- 172.21.15.37:0/1550337429 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8800e070 con 0x7f3b9815dfe0 2023-10-06T02:25:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.227+0000 7f3b9ccbc700 1 -- 172.21.15.37:0/1550337429 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8800bb40 con 0x7f3b9815dfe0 2023-10-06T02:25:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.227+0000 7f3b9ccbc700 1 -- 172.21.15.37:0/1550337429 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88012430 con 0x7f3b9815dfe0 2023-10-06T02:25:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.228+0000 7f3b9ff22700 1 -- 172.21.15.37:0/1550337429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9815dfe0 msgr2=0x7f3b980cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.228+0000 7f3b9ff22700 1 --2- 172.21.15.37:0/1550337429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9815dfe0 0x7f3b980cebf0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3b980887b0 tx=0x7f3b88009780 comp rx=0 tx=0).stop 2023-10-06T02:25:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.228+0000 7f3b9ff22700 1 -- 172.21.15.37:0/1550337429 shutdown_connections 2023-10-06T02:25:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.228+0000 7f3b9ff22700 1 --2- 172.21.15.37:0/1550337429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9815dfe0 0x7f3b980cebf0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.228+0000 7f3b9ff22700 1 --2- 172.21.15.37:0/1550337429 >> v2:172.21.15.191:3300/0 conn(0x7f3b980c63a0 0x7f3b9815daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.228+0000 7f3b9ff22700 1 -- 172.21.15.37:0/1550337429 >> 172.21.15.37:0/1550337429 conn(0x7f3b9806c890 msgr2=0x7f3b980d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.228+0000 7f3b9ff22700 1 -- 172.21.15.37:0/1550337429 shutdown_connections 2023-10-06T02:25:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.228+0000 7f3b9ff22700 1 -- 172.21.15.37:0/1550337429 wait complete. 2023-10-06T02:25:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.229+0000 7f3b9ff22700 1 Processor -- start 2023-10-06T02:25:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.229+0000 7f3b9ff22700 1 -- start start 2023-10-06T02:25:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.230+0000 7f3b9ff22700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b980c63a0 0x7f3b98146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.230+0000 7f3b9ff22700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b98159760 0x7f3b9809c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.230+0000 7f3b9ff22700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9815dfe0 0x7f3b980ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.230+0000 7f3b9ff22700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9809daf0 con 0x7f3b9815dfe0 2023-10-06T02:25:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.230+0000 7f3b9ff22700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9809cee0 con 0x7f3b98159760 2023-10-06T02:25:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.230+0000 7f3b9ff22700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9809d1c0 con 0x7f3b980c63a0 2023-10-06T02:25:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.230+0000 7f3b9e4bf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9815dfe0 0x7f3b980ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.230+0000 7f3b9e4bf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9815dfe0 0x7f3b980ca900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33922/0 (socket says 172.21.15.37:33922) 2023-10-06T02:25:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.230+0000 7f3b9e4bf700 1 -- 172.21.15.37:0/84511655 learned_addr learned my addr 172.21.15.37:0/84511655 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.230+0000 7f3b9d4bd700 1 --2- 172.21.15.37:0/84511655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b98159760 0x7f3b9809c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.230+0000 7f3b9dcbe700 1 --2- 172.21.15.37:0/84511655 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b980c63a0 0x7f3b98146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.230+0000 7f3b9e4bf700 1 -- 172.21.15.37:0/84511655 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b980c63a0 msgr2=0x7f3b98146fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.230+0000 7f3b9e4bf700 1 --2- 172.21.15.37:0/84511655 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b980c63a0 0x7f3b98146fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.230+0000 7f3b9e4bf700 1 -- 172.21.15.37:0/84511655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b98159760 msgr2=0x7f3b9809c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.230+0000 7f3b9e4bf700 1 --2- 172.21.15.37:0/84511655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b98159760 0x7f3b9809c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.230+0000 7f3b9e4bf700 1 -- 172.21.15.37:0/84511655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b88009a20 con 0x7f3b9815dfe0 2023-10-06T02:25:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.230+0000 7f3b9dcbe700 1 --2- 172.21.15.37:0/84511655 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b980c63a0 0x7f3b98146fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.230+0000 7f3b9e4bf700 1 --2- 172.21.15.37:0/84511655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9815dfe0 0x7f3b980ca900 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009fd0 tx=0x7f3b88019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.231+0000 7f3b95ffb700 1 -- 172.21.15.37:0/84511655 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88027470 con 0x7f3b9815dfe0 2023-10-06T02:25:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.231+0000 7f3b95ffb700 1 -- 172.21.15.37:0/84511655 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b880275f0 con 0x7f3b9815dfe0 2023-10-06T02:25:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.231+0000 7f3b95ffb700 1 -- 172.21.15.37:0/84511655 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b880279b0 con 0x7f3b9815dfe0 2023-10-06T02:25:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.231+0000 7f3b9ff22700 1 -- 172.21.15.37:0/84511655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b9809d4a0 con 0x7f3b9815dfe0 2023-10-06T02:25:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.231+0000 7f3b9ff22700 1 -- 172.21.15.37:0/84511655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b98147520 con 0x7f3b9815dfe0 2023-10-06T02:25:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.232+0000 7f3b9ff22700 1 -- 172.21.15.37:0/84511655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9809dca0 con 0x7f3b9815dfe0 2023-10-06T02:25:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.232+0000 7f3b95ffb700 1 -- 172.21.15.37:0/84511655 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3b88024070 con 0x7f3b9815dfe0 2023-10-06T02:25:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.232+0000 7f3b95ffb700 1 --2- 172.21.15.37:0/84511655 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3b84066f60 0x7f3b84069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.232+0000 7f3b95ffb700 1 -- 172.21.15.37:0/84511655 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f3b88086cf0 con 0x7f3b9815dfe0 2023-10-06T02:25:40.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.233+0000 7f3b9dcbe700 1 --2- 172.21.15.37:0/84511655 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3b84066f60 0x7f3b84069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:40.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.233+0000 7f3b9dcbe700 1 --2- 172.21.15.37:0/84511655 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3b84066f60 0x7f3b84069410 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3b900058d0 tx=0x7f3b90009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:40.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.237+0000 7f3b95ffb700 1 -- 172.21.15.37:0/84511655 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b9809dca0 con 0x7f3b9815dfe0 2023-10-06T02:25:40.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.510+0000 7f3b9ff22700 1 -- 172.21.15.37:0/84511655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7f3b9806fbf0 con 0x7f3b9815dfe0 2023-10-06T02:25:40.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.728+0000 7f3b95ffb700 1 -- 172.21.15.37:0/84511655 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v136) v1 ==== 149+0+0 (secure 0 0 0) 0x7f3b8802c0d0 con 0x7f3b9815dfe0 2023-10-06T02:25:40.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.730+0000 7f3b9ff22700 1 -- 172.21.15.37:0/84511655 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3b84066f60 msgr2=0x7f3b84069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:40.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.730+0000 7f3b9ff22700 1 --2- 172.21.15.37:0/84511655 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3b84066f60 0x7f3b84069410 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3b900058d0 tx=0x7f3b90009040 comp rx=0 tx=0).stop 2023-10-06T02:25:40.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.730+0000 7f3b9ff22700 1 -- 172.21.15.37:0/84511655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9815dfe0 msgr2=0x7f3b980ca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:40.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.730+0000 7f3b9ff22700 1 --2- 172.21.15.37:0/84511655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9815dfe0 0x7f3b980ca900 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009fd0 tx=0x7f3b88019000 comp rx=0 tx=0).stop 2023-10-06T02:25:40.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.730+0000 7f3b9ff22700 1 -- 172.21.15.37:0/84511655 shutdown_connections 2023-10-06T02:25:40.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.730+0000 7f3b9ff22700 1 --2- 172.21.15.37:0/84511655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9815dfe0 0x7f3b980ca900 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:40.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.730+0000 7f3b9ff22700 1 --2- 172.21.15.37:0/84511655 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b980c63a0 0x7f3b98146fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:40.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.730+0000 7f3b9ff22700 1 --2- 172.21.15.37:0/84511655 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3b84066f60 0x7f3b84069410 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:40.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.730+0000 7f3b9ff22700 1 --2- 172.21.15.37:0/84511655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b98159760 0x7f3b9809c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:40.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.730+0000 7f3b9ff22700 1 -- 172.21.15.37:0/84511655 >> 172.21.15.37:0/84511655 conn(0x7f3b9806c890 msgr2=0x7f3b980cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:40.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.730+0000 7f3b9ff22700 1 -- 172.21.15.37:0/84511655 shutdown_connections 2023-10-06T02:25:40.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.730+0000 7f3b9ff22700 1 -- 172.21.15.37:0/84511655 wait complete. 2023-10-06T02:25:40.743 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2023-10-06T02:25:40.743 INFO:tasks.cephfs_test_runner:Starting test: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-10-06T02:25:40.743 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2023-10-06T02:25:40.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.862+0000 7f256655f700 1 Processor -- start 2023-10-06T02:25:40.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.862+0000 7f256655f700 1 -- start start 2023-10-06T02:25:40.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.863+0000 7f256655f700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f25600c63a0 0x7f256015daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:40.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.863+0000 7f256655f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f256015dfe0 0x7f25600cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:40.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.863+0000 7f256655f700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25600cb650 con 0x7f2560159760 2023-10-06T02:25:40.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.863+0000 7f256655f700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25600cc2d0 con 0x7f256015dfe0 2023-10-06T02:25:40.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.863+0000 7f256655f700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25600cb930 con 0x7f25600c63a0 2023-10-06T02:25:40.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.863+0000 7f2564afc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f256015dfe0 0x7f25600cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:40.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.863+0000 7f2564afc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f256015dfe0 0x7f25600cebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33930/0 (socket says 172.21.15.37:33930) 2023-10-06T02:25:40.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.863+0000 7f2564afc700 1 -- 172.21.15.37:0/2518493419 learned_addr learned my addr 172.21.15.37:0/2518493419 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:40.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.863+0000 7f255f7fe700 1 --2- 172.21.15.37:0/2518493419 >> v2:172.21.15.191:3300/0 conn(0x7f25600c63a0 0x7f256015daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:40.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.863+0000 7f2564afc700 1 -- 172.21.15.37:0/2518493419 >> v2:172.21.15.191:3300/0 conn(0x7f25600c63a0 msgr2=0x7f256015daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:40.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.863+0000 7f2564afc700 1 --2- 172.21.15.37:0/2518493419 >> v2:172.21.15.191:3300/0 conn(0x7f25600c63a0 0x7f256015daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:40.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.863+0000 7f2564afc700 1 -- 172.21.15.37:0/2518493419 >> v1:172.21.15.191:6789/0 conn(0x7f2560159760 legacy=0x7f256015d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:40.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.863+0000 7f2564afc700 1 -- 172.21.15.37:0/2518493419 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25600cbc10 con 0x7f256015dfe0 2023-10-06T02:25:40.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.864+0000 7f2564afc700 1 --2- 172.21.15.37:0/2518493419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f256015dfe0 0x7f25600cebf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f25600887b0 tx=0x7f2558009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1eacf1676106a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:40.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.864+0000 7f255effd700 1 -- 172.21.15.37:0/2518493419 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255800e070 con 0x7f256015dfe0 2023-10-06T02:25:40.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.864+0000 7f255effd700 1 -- 172.21.15.37:0/2518493419 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255800bab0 con 0x7f256015dfe0 2023-10-06T02:25:40.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.864+0000 7f255effd700 1 -- 172.21.15.37:0/2518493419 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25580092e0 con 0x7f256015dfe0 2023-10-06T02:25:40.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.864+0000 7f256655f700 1 -- 172.21.15.37:0/2518493419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f256015dfe0 msgr2=0x7f25600cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:40.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.864+0000 7f256655f700 1 --2- 172.21.15.37:0/2518493419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f256015dfe0 0x7f25600cebf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f25600887b0 tx=0x7f2558009840 comp rx=0 tx=0).stop 2023-10-06T02:25:40.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.864+0000 7f256655f700 1 -- 172.21.15.37:0/2518493419 shutdown_connections 2023-10-06T02:25:40.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.864+0000 7f256655f700 1 --2- 172.21.15.37:0/2518493419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f256015dfe0 0x7f25600cebf0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:40.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.864+0000 7f256655f700 1 --2- 172.21.15.37:0/2518493419 >> v2:172.21.15.191:3300/0 conn(0x7f25600c63a0 0x7f256015daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:40.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.864+0000 7f256655f700 1 -- 172.21.15.37:0/2518493419 >> 172.21.15.37:0/2518493419 conn(0x7f256006c890 msgr2=0x7f25600d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:40.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.864+0000 7f256655f700 1 -- 172.21.15.37:0/2518493419 shutdown_connections 2023-10-06T02:25:40.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.864+0000 7f256655f700 1 -- 172.21.15.37:0/2518493419 wait complete. 2023-10-06T02:25:40.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.865+0000 7f256655f700 1 Processor -- start 2023-10-06T02:25:40.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.866+0000 7f256655f700 1 -- start start 2023-10-06T02:25:40.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.866+0000 7f256655f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600c63a0 0x7f256014b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:40.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.866+0000 7f256655f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2560159760 0x7f25600c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:40.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.866+0000 7f256655f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f256015dfe0 0x7f25600c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:40.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.866+0000 7f256655f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256016de40 con 0x7f25600c63a0 2023-10-06T02:25:40.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.866+0000 7f256655f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2560149d70 con 0x7f2560159760 2023-10-06T02:25:40.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.866+0000 7f256655f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256016d230 con 0x7f256015dfe0 2023-10-06T02:25:40.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.866+0000 7f255ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600c63a0 0x7f256014b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:40.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.867+0000 7f255ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600c63a0 0x7f256014b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33934/0 (socket says 172.21.15.37:33934) 2023-10-06T02:25:40.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.867+0000 7f255ffff700 1 -- 172.21.15.37:0/1714454693 learned_addr learned my addr 172.21.15.37:0/1714454693 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:40.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.867+0000 7f255f7fe700 1 --2- 172.21.15.37:0/1714454693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2560159760 0x7f25600c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:40.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.867+0000 7f2564afc700 1 --2- 172.21.15.37:0/1714454693 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f256015dfe0 0x7f25600c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:40.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.867+0000 7f255ffff700 1 -- 172.21.15.37:0/1714454693 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f256015dfe0 msgr2=0x7f25600c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:40.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.867+0000 7f255ffff700 1 --2- 172.21.15.37:0/1714454693 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f256015dfe0 0x7f25600c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:40.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.867+0000 7f255ffff700 1 -- 172.21.15.37:0/1714454693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2560159760 msgr2=0x7f25600c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:40.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.867+0000 7f255ffff700 1 --2- 172.21.15.37:0/1714454693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2560159760 0x7f25600c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:40.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.867+0000 7f255ffff700 1 -- 172.21.15.37:0/1714454693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2558009ae0 con 0x7f25600c63a0 2023-10-06T02:25:40.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.867+0000 7f255f7fe700 1 --2- 172.21.15.37:0/1714454693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2560159760 0x7f25600c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:40.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.867+0000 7f2564afc700 1 --2- 172.21.15.37:0/1714454693 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f256015dfe0 0x7f25600c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:40.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.867+0000 7f255ffff700 1 --2- 172.21.15.37:0/1714454693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600c63a0 0x7f256014b280 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f255000c590 tx=0x7f255000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:40.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.867+0000 7f2547fff700 1 -- 172.21.15.37:0/1714454693 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2550011590 con 0x7f25600c63a0 2023-10-06T02:25:40.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.867+0000 7f2547fff700 1 -- 172.21.15.37:0/1714454693 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25500116f0 con 0x7f25600c63a0 2023-10-06T02:25:40.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.867+0000 7f256655f700 1 -- 172.21.15.37:0/1714454693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f256016d510 con 0x7f25600c63a0 2023-10-06T02:25:40.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.867+0000 7f2547fff700 1 -- 172.21.15.37:0/1714454693 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2550011ab0 con 0x7f25600c63a0 2023-10-06T02:25:40.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.867+0000 7f256655f700 1 -- 172.21.15.37:0/1714454693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256016dad0 con 0x7f25600c63a0 2023-10-06T02:25:40.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.868+0000 7f256655f700 1 -- 172.21.15.37:0/1714454693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256006fbf0 con 0x7f25600c63a0 2023-10-06T02:25:40.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.869+0000 7f2547fff700 1 -- 172.21.15.37:0/1714454693 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f255001b3b0 con 0x7f25600c63a0 2023-10-06T02:25:40.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.869+0000 7f2547fff700 1 --2- 172.21.15.37:0/1714454693 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f254c066f30 0x7f254c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:40.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.869+0000 7f2547fff700 1 -- 172.21.15.37:0/1714454693 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f2550083940 con 0x7f25600c63a0 2023-10-06T02:25:40.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.869+0000 7f255f7fe700 1 --2- 172.21.15.37:0/1714454693 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f254c066f30 0x7f254c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:40.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.870+0000 7f255f7fe700 1 --2- 172.21.15.37:0/1714454693 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f254c066f30 0x7f254c0693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f256006e3b0 tx=0x7f2554008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:40.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:40.873+0000 7f2547fff700 1 -- 172.21.15.37:0/1714454693 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2550050d50 con 0x7f25600c63a0 2023-10-06T02:25:41.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.147+0000 7f256655f700 1 -- 172.21.15.37:0/1714454693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) v1 -- 0x7f2560151150 con 0x7f25600c63a0 2023-10-06T02:25:41.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.729+0000 7f2547fff700 1 -- 172.21.15.37:0/1714454693 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v137) v1 ==== 149+0+0 (secure 0 0 0) 0x7f2550017070 con 0x7f25600c63a0 2023-10-06T02:25:41.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.731+0000 7f256655f700 1 -- 172.21.15.37:0/1714454693 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f254c066f30 msgr2=0x7f254c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:41.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.731+0000 7f256655f700 1 --2- 172.21.15.37:0/1714454693 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f254c066f30 0x7f254c0693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f256006e3b0 tx=0x7f2554008040 comp rx=0 tx=0).stop 2023-10-06T02:25:41.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.731+0000 7f256655f700 1 -- 172.21.15.37:0/1714454693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600c63a0 msgr2=0x7f256014b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:41.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.731+0000 7f256655f700 1 --2- 172.21.15.37:0/1714454693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600c63a0 0x7f256014b280 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f255000c590 tx=0x7f255000c950 comp rx=0 tx=0).stop 2023-10-06T02:25:41.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.731+0000 7f256655f700 1 -- 172.21.15.37:0/1714454693 shutdown_connections 2023-10-06T02:25:41.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.731+0000 7f256655f700 1 --2- 172.21.15.37:0/1714454693 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f256015dfe0 0x7f25600c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:41.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.731+0000 7f256655f700 1 --2- 172.21.15.37:0/1714454693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600c63a0 0x7f256014b280 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:41.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.731+0000 7f256655f700 1 --2- 172.21.15.37:0/1714454693 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f254c066f30 0x7f254c0693e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:41.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.731+0000 7f256655f700 1 --2- 172.21.15.37:0/1714454693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2560159760 0x7f25600c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:41.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.731+0000 7f256655f700 1 -- 172.21.15.37:0/1714454693 >> 172.21.15.37:0/1714454693 conn(0x7f256006c890 msgr2=0x7f256015d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:41.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.731+0000 7f256655f700 1 -- 172.21.15.37:0/1714454693 shutdown_connections 2023-10-06T02:25:41.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.732+0000 7f256655f700 1 -- 172.21.15.37:0/1714454693 wait complete. 2023-10-06T02:25:41.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:25:41.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.874+0000 7f439177a700 1 Processor -- start 2023-10-06T02:25:41.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.874+0000 7f439177a700 1 -- start start 2023-10-06T02:25:41.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.875+0000 7f439177a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f438c159670 0x7f438c0b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:41.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.875+0000 7f439177a700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438c0cef20 con 0x7f438c0ce700 2023-10-06T02:25:41.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.875+0000 7f439177a700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438c0cf200 con 0x7f438c0b3d80 2023-10-06T02:25:41.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.875+0000 7f439177a700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438c0b4b30 con 0x7f438c159670 2023-10-06T02:25:41.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.875+0000 7f438bfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f438c159670 0x7f438c0b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:41.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.875+0000 7f438b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f438c0ce700 0x7f438c0b3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41756/0 (socket says 172.21.15.37:41756) 2023-10-06T02:25:41.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.875+0000 7f438b7fe700 1 -- 172.21.15.37:0/1590868534 learned_addr learned my addr 172.21.15.37:0/1590868534 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:41.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.876+0000 7f438bfff700 1 -- 172.21.15.37:0/1590868534 >> v1:172.21.15.191:6789/0 conn(0x7f438c0b3d80 legacy=0x7f438c0aa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:41.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.876+0000 7f438bfff700 1 -- 172.21.15.37:0/1590868534 >> v1:172.21.15.37:6789/0 conn(0x7f438c0ce700 legacy=0x7f438c0b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:41.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.876+0000 7f438bfff700 1 -- 172.21.15.37:0/1590868534 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c0cf4e0 con 0x7f438c159670 2023-10-06T02:25:41.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.876+0000 7f438bfff700 1 --2- 172.21.15.37:0/1590868534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f438c159670 0x7f438c0b45f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f43740098e0 tx=0x7f43740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d3043ce02b7c2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:41.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.876+0000 7f438affd700 1 -- 172.21.15.37:0/1590868534 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374009e80 con 0x7f438c159670 2023-10-06T02:25:41.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.876+0000 7f438affd700 1 -- 172.21.15.37:0/1590868534 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437400b860 con 0x7f438c159670 2023-10-06T02:25:41.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.876+0000 7f438affd700 1 -- 172.21.15.37:0/1590868534 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437400bbe0 con 0x7f438c159670 2023-10-06T02:25:41.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.876+0000 7f439177a700 1 -- 172.21.15.37:0/1590868534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f438c159670 msgr2=0x7f438c0b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:41.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.876+0000 7f439177a700 1 --2- 172.21.15.37:0/1590868534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f438c159670 0x7f438c0b45f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f43740098e0 tx=0x7f43740091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:41.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.876+0000 7f439177a700 1 -- 172.21.15.37:0/1590868534 shutdown_connections 2023-10-06T02:25:41.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.876+0000 7f439177a700 1 --2- 172.21.15.37:0/1590868534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f438c159670 0x7f438c0b45f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:41.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.876+0000 7f439177a700 1 -- 172.21.15.37:0/1590868534 >> 172.21.15.37:0/1590868534 conn(0x7f438c099610 msgr2=0x7f438c06c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:41.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.876+0000 7f439177a700 1 -- 172.21.15.37:0/1590868534 shutdown_connections 2023-10-06T02:25:41.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.876+0000 7f439177a700 1 -- 172.21.15.37:0/1590868534 wait complete. 2023-10-06T02:25:41.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.878+0000 7f439177a700 1 Processor -- start 2023-10-06T02:25:41.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.878+0000 7f439177a700 1 -- start start 2023-10-06T02:25:41.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.878+0000 7f439177a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f438c0b3d80 0x7f438c09ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:41.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.878+0000 7f439177a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f438c0ce700 0x7f438c09b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:41.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.878+0000 7f439177a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f438c159670 0x7f438c169fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:41.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.878+0000 7f439177a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c09bf80 con 0x7f438c0b3d80 2023-10-06T02:25:41.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.878+0000 7f439177a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c09c220 con 0x7f438c0ce700 2023-10-06T02:25:41.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.878+0000 7f439177a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c09c500 con 0x7f438c159670 2023-10-06T02:25:41.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.879+0000 7f438bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f438c0b3d80 0x7f438c09ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:41.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.879+0000 7f438bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f438c0b3d80 0x7f438c09ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33946/0 (socket says 172.21.15.37:33946) 2023-10-06T02:25:41.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.879+0000 7f438bfff700 1 -- 172.21.15.37:0/1866013701 learned_addr learned my addr 172.21.15.37:0/1866013701 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:41.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.879+0000 7f438b7fe700 1 --2- 172.21.15.37:0/1866013701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f438c0ce700 0x7f438c09b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:41.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.879+0000 7f4390f79700 1 --2- 172.21.15.37:0/1866013701 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f438c159670 0x7f438c169fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:41.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.879+0000 7f438bfff700 1 -- 172.21.15.37:0/1866013701 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f438c159670 msgr2=0x7f438c169fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:41.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.879+0000 7f438bfff700 1 --2- 172.21.15.37:0/1866013701 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f438c159670 0x7f438c169fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:41.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.879+0000 7f438bfff700 1 -- 172.21.15.37:0/1866013701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f438c0ce700 msgr2=0x7f438c09b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:41.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.879+0000 7f438bfff700 1 --2- 172.21.15.37:0/1866013701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f438c0ce700 0x7f438c09b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:41.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.879+0000 7f438bfff700 1 -- 172.21.15.37:0/1866013701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4374009420 con 0x7f438c0b3d80 2023-10-06T02:25:41.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.879+0000 7f438b7fe700 1 --2- 172.21.15.37:0/1866013701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f438c0ce700 0x7f438c09b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:41.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.879+0000 7f438bfff700 1 --2- 172.21.15.37:0/1866013701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f438c0b3d80 0x7f438c09ac60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f438c06cff0 tx=0x7f4374017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:41.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.879+0000 7f4383fff700 1 -- 172.21.15.37:0/1866013701 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374011420 con 0x7f438c0b3d80 2023-10-06T02:25:41.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.879+0000 7f4383fff700 1 -- 172.21.15.37:0/1866013701 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43740115a0 con 0x7f438c0b3d80 2023-10-06T02:25:41.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.879+0000 7f439177a700 1 -- 172.21.15.37:0/1866013701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438c09c7e0 con 0x7f438c0b3d80 2023-10-06T02:25:41.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.879+0000 7f4383fff700 1 -- 172.21.15.37:0/1866013701 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374011960 con 0x7f438c0b3d80 2023-10-06T02:25:41.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.879+0000 7f439177a700 1 -- 172.21.15.37:0/1866013701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438c09b6e0 con 0x7f438c0b3d80 2023-10-06T02:25:41.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.880+0000 7f439177a700 1 -- 172.21.15.37:0/1866013701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438c0884f0 con 0x7f438c0b3d80 2023-10-06T02:25:41.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.881+0000 7f4383fff700 1 -- 172.21.15.37:0/1866013701 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43740253f0 con 0x7f438c0b3d80 2023-10-06T02:25:41.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.881+0000 7f4383fff700 1 --2- 172.21.15.37:0/1866013701 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f436c066f30 0x7f436c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:41.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.881+0000 7f4383fff700 1 -- 172.21.15.37:0/1866013701 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f43740860f0 con 0x7f438c0b3d80 2023-10-06T02:25:41.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.881+0000 7f438b7fe700 1 --2- 172.21.15.37:0/1866013701 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f436c066f30 0x7f436c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:41.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.882+0000 7f438b7fe700 1 --2- 172.21.15.37:0/1866013701 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f436c066f30 0x7f436c0693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f438c0c58b0 tx=0x7f437c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:41.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:41.885+0000 7f4383fff700 1 -- 172.21.15.37:0/1866013701 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4374053500 con 0x7f438c0b3d80 2023-10-06T02:25:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.080+0000 7f439177a700 1 -- 172.21.15.37:0/1866013701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f438c064b00 con 0x7f438c0b3d80 2023-10-06T02:25:42.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.083+0000 7f4383fff700 1 -- 172.21.15.37:0/1866013701 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4374006cb0 con 0x7f438c0b3d80 2023-10-06T02:25:42.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.086+0000 7f439177a700 1 -- 172.21.15.37:0/1866013701 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f436c066f30 msgr2=0x7f436c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.086+0000 7f439177a700 1 --2- 172.21.15.37:0/1866013701 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f436c066f30 0x7f436c0693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f438c0c58b0 tx=0x7f437c009040 comp rx=0 tx=0).stop 2023-10-06T02:25:42.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.086+0000 7f439177a700 1 -- 172.21.15.37:0/1866013701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f438c0b3d80 msgr2=0x7f438c09ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.086+0000 7f439177a700 1 --2- 172.21.15.37:0/1866013701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f438c0b3d80 0x7f438c09ac60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f438c06cff0 tx=0x7f4374017000 comp rx=0 tx=0).stop 2023-10-06T02:25:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.086+0000 7f439177a700 1 -- 172.21.15.37:0/1866013701 shutdown_connections 2023-10-06T02:25:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.086+0000 7f439177a700 1 --2- 172.21.15.37:0/1866013701 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f438c159670 0x7f438c169fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.086+0000 7f439177a700 1 --2- 172.21.15.37:0/1866013701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f438c0b3d80 0x7f438c09ac60 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.086+0000 7f439177a700 1 --2- 172.21.15.37:0/1866013701 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f436c066f30 0x7f436c0693e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.086+0000 7f439177a700 1 --2- 172.21.15.37:0/1866013701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f438c0ce700 0x7f438c09b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.086+0000 7f439177a700 1 -- 172.21.15.37:0/1866013701 >> 172.21.15.37:0/1866013701 conn(0x7f438c099610 msgr2=0x7f438c158830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.086+0000 7f439177a700 1 -- 172.21.15.37:0/1866013701 shutdown_connections 2023-10-06T02:25:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.086+0000 7f439177a700 1 -- 172.21.15.37:0/1866013701 wait complete. 2023-10-06T02:25:42.098 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:25:42.098 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:25:42.140 DEBUG:teuthology.orchestra.run.smithi191:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:25:42.185 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:25:42.186 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:25:42.186 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:42.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.307+0000 7f38f77e3700 1 Processor -- start 2023-10-06T02:25:42.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.307+0000 7f38f77e3700 1 -- start start 2023-10-06T02:25:42.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.308+0000 7f38f77e3700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f38f01596d0 0x7f38f00b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.308+0000 7f38f77e3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38f00b3840 0x7f38f00c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.308+0000 7f38f77e3700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f00c5300 con 0x7f38f0159aa0 2023-10-06T02:25:42.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.308+0000 7f38f77e3700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f00c6160 con 0x7f38f00b3840 2023-10-06T02:25:42.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.308+0000 7f38f77e3700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f00c5550 con 0x7f38f01596d0 2023-10-06T02:25:42.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.308+0000 7f38f4d7e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38f00b3840 0x7f38f00c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.308+0000 7f38f4d7e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38f00b3840 0x7f38f00c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33960/0 (socket says 172.21.15.37:33960) 2023-10-06T02:25:42.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.308+0000 7f38f4d7e700 1 -- 172.21.15.37:0/1270721850 learned_addr learned my addr 172.21.15.37:0/1270721850 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:42.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.308+0000 7f38f4d7e700 1 -- 172.21.15.37:0/1270721850 >> v2:172.21.15.191:3300/0 conn(0x7f38f01596d0 msgr2=0x7f38f00b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.308+0000 7f38f4d7e700 1 --2- 172.21.15.37:0/1270721850 >> v2:172.21.15.191:3300/0 conn(0x7f38f01596d0 0x7f38f00b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.308+0000 7f38f4d7e700 1 -- 172.21.15.37:0/1270721850 >> v1:172.21.15.191:6789/0 conn(0x7f38f0159aa0 legacy=0x7f38f00caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.308+0000 7f38f4d7e700 1 -- 172.21.15.37:0/1270721850 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f00c5830 con 0x7f38f00b3840 2023-10-06T02:25:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.308+0000 7f38f4d7e700 1 --2- 172.21.15.37:0/1270721850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f00b3840 0x7f38f00c65f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f38f00896e0 tx=0x7f38e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296c5316e7d57770 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.308+0000 7f38effff700 1 -- 172.21.15.37:0/1270721850 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e400b820 con 0x7f38f00b3840 2023-10-06T02:25:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.308+0000 7f38effff700 1 -- 172.21.15.37:0/1270721850 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e400b980 con 0x7f38f00b3840 2023-10-06T02:25:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.308+0000 7f38effff700 1 -- 172.21.15.37:0/1270721850 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e400bd20 con 0x7f38f00b3840 2023-10-06T02:25:42.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.309+0000 7f38f77e3700 1 -- 172.21.15.37:0/1270721850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f00b3840 msgr2=0x7f38f00c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.309+0000 7f38f77e3700 1 --2- 172.21.15.37:0/1270721850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f00b3840 0x7f38f00c65f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f38f00896e0 tx=0x7f38e4009250 comp rx=0 tx=0).stop 2023-10-06T02:25:42.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.309+0000 7f38f77e3700 1 -- 172.21.15.37:0/1270721850 shutdown_connections 2023-10-06T02:25:42.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.309+0000 7f38f77e3700 1 --2- 172.21.15.37:0/1270721850 >> v2:172.21.15.191:3300/0 conn(0x7f38f01596d0 0x7f38f00b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.309+0000 7f38f77e3700 1 --2- 172.21.15.37:0/1270721850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f00b3840 0x7f38f00c65f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.309+0000 7f38f77e3700 1 -- 172.21.15.37:0/1270721850 >> 172.21.15.37:0/1270721850 conn(0x7f38f006c890 msgr2=0x7f38f00d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:42.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.309+0000 7f38f77e3700 1 -- 172.21.15.37:0/1270721850 shutdown_connections 2023-10-06T02:25:42.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.309+0000 7f38f77e3700 1 -- 172.21.15.37:0/1270721850 wait complete. 2023-10-06T02:25:42.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.310+0000 7f38f77e3700 1 Processor -- start 2023-10-06T02:25:42.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.310+0000 7f38f77e3700 1 -- start start 2023-10-06T02:25:42.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.311+0000 7f38f77e3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f00b3840 0x7f38f01471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.311+0000 7f38f77e3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38f01596d0 0x7f38f016a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.311+0000 7f38f77e3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38f0159aa0 0x7f38f00cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.311+0000 7f38f77e3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f0147730 con 0x7f38f00b3840 2023-10-06T02:25:42.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.311+0000 7f38f77e3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f00cfb30 con 0x7f38f0159aa0 2023-10-06T02:25:42.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.311+0000 7f38f77e3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f00cef40 con 0x7f38f01596d0 2023-10-06T02:25:42.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.311+0000 7f38f557f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f00b3840 0x7f38f01471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.311+0000 7f38f557f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f00b3840 0x7f38f01471f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33966/0 (socket says 172.21.15.37:33966) 2023-10-06T02:25:42.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.311+0000 7f38f557f700 1 -- 172.21.15.37:0/2815445927 learned_addr learned my addr 172.21.15.37:0/2815445927 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:42.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.311+0000 7f38f557f700 1 -- 172.21.15.37:0/2815445927 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38f01596d0 msgr2=0x7f38f016a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.311+0000 7f38f557f700 1 --2- 172.21.15.37:0/2815445927 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38f01596d0 0x7f38f016a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.311+0000 7f38f557f700 1 -- 172.21.15.37:0/2815445927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38f0159aa0 msgr2=0x7f38f00cffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.311+0000 7f38f5d80700 1 --2- 172.21.15.37:0/2815445927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38f0159aa0 0x7f38f00cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.311+0000 7f38f557f700 1 --2- 172.21.15.37:0/2815445927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38f0159aa0 0x7f38f00cffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.311+0000 7f38f557f700 1 -- 172.21.15.37:0/2815445927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e40094f0 con 0x7f38f00b3840 2023-10-06T02:25:42.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.312+0000 7f38f557f700 1 --2- 172.21.15.37:0/2815445927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f00b3840 0x7f38f01471f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f38e000bc30 tx=0x7f38e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:42.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.312+0000 7f38ed7fa700 1 -- 172.21.15.37:0/2815445927 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e00092e0 con 0x7f38f00b3840 2023-10-06T02:25:42.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.312+0000 7f38ed7fa700 1 -- 172.21.15.37:0/2815445927 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e000c7a0 con 0x7f38f00b3840 2023-10-06T02:25:42.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.312+0000 7f38f77e3700 1 -- 172.21.15.37:0/2815445927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f00cf200 con 0x7f38f00b3840 2023-10-06T02:25:42.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.312+0000 7f38ed7fa700 1 -- 172.21.15.37:0/2815445927 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e000cb80 con 0x7f38f00b3840 2023-10-06T02:25:42.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.312+0000 7f38f77e3700 1 -- 172.21.15.37:0/2815445927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f00cf7c0 con 0x7f38f00b3840 2023-10-06T02:25:42.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.313+0000 7f38f77e3700 1 -- 172.21.15.37:0/2815445927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f006fbf0 con 0x7f38f00b3840 2023-10-06T02:25:42.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.313+0000 7f38ed7fa700 1 -- 172.21.15.37:0/2815445927 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f38e0012070 con 0x7f38f00b3840 2023-10-06T02:25:42.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.314+0000 7f38ed7fa700 1 --2- 172.21.15.37:0/2815445927 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f38dc066f30 0x7f38dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.314+0000 7f38ed7fa700 1 -- 172.21.15.37:0/2815445927 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f38e0083fd0 con 0x7f38f00b3840 2023-10-06T02:25:42.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.314+0000 7f38f4d7e700 1 --2- 172.21.15.37:0/2815445927 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f38dc066f30 0x7f38dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.314+0000 7f38f4d7e700 1 --2- 172.21.15.37:0/2815445927 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f38dc066f30 0x7f38dc0693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f38f00896e0 tx=0x7f38e4016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:42.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.318+0000 7f38ed7fa700 1 -- 172.21.15.37:0/2815445927 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f38e00513e0 con 0x7f38f00b3840 2023-10-06T02:25:42.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.556+0000 7f38f77e3700 1 -- 172.21.15.37:0/2815445927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38f00d13e0 con 0x7f38f00b3840 2023-10-06T02:25:42.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.557+0000 7f38ed7fa700 1 -- 172.21.15.37:0/2815445927 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f38e001a090 con 0x7f38f00b3840 2023-10-06T02:25:42.557 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:42.558 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5263,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2341182274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2341182274},{"type":"v1","addr":"172.21.15.191:6837","nonce":2341182274}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5385,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/562500386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":562500386},{"type":"v1","addr":"172.21.15.37:6834","nonce":562500386}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5388,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1403086996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1403086996},{"type":"v1","addr":"172.21.15.37:6835","nonce":1403086996}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5551,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2379878574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2379878574},{"type":"v1","addr":"172.21.15.191:6836","nonce":2379878574}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[]} 2023-10-06T02:25:42.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.559+0000 7f38f77e3700 1 -- 172.21.15.37:0/2815445927 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f38dc066f30 msgr2=0x7f38dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.559+0000 7f38f77e3700 1 --2- 172.21.15.37:0/2815445927 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f38dc066f30 0x7f38dc0693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f38f00896e0 tx=0x7f38e4016000 comp rx=0 tx=0).stop 2023-10-06T02:25:42.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.559+0000 7f38f77e3700 1 -- 172.21.15.37:0/2815445927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f00b3840 msgr2=0x7f38f01471f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.559+0000 7f38f77e3700 1 --2- 172.21.15.37:0/2815445927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f00b3840 0x7f38f01471f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f38e000bc30 tx=0x7f38e0009840 comp rx=0 tx=0).stop 2023-10-06T02:25:42.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.559+0000 7f38f77e3700 1 -- 172.21.15.37:0/2815445927 shutdown_connections 2023-10-06T02:25:42.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.559+0000 7f38f77e3700 1 --2- 172.21.15.37:0/2815445927 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f38dc066f30 0x7f38dc0693e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.559+0000 7f38f77e3700 1 --2- 172.21.15.37:0/2815445927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38f0159aa0 0x7f38f00cffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.559+0000 7f38f77e3700 1 --2- 172.21.15.37:0/2815445927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38f00b3840 0x7f38f01471f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.559+0000 7f38f77e3700 1 --2- 172.21.15.37:0/2815445927 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38f01596d0 0x7f38f016a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.559+0000 7f38f77e3700 1 -- 172.21.15.37:0/2815445927 >> 172.21.15.37:0/2815445927 conn(0x7f38f006c890 msgr2=0x7f38f0154d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:42.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.559+0000 7f38f77e3700 1 -- 172.21.15.37:0/2815445927 shutdown_connections 2023-10-06T02:25:42.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.559+0000 7f38f77e3700 1 -- 172.21.15.37:0/2815445927 wait complete. 2023-10-06T02:25:42.561 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2023-10-06T02:25:42.571 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:25:42.571 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:25:42.572 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:25:42.572 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:25:42.572 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:25:42.572 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:25:42.572 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:25:42.572 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:25:42.572 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:25:42.573 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:25:42.573 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:25:42.573 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:25:42.573 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:25:42.573 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:25:42.573 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:25:42.573 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:25:42.581 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:25:42.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:25:42.582 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:25:42.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:25:42.584 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:25:42.584 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:25:42.585 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:25:42.585 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:25:42.623 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:25:42.623 DEBUG:teuthology.parallel:result is None 2023-10-06T02:25:42.624 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:25:42.624 DEBUG:teuthology.parallel:result is None 2023-10-06T02:25:42.626 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:25:42.626 DEBUG:teuthology.parallel:result is None 2023-10-06T02:25:42.627 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:25:42.627 DEBUG:teuthology.parallel:result is None 2023-10-06T02:25:42.627 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:25:42.699 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-10-06T02:25:42.699 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-10-06T02:25:42.708 INFO:tasks.ceph.mds.d.smithi191.stdout:starting mds.d at 2023-10-06T02:25:42.708 INFO:tasks.ceph.mds.b.smithi191.stdout:starting mds.b at 2023-10-06T02:25:42.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.757+0000 7f79b1594700 1 Processor -- start 2023-10-06T02:25:42.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.757+0000 7f79b1594700 1 -- start start 2023-10-06T02:25:42.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.758+0000 7f79b1594700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f79ac159800 0x7f79ac0c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.758+0000 7f79b1594700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79ac0c9c90 0x7f79ac0ca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.758+0000 7f79b1594700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0ca990 0x7f79ac0cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.758+0000 7f79b1594700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ac0cb830 con 0x7f79ac0c9c90 2023-10-06T02:25:42.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.758+0000 7f79b1594700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ac06df70 con 0x7f79ac159800 2023-10-06T02:25:42.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.758+0000 7f79b1594700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac159bd0 con 0x7f79ac0ca990 2023-10-06T02:25:42.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.758+0000 7f79ab7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79ac0c9c90 0x7f79ac0ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.758+0000 7f79ab7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79ac0c9c90 0x7f79ac0ca110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34008/0 (socket says 172.21.15.37:34008) 2023-10-06T02:25:42.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.758+0000 7f79ab7fe700 1 -- 172.21.15.37:0/1801662000 learned_addr learned my addr 172.21.15.37:0/1801662000 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:42.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.758+0000 7f79abfff700 1 --2- 172.21.15.37:0/1801662000 >> v2:172.21.15.191:3300/0 conn(0x7f79ac159800 0x7f79ac0c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.758+0000 7f79b0d93700 1 --2- 172.21.15.37:0/1801662000 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0ca990 0x7f79ac0cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.758+0000 7f79ab7fe700 1 -- 172.21.15.37:0/1801662000 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0ca990 msgr2=0x7f79ac0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:42.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.758+0000 7f79ab7fe700 1 --2- 172.21.15.37:0/1801662000 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0ca990 0x7f79ac0cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.758+0000 7f79ab7fe700 1 -- 172.21.15.37:0/1801662000 >> v2:172.21.15.191:3300/0 conn(0x7f79ac159800 msgr2=0x7f79ac0c51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:42.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.758+0000 7f79ab7fe700 1 --2- 172.21.15.37:0/1801662000 >> v2:172.21.15.191:3300/0 conn(0x7f79ac159800 0x7f79ac0c51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.758+0000 7f79ab7fe700 1 -- 172.21.15.37:0/1801662000 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac0cb2f0 con 0x7f79ac0c9c90 2023-10-06T02:25:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.758+0000 7f79ab7fe700 1 --2- 172.21.15.37:0/1801662000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79ac0c9c90 0x7f79ac0ca110 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f79ac06b3a0 tx=0x7f79a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b9d7cdcd27e67 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.759+0000 7f79aaffd700 1 -- 172.21.15.37:0/1801662000 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a000b860 con 0x7f79ac0c9c90 2023-10-06T02:25:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.759+0000 7f79aaffd700 1 -- 172.21.15.37:0/1801662000 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a000b9c0 con 0x7f79ac0c9c90 2023-10-06T02:25:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.759+0000 7f79aaffd700 1 -- 172.21.15.37:0/1801662000 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a000bd60 con 0x7f79ac0c9c90 2023-10-06T02:25:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.759+0000 7f79b1594700 1 -- 172.21.15.37:0/1801662000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79ac0c9c90 msgr2=0x7f79ac0ca110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.759+0000 7f79b1594700 1 --2- 172.21.15.37:0/1801662000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79ac0c9c90 0x7f79ac0ca110 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f79ac06b3a0 tx=0x7f79a0009250 comp rx=0 tx=0).stop 2023-10-06T02:25:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.759+0000 7f79b1594700 1 -- 172.21.15.37:0/1801662000 shutdown_connections 2023-10-06T02:25:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.759+0000 7f79b1594700 1 --2- 172.21.15.37:0/1801662000 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0ca990 0x7f79ac0cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.759+0000 7f79b1594700 1 --2- 172.21.15.37:0/1801662000 >> v2:172.21.15.191:3300/0 conn(0x7f79ac159800 0x7f79ac0c51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.759+0000 7f79b1594700 1 --2- 172.21.15.37:0/1801662000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79ac0c9c90 0x7f79ac0ca110 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.759+0000 7f79b1594700 1 -- 172.21.15.37:0/1801662000 >> 172.21.15.37:0/1801662000 conn(0x7f79ac097430 msgr2=0x7f79ac06c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.759+0000 7f79b1594700 1 -- 172.21.15.37:0/1801662000 shutdown_connections 2023-10-06T02:25:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.759+0000 7f79b1594700 1 -- 172.21.15.37:0/1801662000 wait complete. 2023-10-06T02:25:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.760+0000 7f79b1594700 1 Processor -- start 2023-10-06T02:25:42.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.760+0000 7f79b1594700 1 -- start start 2023-10-06T02:25:42.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.761+0000 7f79b1594700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79ac0c9c90 0x7f79ac156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.761+0000 7f79b1594700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0ca990 0x7f79ac0b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.761+0000 7f79b1594700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79ac159800 0x7f79ac0b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.761+0000 7f79b1594700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac15cde0 con 0x7f79ac0c9c90 2023-10-06T02:25:42.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.761+0000 7f79b1594700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac156c80 con 0x7f79ac159800 2023-10-06T02:25:42.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.761+0000 7f79b1594700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac0b3020 con 0x7f79ac0ca990 2023-10-06T02:25:42.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.761+0000 7f79abfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79ac0c9c90 0x7f79ac156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.761+0000 7f79abfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79ac0c9c90 0x7f79ac156740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34012/0 (socket says 172.21.15.37:34012) 2023-10-06T02:25:42.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.761+0000 7f79abfff700 1 -- 172.21.15.37:0/3606911123 learned_addr learned my addr 172.21.15.37:0/3606911123 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:42.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.761+0000 7f79ab7fe700 1 --2- 172.21.15.37:0/3606911123 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0ca990 0x7f79ac0b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.761+0000 7f79b0d93700 1 --2- 172.21.15.37:0/3606911123 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79ac159800 0x7f79ac0b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.762+0000 7f79abfff700 1 -- 172.21.15.37:0/3606911123 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0ca990 msgr2=0x7f79ac0b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.762+0000 7f79abfff700 1 --2- 172.21.15.37:0/3606911123 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0ca990 0x7f79ac0b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.762+0000 7f79abfff700 1 -- 172.21.15.37:0/3606911123 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79ac159800 msgr2=0x7f79ac0b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:42.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.762+0000 7f79abfff700 1 --2- 172.21.15.37:0/3606911123 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79ac159800 0x7f79ac0b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:42.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.762+0000 7f79abfff700 1 -- 172.21.15.37:0/3606911123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a00094f0 con 0x7f79ac0c9c90 2023-10-06T02:25:42.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.762+0000 7f79b0d93700 1 --2- 172.21.15.37:0/3606911123 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79ac159800 0x7f79ac0b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:42.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.762+0000 7f79abfff700 1 --2- 172.21.15.37:0/3606911123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79ac0c9c90 0x7f79ac156740 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f799c00d810 tx=0x7f799c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:42.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.762+0000 7f7993fff700 1 -- 172.21.15.37:0/3606911123 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c0125f0 con 0x7f79ac0c9c90 2023-10-06T02:25:42.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.762+0000 7f7993fff700 1 -- 172.21.15.37:0/3606911123 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c012750 con 0x7f79ac0c9c90 2023-10-06T02:25:42.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.762+0000 7f79b1594700 1 -- 172.21.15.37:0/3606911123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ac0b3300 con 0x7f79ac0c9c90 2023-10-06T02:25:42.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.762+0000 7f7993fff700 1 -- 172.21.15.37:0/3606911123 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c012af0 con 0x7f79ac0c9c90 2023-10-06T02:25:42.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.762+0000 7f79b1594700 1 -- 172.21.15.37:0/3606911123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ac0b38c0 con 0x7f79ac0c9c90 2023-10-06T02:25:42.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.763+0000 7f79b1594700 1 -- 172.21.15.37:0/3606911123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ac064b00 con 0x7f79ac0c9c90 2023-10-06T02:25:42.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.763+0000 7f7993fff700 1 -- 172.21.15.37:0/3606911123 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f799c01e460 con 0x7f79ac0c9c90 2023-10-06T02:25:42.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.764+0000 7f7993fff700 1 --2- 172.21.15.37:0/3606911123 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7998066f30 0x7f79980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:42.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.764+0000 7f7993fff700 1 -- 172.21.15.37:0/3606911123 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f799c084970 con 0x7f79ac0c9c90 2023-10-06T02:25:42.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.764+0000 7f79ab7fe700 1 --2- 172.21.15.37:0/3606911123 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7998066f30 0x7f79980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:42.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.764+0000 7f79ab7fe700 1 --2- 172.21.15.37:0/3606911123 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7998066f30 0x7f79980693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f79ac06b3a0 tx=0x7f79a0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:42.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.768+0000 7f7993fff700 1 -- 172.21.15.37:0/3606911123 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f799c051d80 con 0x7f79ac0c9c90 2023-10-06T02:25:42.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:42.976+0000 7f79b1594700 1 -- 172.21.15.37:0/3606911123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f79ac04bb80 con 0x7f79ac0c9c90 2023-10-06T02:25:43.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.742+0000 7f7993fff700 1 -- 172.21.15.37:0/3606911123 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v53) v1 ==== 97+0+0 (secure 0 0 0) 0x7f799c0553a0 con 0x7f79ac0c9c90 2023-10-06T02:25:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.745+0000 7f79b1594700 1 -- 172.21.15.37:0/3606911123 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7998066f30 msgr2=0x7f79980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.745+0000 7f79b1594700 1 --2- 172.21.15.37:0/3606911123 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7998066f30 0x7f79980693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f79ac06b3a0 tx=0x7f79a0017000 comp rx=0 tx=0).stop 2023-10-06T02:25:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.745+0000 7f79b1594700 1 -- 172.21.15.37:0/3606911123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79ac0c9c90 msgr2=0x7f79ac156740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.745+0000 7f79b1594700 1 --2- 172.21.15.37:0/3606911123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79ac0c9c90 0x7f79ac156740 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f799c00d810 tx=0x7f799c008040 comp rx=0 tx=0).stop 2023-10-06T02:25:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.745+0000 7f79b1594700 1 -- 172.21.15.37:0/3606911123 shutdown_connections 2023-10-06T02:25:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.745+0000 7f79b1594700 1 --2- 172.21.15.37:0/3606911123 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7998066f30 0x7f79980693e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.745+0000 7f79b1594700 1 --2- 172.21.15.37:0/3606911123 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79ac159800 0x7f79ac0b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.745+0000 7f79b1594700 1 --2- 172.21.15.37:0/3606911123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79ac0c9c90 0x7f79ac156740 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.745+0000 7f79b1594700 1 --2- 172.21.15.37:0/3606911123 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0ca990 0x7f79ac0b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.745+0000 7f79b1594700 1 -- 172.21.15.37:0/3606911123 >> 172.21.15.37:0/3606911123 conn(0x7f79ac097430 msgr2=0x7f79ac15d240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.746+0000 7f79b1594700 1 -- 172.21.15.37:0/3606911123 shutdown_connections 2023-10-06T02:25:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.746+0000 7f79b1594700 1 -- 172.21.15.37:0/3606911123 wait complete. 2023-10-06T02:25:43.749 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-10-06T02:25:43.761 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:25:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.886+0000 7fe431d73700 1 Processor -- start 2023-10-06T02:25:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.886+0000 7fe431d73700 1 -- start start 2023-10-06T02:25:43.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.887+0000 7fe431d73700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe42c0cfc00 0x7fe42c1646d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:43.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.887+0000 7fe431d73700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42c15e1b0 con 0x7fe42c159760 2023-10-06T02:25:43.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.887+0000 7fe431d73700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42c0cb650 con 0x7fe42c0c63a0 2023-10-06T02:25:43.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.887+0000 7fe431d73700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe42c0cc2d0 con 0x7fe42c0cfc00 2023-10-06T02:25:43.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.887+0000 7fe42bfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe42c0cfc00 0x7fe42c1646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:43.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.887+0000 7fe42b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe42c159760 0x7fe42c15d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41770/0 (socket says 172.21.15.37:41770) 2023-10-06T02:25:43.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.887+0000 7fe42b7fe700 1 -- 172.21.15.37:0/4276313287 learned_addr learned my addr 172.21.15.37:0/4276313287 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:43.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.888+0000 7fe42bfff700 1 -- 172.21.15.37:0/4276313287 >> v1:172.21.15.191:6789/0 conn(0x7fe42c0c63a0 legacy=0x7fe42c15daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:43.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.888+0000 7fe42bfff700 1 -- 172.21.15.37:0/4276313287 >> v1:172.21.15.37:6789/0 conn(0x7fe42c159760 legacy=0x7fe42c15d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:43.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.888+0000 7fe42a7fc700 1 -- 172.21.15.37:0/4276313287 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187999798 0 0) 0x7fe42c15e1b0 con 0x7fe42c159760 2023-10-06T02:25:43.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.888+0000 7fe42bfff700 1 -- 172.21.15.37:0/4276313287 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c0cb930 con 0x7fe42c0cfc00 2023-10-06T02:25:43.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.888+0000 7fe42bfff700 1 --2- 172.21.15.37:0/4276313287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe42c0cfc00 0x7fe42c1646d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe424009e60 tx=0x7fe424009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a01fd02e90bcaa61 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:43.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.888+0000 7fe42a7fc700 1 -- 172.21.15.37:0/4276313287 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42400e070 con 0x7fe42c0cfc00 2023-10-06T02:25:43.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.888+0000 7fe42a7fc700 1 -- 172.21.15.37:0/4276313287 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42400bc80 con 0x7fe42c0cfc00 2023-10-06T02:25:43.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.888+0000 7fe42a7fc700 1 -- 172.21.15.37:0/4276313287 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424012430 con 0x7fe42c0cfc00 2023-10-06T02:25:43.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.888+0000 7fe431d73700 1 -- 172.21.15.37:0/4276313287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe42c0cfc00 msgr2=0x7fe42c1646d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:43.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.888+0000 7fe431d73700 1 --2- 172.21.15.37:0/4276313287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe42c0cfc00 0x7fe42c1646d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe424009e60 tx=0x7fe424009780 comp rx=0 tx=0).stop 2023-10-06T02:25:43.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.888+0000 7fe431d73700 1 -- 172.21.15.37:0/4276313287 shutdown_connections 2023-10-06T02:25:43.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.888+0000 7fe431d73700 1 --2- 172.21.15.37:0/4276313287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe42c0cfc00 0x7fe42c1646d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:43.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.888+0000 7fe431d73700 1 -- 172.21.15.37:0/4276313287 >> 172.21.15.37:0/4276313287 conn(0x7fe42c06c890 msgr2=0x7fe42c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:43.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.888+0000 7fe431d73700 1 -- 172.21.15.37:0/4276313287 shutdown_connections 2023-10-06T02:25:43.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.889+0000 7fe431d73700 1 -- 172.21.15.37:0/4276313287 wait complete. 2023-10-06T02:25:43.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.890+0000 7fe431d73700 1 Processor -- start 2023-10-06T02:25:43.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.890+0000 7fe431d73700 1 -- start start 2023-10-06T02:25:43.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.890+0000 7fe431d73700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe42c0c63a0 0x7fe42c0b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:43.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.890+0000 7fe431d73700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe42c0cfc00 0x7fe42c14adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:43.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.890+0000 7fe431d73700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe42c159760 0x7fe42c06d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:43.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.890+0000 7fe431d73700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0b4e30 con 0x7fe42c0c63a0 2023-10-06T02:25:43.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.890+0000 7fe431d73700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0b5110 con 0x7fe42c0cfc00 2023-10-06T02:25:43.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.890+0000 7fe431d73700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0b53f0 con 0x7fe42c159760 2023-10-06T02:25:43.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.891+0000 7fe42b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe42c0c63a0 0x7fe42c0b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:43.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.891+0000 7fe42b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe42c0c63a0 0x7fe42c0b5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34024/0 (socket says 172.21.15.37:34024) 2023-10-06T02:25:43.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.891+0000 7fe42b7fe700 1 -- 172.21.15.37:0/2068612447 learned_addr learned my addr 172.21.15.37:0/2068612447 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:43.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.891+0000 7fe42affd700 1 --2- 172.21.15.37:0/2068612447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe42c0cfc00 0x7fe42c14adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:43.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.891+0000 7fe42bfff700 1 --2- 172.21.15.37:0/2068612447 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe42c159760 0x7fe42c06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:43.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.891+0000 7fe42b7fe700 1 -- 172.21.15.37:0/2068612447 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe42c159760 msgr2=0x7fe42c06d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:43.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.891+0000 7fe42b7fe700 1 --2- 172.21.15.37:0/2068612447 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe42c159760 0x7fe42c06d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:43.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.891+0000 7fe42b7fe700 1 -- 172.21.15.37:0/2068612447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe42c0cfc00 msgr2=0x7fe42c14adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:43.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.891+0000 7fe42b7fe700 1 --2- 172.21.15.37:0/2068612447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe42c0cfc00 0x7fe42c14adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:43.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.891+0000 7fe42b7fe700 1 -- 172.21.15.37:0/2068612447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe424009a20 con 0x7fe42c0c63a0 2023-10-06T02:25:43.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.891+0000 7fe42b7fe700 1 --2- 172.21.15.37:0/2068612447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe42c0c63a0 0x7fe42c0b5ed0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00c7e0 tx=0x7fe41c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:43.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.891+0000 7fe4137fe700 1 -- 172.21.15.37:0/2068612447 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c005b30 con 0x7fe42c0c63a0 2023-10-06T02:25:43.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.891+0000 7fe4137fe700 1 -- 172.21.15.37:0/2068612447 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41c005c90 con 0x7fe42c0c63a0 2023-10-06T02:25:43.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.891+0000 7fe431d73700 1 -- 172.21.15.37:0/2068612447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42c0b56d0 con 0x7fe42c0c63a0 2023-10-06T02:25:43.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.891+0000 7fe4137fe700 1 -- 172.21.15.37:0/2068612447 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c007300 con 0x7fe42c0c63a0 2023-10-06T02:25:43.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.891+0000 7fe431d73700 1 -- 172.21.15.37:0/2068612447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42c14b330 con 0x7fe42c0c63a0 2023-10-06T02:25:43.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.892+0000 7fe431d73700 1 -- 172.21.15.37:0/2068612447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42c0b5bf0 con 0x7fe42c0c63a0 2023-10-06T02:25:43.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.893+0000 7fe4137fe700 1 -- 172.21.15.37:0/2068612447 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe41c01b400 con 0x7fe42c0c63a0 2023-10-06T02:25:43.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.893+0000 7fe4137fe700 1 --2- 172.21.15.37:0/2068612447 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe418066f30 0x7fe4180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:43.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.893+0000 7fe4137fe700 1 -- 172.21.15.37:0/2068612447 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe41c083ec0 con 0x7fe42c0c63a0 2023-10-06T02:25:43.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.893+0000 7fe42affd700 1 --2- 172.21.15.37:0/2068612447 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe418066f30 0x7fe4180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:43.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.894+0000 7fe42affd700 1 --2- 172.21.15.37:0/2068612447 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe418066f30 0x7fe4180693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe420006fd0 tx=0x7fe420008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:43.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:43.897+0000 7fe4137fe700 1 -- 172.21.15.37:0/2068612447 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe42c0b5bf0 con 0x7fe42c0c63a0 2023-10-06T02:25:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.165+0000 7fe431d73700 1 -- 172.21.15.37:0/2068612447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe42c0b5bf0 con 0x7fe42c0c63a0 2023-10-06T02:25:44.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.165+0000 7fe4137fe700 1 -- 172.21.15.37:0/2068612447 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fe42c0b5bf0 con 0x7fe42c0c63a0 2023-10-06T02:25:44.166 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:44.166 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:25:44.166 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-10-06T02:25:44.166 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:44.166 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-10-06T02:25:44.166 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lkQF5HRAAmDbVzKumixz+mz8C9Ibu4w==", 2023-10-06T02:25:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:25:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:25:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T02:25:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T02:25:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:25:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:25:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-10-06T02:25:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lpPDVKBAAdg+chey8icfN9/u/REprEw==", 2023-10-06T02:25:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:25:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:25:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T02:25:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T02:25:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:25:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:25:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-10-06T02:25:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lSQ5oJBAAvXZ5RKQNOEujDD8kM0QU+Q==", 2023-10-06T02:25:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:25:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:25:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T02:25:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T02:25:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:25:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:25:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-10-06T02:25:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lE5adLxAAb6XIxhNYBl7FVcprFY526g==", 2023-10-06T02:25:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:25:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:25:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T02:25:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T02:25:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:25:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:25:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-10-06T02:25:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBjbx9lLEJuDRAA5astKYoPcHwja09KROk+tQ==", 2023-10-06T02:25:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:25:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:25:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:25:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:25:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:25:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-10-06T02:25:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBmbx9lwdVEDBAA5TMlEiE5UAavPJzdV22Gtw==", 2023-10-06T02:25:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:25:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:25:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:25:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:25:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:25:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-10-06T02:25:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBpbx9lF5UeChAA1fYYSrtxmm7yMS4pn/hacQ==", 2023-10-06T02:25:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:25:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:25:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:25:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:25:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:25:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-10-06T02:25:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBsbx9l3oTYCBAADYVyJ6Yt2sZfXhundjqceQ==", 2023-10-06T02:25:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:25:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:25:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:25:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:25:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:25:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-10-06T02:25:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBybx9lhrfuCBAA7A97uVPnZDT9ia70W5180A==", 2023-10-06T02:25:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:25:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:25:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:25:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:25:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:25:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-10-06T02:25:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQB1bx9lEntaBxAAzvIEHp4iJvnev2yuqPL3tA==", 2023-10-06T02:25:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:25:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:25:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:25:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:25:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:25:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-10-06T02:25:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQB4bx9lZaxXBxAAE+FsUplhP39hVXuZ4btCqQ==", 2023-10-06T02:25:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:25:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:25:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:25:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:25:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:25:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-10-06T02:25:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQB7bx9lAtvBBhAAZzUs75blYnu3OocrsTVHSg==", 2023-10-06T02:25:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:25:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:25:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:25:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:25:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:25:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-10-06T02:25:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9llHl0MxAAPrpwRuKiAcn+W0aDwzBvvQ==", 2023-10-06T02:25:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:25:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:25:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2023-10-06T02:25:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T02:25:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:25:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-10-06T02:25:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBgbx9lgp1AABAA+oAQVt7MWVsWnRxbWVLNbA==", 2023-10-06T02:25:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:25:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:25:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T02:25:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T02:25:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T02:25:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:25:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-10-06T02:25:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lByLlOBAAeTJLSorscEidED7VHIPKCg==", 2023-10-06T02:25:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:25:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:25:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T02:25:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T02:25:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T02:25:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:25:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-10-06T02:25:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBgbx9l6LuWBRAAvYfXvGvgMYDPlB4CgKaNqw==", 2023-10-06T02:25:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:25:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:25:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T02:25:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T02:25:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T02:25:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:25:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-10-06T02:25:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lgayZAhAA9VQix+78KreRH/YEeftPQA==", 2023-10-06T02:25:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:25:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T02:25:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T02:25:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T02:25:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:25:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:25:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-10-06T02:25:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lg7hcGhAAelKPvNX7CL80KycBGoQ8cw==", 2023-10-06T02:25:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:25:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T02:25:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-10-06T02:25:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:25:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:25:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-10-06T02:25:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9l5BH7FhAAotvMdV8pKCJzZUqTviL3CQ==", 2023-10-06T02:25:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:25:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T02:25:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-10-06T02:25:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:25:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-06T02:25:44.182 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:25:44.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.167+0000 7fe431d73700 1 -- 172.21.15.37:0/2068612447 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe418066f30 msgr2=0x7fe4180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.167+0000 7fe431d73700 1 --2- 172.21.15.37:0/2068612447 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe418066f30 0x7fe4180693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe420006fd0 tx=0x7fe420008040 comp rx=0 tx=0).stop 2023-10-06T02:25:44.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.167+0000 7fe431d73700 1 -- 172.21.15.37:0/2068612447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe42c0c63a0 msgr2=0x7fe42c0b5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.167+0000 7fe431d73700 1 --2- 172.21.15.37:0/2068612447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe42c0c63a0 0x7fe42c0b5ed0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00c7e0 tx=0x7fe41c007df0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.167+0000 7fe431d73700 1 -- 172.21.15.37:0/2068612447 shutdown_connections 2023-10-06T02:25:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.167+0000 7fe431d73700 1 --2- 172.21.15.37:0/2068612447 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe42c159760 0x7fe42c06d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.167+0000 7fe431d73700 1 --2- 172.21.15.37:0/2068612447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe42c0c63a0 0x7fe42c0b5ed0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.167+0000 7fe431d73700 1 --2- 172.21.15.37:0/2068612447 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe418066f30 0x7fe4180693e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.167+0000 7fe431d73700 1 --2- 172.21.15.37:0/2068612447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe42c0cfc00 0x7fe42c14adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.167+0000 7fe431d73700 1 -- 172.21.15.37:0/2068612447 >> 172.21.15.37:0/2068612447 conn(0x7fe42c06c890 msgr2=0x7fe42c154ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.167+0000 7fe431d73700 1 -- 172.21.15.37:0/2068612447 shutdown_connections 2023-10-06T02:25:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.167+0000 7fe431d73700 1 -- 172.21.15.37:0/2068612447 wait complete. 2023-10-06T02:25:44.185 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:25:44.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.303+0000 7f888a0c9700 1 Processor -- start 2023-10-06T02:25:44.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.303+0000 7f888a0c9700 1 -- start start 2023-10-06T02:25:44.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.304+0000 7f888a0c9700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8884159370 0x7f8884159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.304+0000 7f888a0c9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88840b2270 0x7f888415db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.304+0000 7f888a0c9700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88840cb200 con 0x7f88840aff10 2023-10-06T02:25:44.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.304+0000 7f888a0c9700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88840b5c00 con 0x7f88840b2270 2023-10-06T02:25:44.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.304+0000 7f888a0c9700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88840cb7c0 con 0x7f8884159370 2023-10-06T02:25:44.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.304+0000 7f88888c6700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88840b2270 0x7f888415db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.304+0000 7f88888c6700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88840b2270 0x7f888415db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34038/0 (socket says 172.21.15.37:34038) 2023-10-06T02:25:44.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.304+0000 7f88888c6700 1 -- 172.21.15.37:0/895582299 learned_addr learned my addr 172.21.15.37:0/895582299 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:44.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.304+0000 7f88890c7700 1 --2- 172.21.15.37:0/895582299 >> v2:172.21.15.191:3300/0 conn(0x7f8884159370 0x7f8884159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.304+0000 7f88888c6700 1 -- 172.21.15.37:0/895582299 >> v2:172.21.15.191:3300/0 conn(0x7f8884159370 msgr2=0x7f8884159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:44.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.304+0000 7f88888c6700 1 --2- 172.21.15.37:0/895582299 >> v2:172.21.15.191:3300/0 conn(0x7f8884159370 0x7f8884159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.304+0000 7f88888c6700 1 -- 172.21.15.37:0/895582299 >> v1:172.21.15.191:6789/0 conn(0x7f88840aff10 legacy=0x7f88840b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.304+0000 7f88888c6700 1 -- 172.21.15.37:0/895582299 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888415e0d0 con 0x7f88840b2270 2023-10-06T02:25:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.304+0000 7f88888c6700 1 --2- 172.21.15.37:0/895582299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88840b2270 0x7f888415db90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f88840d13a0 tx=0x7f8878009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3180631081ceca58 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.304+0000 7f8883fff700 1 -- 172.21.15.37:0/895582299 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887800b820 con 0x7f88840b2270 2023-10-06T02:25:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.305+0000 7f8883fff700 1 -- 172.21.15.37:0/895582299 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887800b980 con 0x7f88840b2270 2023-10-06T02:25:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.305+0000 7f8883fff700 1 -- 172.21.15.37:0/895582299 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887800bd20 con 0x7f88840b2270 2023-10-06T02:25:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.305+0000 7f888a0c9700 1 -- 172.21.15.37:0/895582299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88840b2270 msgr2=0x7f888415db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.305+0000 7f888a0c9700 1 --2- 172.21.15.37:0/895582299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88840b2270 0x7f888415db90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f88840d13a0 tx=0x7f8878009250 comp rx=0 tx=0).stop 2023-10-06T02:25:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.305+0000 7f888a0c9700 1 -- 172.21.15.37:0/895582299 shutdown_connections 2023-10-06T02:25:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.305+0000 7f888a0c9700 1 --2- 172.21.15.37:0/895582299 >> v2:172.21.15.191:3300/0 conn(0x7f8884159370 0x7f8884159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.305+0000 7f888a0c9700 1 --2- 172.21.15.37:0/895582299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88840b2270 0x7f888415db90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.305+0000 7f888a0c9700 1 -- 172.21.15.37:0/895582299 >> 172.21.15.37:0/895582299 conn(0x7f888406c0b0 msgr2=0x7f888406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:44.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.305+0000 7f888a0c9700 1 -- 172.21.15.37:0/895582299 shutdown_connections 2023-10-06T02:25:44.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.305+0000 7f888a0c9700 1 -- 172.21.15.37:0/895582299 wait complete. 2023-10-06T02:25:44.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.306+0000 7f888a0c9700 1 Processor -- start 2023-10-06T02:25:44.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.306+0000 7f888a0c9700 1 -- start start 2023-10-06T02:25:44.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.307+0000 7f888a0c9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88840aff10 0x7f888414d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.307+0000 7f888a0c9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88840b2270 0x7f88840c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.307+0000 7f888a0c9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8884159370 0x7f88840c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.307+0000 7f888a0c9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888415af50 con 0x7f88840aff10 2023-10-06T02:25:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.307+0000 7f888a0c9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88840c4e90 con 0x7f88840b2270 2023-10-06T02:25:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.307+0000 7f888a0c9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88840c5170 con 0x7f8884159370 2023-10-06T02:25:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.307+0000 7f88890c7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88840aff10 0x7f888414d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.307+0000 7f88890c7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88840aff10 0x7f888414d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34044/0 (socket says 172.21.15.37:34044) 2023-10-06T02:25:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.307+0000 7f88890c7700 1 -- 172.21.15.37:0/2312524084 learned_addr learned my addr 172.21.15.37:0/2312524084 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.307+0000 7f88888c6700 1 --2- 172.21.15.37:0/2312524084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88840b2270 0x7f88840c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.307+0000 7f88898c8700 1 --2- 172.21.15.37:0/2312524084 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8884159370 0x7f88840c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.307+0000 7f88890c7700 1 -- 172.21.15.37:0/2312524084 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8884159370 msgr2=0x7f88840c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.307+0000 7f88890c7700 1 --2- 172.21.15.37:0/2312524084 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8884159370 0x7f88840c9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.307+0000 7f88890c7700 1 -- 172.21.15.37:0/2312524084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88840b2270 msgr2=0x7f88840c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.307+0000 7f88890c7700 1 --2- 172.21.15.37:0/2312524084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88840b2270 0x7f88840c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.307+0000 7f88890c7700 1 -- 172.21.15.37:0/2312524084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88780094f0 con 0x7f88840aff10 2023-10-06T02:25:44.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.308+0000 7f88888c6700 1 --2- 172.21.15.37:0/2312524084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88840b2270 0x7f88840c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:44.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.308+0000 7f88890c7700 1 --2- 172.21.15.37:0/2312524084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88840aff10 0x7f888414d7a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f887400d860 tx=0x7f8874008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:44.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.308+0000 7f88817fa700 1 -- 172.21.15.37:0/2312524084 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88740125f0 con 0x7f88840aff10 2023-10-06T02:25:44.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.308+0000 7f88817fa700 1 -- 172.21.15.37:0/2312524084 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8874012750 con 0x7f88840aff10 2023-10-06T02:25:44.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.308+0000 7f888a0c9700 1 -- 172.21.15.37:0/2312524084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88840c5450 con 0x7f88840aff10 2023-10-06T02:25:44.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.308+0000 7f88817fa700 1 -- 172.21.15.37:0/2312524084 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874012b10 con 0x7f88840aff10 2023-10-06T02:25:44.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.308+0000 7f888a0c9700 1 -- 172.21.15.37:0/2312524084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f888414dce0 con 0x7f88840aff10 2023-10-06T02:25:44.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.309+0000 7f888a0c9700 1 -- 172.21.15.37:0/2312524084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8884064b00 con 0x7f88840aff10 2023-10-06T02:25:44.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.309+0000 7f88817fa700 1 -- 172.21.15.37:0/2312524084 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f887401e460 con 0x7f88840aff10 2023-10-06T02:25:44.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.310+0000 7f88817fa700 1 --2- 172.21.15.37:0/2312524084 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8870066f30 0x7f88700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.310+0000 7f88817fa700 1 -- 172.21.15.37:0/2312524084 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8874084a00 con 0x7f88840aff10 2023-10-06T02:25:44.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.310+0000 7f88888c6700 1 --2- 172.21.15.37:0/2312524084 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8870066f30 0x7f88700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.310+0000 7f88888c6700 1 --2- 172.21.15.37:0/2312524084 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8870066f30 0x7f88700693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f88840d13a0 tx=0x7f8878016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:44.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.314+0000 7f88817fa700 1 -- 172.21.15.37:0/2312524084 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88740558f0 con 0x7f88840aff10 2023-10-06T02:25:44.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.509+0000 7f888a0c9700 1 -- 172.21.15.37:0/2312524084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88840b2750 con 0x7f88840aff10 2023-10-06T02:25:44.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.509+0000 7f88817fa700 1 -- 172.21.15.37:0/2312524084 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+13650 (secure 0 0 0) 0x7f8874055480 con 0x7f88840aff10 2023-10-06T02:25:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:44.510 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":53,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:25:43.739652+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:25:44.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.511+0000 7f888a0c9700 1 -- 172.21.15.37:0/2312524084 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8870066f30 msgr2=0x7f88700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.511+0000 7f888a0c9700 1 --2- 172.21.15.37:0/2312524084 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8870066f30 0x7f88700693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f88840d13a0 tx=0x7f8878016000 comp rx=0 tx=0).stop 2023-10-06T02:25:44.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.511+0000 7f888a0c9700 1 -- 172.21.15.37:0/2312524084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88840aff10 msgr2=0x7f888414d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.511+0000 7f888a0c9700 1 --2- 172.21.15.37:0/2312524084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88840aff10 0x7f888414d7a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f887400d860 tx=0x7f8874008040 comp rx=0 tx=0).stop 2023-10-06T02:25:44.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.511+0000 7f888a0c9700 1 -- 172.21.15.37:0/2312524084 shutdown_connections 2023-10-06T02:25:44.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.511+0000 7f888a0c9700 1 --2- 172.21.15.37:0/2312524084 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8884159370 0x7f88840c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.511+0000 7f888a0c9700 1 --2- 172.21.15.37:0/2312524084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88840aff10 0x7f888414d7a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.511+0000 7f888a0c9700 1 --2- 172.21.15.37:0/2312524084 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8870066f30 0x7f88700693e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.511+0000 7f888a0c9700 1 --2- 172.21.15.37:0/2312524084 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88840b2270 0x7f88840c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.511+0000 7f888a0c9700 1 -- 172.21.15.37:0/2312524084 >> 172.21.15.37:0/2312524084 conn(0x7f888406c0b0 msgr2=0x7f88840cd270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:44.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.512+0000 7f888a0c9700 1 -- 172.21.15.37:0/2312524084 shutdown_connections 2023-10-06T02:25:44.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.512+0000 7f888a0c9700 1 -- 172.21.15.37:0/2312524084 wait complete. 2023-10-06T02:25:44.524 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:23:08.066048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:23:08.561964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T02:25:44.524 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:25:44.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.646+0000 7f1b31990700 1 Processor -- start 2023-10-06T02:25:44.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.646+0000 7f1b31990700 1 -- start start 2023-10-06T02:25:44.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.647+0000 7f1b31990700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f1b2c0af4d0 0x7f1b2c0b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.647+0000 7f1b31990700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b2c0d0a50 0x7f1b2c0b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.647+0000 7f1b31990700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2c0b40a0 con 0x7f1b2c0af8a0 2023-10-06T02:25:44.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.647+0000 7f1b31990700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2c0b1a60 con 0x7f1b2c0d0a50 2023-10-06T02:25:44.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.647+0000 7f1b31990700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2c0b31b0 con 0x7f1b2c0af4d0 2023-10-06T02:25:44.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.647+0000 7f1b3118f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b2c0d0a50 0x7f1b2c0b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.647+0000 7f1b2bfff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1b2c0af8a0 0x7f1b2c0d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41772/0 (socket says 172.21.15.37:41772) 2023-10-06T02:25:44.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.647+0000 7f1b2bfff700 1 -- 172.21.15.37:0/3866995065 learned_addr learned my addr 172.21.15.37:0/3866995065 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:44.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.647+0000 7f1b3098e700 1 --2- 172.21.15.37:0/3866995065 >> v2:172.21.15.191:3300/0 conn(0x7f1b2c0af4d0 0x7f1b2c0b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.647+0000 7f1b2b7fe700 1 -- 172.21.15.37:0/3866995065 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483081962 0 0) 0x7f1b2c0b40a0 con 0x7f1b2c0af8a0 2023-10-06T02:25:44.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.647+0000 7f1b2b7fe700 1 -- 172.21.15.37:0/3866995065 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b1c003570 con 0x7f1b2c0af8a0 2023-10-06T02:25:44.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.647+0000 7f1b3118f700 1 -- 172.21.15.37:0/3866995065 >> v2:172.21.15.191:3300/0 conn(0x7f1b2c0af4d0 msgr2=0x7f1b2c0b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:44.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.647+0000 7f1b3118f700 1 --2- 172.21.15.37:0/3866995065 >> v2:172.21.15.191:3300/0 conn(0x7f1b2c0af4d0 0x7f1b2c0b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.647+0000 7f1b3118f700 1 -- 172.21.15.37:0/3866995065 >> v1:172.21.15.37:6789/0 conn(0x7f1b2c0af8a0 legacy=0x7f1b2c0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.647+0000 7f1b3118f700 1 -- 172.21.15.37:0/3866995065 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c0b3490 con 0x7f1b2c0d0a50 2023-10-06T02:25:44.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.648+0000 7f1b3118f700 1 --2- 172.21.15.37:0/3866995065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b2c0d0a50 0x7f1b2c0b29b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0b64e0 tx=0x7f1b24009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de286face8f3eed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:44.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.648+0000 7f1b2b7fe700 1 -- 172.21.15.37:0/3866995065 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2400e070 con 0x7f1b2c0d0a50 2023-10-06T02:25:44.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.648+0000 7f1b2b7fe700 1 -- 172.21.15.37:0/3866995065 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2400bab0 con 0x7f1b2c0d0a50 2023-10-06T02:25:44.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.648+0000 7f1b2b7fe700 1 -- 172.21.15.37:0/3866995065 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2400be30 con 0x7f1b2c0d0a50 2023-10-06T02:25:44.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.648+0000 7f1b31990700 1 -- 172.21.15.37:0/3866995065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b2c0d0a50 msgr2=0x7f1b2c0b29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.648+0000 7f1b31990700 1 --2- 172.21.15.37:0/3866995065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b2c0d0a50 0x7f1b2c0b29b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0b64e0 tx=0x7f1b24009780 comp rx=0 tx=0).stop 2023-10-06T02:25:44.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.648+0000 7f1b31990700 1 -- 172.21.15.37:0/3866995065 shutdown_connections 2023-10-06T02:25:44.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.648+0000 7f1b31990700 1 --2- 172.21.15.37:0/3866995065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b2c0d0a50 0x7f1b2c0b29b0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.648+0000 7f1b31990700 1 --2- 172.21.15.37:0/3866995065 >> v2:172.21.15.191:3300/0 conn(0x7f1b2c0af4d0 0x7f1b2c0b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.648+0000 7f1b31990700 1 -- 172.21.15.37:0/3866995065 >> 172.21.15.37:0/3866995065 conn(0x7f1b2c06c0b0 msgr2=0x7f1b2c06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:44.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.648+0000 7f1b31990700 1 -- 172.21.15.37:0/3866995065 shutdown_connections 2023-10-06T02:25:44.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.648+0000 7f1b31990700 1 -- 172.21.15.37:0/3866995065 wait complete. 2023-10-06T02:25:44.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.649+0000 7f1b31990700 1 Processor -- start 2023-10-06T02:25:44.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.650+0000 7f1b31990700 1 -- start start 2023-10-06T02:25:44.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.650+0000 7f1b31990700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b2c0af4d0 0x7f1b2c149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.650+0000 7f1b31990700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1b2c0af8a0 0x7f1b2c0b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.650+0000 7f1b31990700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b2c0d0a50 0x7f1b2c0b2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.650+0000 7f1b31990700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c157c90 con 0x7f1b2c0d0a50 2023-10-06T02:25:44.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.650+0000 7f1b31990700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0cd0e0 con 0x7f1b2c0af4d0 2023-10-06T02:25:44.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.650+0000 7f1b31990700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c157360 con 0x7f1b2c0af8a0 2023-10-06T02:25:44.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.651+0000 7f1b3118f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b2c0d0a50 0x7f1b2c0b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.651+0000 7f1b3118f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b2c0d0a50 0x7f1b2c0b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34058/0 (socket says 172.21.15.37:34058) 2023-10-06T02:25:44.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.651+0000 7f1b3118f700 1 -- 172.21.15.37:0/4281024052 learned_addr learned my addr 172.21.15.37:0/4281024052 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:44.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.651+0000 7f1b3098e700 1 --2- 172.21.15.37:0/4281024052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b2c0af4d0 0x7f1b2c149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.651+0000 7f1b2bfff700 1 --2- 172.21.15.37:0/4281024052 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1b2c0af8a0 0x7f1b2c0b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.651+0000 7f1b3118f700 1 -- 172.21.15.37:0/4281024052 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1b2c0af8a0 msgr2=0x7f1b2c0b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.651+0000 7f1b3118f700 1 --2- 172.21.15.37:0/4281024052 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1b2c0af8a0 0x7f1b2c0b22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.651+0000 7f1b3118f700 1 -- 172.21.15.37:0/4281024052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b2c0af4d0 msgr2=0x7f1b2c149860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.651+0000 7f1b3118f700 1 --2- 172.21.15.37:0/4281024052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b2c0af4d0 0x7f1b2c149860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.651+0000 7f1b3118f700 1 -- 172.21.15.37:0/4281024052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b24009a20 con 0x7f1b2c0d0a50 2023-10-06T02:25:44.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.651+0000 7f1b3118f700 1 --2- 172.21.15.37:0/4281024052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b2c0d0a50 0x7f1b2c0b2810 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c089290 tx=0x7f1b24019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:44.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.651+0000 7f1b28ff9700 1 -- 172.21.15.37:0/4281024052 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24012dd0 con 0x7f1b2c0d0a50 2023-10-06T02:25:44.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.651+0000 7f1b28ff9700 1 -- 172.21.15.37:0/4281024052 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b24027470 con 0x7f1b2c0d0a50 2023-10-06T02:25:44.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.651+0000 7f1b31990700 1 -- 172.21.15.37:0/4281024052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2c157640 con 0x7f1b2c0d0a50 2023-10-06T02:25:44.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.651+0000 7f1b28ff9700 1 -- 172.21.15.37:0/4281024052 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24027830 con 0x7f1b2c0d0a50 2023-10-06T02:25:44.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.651+0000 7f1b31990700 1 -- 172.21.15.37:0/4281024052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2c149da0 con 0x7f1b2c0d0a50 2023-10-06T02:25:44.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.652+0000 7f1b31990700 1 -- 172.21.15.37:0/4281024052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2c15ceb0 con 0x7f1b2c0d0a50 2023-10-06T02:25:44.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.653+0000 7f1b28ff9700 1 -- 172.21.15.37:0/4281024052 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b24024070 con 0x7f1b2c0d0a50 2023-10-06T02:25:44.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.653+0000 7f1b28ff9700 1 --2- 172.21.15.37:0/4281024052 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1b10066f30 0x7f1b100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.653+0000 7f1b28ff9700 1 -- 172.21.15.37:0/4281024052 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1b24086cf0 con 0x7f1b2c0d0a50 2023-10-06T02:25:44.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.653+0000 7f1b3098e700 1 --2- 172.21.15.37:0/4281024052 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1b10066f30 0x7f1b100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.654+0000 7f1b3098e700 1 --2- 172.21.15.37:0/4281024052 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1b10066f30 0x7f1b100693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1b20009db0 tx=0x7f1b200091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:44.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.657+0000 7f1b28ff9700 1 -- 172.21.15.37:0/4281024052 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b2408b070 con 0x7f1b2c0d0a50 2023-10-06T02:25:44.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.847+0000 7f1b31990700 1 -- 172.21.15.37:0/4281024052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1b2c064b00 con 0x7f1b2c0d0a50 2023-10-06T02:25:44.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.848+0000 7f1b28ff9700 1 -- 172.21.15.37:0/4281024052 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v53) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1b24054150 con 0x7f1b2c0d0a50 2023-10-06T02:25:44.848 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T02:25:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.850+0000 7f1b31990700 1 -- 172.21.15.37:0/4281024052 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1b10066f30 msgr2=0x7f1b100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.850+0000 7f1b31990700 1 --2- 172.21.15.37:0/4281024052 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1b10066f30 0x7f1b100693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1b20009db0 tx=0x7f1b200091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.850+0000 7f1b31990700 1 -- 172.21.15.37:0/4281024052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b2c0d0a50 msgr2=0x7f1b2c0b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.850+0000 7f1b31990700 1 --2- 172.21.15.37:0/4281024052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b2c0d0a50 0x7f1b2c0b2810 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c089290 tx=0x7f1b24019000 comp rx=0 tx=0).stop 2023-10-06T02:25:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.850+0000 7f1b31990700 1 -- 172.21.15.37:0/4281024052 shutdown_connections 2023-10-06T02:25:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.850+0000 7f1b31990700 1 --2- 172.21.15.37:0/4281024052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b2c0d0a50 0x7f1b2c0b2810 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.850+0000 7f1b31990700 1 --2- 172.21.15.37:0/4281024052 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1b10066f30 0x7f1b100693e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.850+0000 7f1b31990700 1 --2- 172.21.15.37:0/4281024052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b2c0af4d0 0x7f1b2c149860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.850+0000 7f1b31990700 1 --2- 172.21.15.37:0/4281024052 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1b2c0af8a0 0x7f1b2c0b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.850+0000 7f1b31990700 1 -- 172.21.15.37:0/4281024052 >> 172.21.15.37:0/4281024052 conn(0x7f1b2c06c0b0 msgr2=0x7f1b2c15c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:44.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.850+0000 7f1b31990700 1 -- 172.21.15.37:0/4281024052 shutdown_connections 2023-10-06T02:25:44.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.850+0000 7f1b31990700 1 -- 172.21.15.37:0/4281024052 wait complete. 2023-10-06T02:25:44.862 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:25:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.983+0000 7f663c228700 1 Processor -- start 2023-10-06T02:25:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.984+0000 7f663c228700 1 -- start start 2023-10-06T02:25:44.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f663c228700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f66340b1ca0 0x7f6634164560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f663c228700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663415e070 con 0x7f6634150380 2023-10-06T02:25:44.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f663c228700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663415d1c0 con 0x7f6634150750 2023-10-06T02:25:44.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f663c228700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663415d460 con 0x7f66340b1ca0 2023-10-06T02:25:44.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f6639fc4700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6634150380 0x7f66340b3c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41786/0 (socket says 172.21.15.37:41786) 2023-10-06T02:25:44.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f6639fc4700 1 -- 172.21.15.37:0/949416403 learned_addr learned my addr 172.21.15.37:0/949416403 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:44.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f663a7c5700 1 --2- 172.21.15.37:0/949416403 >> v2:172.21.15.191:3300/0 conn(0x7f66340b1ca0 0x7f6634164560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f6638fc2700 1 -- 172.21.15.37:0/949416403 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952462090 0 0) 0x7f663415e070 con 0x7f6634150380 2023-10-06T02:25:44.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f6638fc2700 1 -- 172.21.15.37:0/949416403 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6620003570 con 0x7f6634150380 2023-10-06T02:25:44.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f6638fc2700 1 -- 172.21.15.37:0/949416403 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 576072670 0 0) 0x7f6620003570 con 0x7f6634150380 2023-10-06T02:25:44.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f6638fc2700 1 -- 172.21.15.37:0/949416403 >> v2:172.21.15.191:3300/0 conn(0x7f66340b1ca0 msgr2=0x7f6634164560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:44.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f6638fc2700 1 --2- 172.21.15.37:0/949416403 >> v2:172.21.15.191:3300/0 conn(0x7f66340b1ca0 0x7f6634164560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f6638fc2700 1 -- 172.21.15.37:0/949416403 >> v1:172.21.15.191:6789/0 conn(0x7f6634150750 legacy=0x7f66340b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f6638fc2700 1 -- 172.21.15.37:0/949416403 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663415d740 con 0x7f6634150380 2023-10-06T02:25:44.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f6638fc2700 1 -- 172.21.15.37:0/949416403 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f6630001470 con 0x7f6634150380 2023-10-06T02:25:44.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f6638fc2700 1 -- 172.21.15.37:0/949416403 >> v1:172.21.15.37:6789/0 conn(0x7f6634150380 legacy=0x7f66340b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f6638fc2700 1 --2- 172.21.15.37:0/949416403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6620003a60 0x7f6620003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f6638fc2700 1 --2- 172.21.15.37:0/949416403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6620004810 0x7f6620004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f6638fc2700 1 --2- 172.21.15.37:0/949416403 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f66200051c0 0x7f662000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f6638fc2700 1 -- 172.21.15.37:0/949416403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663415d460 con 0x7f6620003a60 2023-10-06T02:25:44.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f6638fc2700 1 -- 172.21.15.37:0/949416403 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662000c160 con 0x7f6620004810 2023-10-06T02:25:44.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f6638fc2700 1 -- 172.21.15.37:0/949416403 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662000c320 con 0x7f66200051c0 2023-10-06T02:25:44.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.985+0000 7f6639fc4700 1 --2- 172.21.15.37:0/949416403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6620003a60 0x7f6620003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.986+0000 7f66397c3700 1 --2- 172.21.15.37:0/949416403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6620004810 0x7f6620004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.986+0000 7f663a7c5700 1 --2- 172.21.15.37:0/949416403 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f66200051c0 0x7f662000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.986+0000 7f6639fc4700 1 -- 172.21.15.37:0/949416403 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f66200051c0 msgr2=0x7f662000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:44.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.986+0000 7f6639fc4700 1 --2- 172.21.15.37:0/949416403 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f66200051c0 0x7f662000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.986+0000 7f6639fc4700 1 -- 172.21.15.37:0/949416403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6620004810 msgr2=0x7f6620004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:44.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.986+0000 7f6639fc4700 1 --2- 172.21.15.37:0/949416403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6620004810 0x7f6620004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.986+0000 7f6639fc4700 1 -- 172.21.15.37:0/949416403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6620003570 con 0x7f6620003a60 2023-10-06T02:25:44.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.986+0000 7f66397c3700 1 --2- 172.21.15.37:0/949416403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6620004810 0x7f6620004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:44.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.986+0000 7f663a7c5700 1 -- 172.21.15.37:0/949416403 reap_dead start 2023-10-06T02:25:44.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.986+0000 7f6639fc4700 1 --2- 172.21.15.37:0/949416403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6620003a60 0x7f6620003e70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f663000c3c0 tx=0x7f6630001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b627873ae4e064 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:44.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.986+0000 7f6638fc2700 1 -- 172.21.15.37:0/949416403 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663000cc90 con 0x7f6620003a60 2023-10-06T02:25:44.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.986+0000 7f6638fc2700 1 -- 172.21.15.37:0/949416403 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663000cdf0 con 0x7f6620003a60 2023-10-06T02:25:44.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.986+0000 7f6638fc2700 1 -- 172.21.15.37:0/949416403 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6630005b50 con 0x7f6620003a60 2023-10-06T02:25:44.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.986+0000 7f663c228700 1 -- 172.21.15.37:0/949416403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6620003a60 msgr2=0x7f6620003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.986+0000 7f663c228700 1 --2- 172.21.15.37:0/949416403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6620003a60 0x7f6620003e70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f663000c3c0 tx=0x7f6630001e50 comp rx=0 tx=0).stop 2023-10-06T02:25:44.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.987+0000 7f663c228700 1 -- 172.21.15.37:0/949416403 shutdown_connections 2023-10-06T02:25:44.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.987+0000 7f663c228700 1 --2- 172.21.15.37:0/949416403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6620003a60 0x7f6620003e70 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.987+0000 7f663c228700 1 -- 172.21.15.37:0/949416403 >> 172.21.15.37:0/949416403 conn(0x7f663406c0b0 msgr2=0x7f663406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:44.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.987+0000 7f663c228700 1 -- 172.21.15.37:0/949416403 shutdown_connections 2023-10-06T02:25:44.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.987+0000 7f663c228700 1 -- 172.21.15.37:0/949416403 wait complete. 2023-10-06T02:25:44.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.988+0000 7f663c228700 1 Processor -- start 2023-10-06T02:25:44.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.988+0000 7f663c228700 1 -- start start 2023-10-06T02:25:44.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.988+0000 7f663c228700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6620003a60 0x7f6634171870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.988+0000 7f663c228700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66340cac30 0x7f66340cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.988+0000 7f663c228700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66340cbe90 0x7f663416ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.989+0000 7f663c228700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663416e270 con 0x7f66340cac30 2023-10-06T02:25:44.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.989+0000 7f663c228700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66341720a0 con 0x7f66340cbe90 2023-10-06T02:25:44.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.989+0000 7f663c228700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6634172380 con 0x7f6620003a60 2023-10-06T02:25:44.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.989+0000 7f66397c3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66340cac30 0x7f66340cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.989+0000 7f66397c3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66340cac30 0x7f66340cb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34076/0 (socket says 172.21.15.37:34076) 2023-10-06T02:25:44.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.989+0000 7f66397c3700 1 -- 172.21.15.37:0/3333823589 learned_addr learned my addr 172.21.15.37:0/3333823589 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:44.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.989+0000 7f6639fc4700 1 --2- 172.21.15.37:0/3333823589 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6620003a60 0x7f6634171870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.989+0000 7f663a7c5700 1 --2- 172.21.15.37:0/3333823589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66340cbe90 0x7f663416ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.989+0000 7f66397c3700 1 -- 172.21.15.37:0/3333823589 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6620003a60 msgr2=0x7f6634171870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.989+0000 7f66397c3700 1 --2- 172.21.15.37:0/3333823589 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6620003a60 0x7f6634171870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.989+0000 7f66397c3700 1 -- 172.21.15.37:0/3333823589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66340cbe90 msgr2=0x7f663416ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:44.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.989+0000 7f66397c3700 1 --2- 172.21.15.37:0/3333823589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66340cbe90 0x7f663416ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:44.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.989+0000 7f66397c3700 1 -- 172.21.15.37:0/3333823589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6634172660 con 0x7f66340cac30 2023-10-06T02:25:44.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.989+0000 7f66397c3700 1 --2- 172.21.15.37:0/3333823589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66340cac30 0x7f66340cb950 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f662400e840 tx=0x7f6624009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:44.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.989+0000 7f6629ffb700 1 -- 172.21.15.37:0/3333823589 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6624017070 con 0x7f66340cac30 2023-10-06T02:25:44.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.989+0000 7f6629ffb700 1 -- 172.21.15.37:0/3333823589 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6624006820 con 0x7f66340cac30 2023-10-06T02:25:44.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.989+0000 7f6629ffb700 1 -- 172.21.15.37:0/3333823589 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6624006be0 con 0x7f66340cac30 2023-10-06T02:25:44.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.989+0000 7f663c228700 1 -- 172.21.15.37:0/3333823589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663416e530 con 0x7f66340cac30 2023-10-06T02:25:44.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.989+0000 7f663c228700 1 -- 172.21.15.37:0/3333823589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663416ef90 con 0x7f66340cac30 2023-10-06T02:25:44.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.990+0000 7f663c228700 1 -- 172.21.15.37:0/3333823589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663416e8a0 con 0x7f66340cac30 2023-10-06T02:25:44.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.991+0000 7f6629ffb700 1 -- 172.21.15.37:0/3333823589 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6624006d40 con 0x7f66340cac30 2023-10-06T02:25:44.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.991+0000 7f6629ffb700 1 --2- 172.21.15.37:0/3333823589 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6618066f30 0x7f66180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:44.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.991+0000 7f6629ffb700 1 -- 172.21.15.37:0/3333823589 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6624083ef0 con 0x7f66340cac30 2023-10-06T02:25:44.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.991+0000 7f6639fc4700 1 --2- 172.21.15.37:0/3333823589 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6618066f30 0x7f66180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:44.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.992+0000 7f6639fc4700 1 --2- 172.21.15.37:0/3333823589 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6618066f30 0x7f66180693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f66341538a0 tx=0x7f6630015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:44.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:44.996+0000 7f6629ffb700 1 -- 172.21.15.37:0/3333823589 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6624051350 con 0x7f66340cac30 2023-10-06T02:25:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.188+0000 7f663c228700 1 -- 172.21.15.37:0/3333823589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f663415da20 con 0x7f66340cac30 2023-10-06T02:25:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.188+0000 7f6629ffb700 1 -- 172.21.15.37:0/3333823589 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6624054970 con 0x7f66340cac30 2023-10-06T02:25:45.189 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T02:25:45.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.190+0000 7f663c228700 1 -- 172.21.15.37:0/3333823589 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6618066f30 msgr2=0x7f66180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:45.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.190+0000 7f663c228700 1 --2- 172.21.15.37:0/3333823589 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6618066f30 0x7f66180693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f66341538a0 tx=0x7f6630015000 comp rx=0 tx=0).stop 2023-10-06T02:25:45.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.190+0000 7f663c228700 1 -- 172.21.15.37:0/3333823589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66340cac30 msgr2=0x7f66340cb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:45.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.190+0000 7f663c228700 1 --2- 172.21.15.37:0/3333823589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66340cac30 0x7f66340cb950 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f662400e840 tx=0x7f6624009040 comp rx=0 tx=0).stop 2023-10-06T02:25:45.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.190+0000 7f663c228700 1 -- 172.21.15.37:0/3333823589 shutdown_connections 2023-10-06T02:25:45.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.190+0000 7f663c228700 1 --2- 172.21.15.37:0/3333823589 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6618066f30 0x7f66180693e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.190+0000 7f663c228700 1 --2- 172.21.15.37:0/3333823589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66340cbe90 0x7f663416ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.190+0000 7f663c228700 1 --2- 172.21.15.37:0/3333823589 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6620003a60 0x7f6634171870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.190+0000 7f663c228700 1 --2- 172.21.15.37:0/3333823589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66340cac30 0x7f66340cb950 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.190+0000 7f663c228700 1 -- 172.21.15.37:0/3333823589 >> 172.21.15.37:0/3333823589 conn(0x7f663406c0b0 msgr2=0x7f663415c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:45.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.190+0000 7f663c228700 1 -- 172.21.15.37:0/3333823589 shutdown_connections 2023-10-06T02:25:45.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.190+0000 7f663c228700 1 -- 172.21.15.37:0/3333823589 wait complete. 2023-10-06T02:25:45.203 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:25:45.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.320+0000 7f836413b700 1 Processor -- start 2023-10-06T02:25:45.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.320+0000 7f836413b700 1 -- start start 2023-10-06T02:25:45.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.321+0000 7f836413b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f835c159760 0x7f835c15d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:45.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.321+0000 7f836413b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f835c15d8d0 0x7f835c15dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:45.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.321+0000 7f836413b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f835c0c5390 0x7f835c0c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:45.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.321+0000 7f836413b700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f835c0cc2d0 con 0x7f835c0c5390 2023-10-06T02:25:45.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.321+0000 7f836413b700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f835c15e260 con 0x7f835c15d8d0 2023-10-06T02:25:45.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.321+0000 7f836413b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835c0cb650 con 0x7f835c159760 2023-10-06T02:25:45.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.321+0000 7f83626d8700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f835c0c5390 0x7f835c0c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:45.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.321+0000 7f83626d8700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f835c0c5390 0x7f835c0c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49508/0 (socket says 172.21.15.37:49508) 2023-10-06T02:25:45.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.321+0000 7f83626d8700 1 -- 172.21.15.37:0/491692360 learned_addr learned my addr 172.21.15.37:0/491692360 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:45.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.322+0000 7f83616d6700 1 --2- 172.21.15.37:0/491692360 >> v2:172.21.15.191:3300/0 conn(0x7f835c15d8d0 0x7f835c15dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:45.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.322+0000 7f8361ed7700 1 --2- 172.21.15.37:0/491692360 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f835c159760 0x7f835c15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:45.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.322+0000 7f83626d8700 1 -- 172.21.15.37:0/491692360 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f835c159760 msgr2=0x7f835c15d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:45.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.322+0000 7f83626d8700 1 --2- 172.21.15.37:0/491692360 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f835c159760 0x7f835c15d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.322+0000 7f83626d8700 1 -- 172.21.15.37:0/491692360 >> v2:172.21.15.191:3300/0 conn(0x7f835c15d8d0 msgr2=0x7f835c15dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:45.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.322+0000 7f83626d8700 1 --2- 172.21.15.37:0/491692360 >> v2:172.21.15.191:3300/0 conn(0x7f835c15d8d0 0x7f835c15dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.322+0000 7f83626d8700 1 -- 172.21.15.37:0/491692360 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c0cb930 con 0x7f835c0c5390 2023-10-06T02:25:45.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.322+0000 7f83626d8700 1 --2- 172.21.15.37:0/491692360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0c5390 0x7f835c0c5810 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f835c089400 tx=0x7f8354009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ded477f922f988a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:45.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.322+0000 7f8360ed5700 1 -- 172.21.15.37:0/491692360 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835400b8f0 con 0x7f835c0c5390 2023-10-06T02:25:45.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.322+0000 7f8360ed5700 1 -- 172.21.15.37:0/491692360 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835400ba50 con 0x7f835c0c5390 2023-10-06T02:25:45.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.322+0000 7f8360ed5700 1 -- 172.21.15.37:0/491692360 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835400bdf0 con 0x7f835c0c5390 2023-10-06T02:25:45.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.323+0000 7f836413b700 1 -- 172.21.15.37:0/491692360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0c5390 msgr2=0x7f835c0c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:45.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.323+0000 7f836413b700 1 --2- 172.21.15.37:0/491692360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0c5390 0x7f835c0c5810 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f835c089400 tx=0x7f8354009250 comp rx=0 tx=0).stop 2023-10-06T02:25:45.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.323+0000 7f836413b700 1 -- 172.21.15.37:0/491692360 shutdown_connections 2023-10-06T02:25:45.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.323+0000 7f836413b700 1 --2- 172.21.15.37:0/491692360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0c5390 0x7f835c0c5810 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.323+0000 7f836413b700 1 --2- 172.21.15.37:0/491692360 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f835c159760 0x7f835c15d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.323+0000 7f836413b700 1 --2- 172.21.15.37:0/491692360 >> v2:172.21.15.191:3300/0 conn(0x7f835c15d8d0 0x7f835c15dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.323+0000 7f836413b700 1 -- 172.21.15.37:0/491692360 >> 172.21.15.37:0/491692360 conn(0x7f835c06c890 msgr2=0x7f835c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:45.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.323+0000 7f836413b700 1 -- 172.21.15.37:0/491692360 shutdown_connections 2023-10-06T02:25:45.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.323+0000 7f836413b700 1 -- 172.21.15.37:0/491692360 wait complete. 2023-10-06T02:25:45.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.324+0000 7f836413b700 1 Processor -- start 2023-10-06T02:25:45.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.324+0000 7f836413b700 1 -- start start 2023-10-06T02:25:45.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f836413b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0c5390 0x7f835c14a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:45.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f836413b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f835c159760 0x7f835c14d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:45.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f836413b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f835c15d8d0 0x7f835c0c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:45.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f836413b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c0b41f0 con 0x7f835c0c5390 2023-10-06T02:25:45.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f836413b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c16d1c0 con 0x7f835c15d8d0 2023-10-06T02:25:45.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f836413b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835c16d4a0 con 0x7f835c159760 2023-10-06T02:25:45.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f8361ed7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0c5390 0x7f835c14a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:45.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f8361ed7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0c5390 0x7f835c14a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49510/0 (socket says 172.21.15.37:49510) 2023-10-06T02:25:45.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f8361ed7700 1 -- 172.21.15.37:0/1935631795 learned_addr learned my addr 172.21.15.37:0/1935631795 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:45.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f83616d6700 1 --2- 172.21.15.37:0/1935631795 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f835c159760 0x7f835c14d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:45.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f83626d8700 1 --2- 172.21.15.37:0/1935631795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f835c15d8d0 0x7f835c0c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:45.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f8361ed7700 1 -- 172.21.15.37:0/1935631795 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f835c159760 msgr2=0x7f835c14d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:45.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f8361ed7700 1 --2- 172.21.15.37:0/1935631795 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f835c159760 0x7f835c14d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f8361ed7700 1 -- 172.21.15.37:0/1935631795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f835c15d8d0 msgr2=0x7f835c0c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:45.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f8361ed7700 1 --2- 172.21.15.37:0/1935631795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f835c15d8d0 0x7f835c0c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f8361ed7700 1 -- 172.21.15.37:0/1935631795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83540094f0 con 0x7f835c0c5390 2023-10-06T02:25:45.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f8361ed7700 1 --2- 172.21.15.37:0/1935631795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0c5390 0x7f835c14a010 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f834c00e190 tx=0x7f834c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:45.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f8359ffb700 1 -- 172.21.15.37:0/1935631795 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c00ec70 con 0x7f835c0c5390 2023-10-06T02:25:45.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f8359ffb700 1 -- 172.21.15.37:0/1935631795 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c00edf0 con 0x7f835c0c5390 2023-10-06T02:25:45.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f836413b700 1 -- 172.21.15.37:0/1935631795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f835c16d780 con 0x7f835c0c5390 2023-10-06T02:25:45.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.325+0000 7f8359ffb700 1 -- 172.21.15.37:0/1935631795 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c014670 con 0x7f835c0c5390 2023-10-06T02:25:45.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.326+0000 7f836413b700 1 -- 172.21.15.37:0/1935631795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f835c16dd40 con 0x7f835c0c5390 2023-10-06T02:25:45.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.326+0000 7f836413b700 1 -- 172.21.15.37:0/1935631795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f835c06fbf0 con 0x7f835c0c5390 2023-10-06T02:25:45.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.327+0000 7f8359ffb700 1 -- 172.21.15.37:0/1935631795 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f834c0149e0 con 0x7f835c0c5390 2023-10-06T02:25:45.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.327+0000 7f8359ffb700 1 --2- 172.21.15.37:0/1935631795 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8348066f30 0x7f83480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:45.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.327+0000 7f8359ffb700 1 -- 172.21.15.37:0/1935631795 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f834c084a50 con 0x7f835c0c5390 2023-10-06T02:25:45.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.328+0000 7f83616d6700 1 --2- 172.21.15.37:0/1935631795 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8348066f30 0x7f83480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:45.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.328+0000 7f83616d6700 1 --2- 172.21.15.37:0/1935631795 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8348066f30 0x7f83480693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f835c0cfdf0 tx=0x7f8350008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:45.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.332+0000 7f8359ffb700 1 -- 172.21.15.37:0/1935631795 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f834c051eb0 con 0x7f835c0c5390 2023-10-06T02:25:45.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.529+0000 7f836413b700 1 -- 172.21.15.37:0/1935631795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f835c0b6330 con 0x7f835c0c5390 2023-10-06T02:25:45.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.529+0000 7f8359ffb700 1 -- 172.21.15.37:0/1935631795 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v53) v1 ==== 84+0+126 (secure 0 0 0) 0x7f834c0554d0 con 0x7f835c0c5390 2023-10-06T02:25:45.529 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:45.530 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-10-06T02:25:45.530 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:45.530 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-10-06T02:25:45.530 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-10-06T02:25:45.530 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:25:45.530 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:25:45.530 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-10-06T02:25:45.530 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-10-06T02:25:45.530 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:25:45.530 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-10-06T02:25:45.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.531+0000 7f836413b700 1 -- 172.21.15.37:0/1935631795 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8348066f30 msgr2=0x7f83480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:45.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.531+0000 7f836413b700 1 --2- 172.21.15.37:0/1935631795 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8348066f30 0x7f83480693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f835c0cfdf0 tx=0x7f8350008040 comp rx=0 tx=0).stop 2023-10-06T02:25:45.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.531+0000 7f836413b700 1 -- 172.21.15.37:0/1935631795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0c5390 msgr2=0x7f835c14a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:45.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.531+0000 7f836413b700 1 --2- 172.21.15.37:0/1935631795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0c5390 0x7f835c14a010 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f834c00e190 tx=0x7f834c009900 comp rx=0 tx=0).stop 2023-10-06T02:25:45.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.531+0000 7f836413b700 1 -- 172.21.15.37:0/1935631795 shutdown_connections 2023-10-06T02:25:45.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.531+0000 7f836413b700 1 --2- 172.21.15.37:0/1935631795 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8348066f30 0x7f83480693e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.531+0000 7f836413b700 1 --2- 172.21.15.37:0/1935631795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f835c15d8d0 0x7f835c0c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.531+0000 7f836413b700 1 --2- 172.21.15.37:0/1935631795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0c5390 0x7f835c14a010 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.531+0000 7f836413b700 1 --2- 172.21.15.37:0/1935631795 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f835c159760 0x7f835c14d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.531+0000 7f836413b700 1 -- 172.21.15.37:0/1935631795 >> 172.21.15.37:0/1935631795 conn(0x7f835c06c890 msgr2=0x7f835c0cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:45.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.531+0000 7f836413b700 1 -- 172.21.15.37:0/1935631795 shutdown_connections 2023-10-06T02:25:45.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.531+0000 7f836413b700 1 -- 172.21.15.37:0/1935631795 wait complete. 2023-10-06T02:25:45.543 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:25:45.544 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:25:45.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.666+0000 7fd9c4418700 1 Processor -- start 2023-10-06T02:25:45.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.666+0000 7fd9c4418700 1 -- start start 2023-10-06T02:25:45.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.667+0000 7fd9c4418700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9bc159550 0x7fd9bc159920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:45.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.667+0000 7fd9c4418700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd9bc0b24d0 0x7fd9bc15ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:45.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.667+0000 7fd9c4418700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9bc15e300 con 0x7fd9bc06c0b0 2023-10-06T02:25:45.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.667+0000 7fd9c4418700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9bc0b29b0 con 0x7fd9bc0b24d0 2023-10-06T02:25:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.667+0000 7fd9c4418700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc0b2c90 con 0x7fd9bc159550 2023-10-06T02:25:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.667+0000 7fd9c19b3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd9bc0b24d0 0x7fd9bc15ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.667+0000 7fd9c29b5700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd9bc06c0b0 0x7fd9bc06c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42158/0 (socket says 172.21.15.37:42158) 2023-10-06T02:25:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.667+0000 7fd9c29b5700 1 -- 172.21.15.37:0/2607387649 learned_addr learned my addr 172.21.15.37:0/2607387649 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.668+0000 7fd9c21b4700 1 --2- 172.21.15.37:0/2607387649 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9bc159550 0x7fd9bc159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.668+0000 7fd9c11b2700 1 -- 172.21.15.37:0/2607387649 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2420508431 0 0) 0x7fd9bc15e300 con 0x7fd9bc06c0b0 2023-10-06T02:25:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.668+0000 7fd9c11b2700 1 -- 172.21.15.37:0/2607387649 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9a4003570 con 0x7fd9bc06c0b0 2023-10-06T02:25:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.668+0000 7fd9c19b3700 1 -- 172.21.15.37:0/2607387649 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9bc159550 msgr2=0x7fd9bc159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.668+0000 7fd9c19b3700 1 --2- 172.21.15.37:0/2607387649 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9bc159550 0x7fd9bc159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.668+0000 7fd9c19b3700 1 -- 172.21.15.37:0/2607387649 >> v1:172.21.15.37:6789/0 conn(0x7fd9bc06c0b0 legacy=0x7fd9bc06c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.668+0000 7fd9c19b3700 1 -- 172.21.15.37:0/2607387649 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9bc0cb620 con 0x7fd9bc0b24d0 2023-10-06T02:25:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.668+0000 7fd9c21b4700 1 --2- 172.21.15.37:0/2607387649 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9bc159550 0x7fd9bc159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.668+0000 7fd9c19b3700 1 --2- 172.21.15.37:0/2607387649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9bc0b24d0 0x7fd9bc15ddc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00098e0 tx=0x7fd9b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595ceb11e1278b77 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.668+0000 7fd9c11b2700 1 -- 172.21.15.37:0/2607387649 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b000b640 con 0x7fd9bc0b24d0 2023-10-06T02:25:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.668+0000 7fd9c11b2700 1 -- 172.21.15.37:0/2607387649 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b000b7a0 con 0x7fd9bc0b24d0 2023-10-06T02:25:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.668+0000 7fd9c11b2700 1 -- 172.21.15.37:0/2607387649 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b000bb20 con 0x7fd9bc0b24d0 2023-10-06T02:25:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.669+0000 7fd9c4418700 1 -- 172.21.15.37:0/2607387649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9bc0b24d0 msgr2=0x7fd9bc15ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.669+0000 7fd9c4418700 1 --2- 172.21.15.37:0/2607387649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9bc0b24d0 0x7fd9bc15ddc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00098e0 tx=0x7fd9b00091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.669+0000 7fd9c4418700 1 -- 172.21.15.37:0/2607387649 shutdown_connections 2023-10-06T02:25:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.669+0000 7fd9c4418700 1 --2- 172.21.15.37:0/2607387649 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9bc159550 0x7fd9bc159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.669+0000 7fd9c4418700 1 --2- 172.21.15.37:0/2607387649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9bc0b24d0 0x7fd9bc15ddc0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.669+0000 7fd9c4418700 1 -- 172.21.15.37:0/2607387649 >> 172.21.15.37:0/2607387649 conn(0x7fd9bc06d900 msgr2=0x7fd9bc06dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.669+0000 7fd9c4418700 1 -- 172.21.15.37:0/2607387649 shutdown_connections 2023-10-06T02:25:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.669+0000 7fd9c4418700 1 -- 172.21.15.37:0/2607387649 wait complete. 2023-10-06T02:25:45.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.670+0000 7fd9c4418700 1 Processor -- start 2023-10-06T02:25:45.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.670+0000 7fd9c4418700 1 -- start start 2023-10-06T02:25:45.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9c4418700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9bc06c0b0 0x7fd9bc16a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:45.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9c4418700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9bc0b24d0 0x7fd9bc16ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:45.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9c4418700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9bc159550 0x7fd9bc169170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:45.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9c4418700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc16a920 con 0x7fd9bc159550 2023-10-06T02:25:45.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9c4418700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc15a5d0 con 0x7fd9bc0b24d0 2023-10-06T02:25:45.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9c4418700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc1599c0 con 0x7fd9bc06c0b0 2023-10-06T02:25:45.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9c29b5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9bc159550 0x7fd9bc169170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:45.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9c29b5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9bc159550 0x7fd9bc169170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49524/0 (socket says 172.21.15.37:49524) 2023-10-06T02:25:45.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9c29b5700 1 -- 172.21.15.37:0/592523757 learned_addr learned my addr 172.21.15.37:0/592523757 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:45.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9c21b4700 1 --2- 172.21.15.37:0/592523757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9bc06c0b0 0x7fd9bc16a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:45.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9c19b3700 1 --2- 172.21.15.37:0/592523757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9bc0b24d0 0x7fd9bc16ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:45.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9c29b5700 1 -- 172.21.15.37:0/592523757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9bc06c0b0 msgr2=0x7fd9bc16a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:45.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9c29b5700 1 --2- 172.21.15.37:0/592523757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9bc06c0b0 0x7fd9bc16a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9c29b5700 1 -- 172.21.15.37:0/592523757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9bc0b24d0 msgr2=0x7fd9bc16ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:45.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9c29b5700 1 --2- 172.21.15.37:0/592523757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9bc0b24d0 0x7fd9bc16ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:45.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9c29b5700 1 -- 172.21.15.37:0/592523757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b0009420 con 0x7fd9bc159550 2023-10-06T02:25:45.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9c19b3700 1 --2- 172.21.15.37:0/592523757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9bc0b24d0 0x7fd9bc16ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:45.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9c29b5700 1 --2- 172.21.15.37:0/592523757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9bc159550 0x7fd9bc169170 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac001460 tx=0x7fd9ac001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:45.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9ba7fc700 1 -- 172.21.15.37:0/592523757 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac00a950 con 0x7fd9bc159550 2023-10-06T02:25:45.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9ba7fc700 1 -- 172.21.15.37:0/592523757 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ac00aab0 con 0x7fd9bc159550 2023-10-06T02:25:45.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9c4418700 1 -- 172.21.15.37:0/592523757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9bc159ca0 con 0x7fd9bc159550 2023-10-06T02:25:45.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9ba7fc700 1 -- 172.21.15.37:0/592523757 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac00ae30 con 0x7fd9bc159550 2023-10-06T02:25:45.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.671+0000 7fd9c4418700 1 -- 172.21.15.37:0/592523757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9bc15a260 con 0x7fd9bc159550 2023-10-06T02:25:45.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.672+0000 7fd9c4418700 1 -- 172.21.15.37:0/592523757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9bc088b20 con 0x7fd9bc159550 2023-10-06T02:25:45.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.673+0000 7fd9ba7fc700 1 -- 172.21.15.37:0/592523757 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9ac007300 con 0x7fd9bc159550 2023-10-06T02:25:45.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.673+0000 7fd9ba7fc700 1 --2- 172.21.15.37:0/592523757 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd9a8066fb0 0x7fd9a8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:45.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.673+0000 7fd9ba7fc700 1 -- 172.21.15.37:0/592523757 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd9ac084860 con 0x7fd9bc159550 2023-10-06T02:25:45.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.674+0000 7fd9c21b4700 1 --2- 172.21.15.37:0/592523757 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd9a8066fb0 0x7fd9a8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:45.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.674+0000 7fd9c21b4700 1 --2- 172.21.15.37:0/592523757 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd9a8066fb0 0x7fd9a8069460 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4006f00 tx=0x7fd9b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:45.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.678+0000 7fd9ba7fc700 1 -- 172.21.15.37:0/592523757 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9ac051c10 con 0x7fd9bc159550 2023-10-06T02:25:45.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:45.870+0000 7fd9c4418700 1 -- 172.21.15.37:0/592523757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd9bc04bb80 con 0x7fd9bc159550 2023-10-06T02:25:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.761+0000 7fd9ba7fc700 1 -- 172.21.15.37:0/592523757 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v54) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd9ac055230 con 0x7fd9bc159550 2023-10-06T02:25:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.765+0000 7fd9c4418700 1 -- 172.21.15.37:0/592523757 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd9a8066fb0 msgr2=0x7fd9a8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.765+0000 7fd9c4418700 1 --2- 172.21.15.37:0/592523757 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd9a8066fb0 0x7fd9a8069460 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4006f00 tx=0x7fd9b4008040 comp rx=0 tx=0).stop 2023-10-06T02:25:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.765+0000 7fd9c4418700 1 -- 172.21.15.37:0/592523757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9bc159550 msgr2=0x7fd9bc169170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.765+0000 7fd9c4418700 1 --2- 172.21.15.37:0/592523757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9bc159550 0x7fd9bc169170 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac001460 tx=0x7fd9ac001a40 comp rx=0 tx=0).stop 2023-10-06T02:25:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.765+0000 7fd9c4418700 1 -- 172.21.15.37:0/592523757 shutdown_connections 2023-10-06T02:25:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.765+0000 7fd9c4418700 1 --2- 172.21.15.37:0/592523757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9bc159550 0x7fd9bc169170 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.765+0000 7fd9c4418700 1 --2- 172.21.15.37:0/592523757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9bc06c0b0 0x7fd9bc16a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.765+0000 7fd9c4418700 1 --2- 172.21.15.37:0/592523757 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd9a8066fb0 0x7fd9a8069460 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.765+0000 7fd9c4418700 1 --2- 172.21.15.37:0/592523757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9bc0b24d0 0x7fd9bc16ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.765+0000 7fd9c4418700 1 -- 172.21.15.37:0/592523757 >> 172.21.15.37:0/592523757 conn(0x7fd9bc06d900 msgr2=0x7fd9bc0cfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.765+0000 7fd9c4418700 1 -- 172.21.15.37:0/592523757 shutdown_connections 2023-10-06T02:25:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.765+0000 7fd9c4418700 1 -- 172.21.15.37:0/592523757 wait complete. 2023-10-06T02:25:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-10-06T02:25:46.782 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:25:46.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.915+0000 7f199bdf2700 1 Processor -- start 2023-10-06T02:25:46.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.915+0000 7f199bdf2700 1 -- start start 2023-10-06T02:25:46.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.916+0000 7f199bdf2700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1994159790 0x7f19940cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.916+0000 7f199bdf2700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19940b07a0 con 0x7f19940b2a90 2023-10-06T02:25:46.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.916+0000 7f199bdf2700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19940cd8a0 con 0x7f19941593c0 2023-10-06T02:25:46.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.916+0000 7f199bdf2700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1994159bd0 con 0x7f1994159790 2023-10-06T02:25:46.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.916+0000 7f199a38f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1994159790 0x7f19940cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.916+0000 7f199938d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f19940b2a90 0x7f19940ccb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42172/0 (socket says 172.21.15.37:42172) 2023-10-06T02:25:46.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.916+0000 7f199938d700 1 -- 172.21.15.37:0/1581317827 learned_addr learned my addr 172.21.15.37:0/1581317827 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:46.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.917+0000 7f199a38f700 1 -- 172.21.15.37:0/1581317827 >> v1:172.21.15.191:6789/0 conn(0x7f19941593c0 legacy=0x7f19940b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:46.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.917+0000 7f199a38f700 1 -- 172.21.15.37:0/1581317827 >> v1:172.21.15.37:6789/0 conn(0x7f19940b2a90 legacy=0x7f19940ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.917+0000 7f199a38f700 1 -- 172.21.15.37:0/1581317827 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19940afe70 con 0x7f1994159790 2023-10-06T02:25:46.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.917+0000 7f1998b8c700 1 -- 172.21.15.37:0/1581317827 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926578007 0 0) 0x7f19940b07a0 con 0x7f19940b2a90 2023-10-06T02:25:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.917+0000 7f199a38f700 1 --2- 172.21.15.37:0/1581317827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1994159790 0x7f19940cd240 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f198c0098e0 tx=0x7f198c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18501b5605254373 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.917+0000 7f1998b8c700 1 -- 172.21.15.37:0/1581317827 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c009e80 con 0x7f1994159790 2023-10-06T02:25:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.917+0000 7f1998b8c700 1 -- 172.21.15.37:0/1581317827 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198c00b860 con 0x7f1994159790 2023-10-06T02:25:46.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.917+0000 7f1998b8c700 1 -- 172.21.15.37:0/1581317827 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c00bbe0 con 0x7f1994159790 2023-10-06T02:25:46.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.918+0000 7f199bdf2700 1 -- 172.21.15.37:0/1581317827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1994159790 msgr2=0x7f19940cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.918+0000 7f199bdf2700 1 --2- 172.21.15.37:0/1581317827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1994159790 0x7f19940cd240 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f198c0098e0 tx=0x7f198c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.918+0000 7f199bdf2700 1 -- 172.21.15.37:0/1581317827 shutdown_connections 2023-10-06T02:25:46.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.918+0000 7f199bdf2700 1 --2- 172.21.15.37:0/1581317827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1994159790 0x7f19940cd240 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.918+0000 7f199bdf2700 1 -- 172.21.15.37:0/1581317827 >> 172.21.15.37:0/1581317827 conn(0x7f199406c0b0 msgr2=0x7f199406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:46.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.918+0000 7f199bdf2700 1 -- 172.21.15.37:0/1581317827 shutdown_connections 2023-10-06T02:25:46.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.918+0000 7f199bdf2700 1 -- 172.21.15.37:0/1581317827 wait complete. 2023-10-06T02:25:46.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.919+0000 7f199bdf2700 1 Processor -- start 2023-10-06T02:25:46.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.919+0000 7f199bdf2700 1 -- start start 2023-10-06T02:25:46.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f199bdf2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f19940b2a90 0x7f199414aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f199bdf2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19941593c0 0x7f199415d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f199bdf2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1994159790 0x7f19940cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f199bdf2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19940c8f30 con 0x7f19941593c0 2023-10-06T02:25:46.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f199bdf2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19940c8320 con 0x7f1994159790 2023-10-06T02:25:46.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f199bdf2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19940c8600 con 0x7f19940b2a90 2023-10-06T02:25:46.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f199938d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19941593c0 0x7f199415d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f199938d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19941593c0 0x7f199415d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49536/0 (socket says 172.21.15.37:49536) 2023-10-06T02:25:46.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f199938d700 1 -- 172.21.15.37:0/4072206345 learned_addr learned my addr 172.21.15.37:0/4072206345 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:46.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f199938d700 1 -- 172.21.15.37:0/4072206345 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f19940b2a90 msgr2=0x7f199414aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f199a38f700 1 --2- 172.21.15.37:0/4072206345 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1994159790 0x7f19940cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f1999b8e700 1 --2- 172.21.15.37:0/4072206345 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f19940b2a90 0x7f199414aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f199938d700 1 --2- 172.21.15.37:0/4072206345 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f19940b2a90 0x7f199414aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f199938d700 1 -- 172.21.15.37:0/4072206345 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1994159790 msgr2=0x7f19940cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:46.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f199938d700 1 --2- 172.21.15.37:0/4072206345 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1994159790 0x7f19940cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:46.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f199938d700 1 -- 172.21.15.37:0/4072206345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c009420 con 0x7f19941593c0 2023-10-06T02:25:46.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f199a38f700 1 --2- 172.21.15.37:0/4072206345 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1994159790 0x7f19940cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:46.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f1999b8e700 1 --2- 172.21.15.37:0/4072206345 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f19940b2a90 0x7f199414aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:46.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f199938d700 1 --2- 172.21.15.37:0/4072206345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19941593c0 0x7f199415d9b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f198800c7e0 tx=0x7f1988007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:46.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f1991ffb700 1 -- 172.21.15.37:0/4072206345 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988005b30 con 0x7f19941593c0 2023-10-06T02:25:46.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f1991ffb700 1 -- 172.21.15.37:0/4072206345 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1988005c90 con 0x7f19941593c0 2023-10-06T02:25:46.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f199bdf2700 1 -- 172.21.15.37:0/4072206345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19940c88e0 con 0x7f19941593c0 2023-10-06T02:25:46.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.920+0000 7f1991ffb700 1 -- 172.21.15.37:0/4072206345 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988007300 con 0x7f19941593c0 2023-10-06T02:25:46.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.921+0000 7f199bdf2700 1 -- 172.21.15.37:0/4072206345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19940c7ef0 con 0x7f19941593c0 2023-10-06T02:25:46.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.921+0000 7f199bdf2700 1 -- 172.21.15.37:0/4072206345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19940c90e0 con 0x7f19941593c0 2023-10-06T02:25:46.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.922+0000 7f1991ffb700 1 -- 172.21.15.37:0/4072206345 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f198801b400 con 0x7f19941593c0 2023-10-06T02:25:46.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.922+0000 7f1991ffb700 1 --2- 172.21.15.37:0/4072206345 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1980066f30 0x7f19800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:46.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.922+0000 7f1991ffb700 1 -- 172.21.15.37:0/4072206345 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f1988083ff0 con 0x7f19941593c0 2023-10-06T02:25:46.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.922+0000 7f1999b8e700 1 --2- 172.21.15.37:0/4072206345 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1980066f30 0x7f19800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:46.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.923+0000 7f1999b8e700 1 --2- 172.21.15.37:0/4072206345 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1980066f30 0x7f19800693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1984007fd0 tx=0x7f1984009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:46.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:46.927+0000 7f1991ffb700 1 -- 172.21.15.37:0/4072206345 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19940c90e0 con 0x7f19941593c0 2023-10-06T02:25:47.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.120+0000 7f199bdf2700 1 -- 172.21.15.37:0/4072206345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f19940c9070 con 0x7f19941593c0 2023-10-06T02:25:47.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.765+0000 7f1991ffb700 1 -- 172.21.15.37:0/4072206345 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v55) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1988054d90 con 0x7f19941593c0 2023-10-06T02:25:47.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.771+0000 7f199bdf2700 1 -- 172.21.15.37:0/4072206345 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1980066f30 msgr2=0x7f19800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:47.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.771+0000 7f199bdf2700 1 --2- 172.21.15.37:0/4072206345 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1980066f30 0x7f19800693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1984007fd0 tx=0x7f1984009040 comp rx=0 tx=0).stop 2023-10-06T02:25:47.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.771+0000 7f199bdf2700 1 -- 172.21.15.37:0/4072206345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19941593c0 msgr2=0x7f199415d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:47.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.771+0000 7f199bdf2700 1 --2- 172.21.15.37:0/4072206345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19941593c0 0x7f199415d9b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f198800c7e0 tx=0x7f1988007df0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.771+0000 7f199bdf2700 1 -- 172.21.15.37:0/4072206345 shutdown_connections 2023-10-06T02:25:47.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.771+0000 7f199bdf2700 1 --2- 172.21.15.37:0/4072206345 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1980066f30 0x7f19800693e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.771+0000 7f199bdf2700 1 --2- 172.21.15.37:0/4072206345 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1994159790 0x7f19940cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.771+0000 7f199bdf2700 1 --2- 172.21.15.37:0/4072206345 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f19940b2a90 0x7f199414aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.771+0000 7f199bdf2700 1 --2- 172.21.15.37:0/4072206345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19941593c0 0x7f199415d9b0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.771+0000 7f199bdf2700 1 -- 172.21.15.37:0/4072206345 >> 172.21.15.37:0/4072206345 conn(0x7f199406c0b0 msgr2=0x7f19940cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:47.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.772+0000 7f199bdf2700 1 -- 172.21.15.37:0/4072206345 shutdown_connections 2023-10-06T02:25:47.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.772+0000 7f199bdf2700 1 -- 172.21.15.37:0/4072206345 wait complete. 2023-10-06T02:25:47.774 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-10-06T02:25:47.790 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:25:47.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.913+0000 7fecb24e0700 1 Processor -- start 2023-10-06T02:25:47.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.914+0000 7fecb24e0700 1 -- start start 2023-10-06T02:25:47.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.914+0000 7fecb24e0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fecac0af4d0 0x7fecac0b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:47.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.914+0000 7fecb24e0700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fecac0af8a0 0x7fecac0b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:47.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.914+0000 7fecb24e0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fecac0d0340 0x7fecac0d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:47.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.914+0000 7fecb24e0700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecac0b1a60 con 0x7fecac0d0340 2023-10-06T02:25:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.914+0000 7fecb24e0700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecac0b40a0 con 0x7fecac0af8a0 2023-10-06T02:25:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.914+0000 7fecb24e0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecac0d0d00 con 0x7fecac0af4d0 2023-10-06T02:25:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.915+0000 7fecb1cdf700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fecac0d0340 0x7fecac0d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.915+0000 7fecb1cdf700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fecac0d0340 0x7fecac0d07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49540/0 (socket says 172.21.15.37:49540) 2023-10-06T02:25:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.915+0000 7fecb1cdf700 1 -- 172.21.15.37:0/2581137799 learned_addr learned my addr 172.21.15.37:0/2581137799 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.915+0000 7fecb0cdd700 1 --2- 172.21.15.37:0/2581137799 >> v2:172.21.15.191:3300/0 conn(0x7fecac0af8a0 0x7fecac0b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.915+0000 7fecb14de700 1 --2- 172.21.15.37:0/2581137799 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fecac0af4d0 0x7fecac0b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.915+0000 7fecb1cdf700 1 -- 172.21.15.37:0/2581137799 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fecac0af4d0 msgr2=0x7fecac0b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.915+0000 7fecb1cdf700 1 --2- 172.21.15.37:0/2581137799 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fecac0af4d0 0x7fecac0b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.915+0000 7fecb1cdf700 1 -- 172.21.15.37:0/2581137799 >> v2:172.21.15.191:3300/0 conn(0x7fecac0af8a0 msgr2=0x7fecac0b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.915+0000 7fecb1cdf700 1 --2- 172.21.15.37:0/2581137799 >> v2:172.21.15.191:3300/0 conn(0x7fecac0af8a0 0x7fecac0b29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.915+0000 7fecb1cdf700 1 -- 172.21.15.37:0/2581137799 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecac0b31b0 con 0x7fecac0d0340 2023-10-06T02:25:47.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.915+0000 7fecb1cdf700 1 --2- 172.21.15.37:0/2581137799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecac0d0340 0x7fecac0d07c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fecac0648f0 tx=0x7feca4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1dd69a31712abef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:47.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.915+0000 7fecabfff700 1 -- 172.21.15.37:0/2581137799 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca400b640 con 0x7fecac0d0340 2023-10-06T02:25:47.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.915+0000 7fecabfff700 1 -- 172.21.15.37:0/2581137799 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca400b7a0 con 0x7fecac0d0340 2023-10-06T02:25:47.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.915+0000 7fecabfff700 1 -- 172.21.15.37:0/2581137799 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca400bb60 con 0x7fecac0d0340 2023-10-06T02:25:47.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.916+0000 7fecb24e0700 1 -- 172.21.15.37:0/2581137799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecac0d0340 msgr2=0x7fecac0d07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:47.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.916+0000 7fecb24e0700 1 --2- 172.21.15.37:0/2581137799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecac0d0340 0x7fecac0d07c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fecac0648f0 tx=0x7feca4009250 comp rx=0 tx=0).stop 2023-10-06T02:25:47.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.916+0000 7fecb24e0700 1 -- 172.21.15.37:0/2581137799 shutdown_connections 2023-10-06T02:25:47.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.916+0000 7fecb24e0700 1 --2- 172.21.15.37:0/2581137799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecac0d0340 0x7fecac0d07c0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.916+0000 7fecb24e0700 1 --2- 172.21.15.37:0/2581137799 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fecac0af4d0 0x7fecac0b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.916+0000 7fecb24e0700 1 --2- 172.21.15.37:0/2581137799 >> v2:172.21.15.191:3300/0 conn(0x7fecac0af8a0 0x7fecac0b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.916+0000 7fecb24e0700 1 -- 172.21.15.37:0/2581137799 >> 172.21.15.37:0/2581137799 conn(0x7fecac06c0b0 msgr2=0x7fecac06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:47.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.916+0000 7fecb24e0700 1 -- 172.21.15.37:0/2581137799 shutdown_connections 2023-10-06T02:25:47.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.916+0000 7fecb24e0700 1 -- 172.21.15.37:0/2581137799 wait complete. 2023-10-06T02:25:47.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.917+0000 7fecb24e0700 1 Processor -- start 2023-10-06T02:25:47.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.917+0000 7fecb24e0700 1 -- start start 2023-10-06T02:25:47.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.918+0000 7fecb24e0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecac0af4d0 0x7fecac0cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:47.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.918+0000 7fecb24e0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fecac0af8a0 0x7fecac153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:47.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.918+0000 7fecb24e0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecac0d0340 0x7fecac0b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:47.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.918+0000 7fecb24e0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecac0c4420 con 0x7fecac0d0340 2023-10-06T02:25:47.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.918+0000 7fecb24e0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecac0c4700 con 0x7fecac0af4d0 2023-10-06T02:25:47.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.918+0000 7fecb24e0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecac0c49e0 con 0x7fecac0af8a0 2023-10-06T02:25:47.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.918+0000 7fecb1cdf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecac0d0340 0x7fecac0b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:47.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.918+0000 7fecb1cdf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecac0d0340 0x7fecac0b4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49554/0 (socket says 172.21.15.37:49554) 2023-10-06T02:25:47.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.918+0000 7fecb1cdf700 1 -- 172.21.15.37:0/2621546300 learned_addr learned my addr 172.21.15.37:0/2621546300 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.918+0000 7fecb14de700 1 --2- 172.21.15.37:0/2621546300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecac0af4d0 0x7fecac0cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.918+0000 7fecb0cdd700 1 --2- 172.21.15.37:0/2621546300 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fecac0af8a0 0x7fecac153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.918+0000 7fecb1cdf700 1 -- 172.21.15.37:0/2621546300 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fecac0af8a0 msgr2=0x7fecac153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.918+0000 7fecb1cdf700 1 --2- 172.21.15.37:0/2621546300 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fecac0af8a0 0x7fecac153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.918+0000 7fecb1cdf700 1 -- 172.21.15.37:0/2621546300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecac0af4d0 msgr2=0x7fecac0cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.918+0000 7fecb1cdf700 1 --2- 172.21.15.37:0/2621546300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecac0af4d0 0x7fecac0cd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.919+0000 7fecb1cdf700 1 -- 172.21.15.37:0/2621546300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca40094f0 con 0x7fecac0d0340 2023-10-06T02:25:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.919+0000 7fecb1cdf700 1 --2- 172.21.15.37:0/2621546300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecac0d0340 0x7fecac0b4380 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7feca40094c0 tx=0x7feca4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.919+0000 7feca97fa700 1 -- 172.21.15.37:0/2621546300 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca400bb20 con 0x7fecac0d0340 2023-10-06T02:25:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.919+0000 7feca97fa700 1 -- 172.21.15.37:0/2621546300 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca4011420 con 0x7fecac0d0340 2023-10-06T02:25:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.919+0000 7fecb24e0700 1 -- 172.21.15.37:0/2621546300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecac0c4cc0 con 0x7fecac0d0340 2023-10-06T02:25:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.919+0000 7feca97fa700 1 -- 172.21.15.37:0/2621546300 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca40117e0 con 0x7fecac0d0340 2023-10-06T02:25:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.919+0000 7fecb24e0700 1 -- 172.21.15.37:0/2621546300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecac0cd740 con 0x7fecac0d0340 2023-10-06T02:25:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.920+0000 7fecb24e0700 1 -- 172.21.15.37:0/2621546300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecac064b00 con 0x7fecac0d0340 2023-10-06T02:25:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.921+0000 7feca97fa700 1 -- 172.21.15.37:0/2621546300 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feca4011b50 con 0x7fecac0d0340 2023-10-06T02:25:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.921+0000 7feca97fa700 1 --2- 172.21.15.37:0/2621546300 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fec98066f30 0x7fec980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.921+0000 7feca97fa700 1 -- 172.21.15.37:0/2621546300 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5958+0+0 (secure 0 0 0) 0x7feca4085e10 con 0x7fecac0d0340 2023-10-06T02:25:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.921+0000 7fecb14de700 1 --2- 172.21.15.37:0/2621546300 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fec98066f30 0x7fec980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.922+0000 7fecb14de700 1 --2- 172.21.15.37:0/2621546300 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fec98066f30 0x7fec980693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00f570 tx=0x7fec9c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:47.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:47.925+0000 7feca97fa700 1 -- 172.21.15.37:0/2621546300 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feca4053000 con 0x7fecac0d0340 2023-10-06T02:25:48.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.165+0000 7fecb24e0700 1 -- 172.21.15.37:0/2621546300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fecac0b3490 con 0x7fecac0d0340 2023-10-06T02:25:48.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.791+0000 7feca97fa700 1 -- 172.21.15.37:0/2621546300 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v27) v1 ==== 173+0+0 (secure 0 0 0) 0x7feca4056620 con 0x7fecac0d0340 2023-10-06T02:25:48.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.799+0000 7fecb24e0700 1 -- 172.21.15.37:0/2621546300 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fec98066f30 msgr2=0x7fec980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:48.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.799+0000 7fecb24e0700 1 --2- 172.21.15.37:0/2621546300 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fec98066f30 0x7fec980693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00f570 tx=0x7fec9c00b040 comp rx=0 tx=0).stop 2023-10-06T02:25:48.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.799+0000 7fecb24e0700 1 -- 172.21.15.37:0/2621546300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecac0d0340 msgr2=0x7fecac0b4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:48.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.799+0000 7fecb24e0700 1 --2- 172.21.15.37:0/2621546300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecac0d0340 0x7fecac0b4380 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7feca40094c0 tx=0x7feca4017000 comp rx=0 tx=0).stop 2023-10-06T02:25:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.800+0000 7fecb24e0700 1 -- 172.21.15.37:0/2621546300 shutdown_connections 2023-10-06T02:25:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.800+0000 7fecb24e0700 1 --2- 172.21.15.37:0/2621546300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecac0d0340 0x7fecac0b4380 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.800+0000 7fecb24e0700 1 --2- 172.21.15.37:0/2621546300 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fec98066f30 0x7fec980693e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.800+0000 7fecb24e0700 1 --2- 172.21.15.37:0/2621546300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecac0af4d0 0x7fecac0cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:48.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.800+0000 7fecb24e0700 1 --2- 172.21.15.37:0/2621546300 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fecac0af8a0 0x7fecac153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:48.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.800+0000 7fecb24e0700 1 -- 172.21.15.37:0/2621546300 >> 172.21.15.37:0/2621546300 conn(0x7fecac06c0b0 msgr2=0x7fecac0affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:48.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.801+0000 7fecb24e0700 1 -- 172.21.15.37:0/2621546300 shutdown_connections 2023-10-06T02:25:48.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.801+0000 7fecb24e0700 1 -- 172.21.15.37:0/2621546300 wait complete. 2023-10-06T02:25:48.802 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 9 and data pool 10 2023-10-06T02:25:48.815 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:25:48.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.935+0000 7fa2a2405700 1 Processor -- start 2023-10-06T02:25:48.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.935+0000 7fa2a2405700 1 -- start start 2023-10-06T02:25:48.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.936+0000 7fa2a2405700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa29c157060 0x7fa29c157430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:48.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.936+0000 7fa2a2405700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa29c0b1d80 0x7fa29c0b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:48.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.936+0000 7fa2a2405700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29c0b1610 con 0x7fa29c0b1040 2023-10-06T02:25:48.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.936+0000 7fa2a2405700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c0b18f0 con 0x7fa29c157060 2023-10-06T02:25:48.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.936+0000 7fa2a2405700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c15b710 con 0x7fa29c0b1d80 2023-10-06T02:25:48.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.937+0000 7fa2a1403700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa29c157060 0x7fa29c157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:48.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.937+0000 7fa2a1403700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa29c157060 0x7fa29c157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49562/0 (socket says 172.21.15.37:49562) 2023-10-06T02:25:48.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.937+0000 7fa2a1403700 1 -- 172.21.15.37:0/901111456 learned_addr learned my addr 172.21.15.37:0/901111456 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:48.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.937+0000 7fa2a0c02700 1 --1- 172.21.15.37:0/901111456 >> v1:172.21.15.37:6789/0 conn(0x7fa29c0b1040 0x7fa29c15aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42184/0 (socket says 172.21.15.37:42184) 2023-10-06T02:25:48.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.937+0000 7fa2a1c04700 1 --2- 172.21.15.37:0/901111456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa29c0b1d80 0x7fa29c0b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.937+0000 7fa2a1403700 1 -- 172.21.15.37:0/901111456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa29c0b1d80 msgr2=0x7fa29c0b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.937+0000 7fa2a1403700 1 --2- 172.21.15.37:0/901111456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa29c0b1d80 0x7fa29c0b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.937+0000 7fa2a1403700 1 -- 172.21.15.37:0/901111456 >> v1:172.21.15.37:6789/0 conn(0x7fa29c0b1040 legacy=0x7fa29c15aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.937+0000 7fa29bfff700 1 -- 172.21.15.37:0/901111456 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113296344 0 0) 0x7fa29c0b1610 con 0x7fa29c0b1040 2023-10-06T02:25:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.937+0000 7fa2a1403700 1 -- 172.21.15.37:0/901111456 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c15b9f0 con 0x7fa29c157060 2023-10-06T02:25:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.937+0000 7fa2a1403700 1 --2- 172.21.15.37:0/901111456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa29c157060 0x7fa29c157430 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa28c009f20 tx=0x7fa28c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26317122572fc44d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.937+0000 7fa29bfff700 1 -- 172.21.15.37:0/901111456 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00e070 con 0x7fa29c157060 2023-10-06T02:25:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.937+0000 7fa29bfff700 1 -- 172.21.15.37:0/901111456 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c00ba80 con 0x7fa29c157060 2023-10-06T02:25:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.937+0000 7fa29bfff700 1 -- 172.21.15.37:0/901111456 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0092e0 con 0x7fa29c157060 2023-10-06T02:25:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.938+0000 7fa2a2405700 1 -- 172.21.15.37:0/901111456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa29c157060 msgr2=0x7fa29c157430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.938+0000 7fa2a2405700 1 --2- 172.21.15.37:0/901111456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa29c157060 0x7fa29c157430 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa28c009f20 tx=0x7fa28c009840 comp rx=0 tx=0).stop 2023-10-06T02:25:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.938+0000 7fa2a2405700 1 -- 172.21.15.37:0/901111456 shutdown_connections 2023-10-06T02:25:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.938+0000 7fa2a2405700 1 --2- 172.21.15.37:0/901111456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa29c0b1d80 0x7fa29c0b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.938+0000 7fa2a2405700 1 --2- 172.21.15.37:0/901111456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa29c157060 0x7fa29c157430 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.938+0000 7fa2a2405700 1 -- 172.21.15.37:0/901111456 >> 172.21.15.37:0/901111456 conn(0x7fa29c0ce280 msgr2=0x7fa29c0ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.938+0000 7fa2a2405700 1 -- 172.21.15.37:0/901111456 shutdown_connections 2023-10-06T02:25:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.938+0000 7fa2a2405700 1 -- 172.21.15.37:0/901111456 wait complete. 2023-10-06T02:25:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.939+0000 7fa2a2405700 1 Processor -- start 2023-10-06T02:25:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.939+0000 7fa2a2405700 1 -- start start 2023-10-06T02:25:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.940+0000 7fa2a2405700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa29c0b1040 0x7fa29c156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.940+0000 7fa2a2405700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa29c0b1d80 0x7fa29c16bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.940+0000 7fa2a2405700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa29c157060 0x7fa29c167340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.940+0000 7fa2a2405700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c14b4c0 con 0x7fa29c157060 2023-10-06T02:25:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.940+0000 7fa2a2405700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c14c300 con 0x7fa29c0b1d80 2023-10-06T02:25:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.940+0000 7fa2a2405700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c16c050 con 0x7fa29c0b1040 2023-10-06T02:25:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.940+0000 7fa2a1c04700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa29c157060 0x7fa29c167340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.940+0000 7fa2a1c04700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa29c157060 0x7fa29c167340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49564/0 (socket says 172.21.15.37:49564) 2023-10-06T02:25:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.940+0000 7fa2a1c04700 1 -- 172.21.15.37:0/3769431354 learned_addr learned my addr 172.21.15.37:0/3769431354 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.940+0000 7fa2a0c02700 1 --2- 172.21.15.37:0/3769431354 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa29c0b1d80 0x7fa29c16bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.940+0000 7fa2a1403700 1 --2- 172.21.15.37:0/3769431354 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa29c0b1040 0x7fa29c156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.941+0000 7fa2a1c04700 1 -- 172.21.15.37:0/3769431354 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa29c0b1040 msgr2=0x7fa29c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.941+0000 7fa2a1c04700 1 --2- 172.21.15.37:0/3769431354 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa29c0b1040 0x7fa29c156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.941+0000 7fa2a1c04700 1 -- 172.21.15.37:0/3769431354 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa29c0b1d80 msgr2=0x7fa29c16bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.941+0000 7fa2a1c04700 1 --2- 172.21.15.37:0/3769431354 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa29c0b1d80 0x7fa29c16bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.941+0000 7fa2a1c04700 1 -- 172.21.15.37:0/3769431354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c009ae0 con 0x7fa29c157060 2023-10-06T02:25:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.941+0000 7fa2a1c04700 1 --2- 172.21.15.37:0/3769431354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa29c157060 0x7fa29c167340 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa29400d890 tx=0x7fa294008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.941+0000 7fa2997fa700 1 -- 172.21.15.37:0/3769431354 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2940125f0 con 0x7fa29c157060 2023-10-06T02:25:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.941+0000 7fa2997fa700 1 -- 172.21.15.37:0/3769431354 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa294012770 con 0x7fa29c157060 2023-10-06T02:25:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.941+0000 7fa2a2405700 1 -- 172.21.15.37:0/3769431354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29c14b6f0 con 0x7fa29c157060 2023-10-06T02:25:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.941+0000 7fa2997fa700 1 -- 172.21.15.37:0/3769431354 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa294012b30 con 0x7fa29c157060 2023-10-06T02:25:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.941+0000 7fa2a2405700 1 -- 172.21.15.37:0/3769431354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29c14bcb0 con 0x7fa29c157060 2023-10-06T02:25:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.942+0000 7fa2a2405700 1 -- 172.21.15.37:0/3769431354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29c064b00 con 0x7fa29c157060 2023-10-06T02:25:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.942+0000 7fa2997fa700 1 -- 172.21.15.37:0/3769431354 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa29401e460 con 0x7fa29c157060 2023-10-06T02:25:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.943+0000 7fa2997fa700 1 --2- 172.21.15.37:0/3769431354 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa288066f30 0x7fa2880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.943+0000 7fa2997fa700 1 -- 172.21.15.37:0/3769431354 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa294084b90 con 0x7fa29c157060 2023-10-06T02:25:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.943+0000 7fa2a1403700 1 --2- 172.21.15.37:0/3769431354 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa288066f30 0x7fa2880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.943+0000 7fa2a1403700 1 --2- 172.21.15.37:0/3769431354 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa288066f30 0x7fa2880693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa28c009880 tx=0x7fa28c018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:48.947+0000 7fa2997fa700 1 -- 172.21.15.37:0/3769431354 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa294055730 con 0x7fa29c157060 2023-10-06T02:25:49.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.141+0000 7fa2a2405700 1 -- 172.21.15.37:0/3769431354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa29c04bb80 con 0x7fa29c157060 2023-10-06T02:25:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.142+0000 7fa2997fa700 1 -- 172.21.15.37:0/3769431354 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16881 (secure 0 0 0) 0x7fa2940552c0 con 0x7fa29c157060 2023-10-06T02:25:49.142 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:49.142 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":56,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:25:48.166006+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:25:45.900917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T02:25:47.150749+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:25:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.144+0000 7fa2a2405700 1 -- 172.21.15.37:0/3769431354 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa288066f30 msgr2=0x7fa2880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.144+0000 7fa2a2405700 1 --2- 172.21.15.37:0/3769431354 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa288066f30 0x7fa2880693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa28c009880 tx=0x7fa28c018000 comp rx=0 tx=0).stop 2023-10-06T02:25:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.144+0000 7fa2a2405700 1 -- 172.21.15.37:0/3769431354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa29c157060 msgr2=0x7fa29c167340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.144+0000 7fa2a2405700 1 --2- 172.21.15.37:0/3769431354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa29c157060 0x7fa29c167340 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa29400d890 tx=0x7fa294008040 comp rx=0 tx=0).stop 2023-10-06T02:25:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.144+0000 7fa2a2405700 1 -- 172.21.15.37:0/3769431354 shutdown_connections 2023-10-06T02:25:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.144+0000 7fa2a2405700 1 --2- 172.21.15.37:0/3769431354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa29c157060 0x7fa29c167340 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.144+0000 7fa2a2405700 1 --2- 172.21.15.37:0/3769431354 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa29c0b1040 0x7fa29c156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.144+0000 7fa2a2405700 1 --2- 172.21.15.37:0/3769431354 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa288066f30 0x7fa2880693e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.144+0000 7fa2a2405700 1 --2- 172.21.15.37:0/3769431354 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa29c0b1d80 0x7fa29c16bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.144+0000 7fa2a2405700 1 -- 172.21.15.37:0/3769431354 >> 172.21.15.37:0/3769431354 conn(0x7fa29c0ce280 msgr2=0x7fa29c0cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.144+0000 7fa2a2405700 1 -- 172.21.15.37:0/3769431354 shutdown_connections 2023-10-06T02:25:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.144+0000 7fa2a2405700 1 -- 172.21.15.37:0/3769431354 wait complete. 2023-10-06T02:25:49.157 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:25:49.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.275+0000 7f50124b7700 1 Processor -- start 2023-10-06T02:25:49.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.275+0000 7f50124b7700 1 -- start start 2023-10-06T02:25:49.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.276+0000 7f50124b7700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f500c159aa0 0x7f500c0c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:49.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.276+0000 7f50124b7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f500c0c6b30 0x7f500c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:49.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.276+0000 7f50124b7700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500c0c5300 con 0x7f500c1596d0 2023-10-06T02:25:49.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.276+0000 7f50124b7700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500c0c6160 con 0x7f500c0c6b30 2023-10-06T02:25:49.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.276+0000 7f50124b7700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500c0c5550 con 0x7f500c159aa0 2023-10-06T02:25:49.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.276+0000 7f5010a54700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f500c0c6b30 0x7f500c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:49.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.276+0000 7f5010a54700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f500c0c6b30 0x7f500c0cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49570/0 (socket says 172.21.15.37:49570) 2023-10-06T02:25:49.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.276+0000 7f5010a54700 1 -- 172.21.15.37:0/3289890802 learned_addr learned my addr 172.21.15.37:0/3289890802 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:49.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.276+0000 7f500b7fe700 1 --2- 172.21.15.37:0/3289890802 >> v2:172.21.15.191:3300/0 conn(0x7f500c159aa0 0x7f500c0c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:49.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.276+0000 7f5010a54700 1 -- 172.21.15.37:0/3289890802 >> v2:172.21.15.191:3300/0 conn(0x7f500c159aa0 msgr2=0x7f500c0c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:49.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.276+0000 7f5010a54700 1 --2- 172.21.15.37:0/3289890802 >> v2:172.21.15.191:3300/0 conn(0x7f500c159aa0 0x7f500c0c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:49.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.276+0000 7f5010a54700 1 -- 172.21.15.37:0/3289890802 >> v1:172.21.15.191:6789/0 conn(0x7f500c1596d0 legacy=0x7f500c0b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:49.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.276+0000 7f5010a54700 1 -- 172.21.15.37:0/3289890802 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c0c5830 con 0x7f500c0c6b30 2023-10-06T02:25:49.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.276+0000 7f500b7fe700 1 --2- 172.21.15.37:0/3289890802 >> v2:172.21.15.191:3300/0 conn(0x7f500c159aa0 0x7f500c0c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:49.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.276+0000 7f5010a54700 1 --2- 172.21.15.37:0/3289890802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c0c6b30 0x7f500c0cf9f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f500c06d5f0 tx=0x7f5004009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358ce7f6956eeafb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:49.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.277+0000 7f500affd700 1 -- 172.21.15.37:0/3289890802 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500400e070 con 0x7f500c0c6b30 2023-10-06T02:25:49.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.277+0000 7f500affd700 1 -- 172.21.15.37:0/3289890802 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500400ba50 con 0x7f500c0c6b30 2023-10-06T02:25:49.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.277+0000 7f500affd700 1 -- 172.21.15.37:0/3289890802 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50040092e0 con 0x7f500c0c6b30 2023-10-06T02:25:49.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.277+0000 7f50124b7700 1 -- 172.21.15.37:0/3289890802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c0c6b30 msgr2=0x7f500c0cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:49.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.277+0000 7f50124b7700 1 --2- 172.21.15.37:0/3289890802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c0c6b30 0x7f500c0cf9f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f500c06d5f0 tx=0x7f5004009840 comp rx=0 tx=0).stop 2023-10-06T02:25:49.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.277+0000 7f50124b7700 1 -- 172.21.15.37:0/3289890802 shutdown_connections 2023-10-06T02:25:49.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.277+0000 7f50124b7700 1 --2- 172.21.15.37:0/3289890802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c0c6b30 0x7f500c0cf9f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:49.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.277+0000 7f50124b7700 1 --2- 172.21.15.37:0/3289890802 >> v2:172.21.15.191:3300/0 conn(0x7f500c159aa0 0x7f500c0c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:49.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.277+0000 7f50124b7700 1 -- 172.21.15.37:0/3289890802 >> 172.21.15.37:0/3289890802 conn(0x7f500c06c890 msgr2=0x7f500c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:49.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.277+0000 7f50124b7700 1 -- 172.21.15.37:0/3289890802 shutdown_connections 2023-10-06T02:25:49.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.277+0000 7f50124b7700 1 -- 172.21.15.37:0/3289890802 wait complete. 2023-10-06T02:25:49.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.278+0000 7f50124b7700 1 Processor -- start 2023-10-06T02:25:49.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.278+0000 7f50124b7700 1 -- start start 2023-10-06T02:25:49.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.279+0000 7f50124b7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c0c6b30 0x7f500c14f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:49.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.279+0000 7f50124b7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f500c1596d0 0x7f500c15be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:49.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.279+0000 7f50124b7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f500c159aa0 0x7f500c0cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:49.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.279+0000 7f50124b7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c0b5300 con 0x7f500c0c6b30 2023-10-06T02:25:49.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.279+0000 7f50124b7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c0b46f0 con 0x7f500c1596d0 2023-10-06T02:25:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.279+0000 7f50124b7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500c0b49d0 con 0x7f500c159aa0 2023-10-06T02:25:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.279+0000 7f500bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c0c6b30 0x7f500c14f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.279+0000 7f500bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c0c6b30 0x7f500c14f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49584/0 (socket says 172.21.15.37:49584) 2023-10-06T02:25:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.279+0000 7f500bfff700 1 -- 172.21.15.37:0/1832258294 learned_addr learned my addr 172.21.15.37:0/1832258294 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.279+0000 7f5010a54700 1 --2- 172.21.15.37:0/1832258294 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f500c159aa0 0x7f500c0cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.279+0000 7f500bfff700 1 -- 172.21.15.37:0/1832258294 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f500c159aa0 msgr2=0x7f500c0cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.279+0000 7f500b7fe700 1 --2- 172.21.15.37:0/1832258294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f500c1596d0 0x7f500c15be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.279+0000 7f500bfff700 1 --2- 172.21.15.37:0/1832258294 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f500c159aa0 0x7f500c0cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.279+0000 7f500bfff700 1 -- 172.21.15.37:0/1832258294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f500c1596d0 msgr2=0x7f500c15be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.279+0000 7f500bfff700 1 --2- 172.21.15.37:0/1832258294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f500c1596d0 0x7f500c15be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.279+0000 7f500bfff700 1 -- 172.21.15.37:0/1832258294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5004009ae0 con 0x7f500c0c6b30 2023-10-06T02:25:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.279+0000 7f5010a54700 1 --2- 172.21.15.37:0/1832258294 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f500c159aa0 0x7f500c0cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:49.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.279+0000 7f500b7fe700 1 --2- 172.21.15.37:0/1832258294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f500c1596d0 0x7f500c15be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:49.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.280+0000 7f500bfff700 1 --2- 172.21.15.37:0/1832258294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c0c6b30 0x7f500c14f390 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00c590 tx=0x7f4ffc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:49.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.280+0000 7f4ff3fff700 1 -- 172.21.15.37:0/1832258294 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc011590 con 0x7f500c0c6b30 2023-10-06T02:25:49.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.280+0000 7f4ff3fff700 1 -- 172.21.15.37:0/1832258294 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc0116f0 con 0x7f500c0c6b30 2023-10-06T02:25:49.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.280+0000 7f50124b7700 1 -- 172.21.15.37:0/1832258294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500c0b4cb0 con 0x7f500c0c6b30 2023-10-06T02:25:49.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.280+0000 7f4ff3fff700 1 -- 172.21.15.37:0/1832258294 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc011ab0 con 0x7f500c0c6b30 2023-10-06T02:25:49.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.280+0000 7f50124b7700 1 -- 172.21.15.37:0/1832258294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500c14f8d0 con 0x7f500c0c6b30 2023-10-06T02:25:49.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.281+0000 7f50124b7700 1 -- 172.21.15.37:0/1832258294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500c06fbf0 con 0x7f500c0c6b30 2023-10-06T02:25:49.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.281+0000 7f4ff3fff700 1 -- 172.21.15.37:0/1832258294 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ffc01b3b0 con 0x7f500c0c6b30 2023-10-06T02:25:49.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.282+0000 7f4ff3fff700 1 --2- 172.21.15.37:0/1832258294 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4ff8066f30 0x7f4ff80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:49.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.282+0000 7f4ff3fff700 1 -- 172.21.15.37:0/1832258294 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4ffc083c40 con 0x7f500c0c6b30 2023-10-06T02:25:49.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.282+0000 7f500b7fe700 1 --2- 172.21.15.37:0/1832258294 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4ff8066f30 0x7f4ff80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:49.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.282+0000 7f500b7fe700 1 --2- 172.21.15.37:0/1832258294 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4ff8066f30 0x7f4ff80693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5000006f00 tx=0x7f5000008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:49.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.286+0000 7f4ff3fff700 1 -- 172.21.15.37:0/1832258294 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ffc050d50 con 0x7f500c0c6b30 2023-10-06T02:25:49.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.480+0000 7f50124b7700 1 -- 172.21.15.37:0/1832258294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f500c1553d0 con 0x7f500c0c6b30 2023-10-06T02:25:49.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.481+0000 7f4ff3fff700 1 -- 172.21.15.37:0/1832258294 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16881 (secure 0 0 0) 0x7f4ffc017070 con 0x7f500c0c6b30 2023-10-06T02:25:49.482 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:49.482 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":56,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:25:48.166006+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:25:45.900917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T02:25:47.150749+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:25:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.483+0000 7f50124b7700 1 -- 172.21.15.37:0/1832258294 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4ff8066f30 msgr2=0x7f4ff80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.483+0000 7f50124b7700 1 --2- 172.21.15.37:0/1832258294 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4ff8066f30 0x7f4ff80693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5000006f00 tx=0x7f5000008040 comp rx=0 tx=0).stop 2023-10-06T02:25:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.483+0000 7f50124b7700 1 -- 172.21.15.37:0/1832258294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c0c6b30 msgr2=0x7f500c14f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.483+0000 7f50124b7700 1 --2- 172.21.15.37:0/1832258294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c0c6b30 0x7f500c14f390 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00c590 tx=0x7f4ffc00c950 comp rx=0 tx=0).stop 2023-10-06T02:25:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.483+0000 7f50124b7700 1 -- 172.21.15.37:0/1832258294 shutdown_connections 2023-10-06T02:25:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.483+0000 7f50124b7700 1 --2- 172.21.15.37:0/1832258294 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f500c159aa0 0x7f500c0cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.483+0000 7f50124b7700 1 --2- 172.21.15.37:0/1832258294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c0c6b30 0x7f500c14f390 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.483+0000 7f50124b7700 1 --2- 172.21.15.37:0/1832258294 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4ff8066f30 0x7f4ff80693e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.483+0000 7f50124b7700 1 --2- 172.21.15.37:0/1832258294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f500c1596d0 0x7f500c15be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.483+0000 7f50124b7700 1 -- 172.21.15.37:0/1832258294 >> 172.21.15.37:0/1832258294 conn(0x7f500c06c890 msgr2=0x7f500c1567a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.483+0000 7f50124b7700 1 -- 172.21.15.37:0/1832258294 shutdown_connections 2023-10-06T02:25:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.483+0000 7f50124b7700 1 -- 172.21.15.37:0/1832258294 wait complete. 2023-10-06T02:25:49.496 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:25:49.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.617+0000 7f0cc69fa700 1 Processor -- start 2023-10-06T02:25:49.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.617+0000 7f0cc69fa700 1 -- start start 2023-10-06T02:25:49.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.618+0000 7f0cc69fa700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0cc00ccdd0 0x7f0cc0164260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:49.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.618+0000 7f0cc69fa700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc00b2da0 con 0x7f0cc00b29d0 2023-10-06T02:25:49.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.618+0000 7f0cc69fa700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc0099bd0 con 0x7f0cc00cb170 2023-10-06T02:25:49.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.618+0000 7f0cc69fa700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc0159a70 con 0x7f0cc00ccdd0 2023-10-06T02:25:49.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.618+0000 7f0cc61f9700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0cc00ccdd0 0x7f0cc0164260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:49.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.618+0000 7f0cc59f8700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0cc00b29d0 0x7f0cc00ce8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42196/0 (socket says 172.21.15.37:42196) 2023-10-06T02:25:49.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.618+0000 7f0cc59f8700 1 -- 172.21.15.37:0/3680997240 learned_addr learned my addr 172.21.15.37:0/3680997240 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:49.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.618+0000 7f0cc61f9700 1 -- 172.21.15.37:0/3680997240 >> v1:172.21.15.191:6789/0 conn(0x7f0cc00cb170 legacy=0x7f0cc00cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:49.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.618+0000 7f0cc61f9700 1 -- 172.21.15.37:0/3680997240 >> v1:172.21.15.37:6789/0 conn(0x7f0cc00b29d0 legacy=0x7f0cc00ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:49.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.618+0000 7f0cc61f9700 1 -- 172.21.15.37:0/3680997240 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc00cb5e0 con 0x7f0cc00ccdd0 2023-10-06T02:25:49.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.619+0000 7f0cc61f9700 1 --2- 172.21.15.37:0/3680997240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cc00ccdd0 0x7f0cc0164260 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80098e0 tx=0x7f0cb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfec978acc2ac97 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:49.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.619+0000 7f0cc49f6700 1 -- 172.21.15.37:0/3680997240 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8009e80 con 0x7f0cc00ccdd0 2023-10-06T02:25:49.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.619+0000 7f0cc49f6700 1 -- 172.21.15.37:0/3680997240 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb800b860 con 0x7f0cc00ccdd0 2023-10-06T02:25:49.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.619+0000 7f0cc49f6700 1 -- 172.21.15.37:0/3680997240 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb800bbe0 con 0x7f0cc00ccdd0 2023-10-06T02:25:49.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.619+0000 7f0cc69fa700 1 -- 172.21.15.37:0/3680997240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cc00ccdd0 msgr2=0x7f0cc0164260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:49.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.619+0000 7f0cc69fa700 1 --2- 172.21.15.37:0/3680997240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cc00ccdd0 0x7f0cc0164260 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80098e0 tx=0x7f0cb80091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:49.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.619+0000 7f0cc69fa700 1 -- 172.21.15.37:0/3680997240 shutdown_connections 2023-10-06T02:25:49.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.619+0000 7f0cc69fa700 1 --2- 172.21.15.37:0/3680997240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cc00ccdd0 0x7f0cc0164260 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:49.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.619+0000 7f0cc69fa700 1 -- 172.21.15.37:0/3680997240 >> 172.21.15.37:0/3680997240 conn(0x7f0cc0099610 msgr2=0x7f0cc006c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:49.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.619+0000 7f0cc69fa700 1 -- 172.21.15.37:0/3680997240 shutdown_connections 2023-10-06T02:25:49.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.619+0000 7f0cc69fa700 1 -- 172.21.15.37:0/3680997240 wait complete. 2023-10-06T02:25:49.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.621+0000 7f0cc69fa700 1 Processor -- start 2023-10-06T02:25:49.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.621+0000 7f0cc69fa700 1 -- start start 2023-10-06T02:25:49.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.621+0000 7f0cc69fa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cc00b29d0 0x7f0cc006e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:49.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.621+0000 7f0cc69fa700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0cc00cb170 0x7f0cc015c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:49.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.621+0000 7f0cc69fa700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cc00ccdd0 0x7f0cc015c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:49.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.621+0000 7f0cc69fa700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc006f560 con 0x7f0cc00b29d0 2023-10-06T02:25:49.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.621+0000 7f0cc69fa700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00b4790 con 0x7f0cc00cb170 2023-10-06T02:25:49.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.621+0000 7f0cc69fa700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc0150860 con 0x7f0cc00ccdd0 2023-10-06T02:25:49.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.621+0000 7f0cc59f8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cc00b29d0 0x7f0cc006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:49.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.621+0000 7f0cc59f8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cc00b29d0 0x7f0cc006e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49596/0 (socket says 172.21.15.37:49596) 2023-10-06T02:25:49.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.621+0000 7f0cc59f8700 1 -- 172.21.15.37:0/467226960 learned_addr learned my addr 172.21.15.37:0/467226960 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:49.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.622+0000 7f0cc61f9700 1 --2- 172.21.15.37:0/467226960 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cc00ccdd0 0x7f0cc015c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:49.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.622+0000 7f0cc59f8700 1 -- 172.21.15.37:0/467226960 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cc00ccdd0 msgr2=0x7f0cc015c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:49.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.622+0000 7f0cc51f7700 1 --2- 172.21.15.37:0/467226960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0cc00cb170 0x7f0cc015c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:49.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.622+0000 7f0cc59f8700 1 --2- 172.21.15.37:0/467226960 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cc00ccdd0 0x7f0cc015c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:49.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.622+0000 7f0cc59f8700 1 -- 172.21.15.37:0/467226960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0cc00cb170 msgr2=0x7f0cc015c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:49.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.622+0000 7f0cc59f8700 1 --2- 172.21.15.37:0/467226960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0cc00cb170 0x7f0cc015c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:49.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.622+0000 7f0cc59f8700 1 -- 172.21.15.37:0/467226960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb8009420 con 0x7f0cc00b29d0 2023-10-06T02:25:49.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.622+0000 7f0cc59f8700 1 --2- 172.21.15.37:0/467226960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cc00b29d0 0x7f0cc006e490 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000cc70 tx=0x7f0cb0001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:49.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.622+0000 7f0cbdffb700 1 -- 172.21.15.37:0/467226960 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb000ce80 con 0x7f0cc00b29d0 2023-10-06T02:25:49.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.622+0000 7f0cbdffb700 1 -- 172.21.15.37:0/467226960 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb000ab70 con 0x7f0cc00b29d0 2023-10-06T02:25:49.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.622+0000 7f0cbdffb700 1 -- 172.21.15.37:0/467226960 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb00070f0 con 0x7f0cc00b29d0 2023-10-06T02:25:49.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.622+0000 7f0cc69fa700 1 -- 172.21.15.37:0/467226960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc006efa0 con 0x7f0cc00b29d0 2023-10-06T02:25:49.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.622+0000 7f0cc69fa700 1 -- 172.21.15.37:0/467226960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc00b4420 con 0x7f0cc00b29d0 2023-10-06T02:25:49.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.623+0000 7f0cc69fa700 1 -- 172.21.15.37:0/467226960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc00884f0 con 0x7f0cc00b29d0 2023-10-06T02:25:49.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.624+0000 7f0cbdffb700 1 -- 172.21.15.37:0/467226960 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0cb0007520 con 0x7f0cc00b29d0 2023-10-06T02:25:49.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.624+0000 7f0cbdffb700 1 --2- 172.21.15.37:0/467226960 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0cac066f30 0x7f0cac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:49.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.624+0000 7f0cbdffb700 1 -- 172.21.15.37:0/467226960 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0cb0084840 con 0x7f0cc00b29d0 2023-10-06T02:25:49.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.624+0000 7f0cc51f7700 1 --2- 172.21.15.37:0/467226960 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0cac066f30 0x7f0cac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:49.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.625+0000 7f0cc51f7700 1 --2- 172.21.15.37:0/467226960 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0cac066f30 0x7f0cac0693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0cc009e190 tx=0x7f0cb4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:49.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.628+0000 7f0cbdffb700 1 -- 172.21.15.37:0/467226960 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0cb00519d0 con 0x7f0cc00b29d0 2023-10-06T02:25:49.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:49.868+0000 7f0cc69fa700 1 -- 172.21.15.37:0/467226960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0cc00b2da0 con 0x7f0cc00b29d0 2023-10-06T02:25:50.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.795+0000 7f0cbdffb700 1 -- 172.21.15.37:0/467226960 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0cc00b2da0 con 0x7f0cc00b29d0 2023-10-06T02:25:50.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.798+0000 7f0cc69fa700 1 -- 172.21.15.37:0/467226960 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0cac066f30 msgr2=0x7f0cac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:50.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.798+0000 7f0cc69fa700 1 --2- 172.21.15.37:0/467226960 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0cac066f30 0x7f0cac0693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0cc009e190 tx=0x7f0cb4009040 comp rx=0 tx=0).stop 2023-10-06T02:25:50.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.798+0000 7f0cc69fa700 1 -- 172.21.15.37:0/467226960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cc00b29d0 msgr2=0x7f0cc006e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:50.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.798+0000 7f0cc69fa700 1 --2- 172.21.15.37:0/467226960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cc00b29d0 0x7f0cc006e490 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000cc70 tx=0x7f0cb0001a30 comp rx=0 tx=0).stop 2023-10-06T02:25:50.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.798+0000 7f0cc69fa700 1 -- 172.21.15.37:0/467226960 shutdown_connections 2023-10-06T02:25:50.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.798+0000 7f0cc69fa700 1 --2- 172.21.15.37:0/467226960 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cc00ccdd0 0x7f0cc015c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:50.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.798+0000 7f0cc69fa700 1 --2- 172.21.15.37:0/467226960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cc00b29d0 0x7f0cc006e490 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:50.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.798+0000 7f0cc69fa700 1 --2- 172.21.15.37:0/467226960 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0cac066f30 0x7f0cac0693e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:50.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.798+0000 7f0cc69fa700 1 --2- 172.21.15.37:0/467226960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0cc00cb170 0x7f0cc015c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:50.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.798+0000 7f0cc69fa700 1 -- 172.21.15.37:0/467226960 >> 172.21.15.37:0/467226960 conn(0x7f0cc0099610 msgr2=0x7f0cc0152180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:50.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.798+0000 7f0cc69fa700 1 -- 172.21.15.37:0/467226960 shutdown_connections 2023-10-06T02:25:50.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.798+0000 7f0cc69fa700 1 -- 172.21.15.37:0/467226960 wait complete. 2023-10-06T02:25:50.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:25:50.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.942+0000 7f2fd4973700 1 Processor -- start 2023-10-06T02:25:50.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.942+0000 7f2fd4973700 1 -- start start 2023-10-06T02:25:50.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.943+0000 7f2fd4973700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2fd01566a0 0x7f2fd0096a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:50.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.943+0000 7f2fd4973700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd00c7740 con 0x7f2fd006a7a0 2023-10-06T02:25:50.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.943+0000 7f2fd4973700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd00c6b30 con 0x7f2fd00c66a0 2023-10-06T02:25:50.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.943+0000 7f2fd4973700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd00c6e10 con 0x7f2fd01566a0 2023-10-06T02:25:50.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.943+0000 7f2fce59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2fd006a7a0 0x7f2fd0155f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42200/0 (socket says 172.21.15.37:42200) 2023-10-06T02:25:50.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.943+0000 7f2fce59c700 1 -- 172.21.15.37:0/1048763595 learned_addr learned my addr 172.21.15.37:0/1048763595 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:50.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fcd59a700 1 -- 172.21.15.37:0/1048763595 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686358872 0 0) 0x7f2fd00c7740 con 0x7f2fd006a7a0 2023-10-06T02:25:50.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fcd59a700 1 -- 172.21.15.37:0/1048763595 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fb8003570 con 0x7f2fd006a7a0 2023-10-06T02:25:50.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fced9d700 1 --2- 172.21.15.37:0/1048763595 >> v2:172.21.15.191:3300/0 conn(0x7f2fd01566a0 0x7f2fd0096a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:50.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fcd59a700 1 -- 172.21.15.37:0/1048763595 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1468408104 0 0) 0x7f2fb8003570 con 0x7f2fd006a7a0 2023-10-06T02:25:50.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fcd59a700 1 -- 172.21.15.37:0/1048763595 >> v2:172.21.15.191:3300/0 conn(0x7f2fd01566a0 msgr2=0x7f2fd0096a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:50.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fcd59a700 1 --2- 172.21.15.37:0/1048763595 >> v2:172.21.15.191:3300/0 conn(0x7f2fd01566a0 0x7f2fd0096a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:50.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fcd59a700 1 -- 172.21.15.37:0/1048763595 >> v1:172.21.15.191:6789/0 conn(0x7f2fd00c66a0 legacy=0x7f2fd00c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:50.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fcd59a700 1 -- 172.21.15.37:0/1048763595 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd00c70f0 con 0x7f2fd006a7a0 2023-10-06T02:25:50.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fcd59a700 1 -- 172.21.15.37:0/1048763595 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f2fc0001470 con 0x7f2fd006a7a0 2023-10-06T02:25:50.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fcd59a700 1 -- 172.21.15.37:0/1048763595 >> v1:172.21.15.37:6789/0 conn(0x7f2fd006a7a0 legacy=0x7f2fd0155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:50.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fcd59a700 1 --2- 172.21.15.37:0/1048763595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fb8003a60 0x7f2fb8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:50.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fcd59a700 1 --2- 172.21.15.37:0/1048763595 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2fb8004810 0x7f2fb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:50.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fcd59a700 1 --2- 172.21.15.37:0/1048763595 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2fb80051c0 0x7f2fb800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:50.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fcd59a700 1 -- 172.21.15.37:0/1048763595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd00c6e10 con 0x7f2fb8003a60 2023-10-06T02:25:50.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fcd59a700 1 -- 172.21.15.37:0/1048763595 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb800c0d0 con 0x7f2fb8004810 2023-10-06T02:25:50.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fcd59a700 1 -- 172.21.15.37:0/1048763595 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb800c290 con 0x7f2fb80051c0 2023-10-06T02:25:50.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fce59c700 1 --2- 172.21.15.37:0/1048763595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fb8003a60 0x7f2fb8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:50.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fcdd9b700 1 --2- 172.21.15.37:0/1048763595 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2fb8004810 0x7f2fb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:50.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fced9d700 1 --2- 172.21.15.37:0/1048763595 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2fb80051c0 0x7f2fb800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:50.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fce59c700 1 -- 172.21.15.37:0/1048763595 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2fb80051c0 msgr2=0x7f2fb800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:50.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fce59c700 1 --2- 172.21.15.37:0/1048763595 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2fb80051c0 0x7f2fb800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:50.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fce59c700 1 -- 172.21.15.37:0/1048763595 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2fb8004810 msgr2=0x7f2fb8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fce59c700 1 --2- 172.21.15.37:0/1048763595 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2fb8004810 0x7f2fb8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fce59c700 1 -- 172.21.15.37:0/1048763595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb8003570 con 0x7f2fb8003a60 2023-10-06T02:25:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.944+0000 7f2fced9d700 1 -- 172.21.15.37:0/1048763595 reap_dead start 2023-10-06T02:25:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.945+0000 7f2fce59c700 1 --2- 172.21.15.37:0/1048763595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fb8003a60 0x7f2fb8003e70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000c390 tx=0x7f2fd0156b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609d1fec54c36e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.945+0000 7f2fcd59a700 1 -- 172.21.15.37:0/1048763595 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000cbe0 con 0x7f2fb8003a60 2023-10-06T02:25:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.945+0000 7f2fcd59a700 1 -- 172.21.15.37:0/1048763595 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc000cd40 con 0x7f2fb8003a60 2023-10-06T02:25:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.945+0000 7f2fcd59a700 1 -- 172.21.15.37:0/1048763595 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0005b70 con 0x7f2fb8003a60 2023-10-06T02:25:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.945+0000 7f2fd4973700 1 -- 172.21.15.37:0/1048763595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fb8003a60 msgr2=0x7f2fb8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.945+0000 7f2fd4973700 1 --2- 172.21.15.37:0/1048763595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fb8003a60 0x7f2fb8003e70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000c390 tx=0x7f2fd0156b20 comp rx=0 tx=0).stop 2023-10-06T02:25:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.945+0000 7f2fd4973700 1 -- 172.21.15.37:0/1048763595 shutdown_connections 2023-10-06T02:25:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.945+0000 7f2fd4973700 1 --2- 172.21.15.37:0/1048763595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fb8003a60 0x7f2fb8003e70 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:50.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.945+0000 7f2fd4973700 1 -- 172.21.15.37:0/1048763595 >> 172.21.15.37:0/1048763595 conn(0x7f2fd00cc100 msgr2=0x7f2fd00cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:50.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.945+0000 7f2fd4973700 1 -- 172.21.15.37:0/1048763595 shutdown_connections 2023-10-06T02:25:50.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.945+0000 7f2fd4973700 1 -- 172.21.15.37:0/1048763595 wait complete. 2023-10-06T02:25:50.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.946+0000 7f2fd4973700 1 Processor -- start 2023-10-06T02:25:50.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.946+0000 7f2fd4973700 1 -- start start 2023-10-06T02:25:50.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.947+0000 7f2fd4973700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2fb8003a60 0x7f2fd0150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.947+0000 7f2fd4973700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2fd0154ba0 0x7f2fd00ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.947+0000 7f2fd4973700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fd0155010 0x7f2fd00ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.947+0000 7f2fd4973700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd0158a00 con 0x7f2fd0155010 2023-10-06T02:25:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.947+0000 7f2fd4973700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd0150bc0 con 0x7f2fb8003a60 2023-10-06T02:25:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.947+0000 7f2fd4973700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd0157df0 con 0x7f2fd0154ba0 2023-10-06T02:25:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.947+0000 7f2fced9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fd0155010 0x7f2fd00ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.947+0000 7f2fced9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fd0155010 0x7f2fd00ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49608/0 (socket says 172.21.15.37:49608) 2023-10-06T02:25:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.947+0000 7f2fced9d700 1 -- 172.21.15.37:0/3854170075 learned_addr learned my addr 172.21.15.37:0/3854170075 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.947+0000 7f2fcdd9b700 1 --2- 172.21.15.37:0/3854170075 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2fd0154ba0 0x7f2fd00ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:50.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.947+0000 7f2fce59c700 1 --2- 172.21.15.37:0/3854170075 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2fb8003a60 0x7f2fd0150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:50.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.947+0000 7f2fced9d700 1 -- 172.21.15.37:0/3854170075 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2fd0154ba0 msgr2=0x7f2fd00ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:50.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.947+0000 7f2fced9d700 1 --2- 172.21.15.37:0/3854170075 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2fd0154ba0 0x7f2fd00ca1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:50.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.947+0000 7f2fced9d700 1 -- 172.21.15.37:0/3854170075 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2fb8003a60 msgr2=0x7f2fd0150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:50.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.947+0000 7f2fced9d700 1 --2- 172.21.15.37:0/3854170075 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2fb8003a60 0x7f2fd0150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:50.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.947+0000 7f2fced9d700 1 -- 172.21.15.37:0/3854170075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd01580d0 con 0x7f2fd0155010 2023-10-06T02:25:50.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.948+0000 7f2fced9d700 1 --2- 172.21.15.37:0/3854170075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fd0155010 0x7f2fd00ca730 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2fd006a520 tx=0x7f2fc800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:50.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.948+0000 7f2fbe7fc700 1 -- 172.21.15.37:0/3854170075 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc800e070 con 0x7f2fd0155010 2023-10-06T02:25:50.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.948+0000 7f2fbe7fc700 1 -- 172.21.15.37:0/3854170075 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc8011d00 con 0x7f2fd0155010 2023-10-06T02:25:50.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.948+0000 7f2fd4973700 1 -- 172.21.15.37:0/3854170075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd01583b0 con 0x7f2fd0155010 2023-10-06T02:25:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.948+0000 7f2fbe7fc700 1 -- 172.21.15.37:0/3854170075 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc80166c0 con 0x7f2fd0155010 2023-10-06T02:25:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.948+0000 7f2fd4973700 1 -- 172.21.15.37:0/3854170075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd01547e0 con 0x7f2fd0155010 2023-10-06T02:25:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.949+0000 7f2fd4973700 1 -- 172.21.15.37:0/3854170075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd0070c30 con 0x7f2fd0155010 2023-10-06T02:25:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.949+0000 7f2fbe7fc700 1 -- 172.21.15.37:0/3854170075 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fc8016af0 con 0x7f2fd0155010 2023-10-06T02:25:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.950+0000 7f2fbe7fc700 1 --2- 172.21.15.37:0/3854170075 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2fb0066f30 0x7f2fb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.950+0000 7f2fbe7fc700 1 -- 172.21.15.37:0/3854170075 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2fc80851f0 con 0x7f2fd0155010 2023-10-06T02:25:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.950+0000 7f2fce59c700 1 --2- 172.21.15.37:0/3854170075 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2fb0066f30 0x7f2fb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.950+0000 7f2fce59c700 1 --2- 172.21.15.37:0/3854170075 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2fb0066f30 0x7f2fb00693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0007cd0 tx=0x7f2fc0015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:50.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:50.954+0000 7f2fbe7fc700 1 -- 172.21.15.37:0/3854170075 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fc8052300 con 0x7f2fd0155010 2023-10-06T02:25:51.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.192+0000 7f2fd4973700 1 -- 172.21.15.37:0/3854170075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2fd00c2ed0 con 0x7f2fd0155010 2023-10-06T02:25:51.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:25:51.616 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:25:51.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.804+0000 7f2fbe7fc700 1 -- 172.21.15.37:0/3854170075 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2fc8055920 con 0x7f2fd0155010 2023-10-06T02:25:51.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.806+0000 7f2fd4973700 1 -- 172.21.15.37:0/3854170075 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2fb0066f30 msgr2=0x7f2fb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:51.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.806+0000 7f2fd4973700 1 --2- 172.21.15.37:0/3854170075 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2fb0066f30 0x7f2fb00693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0007cd0 tx=0x7f2fc0015000 comp rx=0 tx=0).stop 2023-10-06T02:25:51.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.806+0000 7f2fd4973700 1 -- 172.21.15.37:0/3854170075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fd0155010 msgr2=0x7f2fd00ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.806+0000 7f2fd4973700 1 --2- 172.21.15.37:0/3854170075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fd0155010 0x7f2fd00ca730 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2fd006a520 tx=0x7f2fc800b040 comp rx=0 tx=0).stop 2023-10-06T02:25:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.807+0000 7f2fd4973700 1 -- 172.21.15.37:0/3854170075 shutdown_connections 2023-10-06T02:25:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.807+0000 7f2fd4973700 1 --2- 172.21.15.37:0/3854170075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fd0155010 0x7f2fd00ca730 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.807+0000 7f2fd4973700 1 --2- 172.21.15.37:0/3854170075 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2fb0066f30 0x7f2fb00693e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.807+0000 7f2fd4973700 1 --2- 172.21.15.37:0/3854170075 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2fb8003a60 0x7f2fd0150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.807+0000 7f2fd4973700 1 --2- 172.21.15.37:0/3854170075 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2fd0154ba0 0x7f2fd00ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.807+0000 7f2fd4973700 1 -- 172.21.15.37:0/3854170075 >> 172.21.15.37:0/3854170075 conn(0x7f2fd00cc100 msgr2=0x7f2fd0098250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.807+0000 7f2fd4973700 1 -- 172.21.15.37:0/3854170075 shutdown_connections 2023-10-06T02:25:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.807+0000 7f2fd4973700 1 -- 172.21.15.37:0/3854170075 wait complete. 2023-10-06T02:25:51.821 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:51.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.944+0000 7f852ca51700 1 Processor -- start 2023-10-06T02:25:51.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.944+0000 7f852ca51700 1 -- start start 2023-10-06T02:25:51.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.945+0000 7f852ca51700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f85281596d0 0x7f85280b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:51.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.945+0000 7f852ca51700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8528159aa0 0x7f85280cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:51.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.945+0000 7f852ca51700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85280c5300 con 0x7f85280b3840 2023-10-06T02:25:51.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.945+0000 7f852ca51700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85280c6160 con 0x7f85281596d0 2023-10-06T02:25:51.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.945+0000 7f852ca51700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85280c5550 con 0x7f8528159aa0 2023-10-06T02:25:51.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.945+0000 7f8525d9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f85280b3840 0x7f85280c65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42204/0 (socket says 172.21.15.37:42204) 2023-10-06T02:25:51.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.945+0000 7f8525d9b700 1 -- 172.21.15.37:0/1328075693 learned_addr learned my addr 172.21.15.37:0/1328075693 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:51.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.945+0000 7f852559a700 1 -- 172.21.15.37:0/1328075693 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998379534 0 0) 0x7f85280c5300 con 0x7f85280b3840 2023-10-06T02:25:51.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.945+0000 7f852659c700 1 --2- 172.21.15.37:0/1328075693 >> v2:172.21.15.191:3300/0 conn(0x7f85281596d0 0x7f85280b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:51.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.945+0000 7f8526d9d700 1 --2- 172.21.15.37:0/1328075693 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8528159aa0 0x7f85280cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:51.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.945+0000 7f852559a700 1 -- 172.21.15.37:0/1328075693 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8510003570 con 0x7f85280b3840 2023-10-06T02:25:51.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.945+0000 7f852559a700 1 -- 172.21.15.37:0/1328075693 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4185842410 0 0) 0x7f8510003570 con 0x7f85280b3840 2023-10-06T02:25:51.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.945+0000 7f852559a700 1 -- 172.21.15.37:0/1328075693 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8528159aa0 msgr2=0x7f85280cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:51.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.945+0000 7f852559a700 1 --2- 172.21.15.37:0/1328075693 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8528159aa0 0x7f85280cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:51.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.945+0000 7f852559a700 1 -- 172.21.15.37:0/1328075693 >> v2:172.21.15.191:3300/0 conn(0x7f85281596d0 msgr2=0x7f85280b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:51.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.945+0000 7f852559a700 1 --2- 172.21.15.37:0/1328075693 >> v2:172.21.15.191:3300/0 conn(0x7f85281596d0 0x7f85280b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:51.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.945+0000 7f852559a700 1 -- 172.21.15.37:0/1328075693 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85280c5830 con 0x7f85280b3840 2023-10-06T02:25:51.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.945+0000 7f852559a700 1 -- 172.21.15.37:0/1328075693 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f851c001470 con 0x7f85280b3840 2023-10-06T02:25:51.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.945+0000 7f852559a700 1 -- 172.21.15.37:0/1328075693 >> v1:172.21.15.37:6789/0 conn(0x7f85280b3840 legacy=0x7f85280c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:51.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.946+0000 7f852559a700 1 --2- 172.21.15.37:0/1328075693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8510003a60 0x7f8510003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:51.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.946+0000 7f852559a700 1 --2- 172.21.15.37:0/1328075693 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8528159aa0 0x7f8510004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:51.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.946+0000 7f852559a700 1 --2- 172.21.15.37:0/1328075693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8510004d50 0x7f85100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:51.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.946+0000 7f852559a700 1 -- 172.21.15.37:0/1328075693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85280c6160 con 0x7f8510004d50 2023-10-06T02:25:51.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.946+0000 7f852559a700 1 -- 172.21.15.37:0/1328075693 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85280c5550 con 0x7f8510003a60 2023-10-06T02:25:51.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.946+0000 7f852559a700 1 -- 172.21.15.37:0/1328075693 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851000ba60 con 0x7f8528159aa0 2023-10-06T02:25:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.946+0000 7f8526d9d700 1 --2- 172.21.15.37:0/1328075693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8510004d50 0x7f85100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.946+0000 7f852659c700 1 --2- 172.21.15.37:0/1328075693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8510003a60 0x7f8510003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.946+0000 7f8525d9b700 1 --2- 172.21.15.37:0/1328075693 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8528159aa0 0x7f8510004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.946+0000 7f8526d9d700 1 -- 172.21.15.37:0/1328075693 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8528159aa0 msgr2=0x7f8510004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.946+0000 7f8526d9d700 1 --2- 172.21.15.37:0/1328075693 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8528159aa0 0x7f8510004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.946+0000 7f8526d9d700 1 -- 172.21.15.37:0/1328075693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8510003a60 msgr2=0x7f8510003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.946+0000 7f8526d9d700 1 --2- 172.21.15.37:0/1328075693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8510003a60 0x7f8510003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.946+0000 7f8526d9d700 1 -- 172.21.15.37:0/1328075693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8510003570 con 0x7f8510004d50 2023-10-06T02:25:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.946+0000 7f852659c700 1 --2- 172.21.15.37:0/1328075693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8510003a60 0x7f8510003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:51.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.946+0000 7f8526d9d700 1 --2- 172.21.15.37:0/1328075693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8510004d50 0x7f85100051c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f85280887d0 tx=0x7f852000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad7f9d937488c64b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:51.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.946+0000 7f852559a700 1 -- 172.21.15.37:0/1328075693 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852000e9a0 con 0x7f8510004d50 2023-10-06T02:25:51.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.946+0000 7f852559a700 1 -- 172.21.15.37:0/1328075693 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852000f040 con 0x7f8510004d50 2023-10-06T02:25:51.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.946+0000 7f852559a700 1 -- 172.21.15.37:0/1328075693 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852000ed50 con 0x7f8510004d50 2023-10-06T02:25:51.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.947+0000 7f852ca51700 1 -- 172.21.15.37:0/1328075693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8510004d50 msgr2=0x7f85100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:51.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.947+0000 7f852ca51700 1 --2- 172.21.15.37:0/1328075693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8510004d50 0x7f85100051c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f85280887d0 tx=0x7f852000b040 comp rx=0 tx=0).stop 2023-10-06T02:25:51.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.947+0000 7f8526d9d700 1 -- 172.21.15.37:0/1328075693 reap_dead start 2023-10-06T02:25:51.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.947+0000 7f852ca51700 1 -- 172.21.15.37:0/1328075693 shutdown_connections 2023-10-06T02:25:51.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.947+0000 7f852ca51700 1 -- 172.21.15.37:0/1328075693 >> 172.21.15.37:0/1328075693 conn(0x7f852806c890 msgr2=0x7f85280d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:51.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.947+0000 7f852ca51700 1 -- 172.21.15.37:0/1328075693 shutdown_connections 2023-10-06T02:25:51.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.947+0000 7f852ca51700 1 -- 172.21.15.37:0/1328075693 wait complete. 2023-10-06T02:25:51.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.948+0000 7f852ca51700 1 Processor -- start 2023-10-06T02:25:51.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.948+0000 7f852ca51700 1 -- start start 2023-10-06T02:25:51.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f852ca51700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8510004d50 0x7f85281694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:51.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f852ca51700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f852815a0f0 0x7f852815c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f852ca51700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8528152570 0x7f8528152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f852ca51700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85281550d0 con 0x7f8528152570 2023-10-06T02:25:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f852ca51700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852815a560 con 0x7f852815a0f0 2023-10-06T02:25:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f852ca51700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8528152f50 con 0x7f8510004d50 2023-10-06T02:25:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f8526d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8528152570 0x7f8528152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f8526d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8528152570 0x7f8528152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49634/0 (socket says 172.21.15.37:49634) 2023-10-06T02:25:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f8526d9d700 1 -- 172.21.15.37:0/3525826851 learned_addr learned my addr 172.21.15.37:0/3525826851 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f852659c700 1 --2- 172.21.15.37:0/3525826851 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8510004d50 0x7f85281694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f8525d9b700 1 --2- 172.21.15.37:0/3525826851 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f852815a0f0 0x7f852815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f8526d9d700 1 -- 172.21.15.37:0/3525826851 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8510004d50 msgr2=0x7f85281694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f8526d9d700 1 --2- 172.21.15.37:0/3525826851 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8510004d50 0x7f85281694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f8526d9d700 1 -- 172.21.15.37:0/3525826851 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f852815a0f0 msgr2=0x7f852815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:51.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f8526d9d700 1 --2- 172.21.15.37:0/3525826851 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f852815a0f0 0x7f852815c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:51.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f8526d9d700 1 -- 172.21.15.37:0/3525826851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852815a7d0 con 0x7f8528152570 2023-10-06T02:25:51.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f852659c700 1 --2- 172.21.15.37:0/3525826851 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8510004d50 0x7f85281694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:51.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f8525d9b700 1 --2- 172.21.15.37:0/3525826851 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f852815a0f0 0x7f852815c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:25:51.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f8526d9d700 1 --2- 172.21.15.37:0/3525826851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8528152570 0x7f8528152a10 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8528159ec0 tx=0x7f852001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:51.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f85167fc700 1 -- 172.21.15.37:0/3525826851 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852001d420 con 0x7f8528152570 2023-10-06T02:25:51.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f85167fc700 1 -- 172.21.15.37:0/3525826851 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852001d580 con 0x7f8528152570 2023-10-06T02:25:51.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.949+0000 7f852ca51700 1 -- 172.21.15.37:0/3525826851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852815aab0 con 0x7f8528152570 2023-10-06T02:25:51.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.950+0000 7f85167fc700 1 -- 172.21.15.37:0/3525826851 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852001d940 con 0x7f8528152570 2023-10-06T02:25:51.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.950+0000 7f852ca51700 1 -- 172.21.15.37:0/3525826851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852815b070 con 0x7f8528152570 2023-10-06T02:25:51.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.950+0000 7f852ca51700 1 -- 172.21.15.37:0/3525826851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f852806fbf0 con 0x7f8528152570 2023-10-06T02:25:51.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.951+0000 7f85167fc700 1 -- 172.21.15.37:0/3525826851 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f852001dd30 con 0x7f8528152570 2023-10-06T02:25:51.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.951+0000 7f85167fc700 1 --2- 172.21.15.37:0/3525826851 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8508066f30 0x7f85080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:51.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.951+0000 7f85167fc700 1 -- 172.21.15.37:0/3525826851 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8520085ff0 con 0x7f8528152570 2023-10-06T02:25:51.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.952+0000 7f852659c700 1 --2- 172.21.15.37:0/3525826851 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8508066f30 0x7f85080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:51.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.952+0000 7f852659c700 1 --2- 172.21.15.37:0/3525826851 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8508066f30 0x7f85080693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8518006f00 tx=0x7f8518008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:51.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:51.956+0000 7f85167fc700 1 -- 172.21.15.37:0/3525826851 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85200530e0 con 0x7f8528152570 2023-10-06T02:25:52.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.194+0000 7f852ca51700 1 -- 172.21.15.37:0/3525826851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85280d13e0 con 0x7f8528152570 2023-10-06T02:25:52.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.194+0000 7f85167fc700 1 -- 172.21.15.37:0/3525826851 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f8520018090 con 0x7f8528152570 2023-10-06T02:25:52.195 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:52.195 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/1914186828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1914186828},{"type":"v1","addr":"172.21.15.191:6836","nonce":1914186828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3684230798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":3684230798},{"type":"v1","addr":"172.21.15.191:6837","nonce":3684230798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1883185549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1883185549},{"type":"v1","addr":"172.21.15.37:6834","nonce":1883185549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:25:48.166318+0000","modified":"2023-10-06T02:25:51.793825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3956166862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3956166862},{"type":"v1","addr":"172.21.15.37:6835","nonce":3956166862}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:25:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.196+0000 7f852ca51700 1 -- 172.21.15.37:0/3525826851 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8508066f30 msgr2=0x7f85080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.196+0000 7f852ca51700 1 --2- 172.21.15.37:0/3525826851 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8508066f30 0x7f85080693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8518006f00 tx=0x7f8518008040 comp rx=0 tx=0).stop 2023-10-06T02:25:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.196+0000 7f852ca51700 1 -- 172.21.15.37:0/3525826851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8528152570 msgr2=0x7f8528152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.197+0000 7f852ca51700 1 --2- 172.21.15.37:0/3525826851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8528152570 0x7f8528152a10 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8528159ec0 tx=0x7f852001a000 comp rx=0 tx=0).stop 2023-10-06T02:25:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.197+0000 7f852ca51700 1 -- 172.21.15.37:0/3525826851 shutdown_connections 2023-10-06T02:25:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.197+0000 7f852ca51700 1 --2- 172.21.15.37:0/3525826851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8528152570 0x7f8528152a10 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.197+0000 7f852ca51700 1 --2- 172.21.15.37:0/3525826851 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8510004d50 0x7f85281694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.197+0000 7f852ca51700 1 --2- 172.21.15.37:0/3525826851 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8508066f30 0x7f85080693e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.197+0000 7f852ca51700 1 --2- 172.21.15.37:0/3525826851 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f852815a0f0 0x7f852815c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.197+0000 7f852ca51700 1 -- 172.21.15.37:0/3525826851 >> 172.21.15.37:0/3525826851 conn(0x7f852806c890 msgr2=0x7f85280cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.197+0000 7f852ca51700 1 -- 172.21.15.37:0/3525826851 shutdown_connections 2023-10-06T02:25:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.197+0000 7f852ca51700 1 -- 172.21.15.37:0/3525826851 wait complete. 2023-10-06T02:25:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 31 2023-10-06T02:25:52.209 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:25:52.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.327+0000 7fe3d5953700 1 Processor -- start 2023-10-06T02:25:52.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.327+0000 7fe3d5953700 1 -- start start 2023-10-06T02:25:52.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.328+0000 7fe3d5953700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe3d00b07e0 0x7fe3d00cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:52.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.328+0000 7fe3d5953700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d01587b0 con 0x7fe3d0157200 2023-10-06T02:25:52.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.328+0000 7fe3d5953700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d0157ba0 con 0x7fe3d00c8ed0 2023-10-06T02:25:52.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.328+0000 7fe3d5953700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d0157e80 con 0x7fe3d00b07e0 2023-10-06T02:25:52.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.328+0000 7fe3ceffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe3d0157200 0x7fe3d00c87c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42218/0 (socket says 172.21.15.37:42218) 2023-10-06T02:25:52.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.328+0000 7fe3ceffd700 1 -- 172.21.15.37:0/3774706533 learned_addr learned my addr 172.21.15.37:0/3774706533 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:52.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.328+0000 7fe3cf7fe700 1 --2- 172.21.15.37:0/3774706533 >> v2:172.21.15.191:3300/0 conn(0x7fe3d00b07e0 0x7fe3d00cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:52.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.328+0000 7fe3cdffb700 1 -- 172.21.15.37:0/3774706533 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727579574 0 0) 0x7fe3d01587b0 con 0x7fe3d0157200 2023-10-06T02:25:52.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.328+0000 7fe3cdffb700 1 -- 172.21.15.37:0/3774706533 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3bc003570 con 0x7fe3d0157200 2023-10-06T02:25:52.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.329+0000 7fe3cdffb700 1 -- 172.21.15.37:0/3774706533 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3111518758 0 0) 0x7fe3bc003570 con 0x7fe3d0157200 2023-10-06T02:25:52.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.329+0000 7fe3cf7fe700 1 -- 172.21.15.37:0/3774706533 >> v1:172.21.15.191:6789/0 conn(0x7fe3d00c8ed0 legacy=0x7fe3d00b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:52.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.329+0000 7fe3cf7fe700 1 -- 172.21.15.37:0/3774706533 >> v1:172.21.15.37:6789/0 conn(0x7fe3d0157200 legacy=0x7fe3d00c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:52.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.329+0000 7fe3cf7fe700 1 -- 172.21.15.37:0/3774706533 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d0158160 con 0x7fe3d00b07e0 2023-10-06T02:25:52.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.329+0000 7fe3cf7fe700 1 --2- 172.21.15.37:0/3774706533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3d00b07e0 0x7fe3d00cbd50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8006fd0 tx=0x7fe3c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b647bc1165fc19b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:52.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.329+0000 7fe3cdffb700 1 -- 172.21.15.37:0/3774706533 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c00017f0 con 0x7fe3d00b07e0 2023-10-06T02:25:52.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.329+0000 7fe3cdffb700 1 -- 172.21.15.37:0/3774706533 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c8005a50 con 0x7fe3d00b07e0 2023-10-06T02:25:52.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.329+0000 7fe3cdffb700 1 -- 172.21.15.37:0/3774706533 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8005e10 con 0x7fe3d00b07e0 2023-10-06T02:25:52.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.330+0000 7fe3d5953700 1 -- 172.21.15.37:0/3774706533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3d00b07e0 msgr2=0x7fe3d00cbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:52.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.330+0000 7fe3d5953700 1 --2- 172.21.15.37:0/3774706533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3d00b07e0 0x7fe3d00cbd50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8006fd0 tx=0x7fe3c80091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.330+0000 7fe3d5953700 1 -- 172.21.15.37:0/3774706533 shutdown_connections 2023-10-06T02:25:52.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.330+0000 7fe3d5953700 1 --2- 172.21.15.37:0/3774706533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3d00b07e0 0x7fe3d00cbd50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.330+0000 7fe3d5953700 1 -- 172.21.15.37:0/3774706533 >> 172.21.15.37:0/3774706533 conn(0x7fe3d006c0b0 msgr2=0x7fe3d006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:52.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.330+0000 7fe3d5953700 1 -- 172.21.15.37:0/3774706533 shutdown_connections 2023-10-06T02:25:52.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.330+0000 7fe3d5953700 1 -- 172.21.15.37:0/3774706533 wait complete. 2023-10-06T02:25:52.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.331+0000 7fe3d5953700 1 Processor -- start 2023-10-06T02:25:52.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.331+0000 7fe3d5953700 1 -- start start 2023-10-06T02:25:52.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3d5953700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3d00b07e0 0x7fe3d0147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:52.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3d5953700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d00c8ed0 0x7fe3d00cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:52.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3d5953700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3d0157200 0x7fe3d00ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:52.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3d5953700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00c6470 con 0x7fe3d00c8ed0 2023-10-06T02:25:52.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3d5953700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00c5fe0 con 0x7fe3d00b07e0 2023-10-06T02:25:52.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3d5953700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00c53d0 con 0x7fe3d0157200 2023-10-06T02:25:52.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3ce7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d00c8ed0 0x7fe3d00cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:52.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3ce7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d00c8ed0 0x7fe3d00cca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49644/0 (socket says 172.21.15.37:49644) 2023-10-06T02:25:52.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3ce7fc700 1 -- 172.21.15.37:0/1701549775 learned_addr learned my addr 172.21.15.37:0/1701549775 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:52.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3ceffd700 1 --2- 172.21.15.37:0/1701549775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3d00b07e0 0x7fe3d0147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:52.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3cf7fe700 1 --2- 172.21.15.37:0/1701549775 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3d0157200 0x7fe3d00ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:52.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3ce7fc700 1 -- 172.21.15.37:0/1701549775 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3d0157200 msgr2=0x7fe3d00ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:52.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3ce7fc700 1 --2- 172.21.15.37:0/1701549775 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3d0157200 0x7fe3d00ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3ce7fc700 1 -- 172.21.15.37:0/1701549775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3d00b07e0 msgr2=0x7fe3d0147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:52.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3ce7fc700 1 --2- 172.21.15.37:0/1701549775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3d00b07e0 0x7fe3d0147bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3ce7fc700 1 -- 172.21.15.37:0/1701549775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8009420 con 0x7fe3d00c8ed0 2023-10-06T02:25:52.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3ceffd700 1 --2- 172.21.15.37:0/1701549775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3d00b07e0 0x7fe3d0147bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:52.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3cf7fe700 1 --2- 172.21.15.37:0/1701549775 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3d0157200 0x7fe3d00ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:52.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3ce7fc700 1 --2- 172.21.15.37:0/1701549775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d00c8ed0 0x7fe3d00cca20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe3b800c790 tx=0x7fe3b8007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:52.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3c6ffd700 1 -- 172.21.15.37:0/1701549775 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8011590 con 0x7fe3d00c8ed0 2023-10-06T02:25:52.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3c6ffd700 1 -- 172.21.15.37:0/1701549775 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b80116f0 con 0x7fe3d00c8ed0 2023-10-06T02:25:52.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3d5953700 1 -- 172.21.15.37:0/1701549775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d00c56b0 con 0x7fe3d00c8ed0 2023-10-06T02:25:52.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.332+0000 7fe3c6ffd700 1 -- 172.21.15.37:0/1701549775 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8011ab0 con 0x7fe3d00c8ed0 2023-10-06T02:25:52.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.333+0000 7fe3d5953700 1 -- 172.21.15.37:0/1701549775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d00c5c70 con 0x7fe3d00c8ed0 2023-10-06T02:25:52.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.333+0000 7fe3d5953700 1 -- 172.21.15.37:0/1701549775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d0064160 con 0x7fe3d00c8ed0 2023-10-06T02:25:52.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.334+0000 7fe3c6ffd700 1 -- 172.21.15.37:0/1701549775 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3b801a360 con 0x7fe3d00c8ed0 2023-10-06T02:25:52.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.334+0000 7fe3c6ffd700 1 --2- 172.21.15.37:0/1701549775 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe3b0066f30 0x7fe3b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:52.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.334+0000 7fe3c6ffd700 1 -- 172.21.15.37:0/1701549775 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe3b8083750 con 0x7fe3d00c8ed0 2023-10-06T02:25:52.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.335+0000 7fe3ceffd700 1 --2- 172.21.15.37:0/1701549775 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe3b0066f30 0x7fe3b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:52.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.335+0000 7fe3ceffd700 1 --2- 172.21.15.37:0/1701549775 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe3b0066f30 0x7fe3b00693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0007fd0 tx=0x7fe3c0000f40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:52.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.339+0000 7fe3c6ffd700 1 -- 172.21.15.37:0/1701549775 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3b8050860 con 0x7fe3d00c8ed0 2023-10-06T02:25:52.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.534+0000 7fe3d5953700 1 -- 172.21.15.37:0/1701549775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3d00c6150 con 0x7fe3d00c8ed0 2023-10-06T02:25:52.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.535+0000 7fe3c6ffd700 1 -- 172.21.15.37:0/1701549775 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16868 (secure 0 0 0) 0x7fe3b8053e80 con 0x7fe3d00c8ed0 2023-10-06T02:25:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:52.536 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":57,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:25:49.782471+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:25:45.900917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T02:25:47.150749+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:25:52.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.537+0000 7fe3d5953700 1 -- 172.21.15.37:0/1701549775 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe3b0066f30 msgr2=0x7fe3b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:52.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.537+0000 7fe3d5953700 1 --2- 172.21.15.37:0/1701549775 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe3b0066f30 0x7fe3b00693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0007fd0 tx=0x7fe3c0000f40 comp rx=0 tx=0).stop 2023-10-06T02:25:52.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.537+0000 7fe3d5953700 1 -- 172.21.15.37:0/1701549775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d00c8ed0 msgr2=0x7fe3d00cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:52.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.537+0000 7fe3d5953700 1 --2- 172.21.15.37:0/1701549775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d00c8ed0 0x7fe3d00cca20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe3b800c790 tx=0x7fe3b8007f20 comp rx=0 tx=0).stop 2023-10-06T02:25:52.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.537+0000 7fe3d5953700 1 -- 172.21.15.37:0/1701549775 shutdown_connections 2023-10-06T02:25:52.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.537+0000 7fe3d5953700 1 --2- 172.21.15.37:0/1701549775 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3d0157200 0x7fe3d00ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.537+0000 7fe3d5953700 1 --2- 172.21.15.37:0/1701549775 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe3b0066f30 0x7fe3b00693e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.537+0000 7fe3d5953700 1 --2- 172.21.15.37:0/1701549775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3d00b07e0 0x7fe3d0147bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.537+0000 7fe3d5953700 1 --2- 172.21.15.37:0/1701549775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d00c8ed0 0x7fe3d00cca20 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.537+0000 7fe3d5953700 1 -- 172.21.15.37:0/1701549775 >> 172.21.15.37:0/1701549775 conn(0x7fe3d006c0b0 msgr2=0x7fe3d0158fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:52.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.537+0000 7fe3d5953700 1 -- 172.21.15.37:0/1701549775 shutdown_connections 2023-10-06T02:25:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.537+0000 7fe3d5953700 1 -- 172.21.15.37:0/1701549775 wait complete. 2023-10-06T02:25:52.550 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:25:52.550 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:25:52.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.668+0000 7fc384368700 1 Processor -- start 2023-10-06T02:25:52.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.668+0000 7fc384368700 1 -- start start 2023-10-06T02:25:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.669+0000 7fc384368700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc37c0b3fb0 0x7fc37c067a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.669+0000 7fc384368700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc37c15be40 0x7fc37c067f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.669+0000 7fc384368700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37c158db0 con 0x7fc37c0b3be0 2023-10-06T02:25:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.669+0000 7fc384368700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37c1582f0 con 0x7fc37c15be40 2023-10-06T02:25:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.669+0000 7fc384368700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0cc2f0 con 0x7fc37c0b3fb0 2023-10-06T02:25:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.670+0000 7fc382905700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc37c15be40 0x7fc37c067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.670+0000 7fc381903700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc37c0b3fb0 0x7fc37c067a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.670+0000 7fc381903700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc37c0b3fb0 0x7fc37c067a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:50226/0 (socket says 172.21.15.37:50226) 2023-10-06T02:25:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.670+0000 7fc381903700 1 -- 172.21.15.37:0/2595582010 learned_addr learned my addr 172.21.15.37:0/2595582010 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.670+0000 7fc382905700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc37c15be40 0x7fc37c067f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:33226/0 (socket says 172.21.15.37:33226) 2023-10-06T02:25:52.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.670+0000 7fc381903700 1 -- 172.21.15.37:0/2595582010 >> v2:172.21.15.191:3300/0 conn(0x7fc37c15be40 msgr2=0x7fc37c067f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:52.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.670+0000 7fc381903700 1 --2- 172.21.15.37:0/2595582010 >> v2:172.21.15.191:3300/0 conn(0x7fc37c15be40 0x7fc37c067f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.670+0000 7fc381903700 1 -- 172.21.15.37:0/2595582010 >> v1:172.21.15.191:6789/0 conn(0x7fc37c0b3be0 legacy=0x7fc37c157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:52.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.670+0000 7fc381903700 1 -- 172.21.15.37:0/2595582010 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c0cd790 con 0x7fc37c0b3fb0 2023-10-06T02:25:52.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.670+0000 7fc381903700 1 --2- 172.21.15.37:0/2595582010 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc37c0b3fb0 0x7fc37c067a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc3700099b0 tx=0x7fc370009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a085603ca6e4c1b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:52.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.670+0000 7fc381102700 1 -- 172.21.15.37:0/2595582010 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc370009ea0 con 0x7fc37c0b3fb0 2023-10-06T02:25:52.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.670+0000 7fc381102700 1 -- 172.21.15.37:0/2595582010 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37000b860 con 0x7fc37c0b3fb0 2023-10-06T02:25:52.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.670+0000 7fc381102700 1 -- 172.21.15.37:0/2595582010 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37000bc00 con 0x7fc37c0b3fb0 2023-10-06T02:25:52.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.671+0000 7fc384368700 1 -- 172.21.15.37:0/2595582010 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc37c0b3fb0 msgr2=0x7fc37c067a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:52.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.671+0000 7fc384368700 1 --2- 172.21.15.37:0/2595582010 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc37c0b3fb0 0x7fc37c067a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc3700099b0 tx=0x7fc370009250 comp rx=0 tx=0).stop 2023-10-06T02:25:52.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.671+0000 7fc384368700 1 -- 172.21.15.37:0/2595582010 shutdown_connections 2023-10-06T02:25:52.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.671+0000 7fc384368700 1 --2- 172.21.15.37:0/2595582010 >> v2:172.21.15.191:3300/0 conn(0x7fc37c15be40 0x7fc37c067f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.671+0000 7fc384368700 1 --2- 172.21.15.37:0/2595582010 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc37c0b3fb0 0x7fc37c067a30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.671+0000 7fc384368700 1 -- 172.21.15.37:0/2595582010 >> 172.21.15.37:0/2595582010 conn(0x7fc37c0ce330 msgr2=0x7fc37c0ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:52.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.671+0000 7fc384368700 1 -- 172.21.15.37:0/2595582010 shutdown_connections 2023-10-06T02:25:52.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.671+0000 7fc384368700 1 -- 172.21.15.37:0/2595582010 wait complete. 2023-10-06T02:25:52.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.672+0000 7fc384368700 1 Processor -- start 2023-10-06T02:25:52.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.672+0000 7fc384368700 1 -- start start 2023-10-06T02:25:52.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.673+0000 7fc384368700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc37c0b3be0 0x7fc37c145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:52.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.673+0000 7fc384368700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc37c0b3fb0 0x7fc37c15a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:52.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.673+0000 7fc384368700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37c15be40 0x7fc37c15a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:52.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.673+0000 7fc384368700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0c3d80 con 0x7fc37c15be40 2023-10-06T02:25:52.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.673+0000 7fc384368700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0c3170 con 0x7fc37c0b3be0 2023-10-06T02:25:52.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.673+0000 7fc384368700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0c3450 con 0x7fc37c0b3fb0 2023-10-06T02:25:52.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.673+0000 7fc382905700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37c15be40 0x7fc37c15a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:52.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.673+0000 7fc382905700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37c15be40 0x7fc37c15a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49648/0 (socket says 172.21.15.37:49648) 2023-10-06T02:25:52.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.673+0000 7fc382905700 1 -- 172.21.15.37:0/2890778587 learned_addr learned my addr 172.21.15.37:0/2890778587 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:52.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.673+0000 7fc382104700 1 --2- 172.21.15.37:0/2890778587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc37c0b3be0 0x7fc37c145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:52.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.673+0000 7fc381903700 1 --2- 172.21.15.37:0/2890778587 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc37c0b3fb0 0x7fc37c15a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.673+0000 7fc382905700 1 -- 172.21.15.37:0/2890778587 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc37c0b3fb0 msgr2=0x7fc37c15a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.673+0000 7fc382905700 1 --2- 172.21.15.37:0/2890778587 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc37c0b3fb0 0x7fc37c15a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.673+0000 7fc382905700 1 -- 172.21.15.37:0/2890778587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc37c0b3be0 msgr2=0x7fc37c145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.673+0000 7fc382905700 1 --2- 172.21.15.37:0/2890778587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc37c0b3be0 0x7fc37c145fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.673+0000 7fc382905700 1 -- 172.21.15.37:0/2890778587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3700094f0 con 0x7fc37c15be40 2023-10-06T02:25:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.673+0000 7fc382905700 1 --2- 172.21.15.37:0/2890778587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37c15be40 0x7fc37c15a6d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc37400e8d0 tx=0x7fc3740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.674+0000 7fc37a7fc700 1 -- 172.21.15.37:0/2890778587 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37400ee70 con 0x7fc37c15be40 2023-10-06T02:25:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.674+0000 7fc37a7fc700 1 -- 172.21.15.37:0/2890778587 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37400c850 con 0x7fc37c15be40 2023-10-06T02:25:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.674+0000 7fc384368700 1 -- 172.21.15.37:0/2890778587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37c0c3730 con 0x7fc37c15be40 2023-10-06T02:25:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.674+0000 7fc37a7fc700 1 -- 172.21.15.37:0/2890778587 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37400cc50 con 0x7fc37c15be40 2023-10-06T02:25:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.674+0000 7fc384368700 1 -- 172.21.15.37:0/2890778587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37c146520 con 0x7fc37c15be40 2023-10-06T02:25:52.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.675+0000 7fc384368700 1 -- 172.21.15.37:0/2890778587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc37c0c3ef0 con 0x7fc37c15be40 2023-10-06T02:25:52.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.675+0000 7fc37a7fc700 1 -- 172.21.15.37:0/2890778587 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc374013680 con 0x7fc37c15be40 2023-10-06T02:25:52.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.675+0000 7fc37a7fc700 1 --2- 172.21.15.37:0/2890778587 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc368066f30 0x7fc3680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:52.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.676+0000 7fc37a7fc700 1 -- 172.21.15.37:0/2890778587 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc374084850 con 0x7fc37c15be40 2023-10-06T02:25:52.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.676+0000 7fc382104700 1 --2- 172.21.15.37:0/2890778587 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc368066f30 0x7fc3680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:52.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.676+0000 7fc382104700 1 --2- 172.21.15.37:0/2890778587 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc368066f30 0x7fc3680693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00e230 tx=0x7fc36c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:52.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.680+0000 7fc37a7fc700 1 -- 172.21.15.37:0/2890778587 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc374051960 con 0x7fc37c15be40 2023-10-06T02:25:52.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.868+0000 7fc384368700 1 -- 172.21.15.37:0/2890778587 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc37c1579c0 con 0x7fc368066f30 2023-10-06T02:25:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.877+0000 7fc37a7fc700 1 -- 172.21.15.37:0/2890778587 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308943 (secure 0 0 0) 0x7fc37c1579c0 con 0x7fc368066f30 2023-10-06T02:25:52.881 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:52.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.880+0000 7fc384368700 1 -- 172.21.15.37:0/2890778587 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc368066f30 msgr2=0x7fc3680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.880+0000 7fc384368700 1 --2- 172.21.15.37:0/2890778587 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc368066f30 0x7fc3680693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00e230 tx=0x7fc36c009040 comp rx=0 tx=0).stop 2023-10-06T02:25:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.880+0000 7fc384368700 1 -- 172.21.15.37:0/2890778587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37c15be40 msgr2=0x7fc37c15a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.880+0000 7fc384368700 1 --2- 172.21.15.37:0/2890778587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37c15be40 0x7fc37c15a6d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc37400e8d0 tx=0x7fc3740091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.880+0000 7fc384368700 1 -- 172.21.15.37:0/2890778587 shutdown_connections 2023-10-06T02:25:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.880+0000 7fc384368700 1 --2- 172.21.15.37:0/2890778587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37c15be40 0x7fc37c15a6d0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.880+0000 7fc384368700 1 --2- 172.21.15.37:0/2890778587 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc368066f30 0x7fc3680693e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.880+0000 7fc384368700 1 --2- 172.21.15.37:0/2890778587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc37c0b3be0 0x7fc37c145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.880+0000 7fc384368700 1 --2- 172.21.15.37:0/2890778587 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc37c0b3fb0 0x7fc37c15a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.880+0000 7fc384368700 1 -- 172.21.15.37:0/2890778587 >> 172.21.15.37:0/2890778587 conn(0x7fc37c0ce330 msgr2=0x7fc37c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.880+0000 7fc384368700 1 -- 172.21.15.37:0/2890778587 shutdown_connections 2023-10-06T02:25:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:52.881+0000 7fc384368700 1 -- 172.21.15.37:0/2890778587 wait complete. 2023-10-06T02:25:52.885 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:25:52.893 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2023-10-06T02:25:52.546690+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384580,"kb_used_data":6276,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590140,"statfs":{"total":773094113280,"available":770652303360,"internally_reserved":0,"allocated":6426624,"data_stored":3446853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.788204"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762779+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:48.969007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762329+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:43.827759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771263+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:03.991817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765977+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:18.739198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767718+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:20.191318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767613+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:37.913721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770406+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:16.823479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.776090+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:53.382091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771176+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:57.656013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771243+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:41.394648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767034+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:15.007098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.778100+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:37.561344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.778213+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:23.103556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768638+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:46.321524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.769330+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:23.103556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771508+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:27.557897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762241+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:25.981569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.766332+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:23.618730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770887+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:03.082588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767580+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:01.275354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.777405+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:23.618730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767511+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:41.394648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768061+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:14.533092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.769284+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:23.618730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.777454+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:21.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.778548+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:15.227230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.766594+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:21.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.763060+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:25.687797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768709+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:15.007098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.777547+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:46.321524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765879+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:53.382091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768311+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:33.984884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.772465+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:59.518906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.779666+0000","last_change":"2023-10-06T02:25:47.779666+0000","last_active":"2023-10-06T02:25:47.779666+0000","last_peered":"2023-10-06T02:25:47.779666+0000","last_clean":"2023-10-06T02:25:47.779666+0000","last_became_active":"2023-10-06T02:25:47.779228+0000","last_became_peered":"2023-10-06T02:25:47.779228+0000","last_unstale":"2023-10-06T02:25:47.779666+0000","last_undegraded":"2023-10-06T02:25:47.779666+0000","last_fullsized":"2023-10-06T02:25:47.779666+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:21.300373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765954+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:09.893223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.778547+0000","last_change":"2023-10-06T02:25:47.778547+0000","last_active":"2023-10-06T02:25:47.778547+0000","last_peered":"2023-10-06T02:25:47.778547+0000","last_clean":"2023-10-06T02:25:47.778547+0000","last_became_active":"2023-10-06T02:25:47.778062+0000","last_became_peered":"2023-10-06T02:25:47.778062+0000","last_unstale":"2023-10-06T02:25:47.778547+0000","last_undegraded":"2023-10-06T02:25:47.778547+0000","last_fullsized":"2023-10-06T02:25:47.778547+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:22.094876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768128+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:52.758045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.781462+0000","last_change":"2023-10-06T02:25:47.781462+0000","last_active":"2023-10-06T02:25:47.781462+0000","last_peered":"2023-10-06T02:25:47.781462+0000","last_clean":"2023-10-06T02:25:47.781462+0000","last_became_active":"2023-10-06T02:25:47.781039+0000","last_became_peered":"2023-10-06T02:25:47.781039+0000","last_unstale":"2023-10-06T02:25:47.781462+0000","last_undegraded":"2023-10-06T02:25:47.781462+0000","last_fullsized":"2023-10-06T02:25:47.781462+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:56.647333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.769083+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:37.561344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.772551+0000","last_change":"2023-10-06T02:25:47.772551+0000","last_active":"2023-10-06T02:25:47.772551+0000","last_peered":"2023-10-06T02:25:47.772551+0000","last_clean":"2023-10-06T02:25:47.772551+0000","last_became_active":"2023-10-06T02:25:47.772269+0000","last_became_peered":"2023-10-06T02:25:47.772269+0000","last_unstale":"2023-10-06T02:25:47.772551+0000","last_undegraded":"2023-10-06T02:25:47.772551+0000","last_fullsized":"2023-10-06T02:25:47.772551+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:36.552664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770593+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:25.885346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.775941+0000","last_change":"2023-10-06T02:25:47.775941+0000","last_active":"2023-10-06T02:25:47.775941+0000","last_peered":"2023-10-06T02:25:47.775941+0000","last_clean":"2023-10-06T02:25:47.775941+0000","last_became_active":"2023-10-06T02:25:47.775677+0000","last_became_peered":"2023-10-06T02:25:47.775677+0000","last_unstale":"2023-10-06T02:25:47.775941+0000","last_undegraded":"2023-10-06T02:25:47.775941+0000","last_fullsized":"2023-10-06T02:25:47.775941+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:14.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762044+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:21.678499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.776075+0000","last_change":"2023-10-06T02:25:47.776075+0000","last_active":"2023-10-06T02:25:47.776075+0000","last_peered":"2023-10-06T02:25:47.776075+0000","last_clean":"2023-10-06T02:25:47.776075+0000","last_became_active":"2023-10-06T02:25:47.775812+0000","last_became_peered":"2023-10-06T02:25:47.775812+0000","last_unstale":"2023-10-06T02:25:47.776075+0000","last_undegraded":"2023-10-06T02:25:47.776075+0000","last_fullsized":"2023-10-06T02:25:47.776075+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:20.646833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.773984+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:24.538628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.782265+0000","last_change":"2023-10-06T02:25:47.782265+0000","last_active":"2023-10-06T02:25:47.782265+0000","last_peered":"2023-10-06T02:25:47.782265+0000","last_clean":"2023-10-06T02:25:47.782265+0000","last_became_active":"2023-10-06T02:25:47.781984+0000","last_became_peered":"2023-10-06T02:25:47.781984+0000","last_unstale":"2023-10-06T02:25:47.782265+0000","last_undegraded":"2023-10-06T02:25:47.782265+0000","last_fullsized":"2023-10-06T02:25:47.782265+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:13.998418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768306+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:03.991817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.776645+0000","last_change":"2023-10-06T02:25:47.776645+0000","last_active":"2023-10-06T02:25:47.776645+0000","last_peered":"2023-10-06T02:25:47.776645+0000","last_clean":"2023-10-06T02:25:47.776645+0000","last_became_active":"2023-10-06T02:25:47.776222+0000","last_became_peered":"2023-10-06T02:25:47.776222+0000","last_unstale":"2023-10-06T02:25:47.776645+0000","last_undegraded":"2023-10-06T02:25:47.776645+0000","last_fullsized":"2023-10-06T02:25:47.776645+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:03.400305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762646+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:10.359414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.783911+0000","last_change":"2023-10-06T02:25:47.783911+0000","last_active":"2023-10-06T02:25:47.783911+0000","last_peered":"2023-10-06T02:25:47.783911+0000","last_clean":"2023-10-06T02:25:47.783911+0000","last_became_active":"2023-10-06T02:25:47.783672+0000","last_became_peered":"2023-10-06T02:25:47.783672+0000","last_unstale":"2023-10-06T02:25:47.783911+0000","last_undegraded":"2023-10-06T02:25:47.783911+0000","last_fullsized":"2023-10-06T02:25:47.783911+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:53.337356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768353+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:57.656013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.774544+0000","last_change":"2023-10-06T02:25:47.774544+0000","last_active":"2023-10-06T02:25:47.774544+0000","last_peered":"2023-10-06T02:25:47.774544+0000","last_clean":"2023-10-06T02:25:47.774544+0000","last_became_active":"2023-10-06T02:25:47.773704+0000","last_became_peered":"2023-10-06T02:25:47.773704+0000","last_unstale":"2023-10-06T02:25:47.774544+0000","last_undegraded":"2023-10-06T02:25:47.774544+0000","last_fullsized":"2023-10-06T02:25:47.774544+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:04.612716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.772791+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:39.144943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.781564+0000","last_change":"2023-10-06T02:25:47.781564+0000","last_active":"2023-10-06T02:25:47.781564+0000","last_peered":"2023-10-06T02:25:47.781564+0000","last_clean":"2023-10-06T02:25:47.781564+0000","last_became_active":"2023-10-06T02:25:47.781157+0000","last_became_peered":"2023-10-06T02:25:47.781157+0000","last_unstale":"2023-10-06T02:25:47.781564+0000","last_undegraded":"2023-10-06T02:25:47.781564+0000","last_fullsized":"2023-10-06T02:25:47.781564+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:37.047439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765749+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:54.346036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.774248+0000","last_change":"2023-10-06T02:25:47.774248+0000","last_active":"2023-10-06T02:25:47.774248+0000","last_peered":"2023-10-06T02:25:47.774248+0000","last_clean":"2023-10-06T02:25:47.774248+0000","last_became_active":"2023-10-06T02:25:47.773967+0000","last_became_peered":"2023-10-06T02:25:47.773967+0000","last_unstale":"2023-10-06T02:25:47.774248+0000","last_undegraded":"2023-10-06T02:25:47.774248+0000","last_fullsized":"2023-10-06T02:25:47.774248+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:19.027538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765332+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:35.551701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.782266+0000","last_change":"2023-10-06T02:25:47.782266+0000","last_active":"2023-10-06T02:25:47.782266+0000","last_peered":"2023-10-06T02:25:47.782266+0000","last_clean":"2023-10-06T02:25:47.782266+0000","last_became_active":"2023-10-06T02:25:47.781819+0000","last_became_peered":"2023-10-06T02:25:47.781819+0000","last_unstale":"2023-10-06T02:25:47.782266+0000","last_undegraded":"2023-10-06T02:25:47.782266+0000","last_fullsized":"2023-10-06T02:25:47.782266+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:20.653387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.776962+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:18.739198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.783305+0000","last_change":"2023-10-06T02:25:47.783305+0000","last_active":"2023-10-06T02:25:47.783305+0000","last_peered":"2023-10-06T02:25:47.783305+0000","last_clean":"2023-10-06T02:25:47.783305+0000","last_became_active":"2023-10-06T02:25:47.783026+0000","last_became_peered":"2023-10-06T02:25:47.783026+0000","last_unstale":"2023-10-06T02:25:47.783305+0000","last_undegraded":"2023-10-06T02:25:47.783305+0000","last_fullsized":"2023-10-06T02:25:47.783305+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:53.337356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.773523+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:11:03.662406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.780895+0000","last_change":"2023-10-06T02:25:47.780895+0000","last_active":"2023-10-06T02:25:47.780895+0000","last_peered":"2023-10-06T02:25:47.780895+0000","last_clean":"2023-10-06T02:25:47.780895+0000","last_became_active":"2023-10-06T02:25:47.780602+0000","last_became_peered":"2023-10-06T02:25:47.780602+0000","last_unstale":"2023-10-06T02:25:47.780895+0000","last_undegraded":"2023-10-06T02:25:47.780895+0000","last_fullsized":"2023-10-06T02:25:47.780895+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:08.884543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762767+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:54.359817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.779687+0000","last_change":"2023-10-06T02:25:47.779687+0000","last_active":"2023-10-06T02:25:47.779687+0000","last_peered":"2023-10-06T02:25:47.779687+0000","last_clean":"2023-10-06T02:25:47.779687+0000","last_became_active":"2023-10-06T02:25:47.779422+0000","last_became_peered":"2023-10-06T02:25:47.779422+0000","last_unstale":"2023-10-06T02:25:47.779687+0000","last_undegraded":"2023-10-06T02:25:47.779687+0000","last_fullsized":"2023-10-06T02:25:47.779687+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:06.807270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767455+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:14.533092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.789740+0000","last_change":"2023-10-06T02:25:47.789740+0000","last_active":"2023-10-06T02:25:47.789740+0000","last_peered":"2023-10-06T02:25:47.789740+0000","last_clean":"2023-10-06T02:25:47.789740+0000","last_became_active":"2023-10-06T02:25:47.789419+0000","last_became_peered":"2023-10-06T02:25:47.789419+0000","last_unstale":"2023-10-06T02:25:47.789740+0000","last_undegraded":"2023-10-06T02:25:47.789740+0000","last_fullsized":"2023-10-06T02:25:47.789740+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:20.653387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770463+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:54.727662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.780940+0000","last_change":"2023-10-06T02:25:47.780940+0000","last_active":"2023-10-06T02:25:47.780940+0000","last_peered":"2023-10-06T02:25:47.780940+0000","last_clean":"2023-10-06T02:25:47.780940+0000","last_became_active":"2023-10-06T02:25:47.780649+0000","last_became_peered":"2023-10-06T02:25:47.780649+0000","last_unstale":"2023-10-06T02:25:47.780940+0000","last_undegraded":"2023-10-06T02:25:47.780940+0000","last_fullsized":"2023-10-06T02:25:47.780940+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:06.807270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.778042+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:15.007098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.781285+0000","last_change":"2023-10-06T02:25:47.781285+0000","last_active":"2023-10-06T02:25:47.781285+0000","last_peered":"2023-10-06T02:25:47.781285+0000","last_clean":"2023-10-06T02:25:47.781285+0000","last_became_active":"2023-10-06T02:25:47.780775+0000","last_became_peered":"2023-10-06T02:25:47.780775+0000","last_unstale":"2023-10-06T02:25:47.781285+0000","last_undegraded":"2023-10-06T02:25:47.781285+0000","last_fullsized":"2023-10-06T02:25:47.781285+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.703535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771436+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:03.303783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.774115+0000","last_change":"2023-10-06T02:25:47.774115+0000","last_active":"2023-10-06T02:25:47.774115+0000","last_peered":"2023-10-06T02:25:47.774115+0000","last_clean":"2023-10-06T02:25:47.774115+0000","last_became_active":"2023-10-06T02:25:47.773648+0000","last_became_peered":"2023-10-06T02:25:47.773648+0000","last_unstale":"2023-10-06T02:25:47.774115+0000","last_undegraded":"2023-10-06T02:25:47.774115+0000","last_fullsized":"2023-10-06T02:25:47.774115+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:12.915334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768826+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:20.440565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.780245+0000","last_change":"2023-10-06T02:25:47.780245+0000","last_active":"2023-10-06T02:25:47.780245+0000","last_peered":"2023-10-06T02:25:47.780245+0000","last_clean":"2023-10-06T02:25:47.780245+0000","last_became_active":"2023-10-06T02:25:47.779986+0000","last_became_peered":"2023-10-06T02:25:47.779986+0000","last_unstale":"2023-10-06T02:25:47.780245+0000","last_undegraded":"2023-10-06T02:25:47.780245+0000","last_fullsized":"2023-10-06T02:25:47.780245+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:52.373411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765370+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:38.056119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.773995+0000","last_change":"2023-10-06T02:25:47.773995+0000","last_active":"2023-10-06T02:25:47.773995+0000","last_peered":"2023-10-06T02:25:47.773995+0000","last_clean":"2023-10-06T02:25:47.773995+0000","last_became_active":"2023-10-06T02:25:47.773707+0000","last_became_peered":"2023-10-06T02:25:47.773707+0000","last_unstale":"2023-10-06T02:25:47.773995+0000","last_undegraded":"2023-10-06T02:25:47.773995+0000","last_fullsized":"2023-10-06T02:25:47.773995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:36.552664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762082+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:31.177238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.780787+0000","last_change":"2023-10-06T02:25:47.780787+0000","last_active":"2023-10-06T02:25:47.780787+0000","last_peered":"2023-10-06T02:25:47.780787+0000","last_clean":"2023-10-06T02:25:47.780787+0000","last_became_active":"2023-10-06T02:25:47.780419+0000","last_became_peered":"2023-10-06T02:25:47.780419+0000","last_unstale":"2023-10-06T02:25:47.780787+0000","last_undegraded":"2023-10-06T02:25:47.780787+0000","last_fullsized":"2023-10-06T02:25:47.780787+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:45.312844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770517+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:13:49.398898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.777859+0000","last_change":"2023-10-06T02:25:47.777859+0000","last_active":"2023-10-06T02:25:47.777859+0000","last_peered":"2023-10-06T02:25:47.777859+0000","last_clean":"2023-10-06T02:25:47.777859+0000","last_became_active":"2023-10-06T02:25:47.777513+0000","last_became_peered":"2023-10-06T02:25:47.777513+0000","last_unstale":"2023-10-06T02:25:47.777859+0000","last_undegraded":"2023-10-06T02:25:47.777859+0000","last_fullsized":"2023-10-06T02:25:47.777859+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:40.898787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765775+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:15.256053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.781385+0000","last_change":"2023-10-06T02:25:47.781385+0000","last_active":"2023-10-06T02:25:47.781385+0000","last_peered":"2023-10-06T02:25:47.781385+0000","last_clean":"2023-10-06T02:25:47.781385+0000","last_became_active":"2023-10-06T02:25:47.780787+0000","last_became_peered":"2023-10-06T02:25:47.780787+0000","last_unstale":"2023-10-06T02:25:47.781385+0000","last_undegraded":"2023-10-06T02:25:47.781385+0000","last_fullsized":"2023-10-06T02:25:47.781385+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:34.543022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.765591+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:25:46.765591+0000","last_peered":"2023-10-06T02:25:46.765591+0000","last_clean":"2023-10-06T02:25:46.765591+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:25:46.765591+0000","last_undegraded":"2023-10-06T02:25:46.765591+0000","last_fullsized":"2023-10-06T02:25:46.765591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771919+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:51.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.775239+0000","last_change":"2023-10-06T02:25:47.775239+0000","last_active":"2023-10-06T02:25:47.775239+0000","last_peered":"2023-10-06T02:25:47.775239+0000","last_clean":"2023-10-06T02:25:47.775239+0000","last_became_active":"2023-10-06T02:25:47.774968+0000","last_became_peered":"2023-10-06T02:25:47.774968+0000","last_unstale":"2023-10-06T02:25:47.775239+0000","last_undegraded":"2023-10-06T02:25:47.775239+0000","last_fullsized":"2023-10-06T02:25:47.775239+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:17.730518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":43,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.772772+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:25:46.772772+0000","last_peered":"2023-10-06T02:25:46.772772+0000","last_clean":"2023-10-06T02:25:46.772772+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:25:46.772772+0000","last_undegraded":"2023-10-06T02:25:46.772772+0000","last_fullsized":"2023-10-06T02:25:46.772772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767839+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:44.695976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.780762+0000","last_change":"2023-10-06T02:25:47.780762+0000","last_active":"2023-10-06T02:25:47.780762+0000","last_peered":"2023-10-06T02:25:47.780762+0000","last_clean":"2023-10-06T02:25:47.780762+0000","last_became_active":"2023-10-06T02:25:47.780493+0000","last_became_peered":"2023-10-06T02:25:47.780493+0000","last_unstale":"2023-10-06T02:25:47.780762+0000","last_undegraded":"2023-10-06T02:25:47.780762+0000","last_fullsized":"2023-10-06T02:25:47.780762+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:40.385968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.765190+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:25:46.765190+0000","last_peered":"2023-10-06T02:25:46.765190+0000","last_clean":"2023-10-06T02:25:46.765190+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:25:46.765190+0000","last_undegraded":"2023-10-06T02:25:46.765190+0000","last_fullsized":"2023-10-06T02:25:46.765190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.763943+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:25:46.763943+0000","last_peered":"2023-10-06T02:25:46.763943+0000","last_clean":"2023-10-06T02:25:46.763943+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:25:46.763943+0000","last_undegraded":"2023-10-06T02:25:46.763943+0000","last_fullsized":"2023-10-06T02:25:46.763943+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.776495+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:09.893223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.783177+0000","last_change":"2023-10-06T02:25:47.783177+0000","last_active":"2023-10-06T02:25:47.783177+0000","last_peered":"2023-10-06T02:25:47.783177+0000","last_clean":"2023-10-06T02:25:47.783177+0000","last_became_active":"2023-10-06T02:25:47.782762+0000","last_became_peered":"2023-10-06T02:25:47.782762+0000","last_unstale":"2023-10-06T02:25:47.783177+0000","last_undegraded":"2023-10-06T02:25:47.783177+0000","last_fullsized":"2023-10-06T02:25:47.783177+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:34.543022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.763990+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:25:46.763990+0000","last_peered":"2023-10-06T02:25:46.763990+0000","last_clean":"2023-10-06T02:25:46.763990+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:25:46.763990+0000","last_undegraded":"2023-10-06T02:25:46.763990+0000","last_fullsized":"2023-10-06T02:25:46.763990+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.772574+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:15.338941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.774699+0000","last_change":"2023-10-06T02:25:47.774699+0000","last_active":"2023-10-06T02:25:47.774699+0000","last_peered":"2023-10-06T02:25:47.774699+0000","last_clean":"2023-10-06T02:25:47.774699+0000","last_became_active":"2023-10-06T02:25:47.774440+0000","last_became_peered":"2023-10-06T02:25:47.774440+0000","last_unstale":"2023-10-06T02:25:47.774699+0000","last_undegraded":"2023-10-06T02:25:47.774699+0000","last_fullsized":"2023-10-06T02:25:47.774699+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:22.094876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.763928+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:25:46.763928+0000","last_peered":"2023-10-06T02:25:46.763928+0000","last_clean":"2023-10-06T02:25:46.763928+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:25:46.763928+0000","last_undegraded":"2023-10-06T02:25:46.763928+0000","last_fullsized":"2023-10-06T02:25:46.763928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.772455+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:17.993235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.778193+0000","last_change":"2023-10-06T02:25:47.778193+0000","last_active":"2023-10-06T02:25:47.778193+0000","last_peered":"2023-10-06T02:25:47.778193+0000","last_clean":"2023-10-06T02:25:47.778193+0000","last_became_active":"2023-10-06T02:25:47.777897+0000","last_became_peered":"2023-10-06T02:25:47.777897+0000","last_unstale":"2023-10-06T02:25:47.778193+0000","last_undegraded":"2023-10-06T02:25:47.778193+0000","last_fullsized":"2023-10-06T02:25:47.778193+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:14.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.762158+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:25:46.762158+0000","last_peered":"2023-10-06T02:25:46.762158+0000","last_clean":"2023-10-06T02:25:46.762158+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:25:46.762158+0000","last_undegraded":"2023-10-06T02:25:46.762158+0000","last_fullsized":"2023-10-06T02:25:46.762158+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770377+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:27.460927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.784926+0000","last_change":"2023-10-06T02:25:47.784926+0000","last_active":"2023-10-06T02:25:47.784926+0000","last_peered":"2023-10-06T02:25:47.784926+0000","last_clean":"2023-10-06T02:25:47.784926+0000","last_became_active":"2023-10-06T02:25:47.784660+0000","last_became_peered":"2023-10-06T02:25:47.784660+0000","last_unstale":"2023-10-06T02:25:47.784926+0000","last_undegraded":"2023-10-06T02:25:47.784926+0000","last_fullsized":"2023-10-06T02:25:47.784926+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:14.247373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.761018+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:25:46.761018+0000","last_peered":"2023-10-06T02:25:46.761018+0000","last_clean":"2023-10-06T02:25:46.761018+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:25:46.761018+0000","last_undegraded":"2023-10-06T02:25:46.761018+0000","last_fullsized":"2023-10-06T02:25:46.761018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.769530+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:21.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.782458+0000","last_change":"2023-10-06T02:25:47.782458+0000","last_active":"2023-10-06T02:25:47.782458+0000","last_peered":"2023-10-06T02:25:47.782458+0000","last_clean":"2023-10-06T02:25:47.782458+0000","last_became_active":"2023-10-06T02:25:47.782128+0000","last_became_peered":"2023-10-06T02:25:47.782128+0000","last_unstale":"2023-10-06T02:25:47.782458+0000","last_undegraded":"2023-10-06T02:25:47.782458+0000","last_fullsized":"2023-10-06T02:25:47.782458+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:37.047439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.761086+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:25:46.761086+0000","last_peered":"2023-10-06T02:25:46.761086+0000","last_clean":"2023-10-06T02:25:46.761086+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:25:46.761086+0000","last_undegraded":"2023-10-06T02:25:46.761086+0000","last_fullsized":"2023-10-06T02:25:46.761086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":875792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53000000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.77100000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.314,"15min":0.314},"max":{"1min":0.74399999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.52400000000000002,"15min":0.51400000000000001},"min":{"1min":0.38900000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77400000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54500000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74099999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.437,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.35799999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72799999999999998,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.47699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46999999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.505,"15min":0.50600000000000001},"min":{"1min":0.33900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.67900000000000005,"5min":1.014,"15min":1.014},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.59499999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35199999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.38800000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73899999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.42999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77400000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59599999999999997,"15min":0.59899999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76500000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.63100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":284071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.72699999999999998,"15min":0.76400000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.65800000000000003,"5min":5.859,"15min":5.859},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74299999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.439}]},{"osd":1,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.373,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73299999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.495},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70699999999999996,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.38100000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.36299999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67800000000000005,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.44900000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.72399999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.45200000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.45300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.77500000000000002,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.62,"15min":0.621},"min":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.77300000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.33300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80100000000000005,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.81399999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.39500000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39800000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55700000000000005},"min":{"1min":0.43099999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46700000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.41099999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88500000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84699999999999998,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.52800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298500,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073340,"statfs":{"total":96636764160,"available":96331100160,"internally_reserved":0,"allocated":1241088,"data_stored":869184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.377,"15min":0.38300000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.49199999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.66500000000000004,"15min":0.71499999999999997},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.626,"5min":7.6900000000000004,"15min":7.6900000000000004},"last":0.28699999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.623,"15min":0.67100000000000004},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.53300000000000003,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.69699999999999995,"15min":0.747},"min":{"1min":0.28399999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56200000000000006,"5min":7.758,"15min":7.758},"last":0.251}]},{"osd":3,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.72199999999999998,"15min":0.77200000000000002},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.55400000000000005,"5min":7.7869999999999999,"15min":7.7869999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.41899999999999998,"15min":0.42399999999999999},"min":{"1min":0.28799999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.60099999999999998,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.33800000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":1.069,"15min":1.1439999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84699999999999998,"5min":11.678000000000001,"15min":11.678000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.90100000000000002,"15min":0.94999999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84299999999999997,"5min":7.6529999999999996,"15min":7.6529999999999996},"last":0.74199999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.97899999999999998,"5min":1.399,"15min":1.399},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.93600000000000005,"15min":0.98199999999999998},"min":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.79800000000000004,"5min":7.508,"15min":7.508},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.91100000000000003,"15min":0.95899999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.873,"5min":7.7270000000000003,"15min":7.7270000000000003},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68600000000000005,"15min":0.69199999999999995},"min":{"1min":0.49099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85499999999999998,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.57499999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.91400000000000003,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.95699999999999996,"15min":1.0029999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88200000000000001,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.753}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073924,"statfs":{"total":96636764160,"available":96331698176,"internally_reserved":0,"allocated":643072,"data_stored":277463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34599999999999997,"15min":0.34300000000000003},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.52500000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.35999999999999999,"15min":0.35799999999999998},"min":{"1min":0.27900000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.53900000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.249,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.33200000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.621,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.38500000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.34999999999999998},"min":{"1min":0.26100000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57799999999999996,"5min":0.622,"15min":0.622},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39100000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60299999999999998,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.37}]},{"osd":4,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.47799999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.437,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85099999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.497},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79700000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.56399999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.621,"15min":0.61599999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.47799999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79100000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.50600000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.51700000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90500000000000003,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":285424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.33800000000000002,"15min":0.33600000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.56799999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.26000000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34699999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39900000000000002,"15min":0.39800000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.30399999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.41099999999999998,"15min":0.40600000000000003},"min":{"1min":0.33600000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.29099999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.55100000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.45500000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.90000000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.628,"15min":0.623},"min":{"1min":0.46999999999999997,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93999999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95799999999999996,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.497},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.59799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":284071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.68999999999999995,"15min":0.745},"min":{"1min":0.221,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.59499999999999997,"5min":10.164999999999999,"15min":10.164999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.41099999999999998,"15min":0.41299999999999998},"min":{"1min":0.252,"5min":0.224,"15min":0.224},"max":{"1min":0.67300000000000004,"5min":1.266,"15min":1.266},"last":0.30099999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42799999999999999,"15min":0.432},"min":{"1min":0.27200000000000002,"5min":0.191,"15min":0.191},"max":{"1min":0.70999999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.317},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.433,"15min":0.433},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.83399999999999996,"5min":1.319,"15min":1.319},"last":0.24399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.30599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58899999999999997,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.312,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.81299999999999994,"5min":1.5,"15min":1.5},"last":0.34599999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.629,"15min":0.629},"min":{"1min":0.44500000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77300000000000002,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77700000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65900000000000003,"15min":0.66100000000000003},"min":{"1min":0.46200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86699999999999999,"5min":1.538,"15min":1.538},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.48099999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89400000000000002,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.63900000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.48999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.748,"5min":1.111,"15min":1.111},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.45600000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92800000000000005,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.51800000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46999999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88400000000000001,"5min":1.21,"15min":1.21},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46000000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90000000000000002,"5min":1.135,"15min":1.135},"last":0.53100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":285424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71799999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.504,"15min":0.501},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.49399999999999999,"15min":0.48799999999999999},"min":{"1min":0.41299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.52100000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.44,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.66700000000000004}]},{"osd":3,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.41399999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59599999999999997,"15min":0.59799999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.74299999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48899999999999999,"15min":0.48699999999999999},"min":{"1min":0.32300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76000000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.432}]},{"osd":6,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.377}]},{"osd":7,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81200000000000006,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58099999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.82499999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.48099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":285424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48799999999999999,"15min":0.48199999999999998},"min":{"1min":0.32700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68500000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.499}]},{"osd":2,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.68700000000000006,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.69599999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.372,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.64900000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.496,"15min":0.495},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.38400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.81599999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.43099999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.75800000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.45400000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.47199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:25:52.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:25:53.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.052+0000 7fb3bf2fc700 1 Processor -- start 2023-10-06T02:25:53.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.052+0000 7fb3bf2fc700 1 -- start start 2023-10-06T02:25:53.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.053+0000 7fb3bf2fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb3b8159760 0x7fb3b815d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.053+0000 7fb3bf2fc700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb3b815dd50 0x7fb3b80cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.053+0000 7fb3bf2fc700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b815e1d0 con 0x7fb3b815d8d0 2023-10-06T02:25:53.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.053+0000 7fb3bf2fc700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b80cc2d0 con 0x7fb3b8159760 2023-10-06T02:25:53.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.053+0000 7fb3bf2fc700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b80cb650 con 0x7fb3b815dd50 2023-10-06T02:25:53.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.053+0000 7fb3bd098700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb3b8159760 0x7fb3b815d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.053+0000 7fb3bd098700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb3b8159760 0x7fb3b815d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49650/0 (socket says 172.21.15.37:49650) 2023-10-06T02:25:53.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.053+0000 7fb3bd098700 1 -- 172.21.15.37:0/4065314206 learned_addr learned my addr 172.21.15.37:0/4065314206 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:53.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.053+0000 7fb3bd899700 1 --2- 172.21.15.37:0/4065314206 >> v2:172.21.15.191:3300/0 conn(0x7fb3b815dd50 0x7fb3b80cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.053+0000 7fb3bd098700 1 -- 172.21.15.37:0/4065314206 >> v2:172.21.15.191:3300/0 conn(0x7fb3b815dd50 msgr2=0x7fb3b80cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:53.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.053+0000 7fb3bd098700 1 --2- 172.21.15.37:0/4065314206 >> v2:172.21.15.191:3300/0 conn(0x7fb3b815dd50 0x7fb3b80cfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.053+0000 7fb3bd098700 1 -- 172.21.15.37:0/4065314206 >> v1:172.21.15.191:6789/0 conn(0x7fb3b815d8d0 legacy=0x7fb3b80c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.053+0000 7fb3bd098700 1 -- 172.21.15.37:0/4065314206 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b80cb930 con 0x7fb3b8159760 2023-10-06T02:25:53.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.053+0000 7fb3bd098700 1 --2- 172.21.15.37:0/4065314206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3b8159760 0x7fb3b815d390 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb3b806beb0 tx=0x7fb3a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9611de0c85ccfa97 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.054+0000 7fb3b7fff700 1 -- 172.21.15.37:0/4065314206 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a800e070 con 0x7fb3b8159760 2023-10-06T02:25:53.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.054+0000 7fb3b7fff700 1 -- 172.21.15.37:0/4065314206 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a800bab0 con 0x7fb3b8159760 2023-10-06T02:25:53.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.054+0000 7fb3b7fff700 1 -- 172.21.15.37:0/4065314206 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a80092e0 con 0x7fb3b8159760 2023-10-06T02:25:53.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.054+0000 7fb3bf2fc700 1 -- 172.21.15.37:0/4065314206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3b8159760 msgr2=0x7fb3b815d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.054+0000 7fb3bf2fc700 1 --2- 172.21.15.37:0/4065314206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3b8159760 0x7fb3b815d390 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb3b806beb0 tx=0x7fb3a8009840 comp rx=0 tx=0).stop 2023-10-06T02:25:53.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.054+0000 7fb3bf2fc700 1 -- 172.21.15.37:0/4065314206 shutdown_connections 2023-10-06T02:25:53.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.054+0000 7fb3bf2fc700 1 --2- 172.21.15.37:0/4065314206 >> v2:172.21.15.191:3300/0 conn(0x7fb3b815dd50 0x7fb3b80cfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.054+0000 7fb3bf2fc700 1 --2- 172.21.15.37:0/4065314206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3b8159760 0x7fb3b815d390 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.054+0000 7fb3bf2fc700 1 -- 172.21.15.37:0/4065314206 >> 172.21.15.37:0/4065314206 conn(0x7fb3b806c890 msgr2=0x7fb3b80d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:53.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.054+0000 7fb3bf2fc700 1 -- 172.21.15.37:0/4065314206 shutdown_connections 2023-10-06T02:25:53.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.054+0000 7fb3bf2fc700 1 -- 172.21.15.37:0/4065314206 wait complete. 2023-10-06T02:25:53.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.055+0000 7fb3bf2fc700 1 Processor -- start 2023-10-06T02:25:53.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.055+0000 7fb3bf2fc700 1 -- start start 2023-10-06T02:25:53.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.056+0000 7fb3bf2fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3b8159760 0x7fb3b8158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.056+0000 7fb3bf2fc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3b815d8d0 0x7fb3b80b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.056+0000 7fb3bf2fc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3b815dd50 0x7fb3b80c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.056+0000 7fb3bf2fc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b816a1a0 con 0x7fb3b8159760 2023-10-06T02:25:53.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.056+0000 7fb3bf2fc700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b816a480 con 0x7fb3b815dd50 2023-10-06T02:25:53.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.056+0000 7fb3bf2fc700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b816a760 con 0x7fb3b815d8d0 2023-10-06T02:25:53.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.056+0000 7fb3bd098700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3b8159760 0x7fb3b8158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.056+0000 7fb3bd098700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3b8159760 0x7fb3b8158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49664/0 (socket says 172.21.15.37:49664) 2023-10-06T02:25:53.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.056+0000 7fb3bd098700 1 -- 172.21.15.37:0/2966559285 learned_addr learned my addr 172.21.15.37:0/2966559285 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:53.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.056+0000 7fb3bc897700 1 --2- 172.21.15.37:0/2966559285 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3b815d8d0 0x7fb3b80b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.056+0000 7fb3bd899700 1 --2- 172.21.15.37:0/2966559285 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3b815dd50 0x7fb3b80c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.057+0000 7fb3bd098700 1 -- 172.21.15.37:0/2966559285 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3b815d8d0 msgr2=0x7fb3b80b5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.057+0000 7fb3bd098700 1 --2- 172.21.15.37:0/2966559285 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3b815d8d0 0x7fb3b80b5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.057+0000 7fb3bd098700 1 -- 172.21.15.37:0/2966559285 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3b815dd50 msgr2=0x7fb3b80c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.057+0000 7fb3bd098700 1 --2- 172.21.15.37:0/2966559285 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3b815dd50 0x7fb3b80c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.057+0000 7fb3bd098700 1 -- 172.21.15.37:0/2966559285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a8009ae0 con 0x7fb3b8159760 2023-10-06T02:25:53.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.057+0000 7fb3bd899700 1 --2- 172.21.15.37:0/2966559285 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3b815dd50 0x7fb3b80c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:53.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.057+0000 7fb3bd098700 1 --2- 172.21.15.37:0/2966559285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3b8159760 0x7fb3b8158820 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8088880 tx=0x7fb3a8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.057+0000 7fb3b57fa700 1 -- 172.21.15.37:0/2966559285 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8008af0 con 0x7fb3b8159760 2023-10-06T02:25:53.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.057+0000 7fb3b57fa700 1 -- 172.21.15.37:0/2966559285 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a8008c50 con 0x7fb3b8159760 2023-10-06T02:25:53.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.057+0000 7fb3b57fa700 1 -- 172.21.15.37:0/2966559285 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a801d420 con 0x7fb3b8159760 2023-10-06T02:25:53.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.057+0000 7fb3bf2fc700 1 -- 172.21.15.37:0/2966559285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b816aa40 con 0x7fb3b8159760 2023-10-06T02:25:53.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.057+0000 7fb3bf2fc700 1 -- 172.21.15.37:0/2966559285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b8158d60 con 0x7fb3b8159760 2023-10-06T02:25:53.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.058+0000 7fb3bf2fc700 1 -- 172.21.15.37:0/2966559285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b806fbf0 con 0x7fb3b8159760 2023-10-06T02:25:53.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.059+0000 7fb3b57fa700 1 -- 172.21.15.37:0/2966559285 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3a8003040 con 0x7fb3b8159760 2023-10-06T02:25:53.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.059+0000 7fb3b57fa700 1 --2- 172.21.15.37:0/2966559285 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb3a4066f30 0x7fb3a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.059+0000 7fb3b57fa700 1 -- 172.21.15.37:0/2966559285 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb3a8086040 con 0x7fb3b8159760 2023-10-06T02:25:53.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.059+0000 7fb3bc897700 1 --2- 172.21.15.37:0/2966559285 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb3a4066f30 0x7fb3a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.060+0000 7fb3bc897700 1 --2- 172.21.15.37:0/2966559285 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb3a4066f30 0x7fb3a40693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb3b806e170 tx=0x7fb3ac007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.063+0000 7fb3b57fa700 1 -- 172.21.15.37:0/2966559285 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3a8053150 con 0x7fb3b8159760 2023-10-06T02:25:53.091 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-10-06T02:25:53.091+0000 7f986bfd6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:25:53.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.253+0000 7fb3bf2fc700 1 -- 172.21.15.37:0/2966559285 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3b816a5f0 con 0x7fb3a4066f30 2023-10-06T02:25:53.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.262+0000 7fb3b57fa700 1 -- 172.21.15.37:0/2966559285 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308943 (secure 0 0 0) 0x7fb3b816a5f0 con 0x7fb3a4066f30 2023-10-06T02:25:53.266 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:53.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.265+0000 7fb3bf2fc700 1 -- 172.21.15.37:0/2966559285 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb3a4066f30 msgr2=0x7fb3a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.265+0000 7fb3bf2fc700 1 --2- 172.21.15.37:0/2966559285 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb3a4066f30 0x7fb3a40693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb3b806e170 tx=0x7fb3ac007ec0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.265+0000 7fb3bf2fc700 1 -- 172.21.15.37:0/2966559285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3b8159760 msgr2=0x7fb3b8158820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.265+0000 7fb3bf2fc700 1 --2- 172.21.15.37:0/2966559285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3b8159760 0x7fb3b8158820 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8088880 tx=0x7fb3a8018000 comp rx=0 tx=0).stop 2023-10-06T02:25:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.265+0000 7fb3bf2fc700 1 -- 172.21.15.37:0/2966559285 shutdown_connections 2023-10-06T02:25:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.265+0000 7fb3bf2fc700 1 --2- 172.21.15.37:0/2966559285 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb3a4066f30 0x7fb3a40693e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.265+0000 7fb3bf2fc700 1 --2- 172.21.15.37:0/2966559285 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3b815dd50 0x7fb3b80c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.265+0000 7fb3bf2fc700 1 --2- 172.21.15.37:0/2966559285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3b8159760 0x7fb3b8158820 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.265+0000 7fb3bf2fc700 1 --2- 172.21.15.37:0/2966559285 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3b815d8d0 0x7fb3b80b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.265+0000 7fb3bf2fc700 1 -- 172.21.15.37:0/2966559285 >> 172.21.15.37:0/2966559285 conn(0x7fb3b806c890 msgr2=0x7fb3b80c99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.265+0000 7fb3bf2fc700 1 -- 172.21.15.37:0/2966559285 shutdown_connections 2023-10-06T02:25:53.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.266+0000 7fb3bf2fc700 1 -- 172.21.15.37:0/2966559285 wait complete. 2023-10-06T02:25:53.271 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:25:53.278 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2023-10-06T02:25:52.546690+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384580,"kb_used_data":6276,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590140,"statfs":{"total":773094113280,"available":770652303360,"internally_reserved":0,"allocated":6426624,"data_stored":3446853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.788204"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762779+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:48.969007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762329+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:43.827759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771263+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:03.991817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765977+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:18.739198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767718+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:20.191318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767613+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:37.913721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770406+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:16.823479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.776090+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:53.382091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771176+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:57.656013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771243+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:41.394648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767034+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:15.007098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.778100+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:37.561344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.778213+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:23.103556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768638+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:46.321524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.769330+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:23.103556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771508+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:27.557897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762241+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:25.981569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.766332+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:23.618730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770887+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:03.082588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767580+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:01.275354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.777405+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:23.618730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767511+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:41.394648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768061+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:14.533092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.769284+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:23.618730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.777454+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:21.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.778548+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:15.227230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.766594+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:21.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.763060+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:25.687797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768709+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:15.007098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.777547+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:46.321524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765879+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:53.382091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768311+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:33.984884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.772465+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:59.518906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.779666+0000","last_change":"2023-10-06T02:25:47.779666+0000","last_active":"2023-10-06T02:25:47.779666+0000","last_peered":"2023-10-06T02:25:47.779666+0000","last_clean":"2023-10-06T02:25:47.779666+0000","last_became_active":"2023-10-06T02:25:47.779228+0000","last_became_peered":"2023-10-06T02:25:47.779228+0000","last_unstale":"2023-10-06T02:25:47.779666+0000","last_undegraded":"2023-10-06T02:25:47.779666+0000","last_fullsized":"2023-10-06T02:25:47.779666+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:21.300373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765954+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:09.893223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.778547+0000","last_change":"2023-10-06T02:25:47.778547+0000","last_active":"2023-10-06T02:25:47.778547+0000","last_peered":"2023-10-06T02:25:47.778547+0000","last_clean":"2023-10-06T02:25:47.778547+0000","last_became_active":"2023-10-06T02:25:47.778062+0000","last_became_peered":"2023-10-06T02:25:47.778062+0000","last_unstale":"2023-10-06T02:25:47.778547+0000","last_undegraded":"2023-10-06T02:25:47.778547+0000","last_fullsized":"2023-10-06T02:25:47.778547+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:22.094876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768128+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:52.758045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.781462+0000","last_change":"2023-10-06T02:25:47.781462+0000","last_active":"2023-10-06T02:25:47.781462+0000","last_peered":"2023-10-06T02:25:47.781462+0000","last_clean":"2023-10-06T02:25:47.781462+0000","last_became_active":"2023-10-06T02:25:47.781039+0000","last_became_peered":"2023-10-06T02:25:47.781039+0000","last_unstale":"2023-10-06T02:25:47.781462+0000","last_undegraded":"2023-10-06T02:25:47.781462+0000","last_fullsized":"2023-10-06T02:25:47.781462+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:56.647333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.769083+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:37.561344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.772551+0000","last_change":"2023-10-06T02:25:47.772551+0000","last_active":"2023-10-06T02:25:47.772551+0000","last_peered":"2023-10-06T02:25:47.772551+0000","last_clean":"2023-10-06T02:25:47.772551+0000","last_became_active":"2023-10-06T02:25:47.772269+0000","last_became_peered":"2023-10-06T02:25:47.772269+0000","last_unstale":"2023-10-06T02:25:47.772551+0000","last_undegraded":"2023-10-06T02:25:47.772551+0000","last_fullsized":"2023-10-06T02:25:47.772551+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:36.552664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770593+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:25.885346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.775941+0000","last_change":"2023-10-06T02:25:47.775941+0000","last_active":"2023-10-06T02:25:47.775941+0000","last_peered":"2023-10-06T02:25:47.775941+0000","last_clean":"2023-10-06T02:25:47.775941+0000","last_became_active":"2023-10-06T02:25:47.775677+0000","last_became_peered":"2023-10-06T02:25:47.775677+0000","last_unstale":"2023-10-06T02:25:47.775941+0000","last_undegraded":"2023-10-06T02:25:47.775941+0000","last_fullsized":"2023-10-06T02:25:47.775941+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:14.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762044+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:21.678499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.776075+0000","last_change":"2023-10-06T02:25:47.776075+0000","last_active":"2023-10-06T02:25:47.776075+0000","last_peered":"2023-10-06T02:25:47.776075+0000","last_clean":"2023-10-06T02:25:47.776075+0000","last_became_active":"2023-10-06T02:25:47.775812+0000","last_became_peered":"2023-10-06T02:25:47.775812+0000","last_unstale":"2023-10-06T02:25:47.776075+0000","last_undegraded":"2023-10-06T02:25:47.776075+0000","last_fullsized":"2023-10-06T02:25:47.776075+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:20.646833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.773984+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:24.538628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.782265+0000","last_change":"2023-10-06T02:25:47.782265+0000","last_active":"2023-10-06T02:25:47.782265+0000","last_peered":"2023-10-06T02:25:47.782265+0000","last_clean":"2023-10-06T02:25:47.782265+0000","last_became_active":"2023-10-06T02:25:47.781984+0000","last_became_peered":"2023-10-06T02:25:47.781984+0000","last_unstale":"2023-10-06T02:25:47.782265+0000","last_undegraded":"2023-10-06T02:25:47.782265+0000","last_fullsized":"2023-10-06T02:25:47.782265+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:13.998418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768306+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:03.991817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.776645+0000","last_change":"2023-10-06T02:25:47.776645+0000","last_active":"2023-10-06T02:25:47.776645+0000","last_peered":"2023-10-06T02:25:47.776645+0000","last_clean":"2023-10-06T02:25:47.776645+0000","last_became_active":"2023-10-06T02:25:47.776222+0000","last_became_peered":"2023-10-06T02:25:47.776222+0000","last_unstale":"2023-10-06T02:25:47.776645+0000","last_undegraded":"2023-10-06T02:25:47.776645+0000","last_fullsized":"2023-10-06T02:25:47.776645+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:03.400305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762646+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:10.359414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.783911+0000","last_change":"2023-10-06T02:25:47.783911+0000","last_active":"2023-10-06T02:25:47.783911+0000","last_peered":"2023-10-06T02:25:47.783911+0000","last_clean":"2023-10-06T02:25:47.783911+0000","last_became_active":"2023-10-06T02:25:47.783672+0000","last_became_peered":"2023-10-06T02:25:47.783672+0000","last_unstale":"2023-10-06T02:25:47.783911+0000","last_undegraded":"2023-10-06T02:25:47.783911+0000","last_fullsized":"2023-10-06T02:25:47.783911+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:53.337356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768353+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:57.656013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.774544+0000","last_change":"2023-10-06T02:25:47.774544+0000","last_active":"2023-10-06T02:25:47.774544+0000","last_peered":"2023-10-06T02:25:47.774544+0000","last_clean":"2023-10-06T02:25:47.774544+0000","last_became_active":"2023-10-06T02:25:47.773704+0000","last_became_peered":"2023-10-06T02:25:47.773704+0000","last_unstale":"2023-10-06T02:25:47.774544+0000","last_undegraded":"2023-10-06T02:25:47.774544+0000","last_fullsized":"2023-10-06T02:25:47.774544+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:04.612716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.772791+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:39.144943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.781564+0000","last_change":"2023-10-06T02:25:47.781564+0000","last_active":"2023-10-06T02:25:47.781564+0000","last_peered":"2023-10-06T02:25:47.781564+0000","last_clean":"2023-10-06T02:25:47.781564+0000","last_became_active":"2023-10-06T02:25:47.781157+0000","last_became_peered":"2023-10-06T02:25:47.781157+0000","last_unstale":"2023-10-06T02:25:47.781564+0000","last_undegraded":"2023-10-06T02:25:47.781564+0000","last_fullsized":"2023-10-06T02:25:47.781564+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:37.047439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765749+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:54.346036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.774248+0000","last_change":"2023-10-06T02:25:47.774248+0000","last_active":"2023-10-06T02:25:47.774248+0000","last_peered":"2023-10-06T02:25:47.774248+0000","last_clean":"2023-10-06T02:25:47.774248+0000","last_became_active":"2023-10-06T02:25:47.773967+0000","last_became_peered":"2023-10-06T02:25:47.773967+0000","last_unstale":"2023-10-06T02:25:47.774248+0000","last_undegraded":"2023-10-06T02:25:47.774248+0000","last_fullsized":"2023-10-06T02:25:47.774248+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:19.027538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765332+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:35.551701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.782266+0000","last_change":"2023-10-06T02:25:47.782266+0000","last_active":"2023-10-06T02:25:47.782266+0000","last_peered":"2023-10-06T02:25:47.782266+0000","last_clean":"2023-10-06T02:25:47.782266+0000","last_became_active":"2023-10-06T02:25:47.781819+0000","last_became_peered":"2023-10-06T02:25:47.781819+0000","last_unstale":"2023-10-06T02:25:47.782266+0000","last_undegraded":"2023-10-06T02:25:47.782266+0000","last_fullsized":"2023-10-06T02:25:47.782266+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:20.653387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.776962+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:18.739198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.783305+0000","last_change":"2023-10-06T02:25:47.783305+0000","last_active":"2023-10-06T02:25:47.783305+0000","last_peered":"2023-10-06T02:25:47.783305+0000","last_clean":"2023-10-06T02:25:47.783305+0000","last_became_active":"2023-10-06T02:25:47.783026+0000","last_became_peered":"2023-10-06T02:25:47.783026+0000","last_unstale":"2023-10-06T02:25:47.783305+0000","last_undegraded":"2023-10-06T02:25:47.783305+0000","last_fullsized":"2023-10-06T02:25:47.783305+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:53.337356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.773523+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:11:03.662406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.780895+0000","last_change":"2023-10-06T02:25:47.780895+0000","last_active":"2023-10-06T02:25:47.780895+0000","last_peered":"2023-10-06T02:25:47.780895+0000","last_clean":"2023-10-06T02:25:47.780895+0000","last_became_active":"2023-10-06T02:25:47.780602+0000","last_became_peered":"2023-10-06T02:25:47.780602+0000","last_unstale":"2023-10-06T02:25:47.780895+0000","last_undegraded":"2023-10-06T02:25:47.780895+0000","last_fullsized":"2023-10-06T02:25:47.780895+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:08.884543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762767+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:54.359817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.779687+0000","last_change":"2023-10-06T02:25:47.779687+0000","last_active":"2023-10-06T02:25:47.779687+0000","last_peered":"2023-10-06T02:25:47.779687+0000","last_clean":"2023-10-06T02:25:47.779687+0000","last_became_active":"2023-10-06T02:25:47.779422+0000","last_became_peered":"2023-10-06T02:25:47.779422+0000","last_unstale":"2023-10-06T02:25:47.779687+0000","last_undegraded":"2023-10-06T02:25:47.779687+0000","last_fullsized":"2023-10-06T02:25:47.779687+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:06.807270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767455+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:14.533092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.789740+0000","last_change":"2023-10-06T02:25:47.789740+0000","last_active":"2023-10-06T02:25:47.789740+0000","last_peered":"2023-10-06T02:25:47.789740+0000","last_clean":"2023-10-06T02:25:47.789740+0000","last_became_active":"2023-10-06T02:25:47.789419+0000","last_became_peered":"2023-10-06T02:25:47.789419+0000","last_unstale":"2023-10-06T02:25:47.789740+0000","last_undegraded":"2023-10-06T02:25:47.789740+0000","last_fullsized":"2023-10-06T02:25:47.789740+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:20.653387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770463+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:54.727662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.780940+0000","last_change":"2023-10-06T02:25:47.780940+0000","last_active":"2023-10-06T02:25:47.780940+0000","last_peered":"2023-10-06T02:25:47.780940+0000","last_clean":"2023-10-06T02:25:47.780940+0000","last_became_active":"2023-10-06T02:25:47.780649+0000","last_became_peered":"2023-10-06T02:25:47.780649+0000","last_unstale":"2023-10-06T02:25:47.780940+0000","last_undegraded":"2023-10-06T02:25:47.780940+0000","last_fullsized":"2023-10-06T02:25:47.780940+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:06.807270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.778042+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:15.007098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.781285+0000","last_change":"2023-10-06T02:25:47.781285+0000","last_active":"2023-10-06T02:25:47.781285+0000","last_peered":"2023-10-06T02:25:47.781285+0000","last_clean":"2023-10-06T02:25:47.781285+0000","last_became_active":"2023-10-06T02:25:47.780775+0000","last_became_peered":"2023-10-06T02:25:47.780775+0000","last_unstale":"2023-10-06T02:25:47.781285+0000","last_undegraded":"2023-10-06T02:25:47.781285+0000","last_fullsized":"2023-10-06T02:25:47.781285+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.703535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771436+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:03.303783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.774115+0000","last_change":"2023-10-06T02:25:47.774115+0000","last_active":"2023-10-06T02:25:47.774115+0000","last_peered":"2023-10-06T02:25:47.774115+0000","last_clean":"2023-10-06T02:25:47.774115+0000","last_became_active":"2023-10-06T02:25:47.773648+0000","last_became_peered":"2023-10-06T02:25:47.773648+0000","last_unstale":"2023-10-06T02:25:47.774115+0000","last_undegraded":"2023-10-06T02:25:47.774115+0000","last_fullsized":"2023-10-06T02:25:47.774115+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:12.915334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768826+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:20.440565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.780245+0000","last_change":"2023-10-06T02:25:47.780245+0000","last_active":"2023-10-06T02:25:47.780245+0000","last_peered":"2023-10-06T02:25:47.780245+0000","last_clean":"2023-10-06T02:25:47.780245+0000","last_became_active":"2023-10-06T02:25:47.779986+0000","last_became_peered":"2023-10-06T02:25:47.779986+0000","last_unstale":"2023-10-06T02:25:47.780245+0000","last_undegraded":"2023-10-06T02:25:47.780245+0000","last_fullsized":"2023-10-06T02:25:47.780245+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:52.373411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765370+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:38.056119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.773995+0000","last_change":"2023-10-06T02:25:47.773995+0000","last_active":"2023-10-06T02:25:47.773995+0000","last_peered":"2023-10-06T02:25:47.773995+0000","last_clean":"2023-10-06T02:25:47.773995+0000","last_became_active":"2023-10-06T02:25:47.773707+0000","last_became_peered":"2023-10-06T02:25:47.773707+0000","last_unstale":"2023-10-06T02:25:47.773995+0000","last_undegraded":"2023-10-06T02:25:47.773995+0000","last_fullsized":"2023-10-06T02:25:47.773995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:36.552664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762082+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:31.177238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.780787+0000","last_change":"2023-10-06T02:25:47.780787+0000","last_active":"2023-10-06T02:25:47.780787+0000","last_peered":"2023-10-06T02:25:47.780787+0000","last_clean":"2023-10-06T02:25:47.780787+0000","last_became_active":"2023-10-06T02:25:47.780419+0000","last_became_peered":"2023-10-06T02:25:47.780419+0000","last_unstale":"2023-10-06T02:25:47.780787+0000","last_undegraded":"2023-10-06T02:25:47.780787+0000","last_fullsized":"2023-10-06T02:25:47.780787+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:45.312844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770517+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:13:49.398898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.777859+0000","last_change":"2023-10-06T02:25:47.777859+0000","last_active":"2023-10-06T02:25:47.777859+0000","last_peered":"2023-10-06T02:25:47.777859+0000","last_clean":"2023-10-06T02:25:47.777859+0000","last_became_active":"2023-10-06T02:25:47.777513+0000","last_became_peered":"2023-10-06T02:25:47.777513+0000","last_unstale":"2023-10-06T02:25:47.777859+0000","last_undegraded":"2023-10-06T02:25:47.777859+0000","last_fullsized":"2023-10-06T02:25:47.777859+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:40.898787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765775+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:15.256053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.781385+0000","last_change":"2023-10-06T02:25:47.781385+0000","last_active":"2023-10-06T02:25:47.781385+0000","last_peered":"2023-10-06T02:25:47.781385+0000","last_clean":"2023-10-06T02:25:47.781385+0000","last_became_active":"2023-10-06T02:25:47.780787+0000","last_became_peered":"2023-10-06T02:25:47.780787+0000","last_unstale":"2023-10-06T02:25:47.781385+0000","last_undegraded":"2023-10-06T02:25:47.781385+0000","last_fullsized":"2023-10-06T02:25:47.781385+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:34.543022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.765591+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:25:46.765591+0000","last_peered":"2023-10-06T02:25:46.765591+0000","last_clean":"2023-10-06T02:25:46.765591+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:25:46.765591+0000","last_undegraded":"2023-10-06T02:25:46.765591+0000","last_fullsized":"2023-10-06T02:25:46.765591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771919+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:51.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.775239+0000","last_change":"2023-10-06T02:25:47.775239+0000","last_active":"2023-10-06T02:25:47.775239+0000","last_peered":"2023-10-06T02:25:47.775239+0000","last_clean":"2023-10-06T02:25:47.775239+0000","last_became_active":"2023-10-06T02:25:47.774968+0000","last_became_peered":"2023-10-06T02:25:47.774968+0000","last_unstale":"2023-10-06T02:25:47.775239+0000","last_undegraded":"2023-10-06T02:25:47.775239+0000","last_fullsized":"2023-10-06T02:25:47.775239+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:17.730518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":43,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.772772+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:25:46.772772+0000","last_peered":"2023-10-06T02:25:46.772772+0000","last_clean":"2023-10-06T02:25:46.772772+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:25:46.772772+0000","last_undegraded":"2023-10-06T02:25:46.772772+0000","last_fullsized":"2023-10-06T02:25:46.772772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767839+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:44.695976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.780762+0000","last_change":"2023-10-06T02:25:47.780762+0000","last_active":"2023-10-06T02:25:47.780762+0000","last_peered":"2023-10-06T02:25:47.780762+0000","last_clean":"2023-10-06T02:25:47.780762+0000","last_became_active":"2023-10-06T02:25:47.780493+0000","last_became_peered":"2023-10-06T02:25:47.780493+0000","last_unstale":"2023-10-06T02:25:47.780762+0000","last_undegraded":"2023-10-06T02:25:47.780762+0000","last_fullsized":"2023-10-06T02:25:47.780762+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:40.385968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.765190+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:25:46.765190+0000","last_peered":"2023-10-06T02:25:46.765190+0000","last_clean":"2023-10-06T02:25:46.765190+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:25:46.765190+0000","last_undegraded":"2023-10-06T02:25:46.765190+0000","last_fullsized":"2023-10-06T02:25:46.765190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.763943+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:25:46.763943+0000","last_peered":"2023-10-06T02:25:46.763943+0000","last_clean":"2023-10-06T02:25:46.763943+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:25:46.763943+0000","last_undegraded":"2023-10-06T02:25:46.763943+0000","last_fullsized":"2023-10-06T02:25:46.763943+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.776495+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:09.893223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.783177+0000","last_change":"2023-10-06T02:25:47.783177+0000","last_active":"2023-10-06T02:25:47.783177+0000","last_peered":"2023-10-06T02:25:47.783177+0000","last_clean":"2023-10-06T02:25:47.783177+0000","last_became_active":"2023-10-06T02:25:47.782762+0000","last_became_peered":"2023-10-06T02:25:47.782762+0000","last_unstale":"2023-10-06T02:25:47.783177+0000","last_undegraded":"2023-10-06T02:25:47.783177+0000","last_fullsized":"2023-10-06T02:25:47.783177+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:34.543022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.763990+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:25:46.763990+0000","last_peered":"2023-10-06T02:25:46.763990+0000","last_clean":"2023-10-06T02:25:46.763990+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:25:46.763990+0000","last_undegraded":"2023-10-06T02:25:46.763990+0000","last_fullsized":"2023-10-06T02:25:46.763990+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.772574+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:15.338941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.774699+0000","last_change":"2023-10-06T02:25:47.774699+0000","last_active":"2023-10-06T02:25:47.774699+0000","last_peered":"2023-10-06T02:25:47.774699+0000","last_clean":"2023-10-06T02:25:47.774699+0000","last_became_active":"2023-10-06T02:25:47.774440+0000","last_became_peered":"2023-10-06T02:25:47.774440+0000","last_unstale":"2023-10-06T02:25:47.774699+0000","last_undegraded":"2023-10-06T02:25:47.774699+0000","last_fullsized":"2023-10-06T02:25:47.774699+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:22.094876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.763928+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:25:46.763928+0000","last_peered":"2023-10-06T02:25:46.763928+0000","last_clean":"2023-10-06T02:25:46.763928+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:25:46.763928+0000","last_undegraded":"2023-10-06T02:25:46.763928+0000","last_fullsized":"2023-10-06T02:25:46.763928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.772455+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:17.993235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.778193+0000","last_change":"2023-10-06T02:25:47.778193+0000","last_active":"2023-10-06T02:25:47.778193+0000","last_peered":"2023-10-06T02:25:47.778193+0000","last_clean":"2023-10-06T02:25:47.778193+0000","last_became_active":"2023-10-06T02:25:47.777897+0000","last_became_peered":"2023-10-06T02:25:47.777897+0000","last_unstale":"2023-10-06T02:25:47.778193+0000","last_undegraded":"2023-10-06T02:25:47.778193+0000","last_fullsized":"2023-10-06T02:25:47.778193+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:14.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.762158+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:25:46.762158+0000","last_peered":"2023-10-06T02:25:46.762158+0000","last_clean":"2023-10-06T02:25:46.762158+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:25:46.762158+0000","last_undegraded":"2023-10-06T02:25:46.762158+0000","last_fullsized":"2023-10-06T02:25:46.762158+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770377+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:27.460927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.784926+0000","last_change":"2023-10-06T02:25:47.784926+0000","last_active":"2023-10-06T02:25:47.784926+0000","last_peered":"2023-10-06T02:25:47.784926+0000","last_clean":"2023-10-06T02:25:47.784926+0000","last_became_active":"2023-10-06T02:25:47.784660+0000","last_became_peered":"2023-10-06T02:25:47.784660+0000","last_unstale":"2023-10-06T02:25:47.784926+0000","last_undegraded":"2023-10-06T02:25:47.784926+0000","last_fullsized":"2023-10-06T02:25:47.784926+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:14.247373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.761018+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:25:46.761018+0000","last_peered":"2023-10-06T02:25:46.761018+0000","last_clean":"2023-10-06T02:25:46.761018+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:25:46.761018+0000","last_undegraded":"2023-10-06T02:25:46.761018+0000","last_fullsized":"2023-10-06T02:25:46.761018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.769530+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:21.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.782458+0000","last_change":"2023-10-06T02:25:47.782458+0000","last_active":"2023-10-06T02:25:47.782458+0000","last_peered":"2023-10-06T02:25:47.782458+0000","last_clean":"2023-10-06T02:25:47.782458+0000","last_became_active":"2023-10-06T02:25:47.782128+0000","last_became_peered":"2023-10-06T02:25:47.782128+0000","last_unstale":"2023-10-06T02:25:47.782458+0000","last_undegraded":"2023-10-06T02:25:47.782458+0000","last_fullsized":"2023-10-06T02:25:47.782458+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:37.047439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.761086+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:25:46.761086+0000","last_peered":"2023-10-06T02:25:46.761086+0000","last_clean":"2023-10-06T02:25:46.761086+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:25:46.761086+0000","last_undegraded":"2023-10-06T02:25:46.761086+0000","last_fullsized":"2023-10-06T02:25:46.761086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":875792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53000000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.77100000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.314,"15min":0.314},"max":{"1min":0.74399999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.52400000000000002,"15min":0.51400000000000001},"min":{"1min":0.38900000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77400000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54500000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74099999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.437,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.35799999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72799999999999998,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.47699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46999999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.505,"15min":0.50600000000000001},"min":{"1min":0.33900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.67900000000000005,"5min":1.014,"15min":1.014},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.59499999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35199999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.38800000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73899999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.42999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77400000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59599999999999997,"15min":0.59899999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76500000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.63100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":284071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.72699999999999998,"15min":0.76400000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.65800000000000003,"5min":5.859,"15min":5.859},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74299999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.439}]},{"osd":1,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.373,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73299999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.495},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70699999999999996,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.38100000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.36299999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67800000000000005,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.44900000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.72399999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.45200000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.45300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.77500000000000002,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.62,"15min":0.621},"min":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.77300000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.33300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80100000000000005,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.81399999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.39500000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39800000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55700000000000005},"min":{"1min":0.43099999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46700000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.41099999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88500000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84699999999999998,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.52800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298500,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073340,"statfs":{"total":96636764160,"available":96331100160,"internally_reserved":0,"allocated":1241088,"data_stored":869184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.377,"15min":0.38300000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.49199999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.66500000000000004,"15min":0.71499999999999997},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.626,"5min":7.6900000000000004,"15min":7.6900000000000004},"last":0.28699999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.623,"15min":0.67100000000000004},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.53300000000000003,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.69699999999999995,"15min":0.747},"min":{"1min":0.28399999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56200000000000006,"5min":7.758,"15min":7.758},"last":0.251}]},{"osd":3,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.72199999999999998,"15min":0.77200000000000002},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.55400000000000005,"5min":7.7869999999999999,"15min":7.7869999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.41899999999999998,"15min":0.42399999999999999},"min":{"1min":0.28799999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.60099999999999998,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.33800000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":1.069,"15min":1.1439999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84699999999999998,"5min":11.678000000000001,"15min":11.678000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.90100000000000002,"15min":0.94999999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84299999999999997,"5min":7.6529999999999996,"15min":7.6529999999999996},"last":0.74199999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.97899999999999998,"5min":1.399,"15min":1.399},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.93600000000000005,"15min":0.98199999999999998},"min":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.79800000000000004,"5min":7.508,"15min":7.508},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.91100000000000003,"15min":0.95899999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.873,"5min":7.7270000000000003,"15min":7.7270000000000003},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68600000000000005,"15min":0.69199999999999995},"min":{"1min":0.49099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85499999999999998,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.57499999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.91400000000000003,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.95699999999999996,"15min":1.0029999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88200000000000001,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.753}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073924,"statfs":{"total":96636764160,"available":96331698176,"internally_reserved":0,"allocated":643072,"data_stored":277463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34599999999999997,"15min":0.34300000000000003},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.52500000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.35999999999999999,"15min":0.35799999999999998},"min":{"1min":0.27900000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.53900000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.249,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.33200000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.621,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.38500000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.34999999999999998},"min":{"1min":0.26100000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57799999999999996,"5min":0.622,"15min":0.622},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39100000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60299999999999998,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.37}]},{"osd":4,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.47799999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.437,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85099999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.497},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79700000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.56399999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.621,"15min":0.61599999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.47799999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79100000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.50600000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.51700000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90500000000000003,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":285424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.33800000000000002,"15min":0.33600000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.56799999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.26000000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34699999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39900000000000002,"15min":0.39800000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.30399999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.41099999999999998,"15min":0.40600000000000003},"min":{"1min":0.33600000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.29099999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.55100000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.45500000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.90000000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.628,"15min":0.623},"min":{"1min":0.46999999999999997,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93999999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95799999999999996,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.497},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.59799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":284071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.68999999999999995,"15min":0.745},"min":{"1min":0.221,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.59499999999999997,"5min":10.164999999999999,"15min":10.164999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.41099999999999998,"15min":0.41299999999999998},"min":{"1min":0.252,"5min":0.224,"15min":0.224},"max":{"1min":0.67300000000000004,"5min":1.266,"15min":1.266},"last":0.30099999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42799999999999999,"15min":0.432},"min":{"1min":0.27200000000000002,"5min":0.191,"15min":0.191},"max":{"1min":0.70999999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.317},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.433,"15min":0.433},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.83399999999999996,"5min":1.319,"15min":1.319},"last":0.24399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.30599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58899999999999997,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.312,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.81299999999999994,"5min":1.5,"15min":1.5},"last":0.34599999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.629,"15min":0.629},"min":{"1min":0.44500000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77300000000000002,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77700000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65900000000000003,"15min":0.66100000000000003},"min":{"1min":0.46200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86699999999999999,"5min":1.538,"15min":1.538},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.48099999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89400000000000002,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.63900000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.48999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.748,"5min":1.111,"15min":1.111},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.45600000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92800000000000005,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.51800000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46999999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88400000000000001,"5min":1.21,"15min":1.21},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46000000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90000000000000002,"5min":1.135,"15min":1.135},"last":0.53100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":285424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71799999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.504,"15min":0.501},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.49399999999999999,"15min":0.48799999999999999},"min":{"1min":0.41299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.52100000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.44,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.66700000000000004}]},{"osd":3,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.41399999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59599999999999997,"15min":0.59799999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.74299999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48899999999999999,"15min":0.48699999999999999},"min":{"1min":0.32300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76000000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.432}]},{"osd":6,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.377}]},{"osd":7,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81200000000000006,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58099999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.82499999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.48099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":285424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48799999999999999,"15min":0.48199999999999998},"min":{"1min":0.32700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68500000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.499}]},{"osd":2,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.68700000000000006,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.69599999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.372,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.64900000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.496,"15min":0.495},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.38400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.81599999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.43099999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.75800000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.45400000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.47199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:25:53.284 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:25:53.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.436+0000 7f5ebc93b700 1 Processor -- start 2023-10-06T02:25:53.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.437+0000 7f5ebc93b700 1 -- start start 2023-10-06T02:25:53.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.437+0000 7f5ebc93b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5eb8159aa0 0x7f5eb80c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.437+0000 7f5ebc93b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5eb80c6b30 0x7f5eb80cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.437+0000 7f5ebc93b700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb80c5300 con 0x7f5eb81596d0 2023-10-06T02:25:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.437+0000 7f5ebc93b700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb80c6160 con 0x7f5eb80c6b30 2023-10-06T02:25:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.437+0000 7f5ebc93b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb80c5550 con 0x7f5eb8159aa0 2023-10-06T02:25:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.438+0000 7f5eb6d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5eb80c6b30 0x7f5eb80cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.438+0000 7f5eb659c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5eb81596d0 0x7f5eb80b3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42220/0 (socket says 172.21.15.37:42220) 2023-10-06T02:25:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.438+0000 7f5eb659c700 1 -- 172.21.15.37:0/1081639274 learned_addr learned my addr 172.21.15.37:0/1081639274 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.438+0000 7f5eb5d9b700 1 --2- 172.21.15.37:0/1081639274 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5eb8159aa0 0x7f5eb80c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.438+0000 7f5eb6d9d700 1 -- 172.21.15.37:0/1081639274 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5eb8159aa0 msgr2=0x7f5eb80c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.438+0000 7f5eb6d9d700 1 --2- 172.21.15.37:0/1081639274 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5eb8159aa0 0x7f5eb80c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.438+0000 7f5eb6d9d700 1 -- 172.21.15.37:0/1081639274 >> v1:172.21.15.37:6789/0 conn(0x7f5eb81596d0 legacy=0x7f5eb80b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.438+0000 7f5eb6d9d700 1 -- 172.21.15.37:0/1081639274 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb80c5830 con 0x7f5eb80c6b30 2023-10-06T02:25:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.438+0000 7f5eb559a700 1 -- 172.21.15.37:0/1081639274 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674444163 0 0) 0x7f5eb80c5300 con 0x7f5eb81596d0 2023-10-06T02:25:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.438+0000 7f5eb6d9d700 1 --2- 172.21.15.37:0/1081639274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5eb80c6b30 0x7f5eb80cf9f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00098e0 tx=0x7f5eb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f3e4c9ba93da9d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.438+0000 7f5eb559a700 1 -- 172.21.15.37:0/1081639274 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0009e80 con 0x7f5eb80c6b30 2023-10-06T02:25:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.438+0000 7f5eb559a700 1 -- 172.21.15.37:0/1081639274 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb000b860 con 0x7f5eb80c6b30 2023-10-06T02:25:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.438+0000 7f5eb559a700 1 -- 172.21.15.37:0/1081639274 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb000bbe0 con 0x7f5eb80c6b30 2023-10-06T02:25:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.439+0000 7f5ebc93b700 1 -- 172.21.15.37:0/1081639274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5eb80c6b30 msgr2=0x7f5eb80cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.439+0000 7f5ebc93b700 1 --2- 172.21.15.37:0/1081639274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5eb80c6b30 0x7f5eb80cf9f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00098e0 tx=0x7f5eb00091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.439+0000 7f5ebc93b700 1 -- 172.21.15.37:0/1081639274 shutdown_connections 2023-10-06T02:25:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.439+0000 7f5ebc93b700 1 --2- 172.21.15.37:0/1081639274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5eb80c6b30 0x7f5eb80cf9f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.439+0000 7f5ebc93b700 1 --2- 172.21.15.37:0/1081639274 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5eb8159aa0 0x7f5eb80c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.439+0000 7f5ebc93b700 1 -- 172.21.15.37:0/1081639274 >> 172.21.15.37:0/1081639274 conn(0x7f5eb806c890 msgr2=0x7f5eb80d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.439+0000 7f5ebc93b700 1 -- 172.21.15.37:0/1081639274 shutdown_connections 2023-10-06T02:25:53.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.439+0000 7f5ebc93b700 1 -- 172.21.15.37:0/1081639274 wait complete. 2023-10-06T02:25:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.440+0000 7f5ebc93b700 1 Processor -- start 2023-10-06T02:25:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.440+0000 7f5ebc93b700 1 -- start start 2023-10-06T02:25:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.441+0000 7f5ebc93b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5eb80c6b30 0x7f5eb8147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.441+0000 7f5ebc93b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5eb81596d0 0x7f5eb809b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.441+0000 7f5ebc93b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5eb8159aa0 0x7f5eb8156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.441+0000 7f5ebc93b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb809cf90 con 0x7f5eb80c6b30 2023-10-06T02:25:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.441+0000 7f5ebc93b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb80caf20 con 0x7f5eb8159aa0 2023-10-06T02:25:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.441+0000 7f5ebc93b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb80cb200 con 0x7f5eb81596d0 2023-10-06T02:25:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.441+0000 7f5eb659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5eb80c6b30 0x7f5eb8147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.441+0000 7f5eb659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5eb80c6b30 0x7f5eb8147ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49684/0 (socket says 172.21.15.37:49684) 2023-10-06T02:25:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.441+0000 7f5eb659c700 1 -- 172.21.15.37:0/658638913 learned_addr learned my addr 172.21.15.37:0/658638913 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.441+0000 7f5eb659c700 1 -- 172.21.15.37:0/658638913 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5eb81596d0 msgr2=0x7f5eb809b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.441+0000 7f5eb659c700 1 --2- 172.21.15.37:0/658638913 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5eb81596d0 0x7f5eb809b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.441+0000 7f5eb659c700 1 -- 172.21.15.37:0/658638913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5eb8159aa0 msgr2=0x7f5eb8156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.441+0000 7f5eb659c700 1 --2- 172.21.15.37:0/658638913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5eb8159aa0 0x7f5eb8156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.441+0000 7f5eb659c700 1 -- 172.21.15.37:0/658638913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb0009420 con 0x7f5eb80c6b30 2023-10-06T02:25:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.441+0000 7f5eb659c700 1 --2- 172.21.15.37:0/658638913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5eb80c6b30 0x7f5eb8147ec0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800cd80 tx=0x7f5ea8001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.441+0000 7f5eae7fc700 1 -- 172.21.15.37:0/658638913 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea800ab10 con 0x7f5eb80c6b30 2023-10-06T02:25:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.441+0000 7f5eae7fc700 1 -- 172.21.15.37:0/658638913 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea800ac70 con 0x7f5eb80c6b30 2023-10-06T02:25:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.441+0000 7f5eae7fc700 1 -- 172.21.15.37:0/658638913 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea80070f0 con 0x7f5eb80c6b30 2023-10-06T02:25:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.441+0000 7f5ebc93b700 1 -- 172.21.15.37:0/658638913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb80cb4e0 con 0x7f5eb80c6b30 2023-10-06T02:25:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.441+0000 7f5ebc93b700 1 -- 172.21.15.37:0/658638913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb80cbb20 con 0x7f5eb80c6b30 2023-10-06T02:25:53.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.442+0000 7f5ebc93b700 1 -- 172.21.15.37:0/658638913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb80cacf0 con 0x7f5eb80c6b30 2023-10-06T02:25:53.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.443+0000 7f5eae7fc700 1 -- 172.21.15.37:0/658638913 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ea80074e0 con 0x7f5eb80c6b30 2023-10-06T02:25:53.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.443+0000 7f5eae7fc700 1 --2- 172.21.15.37:0/658638913 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5e98066f30 0x7f5e980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.443+0000 7f5eae7fc700 1 -- 172.21.15.37:0/658638913 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5ea8084c20 con 0x7f5eb80c6b30 2023-10-06T02:25:53.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.443+0000 7f5eb5d9b700 1 --2- 172.21.15.37:0/658638913 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5e98066f30 0x7f5e980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.444+0000 7f5eb5d9b700 1 --2- 172.21.15.37:0/658638913 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5e98066f30 0x7f5e980693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5eb80d10b0 tx=0x7f5ea0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.448+0000 7f5eae7fc700 1 -- 172.21.15.37:0/658638913 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ea8051db0 con 0x7f5eb80c6b30 2023-10-06T02:25:53.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.637+0000 7f5ebc93b700 1 -- 172.21.15.37:0/658638913 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5eb806fbf0 con 0x7f5e98066f30 2023-10-06T02:25:53.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.647+0000 7f5eae7fc700 1 -- 172.21.15.37:0/658638913 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308943 (secure 0 0 0) 0x7f5eb806fbf0 con 0x7f5e98066f30 2023-10-06T02:25:53.651 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:53.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.650+0000 7f5ebc93b700 1 -- 172.21.15.37:0/658638913 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5e98066f30 msgr2=0x7f5e980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.650+0000 7f5ebc93b700 1 --2- 172.21.15.37:0/658638913 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5e98066f30 0x7f5e980693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5eb80d10b0 tx=0x7f5ea0008040 comp rx=0 tx=0).stop 2023-10-06T02:25:53.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.650+0000 7f5ebc93b700 1 -- 172.21.15.37:0/658638913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5eb80c6b30 msgr2=0x7f5eb8147ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.650+0000 7f5ebc93b700 1 --2- 172.21.15.37:0/658638913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5eb80c6b30 0x7f5eb8147ec0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800cd80 tx=0x7f5ea8001ae0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.650+0000 7f5ebc93b700 1 -- 172.21.15.37:0/658638913 shutdown_connections 2023-10-06T02:25:53.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.650+0000 7f5ebc93b700 1 --2- 172.21.15.37:0/658638913 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5e98066f30 0x7f5e980693e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.650+0000 7f5ebc93b700 1 --2- 172.21.15.37:0/658638913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5eb8159aa0 0x7f5eb8156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.650+0000 7f5ebc93b700 1 --2- 172.21.15.37:0/658638913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5eb80c6b30 0x7f5eb8147ec0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.650+0000 7f5ebc93b700 1 --2- 172.21.15.37:0/658638913 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5eb81596d0 0x7f5eb809b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.650+0000 7f5ebc93b700 1 -- 172.21.15.37:0/658638913 >> 172.21.15.37:0/658638913 conn(0x7f5eb806c890 msgr2=0x7f5eb8158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:53.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.650+0000 7f5ebc93b700 1 -- 172.21.15.37:0/658638913 shutdown_connections 2023-10-06T02:25:53.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.650+0000 7f5ebc93b700 1 -- 172.21.15.37:0/658638913 wait complete. 2023-10-06T02:25:53.654 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:25:53.662 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2023-10-06T02:25:52.546690+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384580,"kb_used_data":6276,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590140,"statfs":{"total":773094113280,"available":770652303360,"internally_reserved":0,"allocated":6426624,"data_stored":3446853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.788204"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762779+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:48.969007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762329+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:43.827759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771263+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:03.991817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765977+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:18.739198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767718+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:20.191318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767613+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:37.913721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770406+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:16.823479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.776090+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:53.382091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771176+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:57.656013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771243+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:41.394648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767034+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:15.007098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.778100+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:37.561344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.778213+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:23.103556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768638+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:46.321524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.769330+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:23.103556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771508+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:27.557897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762241+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:25.981569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.766332+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:23.618730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770887+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:03.082588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767580+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:01.275354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.777405+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:23.618730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767511+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:41.394648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768061+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:14.533092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.769284+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:23.618730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.777454+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:21.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.778548+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:15.227230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.766594+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:21.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.763060+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:25.687797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768709+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:15.007098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.777547+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:46.321524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765879+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:53.382091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768311+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:33.984884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.772465+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:59.518906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.779666+0000","last_change":"2023-10-06T02:25:47.779666+0000","last_active":"2023-10-06T02:25:47.779666+0000","last_peered":"2023-10-06T02:25:47.779666+0000","last_clean":"2023-10-06T02:25:47.779666+0000","last_became_active":"2023-10-06T02:25:47.779228+0000","last_became_peered":"2023-10-06T02:25:47.779228+0000","last_unstale":"2023-10-06T02:25:47.779666+0000","last_undegraded":"2023-10-06T02:25:47.779666+0000","last_fullsized":"2023-10-06T02:25:47.779666+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:21.300373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765954+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:09.893223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.778547+0000","last_change":"2023-10-06T02:25:47.778547+0000","last_active":"2023-10-06T02:25:47.778547+0000","last_peered":"2023-10-06T02:25:47.778547+0000","last_clean":"2023-10-06T02:25:47.778547+0000","last_became_active":"2023-10-06T02:25:47.778062+0000","last_became_peered":"2023-10-06T02:25:47.778062+0000","last_unstale":"2023-10-06T02:25:47.778547+0000","last_undegraded":"2023-10-06T02:25:47.778547+0000","last_fullsized":"2023-10-06T02:25:47.778547+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:22.094876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768128+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:52.758045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.781462+0000","last_change":"2023-10-06T02:25:47.781462+0000","last_active":"2023-10-06T02:25:47.781462+0000","last_peered":"2023-10-06T02:25:47.781462+0000","last_clean":"2023-10-06T02:25:47.781462+0000","last_became_active":"2023-10-06T02:25:47.781039+0000","last_became_peered":"2023-10-06T02:25:47.781039+0000","last_unstale":"2023-10-06T02:25:47.781462+0000","last_undegraded":"2023-10-06T02:25:47.781462+0000","last_fullsized":"2023-10-06T02:25:47.781462+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:56.647333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.769083+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:37.561344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.772551+0000","last_change":"2023-10-06T02:25:47.772551+0000","last_active":"2023-10-06T02:25:47.772551+0000","last_peered":"2023-10-06T02:25:47.772551+0000","last_clean":"2023-10-06T02:25:47.772551+0000","last_became_active":"2023-10-06T02:25:47.772269+0000","last_became_peered":"2023-10-06T02:25:47.772269+0000","last_unstale":"2023-10-06T02:25:47.772551+0000","last_undegraded":"2023-10-06T02:25:47.772551+0000","last_fullsized":"2023-10-06T02:25:47.772551+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:36.552664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770593+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:25.885346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.775941+0000","last_change":"2023-10-06T02:25:47.775941+0000","last_active":"2023-10-06T02:25:47.775941+0000","last_peered":"2023-10-06T02:25:47.775941+0000","last_clean":"2023-10-06T02:25:47.775941+0000","last_became_active":"2023-10-06T02:25:47.775677+0000","last_became_peered":"2023-10-06T02:25:47.775677+0000","last_unstale":"2023-10-06T02:25:47.775941+0000","last_undegraded":"2023-10-06T02:25:47.775941+0000","last_fullsized":"2023-10-06T02:25:47.775941+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:14.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762044+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:21.678499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.776075+0000","last_change":"2023-10-06T02:25:47.776075+0000","last_active":"2023-10-06T02:25:47.776075+0000","last_peered":"2023-10-06T02:25:47.776075+0000","last_clean":"2023-10-06T02:25:47.776075+0000","last_became_active":"2023-10-06T02:25:47.775812+0000","last_became_peered":"2023-10-06T02:25:47.775812+0000","last_unstale":"2023-10-06T02:25:47.776075+0000","last_undegraded":"2023-10-06T02:25:47.776075+0000","last_fullsized":"2023-10-06T02:25:47.776075+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:20.646833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.773984+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:24.538628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.782265+0000","last_change":"2023-10-06T02:25:47.782265+0000","last_active":"2023-10-06T02:25:47.782265+0000","last_peered":"2023-10-06T02:25:47.782265+0000","last_clean":"2023-10-06T02:25:47.782265+0000","last_became_active":"2023-10-06T02:25:47.781984+0000","last_became_peered":"2023-10-06T02:25:47.781984+0000","last_unstale":"2023-10-06T02:25:47.782265+0000","last_undegraded":"2023-10-06T02:25:47.782265+0000","last_fullsized":"2023-10-06T02:25:47.782265+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:13.998418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768306+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:03.991817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.776645+0000","last_change":"2023-10-06T02:25:47.776645+0000","last_active":"2023-10-06T02:25:47.776645+0000","last_peered":"2023-10-06T02:25:47.776645+0000","last_clean":"2023-10-06T02:25:47.776645+0000","last_became_active":"2023-10-06T02:25:47.776222+0000","last_became_peered":"2023-10-06T02:25:47.776222+0000","last_unstale":"2023-10-06T02:25:47.776645+0000","last_undegraded":"2023-10-06T02:25:47.776645+0000","last_fullsized":"2023-10-06T02:25:47.776645+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:03.400305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762646+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:10.359414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.783911+0000","last_change":"2023-10-06T02:25:47.783911+0000","last_active":"2023-10-06T02:25:47.783911+0000","last_peered":"2023-10-06T02:25:47.783911+0000","last_clean":"2023-10-06T02:25:47.783911+0000","last_became_active":"2023-10-06T02:25:47.783672+0000","last_became_peered":"2023-10-06T02:25:47.783672+0000","last_unstale":"2023-10-06T02:25:47.783911+0000","last_undegraded":"2023-10-06T02:25:47.783911+0000","last_fullsized":"2023-10-06T02:25:47.783911+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:53.337356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768353+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:57.656013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.774544+0000","last_change":"2023-10-06T02:25:47.774544+0000","last_active":"2023-10-06T02:25:47.774544+0000","last_peered":"2023-10-06T02:25:47.774544+0000","last_clean":"2023-10-06T02:25:47.774544+0000","last_became_active":"2023-10-06T02:25:47.773704+0000","last_became_peered":"2023-10-06T02:25:47.773704+0000","last_unstale":"2023-10-06T02:25:47.774544+0000","last_undegraded":"2023-10-06T02:25:47.774544+0000","last_fullsized":"2023-10-06T02:25:47.774544+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:04.612716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.772791+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:39.144943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.781564+0000","last_change":"2023-10-06T02:25:47.781564+0000","last_active":"2023-10-06T02:25:47.781564+0000","last_peered":"2023-10-06T02:25:47.781564+0000","last_clean":"2023-10-06T02:25:47.781564+0000","last_became_active":"2023-10-06T02:25:47.781157+0000","last_became_peered":"2023-10-06T02:25:47.781157+0000","last_unstale":"2023-10-06T02:25:47.781564+0000","last_undegraded":"2023-10-06T02:25:47.781564+0000","last_fullsized":"2023-10-06T02:25:47.781564+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:37.047439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765749+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:54.346036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.774248+0000","last_change":"2023-10-06T02:25:47.774248+0000","last_active":"2023-10-06T02:25:47.774248+0000","last_peered":"2023-10-06T02:25:47.774248+0000","last_clean":"2023-10-06T02:25:47.774248+0000","last_became_active":"2023-10-06T02:25:47.773967+0000","last_became_peered":"2023-10-06T02:25:47.773967+0000","last_unstale":"2023-10-06T02:25:47.774248+0000","last_undegraded":"2023-10-06T02:25:47.774248+0000","last_fullsized":"2023-10-06T02:25:47.774248+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:19.027538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765332+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:35.551701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.782266+0000","last_change":"2023-10-06T02:25:47.782266+0000","last_active":"2023-10-06T02:25:47.782266+0000","last_peered":"2023-10-06T02:25:47.782266+0000","last_clean":"2023-10-06T02:25:47.782266+0000","last_became_active":"2023-10-06T02:25:47.781819+0000","last_became_peered":"2023-10-06T02:25:47.781819+0000","last_unstale":"2023-10-06T02:25:47.782266+0000","last_undegraded":"2023-10-06T02:25:47.782266+0000","last_fullsized":"2023-10-06T02:25:47.782266+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:20.653387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.776962+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:18.739198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.783305+0000","last_change":"2023-10-06T02:25:47.783305+0000","last_active":"2023-10-06T02:25:47.783305+0000","last_peered":"2023-10-06T02:25:47.783305+0000","last_clean":"2023-10-06T02:25:47.783305+0000","last_became_active":"2023-10-06T02:25:47.783026+0000","last_became_peered":"2023-10-06T02:25:47.783026+0000","last_unstale":"2023-10-06T02:25:47.783305+0000","last_undegraded":"2023-10-06T02:25:47.783305+0000","last_fullsized":"2023-10-06T02:25:47.783305+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:53.337356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.773523+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:11:03.662406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.780895+0000","last_change":"2023-10-06T02:25:47.780895+0000","last_active":"2023-10-06T02:25:47.780895+0000","last_peered":"2023-10-06T02:25:47.780895+0000","last_clean":"2023-10-06T02:25:47.780895+0000","last_became_active":"2023-10-06T02:25:47.780602+0000","last_became_peered":"2023-10-06T02:25:47.780602+0000","last_unstale":"2023-10-06T02:25:47.780895+0000","last_undegraded":"2023-10-06T02:25:47.780895+0000","last_fullsized":"2023-10-06T02:25:47.780895+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:08.884543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762767+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:54.359817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.779687+0000","last_change":"2023-10-06T02:25:47.779687+0000","last_active":"2023-10-06T02:25:47.779687+0000","last_peered":"2023-10-06T02:25:47.779687+0000","last_clean":"2023-10-06T02:25:47.779687+0000","last_became_active":"2023-10-06T02:25:47.779422+0000","last_became_peered":"2023-10-06T02:25:47.779422+0000","last_unstale":"2023-10-06T02:25:47.779687+0000","last_undegraded":"2023-10-06T02:25:47.779687+0000","last_fullsized":"2023-10-06T02:25:47.779687+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:06.807270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767455+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:14.533092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.789740+0000","last_change":"2023-10-06T02:25:47.789740+0000","last_active":"2023-10-06T02:25:47.789740+0000","last_peered":"2023-10-06T02:25:47.789740+0000","last_clean":"2023-10-06T02:25:47.789740+0000","last_became_active":"2023-10-06T02:25:47.789419+0000","last_became_peered":"2023-10-06T02:25:47.789419+0000","last_unstale":"2023-10-06T02:25:47.789740+0000","last_undegraded":"2023-10-06T02:25:47.789740+0000","last_fullsized":"2023-10-06T02:25:47.789740+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:20.653387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770463+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:54.727662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.780940+0000","last_change":"2023-10-06T02:25:47.780940+0000","last_active":"2023-10-06T02:25:47.780940+0000","last_peered":"2023-10-06T02:25:47.780940+0000","last_clean":"2023-10-06T02:25:47.780940+0000","last_became_active":"2023-10-06T02:25:47.780649+0000","last_became_peered":"2023-10-06T02:25:47.780649+0000","last_unstale":"2023-10-06T02:25:47.780940+0000","last_undegraded":"2023-10-06T02:25:47.780940+0000","last_fullsized":"2023-10-06T02:25:47.780940+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:06.807270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.778042+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:15.007098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.781285+0000","last_change":"2023-10-06T02:25:47.781285+0000","last_active":"2023-10-06T02:25:47.781285+0000","last_peered":"2023-10-06T02:25:47.781285+0000","last_clean":"2023-10-06T02:25:47.781285+0000","last_became_active":"2023-10-06T02:25:47.780775+0000","last_became_peered":"2023-10-06T02:25:47.780775+0000","last_unstale":"2023-10-06T02:25:47.781285+0000","last_undegraded":"2023-10-06T02:25:47.781285+0000","last_fullsized":"2023-10-06T02:25:47.781285+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.703535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771436+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:03.303783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.774115+0000","last_change":"2023-10-06T02:25:47.774115+0000","last_active":"2023-10-06T02:25:47.774115+0000","last_peered":"2023-10-06T02:25:47.774115+0000","last_clean":"2023-10-06T02:25:47.774115+0000","last_became_active":"2023-10-06T02:25:47.773648+0000","last_became_peered":"2023-10-06T02:25:47.773648+0000","last_unstale":"2023-10-06T02:25:47.774115+0000","last_undegraded":"2023-10-06T02:25:47.774115+0000","last_fullsized":"2023-10-06T02:25:47.774115+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:12.915334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768826+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:20.440565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.780245+0000","last_change":"2023-10-06T02:25:47.780245+0000","last_active":"2023-10-06T02:25:47.780245+0000","last_peered":"2023-10-06T02:25:47.780245+0000","last_clean":"2023-10-06T02:25:47.780245+0000","last_became_active":"2023-10-06T02:25:47.779986+0000","last_became_peered":"2023-10-06T02:25:47.779986+0000","last_unstale":"2023-10-06T02:25:47.780245+0000","last_undegraded":"2023-10-06T02:25:47.780245+0000","last_fullsized":"2023-10-06T02:25:47.780245+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:52.373411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765370+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:38.056119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.773995+0000","last_change":"2023-10-06T02:25:47.773995+0000","last_active":"2023-10-06T02:25:47.773995+0000","last_peered":"2023-10-06T02:25:47.773995+0000","last_clean":"2023-10-06T02:25:47.773995+0000","last_became_active":"2023-10-06T02:25:47.773707+0000","last_became_peered":"2023-10-06T02:25:47.773707+0000","last_unstale":"2023-10-06T02:25:47.773995+0000","last_undegraded":"2023-10-06T02:25:47.773995+0000","last_fullsized":"2023-10-06T02:25:47.773995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:36.552664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762082+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:31.177238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.780787+0000","last_change":"2023-10-06T02:25:47.780787+0000","last_active":"2023-10-06T02:25:47.780787+0000","last_peered":"2023-10-06T02:25:47.780787+0000","last_clean":"2023-10-06T02:25:47.780787+0000","last_became_active":"2023-10-06T02:25:47.780419+0000","last_became_peered":"2023-10-06T02:25:47.780419+0000","last_unstale":"2023-10-06T02:25:47.780787+0000","last_undegraded":"2023-10-06T02:25:47.780787+0000","last_fullsized":"2023-10-06T02:25:47.780787+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:45.312844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770517+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:13:49.398898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.777859+0000","last_change":"2023-10-06T02:25:47.777859+0000","last_active":"2023-10-06T02:25:47.777859+0000","last_peered":"2023-10-06T02:25:47.777859+0000","last_clean":"2023-10-06T02:25:47.777859+0000","last_became_active":"2023-10-06T02:25:47.777513+0000","last_became_peered":"2023-10-06T02:25:47.777513+0000","last_unstale":"2023-10-06T02:25:47.777859+0000","last_undegraded":"2023-10-06T02:25:47.777859+0000","last_fullsized":"2023-10-06T02:25:47.777859+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:40.898787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765775+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:15.256053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.781385+0000","last_change":"2023-10-06T02:25:47.781385+0000","last_active":"2023-10-06T02:25:47.781385+0000","last_peered":"2023-10-06T02:25:47.781385+0000","last_clean":"2023-10-06T02:25:47.781385+0000","last_became_active":"2023-10-06T02:25:47.780787+0000","last_became_peered":"2023-10-06T02:25:47.780787+0000","last_unstale":"2023-10-06T02:25:47.781385+0000","last_undegraded":"2023-10-06T02:25:47.781385+0000","last_fullsized":"2023-10-06T02:25:47.781385+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:34.543022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.765591+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:25:46.765591+0000","last_peered":"2023-10-06T02:25:46.765591+0000","last_clean":"2023-10-06T02:25:46.765591+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:25:46.765591+0000","last_undegraded":"2023-10-06T02:25:46.765591+0000","last_fullsized":"2023-10-06T02:25:46.765591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771919+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:51.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.775239+0000","last_change":"2023-10-06T02:25:47.775239+0000","last_active":"2023-10-06T02:25:47.775239+0000","last_peered":"2023-10-06T02:25:47.775239+0000","last_clean":"2023-10-06T02:25:47.775239+0000","last_became_active":"2023-10-06T02:25:47.774968+0000","last_became_peered":"2023-10-06T02:25:47.774968+0000","last_unstale":"2023-10-06T02:25:47.775239+0000","last_undegraded":"2023-10-06T02:25:47.775239+0000","last_fullsized":"2023-10-06T02:25:47.775239+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:17.730518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":43,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.772772+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:25:46.772772+0000","last_peered":"2023-10-06T02:25:46.772772+0000","last_clean":"2023-10-06T02:25:46.772772+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:25:46.772772+0000","last_undegraded":"2023-10-06T02:25:46.772772+0000","last_fullsized":"2023-10-06T02:25:46.772772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767839+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:44.695976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.780762+0000","last_change":"2023-10-06T02:25:47.780762+0000","last_active":"2023-10-06T02:25:47.780762+0000","last_peered":"2023-10-06T02:25:47.780762+0000","last_clean":"2023-10-06T02:25:47.780762+0000","last_became_active":"2023-10-06T02:25:47.780493+0000","last_became_peered":"2023-10-06T02:25:47.780493+0000","last_unstale":"2023-10-06T02:25:47.780762+0000","last_undegraded":"2023-10-06T02:25:47.780762+0000","last_fullsized":"2023-10-06T02:25:47.780762+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:40.385968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.765190+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:25:46.765190+0000","last_peered":"2023-10-06T02:25:46.765190+0000","last_clean":"2023-10-06T02:25:46.765190+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:25:46.765190+0000","last_undegraded":"2023-10-06T02:25:46.765190+0000","last_fullsized":"2023-10-06T02:25:46.765190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.763943+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:25:46.763943+0000","last_peered":"2023-10-06T02:25:46.763943+0000","last_clean":"2023-10-06T02:25:46.763943+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:25:46.763943+0000","last_undegraded":"2023-10-06T02:25:46.763943+0000","last_fullsized":"2023-10-06T02:25:46.763943+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.776495+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:09.893223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.783177+0000","last_change":"2023-10-06T02:25:47.783177+0000","last_active":"2023-10-06T02:25:47.783177+0000","last_peered":"2023-10-06T02:25:47.783177+0000","last_clean":"2023-10-06T02:25:47.783177+0000","last_became_active":"2023-10-06T02:25:47.782762+0000","last_became_peered":"2023-10-06T02:25:47.782762+0000","last_unstale":"2023-10-06T02:25:47.783177+0000","last_undegraded":"2023-10-06T02:25:47.783177+0000","last_fullsized":"2023-10-06T02:25:47.783177+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:34.543022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.763990+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:25:46.763990+0000","last_peered":"2023-10-06T02:25:46.763990+0000","last_clean":"2023-10-06T02:25:46.763990+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:25:46.763990+0000","last_undegraded":"2023-10-06T02:25:46.763990+0000","last_fullsized":"2023-10-06T02:25:46.763990+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.772574+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:15.338941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.774699+0000","last_change":"2023-10-06T02:25:47.774699+0000","last_active":"2023-10-06T02:25:47.774699+0000","last_peered":"2023-10-06T02:25:47.774699+0000","last_clean":"2023-10-06T02:25:47.774699+0000","last_became_active":"2023-10-06T02:25:47.774440+0000","last_became_peered":"2023-10-06T02:25:47.774440+0000","last_unstale":"2023-10-06T02:25:47.774699+0000","last_undegraded":"2023-10-06T02:25:47.774699+0000","last_fullsized":"2023-10-06T02:25:47.774699+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:22.094876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.763928+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:25:46.763928+0000","last_peered":"2023-10-06T02:25:46.763928+0000","last_clean":"2023-10-06T02:25:46.763928+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:25:46.763928+0000","last_undegraded":"2023-10-06T02:25:46.763928+0000","last_fullsized":"2023-10-06T02:25:46.763928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.772455+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:17.993235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.778193+0000","last_change":"2023-10-06T02:25:47.778193+0000","last_active":"2023-10-06T02:25:47.778193+0000","last_peered":"2023-10-06T02:25:47.778193+0000","last_clean":"2023-10-06T02:25:47.778193+0000","last_became_active":"2023-10-06T02:25:47.777897+0000","last_became_peered":"2023-10-06T02:25:47.777897+0000","last_unstale":"2023-10-06T02:25:47.778193+0000","last_undegraded":"2023-10-06T02:25:47.778193+0000","last_fullsized":"2023-10-06T02:25:47.778193+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:14.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.762158+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:25:46.762158+0000","last_peered":"2023-10-06T02:25:46.762158+0000","last_clean":"2023-10-06T02:25:46.762158+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:25:46.762158+0000","last_undegraded":"2023-10-06T02:25:46.762158+0000","last_fullsized":"2023-10-06T02:25:46.762158+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770377+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:27.460927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.784926+0000","last_change":"2023-10-06T02:25:47.784926+0000","last_active":"2023-10-06T02:25:47.784926+0000","last_peered":"2023-10-06T02:25:47.784926+0000","last_clean":"2023-10-06T02:25:47.784926+0000","last_became_active":"2023-10-06T02:25:47.784660+0000","last_became_peered":"2023-10-06T02:25:47.784660+0000","last_unstale":"2023-10-06T02:25:47.784926+0000","last_undegraded":"2023-10-06T02:25:47.784926+0000","last_fullsized":"2023-10-06T02:25:47.784926+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:14.247373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.761018+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:25:46.761018+0000","last_peered":"2023-10-06T02:25:46.761018+0000","last_clean":"2023-10-06T02:25:46.761018+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:25:46.761018+0000","last_undegraded":"2023-10-06T02:25:46.761018+0000","last_fullsized":"2023-10-06T02:25:46.761018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.769530+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:21.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.782458+0000","last_change":"2023-10-06T02:25:47.782458+0000","last_active":"2023-10-06T02:25:47.782458+0000","last_peered":"2023-10-06T02:25:47.782458+0000","last_clean":"2023-10-06T02:25:47.782458+0000","last_became_active":"2023-10-06T02:25:47.782128+0000","last_became_peered":"2023-10-06T02:25:47.782128+0000","last_unstale":"2023-10-06T02:25:47.782458+0000","last_undegraded":"2023-10-06T02:25:47.782458+0000","last_fullsized":"2023-10-06T02:25:47.782458+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:37.047439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.761086+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:25:46.761086+0000","last_peered":"2023-10-06T02:25:46.761086+0000","last_clean":"2023-10-06T02:25:46.761086+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:25:46.761086+0000","last_undegraded":"2023-10-06T02:25:46.761086+0000","last_fullsized":"2023-10-06T02:25:46.761086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":875792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53000000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.77100000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.314,"15min":0.314},"max":{"1min":0.74399999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.52400000000000002,"15min":0.51400000000000001},"min":{"1min":0.38900000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77400000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54500000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74099999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.437,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.35799999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72799999999999998,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.47699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46999999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.505,"15min":0.50600000000000001},"min":{"1min":0.33900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.67900000000000005,"5min":1.014,"15min":1.014},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.59499999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35199999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.38800000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73899999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.42999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77400000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59599999999999997,"15min":0.59899999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76500000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.63100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":284071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.72699999999999998,"15min":0.76400000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.65800000000000003,"5min":5.859,"15min":5.859},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74299999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.439}]},{"osd":1,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.373,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73299999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.495},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70699999999999996,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.38100000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.36299999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67800000000000005,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.44900000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.72399999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.45200000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.45300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.77500000000000002,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.62,"15min":0.621},"min":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.77300000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.33300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80100000000000005,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.81399999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.39500000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39800000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55700000000000005},"min":{"1min":0.43099999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46700000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.41099999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88500000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84699999999999998,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.52800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298500,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073340,"statfs":{"total":96636764160,"available":96331100160,"internally_reserved":0,"allocated":1241088,"data_stored":869184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.377,"15min":0.38300000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.49199999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.66500000000000004,"15min":0.71499999999999997},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.626,"5min":7.6900000000000004,"15min":7.6900000000000004},"last":0.28699999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.623,"15min":0.67100000000000004},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.53300000000000003,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.69699999999999995,"15min":0.747},"min":{"1min":0.28399999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56200000000000006,"5min":7.758,"15min":7.758},"last":0.251}]},{"osd":3,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.72199999999999998,"15min":0.77200000000000002},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.55400000000000005,"5min":7.7869999999999999,"15min":7.7869999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.41899999999999998,"15min":0.42399999999999999},"min":{"1min":0.28799999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.60099999999999998,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.33800000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":1.069,"15min":1.1439999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84699999999999998,"5min":11.678000000000001,"15min":11.678000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.90100000000000002,"15min":0.94999999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84299999999999997,"5min":7.6529999999999996,"15min":7.6529999999999996},"last":0.74199999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.97899999999999998,"5min":1.399,"15min":1.399},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.93600000000000005,"15min":0.98199999999999998},"min":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.79800000000000004,"5min":7.508,"15min":7.508},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.91100000000000003,"15min":0.95899999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.873,"5min":7.7270000000000003,"15min":7.7270000000000003},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68600000000000005,"15min":0.69199999999999995},"min":{"1min":0.49099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85499999999999998,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.57499999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.91400000000000003,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.95699999999999996,"15min":1.0029999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88200000000000001,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.753}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073924,"statfs":{"total":96636764160,"available":96331698176,"internally_reserved":0,"allocated":643072,"data_stored":277463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34599999999999997,"15min":0.34300000000000003},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.52500000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.35999999999999999,"15min":0.35799999999999998},"min":{"1min":0.27900000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.53900000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.249,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.33200000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.621,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.38500000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.34999999999999998},"min":{"1min":0.26100000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57799999999999996,"5min":0.622,"15min":0.622},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39100000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60299999999999998,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.37}]},{"osd":4,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.47799999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.437,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85099999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.497},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79700000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.56399999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.621,"15min":0.61599999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.47799999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79100000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.50600000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.51700000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90500000000000003,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":285424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.33800000000000002,"15min":0.33600000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.56799999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.26000000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34699999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39900000000000002,"15min":0.39800000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.30399999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.41099999999999998,"15min":0.40600000000000003},"min":{"1min":0.33600000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.29099999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.55100000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.45500000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.90000000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.628,"15min":0.623},"min":{"1min":0.46999999999999997,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93999999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95799999999999996,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.497},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.59799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":284071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.68999999999999995,"15min":0.745},"min":{"1min":0.221,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.59499999999999997,"5min":10.164999999999999,"15min":10.164999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.41099999999999998,"15min":0.41299999999999998},"min":{"1min":0.252,"5min":0.224,"15min":0.224},"max":{"1min":0.67300000000000004,"5min":1.266,"15min":1.266},"last":0.30099999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42799999999999999,"15min":0.432},"min":{"1min":0.27200000000000002,"5min":0.191,"15min":0.191},"max":{"1min":0.70999999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.317},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.433,"15min":0.433},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.83399999999999996,"5min":1.319,"15min":1.319},"last":0.24399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.30599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58899999999999997,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.312,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.81299999999999994,"5min":1.5,"15min":1.5},"last":0.34599999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.629,"15min":0.629},"min":{"1min":0.44500000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77300000000000002,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77700000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65900000000000003,"15min":0.66100000000000003},"min":{"1min":0.46200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86699999999999999,"5min":1.538,"15min":1.538},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.48099999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89400000000000002,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.63900000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.48999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.748,"5min":1.111,"15min":1.111},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.45600000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92800000000000005,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.51800000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46999999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88400000000000001,"5min":1.21,"15min":1.21},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46000000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90000000000000002,"5min":1.135,"15min":1.135},"last":0.53100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":285424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71799999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.504,"15min":0.501},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.49399999999999999,"15min":0.48799999999999999},"min":{"1min":0.41299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.52100000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.44,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.66700000000000004}]},{"osd":3,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.41399999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59599999999999997,"15min":0.59799999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.74299999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48899999999999999,"15min":0.48699999999999999},"min":{"1min":0.32300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76000000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.432}]},{"osd":6,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.377}]},{"osd":7,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81200000000000006,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58099999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.82499999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.48099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":285424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48799999999999999,"15min":0.48199999999999998},"min":{"1min":0.32700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68500000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.499}]},{"osd":2,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.68700000000000006,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.69599999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.372,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.64900000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.496,"15min":0.495},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.38400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.81599999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.43099999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.75800000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.45400000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.47199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:25:53.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3f is not active+clean 2023-10-06T02:25:53.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.762779+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:20:48.969007+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:25:53.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3e is not active+clean 2023-10-06T02:25:53.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.762329+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:10:43.827759+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:25:53.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3d is not active+clean 2023-10-06T02:25:53.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.771263+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:20:03.991817+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:25:53.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3c is not active+clean 2023-10-06T02:25:53.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.765977+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:16:18.739198+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:25:53.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3b is not active+clean 2023-10-06T02:25:53.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.767718+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:22:20.191318+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:25:53.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3a is not active+clean 2023-10-06T02:25:53.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.767613+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:22:37.913721+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:25:53.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.39 is not active+clean 2023-10-06T02:25:53.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.770406+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:07:16.823479+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:25:53.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2023-10-06T02:25:53.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.776090+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T02:37:53.382091+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:25:53.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2023-10-06T02:25:53.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.771176+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:46:57.656013+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:25:53.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.36 is not active+clean 2023-10-06T02:25:53.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.771243+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:56:41.394648+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:25:53.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.35 is not active+clean 2023-10-06T02:25:53.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.767034+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:30:15.007098+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:25:53.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2023-10-06T02:25:53.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.778100+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:47:37.561344+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:25:53.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.33 is not active+clean 2023-10-06T02:25:53.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.778213+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:09:23.103556+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:25:53.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.32 is not active+clean 2023-10-06T02:25:53.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.768638+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:49:46.321524+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:25:53.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.31 is not active+clean 2023-10-06T02:25:53.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.769330+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:09:23.103556+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:25:53.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.30 is not active+clean 2023-10-06T02:25:53.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.771508+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:32:27.557897+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:25:53.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2f is not active+clean 2023-10-06T02:25:53.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.762241+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:09:25.981569+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:25:53.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2e is not active+clean 2023-10-06T02:25:53.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.766332+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:05:23.618730+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:25:53.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2d is not active+clean 2023-10-06T02:25:53.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.770887+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:38:03.082588+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:25:53.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2c is not active+clean 2023-10-06T02:25:53.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.767580+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:06:01.275354+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:25:53.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2b is not active+clean 2023-10-06T02:25:53.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.777405+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:05:23.618730+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:25:53.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2a is not active+clean 2023-10-06T02:25:53.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.767511+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:56:41.394648+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:25:53.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.29 is not active+clean 2023-10-06T02:25:53.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.768061+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:16:14.533092+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:25:53.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.28 is not active+clean 2023-10-06T02:25:53.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.769284+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:05:23.618730+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:25:53.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.27 is not active+clean 2023-10-06T02:25:53.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.777454+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:02:21.655513+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:25:53.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.26 is not active+clean 2023-10-06T02:25:53.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.778548+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:20:15.227230+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:25:53.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.25 is not active+clean 2023-10-06T02:25:53.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.766594+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:02:21.655513+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:25:53.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.24 is not active+clean 2023-10-06T02:25:53.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.763060+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:54:25.687797+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:25:53.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2023-10-06T02:25:53.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.768709+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:30:15.007098+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:25:53.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.22 is not active+clean 2023-10-06T02:25:53.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.777547+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:49:46.321524+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:25:53.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.21 is not active+clean 2023-10-06T02:25:53.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.765879+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T02:37:53.382091+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:25:53.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.20 is not active+clean 2023-10-06T02:25:53.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.768311+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:07:33.984884+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:25:53.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-10-06T02:25:53.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.772465+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:30:59.518906+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:25:53.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-10-06T02:25:53.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.765954+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:57:09.893223+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:25:53.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-10-06T02:25:53.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.768128+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:59:52.758045+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:25:53.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-10-06T02:25:53.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.769083+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:47:37.561344+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:25:53.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-10-06T02:25:53.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.770593+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:22:25.885346+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:25:53.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-10-06T02:25:53.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.762044+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:28:21.678499+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:25:53.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-10-06T02:25:53.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.773984+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:45:24.538628+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:25:53.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-10-06T02:25:53.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.768306+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:20:03.991817+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:25:53.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-10-06T02:25:53.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.762646+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:49:10.359414+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:25:53.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-10-06T02:25:53.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.768353+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:46:57.656013+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:25:53.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-10-06T02:25:53.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.772791+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:50:39.144943+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:25:53.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-10-06T02:25:53.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.765749+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:58:54.346036+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:25:53.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-10-06T02:25:53.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.765332+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:08:35.551701+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:25:53.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-10-06T02:25:53.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.776962+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:16:18.739198+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:25:53.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-10-06T02:25:53.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.773523+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:11:03.662406+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:25:53.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-10-06T02:25:53.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.762767+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:35:54.359817+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:25:53.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-10-06T02:25:53.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.767455+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:16:14.533092+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:25:53.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-10-06T02:25:53.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.770463+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:08:54.727662+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:25:53.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-10-06T02:25:53.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.778042+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:30:15.007098+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:25:53.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-10-06T02:25:53.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.771436+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:24:03.303783+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:25:53.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-10-06T02:25:53.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.768826+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:33:20.440565+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:25:53.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-10-06T02:25:53.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.765370+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:25:38.056119+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:25:53.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-10-06T02:25:53.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.762082+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:51:31.177238+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:25:53.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-10-06T02:25:53.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.770517+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:13:49.398898+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:25:53.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-10-06T02:25:53.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.765775+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:15:15.256053+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:25:53.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-10-06T02:25:53.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.771919+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:26:51.239741+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:25:53.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-10-06T02:25:53.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.767839+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:31:44.695976+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:25:53.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-10-06T02:25:53.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.776495+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:57:09.893223+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:25:53.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-10-06T02:25:53.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.772574+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:59:15.338941+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:25:53.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-10-06T02:25:53.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.772455+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:53:17.993235+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:25:53.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-10-06T02:25:53.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.770377+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:32:27.460927+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:25:53.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-10-06T02:25:53.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:25:47.756596+0000', 'last_change': '2023-10-06T02:25:47.769530+0000', 'last_active': '2023-10-06T02:25:47.756596+0000', 'last_peered': '2023-10-06T02:25:47.756596+0000', 'last_clean': '2023-10-06T02:25:47.756596+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:25:47.756596+0000', 'last_undegraded': '2023-10-06T02:25:47.756596+0000', 'last_fullsized': '2023-10-06T02:25:47.756596+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'last_clean_scrub_stamp': '2023-10-06T02:25:47.756596+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:02:21.655513+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:25:53.685 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T02:25:53.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.821+0000 7f2052dc3700 1 Processor -- start 2023-10-06T02:25:53.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.821+0000 7f2052dc3700 1 -- start start 2023-10-06T02:25:53.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.822+0000 7f2052dc3700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f204c159760 0x7f204c15d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.822+0000 7f2052dc3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f204c15dd50 0x7f204c0cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.822+0000 7f2052dc3700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204c15e1d0 con 0x7f204c15d8d0 2023-10-06T02:25:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.822+0000 7f2052dc3700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204c0cc2d0 con 0x7f204c159760 2023-10-06T02:25:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.822+0000 7f2052dc3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c0cb650 con 0x7f204c15dd50 2023-10-06T02:25:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.822+0000 7f2050b5f700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f204c159760 0x7f204c15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.822+0000 7f2051360700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f204c15dd50 0x7f204c0cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.822+0000 7f2050b5f700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f204c159760 0x7f204c15d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:33254/0 (socket says 172.21.15.37:33254) 2023-10-06T02:25:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.822+0000 7f2051360700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f204c15dd50 0x7f204c0cfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:50280/0 (socket says 172.21.15.37:50280) 2023-10-06T02:25:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.822+0000 7f2050b5f700 1 -- 172.21.15.37:0/911236580 learned_addr learned my addr 172.21.15.37:0/911236580 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.822+0000 7f204bfff700 1 --1- 172.21.15.37:0/911236580 >> v1:172.21.15.191:6789/0 conn(0x7f204c15d8d0 0x7f204c0c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:34752/0 (socket says 172.21.15.37:34752) 2023-10-06T02:25:53.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.822+0000 7f2051360700 1 -- 172.21.15.37:0/911236580 >> v2:172.21.15.191:3300/0 conn(0x7f204c159760 msgr2=0x7f204c15d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:53.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.822+0000 7f2051360700 1 --2- 172.21.15.37:0/911236580 >> v2:172.21.15.191:3300/0 conn(0x7f204c159760 0x7f204c15d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.822+0000 7f2051360700 1 -- 172.21.15.37:0/911236580 >> v1:172.21.15.191:6789/0 conn(0x7f204c15d8d0 legacy=0x7f204c0c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.822+0000 7f2051360700 1 -- 172.21.15.37:0/911236580 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c0cb930 con 0x7f204c15dd50 2023-10-06T02:25:53.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.822+0000 7f2050b5f700 1 --2- 172.21.15.37:0/911236580 >> v2:172.21.15.191:3300/0 conn(0x7f204c159760 0x7f204c15d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:25:53.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.823+0000 7f2051360700 1 --2- 172.21.15.37:0/911236580 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f204c15dd50 0x7f204c0cfc00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2044009e60 tx=0x7f2044009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7dd54b94859ad7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.823+0000 7f204b7fe700 1 -- 172.21.15.37:0/911236580 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204400e070 con 0x7f204c15dd50 2023-10-06T02:25:53.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.823+0000 7f204b7fe700 1 -- 172.21.15.37:0/911236580 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204400bbf0 con 0x7f204c15dd50 2023-10-06T02:25:53.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.823+0000 7f204b7fe700 1 -- 172.21.15.37:0/911236580 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2044012430 con 0x7f204c15dd50 2023-10-06T02:25:53.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.823+0000 7f2052dc3700 1 -- 172.21.15.37:0/911236580 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f204c15dd50 msgr2=0x7f204c0cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.823+0000 7f2052dc3700 1 --2- 172.21.15.37:0/911236580 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f204c15dd50 0x7f204c0cfc00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2044009e60 tx=0x7f2044009780 comp rx=0 tx=0).stop 2023-10-06T02:25:53.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.823+0000 7f2052dc3700 1 -- 172.21.15.37:0/911236580 shutdown_connections 2023-10-06T02:25:53.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.823+0000 7f2052dc3700 1 --2- 172.21.15.37:0/911236580 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f204c15dd50 0x7f204c0cfc00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.823+0000 7f2052dc3700 1 --2- 172.21.15.37:0/911236580 >> v2:172.21.15.191:3300/0 conn(0x7f204c159760 0x7f204c15d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.823+0000 7f2052dc3700 1 -- 172.21.15.37:0/911236580 >> 172.21.15.37:0/911236580 conn(0x7f204c06c890 msgr2=0x7f204c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:53.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.823+0000 7f2052dc3700 1 -- 172.21.15.37:0/911236580 shutdown_connections 2023-10-06T02:25:53.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.823+0000 7f2052dc3700 1 -- 172.21.15.37:0/911236580 wait complete. 2023-10-06T02:25:53.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.824+0000 7f2052dc3700 1 Processor -- start 2023-10-06T02:25:53.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.825+0000 7f2052dc3700 1 -- start start 2023-10-06T02:25:53.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.825+0000 7f2052dc3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f204c159760 0x7f204c149070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.825+0000 7f2052dc3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f204c15d8d0 0x7f204c0b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.825+0000 7f2052dc3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f204c15dd50 0x7f204c0b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.825+0000 7f2052dc3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c0c8d00 con 0x7f204c15dd50 2023-10-06T02:25:53.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.825+0000 7f2052dc3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c0b6080 con 0x7f204c15d8d0 2023-10-06T02:25:53.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.825+0000 7f2052dc3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c0c80f0 con 0x7f204c159760 2023-10-06T02:25:53.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.825+0000 7f2051360700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f204c15dd50 0x7f204c0b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.825+0000 7f2051360700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f204c15dd50 0x7f204c0b5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49690/0 (socket says 172.21.15.37:49690) 2023-10-06T02:25:53.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.825+0000 7f2051360700 1 -- 172.21.15.37:0/2395710267 learned_addr learned my addr 172.21.15.37:0/2395710267 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:53.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.826+0000 7f204bfff700 1 --2- 172.21.15.37:0/2395710267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f204c15d8d0 0x7f204c0b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.826+0000 7f2050b5f700 1 --2- 172.21.15.37:0/2395710267 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f204c159760 0x7f204c149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.826+0000 7f2051360700 1 -- 172.21.15.37:0/2395710267 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f204c159760 msgr2=0x7f204c149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.826+0000 7f2051360700 1 --2- 172.21.15.37:0/2395710267 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f204c159760 0x7f204c149070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.826+0000 7f2051360700 1 -- 172.21.15.37:0/2395710267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f204c15d8d0 msgr2=0x7f204c0b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:53.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.826+0000 7f2051360700 1 --2- 172.21.15.37:0/2395710267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f204c15d8d0 0x7f204c0b5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:53.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.826+0000 7f2051360700 1 -- 172.21.15.37:0/2395710267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20400094f0 con 0x7f204c15dd50 2023-10-06T02:25:53.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.826+0000 7f2050b5f700 1 --2- 172.21.15.37:0/2395710267 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f204c159760 0x7f204c149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:53.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.826+0000 7f204bfff700 1 --2- 172.21.15.37:0/2395710267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f204c15d8d0 0x7f204c0b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:53.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.826+0000 7f2051360700 1 --2- 172.21.15.37:0/2395710267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f204c15dd50 0x7f204c0b5b40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f20440099f0 tx=0x7f2044019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.826+0000 7f2048ff9700 1 -- 172.21.15.37:0/2395710267 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2044027470 con 0x7f204c15dd50 2023-10-06T02:25:53.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.826+0000 7f2048ff9700 1 -- 172.21.15.37:0/2395710267 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20440275f0 con 0x7f204c15dd50 2023-10-06T02:25:53.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.826+0000 7f2052dc3700 1 -- 172.21.15.37:0/2395710267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2044009a20 con 0x7f204c15dd50 2023-10-06T02:25:53.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.826+0000 7f2048ff9700 1 -- 172.21.15.37:0/2395710267 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20440279b0 con 0x7f204c15dd50 2023-10-06T02:25:53.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.826+0000 7f2052dc3700 1 -- 172.21.15.37:0/2395710267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204c0c86b0 con 0x7f204c15dd50 2023-10-06T02:25:53.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.827+0000 7f2052dc3700 1 -- 172.21.15.37:0/2395710267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204c0c8e70 con 0x7f204c15dd50 2023-10-06T02:25:53.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.828+0000 7f2048ff9700 1 -- 172.21.15.37:0/2395710267 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2044024070 con 0x7f204c15dd50 2023-10-06T02:25:53.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.828+0000 7f2048ff9700 1 --2- 172.21.15.37:0/2395710267 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2030066f30 0x7f20300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:53.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.828+0000 7f2048ff9700 1 -- 172.21.15.37:0/2395710267 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2044087260 con 0x7f204c15dd50 2023-10-06T02:25:53.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.828+0000 7f2050b5f700 1 --2- 172.21.15.37:0/2395710267 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2030066f30 0x7f20300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:53.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.829+0000 7f2050b5f700 1 --2- 172.21.15.37:0/2395710267 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2030066f30 0x7f20300693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2040006d40 tx=0x7f2040008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:53.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:53.832+0000 7f2048ff9700 1 -- 172.21.15.37:0/2395710267 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2044054370 con 0x7f204c15dd50 2023-10-06T02:25:54.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.103+0000 7f2052dc3700 1 -- 172.21.15.37:0/2395710267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f204c06fbf0 con 0x7f204c15dd50 2023-10-06T02:25:54.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.104+0000 7f2048ff9700 1 -- 172.21.15.37:0/2395710267 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1456 (secure 0 0 0) 0x7f2044057990 con 0x7f204c15dd50 2023-10-06T02:25:54.104 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:54.105 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":177,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":57,"num_osds":8,"num_up_osds":8,"osd_up_since":1696558987,"num_in_osds":8,"osd_in_since":1696558979,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":2441809920,"bytes_avail":770652303360,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":31,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5823}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-10-06T02:25:36.543545+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T02:25:54.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.106+0000 7f2052dc3700 1 -- 172.21.15.37:0/2395710267 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2030066f30 msgr2=0x7f20300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:54.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.106+0000 7f2052dc3700 1 --2- 172.21.15.37:0/2395710267 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2030066f30 0x7f20300693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2040006d40 tx=0x7f2040008040 comp rx=0 tx=0).stop 2023-10-06T02:25:54.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.106+0000 7f2052dc3700 1 -- 172.21.15.37:0/2395710267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f204c15dd50 msgr2=0x7f204c0b5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:54.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.106+0000 7f2052dc3700 1 --2- 172.21.15.37:0/2395710267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f204c15dd50 0x7f204c0b5b40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f20440099f0 tx=0x7f2044019000 comp rx=0 tx=0).stop 2023-10-06T02:25:54.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.106+0000 7f2052dc3700 1 -- 172.21.15.37:0/2395710267 shutdown_connections 2023-10-06T02:25:54.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.106+0000 7f2052dc3700 1 --2- 172.21.15.37:0/2395710267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f204c15dd50 0x7f204c0b5b40 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:54.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.106+0000 7f2052dc3700 1 --2- 172.21.15.37:0/2395710267 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f204c159760 0x7f204c149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:54.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.106+0000 7f2052dc3700 1 --2- 172.21.15.37:0/2395710267 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2030066f30 0x7f20300693e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:54.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.106+0000 7f2052dc3700 1 --2- 172.21.15.37:0/2395710267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f204c15d8d0 0x7f204c0b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:54.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.106+0000 7f2052dc3700 1 -- 172.21.15.37:0/2395710267 >> 172.21.15.37:0/2395710267 conn(0x7f204c06c890 msgr2=0x7f204c06ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:54.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.106+0000 7f2052dc3700 1 -- 172.21.15.37:0/2395710267 shutdown_connections 2023-10-06T02:25:54.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.106+0000 7f2052dc3700 1 -- 172.21.15.37:0/2395710267 wait complete. 2023-10-06T02:25:54.118 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T02:25:54.118 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:25:54.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.236+0000 7f7b9085e700 1 Processor -- start 2023-10-06T02:25:54.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.237+0000 7f7b9085e700 1 -- start start 2023-10-06T02:25:54.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.237+0000 7f7b9085e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b8c1596d0 0x7f7b8c0b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:54.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.237+0000 7f7b9085e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b8c0b3840 0x7f7b8c0c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:54.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.238+0000 7f7b9085e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8c0c5300 con 0x7f7b8c159aa0 2023-10-06T02:25:54.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.238+0000 7f7b9085e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b8c0c6160 con 0x7f7b8c0b3840 2023-10-06T02:25:54.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.238+0000 7f7b9085e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c0c5550 con 0x7f7b8c1596d0 2023-10-06T02:25:54.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.238+0000 7f7b89d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b8c0b3840 0x7f7b8c0c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:54.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.238+0000 7f7b8ad9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7b8c159aa0 0x7f7b8c0caba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42230/0 (socket says 172.21.15.37:42230) 2023-10-06T02:25:54.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.238+0000 7f7b8ad9d700 1 -- 172.21.15.37:0/1785971078 learned_addr learned my addr 172.21.15.37:0/1785971078 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:54.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.238+0000 7f7b8a59c700 1 --2- 172.21.15.37:0/1785971078 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b8c1596d0 0x7f7b8c0b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:54.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.238+0000 7f7b89d9b700 1 -- 172.21.15.37:0/1785971078 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b8c1596d0 msgr2=0x7f7b8c0b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:54.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.238+0000 7f7b89d9b700 1 --2- 172.21.15.37:0/1785971078 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b8c1596d0 0x7f7b8c0b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:54.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.238+0000 7f7b89d9b700 1 -- 172.21.15.37:0/1785971078 >> v1:172.21.15.37:6789/0 conn(0x7f7b8c159aa0 legacy=0x7f7b8c0caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:54.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.238+0000 7f7b89d9b700 1 -- 172.21.15.37:0/1785971078 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c0c5830 con 0x7f7b8c0b3840 2023-10-06T02:25:54.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.238+0000 7f7b8959a700 1 -- 172.21.15.37:0/1785971078 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1236413775 0 0) 0x7f7b8c0c5300 con 0x7f7b8c159aa0 2023-10-06T02:25:54.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.238+0000 7f7b89d9b700 1 --2- 172.21.15.37:0/1785971078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b8c0b3840 0x7f7b8c0c65f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7b740098e0 tx=0x7f7b740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956df48175e956c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:54.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.238+0000 7f7b8959a700 1 -- 172.21.15.37:0/1785971078 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7400b640 con 0x7f7b8c0b3840 2023-10-06T02:25:54.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.238+0000 7f7b8959a700 1 -- 172.21.15.37:0/1785971078 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7400b7a0 con 0x7f7b8c0b3840 2023-10-06T02:25:54.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.238+0000 7f7b8959a700 1 -- 172.21.15.37:0/1785971078 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7400bb40 con 0x7f7b8c0b3840 2023-10-06T02:25:54.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.239+0000 7f7b9085e700 1 -- 172.21.15.37:0/1785971078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b8c0b3840 msgr2=0x7f7b8c0c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:54.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.239+0000 7f7b9085e700 1 --2- 172.21.15.37:0/1785971078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b8c0b3840 0x7f7b8c0c65f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7b740098e0 tx=0x7f7b740091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:54.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.239+0000 7f7b9085e700 1 -- 172.21.15.37:0/1785971078 shutdown_connections 2023-10-06T02:25:54.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.239+0000 7f7b9085e700 1 --2- 172.21.15.37:0/1785971078 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b8c1596d0 0x7f7b8c0b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:54.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.239+0000 7f7b9085e700 1 --2- 172.21.15.37:0/1785971078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b8c0b3840 0x7f7b8c0c65f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:54.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.239+0000 7f7b9085e700 1 -- 172.21.15.37:0/1785971078 >> 172.21.15.37:0/1785971078 conn(0x7f7b8c06c890 msgr2=0x7f7b8c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:54.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.239+0000 7f7b9085e700 1 -- 172.21.15.37:0/1785971078 shutdown_connections 2023-10-06T02:25:54.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.239+0000 7f7b9085e700 1 -- 172.21.15.37:0/1785971078 wait complete. 2023-10-06T02:25:54.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.240+0000 7f7b9085e700 1 Processor -- start 2023-10-06T02:25:54.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.240+0000 7f7b9085e700 1 -- start start 2023-10-06T02:25:54.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.241+0000 7f7b9085e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b8c0b3840 0x7f7b8c151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:54.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.241+0000 7f7b9085e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b8c1596d0 0x7f7b8c14f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:54.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.241+0000 7f7b9085e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b8c159aa0 0x7f7b8c14fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:54.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.241+0000 7f7b9085e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c1508c0 con 0x7f7b8c0b3840 2023-10-06T02:25:54.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.241+0000 7f7b9085e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c150ba0 con 0x7f7b8c1596d0 2023-10-06T02:25:54.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.241+0000 7f7b9085e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c150e80 con 0x7f7b8c159aa0 2023-10-06T02:25:54.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.241+0000 7f7b8a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b8c0b3840 0x7f7b8c151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:54.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.241+0000 7f7b8a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b8c0b3840 0x7f7b8c151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49712/0 (socket says 172.21.15.37:49712) 2023-10-06T02:25:54.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.241+0000 7f7b8a59c700 1 -- 172.21.15.37:0/2769328105 learned_addr learned my addr 172.21.15.37:0/2769328105 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:54.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.241+0000 7f7b8ad9d700 1 --2- 172.21.15.37:0/2769328105 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b8c159aa0 0x7f7b8c14fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:54.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.241+0000 7f7b89d9b700 1 --2- 172.21.15.37:0/2769328105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b8c1596d0 0x7f7b8c14f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:54.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.241+0000 7f7b8a59c700 1 -- 172.21.15.37:0/2769328105 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b8c159aa0 msgr2=0x7f7b8c14fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:54.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.241+0000 7f7b8a59c700 1 --2- 172.21.15.37:0/2769328105 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b8c159aa0 0x7f7b8c14fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:54.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.241+0000 7f7b8a59c700 1 -- 172.21.15.37:0/2769328105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b8c1596d0 msgr2=0x7f7b8c14f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:54.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.241+0000 7f7b8a59c700 1 --2- 172.21.15.37:0/2769328105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b8c1596d0 0x7f7b8c14f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:54.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.241+0000 7f7b8a59c700 1 -- 172.21.15.37:0/2769328105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b74009420 con 0x7f7b8c0b3840 2023-10-06T02:25:54.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.241+0000 7f7b8ad9d700 1 --2- 172.21.15.37:0/2769328105 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b8c159aa0 0x7f7b8c14fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:54.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.241+0000 7f7b8a59c700 1 --2- 172.21.15.37:0/2769328105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b8c0b3840 0x7f7b8c151960 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7b8400ec80 tx=0x7f7b840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:54.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.242+0000 7f7b827fc700 1 -- 172.21.15.37:0/2769328105 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8400ca60 con 0x7f7b8c0b3840 2023-10-06T02:25:54.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.242+0000 7f7b827fc700 1 -- 172.21.15.37:0/2769328105 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8400cbc0 con 0x7f7b8c0b3840 2023-10-06T02:25:54.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.242+0000 7f7b9085e700 1 -- 172.21.15.37:0/2769328105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8c151160 con 0x7f7b8c0b3840 2023-10-06T02:25:54.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.242+0000 7f7b827fc700 1 -- 172.21.15.37:0/2769328105 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b84013470 con 0x7f7b8c0b3840 2023-10-06T02:25:54.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.242+0000 7f7b9085e700 1 -- 172.21.15.37:0/2769328105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8c15e880 con 0x7f7b8c0b3840 2023-10-06T02:25:54.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.243+0000 7f7b9085e700 1 -- 172.21.15.37:0/2769328105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8c06fbf0 con 0x7f7b8c0b3840 2023-10-06T02:25:54.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.243+0000 7f7b827fc700 1 -- 172.21.15.37:0/2769328105 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b84013820 con 0x7f7b8c0b3840 2023-10-06T02:25:54.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.243+0000 7f7b827fc700 1 --2- 172.21.15.37:0/2769328105 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7b6c066f30 0x7f7b6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:54.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.244+0000 7f7b827fc700 1 -- 172.21.15.37:0/2769328105 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7b84084aa0 con 0x7f7b8c0b3840 2023-10-06T02:25:54.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.244+0000 7f7b89d9b700 1 --2- 172.21.15.37:0/2769328105 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7b6c066f30 0x7f7b6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:54.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.244+0000 7f7b89d9b700 1 --2- 172.21.15.37:0/2769328105 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7b6c066f30 0x7f7b6c0693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7b740091e0 tx=0x7f7b74017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:54.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.248+0000 7f7b827fc700 1 -- 172.21.15.37:0/2769328105 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b84051bb0 con 0x7f7b8c0b3840 2023-10-06T02:25:54.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.434+0000 7f7b9085e700 1 -- 172.21.15.37:0/2769328105 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b8c0d13e0 con 0x7f7b6c066f30 2023-10-06T02:25:54.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.443+0000 7f7b827fc700 1 -- 172.21.15.37:0/2769328105 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308943 (secure 0 0 0) 0x7f7b8c0d13e0 con 0x7f7b6c066f30 2023-10-06T02:25:54.447 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:54.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.446+0000 7f7b9085e700 1 -- 172.21.15.37:0/2769328105 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7b6c066f30 msgr2=0x7f7b6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:54.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.446+0000 7f7b9085e700 1 --2- 172.21.15.37:0/2769328105 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7b6c066f30 0x7f7b6c0693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7b740091e0 tx=0x7f7b74017000 comp rx=0 tx=0).stop 2023-10-06T02:25:54.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.446+0000 7f7b9085e700 1 -- 172.21.15.37:0/2769328105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b8c0b3840 msgr2=0x7f7b8c151960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:54.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.446+0000 7f7b9085e700 1 --2- 172.21.15.37:0/2769328105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b8c0b3840 0x7f7b8c151960 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7b8400ec80 tx=0x7f7b840091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:54.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.446+0000 7f7b9085e700 1 -- 172.21.15.37:0/2769328105 shutdown_connections 2023-10-06T02:25:54.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.446+0000 7f7b9085e700 1 --2- 172.21.15.37:0/2769328105 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b8c159aa0 0x7f7b8c14fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:54.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.446+0000 7f7b9085e700 1 --2- 172.21.15.37:0/2769328105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b8c0b3840 0x7f7b8c151960 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:54.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.446+0000 7f7b9085e700 1 --2- 172.21.15.37:0/2769328105 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7b6c066f30 0x7f7b6c0693e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:54.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.446+0000 7f7b9085e700 1 --2- 172.21.15.37:0/2769328105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b8c1596d0 0x7f7b8c14f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:54.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.446+0000 7f7b9085e700 1 -- 172.21.15.37:0/2769328105 >> 172.21.15.37:0/2769328105 conn(0x7f7b8c06c890 msgr2=0x7f7b8c0cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:54.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.446+0000 7f7b9085e700 1 -- 172.21.15.37:0/2769328105 shutdown_connections 2023-10-06T02:25:54.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:54.446+0000 7f7b9085e700 1 -- 172.21.15.37:0/2769328105 wait complete. 2023-10-06T02:25:54.451 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:25:54.458 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2023-10-06T02:25:52.546690+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384580,"kb_used_data":6276,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590140,"statfs":{"total":773094113280,"available":770652303360,"internally_reserved":0,"allocated":6426624,"data_stored":3446853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.788204"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762779+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:48.969007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762329+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:43.827759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771263+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:03.991817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765977+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:18.739198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767718+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:22:20.191318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767613+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:37.913721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770406+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:16.823479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.776090+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:53.382091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771176+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:57.656013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771243+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:41.394648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767034+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:15.007098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.778100+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:37.561344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.778213+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:23.103556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768638+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:46.321524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.769330+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:23.103556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771508+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:32:27.557897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762241+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:25.981569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.766332+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:23.618730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770887+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:03.082588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767580+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:01.275354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.777405+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:23.618730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767511+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:41.394648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768061+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:14.533092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.769284+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:23.618730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.777454+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:21.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.778548+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:15.227230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.766594+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:21.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.763060+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:25.687797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768709+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:15.007098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.777547+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:46.321524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765879+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:53.382091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768311+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:33.984884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.772465+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:59.518906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.779666+0000","last_change":"2023-10-06T02:25:47.779666+0000","last_active":"2023-10-06T02:25:47.779666+0000","last_peered":"2023-10-06T02:25:47.779666+0000","last_clean":"2023-10-06T02:25:47.779666+0000","last_became_active":"2023-10-06T02:25:47.779228+0000","last_became_peered":"2023-10-06T02:25:47.779228+0000","last_unstale":"2023-10-06T02:25:47.779666+0000","last_undegraded":"2023-10-06T02:25:47.779666+0000","last_fullsized":"2023-10-06T02:25:47.779666+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:21.300373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765954+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:09.893223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.778547+0000","last_change":"2023-10-06T02:25:47.778547+0000","last_active":"2023-10-06T02:25:47.778547+0000","last_peered":"2023-10-06T02:25:47.778547+0000","last_clean":"2023-10-06T02:25:47.778547+0000","last_became_active":"2023-10-06T02:25:47.778062+0000","last_became_peered":"2023-10-06T02:25:47.778062+0000","last_unstale":"2023-10-06T02:25:47.778547+0000","last_undegraded":"2023-10-06T02:25:47.778547+0000","last_fullsized":"2023-10-06T02:25:47.778547+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:22.094876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768128+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:52.758045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.781462+0000","last_change":"2023-10-06T02:25:47.781462+0000","last_active":"2023-10-06T02:25:47.781462+0000","last_peered":"2023-10-06T02:25:47.781462+0000","last_clean":"2023-10-06T02:25:47.781462+0000","last_became_active":"2023-10-06T02:25:47.781039+0000","last_became_peered":"2023-10-06T02:25:47.781039+0000","last_unstale":"2023-10-06T02:25:47.781462+0000","last_undegraded":"2023-10-06T02:25:47.781462+0000","last_fullsized":"2023-10-06T02:25:47.781462+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:56.647333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.769083+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:37.561344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.772551+0000","last_change":"2023-10-06T02:25:47.772551+0000","last_active":"2023-10-06T02:25:47.772551+0000","last_peered":"2023-10-06T02:25:47.772551+0000","last_clean":"2023-10-06T02:25:47.772551+0000","last_became_active":"2023-10-06T02:25:47.772269+0000","last_became_peered":"2023-10-06T02:25:47.772269+0000","last_unstale":"2023-10-06T02:25:47.772551+0000","last_undegraded":"2023-10-06T02:25:47.772551+0000","last_fullsized":"2023-10-06T02:25:47.772551+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:36.552664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770593+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:25.885346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.775941+0000","last_change":"2023-10-06T02:25:47.775941+0000","last_active":"2023-10-06T02:25:47.775941+0000","last_peered":"2023-10-06T02:25:47.775941+0000","last_clean":"2023-10-06T02:25:47.775941+0000","last_became_active":"2023-10-06T02:25:47.775677+0000","last_became_peered":"2023-10-06T02:25:47.775677+0000","last_unstale":"2023-10-06T02:25:47.775941+0000","last_undegraded":"2023-10-06T02:25:47.775941+0000","last_fullsized":"2023-10-06T02:25:47.775941+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:14.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762044+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:21.678499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.776075+0000","last_change":"2023-10-06T02:25:47.776075+0000","last_active":"2023-10-06T02:25:47.776075+0000","last_peered":"2023-10-06T02:25:47.776075+0000","last_clean":"2023-10-06T02:25:47.776075+0000","last_became_active":"2023-10-06T02:25:47.775812+0000","last_became_peered":"2023-10-06T02:25:47.775812+0000","last_unstale":"2023-10-06T02:25:47.776075+0000","last_undegraded":"2023-10-06T02:25:47.776075+0000","last_fullsized":"2023-10-06T02:25:47.776075+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:20.646833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.773984+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:24.538628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.782265+0000","last_change":"2023-10-06T02:25:47.782265+0000","last_active":"2023-10-06T02:25:47.782265+0000","last_peered":"2023-10-06T02:25:47.782265+0000","last_clean":"2023-10-06T02:25:47.782265+0000","last_became_active":"2023-10-06T02:25:47.781984+0000","last_became_peered":"2023-10-06T02:25:47.781984+0000","last_unstale":"2023-10-06T02:25:47.782265+0000","last_undegraded":"2023-10-06T02:25:47.782265+0000","last_fullsized":"2023-10-06T02:25:47.782265+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:13.998418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768306+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:03.991817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.776645+0000","last_change":"2023-10-06T02:25:47.776645+0000","last_active":"2023-10-06T02:25:47.776645+0000","last_peered":"2023-10-06T02:25:47.776645+0000","last_clean":"2023-10-06T02:25:47.776645+0000","last_became_active":"2023-10-06T02:25:47.776222+0000","last_became_peered":"2023-10-06T02:25:47.776222+0000","last_unstale":"2023-10-06T02:25:47.776645+0000","last_undegraded":"2023-10-06T02:25:47.776645+0000","last_fullsized":"2023-10-06T02:25:47.776645+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:03.400305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762646+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:10.359414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.783911+0000","last_change":"2023-10-06T02:25:47.783911+0000","last_active":"2023-10-06T02:25:47.783911+0000","last_peered":"2023-10-06T02:25:47.783911+0000","last_clean":"2023-10-06T02:25:47.783911+0000","last_became_active":"2023-10-06T02:25:47.783672+0000","last_became_peered":"2023-10-06T02:25:47.783672+0000","last_unstale":"2023-10-06T02:25:47.783911+0000","last_undegraded":"2023-10-06T02:25:47.783911+0000","last_fullsized":"2023-10-06T02:25:47.783911+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:53.337356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768353+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:57.656013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.774544+0000","last_change":"2023-10-06T02:25:47.774544+0000","last_active":"2023-10-06T02:25:47.774544+0000","last_peered":"2023-10-06T02:25:47.774544+0000","last_clean":"2023-10-06T02:25:47.774544+0000","last_became_active":"2023-10-06T02:25:47.773704+0000","last_became_peered":"2023-10-06T02:25:47.773704+0000","last_unstale":"2023-10-06T02:25:47.774544+0000","last_undegraded":"2023-10-06T02:25:47.774544+0000","last_fullsized":"2023-10-06T02:25:47.774544+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:04.612716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.772791+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:39.144943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.781564+0000","last_change":"2023-10-06T02:25:47.781564+0000","last_active":"2023-10-06T02:25:47.781564+0000","last_peered":"2023-10-06T02:25:47.781564+0000","last_clean":"2023-10-06T02:25:47.781564+0000","last_became_active":"2023-10-06T02:25:47.781157+0000","last_became_peered":"2023-10-06T02:25:47.781157+0000","last_unstale":"2023-10-06T02:25:47.781564+0000","last_undegraded":"2023-10-06T02:25:47.781564+0000","last_fullsized":"2023-10-06T02:25:47.781564+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:37.047439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765749+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:54.346036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.774248+0000","last_change":"2023-10-06T02:25:47.774248+0000","last_active":"2023-10-06T02:25:47.774248+0000","last_peered":"2023-10-06T02:25:47.774248+0000","last_clean":"2023-10-06T02:25:47.774248+0000","last_became_active":"2023-10-06T02:25:47.773967+0000","last_became_peered":"2023-10-06T02:25:47.773967+0000","last_unstale":"2023-10-06T02:25:47.774248+0000","last_undegraded":"2023-10-06T02:25:47.774248+0000","last_fullsized":"2023-10-06T02:25:47.774248+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:19.027538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765332+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:35.551701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.782266+0000","last_change":"2023-10-06T02:25:47.782266+0000","last_active":"2023-10-06T02:25:47.782266+0000","last_peered":"2023-10-06T02:25:47.782266+0000","last_clean":"2023-10-06T02:25:47.782266+0000","last_became_active":"2023-10-06T02:25:47.781819+0000","last_became_peered":"2023-10-06T02:25:47.781819+0000","last_unstale":"2023-10-06T02:25:47.782266+0000","last_undegraded":"2023-10-06T02:25:47.782266+0000","last_fullsized":"2023-10-06T02:25:47.782266+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:20.653387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.776962+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:18.739198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.783305+0000","last_change":"2023-10-06T02:25:47.783305+0000","last_active":"2023-10-06T02:25:47.783305+0000","last_peered":"2023-10-06T02:25:47.783305+0000","last_clean":"2023-10-06T02:25:47.783305+0000","last_became_active":"2023-10-06T02:25:47.783026+0000","last_became_peered":"2023-10-06T02:25:47.783026+0000","last_unstale":"2023-10-06T02:25:47.783305+0000","last_undegraded":"2023-10-06T02:25:47.783305+0000","last_fullsized":"2023-10-06T02:25:47.783305+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:53.337356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.773523+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:11:03.662406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.780895+0000","last_change":"2023-10-06T02:25:47.780895+0000","last_active":"2023-10-06T02:25:47.780895+0000","last_peered":"2023-10-06T02:25:47.780895+0000","last_clean":"2023-10-06T02:25:47.780895+0000","last_became_active":"2023-10-06T02:25:47.780602+0000","last_became_peered":"2023-10-06T02:25:47.780602+0000","last_unstale":"2023-10-06T02:25:47.780895+0000","last_undegraded":"2023-10-06T02:25:47.780895+0000","last_fullsized":"2023-10-06T02:25:47.780895+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:08.884543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762767+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:54.359817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.779687+0000","last_change":"2023-10-06T02:25:47.779687+0000","last_active":"2023-10-06T02:25:47.779687+0000","last_peered":"2023-10-06T02:25:47.779687+0000","last_clean":"2023-10-06T02:25:47.779687+0000","last_became_active":"2023-10-06T02:25:47.779422+0000","last_became_peered":"2023-10-06T02:25:47.779422+0000","last_unstale":"2023-10-06T02:25:47.779687+0000","last_undegraded":"2023-10-06T02:25:47.779687+0000","last_fullsized":"2023-10-06T02:25:47.779687+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:06.807270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767455+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:14.533092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.789740+0000","last_change":"2023-10-06T02:25:47.789740+0000","last_active":"2023-10-06T02:25:47.789740+0000","last_peered":"2023-10-06T02:25:47.789740+0000","last_clean":"2023-10-06T02:25:47.789740+0000","last_became_active":"2023-10-06T02:25:47.789419+0000","last_became_peered":"2023-10-06T02:25:47.789419+0000","last_unstale":"2023-10-06T02:25:47.789740+0000","last_undegraded":"2023-10-06T02:25:47.789740+0000","last_fullsized":"2023-10-06T02:25:47.789740+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:20.653387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770463+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:54.727662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.780940+0000","last_change":"2023-10-06T02:25:47.780940+0000","last_active":"2023-10-06T02:25:47.780940+0000","last_peered":"2023-10-06T02:25:47.780940+0000","last_clean":"2023-10-06T02:25:47.780940+0000","last_became_active":"2023-10-06T02:25:47.780649+0000","last_became_peered":"2023-10-06T02:25:47.780649+0000","last_unstale":"2023-10-06T02:25:47.780940+0000","last_undegraded":"2023-10-06T02:25:47.780940+0000","last_fullsized":"2023-10-06T02:25:47.780940+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:06.807270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.778042+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:15.007098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.781285+0000","last_change":"2023-10-06T02:25:47.781285+0000","last_active":"2023-10-06T02:25:47.781285+0000","last_peered":"2023-10-06T02:25:47.781285+0000","last_clean":"2023-10-06T02:25:47.781285+0000","last_became_active":"2023-10-06T02:25:47.780775+0000","last_became_peered":"2023-10-06T02:25:47.780775+0000","last_unstale":"2023-10-06T02:25:47.781285+0000","last_undegraded":"2023-10-06T02:25:47.781285+0000","last_fullsized":"2023-10-06T02:25:47.781285+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.703535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771436+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:03.303783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.774115+0000","last_change":"2023-10-06T02:25:47.774115+0000","last_active":"2023-10-06T02:25:47.774115+0000","last_peered":"2023-10-06T02:25:47.774115+0000","last_clean":"2023-10-06T02:25:47.774115+0000","last_became_active":"2023-10-06T02:25:47.773648+0000","last_became_peered":"2023-10-06T02:25:47.773648+0000","last_unstale":"2023-10-06T02:25:47.774115+0000","last_undegraded":"2023-10-06T02:25:47.774115+0000","last_fullsized":"2023-10-06T02:25:47.774115+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:12.915334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.768826+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:20.440565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.780245+0000","last_change":"2023-10-06T02:25:47.780245+0000","last_active":"2023-10-06T02:25:47.780245+0000","last_peered":"2023-10-06T02:25:47.780245+0000","last_clean":"2023-10-06T02:25:47.780245+0000","last_became_active":"2023-10-06T02:25:47.779986+0000","last_became_peered":"2023-10-06T02:25:47.779986+0000","last_unstale":"2023-10-06T02:25:47.780245+0000","last_undegraded":"2023-10-06T02:25:47.780245+0000","last_fullsized":"2023-10-06T02:25:47.780245+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:52.373411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765370+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:38.056119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.773995+0000","last_change":"2023-10-06T02:25:47.773995+0000","last_active":"2023-10-06T02:25:47.773995+0000","last_peered":"2023-10-06T02:25:47.773995+0000","last_clean":"2023-10-06T02:25:47.773995+0000","last_became_active":"2023-10-06T02:25:47.773707+0000","last_became_peered":"2023-10-06T02:25:47.773707+0000","last_unstale":"2023-10-06T02:25:47.773995+0000","last_undegraded":"2023-10-06T02:25:47.773995+0000","last_fullsized":"2023-10-06T02:25:47.773995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:36.552664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.762082+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:31.177238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.780787+0000","last_change":"2023-10-06T02:25:47.780787+0000","last_active":"2023-10-06T02:25:47.780787+0000","last_peered":"2023-10-06T02:25:47.780787+0000","last_clean":"2023-10-06T02:25:47.780787+0000","last_became_active":"2023-10-06T02:25:47.780419+0000","last_became_peered":"2023-10-06T02:25:47.780419+0000","last_unstale":"2023-10-06T02:25:47.780787+0000","last_undegraded":"2023-10-06T02:25:47.780787+0000","last_fullsized":"2023-10-06T02:25:47.780787+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:45.312844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770517+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:13:49.398898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.777859+0000","last_change":"2023-10-06T02:25:47.777859+0000","last_active":"2023-10-06T02:25:47.777859+0000","last_peered":"2023-10-06T02:25:47.777859+0000","last_clean":"2023-10-06T02:25:47.777859+0000","last_became_active":"2023-10-06T02:25:47.777513+0000","last_became_peered":"2023-10-06T02:25:47.777513+0000","last_unstale":"2023-10-06T02:25:47.777859+0000","last_undegraded":"2023-10-06T02:25:47.777859+0000","last_fullsized":"2023-10-06T02:25:47.777859+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:40.898787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.765775+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:15.256053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.781385+0000","last_change":"2023-10-06T02:25:47.781385+0000","last_active":"2023-10-06T02:25:47.781385+0000","last_peered":"2023-10-06T02:25:47.781385+0000","last_clean":"2023-10-06T02:25:47.781385+0000","last_became_active":"2023-10-06T02:25:47.780787+0000","last_became_peered":"2023-10-06T02:25:47.780787+0000","last_unstale":"2023-10-06T02:25:47.781385+0000","last_undegraded":"2023-10-06T02:25:47.781385+0000","last_fullsized":"2023-10-06T02:25:47.781385+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:34.543022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":44,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.765591+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:25:46.765591+0000","last_peered":"2023-10-06T02:25:46.765591+0000","last_clean":"2023-10-06T02:25:46.765591+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:25:46.765591+0000","last_undegraded":"2023-10-06T02:25:46.765591+0000","last_fullsized":"2023-10-06T02:25:46.765591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.771919+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:51.239741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.775239+0000","last_change":"2023-10-06T02:25:47.775239+0000","last_active":"2023-10-06T02:25:47.775239+0000","last_peered":"2023-10-06T02:25:47.775239+0000","last_clean":"2023-10-06T02:25:47.775239+0000","last_became_active":"2023-10-06T02:25:47.774968+0000","last_became_peered":"2023-10-06T02:25:47.774968+0000","last_unstale":"2023-10-06T02:25:47.775239+0000","last_undegraded":"2023-10-06T02:25:47.775239+0000","last_fullsized":"2023-10-06T02:25:47.775239+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:17.730518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":43,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.772772+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:25:46.772772+0000","last_peered":"2023-10-06T02:25:46.772772+0000","last_clean":"2023-10-06T02:25:46.772772+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:25:46.772772+0000","last_undegraded":"2023-10-06T02:25:46.772772+0000","last_fullsized":"2023-10-06T02:25:46.772772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.767839+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:44.695976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.780762+0000","last_change":"2023-10-06T02:25:47.780762+0000","last_active":"2023-10-06T02:25:47.780762+0000","last_peered":"2023-10-06T02:25:47.780762+0000","last_clean":"2023-10-06T02:25:47.780762+0000","last_became_active":"2023-10-06T02:25:47.780493+0000","last_became_peered":"2023-10-06T02:25:47.780493+0000","last_unstale":"2023-10-06T02:25:47.780762+0000","last_undegraded":"2023-10-06T02:25:47.780762+0000","last_fullsized":"2023-10-06T02:25:47.780762+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:40.385968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.765190+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:25:46.765190+0000","last_peered":"2023-10-06T02:25:46.765190+0000","last_clean":"2023-10-06T02:25:46.765190+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:25:46.765190+0000","last_undegraded":"2023-10-06T02:25:46.765190+0000","last_fullsized":"2023-10-06T02:25:46.765190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":190,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.763943+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:25:46.763943+0000","last_peered":"2023-10-06T02:25:46.763943+0000","last_clean":"2023-10-06T02:25:46.763943+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:25:46.763943+0000","last_undegraded":"2023-10-06T02:25:46.763943+0000","last_fullsized":"2023-10-06T02:25:46.763943+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.776495+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:09.893223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.783177+0000","last_change":"2023-10-06T02:25:47.783177+0000","last_active":"2023-10-06T02:25:47.783177+0000","last_peered":"2023-10-06T02:25:47.783177+0000","last_clean":"2023-10-06T02:25:47.783177+0000","last_became_active":"2023-10-06T02:25:47.782762+0000","last_became_peered":"2023-10-06T02:25:47.782762+0000","last_unstale":"2023-10-06T02:25:47.783177+0000","last_undegraded":"2023-10-06T02:25:47.783177+0000","last_fullsized":"2023-10-06T02:25:47.783177+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:34.543022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.763990+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:25:46.763990+0000","last_peered":"2023-10-06T02:25:46.763990+0000","last_clean":"2023-10-06T02:25:46.763990+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:25:46.763990+0000","last_undegraded":"2023-10-06T02:25:46.763990+0000","last_fullsized":"2023-10-06T02:25:46.763990+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.772574+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:15.338941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.774699+0000","last_change":"2023-10-06T02:25:47.774699+0000","last_active":"2023-10-06T02:25:47.774699+0000","last_peered":"2023-10-06T02:25:47.774699+0000","last_clean":"2023-10-06T02:25:47.774699+0000","last_became_active":"2023-10-06T02:25:47.774440+0000","last_became_peered":"2023-10-06T02:25:47.774440+0000","last_unstale":"2023-10-06T02:25:47.774699+0000","last_undegraded":"2023-10-06T02:25:47.774699+0000","last_fullsized":"2023-10-06T02:25:47.774699+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:22.094876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.763928+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:25:46.763928+0000","last_peered":"2023-10-06T02:25:46.763928+0000","last_clean":"2023-10-06T02:25:46.763928+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:25:46.763928+0000","last_undegraded":"2023-10-06T02:25:46.763928+0000","last_fullsized":"2023-10-06T02:25:46.763928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.772455+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:17.993235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.778193+0000","last_change":"2023-10-06T02:25:47.778193+0000","last_active":"2023-10-06T02:25:47.778193+0000","last_peered":"2023-10-06T02:25:47.778193+0000","last_clean":"2023-10-06T02:25:47.778193+0000","last_became_active":"2023-10-06T02:25:47.777897+0000","last_became_peered":"2023-10-06T02:25:47.777897+0000","last_unstale":"2023-10-06T02:25:47.778193+0000","last_undegraded":"2023-10-06T02:25:47.778193+0000","last_fullsized":"2023-10-06T02:25:47.778193+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:14.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":47,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.762158+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:25:46.762158+0000","last_peered":"2023-10-06T02:25:46.762158+0000","last_clean":"2023-10-06T02:25:46.762158+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:25:46.762158+0000","last_undegraded":"2023-10-06T02:25:46.762158+0000","last_fullsized":"2023-10-06T02:25:46.762158+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.770377+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:27.460927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.784926+0000","last_change":"2023-10-06T02:25:47.784926+0000","last_active":"2023-10-06T02:25:47.784926+0000","last_peered":"2023-10-06T02:25:47.784926+0000","last_clean":"2023-10-06T02:25:47.784926+0000","last_became_active":"2023-10-06T02:25:47.784660+0000","last_became_peered":"2023-10-06T02:25:47.784660+0000","last_unstale":"2023-10-06T02:25:47.784926+0000","last_undegraded":"2023-10-06T02:25:47.784926+0000","last_fullsized":"2023-10-06T02:25:47.784926+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:14.247373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.761018+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:25:46.761018+0000","last_peered":"2023-10-06T02:25:46.761018+0000","last_clean":"2023-10-06T02:25:46.761018+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:25:46.761018+0000","last_undegraded":"2023-10-06T02:25:46.761018+0000","last_fullsized":"2023-10-06T02:25:46.761018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:25:47.756596+0000","last_change":"2023-10-06T02:25:47.769530+0000","last_active":"2023-10-06T02:25:47.756596+0000","last_peered":"2023-10-06T02:25:47.756596+0000","last_clean":"2023-10-06T02:25:47.756596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:25:47.756596+0000","last_undegraded":"2023-10-06T02:25:47.756596+0000","last_fullsized":"2023-10-06T02:25:47.756596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:21.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:25:47.782458+0000","last_change":"2023-10-06T02:25:47.782458+0000","last_active":"2023-10-06T02:25:47.782458+0000","last_peered":"2023-10-06T02:25:47.782458+0000","last_clean":"2023-10-06T02:25:47.782458+0000","last_became_active":"2023-10-06T02:25:47.782128+0000","last_became_peered":"2023-10-06T02:25:47.782128+0000","last_unstale":"2023-10-06T02:25:47.782458+0000","last_undegraded":"2023-10-06T02:25:47.782458+0000","last_fullsized":"2023-10-06T02:25:47.782458+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:37.047439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:25:46.761086+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:25:46.761086+0000","last_peered":"2023-10-06T02:25:46.761086+0000","last_clean":"2023-10-06T02:25:46.761086+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:25:46.761086+0000","last_undegraded":"2023-10-06T02:25:46.761086+0000","last_fullsized":"2023-10-06T02:25:46.761086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":875792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53000000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.77100000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.314,"15min":0.314},"max":{"1min":0.74399999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.52400000000000002,"15min":0.51400000000000001},"min":{"1min":0.38900000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77400000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54500000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74099999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.437,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.35799999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72799999999999998,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.47699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46999999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.505,"15min":0.50600000000000001},"min":{"1min":0.33900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.67900000000000005,"5min":1.014,"15min":1.014},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.59499999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35199999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.38800000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73899999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.42999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77400000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59599999999999997,"15min":0.59899999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76500000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.63100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":284071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.72699999999999998,"15min":0.76400000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.65800000000000003,"5min":5.859,"15min":5.859},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74299999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.439}]},{"osd":1,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.373,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73299999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.495},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70699999999999996,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.38100000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.36299999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67800000000000005,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.44900000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.72399999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.45200000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.45300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.77500000000000002,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.62,"15min":0.621},"min":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.77300000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.33300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80100000000000005,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.81399999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.39500000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39800000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55700000000000005},"min":{"1min":0.43099999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46700000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.41099999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88500000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84699999999999998,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.52800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298500,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073340,"statfs":{"total":96636764160,"available":96331100160,"internally_reserved":0,"allocated":1241088,"data_stored":869184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.377,"15min":0.38300000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.49199999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.66500000000000004,"15min":0.71499999999999997},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.626,"5min":7.6900000000000004,"15min":7.6900000000000004},"last":0.28699999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.623,"15min":0.67100000000000004},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.53300000000000003,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.69699999999999995,"15min":0.747},"min":{"1min":0.28399999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56200000000000006,"5min":7.758,"15min":7.758},"last":0.251}]},{"osd":3,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.72199999999999998,"15min":0.77200000000000002},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.55400000000000005,"5min":7.7869999999999999,"15min":7.7869999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.41899999999999998,"15min":0.42399999999999999},"min":{"1min":0.28799999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.60099999999999998,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.33800000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":1.069,"15min":1.1439999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84699999999999998,"5min":11.678000000000001,"15min":11.678000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.90100000000000002,"15min":0.94999999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84299999999999997,"5min":7.6529999999999996,"15min":7.6529999999999996},"last":0.74199999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.97899999999999998,"5min":1.399,"15min":1.399},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.93600000000000005,"15min":0.98199999999999998},"min":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.79800000000000004,"5min":7.508,"15min":7.508},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.91100000000000003,"15min":0.95899999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.873,"5min":7.7270000000000003,"15min":7.7270000000000003},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68600000000000005,"15min":0.69199999999999995},"min":{"1min":0.49099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85499999999999998,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.57499999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.91400000000000003,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.95699999999999996,"15min":1.0029999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88200000000000001,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.753}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073924,"statfs":{"total":96636764160,"available":96331698176,"internally_reserved":0,"allocated":643072,"data_stored":277463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34599999999999997,"15min":0.34300000000000003},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.52500000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.35999999999999999,"15min":0.35799999999999998},"min":{"1min":0.27900000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.53900000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.249,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.33200000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.621,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.38500000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.34999999999999998},"min":{"1min":0.26100000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57799999999999996,"5min":0.622,"15min":0.622},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39100000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60299999999999998,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.37}]},{"osd":4,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.47799999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.437,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85099999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.497},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79700000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.56399999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.621,"15min":0.61599999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.47799999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79100000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.50600000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.51700000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90500000000000003,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":285424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.33800000000000002,"15min":0.33600000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.56799999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.26000000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34699999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39900000000000002,"15min":0.39800000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.30399999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.41099999999999998,"15min":0.40600000000000003},"min":{"1min":0.33600000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.29099999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.55100000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.45500000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.90000000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.628,"15min":0.623},"min":{"1min":0.46999999999999997,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93999999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95799999999999996,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.497},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.59799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":284071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.68999999999999995,"15min":0.745},"min":{"1min":0.221,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.59499999999999997,"5min":10.164999999999999,"15min":10.164999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.41099999999999998,"15min":0.41299999999999998},"min":{"1min":0.252,"5min":0.224,"15min":0.224},"max":{"1min":0.67300000000000004,"5min":1.266,"15min":1.266},"last":0.30099999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42799999999999999,"15min":0.432},"min":{"1min":0.27200000000000002,"5min":0.191,"15min":0.191},"max":{"1min":0.70999999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.317},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.433,"15min":0.433},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.83399999999999996,"5min":1.319,"15min":1.319},"last":0.24399999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.30599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58899999999999997,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.312,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.81299999999999994,"5min":1.5,"15min":1.5},"last":0.34599999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.629,"15min":0.629},"min":{"1min":0.44500000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77300000000000002,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77700000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65900000000000003,"15min":0.66100000000000003},"min":{"1min":0.46200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86699999999999999,"5min":1.538,"15min":1.538},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.48099999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89400000000000002,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.63900000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.48999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.748,"5min":1.111,"15min":1.111},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.45600000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92800000000000005,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.51800000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46999999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88400000000000001,"5min":1.21,"15min":1.21},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46000000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90000000000000002,"5min":1.135,"15min":1.135},"last":0.53100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":285424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71799999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.504,"15min":0.501},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.49399999999999999,"15min":0.48799999999999999},"min":{"1min":0.41299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.52100000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.44,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.66700000000000004}]},{"osd":3,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.41399999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59599999999999997,"15min":0.59799999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.74299999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48899999999999999,"15min":0.48699999999999999},"min":{"1min":0.32300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76000000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.432}]},{"osd":6,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.377}]},{"osd":7,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81200000000000006,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58099999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.82499999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.48099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297932,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073908,"statfs":{"total":96636764160,"available":96331681792,"internally_reserved":0,"allocated":659456,"data_stored":285424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48799999999999999,"15min":0.48199999999999998},"min":{"1min":0.32700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68500000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.499}]},{"osd":2,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.68700000000000006,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.69599999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.372,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.64900000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.496,"15min":0.495},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.38400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.81599999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.43099999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.75800000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.45400000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.47199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:25:57.467 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:25:57.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.596+0000 7f11baa7f700 1 Processor -- start 2023-10-06T02:25:57.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.596+0000 7f11baa7f700 1 -- start start 2023-10-06T02:25:57.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.597+0000 7f11baa7f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f11b41596d0 0x7f11b40b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.597+0000 7f11baa7f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11b40b3840 0x7f11b40c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.597+0000 7f11baa7f700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f11b4159aa0 0x7f11b40c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.597+0000 7f11baa7f700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b40c5300 con 0x7f11b41596d0 2023-10-06T02:25:57.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.597+0000 7f11baa7f700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b40c6160 con 0x7f11b4159aa0 2023-10-06T02:25:57.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.597+0000 7f11baa7f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b40c5550 con 0x7f11b40b3840 2023-10-06T02:25:57.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.597+0000 7f11b881b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f11b41596d0 0x7f11b40b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.597+0000 7f11b881b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f11b41596d0 0x7f11b40b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55946/0 (socket says 172.21.15.37:55946) 2023-10-06T02:25:57.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.597+0000 7f11b881b700 1 -- 172.21.15.37:0/1494507084 learned_addr learned my addr 172.21.15.37:0/1494507084 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:57.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.597+0000 7f11b3fff700 1 --2- 172.21.15.37:0/1494507084 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11b40b3840 0x7f11b40c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.597+0000 7f11b901c700 1 --2- 172.21.15.37:0/1494507084 >> v2:172.21.15.191:3300/0 conn(0x7f11b4159aa0 0x7f11b40c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.597+0000 7f11b881b700 1 -- 172.21.15.37:0/1494507084 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11b40b3840 msgr2=0x7f11b40c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:57.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.597+0000 7f11b881b700 1 --2- 172.21.15.37:0/1494507084 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11b40b3840 0x7f11b40c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.597+0000 7f11b881b700 1 -- 172.21.15.37:0/1494507084 >> v2:172.21.15.191:3300/0 conn(0x7f11b4159aa0 msgr2=0x7f11b40c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:57.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.597+0000 7f11b881b700 1 --2- 172.21.15.37:0/1494507084 >> v2:172.21.15.191:3300/0 conn(0x7f11b4159aa0 0x7f11b40c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.597+0000 7f11b881b700 1 -- 172.21.15.37:0/1494507084 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b40c5830 con 0x7f11b41596d0 2023-10-06T02:25:57.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.597+0000 7f11b3fff700 1 --2- 172.21.15.37:0/1494507084 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11b40b3840 0x7f11b40c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:57.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.598+0000 7f11b881b700 1 --2- 172.21.15.37:0/1494507084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b41596d0 0x7f11b40b3300 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f11b406d140 tx=0x7f11a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e704fc965668b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.598+0000 7f11b37fe700 1 -- 172.21.15.37:0/1494507084 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4009e70 con 0x7f11b41596d0 2023-10-06T02:25:57.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.598+0000 7f11b37fe700 1 -- 172.21.15.37:0/1494507084 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a400b860 con 0x7f11b41596d0 2023-10-06T02:25:57.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.598+0000 7f11b37fe700 1 -- 172.21.15.37:0/1494507084 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a400bc00 con 0x7f11b41596d0 2023-10-06T02:25:57.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.598+0000 7f11baa7f700 1 -- 172.21.15.37:0/1494507084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b41596d0 msgr2=0x7f11b40b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.598+0000 7f11baa7f700 1 --2- 172.21.15.37:0/1494507084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b41596d0 0x7f11b40b3300 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f11b406d140 tx=0x7f11a4009250 comp rx=0 tx=0).stop 2023-10-06T02:25:57.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.598+0000 7f11baa7f700 1 -- 172.21.15.37:0/1494507084 shutdown_connections 2023-10-06T02:25:57.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.598+0000 7f11baa7f700 1 --2- 172.21.15.37:0/1494507084 >> v2:172.21.15.191:3300/0 conn(0x7f11b4159aa0 0x7f11b40c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.598+0000 7f11baa7f700 1 --2- 172.21.15.37:0/1494507084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b41596d0 0x7f11b40b3300 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.598+0000 7f11baa7f700 1 --2- 172.21.15.37:0/1494507084 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11b40b3840 0x7f11b40c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.598+0000 7f11baa7f700 1 -- 172.21.15.37:0/1494507084 >> 172.21.15.37:0/1494507084 conn(0x7f11b406c890 msgr2=0x7f11b40d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:57.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.598+0000 7f11baa7f700 1 -- 172.21.15.37:0/1494507084 shutdown_connections 2023-10-06T02:25:57.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.598+0000 7f11baa7f700 1 -- 172.21.15.37:0/1494507084 wait complete. 2023-10-06T02:25:57.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.599+0000 7f11baa7f700 1 Processor -- start 2023-10-06T02:25:57.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.600+0000 7f11baa7f700 1 -- start start 2023-10-06T02:25:57.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.600+0000 7f11baa7f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11b40b3840 0x7f11b41416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.600+0000 7f11baa7f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11b41596d0 0x7f11b415cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.600+0000 7f11baa7f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b4159aa0 0x7f11b415c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.600+0000 7f11baa7f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b415bda0 con 0x7f11b4159aa0 2023-10-06T02:25:57.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.600+0000 7f11baa7f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b4141bf0 con 0x7f11b41596d0 2023-10-06T02:25:57.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.600+0000 7f11baa7f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b415b190 con 0x7f11b40b3840 2023-10-06T02:25:57.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.600+0000 7f11b901c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b4159aa0 0x7f11b415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.601+0000 7f11b901c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b4159aa0 0x7f11b415c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55954/0 (socket says 172.21.15.37:55954) 2023-10-06T02:25:57.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.601+0000 7f11b901c700 1 -- 172.21.15.37:0/2379249443 learned_addr learned my addr 172.21.15.37:0/2379249443 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:57.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.601+0000 7f11b881b700 1 --2- 172.21.15.37:0/2379249443 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11b40b3840 0x7f11b41416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.601+0000 7f11b3fff700 1 --2- 172.21.15.37:0/2379249443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11b41596d0 0x7f11b415cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.601+0000 7f11b901c700 1 -- 172.21.15.37:0/2379249443 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11b40b3840 msgr2=0x7f11b41416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.601+0000 7f11b901c700 1 --2- 172.21.15.37:0/2379249443 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11b40b3840 0x7f11b41416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.601+0000 7f11b901c700 1 -- 172.21.15.37:0/2379249443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11b41596d0 msgr2=0x7f11b415cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.601+0000 7f11b901c700 1 --2- 172.21.15.37:0/2379249443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11b41596d0 0x7f11b415cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.601+0000 7f11b901c700 1 -- 172.21.15.37:0/2379249443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a40094f0 con 0x7f11b4159aa0 2023-10-06T02:25:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.601+0000 7f11b901c700 1 --2- 172.21.15.37:0/2379249443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b4159aa0 0x7f11b415c230 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f11ac009d70 tx=0x7f11ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.601+0000 7f11b0ff9700 1 -- 172.21.15.37:0/2379249443 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac00caa0 con 0x7f11b4159aa0 2023-10-06T02:25:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.601+0000 7f11b0ff9700 1 -- 172.21.15.37:0/2379249443 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac00f040 con 0x7f11b4159aa0 2023-10-06T02:25:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.601+0000 7f11baa7f700 1 -- 172.21.15.37:0/2379249443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b415b470 con 0x7f11b4159aa0 2023-10-06T02:25:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.601+0000 7f11b0ff9700 1 -- 172.21.15.37:0/2379249443 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac00ce50 con 0x7f11b4159aa0 2023-10-06T02:25:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.601+0000 7f11baa7f700 1 -- 172.21.15.37:0/2379249443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b415ba30 con 0x7f11b4159aa0 2023-10-06T02:25:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.602+0000 7f11baa7f700 1 -- 172.21.15.37:0/2379249443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b415bf50 con 0x7f11b4159aa0 2023-10-06T02:25:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.603+0000 7f11b0ff9700 1 -- 172.21.15.37:0/2379249443 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f11ac014690 con 0x7f11b4159aa0 2023-10-06T02:25:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.603+0000 7f11b0ff9700 1 --2- 172.21.15.37:0/2379249443 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f11a0066f30 0x7f11a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.603+0000 7f11b0ff9700 1 -- 172.21.15.37:0/2379249443 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f11ac085130 con 0x7f11b4159aa0 2023-10-06T02:25:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.603+0000 7f11b881b700 1 --2- 172.21.15.37:0/2379249443 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f11a0066f30 0x7f11a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.604+0000 7f11b881b700 1 --2- 172.21.15.37:0/2379249443 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f11a0066f30 0x7f11a00693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f11b406d140 tx=0x7f11a4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.607+0000 7f11b0ff9700 1 -- 172.21.15.37:0/2379249443 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11b415bf50 con 0x7f11b4159aa0 2023-10-06T02:25:57.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.797+0000 7f11baa7f700 1 -- 172.21.15.37:0/2379249443 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11b415bf50 con 0x7f11a0066f30 2023-10-06T02:25:57.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.806+0000 7f11b0ff9700 1 -- 172.21.15.37:0/2379249443 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311829 (secure 0 0 0) 0x7f11b415bf50 con 0x7f11a0066f30 2023-10-06T02:25:57.810 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:57.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.809+0000 7f11baa7f700 1 -- 172.21.15.37:0/2379249443 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f11a0066f30 msgr2=0x7f11a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.809+0000 7f11baa7f700 1 --2- 172.21.15.37:0/2379249443 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f11a0066f30 0x7f11a00693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f11b406d140 tx=0x7f11a4017000 comp rx=0 tx=0).stop 2023-10-06T02:25:57.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.809+0000 7f11baa7f700 1 -- 172.21.15.37:0/2379249443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b4159aa0 msgr2=0x7f11b415c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.809+0000 7f11baa7f700 1 --2- 172.21.15.37:0/2379249443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b4159aa0 0x7f11b415c230 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f11ac009d70 tx=0x7f11ac00b040 comp rx=0 tx=0).stop 2023-10-06T02:25:57.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.809+0000 7f11baa7f700 1 -- 172.21.15.37:0/2379249443 shutdown_connections 2023-10-06T02:25:57.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.809+0000 7f11baa7f700 1 --2- 172.21.15.37:0/2379249443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b4159aa0 0x7f11b415c230 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.809+0000 7f11baa7f700 1 --2- 172.21.15.37:0/2379249443 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11b40b3840 0x7f11b41416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.809+0000 7f11baa7f700 1 --2- 172.21.15.37:0/2379249443 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f11a0066f30 0x7f11a00693e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.809+0000 7f11baa7f700 1 --2- 172.21.15.37:0/2379249443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11b41596d0 0x7f11b415cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.809+0000 7f11baa7f700 1 -- 172.21.15.37:0/2379249443 >> 172.21.15.37:0/2379249443 conn(0x7f11b406c890 msgr2=0x7f11b40d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:57.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.809+0000 7f11baa7f700 1 -- 172.21.15.37:0/2379249443 shutdown_connections 2023-10-06T02:25:57.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.809+0000 7f11baa7f700 1 -- 172.21.15.37:0/2379249443 wait complete. 2023-10-06T02:25:57.815 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:25:57.822 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2023-10-06T02:25:56.547991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384860,"kb_used_data":6556,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589860,"statfs":{"total":773094113280,"available":770652016640,"internally_reserved":0,"allocated":6713344,"data_stored":3574737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002317"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.793145+0000","last_change":"2023-10-06T02:25:48.787575+0000","last_active":"2023-10-06T02:25:48.793145+0000","last_peered":"2023-10-06T02:25:48.793145+0000","last_clean":"2023-10-06T02:25:48.793145+0000","last_became_active":"2023-10-06T02:25:48.787299+0000","last_became_peered":"2023-10-06T02:25:48.787299+0000","last_unstale":"2023-10-06T02:25:48.793145+0000","last_undegraded":"2023-10-06T02:25:48.793145+0000","last_fullsized":"2023-10-06T02:25:48.793145+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:15.256053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.793112+0000","last_change":"2023-10-06T02:25:48.784077+0000","last_active":"2023-10-06T02:25:48.793112+0000","last_peered":"2023-10-06T02:25:48.793112+0000","last_clean":"2023-10-06T02:25:48.793112+0000","last_became_active":"2023-10-06T02:25:48.783814+0000","last_became_peered":"2023-10-06T02:25:48.783814+0000","last_unstale":"2023-10-06T02:25:48.793112+0000","last_undegraded":"2023-10-06T02:25:48.793112+0000","last_fullsized":"2023-10-06T02:25:48.793112+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:07.815950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.799805+0000","last_change":"2023-10-06T02:25:48.795079+0000","last_active":"2023-10-06T02:25:48.799805+0000","last_peered":"2023-10-06T02:25:48.799805+0000","last_clean":"2023-10-06T02:25:48.799805+0000","last_became_active":"2023-10-06T02:25:48.794813+0000","last_became_peered":"2023-10-06T02:25:48.794813+0000","last_unstale":"2023-10-06T02:25:48.799805+0000","last_undegraded":"2023-10-06T02:25:48.799805+0000","last_fullsized":"2023-10-06T02:25:48.799805+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:01.275354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.798212+0000","last_change":"2023-10-06T02:25:48.793951+0000","last_active":"2023-10-06T02:25:48.798212+0000","last_peered":"2023-10-06T02:25:48.798212+0000","last_clean":"2023-10-06T02:25:48.798212+0000","last_became_active":"2023-10-06T02:25:48.793680+0000","last_became_peered":"2023-10-06T02:25:48.793680+0000","last_unstale":"2023-10-06T02:25:48.798212+0000","last_undegraded":"2023-10-06T02:25:48.798212+0000","last_fullsized":"2023-10-06T02:25:48.798212+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:46.321524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.800834+0000","last_change":"2023-10-06T02:25:48.789381+0000","last_active":"2023-10-06T02:25:48.800834+0000","last_peered":"2023-10-06T02:25:48.800834+0000","last_clean":"2023-10-06T02:25:48.800834+0000","last_became_active":"2023-10-06T02:25:48.789064+0000","last_became_peered":"2023-10-06T02:25:48.789064+0000","last_unstale":"2023-10-06T02:25:48.800834+0000","last_undegraded":"2023-10-06T02:25:48.800834+0000","last_fullsized":"2023-10-06T02:25:48.800834+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:13.924014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.801053+0000","last_change":"2023-10-06T02:25:48.798269+0000","last_active":"2023-10-06T02:25:48.801053+0000","last_peered":"2023-10-06T02:25:48.801053+0000","last_clean":"2023-10-06T02:25:48.801053+0000","last_became_active":"2023-10-06T02:25:48.798002+0000","last_became_peered":"2023-10-06T02:25:48.798002+0000","last_unstale":"2023-10-06T02:25:48.801053+0000","last_undegraded":"2023-10-06T02:25:48.801053+0000","last_fullsized":"2023-10-06T02:25:48.801053+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:59.361287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.801756+0000","last_change":"2023-10-06T02:25:48.797378+0000","last_active":"2023-10-06T02:25:48.801756+0000","last_peered":"2023-10-06T02:25:48.801756+0000","last_clean":"2023-10-06T02:25:48.801756+0000","last_became_active":"2023-10-06T02:25:48.797121+0000","last_became_peered":"2023-10-06T02:25:48.797121+0000","last_unstale":"2023-10-06T02:25:48.801756+0000","last_undegraded":"2023-10-06T02:25:48.801756+0000","last_fullsized":"2023-10-06T02:25:48.801756+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:26.938792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.799499+0000","last_change":"2023-10-06T02:25:48.796147+0000","last_active":"2023-10-06T02:25:48.799499+0000","last_peered":"2023-10-06T02:25:48.799499+0000","last_clean":"2023-10-06T02:25:48.799499+0000","last_became_active":"2023-10-06T02:25:48.795881+0000","last_became_peered":"2023-10-06T02:25:48.795881+0000","last_unstale":"2023-10-06T02:25:48.799499+0000","last_undegraded":"2023-10-06T02:25:48.799499+0000","last_fullsized":"2023-10-06T02:25:48.799499+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:14.533092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.805036+0000","last_change":"2023-10-06T02:25:48.801398+0000","last_active":"2023-10-06T02:25:48.805036+0000","last_peered":"2023-10-06T02:25:48.805036+0000","last_clean":"2023-10-06T02:25:48.805036+0000","last_became_active":"2023-10-06T02:25:48.801097+0000","last_became_peered":"2023-10-06T02:25:48.801097+0000","last_unstale":"2023-10-06T02:25:48.805036+0000","last_undegraded":"2023-10-06T02:25:48.805036+0000","last_fullsized":"2023-10-06T02:25:48.805036+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:44.695976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.800632+0000","last_change":"2023-10-06T02:25:48.797389+0000","last_active":"2023-10-06T02:25:48.800632+0000","last_peered":"2023-10-06T02:25:48.800632+0000","last_clean":"2023-10-06T02:25:48.800632+0000","last_became_active":"2023-10-06T02:25:48.797144+0000","last_became_peered":"2023-10-06T02:25:48.797144+0000","last_unstale":"2023-10-06T02:25:48.800632+0000","last_undegraded":"2023-10-06T02:25:48.800632+0000","last_fullsized":"2023-10-06T02:25:48.800632+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:52.758045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.802466+0000","last_change":"2023-10-06T02:25:48.798181+0000","last_active":"2023-10-06T02:25:48.802466+0000","last_peered":"2023-10-06T02:25:48.802466+0000","last_clean":"2023-10-06T02:25:48.802466+0000","last_became_active":"2023-10-06T02:25:48.797907+0000","last_became_peered":"2023-10-06T02:25:48.797907+0000","last_unstale":"2023-10-06T02:25:48.802466+0000","last_undegraded":"2023-10-06T02:25:48.802466+0000","last_fullsized":"2023-10-06T02:25:48.802466+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:03.991817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.799585+0000","last_change":"2023-10-06T02:25:48.796282+0000","last_active":"2023-10-06T02:25:48.799585+0000","last_peered":"2023-10-06T02:25:48.799585+0000","last_clean":"2023-10-06T02:25:48.799585+0000","last_became_active":"2023-10-06T02:25:48.795925+0000","last_became_peered":"2023-10-06T02:25:48.795925+0000","last_unstale":"2023-10-06T02:25:48.799585+0000","last_undegraded":"2023-10-06T02:25:48.799585+0000","last_fullsized":"2023-10-06T02:25:48.799585+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:37.913721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.794816+0000","last_change":"2023-10-06T02:25:48.788141+0000","last_active":"2023-10-06T02:25:48.794816+0000","last_peered":"2023-10-06T02:25:48.794816+0000","last_clean":"2023-10-06T02:25:48.794816+0000","last_became_active":"2023-10-06T02:25:48.787878+0000","last_became_peered":"2023-10-06T02:25:48.787878+0000","last_unstale":"2023-10-06T02:25:48.794816+0000","last_undegraded":"2023-10-06T02:25:48.794816+0000","last_fullsized":"2023-10-06T02:25:48.794816+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:33.984884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.804071+0000","last_change":"2023-10-06T02:25:48.800004+0000","last_active":"2023-10-06T02:25:48.804071+0000","last_peered":"2023-10-06T02:25:48.804071+0000","last_clean":"2023-10-06T02:25:48.804071+0000","last_became_active":"2023-10-06T02:25:48.799681+0000","last_became_peered":"2023-10-06T02:25:48.799681+0000","last_unstale":"2023-10-06T02:25:48.804071+0000","last_undegraded":"2023-10-06T02:25:48.804071+0000","last_fullsized":"2023-10-06T02:25:48.804071+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:15.227230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.800342+0000","last_change":"2023-10-06T02:25:48.796949+0000","last_active":"2023-10-06T02:25:48.800342+0000","last_peered":"2023-10-06T02:25:48.800342+0000","last_clean":"2023-10-06T02:25:48.800342+0000","last_became_active":"2023-10-06T02:25:48.796675+0000","last_became_peered":"2023-10-06T02:25:48.796675+0000","last_unstale":"2023-10-06T02:25:48.800342+0000","last_undegraded":"2023-10-06T02:25:48.800342+0000","last_fullsized":"2023-10-06T02:25:48.800342+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:33.984884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.790305+0000","last_change":"2023-10-06T02:25:48.787490+0000","last_active":"2023-10-06T02:25:48.790305+0000","last_peered":"2023-10-06T02:25:48.790305+0000","last_clean":"2023-10-06T02:25:48.790305+0000","last_became_active":"2023-10-06T02:25:48.787209+0000","last_became_peered":"2023-10-06T02:25:48.787209+0000","last_unstale":"2023-10-06T02:25:48.790305+0000","last_undegraded":"2023-10-06T02:25:48.790305+0000","last_fullsized":"2023-10-06T02:25:48.790305+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:16.134863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.795029+0000","last_change":"2023-10-06T02:25:48.791615+0000","last_active":"2023-10-06T02:25:48.795029+0000","last_peered":"2023-10-06T02:25:48.795029+0000","last_clean":"2023-10-06T02:25:48.795029+0000","last_became_active":"2023-10-06T02:25:48.791002+0000","last_became_peered":"2023-10-06T02:25:48.791002+0000","last_unstale":"2023-10-06T02:25:48.795029+0000","last_undegraded":"2023-10-06T02:25:48.795029+0000","last_fullsized":"2023-10-06T02:25:48.795029+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:35.551701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.799103+0000","last_change":"2023-10-06T02:25:48.795087+0000","last_active":"2023-10-06T02:25:48.799103+0000","last_peered":"2023-10-06T02:25:48.799103+0000","last_clean":"2023-10-06T02:25:48.799103+0000","last_became_active":"2023-10-06T02:25:48.794430+0000","last_became_peered":"2023-10-06T02:25:48.794430+0000","last_unstale":"2023-10-06T02:25:48.799103+0000","last_undegraded":"2023-10-06T02:25:48.799103+0000","last_fullsized":"2023-10-06T02:25:48.799103+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:37.561344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.794019+0000","last_change":"2023-10-06T02:25:48.786731+0000","last_active":"2023-10-06T02:25:48.794019+0000","last_peered":"2023-10-06T02:25:48.794019+0000","last_clean":"2023-10-06T02:25:48.794019+0000","last_became_active":"2023-10-06T02:25:48.786362+0000","last_became_peered":"2023-10-06T02:25:48.786362+0000","last_unstale":"2023-10-06T02:25:48.794019+0000","last_undegraded":"2023-10-06T02:25:48.794019+0000","last_fullsized":"2023-10-06T02:25:48.794019+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:22.309053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.790397+0000","last_change":"2023-10-06T02:25:48.788146+0000","last_active":"2023-10-06T02:25:48.790397+0000","last_peered":"2023-10-06T02:25:48.790397+0000","last_clean":"2023-10-06T02:25:48.790397+0000","last_became_active":"2023-10-06T02:25:48.787875+0000","last_became_peered":"2023-10-06T02:25:48.787875+0000","last_unstale":"2023-10-06T02:25:48.790397+0000","last_undegraded":"2023-10-06T02:25:48.790397+0000","last_fullsized":"2023-10-06T02:25:48.790397+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:33.984884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.794793+0000","last_change":"2023-10-06T02:25:48.787739+0000","last_active":"2023-10-06T02:25:48.794793+0000","last_peered":"2023-10-06T02:25:48.794793+0000","last_clean":"2023-10-06T02:25:48.794793+0000","last_became_active":"2023-10-06T02:25:48.787453+0000","last_became_peered":"2023-10-06T02:25:48.787453+0000","last_unstale":"2023-10-06T02:25:48.794793+0000","last_undegraded":"2023-10-06T02:25:48.794793+0000","last_fullsized":"2023-10-06T02:25:48.794793+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:31.712215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.800892+0000","last_change":"2023-10-06T02:25:48.798360+0000","last_active":"2023-10-06T02:25:48.800892+0000","last_peered":"2023-10-06T02:25:48.800892+0000","last_clean":"2023-10-06T02:25:48.800892+0000","last_became_active":"2023-10-06T02:25:48.798090+0000","last_became_peered":"2023-10-06T02:25:48.798090+0000","last_unstale":"2023-10-06T02:25:48.800892+0000","last_undegraded":"2023-10-06T02:25:48.800892+0000","last_fullsized":"2023-10-06T02:25:48.800892+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:44.695976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.798611+0000","last_change":"2023-10-06T02:25:48.797701+0000","last_active":"2023-10-06T02:25:48.798611+0000","last_peered":"2023-10-06T02:25:48.798611+0000","last_clean":"2023-10-06T02:25:48.798611+0000","last_became_active":"2023-10-06T02:25:48.797410+0000","last_became_peered":"2023-10-06T02:25:48.797410+0000","last_unstale":"2023-10-06T02:25:48.798611+0000","last_undegraded":"2023-10-06T02:25:48.798611+0000","last_fullsized":"2023-10-06T02:25:48.798611+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:52.758045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.799906+0000","last_change":"2023-10-06T02:25:48.794997+0000","last_active":"2023-10-06T02:25:48.799906+0000","last_peered":"2023-10-06T02:25:48.799906+0000","last_clean":"2023-10-06T02:25:48.799906+0000","last_became_active":"2023-10-06T02:25:48.794626+0000","last_became_peered":"2023-10-06T02:25:48.794626+0000","last_unstale":"2023-10-06T02:25:48.799906+0000","last_undegraded":"2023-10-06T02:25:48.799906+0000","last_fullsized":"2023-10-06T02:25:48.799906+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:31.712215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.794940+0000","last_change":"2023-10-06T02:25:48.790871+0000","last_active":"2023-10-06T02:25:48.794940+0000","last_peered":"2023-10-06T02:25:48.794940+0000","last_clean":"2023-10-06T02:25:48.794940+0000","last_became_active":"2023-10-06T02:25:48.790605+0000","last_became_peered":"2023-10-06T02:25:48.790605+0000","last_unstale":"2023-10-06T02:25:48.794940+0000","last_undegraded":"2023-10-06T02:25:48.794940+0000","last_fullsized":"2023-10-06T02:25:48.794940+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:41.394648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.794988+0000","last_change":"2023-10-06T02:25:48.791582+0000","last_active":"2023-10-06T02:25:48.794988+0000","last_peered":"2023-10-06T02:25:48.794988+0000","last_clean":"2023-10-06T02:25:48.794988+0000","last_became_active":"2023-10-06T02:25:48.791315+0000","last_became_peered":"2023-10-06T02:25:48.791315+0000","last_unstale":"2023-10-06T02:25:48.794988+0000","last_undegraded":"2023-10-06T02:25:48.794988+0000","last_fullsized":"2023-10-06T02:25:48.794988+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:59:52.758045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.798881+0000","last_change":"2023-10-06T02:25:48.790926+0000","last_active":"2023-10-06T02:25:48.798881+0000","last_peered":"2023-10-06T02:25:48.798881+0000","last_clean":"2023-10-06T02:25:48.798881+0000","last_became_active":"2023-10-06T02:25:48.790692+0000","last_became_peered":"2023-10-06T02:25:48.790692+0000","last_unstale":"2023-10-06T02:25:48.798881+0000","last_undegraded":"2023-10-06T02:25:48.798881+0000","last_fullsized":"2023-10-06T02:25:48.798881+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:15.227230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.795158+0000","last_change":"2023-10-06T02:25:48.792287+0000","last_active":"2023-10-06T02:25:48.795158+0000","last_peered":"2023-10-06T02:25:48.795158+0000","last_clean":"2023-10-06T02:25:48.795158+0000","last_became_active":"2023-10-06T02:25:48.792078+0000","last_became_peered":"2023-10-06T02:25:48.792078+0000","last_unstale":"2023-10-06T02:25:48.795158+0000","last_undegraded":"2023-10-06T02:25:48.795158+0000","last_fullsized":"2023-10-06T02:25:48.795158+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:53.382091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.804949+0000","last_change":"2023-10-06T02:25:48.802255+0000","last_active":"2023-10-06T02:25:48.804949+0000","last_peered":"2023-10-06T02:25:48.804949+0000","last_clean":"2023-10-06T02:25:48.804949+0000","last_became_active":"2023-10-06T02:25:48.801803+0000","last_became_peered":"2023-10-06T02:25:48.801803+0000","last_unstale":"2023-10-06T02:25:48.804949+0000","last_undegraded":"2023-10-06T02:25:48.804949+0000","last_fullsized":"2023-10-06T02:25:48.804949+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:14.533092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.799616+0000","last_change":"2023-10-06T02:25:48.796171+0000","last_active":"2023-10-06T02:25:48.799616+0000","last_peered":"2023-10-06T02:25:48.799616+0000","last_clean":"2023-10-06T02:25:48.799616+0000","last_became_active":"2023-10-06T02:25:48.795897+0000","last_became_peered":"2023-10-06T02:25:48.795897+0000","last_unstale":"2023-10-06T02:25:48.799616+0000","last_undegraded":"2023-10-06T02:25:48.799616+0000","last_fullsized":"2023-10-06T02:25:48.799616+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:01.275354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.798903+0000","last_change":"2023-10-06T02:25:48.791466+0000","last_active":"2023-10-06T02:25:48.798903+0000","last_peered":"2023-10-06T02:25:48.798903+0000","last_clean":"2023-10-06T02:25:48.798903+0000","last_became_active":"2023-10-06T02:25:48.791174+0000","last_became_peered":"2023-10-06T02:25:48.791174+0000","last_unstale":"2023-10-06T02:25:48.798903+0000","last_undegraded":"2023-10-06T02:25:48.798903+0000","last_fullsized":"2023-10-06T02:25:48.798903+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:31.712215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.790903+0000","last_change":"2023-10-06T02:25:48.784238+0000","last_active":"2023-10-06T02:25:48.790903+0000","last_peered":"2023-10-06T02:25:48.790903+0000","last_clean":"2023-10-06T02:25:48.790903+0000","last_became_active":"2023-10-06T02:25:48.783802+0000","last_became_peered":"2023-10-06T02:25:48.783802+0000","last_unstale":"2023-10-06T02:25:48.790903+0000","last_undegraded":"2023-10-06T02:25:48.790903+0000","last_fullsized":"2023-10-06T02:25:48.790903+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:19.420641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.794101+0000","last_change":"2023-10-06T02:25:48.787970+0000","last_active":"2023-10-06T02:25:48.794101+0000","last_peered":"2023-10-06T02:25:48.794101+0000","last_clean":"2023-10-06T02:25:48.794101+0000","last_became_active":"2023-10-06T02:25:48.787702+0000","last_became_peered":"2023-10-06T02:25:48.787702+0000","last_unstale":"2023-10-06T02:25:48.794101+0000","last_undegraded":"2023-10-06T02:25:48.794101+0000","last_fullsized":"2023-10-06T02:25:48.794101+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:25.981569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"56'4","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.804740+0000","last_change":"2023-10-06T02:25:47.779666+0000","last_active":"2023-10-06T02:25:48.804740+0000","last_peered":"2023-10-06T02:25:48.804740+0000","last_clean":"2023-10-06T02:25:48.804740+0000","last_became_active":"2023-10-06T02:25:47.779228+0000","last_became_peered":"2023-10-06T02:25:47.779228+0000","last_unstale":"2023-10-06T02:25:48.804740+0000","last_undegraded":"2023-10-06T02:25:48.804740+0000","last_fullsized":"2023-10-06T02:25:48.804740+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:21.300373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.801924+0000","last_change":"2023-10-06T02:25:48.796369+0000","last_active":"2023-10-06T02:25:48.801924+0000","last_peered":"2023-10-06T02:25:48.801924+0000","last_clean":"2023-10-06T02:25:48.801924+0000","last_became_active":"2023-10-06T02:25:48.796117+0000","last_became_peered":"2023-10-06T02:25:48.796117+0000","last_unstale":"2023-10-06T02:25:48.801924+0000","last_undegraded":"2023-10-06T02:25:48.801924+0000","last_fullsized":"2023-10-06T02:25:48.801924+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:01.275354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.800488+0000","last_change":"2023-10-06T02:25:47.778547+0000","last_active":"2023-10-06T02:25:48.800488+0000","last_peered":"2023-10-06T02:25:48.800488+0000","last_clean":"2023-10-06T02:25:48.800488+0000","last_became_active":"2023-10-06T02:25:47.778062+0000","last_became_peered":"2023-10-06T02:25:47.778062+0000","last_unstale":"2023-10-06T02:25:48.800488+0000","last_undegraded":"2023-10-06T02:25:48.800488+0000","last_fullsized":"2023-10-06T02:25:48.800488+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:22.094876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.791016+0000","last_change":"2023-10-06T02:25:48.784928+0000","last_active":"2023-10-06T02:25:48.791016+0000","last_peered":"2023-10-06T02:25:48.791016+0000","last_clean":"2023-10-06T02:25:48.791016+0000","last_became_active":"2023-10-06T02:25:48.784637+0000","last_became_peered":"2023-10-06T02:25:48.784637+0000","last_unstale":"2023-10-06T02:25:48.791016+0000","last_undegraded":"2023-10-06T02:25:48.791016+0000","last_fullsized":"2023-10-06T02:25:48.791016+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:35.197296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"56'2","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.800171+0000","last_change":"2023-10-06T02:25:47.781462+0000","last_active":"2023-10-06T02:25:48.800171+0000","last_peered":"2023-10-06T02:25:48.800171+0000","last_clean":"2023-10-06T02:25:48.800171+0000","last_became_active":"2023-10-06T02:25:47.781039+0000","last_became_peered":"2023-10-06T02:25:47.781039+0000","last_unstale":"2023-10-06T02:25:48.800171+0000","last_undegraded":"2023-10-06T02:25:48.800171+0000","last_fullsized":"2023-10-06T02:25:48.800171+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:56.647333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.800415+0000","last_change":"2023-10-06T02:25:48.797556+0000","last_active":"2023-10-06T02:25:48.800415+0000","last_peered":"2023-10-06T02:25:48.800415+0000","last_clean":"2023-10-06T02:25:48.800415+0000","last_became_active":"2023-10-06T02:25:48.796629+0000","last_became_peered":"2023-10-06T02:25:48.796629+0000","last_unstale":"2023-10-06T02:25:48.800415+0000","last_undegraded":"2023-10-06T02:25:48.800415+0000","last_fullsized":"2023-10-06T02:25:48.800415+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:07.298794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"56'2","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.801442+0000","last_change":"2023-10-06T02:25:47.772551+0000","last_active":"2023-10-06T02:25:48.801442+0000","last_peered":"2023-10-06T02:25:48.801442+0000","last_clean":"2023-10-06T02:25:48.801442+0000","last_became_active":"2023-10-06T02:25:47.772269+0000","last_became_peered":"2023-10-06T02:25:47.772269+0000","last_unstale":"2023-10-06T02:25:48.801442+0000","last_undegraded":"2023-10-06T02:25:48.801442+0000","last_fullsized":"2023-10-06T02:25:48.801442+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:36.552664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.797011+0000","last_change":"2023-10-06T02:25:48.795207+0000","last_active":"2023-10-06T02:25:48.797011+0000","last_peered":"2023-10-06T02:25:48.797011+0000","last_clean":"2023-10-06T02:25:48.797011+0000","last_became_active":"2023-10-06T02:25:48.794924+0000","last_became_peered":"2023-10-06T02:25:48.794924+0000","last_unstale":"2023-10-06T02:25:48.797011+0000","last_undegraded":"2023-10-06T02:25:48.797011+0000","last_fullsized":"2023-10-06T02:25:48.797011+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:09.905855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.798883+0000","last_change":"2023-10-06T02:25:47.775941+0000","last_active":"2023-10-06T02:25:48.798883+0000","last_peered":"2023-10-06T02:25:48.798883+0000","last_clean":"2023-10-06T02:25:48.798883+0000","last_became_active":"2023-10-06T02:25:47.775677+0000","last_became_peered":"2023-10-06T02:25:47.775677+0000","last_unstale":"2023-10-06T02:25:48.798883+0000","last_undegraded":"2023-10-06T02:25:48.798883+0000","last_fullsized":"2023-10-06T02:25:48.798883+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:14.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.793887+0000","last_change":"2023-10-06T02:25:48.788507+0000","last_active":"2023-10-06T02:25:48.793887+0000","last_peered":"2023-10-06T02:25:48.793887+0000","last_clean":"2023-10-06T02:25:48.793887+0000","last_became_active":"2023-10-06T02:25:48.788046+0000","last_became_peered":"2023-10-06T02:25:48.788046+0000","last_unstale":"2023-10-06T02:25:48.793887+0000","last_undegraded":"2023-10-06T02:25:48.793887+0000","last_fullsized":"2023-10-06T02:25:48.793887+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:21.662066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.797830+0000","last_change":"2023-10-06T02:25:47.776075+0000","last_active":"2023-10-06T02:25:48.797830+0000","last_peered":"2023-10-06T02:25:48.797830+0000","last_clean":"2023-10-06T02:25:48.797830+0000","last_became_active":"2023-10-06T02:25:47.775812+0000","last_became_peered":"2023-10-06T02:25:47.775812+0000","last_unstale":"2023-10-06T02:25:48.797830+0000","last_undegraded":"2023-10-06T02:25:48.797830+0000","last_fullsized":"2023-10-06T02:25:48.797830+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:20.646833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.800753+0000","last_change":"2023-10-06T02:25:48.788611+0000","last_active":"2023-10-06T02:25:48.800753+0000","last_peered":"2023-10-06T02:25:48.800753+0000","last_clean":"2023-10-06T02:25:48.800753+0000","last_became_active":"2023-10-06T02:25:48.787046+0000","last_became_peered":"2023-10-06T02:25:48.787046+0000","last_unstale":"2023-10-06T02:25:48.800753+0000","last_undegraded":"2023-10-06T02:25:48.800753+0000","last_fullsized":"2023-10-06T02:25:48.800753+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:21.678499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.779109+0000","last_change":"2023-10-06T02:25:47.782265+0000","last_active":"2023-10-06T02:25:48.779109+0000","last_peered":"2023-10-06T02:25:48.779109+0000","last_clean":"2023-10-06T02:25:48.779109+0000","last_became_active":"2023-10-06T02:25:47.781984+0000","last_became_peered":"2023-10-06T02:25:47.781984+0000","last_unstale":"2023-10-06T02:25:48.779109+0000","last_undegraded":"2023-10-06T02:25:48.779109+0000","last_fullsized":"2023-10-06T02:25:48.779109+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:13.998418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.791778+0000","last_change":"2023-10-06T02:25:48.789054+0000","last_active":"2023-10-06T02:25:48.791778+0000","last_peered":"2023-10-06T02:25:48.791778+0000","last_clean":"2023-10-06T02:25:48.791778+0000","last_became_active":"2023-10-06T02:25:48.788821+0000","last_became_peered":"2023-10-06T02:25:48.788821+0000","last_unstale":"2023-10-06T02:25:48.791778+0000","last_undegraded":"2023-10-06T02:25:48.791778+0000","last_fullsized":"2023-10-06T02:25:48.791778+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:37.913721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.780135+0000","last_change":"2023-10-06T02:25:47.776645+0000","last_active":"2023-10-06T02:25:48.780135+0000","last_peered":"2023-10-06T02:25:48.780135+0000","last_clean":"2023-10-06T02:25:48.780135+0000","last_became_active":"2023-10-06T02:25:47.776222+0000","last_became_peered":"2023-10-06T02:25:47.776222+0000","last_unstale":"2023-10-06T02:25:48.780135+0000","last_undegraded":"2023-10-06T02:25:48.780135+0000","last_fullsized":"2023-10-06T02:25:48.780135+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:03.400305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.796566+0000","last_change":"2023-10-06T02:25:48.795075+0000","last_active":"2023-10-06T02:25:48.796566+0000","last_peered":"2023-10-06T02:25:48.796566+0000","last_clean":"2023-10-06T02:25:48.796566+0000","last_became_active":"2023-10-06T02:25:48.793748+0000","last_became_peered":"2023-10-06T02:25:48.793748+0000","last_unstale":"2023-10-06T02:25:48.796566+0000","last_undegraded":"2023-10-06T02:25:48.796566+0000","last_fullsized":"2023-10-06T02:25:48.796566+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:38.056119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.787040+0000","last_change":"2023-10-06T02:25:47.783911+0000","last_active":"2023-10-06T02:25:48.787040+0000","last_peered":"2023-10-06T02:25:48.787040+0000","last_clean":"2023-10-06T02:25:48.787040+0000","last_became_active":"2023-10-06T02:25:47.783672+0000","last_became_peered":"2023-10-06T02:25:47.783672+0000","last_unstale":"2023-10-06T02:25:48.787040+0000","last_undegraded":"2023-10-06T02:25:48.787040+0000","last_fullsized":"2023-10-06T02:25:48.787040+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:53.337356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.790321+0000","last_change":"2023-10-06T02:25:48.788022+0000","last_active":"2023-10-06T02:25:48.790321+0000","last_peered":"2023-10-06T02:25:48.790321+0000","last_clean":"2023-10-06T02:25:48.790321+0000","last_became_active":"2023-10-06T02:25:48.787750+0000","last_became_peered":"2023-10-06T02:25:48.787750+0000","last_unstale":"2023-10-06T02:25:48.790321+0000","last_undegraded":"2023-10-06T02:25:48.790321+0000","last_fullsized":"2023-10-06T02:25:48.790321+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:07.298794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.787419+0000","last_change":"2023-10-06T02:25:47.774544+0000","last_active":"2023-10-06T02:25:48.787419+0000","last_peered":"2023-10-06T02:25:48.787419+0000","last_clean":"2023-10-06T02:25:48.787419+0000","last_became_active":"2023-10-06T02:25:47.773704+0000","last_became_peered":"2023-10-06T02:25:47.773704+0000","last_unstale":"2023-10-06T02:25:48.787419+0000","last_undegraded":"2023-10-06T02:25:48.787419+0000","last_fullsized":"2023-10-06T02:25:48.787419+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:04.612716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.800917+0000","last_change":"2023-10-06T02:25:48.790424+0000","last_active":"2023-10-06T02:25:48.800917+0000","last_peered":"2023-10-06T02:25:48.800917+0000","last_clean":"2023-10-06T02:25:48.800917+0000","last_became_active":"2023-10-06T02:25:48.790140+0000","last_became_peered":"2023-10-06T02:25:48.790140+0000","last_unstale":"2023-10-06T02:25:48.800917+0000","last_undegraded":"2023-10-06T02:25:48.800917+0000","last_fullsized":"2023-10-06T02:25:48.800917+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:10.359414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"56'3","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.800106+0000","last_change":"2023-10-06T02:25:47.781564+0000","last_active":"2023-10-06T02:25:48.800106+0000","last_peered":"2023-10-06T02:25:48.800106+0000","last_clean":"2023-10-06T02:25:48.800106+0000","last_became_active":"2023-10-06T02:25:47.781157+0000","last_became_peered":"2023-10-06T02:25:47.781157+0000","last_unstale":"2023-10-06T02:25:48.800106+0000","last_undegraded":"2023-10-06T02:25:48.800106+0000","last_fullsized":"2023-10-06T02:25:48.800106+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:37.047439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.800310+0000","last_change":"2023-10-06T02:25:48.792007+0000","last_active":"2023-10-06T02:25:48.800310+0000","last_peered":"2023-10-06T02:25:48.800310+0000","last_clean":"2023-10-06T02:25:48.800310+0000","last_became_active":"2023-10-06T02:25:48.791761+0000","last_became_peered":"2023-10-06T02:25:48.791761+0000","last_unstale":"2023-10-06T02:25:48.800310+0000","last_undegraded":"2023-10-06T02:25:48.800310+0000","last_fullsized":"2023-10-06T02:25:48.800310+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:23.103556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"56'6","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.813054+0000","last_change":"2023-10-06T02:25:47.774248+0000","last_active":"2023-10-06T02:25:48.813054+0000","last_peered":"2023-10-06T02:25:48.813054+0000","last_clean":"2023-10-06T02:25:48.813054+0000","last_became_active":"2023-10-06T02:25:47.773967+0000","last_became_peered":"2023-10-06T02:25:47.773967+0000","last_unstale":"2023-10-06T02:25:48.813054+0000","last_undegraded":"2023-10-06T02:25:48.813054+0000","last_fullsized":"2023-10-06T02:25:48.813054+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:19.027538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.809943+0000","last_change":"2023-10-06T02:25:48.800986+0000","last_active":"2023-10-06T02:25:48.809943+0000","last_peered":"2023-10-06T02:25:48.809943+0000","last_clean":"2023-10-06T02:25:48.809943+0000","last_became_active":"2023-10-06T02:25:48.800724+0000","last_became_peered":"2023-10-06T02:25:48.800724+0000","last_unstale":"2023-10-06T02:25:48.809943+0000","last_undegraded":"2023-10-06T02:25:48.809943+0000","last_fullsized":"2023-10-06T02:25:48.809943+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:41.394648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"56'2","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.804943+0000","last_change":"2023-10-06T02:25:47.782266+0000","last_active":"2023-10-06T02:25:48.804943+0000","last_peered":"2023-10-06T02:25:48.804943+0000","last_clean":"2023-10-06T02:25:48.804943+0000","last_became_active":"2023-10-06T02:25:47.781819+0000","last_became_peered":"2023-10-06T02:25:47.781819+0000","last_unstale":"2023-10-06T02:25:48.804943+0000","last_undegraded":"2023-10-06T02:25:48.804943+0000","last_fullsized":"2023-10-06T02:25:48.804943+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:20.653387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.788723+0000","last_change":"2023-10-06T02:25:48.781578+0000","last_active":"2023-10-06T02:25:48.788723+0000","last_peered":"2023-10-06T02:25:48.788723+0000","last_clean":"2023-10-06T02:25:48.788723+0000","last_became_active":"2023-10-06T02:25:48.781267+0000","last_became_peered":"2023-10-06T02:25:48.781267+0000","last_unstale":"2023-10-06T02:25:48.788723+0000","last_undegraded":"2023-10-06T02:25:48.788723+0000","last_fullsized":"2023-10-06T02:25:48.788723+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:57.656013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.780459+0000","last_change":"2023-10-06T02:25:47.783305+0000","last_active":"2023-10-06T02:25:48.780459+0000","last_peered":"2023-10-06T02:25:48.780459+0000","last_clean":"2023-10-06T02:25:48.780459+0000","last_became_active":"2023-10-06T02:25:47.783026+0000","last_became_peered":"2023-10-06T02:25:47.783026+0000","last_unstale":"2023-10-06T02:25:48.780459+0000","last_undegraded":"2023-10-06T02:25:48.780459+0000","last_fullsized":"2023-10-06T02:25:48.780459+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:53.337356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.800961+0000","last_change":"2023-10-06T02:25:48.790745+0000","last_active":"2023-10-06T02:25:48.800961+0000","last_peered":"2023-10-06T02:25:48.800961+0000","last_clean":"2023-10-06T02:25:48.800961+0000","last_became_active":"2023-10-06T02:25:48.786390+0000","last_became_peered":"2023-10-06T02:25:48.786390+0000","last_unstale":"2023-10-06T02:25:48.800961+0000","last_undegraded":"2023-10-06T02:25:48.800961+0000","last_fullsized":"2023-10-06T02:25:48.800961+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:51.375936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.785457+0000","last_change":"2023-10-06T02:25:47.780895+0000","last_active":"2023-10-06T02:25:48.785457+0000","last_peered":"2023-10-06T02:25:48.785457+0000","last_clean":"2023-10-06T02:25:48.785457+0000","last_became_active":"2023-10-06T02:25:47.780602+0000","last_became_peered":"2023-10-06T02:25:47.780602+0000","last_unstale":"2023-10-06T02:25:48.785457+0000","last_undegraded":"2023-10-06T02:25:48.785457+0000","last_fullsized":"2023-10-06T02:25:48.785457+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:08.884543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.802134+0000","last_change":"2023-10-06T02:25:48.800193+0000","last_active":"2023-10-06T02:25:48.802134+0000","last_peered":"2023-10-06T02:25:48.802134+0000","last_clean":"2023-10-06T02:25:48.802134+0000","last_became_active":"2023-10-06T02:25:48.799905+0000","last_became_peered":"2023-10-06T02:25:48.799905+0000","last_unstale":"2023-10-06T02:25:48.802134+0000","last_undegraded":"2023-10-06T02:25:48.802134+0000","last_fullsized":"2023-10-06T02:25:48.802134+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:54.346036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"56'8","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.810261+0000","last_change":"2023-10-06T02:25:47.779687+0000","last_active":"2023-10-06T02:25:48.810261+0000","last_peered":"2023-10-06T02:25:48.810261+0000","last_clean":"2023-10-06T02:25:48.810261+0000","last_became_active":"2023-10-06T02:25:47.779422+0000","last_became_peered":"2023-10-06T02:25:47.779422+0000","last_unstale":"2023-10-06T02:25:48.810261+0000","last_undegraded":"2023-10-06T02:25:48.810261+0000","last_fullsized":"2023-10-06T02:25:48.810261+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:06.807270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.798784+0000","last_change":"2023-10-06T02:25:48.796351+0000","last_active":"2023-10-06T02:25:48.798784+0000","last_peered":"2023-10-06T02:25:48.798784+0000","last_clean":"2023-10-06T02:25:48.798784+0000","last_became_active":"2023-10-06T02:25:48.796095+0000","last_became_peered":"2023-10-06T02:25:48.796095+0000","last_unstale":"2023-10-06T02:25:48.798784+0000","last_undegraded":"2023-10-06T02:25:48.798784+0000","last_fullsized":"2023-10-06T02:25:48.798784+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:07.298794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"56'2","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.800826+0000","last_change":"2023-10-06T02:25:47.789740+0000","last_active":"2023-10-06T02:25:48.800826+0000","last_peered":"2023-10-06T02:25:48.800826+0000","last_clean":"2023-10-06T02:25:48.800826+0000","last_became_active":"2023-10-06T02:25:47.789419+0000","last_became_peered":"2023-10-06T02:25:47.789419+0000","last_unstale":"2023-10-06T02:25:48.800826+0000","last_undegraded":"2023-10-06T02:25:48.800826+0000","last_fullsized":"2023-10-06T02:25:48.800826+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:20.653387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.790193+0000","last_change":"2023-10-06T02:25:48.785627+0000","last_active":"2023-10-06T02:25:48.790193+0000","last_peered":"2023-10-06T02:25:48.790193+0000","last_clean":"2023-10-06T02:25:48.790193+0000","last_became_active":"2023-10-06T02:25:48.784962+0000","last_became_peered":"2023-10-06T02:25:48.784962+0000","last_unstale":"2023-10-06T02:25:48.790193+0000","last_undegraded":"2023-10-06T02:25:48.790193+0000","last_fullsized":"2023-10-06T02:25:48.790193+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:49:52.843085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"57'1","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T02:25:49.789932+0000","last_change":"2023-10-06T02:25:47.780940+0000","last_active":"2023-10-06T02:25:49.789932+0000","last_peered":"2023-10-06T02:25:49.789932+0000","last_clean":"2023-10-06T02:25:49.789932+0000","last_became_active":"2023-10-06T02:25:47.780649+0000","last_became_peered":"2023-10-06T02:25:47.780649+0000","last_unstale":"2023-10-06T02:25:49.789932+0000","last_undegraded":"2023-10-06T02:25:49.789932+0000","last_fullsized":"2023-10-06T02:25:49.789932+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:06.807270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.786637+0000","last_change":"2023-10-06T02:25:48.784779+0000","last_active":"2023-10-06T02:25:48.786637+0000","last_peered":"2023-10-06T02:25:48.786637+0000","last_clean":"2023-10-06T02:25:48.786637+0000","last_became_active":"2023-10-06T02:25:48.784461+0000","last_became_peered":"2023-10-06T02:25:48.784461+0000","last_unstale":"2023-10-06T02:25:48.786637+0000","last_undegraded":"2023-10-06T02:25:48.786637+0000","last_fullsized":"2023-10-06T02:25:48.786637+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:44.695976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.774446+0000","last_change":"2023-10-06T02:25:47.781285+0000","last_active":"2023-10-06T02:25:48.774446+0000","last_peered":"2023-10-06T02:25:48.774446+0000","last_clean":"2023-10-06T02:25:48.774446+0000","last_became_active":"2023-10-06T02:25:47.780775+0000","last_became_peered":"2023-10-06T02:25:47.780775+0000","last_unstale":"2023-10-06T02:25:48.774446+0000","last_undegraded":"2023-10-06T02:25:48.774446+0000","last_fullsized":"2023-10-06T02:25:48.774446+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:30.703535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.794072+0000","last_change":"2023-10-06T02:25:48.787639+0000","last_active":"2023-10-06T02:25:48.794072+0000","last_peered":"2023-10-06T02:25:48.794072+0000","last_clean":"2023-10-06T02:25:48.794072+0000","last_became_active":"2023-10-06T02:25:48.787046+0000","last_became_peered":"2023-10-06T02:25:48.787046+0000","last_unstale":"2023-10-06T02:25:48.794072+0000","last_undegraded":"2023-10-06T02:25:48.794072+0000","last_fullsized":"2023-10-06T02:25:48.794072+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:15:47.976728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.784414+0000","last_change":"2023-10-06T02:25:47.774115+0000","last_active":"2023-10-06T02:25:48.784414+0000","last_peered":"2023-10-06T02:25:48.784414+0000","last_clean":"2023-10-06T02:25:48.784414+0000","last_became_active":"2023-10-06T02:25:47.773648+0000","last_became_peered":"2023-10-06T02:25:47.773648+0000","last_unstale":"2023-10-06T02:25:48.784414+0000","last_undegraded":"2023-10-06T02:25:48.784414+0000","last_fullsized":"2023-10-06T02:25:48.784414+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:12.915334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.802533+0000","last_change":"2023-10-06T02:25:48.796994+0000","last_active":"2023-10-06T02:25:48.802533+0000","last_peered":"2023-10-06T02:25:48.802533+0000","last_clean":"2023-10-06T02:25:48.802533+0000","last_became_active":"2023-10-06T02:25:48.796751+0000","last_became_peered":"2023-10-06T02:25:48.796751+0000","last_unstale":"2023-10-06T02:25:48.802533+0000","last_undegraded":"2023-10-06T02:25:48.802533+0000","last_fullsized":"2023-10-06T02:25:48.802533+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:20.036217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.784772+0000","last_change":"2023-10-06T02:25:47.780245+0000","last_active":"2023-10-06T02:25:48.784772+0000","last_peered":"2023-10-06T02:25:48.784772+0000","last_clean":"2023-10-06T02:25:48.784772+0000","last_became_active":"2023-10-06T02:25:47.779986+0000","last_became_peered":"2023-10-06T02:25:47.779986+0000","last_unstale":"2023-10-06T02:25:48.784772+0000","last_undegraded":"2023-10-06T02:25:48.784772+0000","last_fullsized":"2023-10-06T02:25:48.784772+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:52.373411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.809874+0000","last_change":"2023-10-06T02:25:48.800744+0000","last_active":"2023-10-06T02:25:48.809874+0000","last_peered":"2023-10-06T02:25:48.809874+0000","last_clean":"2023-10-06T02:25:48.809874+0000","last_became_active":"2023-10-06T02:25:48.800432+0000","last_became_peered":"2023-10-06T02:25:48.800432+0000","last_unstale":"2023-10-06T02:25:48.809874+0000","last_undegraded":"2023-10-06T02:25:48.809874+0000","last_fullsized":"2023-10-06T02:25:48.809874+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:57.656013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.778329+0000","last_change":"2023-10-06T02:25:47.773995+0000","last_active":"2023-10-06T02:25:48.778329+0000","last_peered":"2023-10-06T02:25:48.778329+0000","last_clean":"2023-10-06T02:25:48.778329+0000","last_became_active":"2023-10-06T02:25:47.773707+0000","last_became_peered":"2023-10-06T02:25:47.773707+0000","last_unstale":"2023-10-06T02:25:48.778329+0000","last_undegraded":"2023-10-06T02:25:48.778329+0000","last_fullsized":"2023-10-06T02:25:48.778329+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:36.552664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.793109+0000","last_change":"2023-10-06T02:25:48.787619+0000","last_active":"2023-10-06T02:25:48.793109+0000","last_peered":"2023-10-06T02:25:48.793109+0000","last_clean":"2023-10-06T02:25:48.793109+0000","last_became_active":"2023-10-06T02:25:48.786900+0000","last_became_peered":"2023-10-06T02:25:48.786900+0000","last_unstale":"2023-10-06T02:25:48.793109+0000","last_undegraded":"2023-10-06T02:25:48.793109+0000","last_fullsized":"2023-10-06T02:25:48.793109+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:05.621396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.779203+0000","last_change":"2023-10-06T02:25:47.780787+0000","last_active":"2023-10-06T02:25:48.779203+0000","last_peered":"2023-10-06T02:25:48.779203+0000","last_clean":"2023-10-06T02:25:48.779203+0000","last_became_active":"2023-10-06T02:25:47.780419+0000","last_became_peered":"2023-10-06T02:25:47.780419+0000","last_unstale":"2023-10-06T02:25:48.779203+0000","last_undegraded":"2023-10-06T02:25:48.779203+0000","last_fullsized":"2023-10-06T02:25:48.779203+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:45.312844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.790342+0000","last_change":"2023-10-06T02:25:48.788064+0000","last_active":"2023-10-06T02:25:48.790342+0000","last_peered":"2023-10-06T02:25:48.790342+0000","last_clean":"2023-10-06T02:25:48.790342+0000","last_became_active":"2023-10-06T02:25:48.787804+0000","last_became_peered":"2023-10-06T02:25:48.787804+0000","last_unstale":"2023-10-06T02:25:48.790342+0000","last_undegraded":"2023-10-06T02:25:48.790342+0000","last_fullsized":"2023-10-06T02:25:48.790342+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:52.897864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.784133+0000","last_change":"2023-10-06T02:25:47.777859+0000","last_active":"2023-10-06T02:25:48.784133+0000","last_peered":"2023-10-06T02:25:48.784133+0000","last_clean":"2023-10-06T02:25:48.784133+0000","last_became_active":"2023-10-06T02:25:47.777513+0000","last_became_peered":"2023-10-06T02:25:47.777513+0000","last_unstale":"2023-10-06T02:25:48.784133+0000","last_undegraded":"2023-10-06T02:25:48.784133+0000","last_fullsized":"2023-10-06T02:25:48.784133+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:40.898787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.809988+0000","last_change":"2023-10-06T02:25:48.802898+0000","last_active":"2023-10-06T02:25:48.809988+0000","last_peered":"2023-10-06T02:25:48.809988+0000","last_clean":"2023-10-06T02:25:48.809988+0000","last_became_active":"2023-10-06T02:25:48.801856+0000","last_became_peered":"2023-10-06T02:25:48.801856+0000","last_unstale":"2023-10-06T02:25:48.809988+0000","last_undegraded":"2023-10-06T02:25:48.809988+0000","last_fullsized":"2023-10-06T02:25:48.809988+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:16:14.533092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.799995+0000","last_change":"2023-10-06T02:25:47.781385+0000","last_active":"2023-10-06T02:25:48.799995+0000","last_peered":"2023-10-06T02:25:48.799995+0000","last_clean":"2023-10-06T02:25:48.799995+0000","last_became_active":"2023-10-06T02:25:47.780787+0000","last_became_peered":"2023-10-06T02:25:47.780787+0000","last_unstale":"2023-10-06T02:25:48.799995+0000","last_undegraded":"2023-10-06T02:25:48.799995+0000","last_fullsized":"2023-10-06T02:25:48.799995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:34.543022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.787009+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:25:48.787009+0000","last_peered":"2023-10-06T02:25:48.787009+0000","last_clean":"2023-10-06T02:25:48.787009+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:25:48.787009+0000","last_undegraded":"2023-10-06T02:25:48.787009+0000","last_fullsized":"2023-10-06T02:25:48.787009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.796562+0000","last_change":"2023-10-06T02:25:48.787642+0000","last_active":"2023-10-06T02:25:48.796562+0000","last_peered":"2023-10-06T02:25:48.796562+0000","last_clean":"2023-10-06T02:25:48.796562+0000","last_became_active":"2023-10-06T02:25:48.787335+0000","last_became_peered":"2023-10-06T02:25:48.787335+0000","last_unstale":"2023-10-06T02:25:48.796562+0000","last_undegraded":"2023-10-06T02:25:48.796562+0000","last_fullsized":"2023-10-06T02:25:48.796562+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:41.907467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.777620+0000","last_change":"2023-10-06T02:25:47.775239+0000","last_active":"2023-10-06T02:25:48.777620+0000","last_peered":"2023-10-06T02:25:48.777620+0000","last_clean":"2023-10-06T02:25:48.777620+0000","last_became_active":"2023-10-06T02:25:47.774968+0000","last_became_peered":"2023-10-06T02:25:47.774968+0000","last_unstale":"2023-10-06T02:25:48.777620+0000","last_undegraded":"2023-10-06T02:25:48.777620+0000","last_fullsized":"2023-10-06T02:25:48.777620+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:17.730518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.777702+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:25:48.777702+0000","last_peered":"2023-10-06T02:25:48.777702+0000","last_clean":"2023-10-06T02:25:48.777702+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:25:48.777702+0000","last_undegraded":"2023-10-06T02:25:48.777702+0000","last_fullsized":"2023-10-06T02:25:48.777702+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.790883+0000","last_change":"2023-10-06T02:25:48.784057+0000","last_active":"2023-10-06T02:25:48.790883+0000","last_peered":"2023-10-06T02:25:48.790883+0000","last_clean":"2023-10-06T02:25:48.790883+0000","last_became_active":"2023-10-06T02:25:48.783448+0000","last_became_peered":"2023-10-06T02:25:48.783448+0000","last_unstale":"2023-10-06T02:25:48.790883+0000","last_undegraded":"2023-10-06T02:25:48.790883+0000","last_fullsized":"2023-10-06T02:25:48.790883+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:23:45.229995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"56'2","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.802831+0000","last_change":"2023-10-06T02:25:47.780762+0000","last_active":"2023-10-06T02:25:48.802831+0000","last_peered":"2023-10-06T02:25:48.802831+0000","last_clean":"2023-10-06T02:25:48.802831+0000","last_became_active":"2023-10-06T02:25:47.780493+0000","last_became_peered":"2023-10-06T02:25:47.780493+0000","last_unstale":"2023-10-06T02:25:48.802831+0000","last_undegraded":"2023-10-06T02:25:48.802831+0000","last_fullsized":"2023-10-06T02:25:48.802831+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:40.385968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.784537+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:25:48.784537+0000","last_peered":"2023-10-06T02:25:48.784537+0000","last_clean":"2023-10-06T02:25:48.784537+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:25:48.784537+0000","last_undegraded":"2023-10-06T02:25:48.784537+0000","last_fullsized":"2023-10-06T02:25:48.784537+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":192,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.785580+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:25:48.785580+0000","last_peered":"2023-10-06T02:25:48.785580+0000","last_clean":"2023-10-06T02:25:48.785580+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:25:48.785580+0000","last_undegraded":"2023-10-06T02:25:48.785580+0000","last_fullsized":"2023-10-06T02:25:48.785580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.788742+0000","last_change":"2023-10-06T02:25:48.783485+0000","last_active":"2023-10-06T02:25:48.788742+0000","last_peered":"2023-10-06T02:25:48.788742+0000","last_clean":"2023-10-06T02:25:48.788742+0000","last_became_active":"2023-10-06T02:25:48.783180+0000","last_became_peered":"2023-10-06T02:25:48.783180+0000","last_unstale":"2023-10-06T02:25:48.788742+0000","last_undegraded":"2023-10-06T02:25:48.788742+0000","last_fullsized":"2023-10-06T02:25:48.788742+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:03.991817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.779389+0000","last_change":"2023-10-06T02:25:47.783177+0000","last_active":"2023-10-06T02:25:48.779389+0000","last_peered":"2023-10-06T02:25:48.779389+0000","last_clean":"2023-10-06T02:25:48.779389+0000","last_became_active":"2023-10-06T02:25:47.782762+0000","last_became_peered":"2023-10-06T02:25:47.782762+0000","last_unstale":"2023-10-06T02:25:48.779389+0000","last_undegraded":"2023-10-06T02:25:48.779389+0000","last_fullsized":"2023-10-06T02:25:48.779389+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:08:34.543022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.788668+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:25:48.788668+0000","last_peered":"2023-10-06T02:25:48.788668+0000","last_clean":"2023-10-06T02:25:48.788668+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:25:48.788668+0000","last_undegraded":"2023-10-06T02:25:48.788668+0000","last_fullsized":"2023-10-06T02:25:48.788668+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.800854+0000","last_change":"2023-10-06T02:25:48.787145+0000","last_active":"2023-10-06T02:25:48.800854+0000","last_peered":"2023-10-06T02:25:48.800854+0000","last_clean":"2023-10-06T02:25:48.800854+0000","last_became_active":"2023-10-06T02:25:48.786829+0000","last_became_peered":"2023-10-06T02:25:48.786829+0000","last_unstale":"2023-10-06T02:25:48.800854+0000","last_undegraded":"2023-10-06T02:25:48.800854+0000","last_fullsized":"2023-10-06T02:25:48.800854+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:31.177238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.777857+0000","last_change":"2023-10-06T02:25:47.774699+0000","last_active":"2023-10-06T02:25:48.777857+0000","last_peered":"2023-10-06T02:25:48.777857+0000","last_clean":"2023-10-06T02:25:48.777857+0000","last_became_active":"2023-10-06T02:25:47.774440+0000","last_became_peered":"2023-10-06T02:25:47.774440+0000","last_unstale":"2023-10-06T02:25:48.777857+0000","last_undegraded":"2023-10-06T02:25:48.777857+0000","last_fullsized":"2023-10-06T02:25:48.777857+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:22.094876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.785660+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:25:48.785660+0000","last_peered":"2023-10-06T02:25:48.785660+0000","last_clean":"2023-10-06T02:25:48.785660+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:25:48.785660+0000","last_undegraded":"2023-10-06T02:25:48.785660+0000","last_fullsized":"2023-10-06T02:25:48.785660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.794033+0000","last_change":"2023-10-06T02:25:48.787330+0000","last_active":"2023-10-06T02:25:48.794033+0000","last_peered":"2023-10-06T02:25:48.794033+0000","last_clean":"2023-10-06T02:25:48.794033+0000","last_became_active":"2023-10-06T02:25:48.786092+0000","last_became_peered":"2023-10-06T02:25:48.786092+0000","last_unstale":"2023-10-06T02:25:48.794033+0000","last_undegraded":"2023-10-06T02:25:48.794033+0000","last_fullsized":"2023-10-06T02:25:48.794033+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:20.895060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.773637+0000","last_change":"2023-10-06T02:25:47.778193+0000","last_active":"2023-10-06T02:25:48.773637+0000","last_peered":"2023-10-06T02:25:48.773637+0000","last_clean":"2023-10-06T02:25:48.773637+0000","last_became_active":"2023-10-06T02:25:47.777897+0000","last_became_peered":"2023-10-06T02:25:47.777897+0000","last_unstale":"2023-10-06T02:25:48.773637+0000","last_undegraded":"2023-10-06T02:25:48.773637+0000","last_fullsized":"2023-10-06T02:25:48.773637+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:14.218550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.779368+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:25:48.779368+0000","last_peered":"2023-10-06T02:25:48.779368+0000","last_clean":"2023-10-06T02:25:48.779368+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:25:48.779368+0000","last_undegraded":"2023-10-06T02:25:48.779368+0000","last_fullsized":"2023-10-06T02:25:48.779368+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.800713+0000","last_change":"2023-10-06T02:25:48.789213+0000","last_active":"2023-10-06T02:25:48.800713+0000","last_peered":"2023-10-06T02:25:48.800713+0000","last_clean":"2023-10-06T02:25:48.800713+0000","last_became_active":"2023-10-06T02:25:48.788919+0000","last_became_peered":"2023-10-06T02:25:48.788919+0000","last_unstale":"2023-10-06T02:25:48.800713+0000","last_undegraded":"2023-10-06T02:25:48.800713+0000","last_fullsized":"2023-10-06T02:25:48.800713+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:43.827759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"56'2","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.801272+0000","last_change":"2023-10-06T02:25:47.784926+0000","last_active":"2023-10-06T02:25:48.801272+0000","last_peered":"2023-10-06T02:25:48.801272+0000","last_clean":"2023-10-06T02:25:48.801272+0000","last_became_active":"2023-10-06T02:25:47.784660+0000","last_became_peered":"2023-10-06T02:25:47.784660+0000","last_unstale":"2023-10-06T02:25:48.801272+0000","last_undegraded":"2023-10-06T02:25:48.801272+0000","last_fullsized":"2023-10-06T02:25:48.801272+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:14.247373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.780239+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:25:48.780239+0000","last_peered":"2023-10-06T02:25:48.780239+0000","last_clean":"2023-10-06T02:25:48.780239+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:25:48.780239+0000","last_undegraded":"2023-10-06T02:25:48.780239+0000","last_fullsized":"2023-10-06T02:25:48.780239+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.807391+0000","last_change":"2023-10-06T02:25:48.803709+0000","last_active":"2023-10-06T02:25:48.807391+0000","last_peered":"2023-10-06T02:25:48.807391+0000","last_clean":"2023-10-06T02:25:48.807391+0000","last_became_active":"2023-10-06T02:25:48.803072+0000","last_became_peered":"2023-10-06T02:25:48.803072+0000","last_unstale":"2023-10-06T02:25:48.807391+0000","last_undegraded":"2023-10-06T02:25:48.807391+0000","last_fullsized":"2023-10-06T02:25:48.807391+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:47.756596+0000","last_clean_scrub_stamp":"2023-10-06T02:25:47.756596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:37.913721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.802406+0000","last_change":"2023-10-06T02:25:47.782458+0000","last_active":"2023-10-06T02:25:48.802406+0000","last_peered":"2023-10-06T02:25:48.802406+0000","last_clean":"2023-10-06T02:25:48.802406+0000","last_became_active":"2023-10-06T02:25:47.782128+0000","last_became_peered":"2023-10-06T02:25:47.782128+0000","last_unstale":"2023-10-06T02:25:48.802406+0000","last_undegraded":"2023-10-06T02:25:48.802406+0000","last_fullsized":"2023-10-06T02:25:48.802406+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:25:46.747916+0000","last_clean_scrub_stamp":"2023-10-06T02:25:46.747916+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:37.047439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:25:48.780317+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:25:48.780317+0000","last_peered":"2023-10-06T02:25:48.780317+0000","last_clean":"2023-10-06T02:25:48.780317+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:25:48.780317+0000","last_undegraded":"2023-10-06T02:25:48.780317+0000","last_fullsized":"2023-10-06T02:25:48.780317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298552,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073288,"statfs":{"total":96636764160,"available":96331046912,"internally_reserved":0,"allocated":1294336,"data_stored":890297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53000000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.77100000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.314,"15min":0.314},"max":{"1min":0.74399999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.52400000000000002,"15min":0.51400000000000001},"min":{"1min":0.38900000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.441},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77400000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74099999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.437,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.496}]},{"osd":3,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72799999999999998,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.47699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.53900000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.505,"15min":0.50600000000000001},"min":{"1min":0.33900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.67900000000000005,"5min":1.014,"15min":1.014},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35199999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.38800000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73899999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59499999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.42999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77400000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59599999999999997,"15min":0.59899999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76500000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.72699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297956,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073884,"statfs":{"total":96636764160,"available":96331657216,"internally_reserved":0,"allocated":684032,"data_stored":297862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.72699999999999998,"15min":0.76400000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.65800000000000003,"5min":5.859,"15min":5.859},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74299999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.373,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73299999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70699999999999996,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.36299999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67800000000000005,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.44900000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.72399999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.45300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.77500000000000002,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.495},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.62,"15min":0.621},"min":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.77300000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.57399999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.33300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80100000000000005,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.81399999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.61899999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39800000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55700000000000005},"min":{"1min":0.43099999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.64300000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.41099999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88500000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84699999999999998,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.65600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298564,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073276,"statfs":{"total":96636764160,"available":96331034624,"internally_reserved":0,"allocated":1306624,"data_stored":891821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.377,"15min":0.38300000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.49199999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.66500000000000004,"15min":0.71499999999999997},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.626,"5min":7.6900000000000004,"15min":7.6900000000000004},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.623,"15min":0.67100000000000004},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.53300000000000003,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.69699999999999995,"15min":0.747},"min":{"1min":0.28399999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56200000000000006,"5min":7.758,"15min":7.758},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.72199999999999998,"15min":0.77200000000000002},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.55400000000000005,"5min":7.7869999999999999,"15min":7.7869999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.41899999999999998,"15min":0.42399999999999999},"min":{"1min":0.28799999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.60099999999999998,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":1.069,"15min":1.1439999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84699999999999998,"5min":11.678000000000001,"15min":11.678000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.90100000000000002,"15min":0.94999999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84299999999999997,"5min":7.6529999999999996,"15min":7.6529999999999996},"last":0.42099999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.97899999999999998,"5min":1.399,"15min":1.399},"last":0.441},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.93600000000000005,"15min":0.98199999999999998},"min":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.79800000000000004,"5min":7.508,"15min":7.508},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.91100000000000003,"15min":0.95899999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.873,"5min":7.7270000000000003,"15min":7.7270000000000003},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68600000000000005,"15min":0.69199999999999995},"min":{"1min":0.49099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85499999999999998,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.54000000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.91400000000000003,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.95699999999999996,"15min":1.0029999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88200000000000001,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.45800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297952,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073888,"statfs":{"total":96636764160,"available":96331661312,"internally_reserved":0,"allocated":679936,"data_stored":297828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34599999999999997,"15min":0.34300000000000003},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.52500000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.35999999999999999,"15min":0.35799999999999998},"min":{"1min":0.27900000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.53900000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.41999999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.249,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.443},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.33200000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.621,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.33500000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35199999999999998,"15min":0.34999999999999998},"min":{"1min":0.26100000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57799999999999996,"5min":0.622,"15min":0.622},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39100000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60299999999999998,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.30299999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.47799999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.437,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85099999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79700000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.52600000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.621,"15min":0.61599999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.47799999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79100000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.51700000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90500000000000003,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.70999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297956,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073884,"statfs":{"total":96636764160,"available":96331657216,"internally_reserved":0,"allocated":684032,"data_stored":299181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.33800000000000002,"15min":0.33600000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.56799999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.30599999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34699999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39900000000000002,"15min":0.39800000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.41099999999999998,"15min":0.40600000000000003},"min":{"1min":0.33600000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.28799999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.45500000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.90000000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.628,"15min":0.623},"min":{"1min":0.46999999999999997,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61099999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93999999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.57499999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95799999999999996,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.59999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297952,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073888,"statfs":{"total":96636764160,"available":96331661312,"internally_reserved":0,"allocated":679936,"data_stored":297828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.68999999999999995,"15min":0.745},"min":{"1min":0.221,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.59499999999999997,"5min":10.164999999999999,"15min":10.164999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.41099999999999998,"15min":0.41299999999999998},"min":{"1min":0.252,"5min":0.224,"15min":0.224},"max":{"1min":0.67300000000000004,"5min":1.266,"15min":1.266},"last":0.34799999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42799999999999999,"15min":0.432},"min":{"1min":0.27200000000000002,"5min":0.191,"15min":0.191},"max":{"1min":0.70999999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.433,"15min":0.433},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.83399999999999996,"5min":1.319,"15min":1.319},"last":0.38100000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.30599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58899999999999997,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.312,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.81299999999999994,"5min":1.5,"15min":1.5},"last":0.37}]},{"osd":4,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.629,"15min":0.629},"min":{"1min":0.44500000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77300000000000002,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77700000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.59399999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65900000000000003,"15min":0.66100000000000003},"min":{"1min":0.46200000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86699999999999999,"5min":1.538,"15min":1.538},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.48099999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89400000000000002,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.629}]},{"osd":6,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.48999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.748,"5min":1.111,"15min":1.111},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.45600000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92800000000000005,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.748}]},{"osd":7,"last update":"Fri Oct 6 02:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46999999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88400000000000001,"5min":1.21,"15min":1.21},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46000000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90000000000000002,"5min":1.135,"15min":1.135},"last":0.66600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":696320,"data_stored":300717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71799999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.504,"15min":0.501},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.74199999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.49399999999999999,"15min":0.48799999999999999},"min":{"1min":0.41299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.44,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.41399999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59599999999999997,"15min":0.59799999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.74299999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70499999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48899999999999999,"15min":0.48699999999999999},"min":{"1min":0.32300000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76000000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81200000000000006,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58099999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.82499999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.65400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297960,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073880,"statfs":{"total":96636764160,"available":96331653120,"internally_reserved":0,"allocated":688128,"data_stored":299203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48799999999999999,"15min":0.48199999999999998},"min":{"1min":0.32700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.373,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.34999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68500000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.68700000000000006,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.41299999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.372,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.64900000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.442},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.57399999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.496,"15min":0.495},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.38400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.81599999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.75800000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.496},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.56100000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:25:57.829 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:25:57.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:25:57.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.988+0000 7f5fcf406700 1 Processor -- start 2023-10-06T02:25:57.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.988+0000 7f5fcf406700 1 -- start start 2023-10-06T02:25:57.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.989+0000 7f5fcf406700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5fc81594a0 0x7f5fc8159870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.989+0000 7f5fcf406700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5fc80c78a0 0x7f5fc80cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.989+0000 7f5fcf406700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fc806c0b0 0x7f5fc80cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.989+0000 7f5fcf406700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc80c8940 con 0x7f5fc80c78a0 2023-10-06T02:25:57.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.989+0000 7f5fcf406700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc80c7d30 con 0x7f5fc81594a0 2023-10-06T02:25:57.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.989+0000 7f5fcf406700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc80c8010 con 0x7f5fc806c0b0 2023-10-06T02:25:57.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.989+0000 7f5fcc9a1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5fc80c78a0 0x7f5fc80cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.989+0000 7f5fcc9a1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5fc80c78a0 0x7f5fc80cae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55960/0 (socket says 172.21.15.37:55960) 2023-10-06T02:25:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.989+0000 7f5fcc9a1700 1 -- 172.21.15.37:0/769000156 learned_addr learned my addr 172.21.15.37:0/769000156 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.989+0000 7f5fcd9a3700 1 --2- 172.21.15.37:0/769000156 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fc806c0b0 0x7f5fc80cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.989+0000 7f5fcd1a2700 1 --2- 172.21.15.37:0/769000156 >> v2:172.21.15.191:3300/0 conn(0x7f5fc81594a0 0x7f5fc8159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.989+0000 7f5fcc9a1700 1 -- 172.21.15.37:0/769000156 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fc806c0b0 msgr2=0x7f5fc80cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.989+0000 7f5fcc9a1700 1 --2- 172.21.15.37:0/769000156 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fc806c0b0 0x7f5fc80cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.989+0000 7f5fcc9a1700 1 -- 172.21.15.37:0/769000156 >> v2:172.21.15.191:3300/0 conn(0x7f5fc81594a0 msgr2=0x7f5fc8159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.989+0000 7f5fcc9a1700 1 --2- 172.21.15.37:0/769000156 >> v2:172.21.15.191:3300/0 conn(0x7f5fc81594a0 0x7f5fc8159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.989+0000 7f5fcc9a1700 1 -- 172.21.15.37:0/769000156 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc80c82f0 con 0x7f5fc80c78a0 2023-10-06T02:25:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.989+0000 7f5fcc9a1700 1 --2- 172.21.15.37:0/769000156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc80c78a0 0x7f5fc80cae30 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f5fc806fd70 tx=0x7f5fbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d4f747a819adf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.990+0000 7f5fc7fff700 1 -- 172.21.15.37:0/769000156 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc00b860 con 0x7f5fc80c78a0 2023-10-06T02:25:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.990+0000 7f5fc7fff700 1 -- 172.21.15.37:0/769000156 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fbc00b9c0 con 0x7f5fc80c78a0 2023-10-06T02:25:57.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.990+0000 7f5fc7fff700 1 -- 172.21.15.37:0/769000156 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc00bd60 con 0x7f5fc80c78a0 2023-10-06T02:25:57.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.990+0000 7f5fcf406700 1 -- 172.21.15.37:0/769000156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc80c78a0 msgr2=0x7f5fc80cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.990+0000 7f5fcf406700 1 --2- 172.21.15.37:0/769000156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc80c78a0 0x7f5fc80cae30 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f5fc806fd70 tx=0x7f5fbc009250 comp rx=0 tx=0).stop 2023-10-06T02:25:57.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.990+0000 7f5fcf406700 1 -- 172.21.15.37:0/769000156 shutdown_connections 2023-10-06T02:25:57.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.990+0000 7f5fcf406700 1 --2- 172.21.15.37:0/769000156 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fc806c0b0 0x7f5fc80cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.990+0000 7f5fcf406700 1 --2- 172.21.15.37:0/769000156 >> v2:172.21.15.191:3300/0 conn(0x7f5fc81594a0 0x7f5fc8159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.990+0000 7f5fcf406700 1 --2- 172.21.15.37:0/769000156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc80c78a0 0x7f5fc80cae30 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.990+0000 7f5fcf406700 1 -- 172.21.15.37:0/769000156 >> 172.21.15.37:0/769000156 conn(0x7f5fc80680f0 msgr2=0x7f5fc806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:57.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.990+0000 7f5fcf406700 1 -- 172.21.15.37:0/769000156 shutdown_connections 2023-10-06T02:25:57.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.990+0000 7f5fcf406700 1 -- 172.21.15.37:0/769000156 wait complete. 2023-10-06T02:25:57.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.991+0000 7f5fcf406700 1 Processor -- start 2023-10-06T02:25:57.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.991+0000 7f5fcf406700 1 -- start start 2023-10-06T02:25:57.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.992+0000 7f5fcf406700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5fc806c0b0 0x7f5fc80b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.992+0000 7f5fcf406700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc80c78a0 0x7f5fc80aa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.992+0000 7f5fcf406700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fc81594a0 0x7f5fc80c2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.992+0000 7f5fcf406700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc80ab0c0 con 0x7f5fc80c78a0 2023-10-06T02:25:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.992+0000 7f5fcf406700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc80ab3a0 con 0x7f5fc806c0b0 2023-10-06T02:25:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.992+0000 7f5fcf406700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc80ab680 con 0x7f5fc81594a0 2023-10-06T02:25:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.992+0000 7f5fcc9a1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc80c78a0 0x7f5fc80aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.992+0000 7f5fcc9a1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc80c78a0 0x7f5fc80aa870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55968/0 (socket says 172.21.15.37:55968) 2023-10-06T02:25:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.992+0000 7f5fcc9a1700 1 -- 172.21.15.37:0/1759952250 learned_addr learned my addr 172.21.15.37:0/1759952250 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.993+0000 7f5fcd1a2700 1 --2- 172.21.15.37:0/1759952250 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5fc806c0b0 0x7f5fc80b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.993+0000 7f5fcd9a3700 1 --2- 172.21.15.37:0/1759952250 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fc81594a0 0x7f5fc80c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.993+0000 7f5fcc9a1700 1 -- 172.21.15.37:0/1759952250 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fc81594a0 msgr2=0x7f5fc80c2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.993+0000 7f5fcc9a1700 1 --2- 172.21.15.37:0/1759952250 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fc81594a0 0x7f5fc80c2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.993+0000 7f5fcc9a1700 1 -- 172.21.15.37:0/1759952250 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5fc806c0b0 msgr2=0x7f5fc80b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:57.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.993+0000 7f5fcc9a1700 1 --2- 172.21.15.37:0/1759952250 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5fc806c0b0 0x7f5fc80b1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:57.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.993+0000 7f5fcc9a1700 1 -- 172.21.15.37:0/1759952250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fbc0094f0 con 0x7f5fc80c78a0 2023-10-06T02:25:57.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.993+0000 7f5fcc9a1700 1 --2- 172.21.15.37:0/1759952250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc80c78a0 0x7f5fc80aa870 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8063d40 tx=0x7f5fbc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.993+0000 7f5fc57fa700 1 -- 172.21.15.37:0/1759952250 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc024440 con 0x7f5fc80c78a0 2023-10-06T02:25:57.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.993+0000 7f5fc57fa700 1 -- 172.21.15.37:0/1759952250 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fbc0245a0 con 0x7f5fc80c78a0 2023-10-06T02:25:57.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.993+0000 7f5fcf406700 1 -- 172.21.15.37:0/1759952250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc80ad660 con 0x7f5fc80c78a0 2023-10-06T02:25:57.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.993+0000 7f5fc57fa700 1 -- 172.21.15.37:0/1759952250 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc024960 con 0x7f5fc80c78a0 2023-10-06T02:25:57.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.993+0000 7f5fcf406700 1 -- 172.21.15.37:0/1759952250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc80aadb0 con 0x7f5fc80c78a0 2023-10-06T02:25:57.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.994+0000 7f5fcf406700 1 -- 172.21.15.37:0/1759952250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc80ad4c0 con 0x7f5fc80c78a0 2023-10-06T02:25:57.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.994+0000 7f5fc57fa700 1 -- 172.21.15.37:0/1759952250 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5fbc01a420 con 0x7f5fc80c78a0 2023-10-06T02:25:57.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.995+0000 7f5fc57fa700 1 --2- 172.21.15.37:0/1759952250 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5fb4066f30 0x7f5fb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:57.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.995+0000 7f5fc57fa700 1 -- 172.21.15.37:0/1759952250 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5fbc0865e0 con 0x7f5fc80c78a0 2023-10-06T02:25:57.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.995+0000 7f5fcd1a2700 1 --2- 172.21.15.37:0/1759952250 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5fb4066f30 0x7f5fb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:57.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.996+0000 7f5fcd1a2700 1 --2- 172.21.15.37:0/1759952250 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5fb4066f30 0x7f5fb40693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8007460 tx=0x7f5fb800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:57.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:57.999+0000 7f5fc57fa700 1 -- 172.21.15.37:0/1759952250 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fc80ad4c0 con 0x7f5fc80c78a0 2023-10-06T02:25:58.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.272+0000 7f5fcf406700 1 -- 172.21.15.37:0/1759952250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5fc80adb80 con 0x7f5fc80c78a0 2023-10-06T02:25:58.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.275+0000 7f5fc57fa700 1 -- 172.21.15.37:0/1759952250 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f5fc80adb80 con 0x7f5fc80c78a0 2023-10-06T02:25:58.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.277+0000 7f5fcf406700 1 -- 172.21.15.37:0/1759952250 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5fb4066f30 msgr2=0x7f5fb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.277+0000 7f5fcf406700 1 --2- 172.21.15.37:0/1759952250 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5fb4066f30 0x7f5fb40693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8007460 tx=0x7f5fb800b040 comp rx=0 tx=0).stop 2023-10-06T02:25:58.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.277+0000 7f5fcf406700 1 -- 172.21.15.37:0/1759952250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc80c78a0 msgr2=0x7f5fc80aa870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.277+0000 7f5fcf406700 1 --2- 172.21.15.37:0/1759952250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc80c78a0 0x7f5fc80aa870 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8063d40 tx=0x7f5fbc017000 comp rx=0 tx=0).stop 2023-10-06T02:25:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.278+0000 7f5fcf406700 1 -- 172.21.15.37:0/1759952250 shutdown_connections 2023-10-06T02:25:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.278+0000 7f5fcf406700 1 --2- 172.21.15.37:0/1759952250 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fc81594a0 0x7f5fc80c2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.278+0000 7f5fcf406700 1 --2- 172.21.15.37:0/1759952250 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5fb4066f30 0x7f5fb40693e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.278+0000 7f5fcf406700 1 --2- 172.21.15.37:0/1759952250 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5fc806c0b0 0x7f5fc80b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.278+0000 7f5fcf406700 1 --2- 172.21.15.37:0/1759952250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc80c78a0 0x7f5fc80aa870 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.278+0000 7f5fcf406700 1 -- 172.21.15.37:0/1759952250 >> 172.21.15.37:0/1759952250 conn(0x7f5fc80680f0 msgr2=0x7f5fc81565c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.278+0000 7f5fcf406700 1 -- 172.21.15.37:0/1759952250 shutdown_connections 2023-10-06T02:25:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.278+0000 7f5fcf406700 1 -- 172.21.15.37:0/1759952250 wait complete. 2023-10-06T02:25:58.280 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-10-06T02:25:58.290 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:25:58.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.408+0000 7fb0ec2bc700 1 Processor -- start 2023-10-06T02:25:58.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.408+0000 7fb0ec2bc700 1 -- start start 2023-10-06T02:25:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.409+0000 7fb0ec2bc700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb0e40c63a0 0x7fb0e415daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.409+0000 7fb0ec2bc700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e40cb650 con 0x7fb0e415dfe0 2023-10-06T02:25:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.409+0000 7fb0ec2bc700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e40cb930 con 0x7fb0e4159760 2023-10-06T02:25:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.409+0000 7fb0ec2bc700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e40cc2d0 con 0x7fb0e40c63a0 2023-10-06T02:25:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.409+0000 7fb0ea859700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb0e415dfe0 0x7fb0e40cebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33324/0 (socket says 172.21.15.37:33324) 2023-10-06T02:25:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.409+0000 7fb0ea859700 1 -- 172.21.15.37:0/1551466981 learned_addr learned my addr 172.21.15.37:0/1551466981 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.409+0000 7fb0e9056700 1 -- 172.21.15.37:0/1551466981 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305587570 0 0) 0x7fb0e40cb650 con 0x7fb0e415dfe0 2023-10-06T02:25:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9857700 1 --2- 172.21.15.37:0/1551466981 >> v2:172.21.15.191:3300/0 conn(0x7fb0e40c63a0 0x7fb0e415daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9056700 1 -- 172.21.15.37:0/1551466981 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0cc003570 con 0x7fb0e415dfe0 2023-10-06T02:25:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9056700 1 -- 172.21.15.37:0/1551466981 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1155267988 0 0) 0x7fb0cc003570 con 0x7fb0e415dfe0 2023-10-06T02:25:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9056700 1 -- 172.21.15.37:0/1551466981 >> v2:172.21.15.191:3300/0 conn(0x7fb0e40c63a0 msgr2=0x7fb0e415daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9056700 1 --2- 172.21.15.37:0/1551466981 >> v2:172.21.15.191:3300/0 conn(0x7fb0e40c63a0 0x7fb0e415daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9056700 1 -- 172.21.15.37:0/1551466981 >> v1:172.21.15.191:6789/0 conn(0x7fb0e4159760 legacy=0x7fb0e415d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9056700 1 -- 172.21.15.37:0/1551466981 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e40cbc10 con 0x7fb0e415dfe0 2023-10-06T02:25:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9056700 1 -- 172.21.15.37:0/1551466981 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7fb0d40017f0 con 0x7fb0e415dfe0 2023-10-06T02:25:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9056700 1 -- 172.21.15.37:0/1551466981 >> v1:172.21.15.37:6789/0 conn(0x7fb0e415dfe0 legacy=0x7fb0e40cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9056700 1 --2- 172.21.15.37:0/1551466981 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0cc003a60 0x7fb0cc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:58.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9056700 1 --2- 172.21.15.37:0/1551466981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0cc004810 0x7fb0cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:58.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9056700 1 --2- 172.21.15.37:0/1551466981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0cc0051c0 0x7fb0cc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:58.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9056700 1 -- 172.21.15.37:0/1551466981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e40cc2d0 con 0x7fb0cc004810 2023-10-06T02:25:58.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9056700 1 -- 172.21.15.37:0/1551466981 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc00c0d0 con 0x7fb0cc0051c0 2023-10-06T02:25:58.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9056700 1 -- 172.21.15.37:0/1551466981 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc00c290 con 0x7fb0cc003a60 2023-10-06T02:25:58.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9857700 1 --2- 172.21.15.37:0/1551466981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0cc004810 0x7fb0cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:58.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0ea859700 1 --2- 172.21.15.37:0/1551466981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0cc0051c0 0x7fb0cc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:58.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0ea058700 1 --2- 172.21.15.37:0/1551466981 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0cc003a60 0x7fb0cc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:58.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9857700 1 -- 172.21.15.37:0/1551466981 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0cc003a60 msgr2=0x7fb0cc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:58.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9857700 1 --2- 172.21.15.37:0/1551466981 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0cc003a60 0x7fb0cc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9857700 1 -- 172.21.15.37:0/1551466981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0cc0051c0 msgr2=0x7fb0cc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:58.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9857700 1 --2- 172.21.15.37:0/1551466981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0cc0051c0 0x7fb0cc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0e9857700 1 -- 172.21.15.37:0/1551466981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc003570 con 0x7fb0cc004810 2023-10-06T02:25:58.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.410+0000 7fb0ea859700 1 -- 172.21.15.37:0/1551466981 reap_dead start 2023-10-06T02:25:58.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.411+0000 7fb0e9857700 1 --2- 172.21.15.37:0/1551466981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0cc004810 0x7fb0cc004c80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8009c00 tx=0x7fb0d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6f8c41ed070f25 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:58.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.411+0000 7fb0e9056700 1 -- 172.21.15.37:0/1551466981 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d800e710 con 0x7fb0cc004810 2023-10-06T02:25:58.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.411+0000 7fb0e9056700 1 -- 172.21.15.37:0/1551466981 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d800e870 con 0x7fb0cc004810 2023-10-06T02:25:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.411+0000 7fb0e9056700 1 -- 172.21.15.37:0/1551466981 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d800ec30 con 0x7fb0cc004810 2023-10-06T02:25:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.411+0000 7fb0ec2bc700 1 -- 172.21.15.37:0/1551466981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0cc004810 msgr2=0x7fb0cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.411+0000 7fb0ec2bc700 1 --2- 172.21.15.37:0/1551466981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0cc004810 0x7fb0cc004c80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8009c00 tx=0x7fb0d80091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.411+0000 7fb0ec2bc700 1 -- 172.21.15.37:0/1551466981 shutdown_connections 2023-10-06T02:25:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.411+0000 7fb0ec2bc700 1 --2- 172.21.15.37:0/1551466981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0cc004810 0x7fb0cc004c80 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.411+0000 7fb0ec2bc700 1 -- 172.21.15.37:0/1551466981 >> 172.21.15.37:0/1551466981 conn(0x7fb0e406c890 msgr2=0x7fb0e40d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.411+0000 7fb0ec2bc700 1 -- 172.21.15.37:0/1551466981 shutdown_connections 2023-10-06T02:25:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.411+0000 7fb0ec2bc700 1 -- 172.21.15.37:0/1551466981 wait complete. 2023-10-06T02:25:58.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.412+0000 7fb0ec2bc700 1 Processor -- start 2023-10-06T02:25:58.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.412+0000 7fb0ec2bc700 1 -- start start 2023-10-06T02:25:58.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.413+0000 7fb0ec2bc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0cc004810 0x7fb0e4169d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:58.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.413+0000 7fb0ec2bc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0e40b3cb0 0x7fb0e40ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:58.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.413+0000 7fb0ec2bc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0e40cd4a0 0x7fb0e414c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:58.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.413+0000 7fb0ec2bc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e416a280 con 0x7fb0cc004810 2023-10-06T02:25:58.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.413+0000 7fb0ec2bc700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e40cd940 con 0x7fb0e40cd4a0 2023-10-06T02:25:58.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.413+0000 7fb0ec2bc700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e414ec30 con 0x7fb0e40b3cb0 2023-10-06T02:25:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.413+0000 7fb0ea058700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0cc004810 0x7fb0e4169d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.413+0000 7fb0ea058700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0cc004810 0x7fb0e4169d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55986/0 (socket says 172.21.15.37:55986) 2023-10-06T02:25:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.413+0000 7fb0ea058700 1 -- 172.21.15.37:0/1164472688 learned_addr learned my addr 172.21.15.37:0/1164472688 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.413+0000 7fb0ea859700 1 --2- 172.21.15.37:0/1164472688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0e40cd4a0 0x7fb0e414c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.413+0000 7fb0e9857700 1 --2- 172.21.15.37:0/1164472688 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0e40b3cb0 0x7fb0e40ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.414+0000 7fb0ea058700 1 -- 172.21.15.37:0/1164472688 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0e40b3cb0 msgr2=0x7fb0e40ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.414+0000 7fb0ea058700 1 --2- 172.21.15.37:0/1164472688 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0e40b3cb0 0x7fb0e40ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.414+0000 7fb0ea058700 1 -- 172.21.15.37:0/1164472688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0e40cd4a0 msgr2=0x7fb0e414c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.414+0000 7fb0ea058700 1 --2- 172.21.15.37:0/1164472688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0e40cd4a0 0x7fb0e414c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.414+0000 7fb0ea058700 1 -- 172.21.15.37:0/1164472688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e414dd40 con 0x7fb0cc004810 2023-10-06T02:25:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.414+0000 7fb0ea058700 1 --2- 172.21.15.37:0/1164472688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0cc004810 0x7fb0e4169d40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc002980 tx=0x7fb0dc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.414+0000 7fb0e27fc700 1 -- 172.21.15.37:0/1164472688 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc006820 con 0x7fb0cc004810 2023-10-06T02:25:58.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.414+0000 7fb0e27fc700 1 -- 172.21.15.37:0/1164472688 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0dc006980 con 0x7fb0cc004810 2023-10-06T02:25:58.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.414+0000 7fb0ec2bc700 1 -- 172.21.15.37:0/1164472688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e414e020 con 0x7fb0cc004810 2023-10-06T02:25:58.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.414+0000 7fb0e27fc700 1 -- 172.21.15.37:0/1164472688 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc006d40 con 0x7fb0cc004810 2023-10-06T02:25:58.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.414+0000 7fb0ec2bc700 1 -- 172.21.15.37:0/1164472688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e414e5e0 con 0x7fb0cc004810 2023-10-06T02:25:58.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.415+0000 7fb0ec2bc700 1 -- 172.21.15.37:0/1164472688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e406fbf0 con 0x7fb0cc004810 2023-10-06T02:25:58.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.415+0000 7fb0e27fc700 1 -- 172.21.15.37:0/1164472688 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb0dc007230 con 0x7fb0cc004810 2023-10-06T02:25:58.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.416+0000 7fb0e27fc700 1 --2- 172.21.15.37:0/1164472688 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb0d0066f30 0x7fb0d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:58.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.416+0000 7fb0e27fc700 1 -- 172.21.15.37:0/1164472688 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb0dc0844e0 con 0x7fb0cc004810 2023-10-06T02:25:58.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.416+0000 7fb0e9857700 1 --2- 172.21.15.37:0/1164472688 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb0d0066f30 0x7fb0d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:58.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.416+0000 7fb0e9857700 1 --2- 172.21.15.37:0/1164472688 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb0d0066f30 0x7fb0d00693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb0d80091e0 tx=0x7fb0d801a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:58.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.420+0000 7fb0e27fc700 1 -- 172.21.15.37:0/1164472688 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0dc0515f0 con 0x7fb0cc004810 2023-10-06T02:25:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.658+0000 7fb0ec2bc700 1 -- 172.21.15.37:0/1164472688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0e404bb80 con 0x7fb0cc004810 2023-10-06T02:25:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.659+0000 7fb0e27fc700 1 -- 172.21.15.37:0/1164472688 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4604 (secure 0 0 0) 0x7fb0dc054c10 con 0x7fb0cc004810 2023-10-06T02:25:58.660 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:25:58.660 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/1914186828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1914186828},{"type":"v1","addr":"172.21.15.191:6836","nonce":1914186828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3684230798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":3684230798},{"type":"v1","addr":"172.21.15.191:6837","nonce":3684230798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1883185549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1883185549},{"type":"v1","addr":"172.21.15.37:6834","nonce":1883185549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:25:48.166318+0000","modified":"2023-10-06T02:25:51.793825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3956166862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3956166862},{"type":"v1","addr":"172.21.15.37:6835","nonce":3956166862}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:25:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.661+0000 7fb0ec2bc700 1 -- 172.21.15.37:0/1164472688 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb0d0066f30 msgr2=0x7fb0d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.661+0000 7fb0ec2bc700 1 --2- 172.21.15.37:0/1164472688 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb0d0066f30 0x7fb0d00693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb0d80091e0 tx=0x7fb0d801a000 comp rx=0 tx=0).stop 2023-10-06T02:25:58.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.661+0000 7fb0ec2bc700 1 -- 172.21.15.37:0/1164472688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0cc004810 msgr2=0x7fb0e4169d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:58.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.661+0000 7fb0ec2bc700 1 --2- 172.21.15.37:0/1164472688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0cc004810 0x7fb0e4169d40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc002980 tx=0x7fb0dc007d30 comp rx=0 tx=0).stop 2023-10-06T02:25:58.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.661+0000 7fb0ec2bc700 1 -- 172.21.15.37:0/1164472688 shutdown_connections 2023-10-06T02:25:58.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.661+0000 7fb0ec2bc700 1 --2- 172.21.15.37:0/1164472688 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb0d0066f30 0x7fb0d00693e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.661+0000 7fb0ec2bc700 1 --2- 172.21.15.37:0/1164472688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0e40cd4a0 0x7fb0e414c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.661+0000 7fb0ec2bc700 1 --2- 172.21.15.37:0/1164472688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0cc004810 0x7fb0e4169d40 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.661+0000 7fb0ec2bc700 1 --2- 172.21.15.37:0/1164472688 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0e40b3cb0 0x7fb0e40ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:58.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.661+0000 7fb0ec2bc700 1 -- 172.21.15.37:0/1164472688 >> 172.21.15.37:0/1164472688 conn(0x7fb0e406c890 msgr2=0x7fb0e40cf810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:58.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.661+0000 7fb0ec2bc700 1 -- 172.21.15.37:0/1164472688 shutdown_connections 2023-10-06T02:25:58.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:58.661+0000 7fb0ec2bc700 1 -- 172.21.15.37:0/1164472688 wait complete. 2023-10-06T02:25:58.663 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 31 2023-10-06T02:25:59.075 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:25:48.166318+0000', 'modified': '2023-10-06T02:25:51.793825+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5823}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5823': {'gid': 5823, 'name': 'c', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/3956166862', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 3956166862}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 3956166862}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:25:59.076 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:25:59.076 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T02:25:59.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.199+0000 7f11efcf6700 1 Processor -- start 2023-10-06T02:25:59.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.200+0000 7f11efcf6700 1 -- start start 2023-10-06T02:25:59.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.200+0000 7f11efcf6700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f11e80cb080 0x7f11e80b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.200+0000 7f11efcf6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11e806de80 0x7f11e80b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.200+0000 7f11efcf6700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e80cc250 con 0x7f11e806dab0 2023-10-06T02:25:59.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.200+0000 7f11efcf6700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e80cb640 con 0x7f11e80cb080 2023-10-06T02:25:59.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.200+0000 7f11efcf6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80cb920 con 0x7f11e806de80 2023-10-06T02:25:59.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.200+0000 7f11eda92700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f11e806dab0 0x7f11e80cc6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33326/0 (socket says 172.21.15.37:33326) 2023-10-06T02:25:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.200+0000 7f11eda92700 1 -- 172.21.15.37:0/41740558 learned_addr learned my addr 172.21.15.37:0/41740558 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11ed291700 1 --2- 172.21.15.37:0/41740558 >> v2:172.21.15.191:3300/0 conn(0x7f11e80cb080 0x7f11e80b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11eca90700 1 -- 172.21.15.37:0/41740558 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111193652 0 0) 0x7f11e80cc250 con 0x7f11e806dab0 2023-10-06T02:25:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11ee293700 1 --2- 172.21.15.37:0/41740558 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11e806de80 0x7f11e80b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11eca90700 1 -- 172.21.15.37:0/41740558 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11d0003570 con 0x7f11e806dab0 2023-10-06T02:25:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11eca90700 1 -- 172.21.15.37:0/41740558 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3662979155 0 0) 0x7f11d0003570 con 0x7f11e806dab0 2023-10-06T02:25:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11eca90700 1 -- 172.21.15.37:0/41740558 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11e806de80 msgr2=0x7f11e80b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11eca90700 1 --2- 172.21.15.37:0/41740558 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11e806de80 0x7f11e80b06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11eca90700 1 -- 172.21.15.37:0/41740558 >> v2:172.21.15.191:3300/0 conn(0x7f11e80cb080 msgr2=0x7f11e80b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11eca90700 1 --2- 172.21.15.37:0/41740558 >> v2:172.21.15.191:3300/0 conn(0x7f11e80cb080 0x7f11e80b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11eca90700 1 -- 172.21.15.37:0/41740558 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e80cbc00 con 0x7f11e806dab0 2023-10-06T02:25:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11eca90700 1 -- 172.21.15.37:0/41740558 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f11d80017f0 con 0x7f11e806dab0 2023-10-06T02:25:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11eca90700 1 -- 172.21.15.37:0/41740558 >> v1:172.21.15.37:6789/0 conn(0x7f11e806dab0 legacy=0x7f11e80cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11eca90700 1 --2- 172.21.15.37:0/41740558 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11e806de80 0x7f11d0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11eca90700 1 --2- 172.21.15.37:0/41740558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11d0003fe0 0x7f11d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11eca90700 1 --2- 172.21.15.37:0/41740558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11d0004d50 0x7f11d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11eca90700 1 -- 172.21.15.37:0/41740558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80cb640 con 0x7f11d0003fe0 2023-10-06T02:25:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11eca90700 1 -- 172.21.15.37:0/41740558 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80cb920 con 0x7f11d0004d50 2023-10-06T02:25:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11eca90700 1 -- 172.21.15.37:0/41740558 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d000ba90 con 0x7f11e806de80 2023-10-06T02:25:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11ed291700 1 --2- 172.21.15.37:0/41740558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11d0003fe0 0x7f11d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11eda92700 1 --2- 172.21.15.37:0/41740558 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11e806de80 0x7f11d0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11ee293700 1 --2- 172.21.15.37:0/41740558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11d0004d50 0x7f11d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11ed291700 1 -- 172.21.15.37:0/41740558 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11e806de80 msgr2=0x7f11d0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:59.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.201+0000 7f11ed291700 1 --2- 172.21.15.37:0/41740558 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11e806de80 0x7f11d0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.202+0000 7f11ed291700 1 -- 172.21.15.37:0/41740558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11d0004d50 msgr2=0x7f11d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:59.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.202+0000 7f11ed291700 1 --2- 172.21.15.37:0/41740558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11d0004d50 0x7f11d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.202+0000 7f11ed291700 1 -- 172.21.15.37:0/41740558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d0003570 con 0x7f11d0003fe0 2023-10-06T02:25:59.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.202+0000 7f11ed291700 1 --2- 172.21.15.37:0/41740558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11d0003fe0 0x7f11d0004810 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009c00 tx=0x7f11dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0dbee178a85b3a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:59.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.202+0000 7f11eca90700 1 -- 172.21.15.37:0/41740558 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc00e6b0 con 0x7f11d0003fe0 2023-10-06T02:25:59.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.202+0000 7f11eca90700 1 -- 172.21.15.37:0/41740558 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11dc00e810 con 0x7f11d0003fe0 2023-10-06T02:25:59.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.202+0000 7f11eca90700 1 -- 172.21.15.37:0/41740558 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc00ebd0 con 0x7f11d0003fe0 2023-10-06T02:25:59.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.202+0000 7f11efcf6700 1 -- 172.21.15.37:0/41740558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11d0003fe0 msgr2=0x7f11d0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.202+0000 7f11efcf6700 1 --2- 172.21.15.37:0/41740558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11d0003fe0 0x7f11d0004810 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009c00 tx=0x7f11dc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.202+0000 7f11ee293700 1 -- 172.21.15.37:0/41740558 reap_dead start 2023-10-06T02:25:59.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.202+0000 7f11efcf6700 1 -- 172.21.15.37:0/41740558 shutdown_connections 2023-10-06T02:25:59.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.202+0000 7f11efcf6700 1 -- 172.21.15.37:0/41740558 >> 172.21.15.37:0/41740558 conn(0x7f11e80d0510 msgr2=0x7f11e80d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:59.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.202+0000 7f11efcf6700 1 -- 172.21.15.37:0/41740558 shutdown_connections 2023-10-06T02:25:59.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.202+0000 7f11efcf6700 1 -- 172.21.15.37:0/41740558 wait complete. 2023-10-06T02:25:59.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.203+0000 7f11efcf6700 1 Processor -- start 2023-10-06T02:25:59.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.203+0000 7f11efcf6700 1 -- start start 2023-10-06T02:25:59.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.204+0000 7f11efcf6700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11d0003fe0 0x7f11e8150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.204+0000 7f11efcf6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11e814ee80 0x7f11e815c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.204+0000 7f11efcf6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11e815c890 0x7f11e80b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.204+0000 7f11efcf6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e8151170 con 0x7f11e815c890 2023-10-06T02:25:59.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.204+0000 7f11efcf6700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e81507a0 con 0x7f11d0003fe0 2023-10-06T02:25:59.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.204+0000 7f11efcf6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e8152150 con 0x7f11e814ee80 2023-10-06T02:25:59.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.204+0000 7f11ee293700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11e815c890 0x7f11e80b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.204+0000 7f11ee293700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11e815c890 0x7f11e80b4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56002/0 (socket says 172.21.15.37:56002) 2023-10-06T02:25:59.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.204+0000 7f11ee293700 1 -- 172.21.15.37:0/3967966386 learned_addr learned my addr 172.21.15.37:0/3967966386 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:59.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.204+0000 7f11eda92700 1 --2- 172.21.15.37:0/3967966386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11d0003fe0 0x7f11e8150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.204+0000 7f11ed291700 1 --2- 172.21.15.37:0/3967966386 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11e814ee80 0x7f11e815c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.205+0000 7f11ee293700 1 -- 172.21.15.37:0/3967966386 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11e814ee80 msgr2=0x7f11e815c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.205+0000 7f11ee293700 1 --2- 172.21.15.37:0/3967966386 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11e814ee80 0x7f11e815c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.205+0000 7f11ee293700 1 -- 172.21.15.37:0/3967966386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11d0003fe0 msgr2=0x7f11e8150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.205+0000 7f11ee293700 1 --2- 172.21.15.37:0/3967966386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11d0003fe0 0x7f11e8150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.205+0000 7f11ee293700 1 -- 172.21.15.37:0/3967966386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e8152430 con 0x7f11e815c890 2023-10-06T02:25:59.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.205+0000 7f11ee293700 1 --2- 172.21.15.37:0/3967966386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11e815c890 0x7f11e80b4f20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f11e80c7540 tx=0x7f11e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:59.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.205+0000 7f11e5ffb700 1 -- 172.21.15.37:0/3967966386 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e0011ed0 con 0x7f11e815c890 2023-10-06T02:25:59.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.205+0000 7f11e5ffb700 1 -- 172.21.15.37:0/3967966386 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e0015670 con 0x7f11e815c890 2023-10-06T02:25:59.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.205+0000 7f11efcf6700 1 -- 172.21.15.37:0/3967966386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e8150430 con 0x7f11e815c890 2023-10-06T02:25:59.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.205+0000 7f11e5ffb700 1 -- 172.21.15.37:0/3967966386 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e0015a30 con 0x7f11e815c890 2023-10-06T02:25:59.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.205+0000 7f11efcf6700 1 -- 172.21.15.37:0/3967966386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e8151d70 con 0x7f11e815c890 2023-10-06T02:25:59.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.207+0000 7f11e5ffb700 1 -- 172.21.15.37:0/3967966386 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f11e0020460 con 0x7f11e815c890 2023-10-06T02:25:59.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.207+0000 7f11e5ffb700 1 --2- 172.21.15.37:0/3967966386 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f11d4066f30 0x7f11d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.207+0000 7f11e5ffb700 1 -- 172.21.15.37:0/3967966386 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f11e00846f0 con 0x7f11e815c890 2023-10-06T02:25:59.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.208+0000 7f11eda92700 1 --2- 172.21.15.37:0/3967966386 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f11d4066f30 0x7f11d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.208+0000 7f11eda92700 1 --2- 172.21.15.37:0/3967966386 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f11d4066f30 0x7f11d40693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f11d8002250 tx=0x7f11d8001960 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:59.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.209+0000 7f11f8feeb80 1 Processor -- start 2023-10-06T02:25:59.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.209+0000 7f11f8feeb80 1 -- start start 2023-10-06T02:25:59.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.210+0000 7f11f8feeb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dadc73840 0x564dadc73c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.210+0000 7f11f8feeb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564dadc74cc0 0x564dadcc36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.210+0000 7f11f8feeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadcc3c00 0x564dadcc4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.210+0000 7f11f8feeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dadbcaa70 con 0x564dadcc3c00 2023-10-06T02:25:59.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.210+0000 7f11f8feeb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dadbc8270 con 0x564dadc73840 2023-10-06T02:25:59.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.210+0000 7f11f8feeb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x564dadbc4060 con 0x564dadc74cc0 2023-10-06T02:25:59.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.210+0000 7f11ee293700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadcc3c00 0x564dadcc4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.210+0000 7f11ee293700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadcc3c00 0x564dadcc4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56008/0 (socket says 172.21.15.37:56008) 2023-10-06T02:25:59.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.210+0000 7f11ee293700 1 -- 172.21.15.37:0/374677574 learned_addr learned my addr 172.21.15.37:0/374677574 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:59.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.210+0000 7f11eda92700 1 --2- 172.21.15.37:0/374677574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dadc73840 0x564dadc73c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.210+0000 7f11ed291700 1 --2- 172.21.15.37:0/374677574 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564dadc74cc0 0x564dadcc36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.210+0000 7f11ee293700 1 -- 172.21.15.37:0/374677574 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564dadc74cc0 msgr2=0x564dadcc36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:59.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.210+0000 7f11ee293700 1 --2- 172.21.15.37:0/374677574 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564dadc74cc0 0x564dadcc36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.210+0000 7f11ee293700 1 -- 172.21.15.37:0/374677574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dadc73840 msgr2=0x564dadc73c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:59.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.210+0000 7f11ee293700 1 --2- 172.21.15.37:0/374677574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dadc73840 0x564dadc73c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.210+0000 7f11ee293700 1 -- 172.21.15.37:0/374677574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564dada5e270 con 0x564dadcc3c00 2023-10-06T02:25:59.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.210+0000 7f11ed291700 1 --2- 172.21.15.37:0/374677574 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564dadc74cc0 0x564dadcc36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:59.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.210+0000 7f11ee293700 1 --2- 172.21.15.37:0/374677574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadcc3c00 0x564dadcc4050 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f11e0001eb0 tx=0x7f11e0082970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16add3a581b5387 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:59.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.211+0000 7f11ceffd700 1 -- 172.21.15.37:0/374677574 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e0055420 con 0x564dadcc3c00 2023-10-06T02:25:59.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.211+0000 7f11ceffd700 1 -- 172.21.15.37:0/374677574 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e0058670 con 0x564dadcc3c00 2023-10-06T02:25:59.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.211+0000 7f11ceffd700 1 -- 172.21.15.37:0/374677574 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e005c3c0 con 0x564dadcc3c00 2023-10-06T02:25:59.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.211+0000 7f11f8feeb80 1 -- 172.21.15.37:0/374677574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadcc3c00 msgr2=0x564dadcc4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.211+0000 7f11f8feeb80 1 --2- 172.21.15.37:0/374677574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadcc3c00 0x564dadcc4050 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f11e0001eb0 tx=0x7f11e0082970 comp rx=0 tx=0).stop 2023-10-06T02:25:59.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.211+0000 7f11f8feeb80 1 -- 172.21.15.37:0/374677574 shutdown_connections 2023-10-06T02:25:59.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.211+0000 7f11f8feeb80 1 --2- 172.21.15.37:0/374677574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadcc3c00 0x564dadcc4050 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.211+0000 7f11f8feeb80 1 --2- 172.21.15.37:0/374677574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dadc73840 0x564dadc73c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.211+0000 7f11f8feeb80 1 --2- 172.21.15.37:0/374677574 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564dadc74cc0 0x564dadcc36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.211+0000 7f11f8feeb80 1 -- 172.21.15.37:0/374677574 >> 172.21.15.37:0/374677574 conn(0x564dadc75160 msgr2=0x564dadc75530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:59.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.211+0000 7f11f8feeb80 1 -- 172.21.15.37:0/374677574 shutdown_connections 2023-10-06T02:25:59.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.211+0000 7f11f8feeb80 1 -- 172.21.15.37:0/374677574 wait complete. 2023-10-06T02:25:59.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.212+0000 7f11f8feeb80 1 -- start start 2023-10-06T02:25:59.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.212+0000 7f11f8feeb80 1 Processor -- start 2023-10-06T02:25:59.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.213+0000 7f11f8feeb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dadc73840 0x564dadcbc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.213+0000 7f11f8feeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc74cc0 0x564dadcba0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.213+0000 7f11f8feeb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564dadcc3c00 0x564dadcba5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.213+0000 7f11f8feeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dadb6f890 con 0x564dadc74cc0 2023-10-06T02:25:59.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.213+0000 7f11f8feeb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dadb8aea0 con 0x564dadc73840 2023-10-06T02:25:59.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.213+0000 7f11f8feeb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x564dada46e30 con 0x564dadcc3c00 2023-10-06T02:25:59.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.213+0000 7f11f8feeb80 10 client.0 _ll_register_callbacks cb 0x564dadc36e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:25:59.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.213+0000 7f11ed291700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc74cc0 0x564dadcba0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.213+0000 7f11ed291700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc74cc0 0x564dadcba0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56024/0 (socket says 172.21.15.37:56024) 2023-10-06T02:25:59.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.213+0000 7f11ed291700 1 -- 172.21.15.37:0/2670389031 learned_addr learned my addr 172.21.15.37:0/2670389031 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:59.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.213+0000 7f11ee293700 1 --2- 172.21.15.37:0/2670389031 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564dadcc3c00 0x564dadcba5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.213+0000 7f11eda92700 1 --2- 172.21.15.37:0/2670389031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dadc73840 0x564dadcbc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.213+0000 7f11ed291700 1 -- 172.21.15.37:0/2670389031 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564dadcc3c00 msgr2=0x564dadcba5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.213+0000 7f11ed291700 1 --2- 172.21.15.37:0/2670389031 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564dadcc3c00 0x564dadcba5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.213+0000 7f11ed291700 1 -- 172.21.15.37:0/2670389031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dadc73840 msgr2=0x564dadcbc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.213+0000 7f11ed291700 1 --2- 172.21.15.37:0/2670389031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dadc73840 0x564dadcbc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.213+0000 7f11ed291700 1 -- 172.21.15.37:0/2670389031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e8151d70 con 0x564dadc74cc0 2023-10-06T02:25:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.213+0000 7f11eda92700 1 --2- 172.21.15.37:0/2670389031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dadc73840 0x564dadcbc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.213+0000 7f11ed291700 1 --2- 172.21.15.37:0/2670389031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc74cc0 0x564dadcba0a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f11dc016000 tx=0x7f11dc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd703b10b0ad956c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.213+0000 7f11c7fff700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:25:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.214+0000 7f11c7fff700 1 -- 172.21.15.37:0/2670389031 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc022070 con 0x564dadc74cc0 2023-10-06T02:25:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.214+0000 7f11c7fff700 1 -- 172.21.15.37:0/2670389031 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(57..57 src has 1..57) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f11dc013680 con 0x564dadc74cc0 2023-10-06T02:25:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.214+0000 7f11f8feeb80 1 -- 172.21.15.37:0/2670389031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564dadc68940 con 0x564dadc74cc0 2023-10-06T02:25:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.214+0000 7f11c7fff700 1 -- 172.21.15.37:0/2670389031 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11dc006a30 con 0x564dadc74cc0 2023-10-06T02:25:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.214+0000 7f11f8feeb80 10 client.6003 fetch_fsmap learned FSMap version 31 2023-10-06T02:25:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.214+0000 7f11f8feeb80 1 -- 172.21.15.37:0/2670389031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x564dada00fe0 con 0x564dadc74cc0 2023-10-06T02:25:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.214+0000 7f11c7fff700 1 -- 172.21.15.37:0/2670389031 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564dadc68940 con 0x564dadc74cc0 2023-10-06T02:25:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.214+0000 7f11c7fff700 1 -- 172.21.15.37:0/2670389031 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f11dc011070 con 0x564dadc74cc0 2023-10-06T02:25:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.214+0000 7f11f8feeb80 10 client.6003 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T02:25:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.214+0000 7f11f8feeb80 10 client.6003 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:25:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.214+0000 7f11f8feeb80 20 client.6003 populate_metadata read hostname 'smithi037' 2023-10-06T02:25:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.214+0000 7f11f8feeb80 1 --2- 172.21.15.37:0/2670389031 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x564dadcb5f10 0x564dadcb62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.214+0000 7f11f8feeb80 4 client.6003 mds_command: new command op to 5823 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:25:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.214+0000 7f11f8feeb80 1 -- 172.21.15.37:0/2670389031 --> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564dadc45870 con 0x564dadcb5f10 2023-10-06T02:25:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.214+0000 7f11eda92700 1 --2- 172.21.15.37:0/2670389031 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x564dadcb5f10 0x564dadcb62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.215+0000 7f11eda92700 1 --2- 172.21.15.37:0/2670389031 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x564dadcb5f10 0x564dadcb62e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ebd9ee72b212913 server_cookie=ede2b1ad4476a927 in_seq=0 out_seq=0 2023-10-06T02:25:59.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.215+0000 7f11c7fff700 10 client.6003 ms_handle_connect on v2:172.21.15.37:6833/3956166862 2023-10-06T02:25:59.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.215+0000 7f11c7fff700 1 -- 172.21.15.37:0/2670389031 <== mds.0 v2:172.21.15.37:6833/3956166862 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564dadc45870 con 0x564dadcb5f10 2023-10-06T02:25:59.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.215+0000 7f11c7fff700 10 client.6003 handle_command_reply: tid=0 2023-10-06T02:25:59.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.215+0000 7f11f8feeb80 1 client.6003 shutdown 2023-10-06T02:25:59.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.215+0000 7f11f8feeb80 1 -- 172.21.15.37:0/2670389031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc74cc0 msgr2=0x564dadcba0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.215+0000 7f11f8feeb80 1 --2- 172.21.15.37:0/2670389031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc74cc0 0x564dadcba0a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f11dc016000 tx=0x7f11dc01a000 comp rx=0 tx=0).stop 2023-10-06T02:25:59.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.215+0000 7f11f8feeb80 1 -- 172.21.15.37:0/2670389031 shutdown_connections 2023-10-06T02:25:59.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.215+0000 7f11f8feeb80 1 --2- 172.21.15.37:0/2670389031 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x564dadcb5f10 0x564dadcb62e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.215+0000 7f11f8feeb80 1 --2- 172.21.15.37:0/2670389031 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564dadcc3c00 0x564dadcba5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.215+0000 7f11f8feeb80 1 --2- 172.21.15.37:0/2670389031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dadc73840 0x564dadcbc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.215+0000 7f11c7fff700 0 client.6003 ms_handle_reset on v2:172.21.15.37:6833/3956166862 2023-10-06T02:25:59.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.215+0000 7f11f8feeb80 1 --2- 172.21.15.37:0/2670389031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc74cc0 0x564dadcba0a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.215+0000 7f11f8feeb80 1 -- 172.21.15.37:0/2670389031 >> 172.21.15.37:0/2670389031 conn(0x564dadc75160 msgr2=0x564dadc9cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:59.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.215+0000 7f11f8feeb80 1 -- 172.21.15.37:0/2670389031 shutdown_connections 2023-10-06T02:25:59.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.215+0000 7f11f8feeb80 1 -- 172.21.15.37:0/2670389031 wait complete. 2023-10-06T02:25:59.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.216+0000 7f11f8feeb80 20 client.6003 trim_cache size 0 max 16384 2023-10-06T02:25:59.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.232+0000 7f11f8feeb80 1 Processor -- start 2023-10-06T02:25:59.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.232+0000 7f11f8feeb80 1 -- start start 2023-10-06T02:25:59.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.233+0000 7f11f8feeb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564dadc73840 0x564dadcbd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.233+0000 7f11f8feeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc74cc0 0x564dadc9cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.233+0000 7f11f8feeb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dadcc3c00 0x564dadc75530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.233+0000 7f11f8feeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dadc3be00 con 0x564dadc74cc0 2023-10-06T02:25:59.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.233+0000 7f11f8feeb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dadc4c1e0 con 0x564dadcc3c00 2023-10-06T02:25:59.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.233+0000 7f11f8feeb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x564dadcc3ff0 con 0x564dadc73840 2023-10-06T02:25:59.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.233+0000 7f11ed291700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc74cc0 0x564dadc9cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.233+0000 7f11ed291700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc74cc0 0x564dadc9cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56032/0 (socket says 172.21.15.37:56032) 2023-10-06T02:25:59.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.233+0000 7f11ed291700 1 -- 172.21.15.37:0/1382178310 learned_addr learned my addr 172.21.15.37:0/1382178310 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:59.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.233+0000 7f11ed291700 1 -- 172.21.15.37:0/1382178310 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564dadc73840 msgr2=0x564dadcbd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:59.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.233+0000 7f11ed291700 1 --2- 172.21.15.37:0/1382178310 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564dadc73840 0x564dadcbd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.233+0000 7f11ed291700 1 -- 172.21.15.37:0/1382178310 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dadcc3c00 msgr2=0x564dadc75530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:59.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.233+0000 7f11ed291700 1 --2- 172.21.15.37:0/1382178310 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dadcc3c00 0x564dadc75530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.233+0000 7f11ed291700 1 -- 172.21.15.37:0/1382178310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564dadb92780 con 0x564dadc74cc0 2023-10-06T02:25:59.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.234+0000 7f11ed291700 1 --2- 172.21.15.37:0/1382178310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc74cc0 0x564dadc9cde0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f11dc00efc0 tx=0x7f11dc027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1bd1be6664ff9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:59.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.234+0000 7f11cf7fe700 1 -- 172.21.15.37:0/1382178310 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc022040 con 0x564dadc74cc0 2023-10-06T02:25:59.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.234+0000 7f11cf7fe700 1 -- 172.21.15.37:0/1382178310 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11dc023040 con 0x564dadc74cc0 2023-10-06T02:25:59.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.234+0000 7f11cf7fe700 1 -- 172.21.15.37:0/1382178310 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc013d90 con 0x564dadc74cc0 2023-10-06T02:25:59.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.234+0000 7f11f8feeb80 1 -- 172.21.15.37:0/1382178310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc74cc0 msgr2=0x564dadc9cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.234+0000 7f11f8feeb80 1 --2- 172.21.15.37:0/1382178310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc74cc0 0x564dadc9cde0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f11dc00efc0 tx=0x7f11dc027000 comp rx=0 tx=0).stop 2023-10-06T02:25:59.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.234+0000 7f11f8feeb80 1 -- 172.21.15.37:0/1382178310 shutdown_connections 2023-10-06T02:25:59.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.234+0000 7f11f8feeb80 1 --2- 172.21.15.37:0/1382178310 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dadcc3c00 0x564dadc75530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.234+0000 7f11f8feeb80 1 --2- 172.21.15.37:0/1382178310 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564dadc73840 0x564dadcbd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.234+0000 7f11f8feeb80 1 --2- 172.21.15.37:0/1382178310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc74cc0 0x564dadc9cde0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.234+0000 7f11f8feeb80 1 -- 172.21.15.37:0/1382178310 >> 172.21.15.37:0/1382178310 conn(0x564dadc75160 msgr2=0x564dadc6fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:59.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.234+0000 7f11f8feeb80 1 -- 172.21.15.37:0/1382178310 shutdown_connections 2023-10-06T02:25:59.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.234+0000 7f11f8feeb80 1 -- 172.21.15.37:0/1382178310 wait complete. 2023-10-06T02:25:59.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.235+0000 7f11f8feeb80 1 -- start start 2023-10-06T02:25:59.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.235+0000 7f11f8feeb80 1 Processor -- start 2023-10-06T02:25:59.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.236+0000 7f11f8feeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc73840 0x564dadc75530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.236+0000 7f11f8feeb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dadc74cc0 0x564dadc75a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.236+0000 7f11f8feeb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564dadcc3c00 0x564dadcbb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.236+0000 7f11f8feeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dadcbb510 con 0x564dadc73840 2023-10-06T02:25:59.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.236+0000 7f11f8feeb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dadc98070 con 0x564dadc74cc0 2023-10-06T02:25:59.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.236+0000 7f11f8feeb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x564dadd20f00 con 0x564dadcc3c00 2023-10-06T02:25:59.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.236+0000 7f11f8feeb80 10 client.0 _ll_register_callbacks cb 0x564dadc36e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:25:59.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.236+0000 7f11eda92700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc73840 0x564dadc75530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.236+0000 7f11eda92700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc73840 0x564dadc75530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56038/0 (socket says 172.21.15.37:56038) 2023-10-06T02:25:59.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.236+0000 7f11eda92700 1 -- 172.21.15.37:0/4229037971 learned_addr learned my addr 172.21.15.37:0/4229037971 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:59.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.236+0000 7f11ee293700 1 --2- 172.21.15.37:0/4229037971 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564dadcc3c00 0x564dadcbb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.236+0000 7f11eda92700 1 -- 172.21.15.37:0/4229037971 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564dadcc3c00 msgr2=0x564dadcbb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:59.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.236+0000 7f11eda92700 1 --2- 172.21.15.37:0/4229037971 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564dadcc3c00 0x564dadcbb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.236+0000 7f11eda92700 1 -- 172.21.15.37:0/4229037971 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dadc74cc0 msgr2=0x564dadc75a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:59.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.236+0000 7f11eda92700 1 --2- 172.21.15.37:0/4229037971 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dadc74cc0 0x564dadc75a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.236+0000 7f11eda92700 1 -- 172.21.15.37:0/4229037971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564dada00fe0 con 0x564dadc73840 2023-10-06T02:25:59.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.236+0000 7f11eda92700 1 --2- 172.21.15.37:0/4229037971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc73840 0x564dadc75530 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f11d8001350 tx=0x7f11d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64c0210d70ab838 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:59.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.236+0000 7f11c7fff700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:25:59.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.236+0000 7f11c7fff700 1 -- 172.21.15.37:0/4229037971 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d8015e30 con 0x564dadc73840 2023-10-06T02:25:59.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.237+0000 7f11c7fff700 1 -- 172.21.15.37:0/4229037971 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(57..57 src has 1..57) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f11d801a040 con 0x564dadc73840 2023-10-06T02:25:59.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.237+0000 7f11f8feeb80 1 -- 172.21.15.37:0/4229037971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f11e0058670 con 0x564dadc73840 2023-10-06T02:25:59.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.237+0000 7f11c7fff700 1 -- 172.21.15.37:0/4229037971 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11d8023c10 con 0x564dadc73840 2023-10-06T02:25:59.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.237+0000 7f11f8feeb80 10 client.6009 fetch_fsmap learned FSMap version 31 2023-10-06T02:25:59.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.237+0000 7f11f8feeb80 1 -- 172.21.15.37:0/4229037971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x564dadb79470 con 0x564dadc73840 2023-10-06T02:25:59.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.237+0000 7f11c7fff700 1 -- 172.21.15.37:0/4229037971 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e0058670 con 0x564dadc73840 2023-10-06T02:25:59.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.237+0000 7f11c7fff700 1 -- 172.21.15.37:0/4229037971 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f11d8022410 con 0x564dadc73840 2023-10-06T02:25:59.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.237+0000 7f11f8feeb80 10 client.6009 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T02:25:59.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.237+0000 7f11f8feeb80 10 client.6009 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:25:59.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.237+0000 7f11f8feeb80 20 client.6009 populate_metadata read hostname 'smithi037' 2023-10-06T02:25:59.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.237+0000 7f11f8feeb80 1 --2- 172.21.15.37:0/4229037971 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x564dadcbbe70 0x564dadcb0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.237+0000 7f11f8feeb80 4 client.6009 mds_command: new command op to 5823 tid=0[{"prefix": "status"}] 2023-10-06T02:25:59.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.237+0000 7f11f8feeb80 1 -- 172.21.15.37:0/4229037971 --> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564dadb66e00 con 0x564dadcbbe70 2023-10-06T02:25:59.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.237+0000 7f11ed291700 1 --2- 172.21.15.37:0/4229037971 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x564dadcbbe70 0x564dadcb0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.237+0000 7f11ed291700 1 --2- 172.21.15.37:0/4229037971 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x564dadcbbe70 0x564dadcb0350 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f2bf43540acbc10 server_cookie=9ee56ee6d614b24e in_seq=0 out_seq=0 2023-10-06T02:25:59.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.237+0000 7f11c7fff700 10 client.6009 ms_handle_connect on v2:172.21.15.37:6833/3956166862 2023-10-06T02:25:59.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.238+0000 7f11c7fff700 1 -- 172.21.15.37:0/4229037971 <== mds.0 v2:172.21.15.37:6833/3956166862 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x564dadb66e00 con 0x564dadcbbe70 2023-10-06T02:25:59.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.238+0000 7f11c7fff700 10 client.6009 handle_command_reply: tid=0 2023-10-06T02:25:59.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.238+0000 7f11f8feeb80 1 client.6009 shutdown 2023-10-06T02:25:59.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.238+0000 7f11f8feeb80 1 -- 172.21.15.37:0/4229037971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc73840 msgr2=0x564dadc75530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.238+0000 7f11f8feeb80 1 --2- 172.21.15.37:0/4229037971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc73840 0x564dadc75530 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f11d8001350 tx=0x7f11d8017000 comp rx=0 tx=0).stop 2023-10-06T02:25:59.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.238+0000 7f11f8feeb80 1 -- 172.21.15.37:0/4229037971 shutdown_connections 2023-10-06T02:25:59.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.238+0000 7f11f8feeb80 1 --2- 172.21.15.37:0/4229037971 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x564dadcbbe70 0x564dadcb0350 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.238+0000 7f11f8feeb80 1 --2- 172.21.15.37:0/4229037971 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564dadcc3c00 0x564dadcbb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.238+0000 7f11c7fff700 0 client.6009 ms_handle_reset on v2:172.21.15.37:6833/3956166862 2023-10-06T02:25:59.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.238+0000 7f11f8feeb80 1 --2- 172.21.15.37:0/4229037971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564dadc73840 0x564dadc75530 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.238+0000 7f11f8feeb80 1 --2- 172.21.15.37:0/4229037971 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564dadc74cc0 0x564dadc75a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.238+0000 7f11f8feeb80 1 -- 172.21.15.37:0/4229037971 >> 172.21.15.37:0/4229037971 conn(0x564dadc75160 msgr2=0x564dadc6fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:59.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.238+0000 7f11f8feeb80 1 -- 172.21.15.37:0/4229037971 shutdown_connections 2023-10-06T02:25:59.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.238+0000 7f11f8feeb80 1 -- 172.21.15.37:0/4229037971 wait complete. 2023-10-06T02:25:59.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.238+0000 7f11f8feeb80 20 client.6009 trim_cache size 0 max 16384 2023-10-06T02:25:59.246 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:25:59.246 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "d1f292a2-fd8c-430a-be88-f44de408e77c", 2023-10-06T02:25:59.246 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-10-06T02:25:59.246 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5823, 2023-10-06T02:25:59.246 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-10-06T02:25:59.246 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-10-06T02:25:59.246 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-10-06T02:25:59.246 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 10.455545975, 2023-10-06T02:25:59.246 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 31, 2023-10-06T02:25:59.247 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 57, 2023-10-06T02:25:59.247 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 57, 2023-10-06T02:25:59.247 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 16.537250920000002 2023-10-06T02:25:59.247 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:25:59.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.238+0000 7f11efcf6700 1 -- 172.21.15.37:0/3967966386 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f11d4066f30 msgr2=0x7f11d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.238+0000 7f11efcf6700 1 --2- 172.21.15.37:0/3967966386 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f11d4066f30 0x7f11d40693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f11d8002250 tx=0x7f11d8001960 comp rx=0 tx=0).stop 2023-10-06T02:25:59.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.238+0000 7f11efcf6700 1 -- 172.21.15.37:0/3967966386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11e815c890 msgr2=0x7f11e80b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.238+0000 7f11efcf6700 1 --2- 172.21.15.37:0/3967966386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11e815c890 0x7f11e80b4f20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f11e80c7540 tx=0x7f11e0008040 comp rx=0 tx=0).stop 2023-10-06T02:25:59.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.239+0000 7f11efcf6700 1 -- 172.21.15.37:0/3967966386 shutdown_connections 2023-10-06T02:25:59.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.239+0000 7f11efcf6700 1 --2- 172.21.15.37:0/3967966386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11e815c890 0x7f11e80b4f20 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.239+0000 7f11efcf6700 1 --2- 172.21.15.37:0/3967966386 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f11d4066f30 0x7f11d40693e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.239+0000 7f11efcf6700 1 --2- 172.21.15.37:0/3967966386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11d0003fe0 0x7f11e8150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.239+0000 7f11efcf6700 1 --2- 172.21.15.37:0/3967966386 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11e814ee80 0x7f11e815c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.239+0000 7f11efcf6700 1 -- 172.21.15.37:0/3967966386 >> 172.21.15.37:0/3967966386 conn(0x7f11e80d0510 msgr2=0x7f11e80c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:59.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.239+0000 7f11efcf6700 1 -- 172.21.15.37:0/3967966386 shutdown_connections 2023-10-06T02:25:59.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.239+0000 7f11efcf6700 1 -- 172.21.15.37:0/3967966386 wait complete. 2023-10-06T02:25:59.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:25:59.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.369+0000 7f3addd6e700 1 Processor -- start 2023-10-06T02:25:59.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.369+0000 7f3addd6e700 1 -- start start 2023-10-06T02:25:59.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.370+0000 7f3addd6e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3ad80b2270 0x7f3ad8159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.370+0000 7f3addd6e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad80cb200 con 0x7f3ad8159370 2023-10-06T02:25:59.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.370+0000 7f3addd6e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad80cb7c0 con 0x7f3ad80b0620 2023-10-06T02:25:59.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.370+0000 7f3addd6e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad80b5c00 con 0x7f3ad80b2270 2023-10-06T02:25:59.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.370+0000 7f3add56d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3ad80b2270 0x7f3ad8159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.370+0000 7f3adcd6c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3ad8159370 0x7f3ad80aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33338/0 (socket says 172.21.15.37:33338) 2023-10-06T02:25:59.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.370+0000 7f3adcd6c700 1 -- 172.21.15.37:0/3332005162 learned_addr learned my addr 172.21.15.37:0/3332005162 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:25:59.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.370+0000 7f3ad77fe700 1 -- 172.21.15.37:0/3332005162 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193688892 0 0) 0x7f3ad80cb200 con 0x7f3ad8159370 2023-10-06T02:25:59.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.370+0000 7f3ad77fe700 1 -- 172.21.15.37:0/3332005162 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ac0003570 con 0x7f3ad8159370 2023-10-06T02:25:59.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.370+0000 7f3add56d700 1 -- 172.21.15.37:0/3332005162 >> v1:172.21.15.191:6789/0 conn(0x7f3ad80b0620 legacy=0x7f3ad80cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:25:59.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.370+0000 7f3add56d700 1 -- 172.21.15.37:0/3332005162 >> v1:172.21.15.37:6789/0 conn(0x7f3ad8159370 legacy=0x7f3ad80aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.370+0000 7f3add56d700 1 -- 172.21.15.37:0/3332005162 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad80b2750 con 0x7f3ad80b2270 2023-10-06T02:25:59.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.371+0000 7f3add56d700 1 --2- 172.21.15.37:0/3332005162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ad80b2270 0x7f3ad8159740 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009e60 tx=0x7f3ad0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38da6cc034caaec3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:59.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.371+0000 7f3ad77fe700 1 -- 172.21.15.37:0/3332005162 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad000e070 con 0x7f3ad80b2270 2023-10-06T02:25:59.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.371+0000 7f3ad77fe700 1 -- 172.21.15.37:0/3332005162 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad000bb20 con 0x7f3ad80b2270 2023-10-06T02:25:59.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.371+0000 7f3ad77fe700 1 -- 172.21.15.37:0/3332005162 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0012430 con 0x7f3ad80b2270 2023-10-06T02:25:59.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.371+0000 7f3addd6e700 1 -- 172.21.15.37:0/3332005162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ad80b2270 msgr2=0x7f3ad8159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.371+0000 7f3addd6e700 1 --2- 172.21.15.37:0/3332005162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ad80b2270 0x7f3ad8159740 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009e60 tx=0x7f3ad0009780 comp rx=0 tx=0).stop 2023-10-06T02:25:59.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.371+0000 7f3addd6e700 1 -- 172.21.15.37:0/3332005162 shutdown_connections 2023-10-06T02:25:59.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.371+0000 7f3addd6e700 1 --2- 172.21.15.37:0/3332005162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ad80b2270 0x7f3ad8159740 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.371+0000 7f3addd6e700 1 -- 172.21.15.37:0/3332005162 >> 172.21.15.37:0/3332005162 conn(0x7f3ad806c0b0 msgr2=0x7f3ad806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:59.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.371+0000 7f3addd6e700 1 -- 172.21.15.37:0/3332005162 shutdown_connections 2023-10-06T02:25:59.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.371+0000 7f3addd6e700 1 -- 172.21.15.37:0/3332005162 wait complete. 2023-10-06T02:25:59.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.372+0000 7f3addd6e700 1 Processor -- start 2023-10-06T02:25:59.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.373+0000 7f3addd6e700 1 -- start start 2023-10-06T02:25:59.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.373+0000 7f3addd6e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3ad80b0620 0x7f3ad814c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.373+0000 7f3addd6e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ad80b2270 0x7f3ad80b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.373+0000 7f3addd6e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ad8159370 0x7f3ad80b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.373+0000 7f3addd6e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad80b3180 con 0x7f3ad80b2270 2023-10-06T02:25:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.373+0000 7f3addd6e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad80b46f0 con 0x7f3ad8159370 2023-10-06T02:25:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.373+0000 7f3addd6e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad80b33f0 con 0x7f3ad80b0620 2023-10-06T02:25:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.373+0000 7f3ad7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ad80b2270 0x7f3ad80b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.373+0000 7f3ad7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ad80b2270 0x7f3ad80b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56048/0 (socket says 172.21.15.37:56048) 2023-10-06T02:25:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.373+0000 7f3ad7fff700 1 -- 172.21.15.37:0/2599139846 learned_addr learned my addr 172.21.15.37:0/2599139846 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:25:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.374+0000 7f3adcd6c700 1 --2- 172.21.15.37:0/2599139846 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3ad80b0620 0x7f3ad814c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.374+0000 7f3add56d700 1 --2- 172.21.15.37:0/2599139846 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ad8159370 0x7f3ad80b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.374+0000 7f3ad7fff700 1 -- 172.21.15.37:0/2599139846 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3ad80b0620 msgr2=0x7f3ad814c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.374+0000 7f3ad7fff700 1 --2- 172.21.15.37:0/2599139846 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3ad80b0620 0x7f3ad814c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.374+0000 7f3ad7fff700 1 -- 172.21.15.37:0/2599139846 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ad8159370 msgr2=0x7f3ad80b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.374+0000 7f3ad7fff700 1 --2- 172.21.15.37:0/2599139846 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ad8159370 0x7f3ad80b4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.374+0000 7f3ad7fff700 1 -- 172.21.15.37:0/2599139846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad0009a20 con 0x7f3ad80b2270 2023-10-06T02:25:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.374+0000 7f3adcd6c700 1 --2- 172.21.15.37:0/2599139846 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3ad80b0620 0x7f3ad814c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:25:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.374+0000 7f3ad7fff700 1 --2- 172.21.15.37:0/2599139846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ad80b2270 0x7f3ad80b41b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3acc00c5d0 tx=0x7f3acc007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.374+0000 7f3ad4ff9700 1 -- 172.21.15.37:0/2599139846 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc011590 con 0x7f3ad80b2270 2023-10-06T02:25:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.374+0000 7f3ad4ff9700 1 -- 172.21.15.37:0/2599139846 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc011710 con 0x7f3ad80b2270 2023-10-06T02:25:59.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.374+0000 7f3addd6e700 1 -- 172.21.15.37:0/2599139846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad80b36d0 con 0x7f3ad80b2270 2023-10-06T02:25:59.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.374+0000 7f3ad4ff9700 1 -- 172.21.15.37:0/2599139846 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc011ad0 con 0x7f3ad80b2270 2023-10-06T02:25:59.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.374+0000 7f3addd6e700 1 -- 172.21.15.37:0/2599139846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad80b3c90 con 0x7f3ad80b2270 2023-10-06T02:25:59.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.375+0000 7f3addd6e700 1 -- 172.21.15.37:0/2599139846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad80b3530 con 0x7f3ad80b2270 2023-10-06T02:25:59.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.376+0000 7f3ad4ff9700 1 -- 172.21.15.37:0/2599139846 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3acc01c460 con 0x7f3ad80b2270 2023-10-06T02:25:59.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.376+0000 7f3ad4ff9700 1 --2- 172.21.15.37:0/2599139846 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3ac4066f30 0x7f3ac40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:25:59.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.376+0000 7f3ad4ff9700 1 -- 172.21.15.37:0/2599139846 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3acc084490 con 0x7f3ad80b2270 2023-10-06T02:25:59.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.376+0000 7f3adcd6c700 1 --2- 172.21.15.37:0/2599139846 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3ac4066f30 0x7f3ac40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:25:59.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.377+0000 7f3adcd6c700 1 --2- 172.21.15.37:0/2599139846 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3ac4066f30 0x7f3ac40693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8155870 tx=0x7f3ac8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:25:59.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.380+0000 7f3ad4ff9700 1 -- 172.21.15.37:0/2599139846 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ad80b3530 con 0x7f3ad80b2270 2023-10-06T02:25:59.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.619+0000 7f3addd6e700 1 -- 172.21.15.37:0/2599139846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3ad80b3530 con 0x7f3ad80b2270 2023-10-06T02:25:59.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.619+0000 7f3ad4ff9700 1 -- 172.21.15.37:0/2599139846 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3ad80b3530 con 0x7f3ad80b2270 2023-10-06T02:25:59.620 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:25:59.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.621+0000 7f3addd6e700 1 -- 172.21.15.37:0/2599139846 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3ac4066f30 msgr2=0x7f3ac40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.621+0000 7f3addd6e700 1 --2- 172.21.15.37:0/2599139846 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3ac4066f30 0x7f3ac40693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8155870 tx=0x7f3ac8009040 comp rx=0 tx=0).stop 2023-10-06T02:25:59.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.621+0000 7f3addd6e700 1 -- 172.21.15.37:0/2599139846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ad80b2270 msgr2=0x7f3ad80b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:25:59.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.621+0000 7f3addd6e700 1 --2- 172.21.15.37:0/2599139846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ad80b2270 0x7f3ad80b41b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3acc00c5d0 tx=0x7f3acc007f60 comp rx=0 tx=0).stop 2023-10-06T02:25:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.621+0000 7f3addd6e700 1 -- 172.21.15.37:0/2599139846 shutdown_connections 2023-10-06T02:25:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.621+0000 7f3addd6e700 1 --2- 172.21.15.37:0/2599139846 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3ac4066f30 0x7f3ac40693e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.621+0000 7f3addd6e700 1 --2- 172.21.15.37:0/2599139846 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ad8159370 0x7f3ad80b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.621+0000 7f3addd6e700 1 --2- 172.21.15.37:0/2599139846 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3ad80b0620 0x7f3ad814c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.621+0000 7f3addd6e700 1 --2- 172.21.15.37:0/2599139846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ad80b2270 0x7f3ad80b41b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:25:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.621+0000 7f3addd6e700 1 -- 172.21.15.37:0/2599139846 >> 172.21.15.37:0/2599139846 conn(0x7f3ad806c0b0 msgr2=0x7f3ad814e820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:25:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.621+0000 7f3addd6e700 1 -- 172.21.15.37:0/2599139846 shutdown_connections 2023-10-06T02:25:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:25:59.621+0000 7f3addd6e700 1 -- 172.21.15.37:0/2599139846 wait complete. 2023-10-06T02:25:59.634 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:25:59.634 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:25:59.634 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-10-06T02:25:59.634 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:25:59.635 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:25:59.635 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:25:59.635 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:25:59.635 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:25:59.635 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:25:59.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:59.635 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-10-06T02:25:59.652 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:25:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:25:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:25:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T02:25:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:59.653 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:25:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:25:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-10-06T02:25:59.653 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:25:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:25:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-10-06T02:25:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:25:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42322sec preferred_lft 42322sec 2023-10-06T02:25:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-10-06T02:25:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:59.654 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:25:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:25:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-10-06T02:25:59.655 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:25:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:25:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-10-06T02:25:59.655 INFO:teuthology.orchestra.run.smithi037.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:25:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 26:84:4a:aa:8b:b5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:25:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:25:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::a0fb:38ff:fe90:57e1/64 scope link 2023-10-06T02:25:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:59.656 INFO:teuthology.orchestra.run.smithi037.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:25:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 36:fb:a9:50:59:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:25:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::34fb:a9ff:fe50:5976/64 scope link 2023-10-06T02:25:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:59.657 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:25:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 26:84:4a:aa:8b:b5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:25:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::2484:4aff:feaa:8bb5/64 scope link 2023-10-06T02:25:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:25:59.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:59.658 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:25:59.716 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T02:25:59.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:59.717 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-10-06T02:25:59.773 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-10-06T02:25:59.773 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:25:59.773 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:25:59.773 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:25:59.773 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:25:59.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:59.774 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T02:25:59.774 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T02:25:59.774 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:25:59.774 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:25:59.774 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:25:59.774 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T02:25:59.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:59.875 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T02:25:59.889 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:25:59.890 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:25:59.890 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:25:59.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:25:59.890 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-10-06T02:25:59.955 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:25:59.955 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:25:59.955 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:00.010 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:26:00.010 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:26:00.010 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:00.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T02:26:00.130 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:26:00.131 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:26:00.195 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:26:00.196 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:26:00.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:26:00.197 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T02:26:00.252 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:26:00.252 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:26:00.294 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T02:26:00.319 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:26:00.319 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:26:00.377 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-10-06T02:26:00.377+0000 7f03d63ce540 -1 init, newargv = 0x55f13cb73cd0 newargc=15 2023-10-06T02:26:00.377 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[109647]: starting ceph client 2023-10-06T02:26:00.382 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[109647]: starting fuse 2023-10-06T02:26:00.385 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:26:00.386 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:26:00.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:26:00.386 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T02:26:00.442 INFO:teuthology.orchestra.run.smithi037.stdout:46 2023-10-06T02:26:00.442 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T02:26:00.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:26:00.443 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-10-06T02:26:00.443 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-10-06T02:26:00.443 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:26:00.443 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-10-06T02:26:00.443 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:26:00.443 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-10-06T02:26:00.443 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:26:00.443 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-10-06T02:26:00.443 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:26:00.444 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:26:00.444 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-10-06T02:26:00.444 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-10-06T02:26:00.444 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-10-06T02:26:00.444 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-10-06T02:26:00.444 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:26:00.444 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-10-06T02:26:00.444 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:26:00.444 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:26:00.444 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:26:00.444 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-10-06T02:26:00.445 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-10-06T02:26:00.445 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-10-06T02:26:00.445 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:26:00.445 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:26:00.445 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-10-06T02:26:00.445 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:26:00.564 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.109647.asok 2023-10-06T02:26:00.746 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.109647.asok 2023-10-06T02:26:00.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:26:00.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.109647.asok status 2023-10-06T02:26:00.900 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:26:00.901 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-10-06T02:26:00.901 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:26:00.901 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:26:00.901 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-10-06T02:26:00.901 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-10-06T02:26:00.901 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:26:00.901 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "109647", 2023-10-06T02:26:00.901 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-10-06T02:26:00.902 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:26:00.902 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-10-06T02:26:00.902 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-10-06T02:26:00.902 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6024, 2023-10-06T02:26:00.902 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-10-06T02:26:00.902 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-10-06T02:26:00.902 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-10-06T02:26:00.902 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 6024 2023-10-06T02:26:00.902 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:26:00.902 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T02:26:00.902 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T02:26:00.902 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:26:00.903 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 58035226 2023-10-06T02:26:00.903 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:26:00.903 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:26:00.903 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T02:26:00.903 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T02:26:00.903 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:26:00.903 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 58035226 2023-10-06T02:26:00.903 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:26:00.903 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.6024 192.168.0.1:0/58035226", 2023-10-06T02:26:00.903 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/58035226", 2023-10-06T02:26:00.903 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-10-06T02:26:00.903 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 31, 2023-10-06T02:26:00.904 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 57, 2023-10-06T02:26:00.904 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:26:00.904 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-10-06T02:26:00.904 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-10-06T02:26:00.904 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:26:00.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:26:00.911 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-10-06T02:26:00.911 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:00.926 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-10-06T02:26:00.926 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:00.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:26:00.927 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:00.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:26:00.992 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file1_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2023-10-06T02:26:01.121 INFO:teuthology.orchestra.run.smithi037.stderr:6+0 records in 2023-10-06T02:26:01.121 INFO:teuthology.orchestra.run.smithi037.stderr:6+0 records out 2023-10-06T02:26:01.122 INFO:teuthology.orchestra.run.smithi037.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0688424 s, 91.4 MB/s 2023-10-06T02:26:01.122 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-10-06T02:26:01.122 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:26:01.122 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:01.159 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[109647]: fuse finished with error 0 and tester_r 0 2023-10-06T02:26:01.161 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:26:07.263 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:26:07.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:07.263 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:26:07.282 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:07.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.455+0000 7fbf92a63700 1 Processor -- start 2023-10-06T02:26:07.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.456+0000 7fbf92a63700 1 -- start start 2023-10-06T02:26:07.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.456+0000 7fbf92a63700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf8c155e50 0x7fbf8c159800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.456+0000 7fbf92a63700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf8c159d40 0x7fbf8c06ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.456+0000 7fbf92a63700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8c0aa740 con 0x7fbf8c155a80 2023-10-06T02:26:07.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.456+0000 7fbf92a63700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8c15a2c0 con 0x7fbf8c155e50 2023-10-06T02:26:07.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.456+0000 7fbf92a63700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c15a5a0 con 0x7fbf8c159d40 2023-10-06T02:26:07.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.457+0000 7fbf91000700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf8c159d40 0x7fbf8c06ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.457+0000 7fbf8b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf8c155e50 0x7fbf8c159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.457+0000 7fbf91000700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf8c159d40 0x7fbf8c06ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:51472/0 (socket says 172.21.15.37:51472) 2023-10-06T02:26:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.457+0000 7fbf91000700 1 -- 172.21.15.37:0/310409653 learned_addr learned my addr 172.21.15.37:0/310409653 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.457+0000 7fbf8b7fe700 1 -- 172.21.15.37:0/310409653 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf8c159d40 msgr2=0x7fbf8c06ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.457+0000 7fbf8b7fe700 1 --2- 172.21.15.37:0/310409653 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf8c159d40 0x7fbf8c06ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.457+0000 7fbf8b7fe700 1 -- 172.21.15.37:0/310409653 >> v1:172.21.15.37:6789/0 conn(0x7fbf8c155a80 legacy=0x7fbf8c0ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.457+0000 7fbf8affd700 1 -- 172.21.15.37:0/310409653 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267102854 0 0) 0x7fbf8c0aa740 con 0x7fbf8c155a80 2023-10-06T02:26:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.457+0000 7fbf8b7fe700 1 -- 172.21.15.37:0/310409653 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c0aa990 con 0x7fbf8c155e50 2023-10-06T02:26:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.458+0000 7fbf8b7fe700 1 --2- 172.21.15.37:0/310409653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf8c155e50 0x7fbf8c159800 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fbf740098e0 tx=0x7fbf740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1368d6a942271f0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.458+0000 7fbf8affd700 1 -- 172.21.15.37:0/310409653 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7400b640 con 0x7fbf8c155e50 2023-10-06T02:26:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.458+0000 7fbf8affd700 1 -- 172.21.15.37:0/310409653 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7400b7a0 con 0x7fbf8c155e50 2023-10-06T02:26:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.458+0000 7fbf8affd700 1 -- 172.21.15.37:0/310409653 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7400bb40 con 0x7fbf8c155e50 2023-10-06T02:26:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.458+0000 7fbf92a63700 1 -- 172.21.15.37:0/310409653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf8c155e50 msgr2=0x7fbf8c159800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.458+0000 7fbf92a63700 1 --2- 172.21.15.37:0/310409653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf8c155e50 0x7fbf8c159800 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fbf740098e0 tx=0x7fbf740091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.458+0000 7fbf92a63700 1 -- 172.21.15.37:0/310409653 shutdown_connections 2023-10-06T02:26:07.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.458+0000 7fbf92a63700 1 --2- 172.21.15.37:0/310409653 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf8c159d40 0x7fbf8c06ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.458+0000 7fbf92a63700 1 --2- 172.21.15.37:0/310409653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf8c155e50 0x7fbf8c159800 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.458+0000 7fbf92a63700 1 -- 172.21.15.37:0/310409653 >> 172.21.15.37:0/310409653 conn(0x7fbf8c0cc120 msgr2=0x7fbf8c0cc520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:07.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.458+0000 7fbf92a63700 1 -- 172.21.15.37:0/310409653 shutdown_connections 2023-10-06T02:26:07.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.458+0000 7fbf92a63700 1 -- 172.21.15.37:0/310409653 wait complete. 2023-10-06T02:26:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.460+0000 7fbf92a63700 1 Processor -- start 2023-10-06T02:26:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.460+0000 7fbf92a63700 1 -- start start 2023-10-06T02:26:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.460+0000 7fbf92a63700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf8c155a80 0x7fbf8c16a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.460+0000 7fbf92a63700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf8c155e50 0x7fbf8c14b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.461+0000 7fbf92a63700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf8c159d40 0x7fbf8c167390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.461+0000 7fbf92a63700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c14cd50 con 0x7fbf8c155a80 2023-10-06T02:26:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.461+0000 7fbf92a63700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c14b700 con 0x7fbf8c159d40 2023-10-06T02:26:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.461+0000 7fbf92a63700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c16a7a0 con 0x7fbf8c155e50 2023-10-06T02:26:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.461+0000 7fbf8bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf8c155a80 0x7fbf8c16a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.461+0000 7fbf8bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf8c155a80 0x7fbf8c16a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35618/0 (socket says 172.21.15.37:35618) 2023-10-06T02:26:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.461+0000 7fbf8bfff700 1 -- 172.21.15.37:0/192171555 learned_addr learned my addr 172.21.15.37:0/192171555 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.461+0000 7fbf8b7fe700 1 --2- 172.21.15.37:0/192171555 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf8c155e50 0x7fbf8c14b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.461+0000 7fbf91000700 1 --2- 172.21.15.37:0/192171555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf8c159d40 0x7fbf8c167390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.461+0000 7fbf8bfff700 1 -- 172.21.15.37:0/192171555 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf8c155e50 msgr2=0x7fbf8c14b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.461+0000 7fbf8bfff700 1 --2- 172.21.15.37:0/192171555 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf8c155e50 0x7fbf8c14b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.461+0000 7fbf8bfff700 1 -- 172.21.15.37:0/192171555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf8c159d40 msgr2=0x7fbf8c167390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.461+0000 7fbf8bfff700 1 --2- 172.21.15.37:0/192171555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf8c159d40 0x7fbf8c167390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.461+0000 7fbf8bfff700 1 -- 172.21.15.37:0/192171555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf74009420 con 0x7fbf8c155a80 2023-10-06T02:26:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.461+0000 7fbf8bfff700 1 --2- 172.21.15.37:0/192171555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf8c155a80 0x7fbf8c16a260 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00c7e0 tx=0x7fbf7c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.461+0000 7fbf83fff700 1 -- 172.21.15.37:0/192171555 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c0105c0 con 0x7fbf8c155a80 2023-10-06T02:26:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.461+0000 7fbf83fff700 1 -- 172.21.15.37:0/192171555 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7c010740 con 0x7fbf8c155a80 2023-10-06T02:26:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.461+0000 7fbf92a63700 1 -- 172.21.15.37:0/192171555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8c14c150 con 0x7fbf8c155a80 2023-10-06T02:26:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.461+0000 7fbf83fff700 1 -- 172.21.15.37:0/192171555 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c010b00 con 0x7fbf8c155a80 2023-10-06T02:26:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.461+0000 7fbf92a63700 1 -- 172.21.15.37:0/192171555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8c14c710 con 0x7fbf8c155a80 2023-10-06T02:26:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.462+0000 7fbf92a63700 1 -- 172.21.15.37:0/192171555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8c0689b0 con 0x7fbf8c155a80 2023-10-06T02:26:07.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.463+0000 7fbf83fff700 1 -- 172.21.15.37:0/192171555 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf7c01b3b0 con 0x7fbf8c155a80 2023-10-06T02:26:07.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.463+0000 7fbf83fff700 1 --2- 172.21.15.37:0/192171555 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbf6c066f30 0x7fbf6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.463+0000 7fbf83fff700 1 -- 172.21.15.37:0/192171555 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fbf7c083cb0 con 0x7fbf8c155a80 2023-10-06T02:26:07.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.463+0000 7fbf8b7fe700 1 --2- 172.21.15.37:0/192171555 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbf6c066f30 0x7fbf6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.464+0000 7fbf8b7fe700 1 --2- 172.21.15.37:0/192171555 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbf6c066f30 0x7fbf6c0693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbf740091e0 tx=0x7fbf74017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:07.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.468+0000 7fbf83fff700 1 -- 172.21.15.37:0/192171555 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf7c050d50 con 0x7fbf8c155a80 2023-10-06T02:26:07.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.704+0000 7fbf92a63700 1 -- 172.21.15.37:0/192171555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf8c04bb80 con 0x7fbf8c155a80 2023-10-06T02:26:07.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.705+0000 7fbf83fff700 1 -- 172.21.15.37:0/192171555 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4604 (secure 0 0 0) 0x7fbf7c017070 con 0x7fbf8c155a80 2023-10-06T02:26:07.705 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:26:07.705 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/1914186828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1914186828},{"type":"v1","addr":"172.21.15.191:6836","nonce":1914186828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3684230798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":3684230798},{"type":"v1","addr":"172.21.15.191:6837","nonce":3684230798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1883185549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1883185549},{"type":"v1","addr":"172.21.15.37:6834","nonce":1883185549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:25:48.166318+0000","modified":"2023-10-06T02:25:51.793825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3956166862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3956166862},{"type":"v1","addr":"172.21.15.37:6835","nonce":3956166862}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:26:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.707+0000 7fbf92a63700 1 -- 172.21.15.37:0/192171555 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbf6c066f30 msgr2=0x7fbf6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.707+0000 7fbf92a63700 1 --2- 172.21.15.37:0/192171555 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbf6c066f30 0x7fbf6c0693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbf740091e0 tx=0x7fbf74017000 comp rx=0 tx=0).stop 2023-10-06T02:26:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.707+0000 7fbf92a63700 1 -- 172.21.15.37:0/192171555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf8c155a80 msgr2=0x7fbf8c16a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:07.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.707+0000 7fbf92a63700 1 --2- 172.21.15.37:0/192171555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf8c155a80 0x7fbf8c16a260 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00c7e0 tx=0x7fbf7c007df0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.707+0000 7fbf92a63700 1 -- 172.21.15.37:0/192171555 shutdown_connections 2023-10-06T02:26:07.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.707+0000 7fbf92a63700 1 --2- 172.21.15.37:0/192171555 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbf6c066f30 0x7fbf6c0693e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.707+0000 7fbf92a63700 1 --2- 172.21.15.37:0/192171555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf8c159d40 0x7fbf8c167390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.707+0000 7fbf92a63700 1 --2- 172.21.15.37:0/192171555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf8c155a80 0x7fbf8c16a260 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.707+0000 7fbf92a63700 1 --2- 172.21.15.37:0/192171555 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf8c155e50 0x7fbf8c14b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.707+0000 7fbf92a63700 1 -- 172.21.15.37:0/192171555 >> 172.21.15.37:0/192171555 conn(0x7fbf8c0cc120 msgr2=0x7fbf8c1593c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:07.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.707+0000 7fbf92a63700 1 -- 172.21.15.37:0/192171555 shutdown_connections 2023-10-06T02:26:07.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.707+0000 7fbf92a63700 1 -- 172.21.15.37:0/192171555 wait complete. 2023-10-06T02:26:07.709 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 31 2023-10-06T02:26:07.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-10-06T02:26:07.870 INFO:teuthology.orchestra.run.smithi037.stdout:{"message":"","return_code":0} 2023-10-06T02:26:07.870 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T02:26:07.870 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.989+0000 7f78baf7b700 1 Processor -- start 2023-10-06T02:26:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.989+0000 7f78baf7b700 1 -- start start 2023-10-06T02:26:07.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.989+0000 7f78baf7b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f78b41596d0 0x7f78b40b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.989+0000 7f78baf7b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f78b40b3840 0x7f78b40c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.989+0000 7f78baf7b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f78b4159aa0 0x7f78b40c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.989+0000 7f78baf7b700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b40c5300 con 0x7f78b41596d0 2023-10-06T02:26:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.990+0000 7f78baf7b700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b40c6160 con 0x7f78b40b3840 2023-10-06T02:26:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.990+0000 7f78baf7b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b40c5550 con 0x7f78b4159aa0 2023-10-06T02:26:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.990+0000 7f78b8d17700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f78b41596d0 0x7f78b40b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.990+0000 7f78b8d17700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f78b41596d0 0x7f78b40b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35634/0 (socket says 172.21.15.37:35634) 2023-10-06T02:26:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.990+0000 7f78b8d17700 1 -- 172.21.15.37:0/2845561813 learned_addr learned my addr 172.21.15.37:0/2845561813 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.990+0000 7f78b3fff700 1 --2- 172.21.15.37:0/2845561813 >> v2:172.21.15.191:3300/0 conn(0x7f78b40b3840 0x7f78b40c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.990+0000 7f78b9518700 1 --2- 172.21.15.37:0/2845561813 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f78b4159aa0 0x7f78b40c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:07.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.990+0000 7f78b8d17700 1 -- 172.21.15.37:0/2845561813 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f78b4159aa0 msgr2=0x7f78b40c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:07.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.990+0000 7f78b8d17700 1 --2- 172.21.15.37:0/2845561813 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f78b4159aa0 0x7f78b40c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.990+0000 7f78b8d17700 1 -- 172.21.15.37:0/2845561813 >> v2:172.21.15.191:3300/0 conn(0x7f78b40b3840 msgr2=0x7f78b40c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:07.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.990+0000 7f78b8d17700 1 --2- 172.21.15.37:0/2845561813 >> v2:172.21.15.191:3300/0 conn(0x7f78b40b3840 0x7f78b40c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:07.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.990+0000 7f78b8d17700 1 -- 172.21.15.37:0/2845561813 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b40c5830 con 0x7f78b41596d0 2023-10-06T02:26:07.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.990+0000 7f78b8d17700 1 --2- 172.21.15.37:0/2845561813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78b41596d0 0x7f78b40b3300 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f78b406d5f0 tx=0x7f78a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0fa829ff956ec2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:07.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.990+0000 7f78b37fe700 1 -- 172.21.15.37:0/2845561813 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a800b860 con 0x7f78b41596d0 2023-10-06T02:26:07.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.990+0000 7f78b37fe700 1 -- 172.21.15.37:0/2845561813 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a800b9c0 con 0x7f78b41596d0 2023-10-06T02:26:07.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.990+0000 7f78b37fe700 1 -- 172.21.15.37:0/2845561813 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a800bd60 con 0x7f78b41596d0 2023-10-06T02:26:07.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.991+0000 7f78baf7b700 1 -- 172.21.15.37:0/2845561813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78b41596d0 msgr2=0x7f78b40b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.991+0000 7f78baf7b700 1 --2- 172.21.15.37:0/2845561813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78b41596d0 0x7f78b40b3300 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f78b406d5f0 tx=0x7f78a8009250 comp rx=0 tx=0).stop 2023-10-06T02:26:08.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.991+0000 7f78baf7b700 1 -- 172.21.15.37:0/2845561813 shutdown_connections 2023-10-06T02:26:08.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.991+0000 7f78baf7b700 1 --2- 172.21.15.37:0/2845561813 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f78b4159aa0 0x7f78b40c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.991+0000 7f78baf7b700 1 --2- 172.21.15.37:0/2845561813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78b41596d0 0x7f78b40b3300 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.991+0000 7f78baf7b700 1 --2- 172.21.15.37:0/2845561813 >> v2:172.21.15.191:3300/0 conn(0x7f78b40b3840 0x7f78b40c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.991+0000 7f78baf7b700 1 -- 172.21.15.37:0/2845561813 >> 172.21.15.37:0/2845561813 conn(0x7f78b406c890 msgr2=0x7f78b40d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:08.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.991+0000 7f78baf7b700 1 -- 172.21.15.37:0/2845561813 shutdown_connections 2023-10-06T02:26:08.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.991+0000 7f78baf7b700 1 -- 172.21.15.37:0/2845561813 wait complete. 2023-10-06T02:26:08.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.992+0000 7f78baf7b700 1 Processor -- start 2023-10-06T02:26:08.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.992+0000 7f78baf7b700 1 -- start start 2023-10-06T02:26:08.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.993+0000 7f78baf7b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78b40b3840 0x7f78b409ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.993+0000 7f78baf7b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f78b41596d0 0x7f78b41532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.993+0000 7f78baf7b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78b4159aa0 0x7f78b40cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.993+0000 7f78baf7b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b4159ef0 con 0x7f78b40b3840 2023-10-06T02:26:08.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.993+0000 7f78baf7b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b415a4b0 con 0x7f78b4159aa0 2023-10-06T02:26:08.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.993+0000 7f78baf7b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b40cb820 con 0x7f78b41596d0 2023-10-06T02:26:08.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.993+0000 7f78b8d17700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78b40b3840 0x7f78b409ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.993+0000 7f78b8d17700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78b40b3840 0x7f78b409ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35638/0 (socket says 172.21.15.37:35638) 2023-10-06T02:26:08.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.993+0000 7f78b8d17700 1 -- 172.21.15.37:0/533672529 learned_addr learned my addr 172.21.15.37:0/533672529 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:08.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.993+0000 7f78b9518700 1 --2- 172.21.15.37:0/533672529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78b4159aa0 0x7f78b40cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.993+0000 7f78b3fff700 1 --2- 172.21.15.37:0/533672529 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f78b41596d0 0x7f78b41532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.993+0000 7f78b8d17700 1 -- 172.21.15.37:0/533672529 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f78b41596d0 msgr2=0x7f78b41532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.993+0000 7f78b8d17700 1 --2- 172.21.15.37:0/533672529 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f78b41596d0 0x7f78b41532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.993+0000 7f78b8d17700 1 -- 172.21.15.37:0/533672529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78b4159aa0 msgr2=0x7f78b40cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.993+0000 7f78b8d17700 1 --2- 172.21.15.37:0/533672529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78b4159aa0 0x7f78b40cb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.993+0000 7f78b8d17700 1 -- 172.21.15.37:0/533672529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a80094f0 con 0x7f78b40b3840 2023-10-06T02:26:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.994+0000 7f78b8d17700 1 --2- 172.21.15.37:0/533672529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78b40b3840 0x7f78b409ae60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f78a800b3c0 tx=0x7f78a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.994+0000 7f78b0ff9700 1 -- 172.21.15.37:0/533672529 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a8024440 con 0x7f78b40b3840 2023-10-06T02:26:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.994+0000 7f78b0ff9700 1 -- 172.21.15.37:0/533672529 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a80245a0 con 0x7f78b40b3840 2023-10-06T02:26:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.994+0000 7f78b0ff9700 1 -- 172.21.15.37:0/533672529 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a8024960 con 0x7f78b40b3840 2023-10-06T02:26:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.994+0000 7f78baf7b700 1 -- 172.21.15.37:0/533672529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b409b4f0 con 0x7f78b40b3840 2023-10-06T02:26:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.994+0000 7f78baf7b700 1 -- 172.21.15.37:0/533672529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b415a140 con 0x7f78b40b3840 2023-10-06T02:26:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.995+0000 7f78baf7b700 1 -- 172.21.15.37:0/533672529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b406eb50 con 0x7f78b40b3840 2023-10-06T02:26:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.995+0000 7f78b0ff9700 1 -- 172.21.15.37:0/533672529 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f78a801a420 con 0x7f78b40b3840 2023-10-06T02:26:08.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.995+0000 7f78b0ff9700 1 --2- 172.21.15.37:0/533672529 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7898066f30 0x7f78980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.996+0000 7f78b0ff9700 1 -- 172.21.15.37:0/533672529 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f78a8086460 con 0x7f78b40b3840 2023-10-06T02:26:08.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.996+0000 7f78b3fff700 1 --2- 172.21.15.37:0/533672529 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7898066f30 0x7f78980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:07.996+0000 7f78b3fff700 1 --2- 172.21.15.37:0/533672529 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7898066f30 0x7f78980693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f78b415b800 tx=0x7f78a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:08.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.000+0000 7f78b0ff9700 1 -- 172.21.15.37:0/533672529 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78a8053500 con 0x7f78b40b3840 2023-10-06T02:26:08.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.236+0000 7f78baf7b700 1 -- 172.21.15.37:0/533672529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78b406fbf0 con 0x7f78b40b3840 2023-10-06T02:26:08.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.237+0000 7f78b0ff9700 1 -- 172.21.15.37:0/533672529 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f78a8056b20 con 0x7f78b40b3840 2023-10-06T02:26:08.238 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:26:08.238 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/1914186828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1914186828},{"type":"v1","addr":"172.21.15.191:6836","nonce":1914186828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3684230798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":3684230798},{"type":"v1","addr":"172.21.15.191:6837","nonce":3684230798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1883185549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1883185549},{"type":"v1","addr":"172.21.15.37:6834","nonce":1883185549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:25:48.166318+0000","modified":"2023-10-06T02:25:51.793825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3956166862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3956166862},{"type":"v1","addr":"172.21.15.37:6835","nonce":3956166862}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:26:08.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.239+0000 7f78baf7b700 1 -- 172.21.15.37:0/533672529 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7898066f30 msgr2=0x7f78980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.239+0000 7f78baf7b700 1 --2- 172.21.15.37:0/533672529 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7898066f30 0x7f78980693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f78b415b800 tx=0x7f78a0008040 comp rx=0 tx=0).stop 2023-10-06T02:26:08.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.239+0000 7f78baf7b700 1 -- 172.21.15.37:0/533672529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78b40b3840 msgr2=0x7f78b409ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.239+0000 7f78baf7b700 1 --2- 172.21.15.37:0/533672529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78b40b3840 0x7f78b409ae60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f78a800b3c0 tx=0x7f78a8017000 comp rx=0 tx=0).stop 2023-10-06T02:26:08.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.239+0000 7f78baf7b700 1 -- 172.21.15.37:0/533672529 shutdown_connections 2023-10-06T02:26:08.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.239+0000 7f78baf7b700 1 --2- 172.21.15.37:0/533672529 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7898066f30 0x7f78980693e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.239+0000 7f78baf7b700 1 --2- 172.21.15.37:0/533672529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78b4159aa0 0x7f78b40cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.239+0000 7f78baf7b700 1 --2- 172.21.15.37:0/533672529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78b40b3840 0x7f78b409ae60 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.239+0000 7f78baf7b700 1 --2- 172.21.15.37:0/533672529 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f78b41596d0 0x7f78b41532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.239+0000 7f78baf7b700 1 -- 172.21.15.37:0/533672529 >> 172.21.15.37:0/533672529 conn(0x7f78b406c890 msgr2=0x7f78b41553b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:08.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.239+0000 7f78baf7b700 1 -- 172.21.15.37:0/533672529 shutdown_connections 2023-10-06T02:26:08.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.239+0000 7f78baf7b700 1 -- 172.21.15.37:0/533672529 wait complete. 2023-10-06T02:26:08.242 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 31 2023-10-06T02:26:08.252 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata get mds0_inotable - 2023-10-06T02:26:08.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.290+0000 7fbd1c209000 1 Processor -- start 2023-10-06T02:26:08.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.290+0000 7fbd1c209000 1 -- start start 2023-10-06T02:26:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.291+0000 7fbd1c209000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55a6248219d0 0x55a6248f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.291+0000 7fbd1c209000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a6248238f0 0x55a624860a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.291+0000 7fbd1c209000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a62484e300 0x55a624820230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.291+0000 7fbd1c209000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a62476b980 con 0x55a62484e300 2023-10-06T02:26:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.291+0000 7fbd1c209000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a62476b620 con 0x55a6248238f0 2023-10-06T02:26:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.291+0000 7fbd1c209000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a624762400 con 0x55a6248219d0 2023-10-06T02:26:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.291+0000 7fbd15c45700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a62484e300 0x55a624820230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.291+0000 7fbd15c45700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a62484e300 0x55a624820230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35660/0 (socket says 172.21.15.37:35660) 2023-10-06T02:26:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.291+0000 7fbd15c45700 1 -- 172.21.15.37:0/2925010441 learned_addr learned my addr 172.21.15.37:0/2925010441 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.291+0000 7fbd15444700 1 --2- 172.21.15.37:0/2925010441 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55a6248219d0 0x55a6248f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.291+0000 7fbd14c43700 1 --2- 172.21.15.37:0/2925010441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a6248238f0 0x55a624860a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.291+0000 7fbd15c45700 1 -- 172.21.15.37:0/2925010441 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55a6248219d0 msgr2=0x55a6248f3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.291+0000 7fbd15c45700 1 --2- 172.21.15.37:0/2925010441 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55a6248219d0 0x55a6248f3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.291+0000 7fbd15c45700 1 -- 172.21.15.37:0/2925010441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a6248238f0 msgr2=0x55a624860a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.291+0000 7fbd15c45700 1 --2- 172.21.15.37:0/2925010441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a6248238f0 0x55a624860a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.291+0000 7fbd15c45700 1 -- 172.21.15.37:0/2925010441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0800a0e0 con 0x55a62484e300 2023-10-06T02:26:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.291+0000 7fbd15c45700 1 --2- 172.21.15.37:0/2925010441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a62484e300 0x55a624820230 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000a790 tx=0x7fbd10005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641e17ed56f2e072 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.291+0000 7fbd0f7fe700 1 -- 172.21.15.37:0/2925010441 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1000f070 con 0x55a62484e300 2023-10-06T02:26:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.291+0000 7fbd0f7fe700 1 -- 172.21.15.37:0/2925010441 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd10008570 con 0x55a62484e300 2023-10-06T02:26:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.291+0000 7fbd0f7fe700 1 -- 172.21.15.37:0/2925010441 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd10008910 con 0x55a62484e300 2023-10-06T02:26:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.292+0000 7fbd1c209000 1 -- 172.21.15.37:0/2925010441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a62484e300 msgr2=0x55a624820230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.292+0000 7fbd1c209000 1 --2- 172.21.15.37:0/2925010441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a62484e300 0x55a624820230 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000a790 tx=0x7fbd10005c60 comp rx=0 tx=0).stop 2023-10-06T02:26:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.292+0000 7fbd1c209000 1 -- 172.21.15.37:0/2925010441 shutdown_connections 2023-10-06T02:26:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.292+0000 7fbd1c209000 1 --2- 172.21.15.37:0/2925010441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a62484e300 0x55a624820230 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.292+0000 7fbd1c209000 1 --2- 172.21.15.37:0/2925010441 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55a6248219d0 0x55a6248f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.292+0000 7fbd1c209000 1 --2- 172.21.15.37:0/2925010441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a6248238f0 0x55a624860a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.292+0000 7fbd1c209000 1 -- 172.21.15.37:0/2925010441 >> 172.21.15.37:0/2925010441 conn(0x55a624869af0 msgr2=0x55a6248f6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.292+0000 7fbd1c209000 1 -- 172.21.15.37:0/2925010441 shutdown_connections 2023-10-06T02:26:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.292+0000 7fbd1c209000 1 -- 172.21.15.37:0/2925010441 wait complete. 2023-10-06T02:26:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.292+0000 7fbd1c209000 1 Processor -- start 2023-10-06T02:26:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.292+0000 7fbd1c209000 1 -- start start 2023-10-06T02:26:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.293+0000 7fbd1c209000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a6248219d0 0x55a624865d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.293+0000 7fbd1c209000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55a6248238f0 0x55a6249067d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.293+0000 7fbd1c209000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a62484e300 0x55a6248f66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.293+0000 7fbd1c209000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a624866240 con 0x55a62484e300 2023-10-06T02:26:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.293+0000 7fbd1c209000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a62484c9e0 con 0x55a6248219d0 2023-10-06T02:26:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.293+0000 7fbd1c209000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a624866e20 con 0x55a6248238f0 2023-10-06T02:26:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.293+0000 7fbd15c45700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a62484e300 0x55a6248f66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.293+0000 7fbd15c45700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a62484e300 0x55a6248f66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35666/0 (socket says 172.21.15.37:35666) 2023-10-06T02:26:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.293+0000 7fbd15c45700 1 -- 172.21.15.37:0/347912324 learned_addr learned my addr 172.21.15.37:0/347912324 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.293+0000 7fbd15444700 1 --2- 172.21.15.37:0/347912324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a6248219d0 0x55a624865d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.293+0000 7fbd14c43700 1 --2- 172.21.15.37:0/347912324 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55a6248238f0 0x55a6249067d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.294+0000 7fbd15c45700 1 -- 172.21.15.37:0/347912324 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55a6248238f0 msgr2=0x55a6249067d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.294+0000 7fbd15c45700 1 --2- 172.21.15.37:0/347912324 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55a6248238f0 0x55a6249067d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.294+0000 7fbd15c45700 1 -- 172.21.15.37:0/347912324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a6248219d0 msgr2=0x55a624865d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.294+0000 7fbd15c45700 1 --2- 172.21.15.37:0/347912324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a6248219d0 0x55a624865d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.294+0000 7fbd15c45700 1 -- 172.21.15.37:0/347912324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1000a440 con 0x55a62484e300 2023-10-06T02:26:08.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.294+0000 7fbd15c45700 1 --2- 172.21.15.37:0/347912324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a62484e300 0x55a6248f66f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbd10005ca0 tx=0x7fbd10015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:08.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.294+0000 7fbd0dffb700 1 -- 172.21.15.37:0/347912324 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd10015730 con 0x55a62484e300 2023-10-06T02:26:08.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.294+0000 7fbd0dffb700 1 -- 172.21.15.37:0/347912324 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd100158b0 con 0x55a62484e300 2023-10-06T02:26:08.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.294+0000 7fbd1c209000 1 -- 172.21.15.37:0/347912324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a62477a3d0 con 0x55a62484e300 2023-10-06T02:26:08.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.294+0000 7fbd0dffb700 1 -- 172.21.15.37:0/347912324 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd10015c70 con 0x55a62484e300 2023-10-06T02:26:08.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.294+0000 7fbd1c209000 1 -- 172.21.15.37:0/347912324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a62476dae0 con 0x55a62484e300 2023-10-06T02:26:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.295+0000 7fbd0dffb700 1 -- 172.21.15.37:0/347912324 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd1001c050 con 0x55a62484e300 2023-10-06T02:26:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.296+0000 7fbd0dffb700 1 --2- 172.21.15.37:0/347912324 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbcf8065890 0x7fbcf8067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.296+0000 7fbd0dffb700 1 -- 172.21.15.37:0/347912324 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fbd10084d60 con 0x55a62484e300 2023-10-06T02:26:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.296+0000 7fbd1c209000 1 --2- 172.21.15.37:0/347912324 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x55a624844b00 0x55a6249060e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.296+0000 7fbd1c209000 1 -- 172.21.15.37:0/347912324 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:1 9.13 9:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59) v8 -- 0x55a6248f2700 con 0x55a624844b00 2023-10-06T02:26:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.296+0000 7fbd15444700 1 --2- 172.21.15.37:0/347912324 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbcf8065890 0x7fbcf8067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.296+0000 7fbd14c43700 1 --2- 172.21.15.37:0/347912324 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x55a624844b00 0x55a6249060e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.296+0000 7fbd15444700 1 --2- 172.21.15.37:0/347912324 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbcf8065890 0x7fbcf8067d40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbd08005d80 tx=0x7fbd08015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.297+0000 7fbd14c43700 1 --2- 172.21.15.37:0/347912324 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x55a624844b00 0x55a6249060e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:08.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.297+0000 7fbd14c43700 1 -- 172.21.15.37:0/347912324 <== osd.7 v2:172.21.15.191:6813/90854 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x7fbd0000f760 con 0x55a624844b00 2023-10-06T02:26:08.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.297+0000 7fbd1c209000 1 -- 172.21.15.37:0/347912324 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x55a624844b00 msgr2=0x55a6249060e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.297+0000 7fbd1c209000 1 --2- 172.21.15.37:0/347912324 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x55a624844b00 0x55a6249060e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.297+0000 7fbd1c209000 1 -- 172.21.15.37:0/347912324 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbcf8065890 msgr2=0x7fbcf8067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.297+0000 7fbd1c209000 1 --2- 172.21.15.37:0/347912324 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbcf8065890 0x7fbcf8067d40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbd08005d80 tx=0x7fbd08015000 comp rx=0 tx=0).stop 2023-10-06T02:26:08.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.297+0000 7fbd1c209000 1 -- 172.21.15.37:0/347912324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a62484e300 msgr2=0x55a6248f66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.297+0000 7fbd1c209000 1 --2- 172.21.15.37:0/347912324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a62484e300 0x55a6248f66f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbd10005ca0 tx=0x7fbd10015000 comp rx=0 tx=0).stop 2023-10-06T02:26:08.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.297+0000 7fbd15c45700 1 -- 172.21.15.37:0/347912324 reap_dead start 2023-10-06T02:26:08.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.297+0000 7fbd1c209000 1 -- 172.21.15.37:0/347912324 shutdown_connections 2023-10-06T02:26:08.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.297+0000 7fbd1c209000 1 -- 172.21.15.37:0/347912324 >> 172.21.15.37:0/347912324 conn(0x55a624869af0 msgr2=0x55a62484cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:08.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.297+0000 7fbd1c209000 1 -- 172.21.15.37:0/347912324 shutdown_connections 2023-10-06T02:26:08.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.297+0000 7fbd1c209000 1 -- 172.21.15.37:0/347912324 wait complete. 2023-10-06T02:26:08.303 INFO:teuthology.orchestra.run.smithi037.stdout:����� 2023-10-06T02:26:08.304 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:26:08.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.462+0000 7fb2353fc700 1 Processor -- start 2023-10-06T02:26:08.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.462+0000 7fb2353fc700 1 -- start start 2023-10-06T02:26:08.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.462+0000 7fb2353fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb230159aa0 0x7fb2300c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.462+0000 7fb2353fc700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb2300c6b30 0x7fb2300cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.462+0000 7fb2353fc700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2300c5300 con 0x7fb2301596d0 2023-10-06T02:26:08.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.462+0000 7fb2353fc700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2300c6160 con 0x7fb230159aa0 2023-10-06T02:26:08.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.462+0000 7fb2353fc700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2300c5550 con 0x7fb2300c6b30 2023-10-06T02:26:08.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.463+0000 7fb22e7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb230159aa0 0x7fb2300c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.463+0000 7fb22e7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb230159aa0 0x7fb2300c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35674/0 (socket says 172.21.15.37:35674) 2023-10-06T02:26:08.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.463+0000 7fb22e7fc700 1 -- 172.21.15.37:0/4254225121 learned_addr learned my addr 172.21.15.37:0/4254225121 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:08.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.463+0000 7fb22f7fe700 1 --2- 172.21.15.37:0/4254225121 >> v2:172.21.15.191:3300/0 conn(0x7fb2300c6b30 0x7fb2300cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.463+0000 7fb22e7fc700 1 -- 172.21.15.37:0/4254225121 >> v2:172.21.15.191:3300/0 conn(0x7fb2300c6b30 msgr2=0x7fb2300cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:08.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.463+0000 7fb22e7fc700 1 --2- 172.21.15.37:0/4254225121 >> v2:172.21.15.191:3300/0 conn(0x7fb2300c6b30 0x7fb2300cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.463+0000 7fb22e7fc700 1 -- 172.21.15.37:0/4254225121 >> v1:172.21.15.191:6789/0 conn(0x7fb2301596d0 legacy=0x7fb2300b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.463+0000 7fb22e7fc700 1 -- 172.21.15.37:0/4254225121 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2300c5830 con 0x7fb230159aa0 2023-10-06T02:26:08.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.463+0000 7fb22f7fe700 1 --2- 172.21.15.37:0/4254225121 >> v2:172.21.15.191:3300/0 conn(0x7fb2300c6b30 0x7fb2300cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:08.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.463+0000 7fb22e7fc700 1 --2- 172.21.15.37:0/4254225121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb230159aa0 0x7fb2300c65f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb230070c30 tx=0x7fb220009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83f164e8aaa6ef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:08.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.463+0000 7fb22dffb700 1 -- 172.21.15.37:0/4254225121 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22000b860 con 0x7fb230159aa0 2023-10-06T02:26:08.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.463+0000 7fb22dffb700 1 -- 172.21.15.37:0/4254225121 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22000b9c0 con 0x7fb230159aa0 2023-10-06T02:26:08.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.463+0000 7fb22dffb700 1 -- 172.21.15.37:0/4254225121 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22000bd60 con 0x7fb230159aa0 2023-10-06T02:26:08.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.464+0000 7fb2353fc700 1 -- 172.21.15.37:0/4254225121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb230159aa0 msgr2=0x7fb2300c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.464+0000 7fb2353fc700 1 --2- 172.21.15.37:0/4254225121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb230159aa0 0x7fb2300c65f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb230070c30 tx=0x7fb220009250 comp rx=0 tx=0).stop 2023-10-06T02:26:08.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.464+0000 7fb2353fc700 1 -- 172.21.15.37:0/4254225121 shutdown_connections 2023-10-06T02:26:08.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.464+0000 7fb2353fc700 1 --2- 172.21.15.37:0/4254225121 >> v2:172.21.15.191:3300/0 conn(0x7fb2300c6b30 0x7fb2300cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.464+0000 7fb2353fc700 1 --2- 172.21.15.37:0/4254225121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb230159aa0 0x7fb2300c65f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.464+0000 7fb2353fc700 1 -- 172.21.15.37:0/4254225121 >> 172.21.15.37:0/4254225121 conn(0x7fb23006c890 msgr2=0x7fb2300d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:08.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.464+0000 7fb2353fc700 1 -- 172.21.15.37:0/4254225121 shutdown_connections 2023-10-06T02:26:08.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.464+0000 7fb2353fc700 1 -- 172.21.15.37:0/4254225121 wait complete. 2023-10-06T02:26:08.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.465+0000 7fb2353fc700 1 Processor -- start 2023-10-06T02:26:08.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.465+0000 7fb2353fc700 1 -- start start 2023-10-06T02:26:08.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.466+0000 7fb2353fc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2300c6b30 0x7fb230156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.466+0000 7fb2353fc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2301596d0 0x7fb23009c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.466+0000 7fb2353fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb230159aa0 0x7fb23016a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.466+0000 7fb2353fc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23009d1c0 con 0x7fb230159aa0 2023-10-06T02:26:08.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.466+0000 7fb2353fc700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23015db40 con 0x7fb2301596d0 2023-10-06T02:26:08.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.466+0000 7fb2353fc700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23015d210 con 0x7fb2300c6b30 2023-10-06T02:26:08.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.466+0000 7fb22f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb230159aa0 0x7fb23016a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.466+0000 7fb22f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb230159aa0 0x7fb23016a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35684/0 (socket says 172.21.15.37:35684) 2023-10-06T02:26:08.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.466+0000 7fb22f7fe700 1 -- 172.21.15.37:0/4100253635 learned_addr learned my addr 172.21.15.37:0/4100253635 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:08.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.466+0000 7fb22effd700 1 --2- 172.21.15.37:0/4100253635 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2300c6b30 0x7fb230156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.466+0000 7fb22e7fc700 1 --2- 172.21.15.37:0/4100253635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2301596d0 0x7fb23009c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.466+0000 7fb22f7fe700 1 -- 172.21.15.37:0/4100253635 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2300c6b30 msgr2=0x7fb230156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.466+0000 7fb22f7fe700 1 --2- 172.21.15.37:0/4100253635 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2300c6b30 0x7fb230156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.466+0000 7fb22f7fe700 1 -- 172.21.15.37:0/4100253635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2301596d0 msgr2=0x7fb23009c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.466+0000 7fb22f7fe700 1 --2- 172.21.15.37:0/4100253635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2301596d0 0x7fb23009c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.466+0000 7fb22f7fe700 1 -- 172.21.15.37:0/4100253635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2200094f0 con 0x7fb230159aa0 2023-10-06T02:26:08.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.466+0000 7fb22e7fc700 1 --2- 172.21.15.37:0/4100253635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2301596d0 0x7fb23009c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:08.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.466+0000 7fb22f7fe700 1 --2- 172.21.15.37:0/4100253635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb230159aa0 0x7fb23016a180 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb22800d180 tx=0x7fb228009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:08.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.467+0000 7fb226ffd700 1 -- 172.21.15.37:0/4100253635 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22800de20 con 0x7fb230159aa0 2023-10-06T02:26:08.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.467+0000 7fb226ffd700 1 -- 172.21.15.37:0/4100253635 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22800f040 con 0x7fb230159aa0 2023-10-06T02:26:08.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.467+0000 7fb2353fc700 1 -- 172.21.15.37:0/4100253635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb23015d4f0 con 0x7fb230159aa0 2023-10-06T02:26:08.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.467+0000 7fb226ffd700 1 -- 172.21.15.37:0/4100253635 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb228015690 con 0x7fb230159aa0 2023-10-06T02:26:08.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.467+0000 7fb2353fc700 1 -- 172.21.15.37:0/4100253635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb23009ce50 con 0x7fb230159aa0 2023-10-06T02:26:08.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.467+0000 7fb2353fc700 1 -- 172.21.15.37:0/4100253635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23015dcb0 con 0x7fb230159aa0 2023-10-06T02:26:08.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.468+0000 7fb226ffd700 1 -- 172.21.15.37:0/4100253635 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb22801e3b0 con 0x7fb230159aa0 2023-10-06T02:26:08.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.468+0000 7fb226ffd700 1 --2- 172.21.15.37:0/4100253635 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb210066f30 0x7fb2100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:08.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.468+0000 7fb226ffd700 1 -- 172.21.15.37:0/4100253635 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fb228084d10 con 0x7fb230159aa0 2023-10-06T02:26:08.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.469+0000 7fb22effd700 1 --2- 172.21.15.37:0/4100253635 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb210066f30 0x7fb2100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:08.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.469+0000 7fb22effd700 1 --2- 172.21.15.37:0/4100253635 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb210066f30 0x7fb2100693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb2180037c0 tx=0x7fb218009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:08.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.472+0000 7fb226ffd700 1 -- 172.21.15.37:0/4100253635 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb228051db0 con 0x7fb230159aa0 2023-10-06T02:26:08.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.713+0000 7fb2353fc700 1 -- 172.21.15.37:0/4100253635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb23006fbf0 con 0x7fb230159aa0 2023-10-06T02:26:08.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.713+0000 7fb226ffd700 1 -- 172.21.15.37:0/4100253635 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb22801a070 con 0x7fb230159aa0 2023-10-06T02:26:08.713 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:26:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.715+0000 7fb2353fc700 1 -- 172.21.15.37:0/4100253635 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb210066f30 msgr2=0x7fb2100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.715+0000 7fb2353fc700 1 --2- 172.21.15.37:0/4100253635 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb210066f30 0x7fb2100693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb2180037c0 tx=0x7fb218009040 comp rx=0 tx=0).stop 2023-10-06T02:26:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.715+0000 7fb2353fc700 1 -- 172.21.15.37:0/4100253635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb230159aa0 msgr2=0x7fb23016a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.715+0000 7fb2353fc700 1 --2- 172.21.15.37:0/4100253635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb230159aa0 0x7fb23016a180 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb22800d180 tx=0x7fb228009a50 comp rx=0 tx=0).stop 2023-10-06T02:26:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.715+0000 7fb2353fc700 1 -- 172.21.15.37:0/4100253635 shutdown_connections 2023-10-06T02:26:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.715+0000 7fb2353fc700 1 --2- 172.21.15.37:0/4100253635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb230159aa0 0x7fb23016a180 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.715+0000 7fb2353fc700 1 --2- 172.21.15.37:0/4100253635 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2300c6b30 0x7fb230156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.715+0000 7fb2353fc700 1 --2- 172.21.15.37:0/4100253635 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb210066f30 0x7fb2100693e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.715+0000 7fb2353fc700 1 --2- 172.21.15.37:0/4100253635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2301596d0 0x7fb23009c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.715+0000 7fb2353fc700 1 -- 172.21.15.37:0/4100253635 >> 172.21.15.37:0/4100253635 conn(0x7fb23006c890 msgr2=0x7fb230157010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.715+0000 7fb2353fc700 1 -- 172.21.15.37:0/4100253635 shutdown_connections 2023-10-06T02:26:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:08.715+0000 7fb2353fc700 1 -- 172.21.15.37:0/4100253635 wait complete. 2023-10-06T02:26:08.727 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:26:08.728 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:26:08.728 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-10-06T02:26:08.728 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:26:08.728 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:08.728 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:26:08.728 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:26:08.728 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:26:08.728 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:26:08.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:08.728 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-10-06T02:26:08.744 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:26:08.744 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:26:08.744 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:26:08.744 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:26:08.745 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T02:26:08.745 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:26:08.745 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:26:08.745 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:26:08.745 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-10-06T02:26:08.745 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:26:08.745 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:26:08.745 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-10-06T02:26:08.745 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:26:08.745 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42313sec preferred_lft 42313sec 2023-10-06T02:26:08.745 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-10-06T02:26:08.746 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:26:08.746 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:26:08.746 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:26:08.746 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-10-06T02:26:08.746 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:26:08.746 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:26:08.746 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-10-06T02:26:08.746 INFO:teuthology.orchestra.run.smithi037.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:26:08.746 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 26:84:4a:aa:8b:b5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:26:08.746 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:26:08.746 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:26:08.747 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::a0fb:38ff:fe90:57e1/64 scope link 2023-10-06T02:26:08.747 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:26:08.747 INFO:teuthology.orchestra.run.smithi037.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:26:08.747 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 36:fb:a9:50:59:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:26:08.747 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::34fb:a9ff:fe50:5976/64 scope link 2023-10-06T02:26:08.747 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:26:08.747 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:26:08.747 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 26:84:4a:aa:8b:b5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:26:08.747 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::2484:4aff:feaa:8bb5/64 scope link 2023-10-06T02:26:08.747 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:26:08.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:08.748 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:26:08.808 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T02:26:08.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:08.809 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-10-06T02:26:08.865 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-10-06T02:26:08.866 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:26:08.866 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:26:08.866 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:26:08.866 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:26:08.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:08.866 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T02:26:08.867 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T02:26:08.867 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:26:08.867 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:26:08.867 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:26:08.867 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T02:26:08.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:08.969 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T02:26:08.983 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:26:08.984 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:26:08.984 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:26:08.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:08.984 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-10-06T02:26:09.049 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:26:09.050 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:26:09.050 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:09.105 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:26:09.105 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:26:09.106 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:09.160 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T02:26:09.225 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:26:09.225 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:26:09.289 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:26:09.290 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:26:09.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:26:09.291 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T02:26:09.346 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:26:09.346 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:26:09.388 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T02:26:09.414 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:26:09.415 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:26:09.471 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-10-06T02:26:09.471+0000 7f8f653e2540 -1 init, newargv = 0x55d7eaf25b80 newargc=15 2023-10-06T02:26:09.471 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[110252]: starting ceph client 2023-10-06T02:26:09.475 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[110252]: starting fuse 2023-10-06T02:26:09.480 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:26:09.481 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:26:09.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:26:09.482 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T02:26:09.537 INFO:teuthology.orchestra.run.smithi037.stdout:46 2023-10-06T02:26:09.537 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T02:26:09.538 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:26:09.538 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-10-06T02:26:09.538 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-10-06T02:26:09.538 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:26:09.538 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-10-06T02:26:09.538 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:26:09.538 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-10-06T02:26:09.538 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:26:09.538 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-10-06T02:26:09.538 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:26:09.538 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:26:09.539 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-10-06T02:26:09.539 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-10-06T02:26:09.539 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-10-06T02:26:09.539 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-10-06T02:26:09.539 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:26:09.539 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-10-06T02:26:09.539 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:26:09.539 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:26:09.539 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:26:09.539 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-10-06T02:26:09.539 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-10-06T02:26:09.539 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-10-06T02:26:09.539 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:26:09.540 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:26:09.540 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-10-06T02:26:09.540 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:26:09.661 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.110252.asok 2023-10-06T02:26:09.843 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.110252.asok 2023-10-06T02:26:09.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:26:09.843 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.110252.asok status 2023-10-06T02:26:09.997 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:26:09.998 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-10-06T02:26:09.998 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:26:09.998 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:26:09.998 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-10-06T02:26:09.998 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-10-06T02:26:09.998 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:26:09.998 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "110252", 2023-10-06T02:26:09.998 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-10-06T02:26:09.998 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:26:09.998 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-10-06T02:26:09.999 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-10-06T02:26:09.999 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6060, 2023-10-06T02:26:09.999 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-10-06T02:26:09.999 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-10-06T02:26:09.999 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-10-06T02:26:09.999 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 6060 2023-10-06T02:26:09.999 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:26:09.999 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T02:26:09.999 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T02:26:09.999 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:26:09.999 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1140030892 2023-10-06T02:26:10.000 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:26:10.000 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:26:10.000 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T02:26:10.000 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T02:26:10.000 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:26:10.000 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1140030892 2023-10-06T02:26:10.000 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:26:10.000 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.6060 192.168.0.1:0/1140030892", 2023-10-06T02:26:10.000 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/1140030892", 2023-10-06T02:26:10.001 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-10-06T02:26:10.001 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 31, 2023-10-06T02:26:10.001 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 59, 2023-10-06T02:26:10.001 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:26:10.001 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-10-06T02:26:10.001 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-10-06T02:26:10.001 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:26:10.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:26:10.008 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-10-06T02:26:10.008 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:10.023 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-10-06T02:26:10.023 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:10.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:26:10.024 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:10.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:26:10.089 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file2_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2023-10-06T02:26:10.208 INFO:teuthology.orchestra.run.smithi037.stderr:6+0 records in 2023-10-06T02:26:10.209 INFO:teuthology.orchestra.run.smithi037.stderr:6+0 records out 2023-10-06T02:26:10.209 INFO:teuthology.orchestra.run.smithi037.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0617075 s, 102 MB/s 2023-10-06T02:26:10.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:26:10.210 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file3_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2023-10-06T02:26:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:6+0 records in 2023-10-06T02:26:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:6+0 records out 2023-10-06T02:26:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0571258 s, 110 MB/s 2023-10-06T02:26:10.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:26:10.285 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2023-10-06T02:26:10.303 INFO:teuthology.orchestra.run.smithi037.stdout:./ 2023-10-06T02:26:10.303 INFO:teuthology.orchestra.run.smithi037.stdout:./file2_sixmegs 2023-10-06T02:26:10.303 INFO:teuthology.orchestra.run.smithi037.stdout:./file3_sixmegs 2023-10-06T02:26:10.303 INFO:teuthology.orchestra.run.smithi037.stdout:./file1_sixmegs 2023-10-06T02:26:10.304 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:26:10.304 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:26:10.304 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:26:10.304 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:26:10.304 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2023-10-06T02:26:10.304 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:26:10.410 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T02:26:10.599 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:26:10.599 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:26:10.599 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:26:10.599 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:26:10.599 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file2_sixmegs").st_ino) 2023-10-06T02:26:10.599 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:26:10.706 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627777 2023-10-06T02:26:10.895 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:26:10.895 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:26:10.895 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:26:10.895 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:26:10.895 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file3_sixmegs").st_ino) 2023-10-06T02:26:10.896 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:26:11.002 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627778 2023-10-06T02:26:11.190 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:26:11.190 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:26:11.190 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:26:11.190 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:26:11.191 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file1_sixmegs").st_ino) 2023-10-06T02:26:11.191 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:26:11.296 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627776 2023-10-06T02:26:11.485 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-10-06T02:26:11.485 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:26:11.485 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:11.559 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[110252]: fuse finished with error 0 and tester_r 0 2023-10-06T02:26:11.560 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:26:17.662 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:26:17.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:17.662 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:26:17.681 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:17.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.850+0000 7f911ca89700 1 Processor -- start 2023-10-06T02:26:17.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.850+0000 7f911ca89700 1 -- start start 2023-10-06T02:26:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.851+0000 7f911ca89700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f91180adf40 0x7f91180b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.851+0000 7f911ca89700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f91180b0be0 0x7f911806a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.851+0000 7f911ca89700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f911806a9e0 0x7f9118157040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.851+0000 7f911ca89700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91180aa8a0 con 0x7f91180b0be0 2023-10-06T02:26:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.851+0000 7f911ca89700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f911806af60 con 0x7f91180adf40 2023-10-06T02:26:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.851+0000 7f911ca89700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911806b240 con 0x7f911806a9e0 2023-10-06T02:26:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.851+0000 7f9115d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f91180b0be0 0x7f911806a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.851+0000 7f9115d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f91180b0be0 0x7f911806a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40286/0 (socket says 172.21.15.37:40286) 2023-10-06T02:26:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.851+0000 7f9115d9b700 1 -- 172.21.15.37:0/3461386470 learned_addr learned my addr 172.21.15.37:0/3461386470 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.851+0000 7f9116d9d700 1 --2- 172.21.15.37:0/3461386470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f911806a9e0 0x7f9118157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.851+0000 7f911659c700 1 --2- 172.21.15.37:0/3461386470 >> v2:172.21.15.191:3300/0 conn(0x7f91180adf40 0x7f91180b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.852+0000 7f9115d9b700 1 -- 172.21.15.37:0/3461386470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f911806a9e0 msgr2=0x7f9118157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.852+0000 7f9115d9b700 1 --2- 172.21.15.37:0/3461386470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f911806a9e0 0x7f9118157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.852+0000 7f9115d9b700 1 -- 172.21.15.37:0/3461386470 >> v2:172.21.15.191:3300/0 conn(0x7f91180adf40 msgr2=0x7f91180b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.852+0000 7f9115d9b700 1 --2- 172.21.15.37:0/3461386470 >> v2:172.21.15.191:3300/0 conn(0x7f91180adf40 0x7f91180b06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.852+0000 7f9115d9b700 1 -- 172.21.15.37:0/3461386470 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911806b520 con 0x7f91180b0be0 2023-10-06T02:26:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.852+0000 7f9115d9b700 1 --2- 172.21.15.37:0/3461386470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91180b0be0 0x7f911806a4a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f911806b940 tx=0x7f910c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e675f7b6fbe8f82 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.852+0000 7f911559a700 1 -- 172.21.15.37:0/3461386470 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c00b860 con 0x7f91180b0be0 2023-10-06T02:26:17.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.852+0000 7f911559a700 1 -- 172.21.15.37:0/3461386470 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910c00b9c0 con 0x7f91180b0be0 2023-10-06T02:26:17.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.852+0000 7f911559a700 1 -- 172.21.15.37:0/3461386470 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c00bd60 con 0x7f91180b0be0 2023-10-06T02:26:17.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.852+0000 7f911ca89700 1 -- 172.21.15.37:0/3461386470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91180b0be0 msgr2=0x7f911806a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.852+0000 7f911ca89700 1 --2- 172.21.15.37:0/3461386470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91180b0be0 0x7f911806a4a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f911806b940 tx=0x7f910c009250 comp rx=0 tx=0).stop 2023-10-06T02:26:17.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.852+0000 7f911ca89700 1 -- 172.21.15.37:0/3461386470 shutdown_connections 2023-10-06T02:26:17.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.852+0000 7f911ca89700 1 --2- 172.21.15.37:0/3461386470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f911806a9e0 0x7f9118157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.852+0000 7f911ca89700 1 --2- 172.21.15.37:0/3461386470 >> v2:172.21.15.191:3300/0 conn(0x7f91180adf40 0x7f91180b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.852+0000 7f911ca89700 1 --2- 172.21.15.37:0/3461386470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91180b0be0 0x7f911806a4a0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.852+0000 7f911ca89700 1 -- 172.21.15.37:0/3461386470 >> 172.21.15.37:0/3461386470 conn(0x7f91180cc120 msgr2=0x7f91180cc520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:17.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.853+0000 7f911ca89700 1 -- 172.21.15.37:0/3461386470 shutdown_connections 2023-10-06T02:26:17.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.853+0000 7f911ca89700 1 -- 172.21.15.37:0/3461386470 wait complete. 2023-10-06T02:26:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.854+0000 7f911ca89700 1 Processor -- start 2023-10-06T02:26:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.854+0000 7f911ca89700 1 -- start start 2023-10-06T02:26:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.854+0000 7f911ca89700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f911806a9e0 0x7f91180acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.854+0000 7f911ca89700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91180adf40 0x7f9118141e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.854+0000 7f911ca89700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91180b0be0 0x7f91180978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.854+0000 7f911ca89700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9118152de0 con 0x7f91180b0be0 2023-10-06T02:26:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.854+0000 7f911ca89700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9118169cc0 con 0x7f91180adf40 2023-10-06T02:26:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.854+0000 7f911ca89700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9118152ab0 con 0x7f911806a9e0 2023-10-06T02:26:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.855+0000 7f9116d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91180b0be0 0x7f91180978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.855+0000 7f9116d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91180b0be0 0x7f91180978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40290/0 (socket says 172.21.15.37:40290) 2023-10-06T02:26:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.855+0000 7f9116d9d700 1 -- 172.21.15.37:0/3423561746 learned_addr learned my addr 172.21.15.37:0/3423561746 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.855+0000 7f911659c700 1 --2- 172.21.15.37:0/3423561746 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f911806a9e0 0x7f91180acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.855+0000 7f9115d9b700 1 --2- 172.21.15.37:0/3423561746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91180adf40 0x7f9118141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.855+0000 7f9116d9d700 1 -- 172.21.15.37:0/3423561746 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f911806a9e0 msgr2=0x7f91180acbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.855+0000 7f9116d9d700 1 --2- 172.21.15.37:0/3423561746 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f911806a9e0 0x7f91180acbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.855+0000 7f9116d9d700 1 -- 172.21.15.37:0/3423561746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91180adf40 msgr2=0x7f9118141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.855+0000 7f9116d9d700 1 --2- 172.21.15.37:0/3423561746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91180adf40 0x7f9118141e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.855+0000 7f9116d9d700 1 -- 172.21.15.37:0/3423561746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c0094f0 con 0x7f91180b0be0 2023-10-06T02:26:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.855+0000 7f9116d9d700 1 --2- 172.21.15.37:0/3423561746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91180b0be0 0x7f91180978e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f911000d890 tx=0x7f9110008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.855+0000 7f91067fc700 1 -- 172.21.15.37:0/3423561746 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91100125f0 con 0x7f91180b0be0 2023-10-06T02:26:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.855+0000 7f91067fc700 1 -- 172.21.15.37:0/3423561746 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9110012770 con 0x7f91180b0be0 2023-10-06T02:26:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.855+0000 7f911ca89700 1 -- 172.21.15.37:0/3423561746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91180ad410 con 0x7f91180b0be0 2023-10-06T02:26:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.855+0000 7f91067fc700 1 -- 172.21.15.37:0/3423561746 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9110012b30 con 0x7f91180b0be0 2023-10-06T02:26:17.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.855+0000 7f911ca89700 1 -- 172.21.15.37:0/3423561746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91180ad9d0 con 0x7f91180b0be0 2023-10-06T02:26:17.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.856+0000 7f911ca89700 1 -- 172.21.15.37:0/3423561746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911806e4d0 con 0x7f91180b0be0 2023-10-06T02:26:17.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.857+0000 7f91067fc700 1 -- 172.21.15.37:0/3423561746 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f911001e460 con 0x7f91180b0be0 2023-10-06T02:26:17.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.857+0000 7f91067fc700 1 --2- 172.21.15.37:0/3423561746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f90f8066f30 0x7f90f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:17.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.857+0000 7f91067fc700 1 -- 172.21.15.37:0/3423561746 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f9110084c50 con 0x7f91180b0be0 2023-10-06T02:26:17.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.858+0000 7f911659c700 1 --2- 172.21.15.37:0/3423561746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f90f8066f30 0x7f90f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:17.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.858+0000 7f911659c700 1 --2- 172.21.15.37:0/3423561746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f90f8066f30 0x7f90f80693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9108009fd0 tx=0x7f9108009880 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:17.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:17.862+0000 7f91067fc700 1 -- 172.21.15.37:0/3423561746 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f911008a020 con 0x7f91180b0be0 2023-10-06T02:26:18.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.103+0000 7f911ca89700 1 -- 172.21.15.37:0/3423561746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9118152f20 con 0x7f91180b0be0 2023-10-06T02:26:18.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.104+0000 7f91067fc700 1 -- 172.21.15.37:0/3423561746 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f9110055780 con 0x7f91180b0be0 2023-10-06T02:26:18.106 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:26:18.106 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/1914186828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1914186828},{"type":"v1","addr":"172.21.15.191:6836","nonce":1914186828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3684230798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":3684230798},{"type":"v1","addr":"172.21.15.191:6837","nonce":3684230798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1883185549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1883185549},{"type":"v1","addr":"172.21.15.37:6834","nonce":1883185549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:25:48.166318+0000","modified":"2023-10-06T02:25:51.793825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3956166862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3956166862},{"type":"v1","addr":"172.21.15.37:6835","nonce":3956166862}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:26:18.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.106+0000 7f911ca89700 1 -- 172.21.15.37:0/3423561746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f90f8066f30 msgr2=0x7f90f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.106+0000 7f911ca89700 1 --2- 172.21.15.37:0/3423561746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f90f8066f30 0x7f90f80693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9108009fd0 tx=0x7f9108009880 comp rx=0 tx=0).stop 2023-10-06T02:26:18.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.106+0000 7f911ca89700 1 -- 172.21.15.37:0/3423561746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91180b0be0 msgr2=0x7f91180978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.106+0000 7f911ca89700 1 --2- 172.21.15.37:0/3423561746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91180b0be0 0x7f91180978e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f911000d890 tx=0x7f9110008040 comp rx=0 tx=0).stop 2023-10-06T02:26:18.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.106+0000 7f911ca89700 1 -- 172.21.15.37:0/3423561746 shutdown_connections 2023-10-06T02:26:18.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.106+0000 7f911ca89700 1 --2- 172.21.15.37:0/3423561746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91180b0be0 0x7f91180978e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.106+0000 7f911ca89700 1 --2- 172.21.15.37:0/3423561746 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f911806a9e0 0x7f91180acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.106+0000 7f911ca89700 1 --2- 172.21.15.37:0/3423561746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f90f8066f30 0x7f90f80693e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.106+0000 7f911ca89700 1 --2- 172.21.15.37:0/3423561746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91180adf40 0x7f9118141e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.106+0000 7f911ca89700 1 -- 172.21.15.37:0/3423561746 >> 172.21.15.37:0/3423561746 conn(0x7f91180cc120 msgr2=0x7f911806a260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:18.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.106+0000 7f911ca89700 1 -- 172.21.15.37:0/3423561746 shutdown_connections 2023-10-06T02:26:18.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.106+0000 7f911ca89700 1 -- 172.21.15.37:0/3423561746 wait complete. 2023-10-06T02:26:18.110 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 31 2023-10-06T02:26:18.119 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-10-06T02:26:18.265 INFO:teuthology.orchestra.run.smithi037.stdout:{"message":"","return_code":0} 2023-10-06T02:26:18.266 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T02:26:18.266 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi037.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:26:18.266 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:26:18.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:26:18.267 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:26:18.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:26:18.282 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:26:18.282 DEBUG:teuthology.orchestra.run.smithi037:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-06T02:26:18.324 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start / repair,recursive 2023-10-06T02:26:18.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.445+0000 7f503aaaa700 1 Processor -- start 2023-10-06T02:26:18.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.446+0000 7f503aaaa700 1 -- start start 2023-10-06T02:26:18.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.446+0000 7f503aaaa700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5034142f70 0x7f50340b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.446+0000 7f503aaaa700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5034143340 0x7f5034067990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.446+0000 7f503aaaa700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503415e3f0 con 0x7f5034067ed0 2023-10-06T02:26:18.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.446+0000 7f503aaaa700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5034068330 con 0x7f5034142f70 2023-10-06T02:26:18.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.446+0000 7f503aaaa700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50340b13c0 con 0x7f5034143340 2023-10-06T02:26:18.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.447+0000 7f5038846700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5034142f70 0x7f50340b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.447+0000 7f5039047700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5034067ed0 0x7f5034068ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48508/0 (socket says 172.21.15.37:48508) 2023-10-06T02:26:18.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.447+0000 7f5039047700 1 -- 172.21.15.37:0/3651572515 learned_addr learned my addr 172.21.15.37:0/3651572515 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:26:18.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.447+0000 7f5033fff700 1 --2- 172.21.15.37:0/3651572515 >> v2:172.21.15.191:3300/0 conn(0x7f5034143340 0x7f5034067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.447+0000 7f5038846700 1 -- 172.21.15.37:0/3651572515 >> v2:172.21.15.191:3300/0 conn(0x7f5034143340 msgr2=0x7f5034067990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.447+0000 7f5038846700 1 --2- 172.21.15.37:0/3651572515 >> v2:172.21.15.191:3300/0 conn(0x7f5034143340 0x7f5034067990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.447+0000 7f5038846700 1 -- 172.21.15.37:0/3651572515 >> v1:172.21.15.37:6789/0 conn(0x7f5034067ed0 legacy=0x7f5034068ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.447+0000 7f50337fe700 1 -- 172.21.15.37:0/3651572515 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896370600 0 0) 0x7f503415e3f0 con 0x7f5034067ed0 2023-10-06T02:26:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.447+0000 7f5038846700 1 -- 172.21.15.37:0/3651572515 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503415d7e0 con 0x7f5034142f70 2023-10-06T02:26:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.447+0000 7f5033fff700 1 --2- 172.21.15.37:0/3651572515 >> v2:172.21.15.191:3300/0 conn(0x7f5034143340 0x7f5034067990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.447+0000 7f5038846700 1 --2- 172.21.15.37:0/3651572515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5034142f70 0x7f50340b18a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f503415d380 tx=0x7f50280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c5dabe38242d9e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.447+0000 7f50337fe700 1 -- 172.21.15.37:0/3651572515 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502800b6b0 con 0x7f5034142f70 2023-10-06T02:26:18.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.447+0000 7f50337fe700 1 -- 172.21.15.37:0/3651572515 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502800b810 con 0x7f5034142f70 2023-10-06T02:26:18.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.447+0000 7f50337fe700 1 -- 172.21.15.37:0/3651572515 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502800bbb0 con 0x7f5034142f70 2023-10-06T02:26:18.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.448+0000 7f503aaaa700 1 -- 172.21.15.37:0/3651572515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5034142f70 msgr2=0x7f50340b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.448+0000 7f503aaaa700 1 --2- 172.21.15.37:0/3651572515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5034142f70 0x7f50340b18a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f503415d380 tx=0x7f50280091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.448+0000 7f503aaaa700 1 -- 172.21.15.37:0/3651572515 shutdown_connections 2023-10-06T02:26:18.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.448+0000 7f503aaaa700 1 --2- 172.21.15.37:0/3651572515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5034142f70 0x7f50340b18a0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.448+0000 7f503aaaa700 1 --2- 172.21.15.37:0/3651572515 >> v2:172.21.15.191:3300/0 conn(0x7f5034143340 0x7f5034067990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.448+0000 7f503aaaa700 1 -- 172.21.15.37:0/3651572515 >> 172.21.15.37:0/3651572515 conn(0x7f50340ce360 msgr2=0x7f50340ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:18.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.448+0000 7f503aaaa700 1 -- 172.21.15.37:0/3651572515 shutdown_connections 2023-10-06T02:26:18.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.448+0000 7f503aaaa700 1 -- 172.21.15.37:0/3651572515 wait complete. 2023-10-06T02:26:18.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.449+0000 7f503aaaa700 1 Processor -- start 2023-10-06T02:26:18.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.449+0000 7f503aaaa700 1 -- start start 2023-10-06T02:26:18.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.450+0000 7f503aaaa700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5034067ed0 0x7f50340c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.450+0000 7f503aaaa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5034142f70 0x7f5034141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.450+0000 7f503aaaa700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5034143340 0x7f5034158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.450+0000 7f503aaaa700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340c93a0 con 0x7f5034142f70 2023-10-06T02:26:18.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.450+0000 7f503aaaa700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340c8de0 con 0x7f5034143340 2023-10-06T02:26:18.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.450+0000 7f503aaaa700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50340c90c0 con 0x7f5034067ed0 2023-10-06T02:26:18.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.450+0000 7f5033fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5034142f70 0x7f5034141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.450+0000 7f5033fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5034142f70 0x7f5034141f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40308/0 (socket says 172.21.15.37:40308) 2023-10-06T02:26:18.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.450+0000 7f5033fff700 1 -- 172.21.15.37:0/2965724244 learned_addr learned my addr 172.21.15.37:0/2965724244 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:18.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.451+0000 7f5039047700 1 --2- 172.21.15.37:0/2965724244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5034143340 0x7f5034158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.451+0000 7f5038846700 1 --2- 172.21.15.37:0/2965724244 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5034067ed0 0x7f50340c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.451+0000 7f5033fff700 1 -- 172.21.15.37:0/2965724244 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5034067ed0 msgr2=0x7f50340c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.451+0000 7f5033fff700 1 --2- 172.21.15.37:0/2965724244 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5034067ed0 0x7f50340c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.451+0000 7f5033fff700 1 -- 172.21.15.37:0/2965724244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5034143340 msgr2=0x7f5034158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.451+0000 7f5033fff700 1 --2- 172.21.15.37:0/2965724244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5034143340 0x7f5034158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.451+0000 7f5033fff700 1 -- 172.21.15.37:0/2965724244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5028009420 con 0x7f5034142f70 2023-10-06T02:26:18.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.451+0000 7f5039047700 1 --2- 172.21.15.37:0/2965724244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5034143340 0x7f5034158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:18.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.451+0000 7f5033fff700 1 --2- 172.21.15.37:0/2965724244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5034142f70 0x7f5034141f20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f502000c850 tx=0x7f5020008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.451+0000 7f5030ff9700 1 -- 172.21.15.37:0/2965724244 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020011600 con 0x7f5034142f70 2023-10-06T02:26:18.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.451+0000 7f5030ff9700 1 -- 172.21.15.37:0/2965724244 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5020011760 con 0x7f5034142f70 2023-10-06T02:26:18.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.451+0000 7f503aaaa700 1 -- 172.21.15.37:0/2965724244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50340c9880 con 0x7f5034142f70 2023-10-06T02:26:18.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.451+0000 7f5030ff9700 1 -- 172.21.15.37:0/2965724244 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020011b00 con 0x7f5034142f70 2023-10-06T02:26:18.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.451+0000 7f503aaaa700 1 -- 172.21.15.37:0/2965724244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50340c8a20 con 0x7f5034142f70 2023-10-06T02:26:18.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.453+0000 7f5030ff9700 1 -- 172.21.15.37:0/2965724244 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f50200073b0 con 0x7f5034142f70 2023-10-06T02:26:18.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.453+0000 7f5030ff9700 1 --2- 172.21.15.37:0/2965724244 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5018066f30 0x7f50180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.453+0000 7f5030ff9700 1 -- 172.21.15.37:0/2965724244 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f5020084680 con 0x7f5034142f70 2023-10-06T02:26:18.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.453+0000 7f5038846700 1 --2- 172.21.15.37:0/2965724244 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5018066f30 0x7f50180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.454+0000 7f5038846700 1 --2- 172.21.15.37:0/2965724244 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5018066f30 0x7f50180693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5028003080 tx=0x7f5028017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.455+0000 7f5043da2b80 1 Processor -- start 2023-10-06T02:26:18.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.455+0000 7f5043da2b80 1 -- start start 2023-10-06T02:26:18.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f5043da2b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a7603f910 0x559a7603fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f5043da2b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a76040d90 0x559a7608f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f5043da2b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a7608fcd0 0x559a76090120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f5043da2b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a75f96b40 con 0x559a76040d90 2023-10-06T02:26:18.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f5043da2b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a75f94340 con 0x559a7608fcd0 2023-10-06T02:26:18.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f5043da2b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a75f90130 con 0x559a7603f910 2023-10-06T02:26:18.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f5033fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a76040d90 0x559a7608f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f5033fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a76040d90 0x559a7608f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40320/0 (socket says 172.21.15.37:40320) 2023-10-06T02:26:18.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f5033fff700 1 -- 172.21.15.37:0/1746677697 learned_addr learned my addr 172.21.15.37:0/1746677697 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:18.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f5038846700 1 --2- 172.21.15.37:0/1746677697 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a7603f910 0x559a7603fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f5039047700 1 --2- 172.21.15.37:0/1746677697 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a7608fcd0 0x559a76090120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f5033fff700 1 -- 172.21.15.37:0/1746677697 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a7603f910 msgr2=0x559a7603fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f5033fff700 1 --2- 172.21.15.37:0/1746677697 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a7603f910 0x559a7603fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f5033fff700 1 -- 172.21.15.37:0/1746677697 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a7608fcd0 msgr2=0x559a76090120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f5033fff700 1 --2- 172.21.15.37:0/1746677697 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a7608fcd0 0x559a76090120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f5033fff700 1 -- 172.21.15.37:0/1746677697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a75e2a340 con 0x559a76040d90 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f5039047700 1 --2- 172.21.15.37:0/1746677697 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a7608fcd0 0x559a76090120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f5033fff700 1 --2- 172.21.15.37:0/1746677697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a76040d90 0x559a7608f790 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f50200829d0 tx=0x7f5020082930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa833261ecb7726c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f501dffb700 1 -- 172.21.15.37:0/1746677697 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50200553e0 con 0x559a76040d90 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f501dffb700 1 -- 172.21.15.37:0/1746677697 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5020058630 con 0x559a76040d90 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.456+0000 7f501dffb700 1 -- 172.21.15.37:0/1746677697 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502005c380 con 0x559a76040d90 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.457+0000 7f5043da2b80 1 -- 172.21.15.37:0/1746677697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a76040d90 msgr2=0x559a7608f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.457+0000 7f5043da2b80 1 --2- 172.21.15.37:0/1746677697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a76040d90 0x559a7608f790 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f50200829d0 tx=0x7f5020082930 comp rx=0 tx=0).stop 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.457+0000 7f5043da2b80 1 -- 172.21.15.37:0/1746677697 shutdown_connections 2023-10-06T02:26:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.457+0000 7f5043da2b80 1 --2- 172.21.15.37:0/1746677697 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a7608fcd0 0x559a76090120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.457+0000 7f5043da2b80 1 --2- 172.21.15.37:0/1746677697 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a7603f910 0x559a7603fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.457+0000 7f5043da2b80 1 --2- 172.21.15.37:0/1746677697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a76040d90 0x559a7608f790 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.457+0000 7f5043da2b80 1 -- 172.21.15.37:0/1746677697 >> 172.21.15.37:0/1746677697 conn(0x559a76041230 msgr2=0x559a76041600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:18.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.457+0000 7f5043da2b80 1 -- 172.21.15.37:0/1746677697 shutdown_connections 2023-10-06T02:26:18.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.457+0000 7f5043da2b80 1 -- 172.21.15.37:0/1746677697 wait complete. 2023-10-06T02:26:18.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.458+0000 7f5043da2b80 1 -- start start 2023-10-06T02:26:18.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.458+0000 7f5043da2b80 1 Processor -- start 2023-10-06T02:26:18.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5043da2b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7603f910 0x559a7603c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5043da2b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a76040d90 0x559a76086170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5043da2b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a7608fcd0 0x559a760866b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5043da2b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a75f3b960 con 0x559a7603f910 2023-10-06T02:26:18.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5043da2b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a75f56f70 con 0x559a76040d90 2023-10-06T02:26:18.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5043da2b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a75e12f00 con 0x559a7608fcd0 2023-10-06T02:26:18.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5043da2b80 10 client.0 _ll_register_callbacks cb 0x559a76002f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:26:18.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5038846700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7603f910 0x559a7603c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5038846700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7603f910 0x559a7603c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40330/0 (socket says 172.21.15.37:40330) 2023-10-06T02:26:18.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5038846700 1 -- 172.21.15.37:0/3175981627 learned_addr learned my addr 172.21.15.37:0/3175981627 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:18.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5033fff700 1 --2- 172.21.15.37:0/3175981627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a76040d90 0x559a76086170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5039047700 1 --2- 172.21.15.37:0/3175981627 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a7608fcd0 0x559a760866b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5038846700 1 -- 172.21.15.37:0/3175981627 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a7608fcd0 msgr2=0x559a760866b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5038846700 1 --2- 172.21.15.37:0/3175981627 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a7608fcd0 0x559a760866b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5038846700 1 -- 172.21.15.37:0/3175981627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a76040d90 msgr2=0x559a76086170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5038846700 1 --2- 172.21.15.37:0/3175981627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a76040d90 0x559a76086170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5038846700 1 -- 172.21.15.37:0/3175981627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50340c8a20 con 0x559a7603f910 2023-10-06T02:26:18.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5038846700 1 --2- 172.21.15.37:0/3175981627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7603f910 0x559a7603c720 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f50340b0e20 tx=0x7f502801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4349f3bc4b52581 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5012ffd700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:26:18.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5012ffd700 1 -- 172.21.15.37:0/3175981627 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502801a640 con 0x559a7603f910 2023-10-06T02:26:18.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5012ffd700 1 -- 172.21.15.37:0/3175981627 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f502801a7a0 con 0x559a7603f910 2023-10-06T02:26:18.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.459+0000 7f5043da2b80 1 -- 172.21.15.37:0/3175981627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559a76034a10 con 0x559a7603f910 2023-10-06T02:26:18.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.460+0000 7f5012ffd700 1 -- 172.21.15.37:0/3175981627 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f502801ab90 con 0x559a7603f910 2023-10-06T02:26:18.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.460+0000 7f5043da2b80 10 client.6081 fetch_fsmap learned FSMap version 31 2023-10-06T02:26:18.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.460+0000 7f5043da2b80 1 -- 172.21.15.37:0/3175981627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x559a75dcd0b0 con 0x559a7603f910 2023-10-06T02:26:18.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.460+0000 7f5012ffd700 1 -- 172.21.15.37:0/3175981627 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559a76034a10 con 0x559a7603f910 2023-10-06T02:26:18.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.460+0000 7f5012ffd700 1 -- 172.21.15.37:0/3175981627 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f502801acf0 con 0x559a7603f910 2023-10-06T02:26:18.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.460+0000 7f5043da2b80 10 client.6081 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T02:26:18.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.460+0000 7f5043da2b80 10 client.6081 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T02:26:18.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.460+0000 7f5043da2b80 20 client.6081 populate_metadata read hostname 'smithi037' 2023-10-06T02:26:18.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.460+0000 7f5043da2b80 1 --2- 172.21.15.37:0/3175981627 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x559a76065c40 0x559a76099850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.460+0000 7f5043da2b80 4 client.6081 mds_command: new command op to 5823 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:26:18.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.460+0000 7f5043da2b80 1 -- 172.21.15.37:0/3175981627 --> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559a76011940 con 0x559a76065c40 2023-10-06T02:26:18.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.460+0000 7f5033fff700 1 --2- 172.21.15.37:0/3175981627 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x559a76065c40 0x559a76099850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.460+0000 7f5012ffd700 10 client.6081 ms_handle_connect on v2:172.21.15.37:6833/3956166862 2023-10-06T02:26:18.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.460+0000 7f5033fff700 1 --2- 172.21.15.37:0/3175981627 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x559a76065c40 0x559a76099850 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17f0d9182ab6a4cb server_cookie=78dc3b0ea1e3838e in_seq=0 out_seq=0 2023-10-06T02:26:18.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.461+0000 7f5012ffd700 1 -- 172.21.15.37:0/3175981627 <== mds.0 v2:172.21.15.37:6833/3956166862 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x559a76011940 con 0x559a76065c40 2023-10-06T02:26:18.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.461+0000 7f5012ffd700 10 client.6081 handle_command_reply: tid=0 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.461+0000 7f5043da2b80 1 client.6081 shutdown 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.461+0000 7f5043da2b80 1 -- 172.21.15.37:0/3175981627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7603f910 msgr2=0x559a7603c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.461+0000 7f5043da2b80 1 --2- 172.21.15.37:0/3175981627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7603f910 0x559a7603c720 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f50340b0e20 tx=0x7f502801e040 comp rx=0 tx=0).stop 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.461+0000 7f5043da2b80 1 -- 172.21.15.37:0/3175981627 shutdown_connections 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.461+0000 7f5043da2b80 1 --2- 172.21.15.37:0/3175981627 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x559a76065c40 0x559a76099850 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.461+0000 7f5043da2b80 1 --2- 172.21.15.37:0/3175981627 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a7608fcd0 0x559a760866b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.461+0000 7f5043da2b80 1 --2- 172.21.15.37:0/3175981627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7603f910 0x559a7603c720 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.461+0000 7f5012ffd700 0 client.6081 ms_handle_reset on v2:172.21.15.37:6833/3956166862 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.461+0000 7f5043da2b80 1 --2- 172.21.15.37:0/3175981627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a76040d90 0x559a76086170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.461+0000 7f5043da2b80 1 -- 172.21.15.37:0/3175981627 >> 172.21.15.37:0/3175981627 conn(0x559a76041230 msgr2=0x559a76040280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.461+0000 7f5043da2b80 1 -- 172.21.15.37:0/3175981627 shutdown_connections 2023-10-06T02:26:18.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.461+0000 7f5043da2b80 1 -- 172.21.15.37:0/3175981627 wait complete. 2023-10-06T02:26:18.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.461+0000 7f5043da2b80 20 client.6081 trim_cache size 0 max 16384 2023-10-06T02:26:18.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.469+0000 7fd28217b700 1 Processor -- start 2023-10-06T02:26:18.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.469+0000 7fd28217b700 1 -- start start 2023-10-06T02:26:18.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.470+0000 7fd28217b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd27c0ce6c0 0x7fd27c0cb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.470+0000 7fd28217b700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd27c0ccb50 con 0x7fd27c0cbba0 2023-10-06T02:26:18.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.470+0000 7fd28217b700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd27c15a1c0 con 0x7fd27c159620 2023-10-06T02:26:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.470+0000 7fd28217b700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27c0ceb30 con 0x7fd27c0ce6c0 2023-10-06T02:26:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.470+0000 7fd27affd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd27c0ce6c0 0x7fd27c0cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.470+0000 7fd27bfff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd27c0cbba0 0x7fd27c0d0430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48520/0 (socket says 172.21.15.37:48520) 2023-10-06T02:26:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.470+0000 7fd27affd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd27c0ce6c0 0x7fd27c0cb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40342/0 (socket says 172.21.15.37:40342) 2023-10-06T02:26:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.470+0000 7fd27bfff700 1 -- 172.21.15.37:0/1472069127 learned_addr learned my addr 172.21.15.37:0/1472069127 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:26:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.470+0000 7fd27affd700 1 -- 172.21.15.37:0/1472069127 >> v1:172.21.15.191:6789/0 conn(0x7fd27c159620 legacy=0x7fd27c1599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.470+0000 7fd27affd700 1 -- 172.21.15.37:0/1472069127 >> v1:172.21.15.37:6789/0 conn(0x7fd27c0cbba0 legacy=0x7fd27c0d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.470+0000 7fd27a7fc700 1 -- 172.21.15.37:0/1472069127 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829149413 0 0) 0x7fd27c0ccb50 con 0x7fd27c0cbba0 2023-10-06T02:26:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.470+0000 7fd27affd700 1 -- 172.21.15.37:0/1472069127 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c15a4a0 con 0x7fd27c0ce6c0 2023-10-06T02:26:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.471+0000 7fd27affd700 1 --2- 172.21.15.37:0/1472069127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd27c0ce6c0 0x7fd27c0cb660 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd270009860 tx=0x7fd2700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db8f0be3aa7f61 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.471+0000 7fd27a7fc700 1 -- 172.21.15.37:0/1472069127 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270011630 con 0x7fd27c0ce6c0 2023-10-06T02:26:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.471+0000 7fd27a7fc700 1 -- 172.21.15.37:0/1472069127 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd270011790 con 0x7fd27c0ce6c0 2023-10-06T02:26:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.471+0000 7fd27a7fc700 1 -- 172.21.15.37:0/1472069127 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270011b50 con 0x7fd27c0ce6c0 2023-10-06T02:26:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.471+0000 7fd28217b700 1 -- 172.21.15.37:0/1472069127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd27c0ce6c0 msgr2=0x7fd27c0cb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.471+0000 7fd28217b700 1 --2- 172.21.15.37:0/1472069127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd27c0ce6c0 0x7fd27c0cb660 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd270009860 tx=0x7fd2700091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.471+0000 7fd28217b700 1 -- 172.21.15.37:0/1472069127 shutdown_connections 2023-10-06T02:26:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.471+0000 7fd28217b700 1 --2- 172.21.15.37:0/1472069127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd27c0ce6c0 0x7fd27c0cb660 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.471+0000 7fd28217b700 1 -- 172.21.15.37:0/1472069127 >> 172.21.15.37:0/1472069127 conn(0x7fd27c06c0b0 msgr2=0x7fd27c06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.471+0000 7fd28217b700 1 -- 172.21.15.37:0/1472069127 shutdown_connections 2023-10-06T02:26:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.471+0000 7fd28217b700 1 -- 172.21.15.37:0/1472069127 wait complete. 2023-10-06T02:26:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.473+0000 7fd28217b700 1 Processor -- start 2023-10-06T02:26:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.473+0000 7fd28217b700 1 -- start start 2023-10-06T02:26:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.473+0000 7fd28217b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd27c0cbba0 0x7fd27c0b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.473+0000 7fd28217b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd27c0ce6c0 0x7fd27c0b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.473+0000 7fd28217b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd27c159620 0x7fd27c0b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.473+0000 7fd28217b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c1498e0 con 0x7fd27c0cbba0 2023-10-06T02:26:18.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.473+0000 7fd28217b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c0b4230 con 0x7fd27c0ce6c0 2023-10-06T02:26:18.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.473+0000 7fd28217b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c0b4510 con 0x7fd27c159620 2023-10-06T02:26:18.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.473+0000 7fd27b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd27c0cbba0 0x7fd27c0b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.473+0000 7fd27b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd27c0cbba0 0x7fd27c0b1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40350/0 (socket says 172.21.15.37:40350) 2023-10-06T02:26:18.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.473+0000 7fd27b7fe700 1 -- 172.21.15.37:0/4026382078 learned_addr learned my addr 172.21.15.37:0/4026382078 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:18.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.474+0000 7fd27affd700 1 --2- 172.21.15.37:0/4026382078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd27c0ce6c0 0x7fd27c0b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.474+0000 7fd27bfff700 1 --2- 172.21.15.37:0/4026382078 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd27c159620 0x7fd27c0b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.474+0000 7fd27b7fe700 1 -- 172.21.15.37:0/4026382078 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd27c159620 msgr2=0x7fd27c0b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.474+0000 7fd27b7fe700 1 --2- 172.21.15.37:0/4026382078 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd27c159620 0x7fd27c0b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.474+0000 7fd27b7fe700 1 -- 172.21.15.37:0/4026382078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd27c0ce6c0 msgr2=0x7fd27c0b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.474+0000 7fd27b7fe700 1 --2- 172.21.15.37:0/4026382078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd27c0ce6c0 0x7fd27c0b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.474+0000 7fd27b7fe700 1 -- 172.21.15.37:0/4026382078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd270009420 con 0x7fd27c0cbba0 2023-10-06T02:26:18.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.474+0000 7fd27b7fe700 1 --2- 172.21.15.37:0/4026382078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd27c0cbba0 0x7fd27c0b1bf0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd26c00c810 tx=0x7fd26c007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.474+0000 7fd2637fe700 1 -- 172.21.15.37:0/4026382078 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c011590 con 0x7fd27c0cbba0 2023-10-06T02:26:18.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.474+0000 7fd2637fe700 1 -- 172.21.15.37:0/4026382078 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c011710 con 0x7fd27c0cbba0 2023-10-06T02:26:18.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.474+0000 7fd28217b700 1 -- 172.21.15.37:0/4026382078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27c0b47f0 con 0x7fd27c0cbba0 2023-10-06T02:26:18.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.474+0000 7fd2637fe700 1 -- 172.21.15.37:0/4026382078 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c011ad0 con 0x7fd27c0cbba0 2023-10-06T02:26:18.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.474+0000 7fd28217b700 1 -- 172.21.15.37:0/4026382078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27c0b4db0 con 0x7fd27c0cbba0 2023-10-06T02:26:18.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.475+0000 7fd28217b700 1 -- 172.21.15.37:0/4026382078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fd27c063de0 con 0x7fd27c0cbba0 2023-10-06T02:26:18.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.476+0000 7fd2637fe700 1 -- 172.21.15.37:0/4026382078 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd26c01b3b0 con 0x7fd27c0cbba0 2023-10-06T02:26:18.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.476+0000 7fd2637fe700 1 --2- 172.21.15.37:0/4026382078 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd268066f60 0x7fd268069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.476+0000 7fd2637fe700 1 -- 172.21.15.37:0/4026382078 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fd26c083c40 con 0x7fd27c0cbba0 2023-10-06T02:26:18.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.476+0000 7fd27affd700 1 --2- 172.21.15.37:0/4026382078 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd268066f60 0x7fd268069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.476+0000 7fd2637fe700 1 -- 172.21.15.37:0/4026382078 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+513 (secure 0 0 0) 0x7fd26c086330 con 0x7fd27c0cbba0 2023-10-06T02:26:18.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.476+0000 7fd28217b700 1 -- 172.21.15.37:0/4026382078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fd27c14a970 con 0x7fd27c0cbba0 2023-10-06T02:26:18.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.477+0000 7fd27affd700 1 --2- 172.21.15.37:0/4026382078 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd268066f60 0x7fd268069410 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd2700093f0 tx=0x7fd270016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.479+0000 7f5043da2b80 1 Processor -- start 2023-10-06T02:26:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.479+0000 7f5043da2b80 1 -- start start 2023-10-06T02:26:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.479+0000 7f5043da2b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a7603f910 0x559a7603b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.479+0000 7f5043da2b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a76040d90 0x559a76080440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.479+0000 7f5043da2b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7608fcd0 0x559a760e35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.479+0000 7f5043da2b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a76040560 con 0x559a7608fcd0 2023-10-06T02:26:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.479+0000 7f5043da2b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a7603e2c0 con 0x559a7603f910 2023-10-06T02:26:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.479+0000 7f5043da2b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a76081410 con 0x559a76040d90 2023-10-06T02:26:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.480+0000 7f5039047700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7608fcd0 0x559a760e35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.480+0000 7f5039047700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7608fcd0 0x559a760e35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40356/0 (socket says 172.21.15.37:40356) 2023-10-06T02:26:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.480+0000 7f5039047700 1 -- 172.21.15.37:0/4292363736 learned_addr learned my addr 172.21.15.37:0/4292363736 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.480+0000 7f5033fff700 1 --2- 172.21.15.37:0/4292363736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a76040d90 0x559a76080440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.480+0000 7f5038846700 1 --2- 172.21.15.37:0/4292363736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a7603f910 0x559a7603b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.480+0000 7f5039047700 1 -- 172.21.15.37:0/4292363736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a76040d90 msgr2=0x559a76080440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.480+0000 7f5039047700 1 --2- 172.21.15.37:0/4292363736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a76040d90 0x559a76080440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.480+0000 7f5039047700 1 -- 172.21.15.37:0/4292363736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a7603f910 msgr2=0x559a7603b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.480+0000 7f5039047700 1 --2- 172.21.15.37:0/4292363736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a7603f910 0x559a7603b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.480+0000 7f5039047700 1 -- 172.21.15.37:0/4292363736 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a75f5e850 con 0x559a7608fcd0 2023-10-06T02:26:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.480+0000 7f5039047700 1 --2- 172.21.15.37:0/4292363736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7608fcd0 0x559a760e35a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f502c0020b0 tx=0x7f502c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f741ff963ee3c20 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.480+0000 7f501e7fc700 1 -- 172.21.15.37:0/4292363736 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c01a030 con 0x559a7608fcd0 2023-10-06T02:26:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.480+0000 7f501e7fc700 1 -- 172.21.15.37:0/4292363736 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502c007a40 con 0x559a7608fcd0 2023-10-06T02:26:18.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.480+0000 7f501e7fc700 1 -- 172.21.15.37:0/4292363736 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c015670 con 0x559a7608fcd0 2023-10-06T02:26:18.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.481+0000 7f5043da2b80 1 -- 172.21.15.37:0/4292363736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7608fcd0 msgr2=0x559a760e35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.481+0000 7f5043da2b80 1 --2- 172.21.15.37:0/4292363736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7608fcd0 0x559a760e35a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f502c0020b0 tx=0x7f502c009040 comp rx=0 tx=0).stop 2023-10-06T02:26:18.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.481+0000 7f5043da2b80 1 -- 172.21.15.37:0/4292363736 shutdown_connections 2023-10-06T02:26:18.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.481+0000 7f5043da2b80 1 --2- 172.21.15.37:0/4292363736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7608fcd0 0x559a760e35a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.481+0000 7f5043da2b80 1 --2- 172.21.15.37:0/4292363736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a7603f910 0x559a7603b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.481+0000 7f5043da2b80 1 --2- 172.21.15.37:0/4292363736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a76040d90 0x559a76080440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.481+0000 7f5043da2b80 1 -- 172.21.15.37:0/4292363736 >> 172.21.15.37:0/4292363736 conn(0x559a76041230 msgr2=0x559a7606f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:18.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.481+0000 7f5043da2b80 1 -- 172.21.15.37:0/4292363736 shutdown_connections 2023-10-06T02:26:18.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.481+0000 7f5043da2b80 1 -- 172.21.15.37:0/4292363736 wait complete. 2023-10-06T02:26:18.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.481+0000 7f5043da2b80 1 -- start start 2023-10-06T02:26:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.482+0000 7f5043da2b80 1 Processor -- start 2023-10-06T02:26:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.482+0000 7f5043da2b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a7603f910 0x559a760e4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.482+0000 7f5043da2b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a76040d90 0x559a76089fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.482+0000 7f5043da2b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7608fcd0 0x559a7608a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.482+0000 7f5043da2b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a76082590 con 0x559a7608fcd0 2023-10-06T02:26:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.482+0000 7f5043da2b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a76082060 con 0x559a76040d90 2023-10-06T02:26:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.482+0000 7f5043da2b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a760e6cf0 con 0x559a7603f910 2023-10-06T02:26:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.482+0000 7f5043da2b80 10 client.0 _ll_register_callbacks cb 0x559a76002f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:26:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.483+0000 7f5039047700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7608fcd0 0x559a7608a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.483+0000 7f5039047700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7608fcd0 0x559a7608a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40370/0 (socket says 172.21.15.37:40370) 2023-10-06T02:26:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.483+0000 7f5039047700 1 -- 172.21.15.37:0/1398640383 learned_addr learned my addr 172.21.15.37:0/1398640383 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.483+0000 7f5033fff700 1 --2- 172.21.15.37:0/1398640383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a76040d90 0x559a76089fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.483+0000 7f5038846700 1 --2- 172.21.15.37:0/1398640383 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a7603f910 0x559a760e4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.483+0000 7f5039047700 1 -- 172.21.15.37:0/1398640383 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a7603f910 msgr2=0x559a760e4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.483+0000 7f5039047700 1 --2- 172.21.15.37:0/1398640383 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a7603f910 0x559a760e4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.483+0000 7f5039047700 1 -- 172.21.15.37:0/1398640383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a76040d90 msgr2=0x559a76089fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.483+0000 7f5039047700 1 --2- 172.21.15.37:0/1398640383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a76040d90 0x559a76089fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.483+0000 7f5039047700 1 -- 172.21.15.37:0/1398640383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f502c001de0 con 0x559a7608fcd0 2023-10-06T02:26:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.483+0000 7f5039047700 1 --2- 172.21.15.37:0/1398640383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7608fcd0 0x559a7608a520 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f502c004fd0 tx=0x7f502c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb773077ce448a3c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.483+0000 7f5012ffd700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:26:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.483+0000 7f5012ffd700 1 -- 172.21.15.37:0/1398640383 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c015cf0 con 0x559a7608fcd0 2023-10-06T02:26:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.483+0000 7f5012ffd700 1 -- 172.21.15.37:0/1398640383 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f502c01b070 con 0x559a7608fcd0 2023-10-06T02:26:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.483+0000 7f5043da2b80 1 -- 172.21.15.37:0/1398640383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5020058630 con 0x559a7608fcd0 2023-10-06T02:26:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.483+0000 7f5012ffd700 1 -- 172.21.15.37:0/1398640383 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f502c015e50 con 0x559a7608fcd0 2023-10-06T02:26:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.483+0000 7f5043da2b80 10 client.6096 fetch_fsmap learned FSMap version 31 2023-10-06T02:26:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.483+0000 7f5043da2b80 1 -- 172.21.15.37:0/1398640383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x559a75f45540 con 0x559a7608fcd0 2023-10-06T02:26:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.484+0000 7f5012ffd700 1 -- 172.21.15.37:0/1398640383 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502c02f020 con 0x559a7608fcd0 2023-10-06T02:26:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.484+0000 7f5012ffd700 1 -- 172.21.15.37:0/1398640383 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f502c012050 con 0x559a7608fcd0 2023-10-06T02:26:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.484+0000 7f5043da2b80 10 client.6096 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T02:26:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.484+0000 7f5043da2b80 10 client.6096 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T02:26:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.484+0000 7f5043da2b80 20 client.6096 populate_metadata read hostname 'smithi037' 2023-10-06T02:26:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.484+0000 7f5043da2b80 1 --2- 172.21.15.37:0/1398640383 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x559a76082da0 0x559a7608aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.484+0000 7f5043da2b80 4 client.6096 mds_command: new command op to 5823 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2023-10-06T02:26:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.484+0000 7f5043da2b80 1 -- 172.21.15.37:0/1398640383 --> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x559a75f32ed0 con 0x559a76082da0 2023-10-06T02:26:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.484+0000 7f5038846700 1 --2- 172.21.15.37:0/1398640383 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x559a76082da0 0x559a7608aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.484+0000 7f5012ffd700 10 client.6096 ms_handle_connect on v2:172.21.15.37:6833/3956166862 2023-10-06T02:26:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.484+0000 7f5038846700 1 --2- 172.21.15.37:0/1398640383 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x559a76082da0 0x559a7608aa60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4ec8a64d73476f8 server_cookie=42ccf256af419b9f in_seq=0 out_seq=0 2023-10-06T02:26:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.485+0000 7f5012ffd700 1 -- 172.21.15.37:0/1398640383 <== mds.0 v2:172.21.15.37:6833/3956166862 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x559a75f32ed0 con 0x559a76082da0 2023-10-06T02:26:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.485+0000 7f5012ffd700 10 client.6096 handle_command_reply: tid=0 2023-10-06T02:26:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.485+0000 7f5043da2b80 1 client.6096 shutdown 2023-10-06T02:26:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.485+0000 7f5043da2b80 1 -- 172.21.15.37:0/1398640383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7608fcd0 msgr2=0x559a7608a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.485+0000 7f5043da2b80 1 --2- 172.21.15.37:0/1398640383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7608fcd0 0x559a7608a520 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f502c004fd0 tx=0x7f502c01d000 comp rx=0 tx=0).stop 2023-10-06T02:26:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.485+0000 7f5043da2b80 1 -- 172.21.15.37:0/1398640383 shutdown_connections 2023-10-06T02:26:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.485+0000 7f5043da2b80 1 --2- 172.21.15.37:0/1398640383 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x559a76082da0 0x559a7608aa60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.485+0000 7f5043da2b80 1 --2- 172.21.15.37:0/1398640383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a7608fcd0 0x559a7608a520 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.485+0000 7f5043da2b80 1 --2- 172.21.15.37:0/1398640383 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a7603f910 0x559a760e4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.485+0000 7f5043da2b80 1 --2- 172.21.15.37:0/1398640383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a76040d90 0x559a76089fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.485+0000 7f5043da2b80 1 -- 172.21.15.37:0/1398640383 >> 172.21.15.37:0/1398640383 conn(0x559a76041230 msgr2=0x559a76080440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:18.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.485+0000 7f5012ffd700 0 client.6096 ms_handle_reset on v2:172.21.15.37:6833/3956166862 2023-10-06T02:26:18.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.485+0000 7f5043da2b80 1 -- 172.21.15.37:0/1398640383 shutdown_connections 2023-10-06T02:26:18.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.485+0000 7f5043da2b80 1 -- 172.21.15.37:0/1398640383 wait complete. 2023-10-06T02:26:18.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.486+0000 7f5043da2b80 20 client.6096 trim_cache size 0 max 16384 2023-10-06T02:26:18.510 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:26:18.510 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2023-10-06T02:26:18.511 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "fa488709-8381-41a0-9f81-f73d88bec26d", 2023-10-06T02:26:18.511 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2023-10-06T02:26:18.511 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:26:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.486+0000 7f503aaaa700 1 -- 172.21.15.37:0/2965724244 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5018066f30 msgr2=0x7f50180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.486+0000 7f503aaaa700 1 --2- 172.21.15.37:0/2965724244 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5018066f30 0x7f50180693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5028003080 tx=0x7f5028017000 comp rx=0 tx=0).stop 2023-10-06T02:26:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.486+0000 7f503aaaa700 1 -- 172.21.15.37:0/2965724244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5034142f70 msgr2=0x7f5034141f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.486+0000 7f503aaaa700 1 --2- 172.21.15.37:0/2965724244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5034142f70 0x7f5034141f20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f502000c850 tx=0x7f5020008040 comp rx=0 tx=0).stop 2023-10-06T02:26:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.486+0000 7f503aaaa700 1 -- 172.21.15.37:0/2965724244 shutdown_connections 2023-10-06T02:26:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.486+0000 7f503aaaa700 1 --2- 172.21.15.37:0/2965724244 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5018066f30 0x7f50180693e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.486+0000 7f503aaaa700 1 --2- 172.21.15.37:0/2965724244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5034143340 0x7f5034158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.486+0000 7f503aaaa700 1 --2- 172.21.15.37:0/2965724244 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5034067ed0 0x7f50340c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.486+0000 7f503aaaa700 1 --2- 172.21.15.37:0/2965724244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5034142f70 0x7f5034141f20 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.486+0000 7f503aaaa700 1 -- 172.21.15.37:0/2965724244 >> 172.21.15.37:0/2965724244 conn(0x7f50340ce360 msgr2=0x7f5034141360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.486+0000 7f503aaaa700 1 -- 172.21.15.37:0/2965724244 shutdown_connections 2023-10-06T02:26:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.486+0000 7f503aaaa700 1 -- 172.21.15.37:0/2965724244 wait complete. 2023-10-06T02:26:18.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-10-06T02:26:18.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.633+0000 7fb9ee0f7700 1 Processor -- start 2023-10-06T02:26:18.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.633+0000 7fb9ee0f7700 1 -- start start 2023-10-06T02:26:18.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.634+0000 7fb9ee0f7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb9e80ca7d0 0x7fb9e806c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.634+0000 7fb9ee0f7700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb9e80aee30 0x7fb9e81590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.634+0000 7fb9ee0f7700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e806d4d0 con 0x7fb9e80caba0 2023-10-06T02:26:18.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.634+0000 7fb9ee0f7700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e806c5f0 con 0x7fb9e80ca7d0 2023-10-06T02:26:18.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.634+0000 7fb9ee0f7700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e806c8c0 con 0x7fb9e80aee30 2023-10-06T02:26:18.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.634+0000 7fb9e77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb9e80ca7d0 0x7fb9e806c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.634+0000 7fb9e7fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb9e80caba0 0x7fb9e815d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48526/0 (socket says 172.21.15.37:48526) 2023-10-06T02:26:18.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.634+0000 7fb9e7fff700 1 -- 172.21.15.37:0/1994178842 learned_addr learned my addr 172.21.15.37:0/1994178842 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:26:18.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.634+0000 7fb9e6ffd700 1 --2- 172.21.15.37:0/1994178842 >> v2:172.21.15.191:3300/0 conn(0x7fb9e80aee30 0x7fb9e81590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.634+0000 7fb9e77fe700 1 -- 172.21.15.37:0/1994178842 >> v2:172.21.15.191:3300/0 conn(0x7fb9e80aee30 msgr2=0x7fb9e81590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.634+0000 7fb9e77fe700 1 --2- 172.21.15.37:0/1994178842 >> v2:172.21.15.191:3300/0 conn(0x7fb9e80aee30 0x7fb9e81590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.634+0000 7fb9e77fe700 1 -- 172.21.15.37:0/1994178842 >> v1:172.21.15.37:6789/0 conn(0x7fb9e80caba0 legacy=0x7fb9e815d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.634+0000 7fb9e77fe700 1 -- 172.21.15.37:0/1994178842 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e806cba0 con 0x7fb9e80ca7d0 2023-10-06T02:26:18.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.634+0000 7fb9e67fc700 1 -- 172.21.15.37:0/1994178842 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365154814 0 0) 0x7fb9e806d4d0 con 0x7fb9e80caba0 2023-10-06T02:26:18.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.635+0000 7fb9e77fe700 1 --2- 172.21.15.37:0/1994178842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e80ca7d0 0x7fb9e806c0b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80cc910 tx=0x7fb9d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e94fd76f4db87d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.635+0000 7fb9e67fc700 1 -- 172.21.15.37:0/1994178842 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8011630 con 0x7fb9e80ca7d0 2023-10-06T02:26:18.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.635+0000 7fb9e67fc700 1 -- 172.21.15.37:0/1994178842 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d8011790 con 0x7fb9e80ca7d0 2023-10-06T02:26:18.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.635+0000 7fb9e67fc700 1 -- 172.21.15.37:0/1994178842 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8011b30 con 0x7fb9e80ca7d0 2023-10-06T02:26:18.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.635+0000 7fb9ee0f7700 1 -- 172.21.15.37:0/1994178842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e80ca7d0 msgr2=0x7fb9e806c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.635+0000 7fb9ee0f7700 1 --2- 172.21.15.37:0/1994178842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e80ca7d0 0x7fb9e806c0b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80cc910 tx=0x7fb9d80091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.635+0000 7fb9ee0f7700 1 -- 172.21.15.37:0/1994178842 shutdown_connections 2023-10-06T02:26:18.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.635+0000 7fb9ee0f7700 1 --2- 172.21.15.37:0/1994178842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e80ca7d0 0x7fb9e806c0b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.635+0000 7fb9ee0f7700 1 --2- 172.21.15.37:0/1994178842 >> v2:172.21.15.191:3300/0 conn(0x7fb9e80aee30 0x7fb9e81590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.635+0000 7fb9ee0f7700 1 -- 172.21.15.37:0/1994178842 >> 172.21.15.37:0/1994178842 conn(0x7fb9e80cd480 msgr2=0x7fb9e80c9420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:18.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.635+0000 7fb9ee0f7700 1 -- 172.21.15.37:0/1994178842 shutdown_connections 2023-10-06T02:26:18.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.635+0000 7fb9ee0f7700 1 -- 172.21.15.37:0/1994178842 wait complete. 2023-10-06T02:26:18.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.637+0000 7fb9ee0f7700 1 Processor -- start 2023-10-06T02:26:18.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.637+0000 7fb9ee0f7700 1 -- start start 2023-10-06T02:26:18.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.637+0000 7fb9ee0f7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb9e80aee30 0x7fb9e816ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.637+0000 7fb9ee0f7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e80ca7d0 0x7fb9e80c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.637+0000 7fb9ee0f7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9e80caba0 0x7fb9e80c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.637+0000 7fb9ee0f7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80c3660 con 0x7fb9e80ca7d0 2023-10-06T02:26:18.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.637+0000 7fb9ee0f7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80b1260 con 0x7fb9e80caba0 2023-10-06T02:26:18.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.637+0000 7fb9ee0f7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e816cf60 con 0x7fb9e80aee30 2023-10-06T02:26:18.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.637+0000 7fb9e6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e80ca7d0 0x7fb9e80c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.637+0000 7fb9e6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e80ca7d0 0x7fb9e80c6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40386/0 (socket says 172.21.15.37:40386) 2023-10-06T02:26:18.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.637+0000 7fb9e6ffd700 1 -- 172.21.15.37:0/4059380464 learned_addr learned my addr 172.21.15.37:0/4059380464 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:18.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.638+0000 7fb9e6ffd700 1 -- 172.21.15.37:0/4059380464 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb9e80aee30 msgr2=0x7fb9e816ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.638+0000 7fb9e6ffd700 1 --2- 172.21.15.37:0/4059380464 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb9e80aee30 0x7fb9e816ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.638+0000 7fb9e6ffd700 1 -- 172.21.15.37:0/4059380464 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9e80caba0 msgr2=0x7fb9e80c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.638+0000 7fb9e6ffd700 1 --2- 172.21.15.37:0/4059380464 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9e80caba0 0x7fb9e80c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.638+0000 7fb9e6ffd700 1 -- 172.21.15.37:0/4059380464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d8009420 con 0x7fb9e80ca7d0 2023-10-06T02:26:18.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.638+0000 7fb9e6ffd700 1 --2- 172.21.15.37:0/4059380464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e80ca7d0 0x7fb9e80c6ca0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00ece0 tx=0x7fb9dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.638+0000 7fb9cf7fe700 1 -- 172.21.15.37:0/4059380464 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc00c9d0 con 0x7fb9e80ca7d0 2023-10-06T02:26:18.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.638+0000 7fb9cf7fe700 1 -- 172.21.15.37:0/4059380464 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc00cb30 con 0x7fb9e80ca7d0 2023-10-06T02:26:18.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.638+0000 7fb9cf7fe700 1 -- 172.21.15.37:0/4059380464 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc00ced0 con 0x7fb9e80ca7d0 2023-10-06T02:26:18.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.638+0000 7fb9ee0f7700 1 -- 172.21.15.37:0/4059380464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e80b0650 con 0x7fb9e80ca7d0 2023-10-06T02:26:18.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.638+0000 7fb9ee0f7700 1 -- 172.21.15.37:0/4059380464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e80b0c10 con 0x7fb9e80ca7d0 2023-10-06T02:26:18.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.640+0000 7fb9cf7fe700 1 -- 172.21.15.37:0/4059380464 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb9dc013680 con 0x7fb9e80ca7d0 2023-10-06T02:26:18.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.640+0000 7fb9cf7fe700 1 --2- 172.21.15.37:0/4059380464 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb9d4066f30 0x7fb9d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.640+0000 7fb9cf7fe700 1 -- 172.21.15.37:0/4059380464 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fb9dc084ac0 con 0x7fb9e80ca7d0 2023-10-06T02:26:18.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.640+0000 7fb9e77fe700 1 --2- 172.21.15.37:0/4059380464 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb9d4066f30 0x7fb9d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.641+0000 7fb9e77fe700 1 --2- 172.21.15.37:0/4059380464 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb9d4066f30 0x7fb9d40693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80c7870 tx=0x7fb9d8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.642+0000 7fb9f73efb80 1 Processor -- start 2023-10-06T02:26:18.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.642+0000 7fb9f73efb80 1 -- start start 2023-10-06T02:26:18.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.643+0000 7fb9f73efb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40c97890 0x562b40c97c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.643+0000 7fb9f73efb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562b40c98d10 0x562b40ce7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.643+0000 7fb9f73efb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40ce7c50 0x562b40ce80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.643+0000 7fb9f73efb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b40beeac0 con 0x562b40ce7c50 2023-10-06T02:26:18.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.643+0000 7fb9f73efb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b40bec2c0 con 0x562b40c97890 2023-10-06T02:26:18.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.643+0000 7fb9f73efb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b40be80b0 con 0x562b40c98d10 2023-10-06T02:26:18.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.643+0000 7fb9e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40ce7c50 0x562b40ce80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.643+0000 7fb9e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40ce7c50 0x562b40ce80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40400/0 (socket says 172.21.15.37:40400) 2023-10-06T02:26:18.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.643+0000 7fb9e77fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40c97890 0x562b40c97c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.643+0000 7fb9e6ffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562b40c98d10 0x562b40ce7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.643+0000 7fb9e7fff700 1 -- 172.21.15.37:0/2406940278 learned_addr learned my addr 172.21.15.37:0/2406940278 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:18.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.643+0000 7fb9e7fff700 1 -- 172.21.15.37:0/2406940278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562b40c98d10 msgr2=0x562b40ce7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.643+0000 7fb9e7fff700 1 --2- 172.21.15.37:0/2406940278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562b40c98d10 0x562b40ce7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.643+0000 7fb9e7fff700 1 -- 172.21.15.37:0/2406940278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40c97890 msgr2=0x562b40c97c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.643+0000 7fb9e7fff700 1 --2- 172.21.15.37:0/2406940278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40c97890 0x562b40c97c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.643+0000 7fb9e7fff700 1 -- 172.21.15.37:0/2406940278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b40a822c0 con 0x562b40ce7c50 2023-10-06T02:26:18.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.643+0000 7fb9e6ffd700 1 --2- 172.21.15.37:0/2406940278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562b40c98d10 0x562b40ce7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:26:18.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.643+0000 7fb9e7fff700 1 --2- 172.21.15.37:0/2406940278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40ce7c50 0x562b40ce80a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0002110 tx=0x7fb9e00019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79885479e4ded46 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.644+0000 7fb9ccff9700 1 -- 172.21.15.37:0/2406940278 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e000cb70 con 0x562b40ce7c50 2023-10-06T02:26:18.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.644+0000 7fb9ccff9700 1 -- 172.21.15.37:0/2406940278 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e000ccd0 con 0x562b40ce7c50 2023-10-06T02:26:18.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.644+0000 7fb9ccff9700 1 -- 172.21.15.37:0/2406940278 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0007320 con 0x562b40ce7c50 2023-10-06T02:26:18.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.644+0000 7fb9f73efb80 1 -- 172.21.15.37:0/2406940278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40ce7c50 msgr2=0x562b40ce80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.644+0000 7fb9f73efb80 1 --2- 172.21.15.37:0/2406940278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40ce7c50 0x562b40ce80a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0002110 tx=0x7fb9e00019b0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.644+0000 7fb9f73efb80 1 -- 172.21.15.37:0/2406940278 shutdown_connections 2023-10-06T02:26:18.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.644+0000 7fb9f73efb80 1 --2- 172.21.15.37:0/2406940278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40ce7c50 0x562b40ce80a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.644+0000 7fb9f73efb80 1 --2- 172.21.15.37:0/2406940278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40c97890 0x562b40c97c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.644+0000 7fb9f73efb80 1 --2- 172.21.15.37:0/2406940278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562b40c98d10 0x562b40ce7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.644+0000 7fb9f73efb80 1 -- 172.21.15.37:0/2406940278 >> 172.21.15.37:0/2406940278 conn(0x562b40c991b0 msgr2=0x562b40c99580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:18.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.644+0000 7fb9f73efb80 1 -- 172.21.15.37:0/2406940278 shutdown_connections 2023-10-06T02:26:18.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.645+0000 7fb9f73efb80 1 -- 172.21.15.37:0/2406940278 wait complete. 2023-10-06T02:26:18.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.645+0000 7fb9f73efb80 1 -- start start 2023-10-06T02:26:18.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.645+0000 7fb9f73efb80 1 Processor -- start 2023-10-06T02:26:18.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.646+0000 7fb9f73efb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562b40c97890 0x562b40cc4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.646+0000 7fb9f73efb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40c98d10 0x562b40cc64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.646+0000 7fb9f73efb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40ce7c50 0x562b40cc6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.646+0000 7fb9f73efb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b40b938e0 con 0x562b40c98d10 2023-10-06T02:26:18.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.646+0000 7fb9f73efb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b40baeef0 con 0x562b40ce7c50 2023-10-06T02:26:18.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.646+0000 7fb9f73efb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b40a6ae80 con 0x562b40c97890 2023-10-06T02:26:18.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.646+0000 7fb9f73efb80 10 client.0 _ll_register_callbacks cb 0x562b40c5aec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:26:18.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.646+0000 7fb9e6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40c98d10 0x562b40cc64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.646+0000 7fb9e6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40c98d10 0x562b40cc64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40402/0 (socket says 172.21.15.37:40402) 2023-10-06T02:26:18.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.646+0000 7fb9e6ffd700 1 -- 172.21.15.37:0/4285468718 learned_addr learned my addr 172.21.15.37:0/4285468718 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:18.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.646+0000 7fb9e77fe700 1 --2- 172.21.15.37:0/4285468718 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562b40c97890 0x562b40cc4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.646+0000 7fb9e7fff700 1 --2- 172.21.15.37:0/4285468718 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40ce7c50 0x562b40cc6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.646+0000 7fb9e6ffd700 1 -- 172.21.15.37:0/4285468718 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562b40c97890 msgr2=0x562b40cc4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.646+0000 7fb9e6ffd700 1 --2- 172.21.15.37:0/4285468718 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562b40c97890 0x562b40cc4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.646+0000 7fb9e6ffd700 1 -- 172.21.15.37:0/4285468718 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40ce7c50 msgr2=0x562b40cc6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.646+0000 7fb9e6ffd700 1 --2- 172.21.15.37:0/4285468718 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40ce7c50 0x562b40cc6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.646+0000 7fb9e6ffd700 1 -- 172.21.15.37:0/4285468718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e80b0c10 con 0x562b40c98d10 2023-10-06T02:26:18.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.646+0000 7fb9e6ffd700 1 --2- 172.21.15.37:0/4285468718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40c98d10 0x562b40cc64f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc055520 tx=0x7fb9dc082d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f567dedb1931a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.646+0000 7fb9c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:26:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.647+0000 7fb9c5ffb700 1 -- 172.21.15.37:0/4285468718 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc054d10 con 0x562b40c98d10 2023-10-06T02:26:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.647+0000 7fb9c5ffb700 1 -- 172.21.15.37:0/4285468718 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fb9dc06be40 con 0x562b40c98d10 2023-10-06T02:26:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.647+0000 7fb9f73efb80 1 -- 172.21.15.37:0/4285468718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b40c8c990 con 0x562b40c98d10 2023-10-06T02:26:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.647+0000 7fb9c5ffb700 1 -- 172.21.15.37:0/4285468718 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9dc05c330 con 0x562b40c98d10 2023-10-06T02:26:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.647+0000 7fb9f73efb80 10 client.6111 fetch_fsmap learned FSMap version 31 2023-10-06T02:26:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.647+0000 7fb9f73efb80 1 -- 172.21.15.37:0/4285468718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x7fb9e0001c90 con 0x562b40c98d10 2023-10-06T02:26:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.647+0000 7fb9c5ffb700 1 -- 172.21.15.37:0/4285468718 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562b40c8c990 con 0x562b40c98d10 2023-10-06T02:26:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.647+0000 7fb9c5ffb700 1 -- 172.21.15.37:0/4285468718 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb9dc071260 con 0x562b40c98d10 2023-10-06T02:26:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.647+0000 7fb9f73efb80 10 client.6111 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T02:26:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.647+0000 7fb9f73efb80 10 client.6111 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T02:26:18.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.647+0000 7fb9f73efb80 20 client.6111 populate_metadata read hostname 'smithi037' 2023-10-06T02:26:18.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.647+0000 7fb9f73efb80 1 --2- 172.21.15.37:0/4285468718 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x562b40cc6f70 0x562b40cc2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.647+0000 7fb9f73efb80 4 client.6111 mds_command: new command op to 5823 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:26:18.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.647+0000 7fb9f73efb80 1 -- 172.21.15.37:0/4285468718 --> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b40c698c0 con 0x562b40cc6f70 2023-10-06T02:26:18.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.647+0000 7fb9e77fe700 1 --2- 172.21.15.37:0/4285468718 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x562b40cc6f70 0x562b40cc2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.648+0000 7fb9c5ffb700 10 client.6111 ms_handle_connect on v2:172.21.15.37:6833/3956166862 2023-10-06T02:26:18.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.648+0000 7fb9e77fe700 1 --2- 172.21.15.37:0/4285468718 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x562b40cc6f70 0x562b40cc2830 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4db68536dd29f86 server_cookie=75d7a7666b019840 in_seq=0 out_seq=0 2023-10-06T02:26:18.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.648+0000 7fb9c5ffb700 1 -- 172.21.15.37:0/4285468718 <== mds.0 v2:172.21.15.37:6833/3956166862 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x562b40c698c0 con 0x562b40cc6f70 2023-10-06T02:26:18.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.648+0000 7fb9c5ffb700 10 client.6111 handle_command_reply: tid=0 2023-10-06T02:26:18.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.648+0000 7fb9f73efb80 1 client.6111 shutdown 2023-10-06T02:26:18.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.648+0000 7fb9f73efb80 1 -- 172.21.15.37:0/4285468718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40c98d10 msgr2=0x562b40cc64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.648+0000 7fb9f73efb80 1 --2- 172.21.15.37:0/4285468718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40c98d10 0x562b40cc64f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc055520 tx=0x7fb9dc082d70 comp rx=0 tx=0).stop 2023-10-06T02:26:18.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.648+0000 7fb9f73efb80 1 -- 172.21.15.37:0/4285468718 shutdown_connections 2023-10-06T02:26:18.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.648+0000 7fb9f73efb80 1 --2- 172.21.15.37:0/4285468718 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x562b40cc6f70 0x562b40cc2830 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.648+0000 7fb9f73efb80 1 --2- 172.21.15.37:0/4285468718 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40ce7c50 0x562b40cc6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.648+0000 7fb9f73efb80 1 --2- 172.21.15.37:0/4285468718 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562b40c97890 0x562b40cc4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.648+0000 7fb9c5ffb700 0 client.6111 ms_handle_reset on v2:172.21.15.37:6833/3956166862 2023-10-06T02:26:18.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.648+0000 7fb9f73efb80 1 --2- 172.21.15.37:0/4285468718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40c98d10 0x562b40cc64f0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.648+0000 7fb9f73efb80 1 -- 172.21.15.37:0/4285468718 >> 172.21.15.37:0/4285468718 conn(0x562b40c991b0 msgr2=0x562b40c98200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:18.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.648+0000 7fb9f73efb80 1 -- 172.21.15.37:0/4285468718 shutdown_connections 2023-10-06T02:26:18.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.648+0000 7fb9f73efb80 1 -- 172.21.15.37:0/4285468718 wait complete. 2023-10-06T02:26:18.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.648+0000 7fb9f73efb80 20 client.6111 trim_cache size 0 max 16384 2023-10-06T02:26:18.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.664+0000 7fb9f73efb80 1 Processor -- start 2023-10-06T02:26:18.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.665+0000 7fb9f73efb80 1 -- start start 2023-10-06T02:26:18.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.665+0000 7fb9f73efb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562b40c97890 0x562b40d3ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.665+0000 7fb9f73efb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40c98d10 0x562b40cc64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.665+0000 7fb9f73efb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40ce7c50 0x562b40cd8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.665+0000 7fb9f73efb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b40cd8da0 con 0x562b40c98d10 2023-10-06T02:26:18.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.665+0000 7fb9f73efb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b40c70230 con 0x562b40ce7c50 2023-10-06T02:26:18.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.665+0000 7fb9f73efb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b40c97d00 con 0x562b40c97890 2023-10-06T02:26:18.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.665+0000 7fb9e6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40c98d10 0x562b40cc64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.665+0000 7fb9e6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40c98d10 0x562b40cc64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40418/0 (socket says 172.21.15.37:40418) 2023-10-06T02:26:18.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.665+0000 7fb9e6ffd700 1 -- 172.21.15.37:0/331378257 learned_addr learned my addr 172.21.15.37:0/331378257 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:18.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.666+0000 7fb9e6ffd700 1 -- 172.21.15.37:0/331378257 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562b40c97890 msgr2=0x562b40d3ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.666+0000 7fb9e6ffd700 1 --2- 172.21.15.37:0/331378257 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562b40c97890 0x562b40d3ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.666+0000 7fb9e6ffd700 1 -- 172.21.15.37:0/331378257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40ce7c50 msgr2=0x562b40cd8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.666+0000 7fb9e7fff700 1 --2- 172.21.15.37:0/331378257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40ce7c50 0x562b40cd8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.666+0000 7fb9e6ffd700 1 --2- 172.21.15.37:0/331378257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40ce7c50 0x562b40cd8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.666+0000 7fb9e6ffd700 1 -- 172.21.15.37:0/331378257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b40a25030 con 0x562b40c98d10 2023-10-06T02:26:18.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.666+0000 7fb9e7fff700 1 --2- 172.21.15.37:0/331378257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40ce7c50 0x562b40cd8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:18.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.666+0000 7fb9e6ffd700 1 --2- 172.21.15.37:0/331378257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40c98d10 0x562b40cc64f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00c7c0 tx=0x7fb9dc06d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db8333219736d4d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.666+0000 7fb9cd7fa700 1 -- 172.21.15.37:0/331378257 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc054d10 con 0x562b40c98d10 2023-10-06T02:26:18.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.666+0000 7fb9cd7fa700 1 -- 172.21.15.37:0/331378257 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc05c330 con 0x562b40c98d10 2023-10-06T02:26:18.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.666+0000 7fb9cd7fa700 1 -- 172.21.15.37:0/331378257 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc055360 con 0x562b40c98d10 2023-10-06T02:26:18.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.666+0000 7fb9f73efb80 1 -- 172.21.15.37:0/331378257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40c98d10 msgr2=0x562b40cc64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.666+0000 7fb9f73efb80 1 --2- 172.21.15.37:0/331378257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40c98d10 0x562b40cc64f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00c7c0 tx=0x7fb9dc06d000 comp rx=0 tx=0).stop 2023-10-06T02:26:18.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.666+0000 7fb9f73efb80 1 -- 172.21.15.37:0/331378257 shutdown_connections 2023-10-06T02:26:18.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.666+0000 7fb9f73efb80 1 --2- 172.21.15.37:0/331378257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40ce7c50 0x562b40cd8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.666+0000 7fb9f73efb80 1 --2- 172.21.15.37:0/331378257 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562b40c97890 0x562b40d3ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.666+0000 7fb9f73efb80 1 --2- 172.21.15.37:0/331378257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40c98d10 0x562b40cc64f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.666+0000 7fb9f73efb80 1 -- 172.21.15.37:0/331378257 >> 172.21.15.37:0/331378257 conn(0x562b40c991b0 msgr2=0x562b40c9acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:18.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.666+0000 7fb9f73efb80 1 -- 172.21.15.37:0/331378257 shutdown_connections 2023-10-06T02:26:18.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.666+0000 7fb9f73efb80 1 -- 172.21.15.37:0/331378257 wait complete. 2023-10-06T02:26:18.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.667+0000 7fb9f73efb80 1 -- start start 2023-10-06T02:26:18.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.667+0000 7fb9f73efb80 1 Processor -- start 2023-10-06T02:26:18.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.668+0000 7fb9f73efb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40c97890 0x562b40cf0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.668+0000 7fb9f73efb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562b40c98d10 0x562b40cf0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.668+0000 7fb9f73efb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40ce7c50 0x562b40cbd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.668+0000 7fb9f73efb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b40cd53b0 con 0x562b40ce7c50 2023-10-06T02:26:18.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.668+0000 7fb9f73efb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b40cbeb30 con 0x562b40c97890 2023-10-06T02:26:18.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.668+0000 7fb9f73efb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b40cd4e50 con 0x562b40c98d10 2023-10-06T02:26:18.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.668+0000 7fb9f73efb80 10 client.0 _ll_register_callbacks cb 0x562b40c5aec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:26:18.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.668+0000 7fb9e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40ce7c50 0x562b40cbd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.668+0000 7fb9e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40ce7c50 0x562b40cbd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40420/0 (socket says 172.21.15.37:40420) 2023-10-06T02:26:18.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.668+0000 7fb9e7fff700 1 -- 172.21.15.37:0/4017699061 learned_addr learned my addr 172.21.15.37:0/4017699061 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:18.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.668+0000 7fb9e6ffd700 1 --2- 172.21.15.37:0/4017699061 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562b40c98d10 0x562b40cf0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.668+0000 7fb9e77fe700 1 --2- 172.21.15.37:0/4017699061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40c97890 0x562b40cf0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.668+0000 7fb9e7fff700 1 -- 172.21.15.37:0/4017699061 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562b40c98d10 msgr2=0x562b40cf0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.668+0000 7fb9e7fff700 1 --2- 172.21.15.37:0/4017699061 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562b40c98d10 0x562b40cf0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.668+0000 7fb9e7fff700 1 -- 172.21.15.37:0/4017699061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40c97890 msgr2=0x562b40cf0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:18.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.668+0000 7fb9e7fff700 1 --2- 172.21.15.37:0/4017699061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40c97890 0x562b40cf0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.668+0000 7fb9e7fff700 1 -- 172.21.15.37:0/4017699061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e0001c90 con 0x562b40ce7c50 2023-10-06T02:26:18.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.668+0000 7fb9e77fe700 1 --2- 172.21.15.37:0/4017699061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40c97890 0x562b40cf0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:18.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.668+0000 7fb9e7fff700 1 --2- 172.21.15.37:0/4017699061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40ce7c50 0x562b40cbd7f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00020e0 tx=0x7fb9e0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b65bcf79b47cfc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:18.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.668+0000 7fb9c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:26:18.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.669+0000 7fb9c5ffb700 1 -- 172.21.15.37:0/4017699061 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0001480 con 0x562b40ce7c50 2023-10-06T02:26:18.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.669+0000 7fb9c5ffb700 1 -- 172.21.15.37:0/4017699061 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fb9e000ce40 con 0x562b40ce7c50 2023-10-06T02:26:18.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.669+0000 7fb9f73efb80 1 -- 172.21.15.37:0/4017699061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb9e000ccd0 con 0x562b40ce7c50 2023-10-06T02:26:18.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.669+0000 7fb9c5ffb700 1 -- 172.21.15.37:0/4017699061 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9e0007920 con 0x562b40ce7c50 2023-10-06T02:26:18.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.669+0000 7fb9f73efb80 10 client.6117 fetch_fsmap learned FSMap version 31 2023-10-06T02:26:18.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.669+0000 7fb9f73efb80 1 -- 172.21.15.37:0/4017699061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x562b40bb67d0 con 0x562b40ce7c50 2023-10-06T02:26:18.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.669+0000 7fb9c5ffb700 1 -- 172.21.15.37:0/4017699061 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e000ccd0 con 0x562b40ce7c50 2023-10-06T02:26:18.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.669+0000 7fb9c5ffb700 1 -- 172.21.15.37:0/4017699061 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb9e000c0e0 con 0x562b40ce7c50 2023-10-06T02:26:18.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.669+0000 7fb9f73efb80 10 client.6117 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T02:26:18.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.669+0000 7fb9f73efb80 10 client.6117 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T02:26:18.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.669+0000 7fb9f73efb80 20 client.6117 populate_metadata read hostname 'smithi037' 2023-10-06T02:26:18.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.669+0000 7fb9f73efb80 1 --2- 172.21.15.37:0/4017699061 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x562b40cbf540 0x562b40cbdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:18.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.669+0000 7fb9f73efb80 4 client.6117 mds_command: new command op to 5823 tid=0[{"prefix": "scrub status"}] 2023-10-06T02:26:18.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.669+0000 7fb9f73efb80 1 -- 172.21.15.37:0/4017699061 --> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562b40b8ae50 con 0x562b40cbf540 2023-10-06T02:26:18.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.669+0000 7fb9e77fe700 1 --2- 172.21.15.37:0/4017699061 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x562b40cbf540 0x562b40cbdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:18.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.669+0000 7fb9c5ffb700 10 client.6117 ms_handle_connect on v2:172.21.15.37:6833/3956166862 2023-10-06T02:26:18.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.669+0000 7fb9e77fe700 1 --2- 172.21.15.37:0/4017699061 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x562b40cbf540 0x562b40cbdd30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ca3346cab020212 server_cookie=ad614afde7826675 in_seq=0 out_seq=0 2023-10-06T02:26:18.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9c5ffb700 1 -- 172.21.15.37:0/4017699061 <== mds.0 v2:172.21.15.37:6833/3956166862 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x562b40b8ae50 con 0x562b40cbf540 2023-10-06T02:26:18.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9c5ffb700 10 client.6117 handle_command_reply: tid=0 2023-10-06T02:26:18.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9f73efb80 1 client.6117 shutdown 2023-10-06T02:26:18.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9f73efb80 1 -- 172.21.15.37:0/4017699061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40ce7c50 msgr2=0x562b40cbd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9f73efb80 1 --2- 172.21.15.37:0/4017699061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40ce7c50 0x562b40cbd7f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00020e0 tx=0x7fb9e0015000 comp rx=0 tx=0).stop 2023-10-06T02:26:18.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9f73efb80 1 -- 172.21.15.37:0/4017699061 shutdown_connections 2023-10-06T02:26:18.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9f73efb80 1 --2- 172.21.15.37:0/4017699061 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x562b40cbf540 0x562b40cbdd30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9f73efb80 1 --2- 172.21.15.37:0/4017699061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b40ce7c50 0x562b40cbd7f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9f73efb80 1 --2- 172.21.15.37:0/4017699061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562b40c97890 0x562b40cf0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9f73efb80 1 --2- 172.21.15.37:0/4017699061 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562b40c98d10 0x562b40cf0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9c5ffb700 0 client.6117 ms_handle_reset on v2:172.21.15.37:6833/3956166862 2023-10-06T02:26:18.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9f73efb80 1 -- 172.21.15.37:0/4017699061 >> 172.21.15.37:0/4017699061 conn(0x562b40c991b0 msgr2=0x562b40cc5130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:18.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9f73efb80 1 -- 172.21.15.37:0/4017699061 shutdown_connections 2023-10-06T02:26:18.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9f73efb80 1 -- 172.21.15.37:0/4017699061 wait complete. 2023-10-06T02:26:18.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9f73efb80 20 client.6117 trim_cache size 0 max 16384 2023-10-06T02:26:18.680 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:26:18.680 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T02:26:18.680 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2023-10-06T02:26:18.680 INFO:teuthology.orchestra.run.smithi037.stdout: "fa488709-8381-41a0-9f81-f73d88bec26d": { 2023-10-06T02:26:18.680 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2023-10-06T02:26:18.680 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "fa488709-8381-41a0-9f81-f73d88bec26d", 2023-10-06T02:26:18.681 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,repair" 2023-10-06T02:26:18.681 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:26:18.681 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:26:18.681 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:26:18.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9ee0f7700 1 -- 172.21.15.37:0/4059380464 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb9d4066f30 msgr2=0x7fb9d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9ee0f7700 1 --2- 172.21.15.37:0/4059380464 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb9d4066f30 0x7fb9d40693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80c7870 tx=0x7fb9d8017000 comp rx=0 tx=0).stop 2023-10-06T02:26:18.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9ee0f7700 1 -- 172.21.15.37:0/4059380464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e80ca7d0 msgr2=0x7fb9e80c6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:18.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9ee0f7700 1 --2- 172.21.15.37:0/4059380464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e80ca7d0 0x7fb9e80c6ca0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00ece0 tx=0x7fb9dc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9ee0f7700 1 -- 172.21.15.37:0/4059380464 shutdown_connections 2023-10-06T02:26:18.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9ee0f7700 1 --2- 172.21.15.37:0/4059380464 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb9d4066f30 0x7fb9d40693e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9ee0f7700 1 --2- 172.21.15.37:0/4059380464 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9e80caba0 0x7fb9e80c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9ee0f7700 1 --2- 172.21.15.37:0/4059380464 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb9e80aee30 0x7fb9e816ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9ee0f7700 1 --2- 172.21.15.37:0/4059380464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e80ca7d0 0x7fb9e80c6ca0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:18.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9ee0f7700 1 -- 172.21.15.37:0/4059380464 >> 172.21.15.37:0/4059380464 conn(0x7fb9e80cd480 msgr2=0x7fb9e814ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:18.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9ee0f7700 1 -- 172.21.15.37:0/4059380464 shutdown_connections 2023-10-06T02:26:18.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.670+0000 7fb9ee0f7700 1 -- 172.21.15.37:0/4059380464 wait complete. 2023-10-06T02:26:18.684 INFO:tasks.cephfs.filesystem:scrub status for tag:fa488709-8381-41a0-9f81-f73d88bec26d - {'path': '/', 'tag': 'fa488709-8381-41a0-9f81-f73d88bec26d', 'options': 'recursive,repair'} 2023-10-06T02:26:18.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:18.868+0000 7fd2637fe700 1 -- 172.21.15.37:0/4026382078 <== mon.0 v2:172.21.15.37:3300/0 7 ==== log(4 entries from seq 1 at 2023-10-06T02:26:18.486385+0000) v1 ==== 695+0+0 (secure 0 0 0) 0x7fd26c0550a0 con 0x7fd27c0cbba0 2023-10-06T02:26:18.869 INFO:teuthology.orchestra.run.smithi037.stdout: cluster: 2023-10-06T02:26:18.870 INFO:teuthology.orchestra.run.smithi037.stdout: id: d1f292a2-fd8c-430a-be88-f44de408e77c 2023-10-06T02:26:18.870 INFO:teuthology.orchestra.run.smithi037.stdout: health: HEALTH_OK 2023-10-06T02:26:18.870 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:26:18.870 INFO:teuthology.orchestra.run.smithi037.stdout: services: 2023-10-06T02:26:18.870 INFO:teuthology.orchestra.run.smithi037.stdout: mon: 3 daemons, quorum a,b,c (age 3m) 2023-10-06T02:26:18.870 INFO:teuthology.orchestra.run.smithi037.stdout: mgr: x(active, since 3m), standbys: y 2023-10-06T02:26:18.870 INFO:teuthology.orchestra.run.smithi037.stdout: mds: 1/1 daemons up, 3 standby 2023-10-06T02:26:18.870 INFO:teuthology.orchestra.run.smithi037.stdout: osd: 8 osds: 8 up (since 3m), 8 in (since 3m) 2023-10-06T02:26:18.870 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:26:18.870 INFO:teuthology.orchestra.run.smithi037.stdout: data: 2023-10-06T02:26:18.871 INFO:teuthology.orchestra.run.smithi037.stdout: volumes: 1/1 healthy 2023-10-06T02:26:18.871 INFO:teuthology.orchestra.run.smithi037.stdout: pools: 4 pools, 105 pgs 2023-10-06T02:26:18.872 INFO:teuthology.orchestra.run.smithi037.stdout: objects: 30 objects, 19 MiB 2023-10-06T02:26:18.872 INFO:teuthology.orchestra.run.smithi037.stdout: usage: 2.3 GiB used, 718 GiB / 720 GiB avail 2023-10-06T02:26:18.872 INFO:teuthology.orchestra.run.smithi037.stdout: pgs: 105 active+clean 2023-10-06T02:26:18.872 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:26:18.872 INFO:teuthology.orchestra.run.smithi037.stdout: io: 2023-10-06T02:26:18.872 INFO:teuthology.orchestra.run.smithi037.stdout: client: 85 B/s rd, 1.0 MiB/s wr, 0 op/s rd, 2 op/s wr 2023-10-06T02:26:18.872 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:26:18.872 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:26:18.872 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:26:18.486385+0000 mds.c [INF] scrub queued for path: / 2023-10-06T02:26:18.872 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:26:18.486388+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2023-10-06T02:26:18.872 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:26:18.486392+0000 mds.c [INF] scrub summary: active paths [/] 2023-10-06T02:26:18.873 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:26:18.487616+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2023-10-06T02:26:21.686 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:26:21.689 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:26:22.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:22.877+0000 7fd2637fe700 1 -- 172.21.15.37:0/4026382078 <== mon.0 v2:172.21.15.37:3300/0 8 ==== log(1 entries from seq 5 at 2023-10-06T02:26:22.703895+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7fd26c0549a0 con 0x7fd27c0cbba0 2023-10-06T02:26:22.879 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:26:22.703895+0000 mds.c [INF] scrub summary: idle 2023-10-06T02:26:48.684 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-10-06T02:26:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.819+0000 7f31486fe700 1 Processor -- start 2023-10-06T02:26:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.819+0000 7f31486fe700 1 -- start start 2023-10-06T02:26:48.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.820+0000 7f31486fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f31401593c0 0x7f3140159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.820+0000 7f31486fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31400ccb30 0x7f31400ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.820+0000 7f31486fe700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31400b07a0 con 0x7f31400b2380 2023-10-06T02:26:48.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.820+0000 7f31486fe700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31400cd8a0 con 0x7f31400ccb30 2023-10-06T02:26:48.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.820+0000 7f31486fe700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31400afe70 con 0x7f31401593c0 2023-10-06T02:26:48.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.821+0000 7f3146c9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31400ccb30 0x7f31400ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.821+0000 7f3146c9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31400ccb30 0x7f31400ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38908/0 (socket says 172.21.15.37:38908) 2023-10-06T02:26:48.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.821+0000 7f3146c9b700 1 -- 172.21.15.37:0/1767980052 learned_addr learned my addr 172.21.15.37:0/1767980052 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:48.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.821+0000 7f314649a700 1 --2- 172.21.15.37:0/1767980052 >> v2:172.21.15.191:3300/0 conn(0x7f31401593c0 0x7f3140159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.821+0000 7f3146c9b700 1 -- 172.21.15.37:0/1767980052 >> v2:172.21.15.191:3300/0 conn(0x7f31401593c0 msgr2=0x7f3140159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:48.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.821+0000 7f3146c9b700 1 --2- 172.21.15.37:0/1767980052 >> v2:172.21.15.191:3300/0 conn(0x7f31401593c0 0x7f3140159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.821+0000 7f3146c9b700 1 -- 172.21.15.37:0/1767980052 >> v1:172.21.15.191:6789/0 conn(0x7f31400b2380 legacy=0x7f31400b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.821+0000 7f3146c9b700 1 -- 172.21.15.37:0/1767980052 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31400b0150 con 0x7f31400ccb30 2023-10-06T02:26:48.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.821+0000 7f3146c9b700 1 --2- 172.21.15.37:0/1767980052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31400ccb30 0x7f31400ccf90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f314006d520 tx=0x7f3138009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0a052fa58e8652 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:48.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.821+0000 7f3145498700 1 -- 172.21.15.37:0/1767980052 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3138009e70 con 0x7f31400ccb30 2023-10-06T02:26:48.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.821+0000 7f3145498700 1 -- 172.21.15.37:0/1767980052 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313800b860 con 0x7f31400ccb30 2023-10-06T02:26:48.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.821+0000 7f3145498700 1 -- 172.21.15.37:0/1767980052 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313800bc00 con 0x7f31400ccb30 2023-10-06T02:26:48.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.822+0000 7f31486fe700 1 -- 172.21.15.37:0/1767980052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31400ccb30 msgr2=0x7f31400ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.822+0000 7f31486fe700 1 --2- 172.21.15.37:0/1767980052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31400ccb30 0x7f31400ccf90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f314006d520 tx=0x7f3138009250 comp rx=0 tx=0).stop 2023-10-06T02:26:48.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.822+0000 7f31486fe700 1 -- 172.21.15.37:0/1767980052 shutdown_connections 2023-10-06T02:26:48.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.822+0000 7f31486fe700 1 --2- 172.21.15.37:0/1767980052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31400ccb30 0x7f31400ccf90 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.822+0000 7f31486fe700 1 --2- 172.21.15.37:0/1767980052 >> v2:172.21.15.191:3300/0 conn(0x7f31401593c0 0x7f3140159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.822+0000 7f31486fe700 1 -- 172.21.15.37:0/1767980052 >> 172.21.15.37:0/1767980052 conn(0x7f314006c0b0 msgr2=0x7f314006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:48.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.822+0000 7f31486fe700 1 -- 172.21.15.37:0/1767980052 shutdown_connections 2023-10-06T02:26:48.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.822+0000 7f31486fe700 1 -- 172.21.15.37:0/1767980052 wait complete. 2023-10-06T02:26:48.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.823+0000 7f31486fe700 1 Processor -- start 2023-10-06T02:26:48.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.823+0000 7f31486fe700 1 -- start start 2023-10-06T02:26:48.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.824+0000 7f31486fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31400b2380 0x7f3140144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.824+0000 7f31486fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31400ccb30 0x7f31400c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.824+0000 7f31486fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31401593c0 0x7f31400c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.824+0000 7f31486fe700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314015dea0 con 0x7f31400b2380 2023-10-06T02:26:48.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.824+0000 7f31486fe700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31401449c0 con 0x7f31401593c0 2023-10-06T02:26:48.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.824+0000 7f31486fe700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31400c8060 con 0x7f31400ccb30 2023-10-06T02:26:48.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.824+0000 7f314649a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31400b2380 0x7f3140144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.824+0000 7f314649a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31400b2380 0x7f3140144480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38916/0 (socket says 172.21.15.37:38916) 2023-10-06T02:26:48.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.824+0000 7f314649a700 1 -- 172.21.15.37:0/804216793 learned_addr learned my addr 172.21.15.37:0/804216793 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:48.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.824+0000 7f3146c9b700 1 --2- 172.21.15.37:0/804216793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31401593c0 0x7f31400c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.824+0000 7f3145c99700 1 --2- 172.21.15.37:0/804216793 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31400ccb30 0x7f31400c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.824+0000 7f314649a700 1 -- 172.21.15.37:0/804216793 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31400ccb30 msgr2=0x7f31400c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.824+0000 7f314649a700 1 --2- 172.21.15.37:0/804216793 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31400ccb30 0x7f31400c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.824+0000 7f314649a700 1 -- 172.21.15.37:0/804216793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31401593c0 msgr2=0x7f31400c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.824+0000 7f314649a700 1 --2- 172.21.15.37:0/804216793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31401593c0 0x7f31400c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.824+0000 7f314649a700 1 -- 172.21.15.37:0/804216793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31380094f0 con 0x7f31400b2380 2023-10-06T02:26:48.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.824+0000 7f314649a700 1 --2- 172.21.15.37:0/804216793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31400b2380 0x7f3140144480 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f313c009ea0 tx=0x7f313c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:48.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.824+0000 7f31367fc700 1 -- 172.21.15.37:0/804216793 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c00caa0 con 0x7f31400b2380 2023-10-06T02:26:48.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.825+0000 7f31367fc700 1 -- 172.21.15.37:0/804216793 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c00f040 con 0x7f31400b2380 2023-10-06T02:26:48.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.825+0000 7f31486fe700 1 -- 172.21.15.37:0/804216793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314015d850 con 0x7f31400b2380 2023-10-06T02:26:48.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.825+0000 7f31367fc700 1 -- 172.21.15.37:0/804216793 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c00ce70 con 0x7f31400b2380 2023-10-06T02:26:48.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.825+0000 7f31486fe700 1 -- 172.21.15.37:0/804216793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3140156dd0 con 0x7f31400b2380 2023-10-06T02:26:48.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.826+0000 7f31367fc700 1 -- 172.21.15.37:0/804216793 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f313c014690 con 0x7f31400b2380 2023-10-06T02:26:48.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.826+0000 7f31367fc700 1 --2- 172.21.15.37:0/804216793 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3124066f30 0x7f31240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.826+0000 7f31367fc700 1 -- 172.21.15.37:0/804216793 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f313c084fe0 con 0x7f31400b2380 2023-10-06T02:26:48.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.827+0000 7f3145c99700 1 --2- 172.21.15.37:0/804216793 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3124066f30 0x7f31240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.827+0000 7f3145c99700 1 --2- 172.21.15.37:0/804216793 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3124066f30 0x7f31240693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3140147580 tx=0x7f3130007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:48.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.828+0000 7f31519f6b80 1 Processor -- start 2023-10-06T02:26:48.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.828+0000 7f31519f6b80 1 -- start start 2023-10-06T02:26:48.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.829+0000 7f31519f6b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1030890 0x55d8e1030c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.829+0000 7f31519f6b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1031d10 0x55d8e1080710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.829+0000 7f31519f6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1080c50 0x55d8e10810a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.829+0000 7f31519f6b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8e0f87ac0 con 0x55d8e1080c50 2023-10-06T02:26:48.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.829+0000 7f31519f6b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8e0f852c0 con 0x55d8e1030890 2023-10-06T02:26:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.829+0000 7f31519f6b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8e0f810b0 con 0x55d8e1031d10 2023-10-06T02:26:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.829+0000 7f3146c9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1080c50 0x55d8e10810a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.829+0000 7f3146c9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1080c50 0x55d8e10810a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38924/0 (socket says 172.21.15.37:38924) 2023-10-06T02:26:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.829+0000 7f314649a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1030890 0x55d8e1030c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.829+0000 7f3146c9b700 1 -- 172.21.15.37:0/2057714367 learned_addr learned my addr 172.21.15.37:0/2057714367 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.829+0000 7f3145c99700 1 --2- 172.21.15.37:0/2057714367 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1031d10 0x55d8e1080710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.830+0000 7f3146c9b700 1 -- 172.21.15.37:0/2057714367 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1031d10 msgr2=0x55d8e1080710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.830+0000 7f3146c9b700 1 --2- 172.21.15.37:0/2057714367 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1031d10 0x55d8e1080710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.830+0000 7f3146c9b700 1 -- 172.21.15.37:0/2057714367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1030890 msgr2=0x55d8e1030c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.830+0000 7f3146c9b700 1 --2- 172.21.15.37:0/2057714367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1030890 0x55d8e1030c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.830+0000 7f3146c9b700 1 -- 172.21.15.37:0/2057714367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8e0e1b2c0 con 0x55d8e1080c50 2023-10-06T02:26:48.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.830+0000 7f3146c9b700 1 --2- 172.21.15.37:0/2057714367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1080c50 0x55d8e10810a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f313800b3c0 tx=0x7f3138017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251b6edbc3a9074f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:48.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.830+0000 7f31237fe700 1 -- 172.21.15.37:0/2057714367 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3138021070 con 0x55d8e1080c50 2023-10-06T02:26:48.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.830+0000 7f31237fe700 1 -- 172.21.15.37:0/2057714367 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3138006d40 con 0x55d8e1080c50 2023-10-06T02:26:48.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.830+0000 7f31237fe700 1 -- 172.21.15.37:0/2057714367 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313800bbe0 con 0x55d8e1080c50 2023-10-06T02:26:48.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.831+0000 7f31519f6b80 1 -- 172.21.15.37:0/2057714367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1080c50 msgr2=0x55d8e10810a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.831+0000 7f31519f6b80 1 --2- 172.21.15.37:0/2057714367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1080c50 0x55d8e10810a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f313800b3c0 tx=0x7f3138017000 comp rx=0 tx=0).stop 2023-10-06T02:26:48.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.831+0000 7f31519f6b80 1 -- 172.21.15.37:0/2057714367 shutdown_connections 2023-10-06T02:26:48.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.831+0000 7f31519f6b80 1 --2- 172.21.15.37:0/2057714367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1080c50 0x55d8e10810a0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.831+0000 7f31519f6b80 1 --2- 172.21.15.37:0/2057714367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1030890 0x55d8e1030c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.831+0000 7f31519f6b80 1 --2- 172.21.15.37:0/2057714367 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1031d10 0x55d8e1080710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.831+0000 7f31519f6b80 1 -- 172.21.15.37:0/2057714367 >> 172.21.15.37:0/2057714367 conn(0x55d8e10321b0 msgr2=0x55d8e1032580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:48.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.831+0000 7f31519f6b80 1 -- 172.21.15.37:0/2057714367 shutdown_connections 2023-10-06T02:26:48.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.831+0000 7f31519f6b80 1 -- 172.21.15.37:0/2057714367 wait complete. 2023-10-06T02:26:48.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.831+0000 7f31519f6b80 1 -- start start 2023-10-06T02:26:48.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.831+0000 7f31519f6b80 1 Processor -- start 2023-10-06T02:26:48.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.832+0000 7f31519f6b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1030890 0x55d8e10770f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.832+0000 7f31519f6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1031d10 0x55d8e1077630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.832+0000 7f31519f6b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1080c50 0x55d8e1070120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.832+0000 7f31519f6b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8e0f2c8e0 con 0x55d8e1031d10 2023-10-06T02:26:48.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.832+0000 7f31519f6b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8e0f47ef0 con 0x55d8e1080c50 2023-10-06T02:26:48.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.832+0000 7f31519f6b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8e0e03e80 con 0x55d8e1030890 2023-10-06T02:26:48.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.832+0000 7f31519f6b80 10 client.0 _ll_register_callbacks cb 0x55d8e0ff3ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:26:48.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.832+0000 7f3145c99700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1031d10 0x55d8e1077630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.832+0000 7f3145c99700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1031d10 0x55d8e1077630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38940/0 (socket says 172.21.15.37:38940) 2023-10-06T02:26:48.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.832+0000 7f3145c99700 1 -- 172.21.15.37:0/1516833483 learned_addr learned my addr 172.21.15.37:0/1516833483 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:48.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.833+0000 7f314649a700 1 --2- 172.21.15.37:0/1516833483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1030890 0x55d8e10770f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.833+0000 7f3146c9b700 1 --2- 172.21.15.37:0/1516833483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1080c50 0x55d8e1070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.833+0000 7f3145c99700 1 -- 172.21.15.37:0/1516833483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1030890 msgr2=0x55d8e10770f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:48.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.833+0000 7f3145c99700 1 --2- 172.21.15.37:0/1516833483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1030890 0x55d8e10770f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.833+0000 7f3145c99700 1 -- 172.21.15.37:0/1516833483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1080c50 msgr2=0x55d8e1070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:48.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.833+0000 7f3145c99700 1 --2- 172.21.15.37:0/1516833483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1080c50 0x55d8e1070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.833+0000 7f3145c99700 1 -- 172.21.15.37:0/1516833483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31400b0150 con 0x55d8e1031d10 2023-10-06T02:26:48.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.833+0000 7f3145c99700 1 --2- 172.21.15.37:0/1516833483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1031d10 0x55d8e1077630 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f31300145b0 tx=0x7f3130015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b574f19dcb7478fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:48.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.833+0000 7f3120ff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:26:48.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.833+0000 7f3120ff9700 1 -- 172.21.15.37:0/1516833483 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130014c80 con 0x55d8e1031d10 2023-10-06T02:26:48.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.833+0000 7f3120ff9700 1 -- 172.21.15.37:0/1516833483 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f313001c040 con 0x55d8e1031d10 2023-10-06T02:26:48.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.833+0000 7f31519f6b80 1 -- 172.21.15.37:0/1516833483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8e1025990 con 0x55d8e1031d10 2023-10-06T02:26:48.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.833+0000 7f3120ff9700 1 -- 172.21.15.37:0/1516833483 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3130021400 con 0x55d8e1031d10 2023-10-06T02:26:48.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.833+0000 7f31519f6b80 10 client.6129 fetch_fsmap learned FSMap version 31 2023-10-06T02:26:48.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.833+0000 7f31519f6b80 1 -- 172.21.15.37:0/1516833483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x55d8e0dbe030 con 0x55d8e1031d10 2023-10-06T02:26:48.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.833+0000 7f3120ff9700 1 -- 172.21.15.37:0/1516833483 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d8e1025990 con 0x55d8e1031d10 2023-10-06T02:26:48.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.834+0000 7f3120ff9700 1 -- 172.21.15.37:0/1516833483 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f313002a3f0 con 0x55d8e1031d10 2023-10-06T02:26:48.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.834+0000 7f31519f6b80 10 client.6129 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T02:26:48.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.834+0000 7f31519f6b80 10 client.6129 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T02:26:48.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.834+0000 7f31519f6b80 20 client.6129 populate_metadata read hostname 'smithi037' 2023-10-06T02:26:48.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.834+0000 7f31519f6b80 1 --2- 172.21.15.37:0/1516833483 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x55d8e1059ad0 0x55d8e1070660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.834+0000 7f31519f6b80 4 client.6129 mds_command: new command op to 5823 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:26:48.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.834+0000 7f31519f6b80 1 -- 172.21.15.37:0/1516833483 --> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8e10028c0 con 0x55d8e1059ad0 2023-10-06T02:26:48.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.834+0000 7f314649a700 1 --2- 172.21.15.37:0/1516833483 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x55d8e1059ad0 0x55d8e1070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.834+0000 7f314649a700 1 --2- 172.21.15.37:0/1516833483 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x55d8e1059ad0 0x55d8e1070660 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80a45921c92037ae server_cookie=f74db026bd9cb015 in_seq=0 out_seq=0 2023-10-06T02:26:48.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.834+0000 7f3120ff9700 10 client.6129 ms_handle_connect on v2:172.21.15.37:6833/3956166862 2023-10-06T02:26:48.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.835+0000 7f3120ff9700 1 -- 172.21.15.37:0/1516833483 <== mds.0 v2:172.21.15.37:6833/3956166862 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d8e10028c0 con 0x55d8e1059ad0 2023-10-06T02:26:48.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.835+0000 7f3120ff9700 10 client.6129 handle_command_reply: tid=0 2023-10-06T02:26:48.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.835+0000 7f31519f6b80 1 client.6129 shutdown 2023-10-06T02:26:48.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.835+0000 7f31519f6b80 1 -- 172.21.15.37:0/1516833483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1031d10 msgr2=0x55d8e1077630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.835+0000 7f31519f6b80 1 --2- 172.21.15.37:0/1516833483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1031d10 0x55d8e1077630 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f31300145b0 tx=0x7f3130015000 comp rx=0 tx=0).stop 2023-10-06T02:26:48.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.835+0000 7f31519f6b80 1 -- 172.21.15.37:0/1516833483 shutdown_connections 2023-10-06T02:26:48.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.835+0000 7f31519f6b80 1 --2- 172.21.15.37:0/1516833483 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x55d8e1059ad0 0x55d8e1070660 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.835+0000 7f31519f6b80 1 --2- 172.21.15.37:0/1516833483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1080c50 0x55d8e1070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.835+0000 7f3120ff9700 0 client.6129 ms_handle_reset on v2:172.21.15.37:6833/3956166862 2023-10-06T02:26:48.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.835+0000 7f31519f6b80 1 --2- 172.21.15.37:0/1516833483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1030890 0x55d8e10770f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.835+0000 7f31519f6b80 1 --2- 172.21.15.37:0/1516833483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1031d10 0x55d8e1077630 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.835+0000 7f31519f6b80 1 -- 172.21.15.37:0/1516833483 >> 172.21.15.37:0/1516833483 conn(0x55d8e10321b0 msgr2=0x55d8e107a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:48.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.835+0000 7f31519f6b80 1 -- 172.21.15.37:0/1516833483 shutdown_connections 2023-10-06T02:26:48.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.835+0000 7f31519f6b80 1 -- 172.21.15.37:0/1516833483 wait complete. 2023-10-06T02:26:48.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.835+0000 7f31519f6b80 20 client.6129 trim_cache size 0 max 16384 2023-10-06T02:26:48.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.851+0000 7f31519f6b80 1 Processor -- start 2023-10-06T02:26:48.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.851+0000 7f31519f6b80 1 -- start start 2023-10-06T02:26:48.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f31519f6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1030890 0x55d8e105b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f31519f6b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1031d10 0x55d8e1076d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f31519f6b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1080c50 0x55d8e1077260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f31519f6b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8e108a0e0 con 0x55d8e1030890 2023-10-06T02:26:48.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f31519f6b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8e102c260 con 0x55d8e1080c50 2023-10-06T02:26:48.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f31519f6b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8e105d050 con 0x55d8e1031d10 2023-10-06T02:26:48.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f314649a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1030890 0x55d8e105b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f314649a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1030890 0x55d8e105b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38950/0 (socket says 172.21.15.37:38950) 2023-10-06T02:26:48.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f314649a700 1 -- 172.21.15.37:0/653585851 learned_addr learned my addr 172.21.15.37:0/653585851 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:48.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f3145c99700 1 --2- 172.21.15.37:0/653585851 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1031d10 0x55d8e1076d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f314649a700 1 -- 172.21.15.37:0/653585851 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1031d10 msgr2=0x55d8e1076d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:48.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f3146c9b700 1 --2- 172.21.15.37:0/653585851 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1080c50 0x55d8e1077260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f314649a700 1 --2- 172.21.15.37:0/653585851 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1031d10 0x55d8e1076d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f314649a700 1 -- 172.21.15.37:0/653585851 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1080c50 msgr2=0x55d8e1077260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:48.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f314649a700 1 --2- 172.21.15.37:0/653585851 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1080c50 0x55d8e1077260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f314649a700 1 -- 172.21.15.37:0/653585851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8e0f4f7d0 con 0x55d8e1030890 2023-10-06T02:26:48.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f3145c99700 1 --2- 172.21.15.37:0/653585851 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1031d10 0x55d8e1076d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:48.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f3146c9b700 1 --2- 172.21.15.37:0/653585851 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1080c50 0x55d8e1077260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:48.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f314649a700 1 --2- 172.21.15.37:0/653585851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1030890 0x55d8e105b630 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f313c009e70 tx=0x7f313c016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b633df13b6287fde server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:48.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f3123fff700 1 -- 172.21.15.37:0/653585851 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c05cc80 con 0x55d8e1030890 2023-10-06T02:26:48.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f3123fff700 1 -- 172.21.15.37:0/653585851 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c0833e0 con 0x55d8e1030890 2023-10-06T02:26:48.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.852+0000 7f3123fff700 1 -- 172.21.15.37:0/653585851 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c054080 con 0x55d8e1030890 2023-10-06T02:26:48.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.853+0000 7f31519f6b80 1 -- 172.21.15.37:0/653585851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1030890 msgr2=0x55d8e105b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.853+0000 7f31519f6b80 1 --2- 172.21.15.37:0/653585851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1030890 0x55d8e105b630 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f313c009e70 tx=0x7f313c016040 comp rx=0 tx=0).stop 2023-10-06T02:26:48.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.853+0000 7f31519f6b80 1 -- 172.21.15.37:0/653585851 shutdown_connections 2023-10-06T02:26:48.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.853+0000 7f31519f6b80 1 --2- 172.21.15.37:0/653585851 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1080c50 0x55d8e1077260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.853+0000 7f31519f6b80 1 --2- 172.21.15.37:0/653585851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1030890 0x55d8e105b630 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.853+0000 7f31519f6b80 1 --2- 172.21.15.37:0/653585851 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1031d10 0x55d8e1076d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.853+0000 7f31519f6b80 1 -- 172.21.15.37:0/653585851 >> 172.21.15.37:0/653585851 conn(0x55d8e10321b0 msgr2=0x55d8e1033d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:48.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.853+0000 7f31519f6b80 1 -- 172.21.15.37:0/653585851 shutdown_connections 2023-10-06T02:26:48.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.853+0000 7f31519f6b80 1 -- 172.21.15.37:0/653585851 wait complete. 2023-10-06T02:26:48.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.854+0000 7f31519f6b80 1 -- start start 2023-10-06T02:26:48.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.854+0000 7f31519f6b80 1 Processor -- start 2023-10-06T02:26:48.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.854+0000 7f31519f6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1030890 0x55d8e105fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f31519f6b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1031d10 0x55d8e10da230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f31519f6b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1080c50 0x55d8e10da770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f31519f6b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8e10dd4f0 con 0x55d8e1030890 2023-10-06T02:26:48.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f31519f6b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8e1070c30 con 0x55d8e1031d10 2023-10-06T02:26:48.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f31519f6b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8e105aa10 con 0x55d8e1080c50 2023-10-06T02:26:48.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f31519f6b80 10 client.0 _ll_register_callbacks cb 0x55d8e0ff3ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:26:48.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f314649a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1030890 0x55d8e105fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f314649a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1030890 0x55d8e105fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38966/0 (socket says 172.21.15.37:38966) 2023-10-06T02:26:48.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f314649a700 1 -- 172.21.15.37:0/4184362167 learned_addr learned my addr 172.21.15.37:0/4184362167 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:48.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f3145c99700 1 --2- 172.21.15.37:0/4184362167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1031d10 0x55d8e10da230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f3146c9b700 1 --2- 172.21.15.37:0/4184362167 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1080c50 0x55d8e10da770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f314649a700 1 -- 172.21.15.37:0/4184362167 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1080c50 msgr2=0x55d8e10da770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:48.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f314649a700 1 --2- 172.21.15.37:0/4184362167 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1080c50 0x55d8e10da770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f314649a700 1 -- 172.21.15.37:0/4184362167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1031d10 msgr2=0x55d8e10da230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:48.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f314649a700 1 --2- 172.21.15.37:0/4184362167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1031d10 0x55d8e10da230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f314649a700 1 -- 172.21.15.37:0/4184362167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3140156dd0 con 0x55d8e1030890 2023-10-06T02:26:48.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f314649a700 1 --2- 172.21.15.37:0/4184362167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1030890 0x55d8e105fa80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f313c0559e0 tx=0x7f313c01f030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f5d566cf447283 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:48.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f3120ff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:26:48.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f3120ff9700 1 -- 172.21.15.37:0/4184362167 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c058f30 con 0x55d8e1030890 2023-10-06T02:26:48.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f3120ff9700 1 -- 172.21.15.37:0/4184362167 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f313c05cc80 con 0x55d8e1030890 2023-10-06T02:26:48.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f31519f6b80 1 -- 172.21.15.37:0/4184362167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3138006d40 con 0x55d8e1030890 2023-10-06T02:26:48.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f3120ff9700 1 -- 172.21.15.37:0/4184362167 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f313c054080 con 0x55d8e1030890 2023-10-06T02:26:48.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f31519f6b80 10 client.6135 fetch_fsmap learned FSMap version 31 2023-10-06T02:26:48.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.855+0000 7f31519f6b80 1 -- 172.21.15.37:0/4184362167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x55d8e0f364c0 con 0x55d8e1030890 2023-10-06T02:26:48.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.856+0000 7f3120ff9700 1 -- 172.21.15.37:0/4184362167 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3138006d40 con 0x55d8e1030890 2023-10-06T02:26:48.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.856+0000 7f3120ff9700 1 -- 172.21.15.37:0/4184362167 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f313c0551d0 con 0x55d8e1030890 2023-10-06T02:26:48.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.856+0000 7f31519f6b80 10 client.6135 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T02:26:48.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.856+0000 7f31519f6b80 10 client.6135 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T02:26:48.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.856+0000 7f31519f6b80 20 client.6135 populate_metadata read hostname 'smithi037' 2023-10-06T02:26:48.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.856+0000 7f31519f6b80 1 --2- 172.21.15.37:0/4184362167 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x55d8e106fee0 0x55d8e10702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:48.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.856+0000 7f31519f6b80 4 client.6135 mds_command: new command op to 5823 tid=0[{"prefix": "scrub status"}] 2023-10-06T02:26:48.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.856+0000 7f31519f6b80 1 -- 172.21.15.37:0/4184362167 --> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d8e0f23e50 con 0x55d8e106fee0 2023-10-06T02:26:48.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.856+0000 7f3145c99700 1 --2- 172.21.15.37:0/4184362167 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x55d8e106fee0 0x55d8e10702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:48.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.856+0000 7f3145c99700 1 --2- 172.21.15.37:0/4184362167 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x55d8e106fee0 0x55d8e10702b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2a80706802e1602 server_cookie=6de4dedd62357d7f in_seq=0 out_seq=0 2023-10-06T02:26:48.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.856+0000 7f3120ff9700 10 client.6135 ms_handle_connect on v2:172.21.15.37:6833/3956166862 2023-10-06T02:26:48.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.856+0000 7f3120ff9700 1 -- 172.21.15.37:0/4184362167 <== mds.0 v2:172.21.15.37:6833/3956166862 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55d8e0f23e50 con 0x55d8e106fee0 2023-10-06T02:26:48.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.856+0000 7f3120ff9700 10 client.6135 handle_command_reply: tid=0 2023-10-06T02:26:48.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.856+0000 7f31519f6b80 1 client.6135 shutdown 2023-10-06T02:26:48.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.856+0000 7f31519f6b80 1 -- 172.21.15.37:0/4184362167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1030890 msgr2=0x55d8e105fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.856+0000 7f31519f6b80 1 --2- 172.21.15.37:0/4184362167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1030890 0x55d8e105fa80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f313c0559e0 tx=0x7f313c01f030 comp rx=0 tx=0).stop 2023-10-06T02:26:48.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.856+0000 7f31519f6b80 1 -- 172.21.15.37:0/4184362167 shutdown_connections 2023-10-06T02:26:48.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.856+0000 7f31519f6b80 1 --2- 172.21.15.37:0/4184362167 >> [v2:172.21.15.37:6833/3956166862,v1:172.21.15.37:6835/3956166862] conn(0x55d8e106fee0 0x55d8e10702b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.857+0000 7f31519f6b80 1 --2- 172.21.15.37:0/4184362167 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8e1080c50 0x55d8e10da770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.857+0000 7f31519f6b80 1 --2- 172.21.15.37:0/4184362167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8e1030890 0x55d8e105fa80 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.857+0000 7f3120ff9700 0 client.6135 ms_handle_reset on v2:172.21.15.37:6833/3956166862 2023-10-06T02:26:48.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.857+0000 7f31519f6b80 1 --2- 172.21.15.37:0/4184362167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8e1031d10 0x55d8e10da230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.857+0000 7f31519f6b80 1 -- 172.21.15.37:0/4184362167 >> 172.21.15.37:0/4184362167 conn(0x55d8e10321b0 msgr2=0x55d8e1033cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:48.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.857+0000 7f31519f6b80 1 -- 172.21.15.37:0/4184362167 shutdown_connections 2023-10-06T02:26:48.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.857+0000 7f31519f6b80 1 -- 172.21.15.37:0/4184362167 wait complete. 2023-10-06T02:26:48.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.857+0000 7f31519f6b80 20 client.6135 trim_cache size 0 max 16384 2023-10-06T02:26:48.868 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:26:48.868 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2023-10-06T02:26:48.868 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2023-10-06T02:26:48.868 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:26:48.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.857+0000 7f31486fe700 1 -- 172.21.15.37:0/804216793 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3124066f30 msgr2=0x7f31240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.857+0000 7f31486fe700 1 --2- 172.21.15.37:0/804216793 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3124066f30 0x7f31240693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3140147580 tx=0x7f3130007ec0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.857+0000 7f31486fe700 1 -- 172.21.15.37:0/804216793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31400b2380 msgr2=0x7f3140144480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:48.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.857+0000 7f31486fe700 1 --2- 172.21.15.37:0/804216793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31400b2380 0x7f3140144480 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f313c009ea0 tx=0x7f313c00b040 comp rx=0 tx=0).stop 2023-10-06T02:26:48.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.857+0000 7f31486fe700 1 -- 172.21.15.37:0/804216793 shutdown_connections 2023-10-06T02:26:48.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.857+0000 7f31486fe700 1 --2- 172.21.15.37:0/804216793 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3124066f30 0x7f31240693e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.857+0000 7f31486fe700 1 --2- 172.21.15.37:0/804216793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31401593c0 0x7f31400c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.857+0000 7f31486fe700 1 --2- 172.21.15.37:0/804216793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31400b2380 0x7f3140144480 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.857+0000 7f31486fe700 1 --2- 172.21.15.37:0/804216793 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31400ccb30 0x7f31400c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:48.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.857+0000 7f31486fe700 1 -- 172.21.15.37:0/804216793 >> 172.21.15.37:0/804216793 conn(0x7f314006c0b0 msgr2=0x7f3140158960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:48.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.857+0000 7f31486fe700 1 -- 172.21.15.37:0/804216793 shutdown_connections 2023-10-06T02:26:48.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:48.857+0000 7f31486fe700 1 -- 172.21.15.37:0/804216793 wait complete. 2023-10-06T02:26:48.871 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T02:26:48.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:26:49.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.091+0000 7fe998d8a700 1 Processor -- start 2023-10-06T02:26:49.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.091+0000 7fe998d8a700 1 -- start start 2023-10-06T02:26:49.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.092+0000 7fe998d8a700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe99406de80 0x7fe9940b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.092+0000 7fe998d8a700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9940cc250 con 0x7fe9940cb080 2023-10-06T02:26:49.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.092+0000 7fe998d8a700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9940cb640 con 0x7fe99406dab0 2023-10-06T02:26:49.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.092+0000 7fe998d8a700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9940b0e00 con 0x7fe99406de80 2023-10-06T02:26:49.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.093+0000 7fe991d9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe9940cb080 0x7fe9940b01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38224/0 (socket says 172.21.15.37:38224) 2023-10-06T02:26:49.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.093+0000 7fe991d9b700 1 -- 172.21.15.37:0/248328421 learned_addr learned my addr 172.21.15.37:0/248328421 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:26:49.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.093+0000 7fe992d9d700 1 --2- 172.21.15.37:0/248328421 >> v2:172.21.15.191:3300/0 conn(0x7fe99406de80 0x7fe9940b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.093+0000 7fe99159a700 1 -- 172.21.15.37:0/248328421 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093236591 0 0) 0x7fe9940cc250 con 0x7fe9940cb080 2023-10-06T02:26:49.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.093+0000 7fe99159a700 1 -- 172.21.15.37:0/248328421 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe980003570 con 0x7fe9940cb080 2023-10-06T02:26:49.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.093+0000 7fe99159a700 1 -- 172.21.15.37:0/248328421 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1825280834 0 0) 0x7fe980003570 con 0x7fe9940cb080 2023-10-06T02:26:49.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.093+0000 7fe99159a700 1 -- 172.21.15.37:0/248328421 >> v2:172.21.15.191:3300/0 conn(0x7fe99406de80 msgr2=0x7fe9940b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:49.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.093+0000 7fe99159a700 1 --2- 172.21.15.37:0/248328421 >> v2:172.21.15.191:3300/0 conn(0x7fe99406de80 0x7fe9940b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.093+0000 7fe99159a700 1 -- 172.21.15.37:0/248328421 >> v1:172.21.15.191:6789/0 conn(0x7fe99406dab0 legacy=0x7fe9940cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.093+0000 7fe99159a700 1 -- 172.21.15.37:0/248328421 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9940cb920 con 0x7fe9940cb080 2023-10-06T02:26:49.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.093+0000 7fe99159a700 1 -- 172.21.15.37:0/248328421 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7fe97c001470 con 0x7fe9940cb080 2023-10-06T02:26:49.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.093+0000 7fe99159a700 1 -- 172.21.15.37:0/248328421 >> v1:172.21.15.37:6789/0 conn(0x7fe9940cb080 legacy=0x7fe9940b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.093+0000 7fe99159a700 1 --2- 172.21.15.37:0/248328421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe980003a60 0x7fe980003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.093+0000 7fe99159a700 1 --2- 172.21.15.37:0/248328421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe980004810 0x7fe980004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.093+0000 7fe99159a700 1 --2- 172.21.15.37:0/248328421 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe9800051c0 0x7fe98000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.093+0000 7fe99159a700 1 -- 172.21.15.37:0/248328421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9940b0e00 con 0x7fe980004810 2023-10-06T02:26:49.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.093+0000 7fe99159a700 1 -- 172.21.15.37:0/248328421 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98000c050 con 0x7fe980003a60 2023-10-06T02:26:49.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.093+0000 7fe99159a700 1 -- 172.21.15.37:0/248328421 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98000c210 con 0x7fe9800051c0 2023-10-06T02:26:49.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.093+0000 7fe991d9b700 1 --2- 172.21.15.37:0/248328421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe980004810 0x7fe980004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.093+0000 7fe99259c700 1 --2- 172.21.15.37:0/248328421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe980003a60 0x7fe980003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.094+0000 7fe992d9d700 1 --2- 172.21.15.37:0/248328421 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe9800051c0 0x7fe98000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.094+0000 7fe991d9b700 1 -- 172.21.15.37:0/248328421 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe9800051c0 msgr2=0x7fe98000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:49.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.094+0000 7fe991d9b700 1 --2- 172.21.15.37:0/248328421 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe9800051c0 0x7fe98000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.094+0000 7fe991d9b700 1 -- 172.21.15.37:0/248328421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe980003a60 msgr2=0x7fe980003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:49.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.094+0000 7fe991d9b700 1 --2- 172.21.15.37:0/248328421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe980003a60 0x7fe980003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.094+0000 7fe991d9b700 1 -- 172.21.15.37:0/248328421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe980003570 con 0x7fe980004810 2023-10-06T02:26:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.094+0000 7fe992d9d700 1 --2- 172.21.15.37:0/248328421 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe9800051c0 0x7fe98000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.094+0000 7fe992d9d700 1 -- 172.21.15.37:0/248328421 reap_dead start 2023-10-06T02:26:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.094+0000 7fe991d9b700 1 --2- 172.21.15.37:0/248328421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe980004810 0x7fe980004c80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00c3c0 tx=0x7fe97c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39d48a107a4baae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.094+0000 7fe99159a700 1 -- 172.21.15.37:0/248328421 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c00cc90 con 0x7fe980004810 2023-10-06T02:26:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.094+0000 7fe99159a700 1 -- 172.21.15.37:0/248328421 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97c00cdf0 con 0x7fe980004810 2023-10-06T02:26:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.094+0000 7fe99159a700 1 -- 172.21.15.37:0/248328421 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c005b70 con 0x7fe980004810 2023-10-06T02:26:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.095+0000 7fe998d8a700 1 -- 172.21.15.37:0/248328421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe980004810 msgr2=0x7fe980004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.095+0000 7fe998d8a700 1 --2- 172.21.15.37:0/248328421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe980004810 0x7fe980004c80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00c3c0 tx=0x7fe97c001e70 comp rx=0 tx=0).stop 2023-10-06T02:26:49.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.095+0000 7fe998d8a700 1 -- 172.21.15.37:0/248328421 shutdown_connections 2023-10-06T02:26:49.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.095+0000 7fe998d8a700 1 --2- 172.21.15.37:0/248328421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe980004810 0x7fe980004c80 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.095+0000 7fe998d8a700 1 -- 172.21.15.37:0/248328421 >> 172.21.15.37:0/248328421 conn(0x7fe9940d0510 msgr2=0x7fe9940d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:49.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.095+0000 7fe998d8a700 1 -- 172.21.15.37:0/248328421 shutdown_connections 2023-10-06T02:26:49.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.095+0000 7fe998d8a700 1 -- 172.21.15.37:0/248328421 wait complete. 2023-10-06T02:26:49.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.096+0000 7fe998d8a700 1 Processor -- start 2023-10-06T02:26:49.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.096+0000 7fe998d8a700 1 -- start start 2023-10-06T02:26:49.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.096+0000 7fe998d8a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe980004810 0x7fe99416a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.096+0000 7fe998d8a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe99416a8d0 0x7fe994167340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.096+0000 7fe998d8a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe994168e50 0x7fe9940b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.096+0000 7fe998d8a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9940a7160 con 0x7fe980004810 2023-10-06T02:26:49.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.096+0000 7fe998d8a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99416a6c0 con 0x7fe994168e50 2023-10-06T02:26:49.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.096+0000 7fe998d8a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe994167880 con 0x7fe99416a8d0 2023-10-06T02:26:49.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.097+0000 7fe99259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe980004810 0x7fe99416a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.097+0000 7fe99259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe980004810 0x7fe99416a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38980/0 (socket says 172.21.15.37:38980) 2023-10-06T02:26:49.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.097+0000 7fe99259c700 1 -- 172.21.15.37:0/56386321 learned_addr learned my addr 172.21.15.37:0/56386321 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:49.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.097+0000 7fe991d9b700 1 --2- 172.21.15.37:0/56386321 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe99416a8d0 0x7fe994167340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.097+0000 7fe992d9d700 1 --2- 172.21.15.37:0/56386321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe994168e50 0x7fe9940b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.097+0000 7fe99259c700 1 -- 172.21.15.37:0/56386321 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe99416a8d0 msgr2=0x7fe994167340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.097+0000 7fe99259c700 1 --2- 172.21.15.37:0/56386321 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe99416a8d0 0x7fe994167340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.097+0000 7fe99259c700 1 -- 172.21.15.37:0/56386321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe994168e50 msgr2=0x7fe9940b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.097+0000 7fe99259c700 1 --2- 172.21.15.37:0/56386321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe994168e50 0x7fe9940b2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.097+0000 7fe99259c700 1 -- 172.21.15.37:0/56386321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99416add0 con 0x7fe980004810 2023-10-06T02:26:49.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.097+0000 7fe99259c700 1 --2- 172.21.15.37:0/56386321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe980004810 0x7fe99416a180 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe98400edb0 tx=0x7fe9840016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.097+0000 7fe98a7fc700 1 -- 172.21.15.37:0/56386321 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98400cb10 con 0x7fe980004810 2023-10-06T02:26:49.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.097+0000 7fe98a7fc700 1 -- 172.21.15.37:0/56386321 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98400cc90 con 0x7fe980004810 2023-10-06T02:26:49.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.097+0000 7fe998d8a700 1 -- 172.21.15.37:0/56386321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99416b0b0 con 0x7fe980004810 2023-10-06T02:26:49.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.097+0000 7fe98a7fc700 1 -- 172.21.15.37:0/56386321 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984013670 con 0x7fe980004810 2023-10-06T02:26:49.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.097+0000 7fe998d8a700 1 -- 172.21.15.37:0/56386321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99416b670 con 0x7fe980004810 2023-10-06T02:26:49.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.098+0000 7fe998d8a700 1 -- 172.21.15.37:0/56386321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe994088ba0 con 0x7fe980004810 2023-10-06T02:26:49.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.098+0000 7fe98a7fc700 1 -- 172.21.15.37:0/56386321 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe984013a60 con 0x7fe980004810 2023-10-06T02:26:49.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.099+0000 7fe98a7fc700 1 --2- 172.21.15.37:0/56386321 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe974066f30 0x7fe9740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.099+0000 7fe98a7fc700 1 -- 172.21.15.37:0/56386321 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fe984084e90 con 0x7fe980004810 2023-10-06T02:26:49.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.099+0000 7fe991d9b700 1 --2- 172.21.15.37:0/56386321 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe974066f30 0x7fe9740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.100+0000 7fe991d9b700 1 --2- 172.21.15.37:0/56386321 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe974066f30 0x7fe9740693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe99416ad00 tx=0x7fe97c015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.103+0000 7fe98a7fc700 1 -- 172.21.15.37:0/56386321 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe984051f30 con 0x7fe980004810 2023-10-06T02:26:49.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.340+0000 7fe998d8a700 1 -- 172.21.15.37:0/56386321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe99404bb80 con 0x7fe980004810 2023-10-06T02:26:49.385 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-10-06T02:26:49.341+0000 7f292cc58700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:26:49.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.344+0000 7fe98a7fc700 1 -- 172.21.15.37:0/56386321 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe984055550 con 0x7fe980004810 2023-10-06T02:26:49.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.347+0000 7fe998d8a700 1 -- 172.21.15.37:0/56386321 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe974066f30 msgr2=0x7fe9740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.347+0000 7fe998d8a700 1 --2- 172.21.15.37:0/56386321 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe974066f30 0x7fe9740693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe99416ad00 tx=0x7fe97c015000 comp rx=0 tx=0).stop 2023-10-06T02:26:49.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.347+0000 7fe998d8a700 1 -- 172.21.15.37:0/56386321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe980004810 msgr2=0x7fe99416a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.347+0000 7fe998d8a700 1 --2- 172.21.15.37:0/56386321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe980004810 0x7fe99416a180 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe98400edb0 tx=0x7fe9840016d0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.347+0000 7fe998d8a700 1 -- 172.21.15.37:0/56386321 shutdown_connections 2023-10-06T02:26:49.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.347+0000 7fe998d8a700 1 --2- 172.21.15.37:0/56386321 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe974066f30 0x7fe9740693e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.347+0000 7fe998d8a700 1 --2- 172.21.15.37:0/56386321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe994168e50 0x7fe9940b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.347+0000 7fe998d8a700 1 --2- 172.21.15.37:0/56386321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe980004810 0x7fe99416a180 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.347+0000 7fe998d8a700 1 --2- 172.21.15.37:0/56386321 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe99416a8d0 0x7fe994167340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.347+0000 7fe998d8a700 1 -- 172.21.15.37:0/56386321 >> 172.21.15.37:0/56386321 conn(0x7fe9940d0510 msgr2=0x7fe99415bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:49.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.347+0000 7fe998d8a700 1 -- 172.21.15.37:0/56386321 shutdown_connections 2023-10-06T02:26:49.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.347+0000 7fe998d8a700 1 -- 172.21.15.37:0/56386321 wait complete. 2023-10-06T02:26:49.387 INFO:tasks.ceph.mds.c.smithi037.stderr: -5625> 2023-10-06T02:25:53.091+0000 7f986bfd6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:26:49.388 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:26:49.388 DEBUG:teuthology.orchestra.run.smithi037:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627777 summary 2023-10-06T02:26:49.389 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-10-06T02:26:49.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.425+0000 7f9ad7f2c240 1 -- start start 2023-10-06T02:26:49.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.425+0000 7f9ad7f2c240 1 Processor -- start 2023-10-06T02:26:49.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9ad7f2c240 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559b24496400 0x559b24526580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9ad7f2c240 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b24496800 0x559b24526b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9ad7f2c240 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b24496c00 0x559b24527080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9ad7f2c240 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b243f7cc0 con 0x559b24496c00 2023-10-06T02:26:49.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9ad7f2c240 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b243f7540 con 0x559b24496800 2023-10-06T02:26:49.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9ad7f2c240 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b243f7b80 con 0x559b24496400 2023-10-06T02:26:49.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9ad1bfb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b24496c00 0x559b24527080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9ad1bfb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b24496c00 0x559b24527080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39006/0 (socket says 172.21.15.37:39006) 2023-10-06T02:26:49.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9ad1bfb700 1 -- 172.21.15.37:0/1266597610 learned_addr learned my addr 172.21.15.37:0/1266597610 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:49.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9ad13fa700 1 --2- 172.21.15.37:0/1266597610 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559b24496400 0x559b24526580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9ad0bf9700 1 --2- 172.21.15.37:0/1266597610 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b24496800 0x559b24526b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9ad1bfb700 1 -- 172.21.15.37:0/1266597610 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559b24496400 msgr2=0x559b24526580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:49.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9ad1bfb700 1 --2- 172.21.15.37:0/1266597610 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559b24496400 0x559b24526580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9ad1bfb700 1 -- 172.21.15.37:0/1266597610 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b24496800 msgr2=0x559b24526b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9ad1bfb700 1 --2- 172.21.15.37:0/1266597610 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b24496800 0x559b24526b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9ad1bfb700 1 -- 172.21.15.37:0/1266597610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b243da340 con 0x559b24496c00 2023-10-06T02:26:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9ad1bfb700 1 --2- 172.21.15.37:0/1266597610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b24496c00 0x559b24527080 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x559b25134030 tx=0x559b25149b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d32f4c583fe3e61 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9acebf5700 1 -- 172.21.15.37:0/1266597610 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559b243ef080 con 0x559b24496c00 2023-10-06T02:26:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9acebf5700 1 -- 172.21.15.37:0/1266597610 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559b2440c480 con 0x559b24496c00 2023-10-06T02:26:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9acebf5700 1 -- 172.21.15.37:0/1266597610 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559b243ef600 con 0x559b24496c00 2023-10-06T02:26:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1266597610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b243da000 con 0x559b24496c00 2023-10-06T02:26:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1266597610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x559b243daea0 con 0x559b24496c00 2023-10-06T02:26:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9ad7f2c240 4 waiting for MDS map... 2023-10-06T02:26:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.426+0000 7f9acebf5700 1 -- 172.21.15.37:0/1266597610 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x559b243fac40 con 0x559b24496c00 2023-10-06T02:26:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.427+0000 7f9acebf5700 1 -- 172.21.15.37:0/1266597610 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 32) v1 ==== 2559+0+0 (secure 0 0 0) 0x559b251a2300 con 0x559b24496c00 2023-10-06T02:26:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.427+0000 7f9ad7f2c240 4 Got MDS map 32 2023-10-06T02:26:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.427+0000 7f9ad7f2c240 10 main: JournalTool::main 2023-10-06T02:26:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.427+0000 7f9ad7f2c240 4 main: JournalTool: connecting to RADOS... 2023-10-06T02:26:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.427+0000 7f9ad7f2c240 1 Processor -- start 2023-10-06T02:26:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.427+0000 7f9ad7f2c240 1 -- start start 2023-10-06T02:26:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.428+0000 7f9ad7f2c240 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559b24497800 0x559b24527600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.428+0000 7f9ad7f2c240 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b24497c00 0x559b24527b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.428+0000 7f9ad7f2c240 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b25208000 0x559b24528100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.428+0000 7f9ad7f2c240 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b243f6dc0 con 0x559b25208000 2023-10-06T02:26:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.428+0000 7f9ad7f2c240 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b243f7b80 con 0x559b24497c00 2023-10-06T02:26:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.428+0000 7f9ad7f2c240 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b243f7540 con 0x559b24497800 2023-10-06T02:26:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.428+0000 7f9ad0bf9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b25208000 0x559b24528100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.428+0000 7f9ad0bf9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b25208000 0x559b24528100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39022/0 (socket says 172.21.15.37:39022) 2023-10-06T02:26:49.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.428+0000 7f9ad0bf9700 1 -- 172.21.15.37:0/3997388784 learned_addr learned my addr 172.21.15.37:0/3997388784 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:49.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.428+0000 7f9ad0bf9700 1 --2- 172.21.15.37:0/3997388784 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559b24497800 0x559b24527600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.428+0000 7f9ad13fa700 1 --2- 172.21.15.37:0/3997388784 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b24497c00 0x559b24527b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.428+0000 7f9ad0bf9700 1 -- 172.21.15.37:0/3997388784 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559b24497800 msgr2=0x559b24527600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:49.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.428+0000 7f9ad0bf9700 1 --2- 172.21.15.37:0/3997388784 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559b24497800 0x559b24527600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.428+0000 7f9ad0bf9700 1 -- 172.21.15.37:0/3997388784 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b24497c00 msgr2=0x559b24527b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:49.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.428+0000 7f9ad0bf9700 1 --2- 172.21.15.37:0/3997388784 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b24497c00 0x559b24527b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.428+0000 7f9ad0bf9700 1 -- 172.21.15.37:0/3997388784 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b243db860 con 0x559b25208000 2023-10-06T02:26:49.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.428+0000 7f9ad13fa700 1 --2- 172.21.15.37:0/3997388784 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b24497c00 0x559b24527b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:49.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.428+0000 7f9ad0bf9700 1 --2- 172.21.15.37:0/3997388784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b25208000 0x559b24528100 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x559b25135590 tx=0x559b2521e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf0ff84666c0eb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.428+0000 7f9accbf1700 1 -- 172.21.15.37:0/3997388784 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559b243ef080 con 0x559b25208000 2023-10-06T02:26:49.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.429+0000 7f9accbf1700 1 -- 172.21.15.37:0/3997388784 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559b2440cd80 con 0x559b25208000 2023-10-06T02:26:49.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.429+0000 7f9accbf1700 1 -- 172.21.15.37:0/3997388784 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559b243ef600 con 0x559b25208000 2023-10-06T02:26:49.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.429+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/3997388784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b25208000 msgr2=0x559b24528100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.429+0000 7f9ad7f2c240 1 --2- 172.21.15.37:0/3997388784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b25208000 0x559b24528100 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x559b25135590 tx=0x559b2521e0c0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.429+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/3997388784 shutdown_connections 2023-10-06T02:26:49.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.429+0000 7f9ad7f2c240 1 --2- 172.21.15.37:0/3997388784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b25208000 0x559b24528100 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.429+0000 7f9ad7f2c240 1 --2- 172.21.15.37:0/3997388784 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559b24497800 0x559b24527600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.429+0000 7f9ad7f2c240 1 --2- 172.21.15.37:0/3997388784 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b24497c00 0x559b24527b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.429+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/3997388784 >> 172.21.15.37:0/3997388784 conn(0x559b24497000 msgr2=0x559b244ab800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:49.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.429+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/3997388784 shutdown_connections 2023-10-06T02:26:49.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.429+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/3997388784 wait complete. 2023-10-06T02:26:49.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.429+0000 7f9ad7f2c240 1 Processor -- start 2023-10-06T02:26:49.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.430+0000 7f9ad7f2c240 1 -- start start 2023-10-06T02:26:49.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.430+0000 7f9ad7f2c240 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559b24497c00 0x559b24528c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.430+0000 7f9ad7f2c240 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b24497800 0x559b24528680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.430+0000 7f9ad7f2c240 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b25208000 0x559b24528100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.430+0000 7f9ad7f2c240 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b243f63c0 con 0x559b25208000 2023-10-06T02:26:49.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.430+0000 7f9ad7f2c240 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b243f6000 con 0x559b24497800 2023-10-06T02:26:49.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.430+0000 7f9ad7f2c240 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b243f7180 con 0x559b24497c00 2023-10-06T02:26:49.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.430+0000 7f9ad0bf9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b25208000 0x559b24528100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.430+0000 7f9ad0bf9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b25208000 0x559b24528100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39034/0 (socket says 172.21.15.37:39034) 2023-10-06T02:26:49.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.430+0000 7f9ad0bf9700 1 -- 172.21.15.37:0/1731550680 learned_addr learned my addr 172.21.15.37:0/1731550680 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:49.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.430+0000 7f9ad0bf9700 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559b24497c00 0x559b24528c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.430+0000 7f9ad13fa700 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b24497800 0x559b24528680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.431+0000 7f9ad0bf9700 1 -- 172.21.15.37:0/1731550680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559b24497c00 msgr2=0x559b24528c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.431+0000 7f9ad0bf9700 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559b24497c00 0x559b24528c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.431+0000 7f9ad0bf9700 1 -- 172.21.15.37:0/1731550680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b24497800 msgr2=0x559b24528680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.431+0000 7f9ad0bf9700 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b24497800 0x559b24528680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.431+0000 7f9ad0bf9700 1 -- 172.21.15.37:0/1731550680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b243da9c0 con 0x559b25208000 2023-10-06T02:26:49.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.431+0000 7f9ad0bf9700 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b25208000 0x559b24528100 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x559b25210060 tx=0x559b25149860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.431+0000 7f9acb3ee700 1 -- 172.21.15.37:0/1731550680 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559b243eedc0 con 0x559b25208000 2023-10-06T02:26:49.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.431+0000 7f9acb3ee700 1 -- 172.21.15.37:0/1731550680 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559b2440cf00 con 0x559b25208000 2023-10-06T02:26:49.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.431+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1731550680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559b243dba00 con 0x559b25208000 2023-10-06T02:26:49.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.431+0000 7f9acb3ee700 1 -- 172.21.15.37:0/1731550680 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559b243ef080 con 0x559b25208000 2023-10-06T02:26:49.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.431+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1731550680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b243db860 con 0x559b25208000 2023-10-06T02:26:49.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.431+0000 7f9ad7f2c240 4 main: JournalTool: resolving pool 9 2023-10-06T02:26:49.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.432+0000 7f9acb3ee700 1 -- 172.21.15.37:0/1731550680 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x559b2512d080 con 0x559b25208000 2023-10-06T02:26:49.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.432+0000 7f9acb3ee700 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x559b25240400 0x559b24529700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.433+0000 7f9acb3ee700 1 -- 172.21.15.37:0/1731550680 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x559b243faa80 con 0x559b25208000 2023-10-06T02:26:49.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.433+0000 7f9ad7f2c240 4 main: JournalTool: creating IoCtx.. 2023-10-06T02:26:49.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.433+0000 7f9ad7f2c240 4 main: Executing for rank 0 2023-10-06T02:26:49.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.433+0000 7f9ad7f2c240 4 Filtering by inode '1099511627777' 2023-10-06T02:26:49.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.433+0000 7f9ad7f2c240 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x559b25208400 0x559b24527b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.433+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1731550680 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:1 9.f 9:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60) v8 -- 0x559b25208800 con 0x559b25208400 2023-10-06T02:26:49.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.433+0000 7f9ad13fa700 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x559b25240400 0x559b24529700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.433+0000 7f9ad0bf9700 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x559b25208400 0x559b24527b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.433+0000 7f9ad13fa700 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x559b25240400 0x559b24529700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x559b25137680 tx=0x559b2521f260 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.433+0000 7f9ad0bf9700 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x559b25208400 0x559b24527b80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.434+0000 7f9ad0bf9700 1 -- 172.21.15.37:0/1731550680 <== osd.5 v2:172.21.15.191:6808/90853 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x559b25114fc0 con 0x559b25208400 2023-10-06T02:26:49.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.434+0000 7f9ad7f2c240 4 Pointer 400.00000000 is readable 2023-10-06T02:26:49.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.434+0000 7f9ad7f2c240 4 JournalScanner::scan: reading header object '200.00000000' 2023-10-06T02:26:49.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.434+0000 7f9ad7f2c240 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x559b25208c00 0x559b24527600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.434+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1731550680 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:2 9.14 9:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60) v8 -- 0x559b25209000 con 0x559b25208c00 2023-10-06T02:26:49.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.434+0000 7f9ad1bfb700 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x559b25208c00 0x559b24527600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.434+0000 7f9ad1bfb700 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x559b25208c00 0x559b24527600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.437+0000 7f9ad1bfb700 1 -- 172.21.15.37:0/1731550680 <== osd.1 v2:172.21.15.37:6808/90617 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x559b25115200 con 0x559b25208c00 2023-10-06T02:26:49.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.437+0000 7f9ad7f2c240 10 Header 0x400000 0x405cec 0x406068 2023-10-06T02:26:49.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.437+0000 7f9ad7f2c240 10 Starting journal scan from offset 0x405cec 2023-10-06T02:26:49.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.437+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1731550680 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:3 9.14 9:2e2fa760:::200.00000001:head [read 23788~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60) v8 -- 0x559b25209400 con 0x559b25208c00 2023-10-06T02:26:49.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.437+0000 7f9ad1bfb700 1 -- 172.21.15.37:0/1731550680 <== osd.1 v2:172.21.15.37:6808/90617 2 ==== osd_op_reply(3 200.00000001 [read 23788~892 out=892b] v0'0 uv27 ondisk = 0) v8 ==== 156+0+892 (crc 0 0 0) 0x559b25115200 con 0x559b25208c00 2023-10-06T02:26:49.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.437+0000 7f9ad7f2c240 4 Read 0x37c bytes from 200.00000001 gap=0 2023-10-06T02:26:49.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.437+0000 7f9ad7f2c240 10 Parsing data, 0x37c bytes available 2023-10-06T02:26:49.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.437+0000 7f9ad7f2c240 10 Attempting decode at 0x405cec 2023-10-06T02:26:49.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.437+0000 7f9ad7f2c240 10 Consumed 0x37c bytes 2023-10-06T02:26:49.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.437+0000 7f9ad7f2c240 10 Valid entry at 0x405cec 2023-10-06T02:26:49.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.437+0000 7f9ad7f2c240 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x559b25209800 0x559b2532e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.437+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1731550680 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:4 9.1b 9:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60) v8 -- 0x559b25209c00 con 0x559b25209800 2023-10-06T02:26:49.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.437+0000 7f9ad13fa700 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x559b25209800 0x559b2532e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad13fa700 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x559b25209800 0x559b2532e000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad13fa700 1 -- 172.21.15.37:0/1731550680 <== osd.3 v2:172.21.15.37:6817/90628 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x559b25115440 con 0x559b25209800 2023-10-06T02:26:49.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 4 Reached end of journal objects 2023-10-06T02:26:49.447 INFO:teuthology.orchestra.run.smithi037.stdout:Events by type: 2023-10-06T02:26:49.447 INFO:teuthology.orchestra.run.smithi037.stdout:Errors: 0 2023-10-06T02:26:49.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 4 Scanned objects, 0 missing, 1 valid 2023-10-06T02:26:49.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 4 Events scanned, 0 gaps 2023-10-06T02:26:49.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 4 Found 1 valid events 2023-10-06T02:26:49.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 4 Selected 0 events events for processing 2023-10-06T02:26:49.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 4 0 events 2023-10-06T02:26:49.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1731550680 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x559b25208c00 msgr2=0x559b24527600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x559b25208c00 0x559b24527600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1731550680 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x559b25209800 msgr2=0x559b2532e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x559b25209800 0x559b2532e000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1731550680 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x559b25208400 msgr2=0x559b24527b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x559b25208400 0x559b24527b80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad13fa700 1 -- 172.21.15.37:0/1731550680 reap_dead start 2023-10-06T02:26:49.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1731550680 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x559b25240400 msgr2=0x559b24529700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x559b25240400 0x559b24529700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x559b25137680 tx=0x559b2521f260 comp rx=0 tx=0).stop 2023-10-06T02:26:49.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1731550680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b25208000 msgr2=0x559b24528100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b25208000 0x559b24528100 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x559b25210060 tx=0x559b25149860 comp rx=0 tx=0).stop 2023-10-06T02:26:49.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1731550680 shutdown_connections 2023-10-06T02:26:49.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x559b25240400 0x559b24529700 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 1 --2- 172.21.15.37:0/1731550680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b25208000 0x559b24528100 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1731550680 >> 172.21.15.37:0/1731550680 conn(0x559b24497000 msgr2=0x559b244ab800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:49.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1731550680 shutdown_connections 2023-10-06T02:26:49.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.438+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1731550680 wait complete. 2023-10-06T02:26:49.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.439+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1266597610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b24496c00 msgr2=0x559b24527080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.439+0000 7f9ad7f2c240 1 --2- 172.21.15.37:0/1266597610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b24496c00 0x559b24527080 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x559b25134030 tx=0x559b25149b60 comp rx=0 tx=0).stop 2023-10-06T02:26:49.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.439+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1266597610 shutdown_connections 2023-10-06T02:26:49.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.439+0000 7f9ad7f2c240 1 --2- 172.21.15.37:0/1266597610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b24496c00 0x559b24527080 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.439+0000 7f9ad7f2c240 1 --2- 172.21.15.37:0/1266597610 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559b24496400 0x559b24526580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.439+0000 7f9ad7f2c240 1 --2- 172.21.15.37:0/1266597610 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b24496800 0x559b24526b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.439+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1266597610 >> 172.21.15.37:0/1266597610 conn(0x559b24496000 msgr2=0x559b244ab000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:49.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.439+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1266597610 shutdown_connections 2023-10-06T02:26:49.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.439+0000 7f9ad7f2c240 1 -- 172.21.15.37:0/1266597610 wait complete. 2023-10-06T02:26:49.453 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627777', 'summary'] in time 0:00:00.065041, result: Events by type: Errors: 0 2023-10-06T02:26:49.454 DEBUG:teuthology.orchestra.run.smithi037:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627778 summary 2023-10-06T02:26:49.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.527+0000 7fc26517d240 1 -- start start 2023-10-06T02:26:49.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.527+0000 7fc26517d240 1 Processor -- start 2023-10-06T02:26:49.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.528+0000 7fc26517d240 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5597f987b000 0x5597fa4c0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.528+0000 7fc26517d240 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5597f987bc00 0x5597fa4c0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.528+0000 7fc26517d240 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597f987a800 0x5597fa4c1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.528+0000 7fc26517d240 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597f9745cc0 con 0x5597f987a800 2023-10-06T02:26:49.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.528+0000 7fc26517d240 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597f9745540 con 0x5597f987bc00 2023-10-06T02:26:49.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.528+0000 7fc26517d240 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597f9744000 con 0x5597f987b000 2023-10-06T02:26:49.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.528+0000 7fc25ee4c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597f987a800 0x5597fa4c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.528+0000 7fc25ee4c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597f987a800 0x5597fa4c1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39048/0 (socket says 172.21.15.37:39048) 2023-10-06T02:26:49.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.528+0000 7fc25ee4c700 1 -- 172.21.15.37:0/1693042859 learned_addr learned my addr 172.21.15.37:0/1693042859 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:49.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.528+0000 7fc25e64b700 1 --2- 172.21.15.37:0/1693042859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5597f987b000 0x5597fa4c0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.528+0000 7fc25de4a700 1 --2- 172.21.15.37:0/1693042859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5597f987bc00 0x5597fa4c0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.528+0000 7fc25ee4c700 1 -- 172.21.15.37:0/1693042859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5597f987b000 msgr2=0x5597fa4c0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:49.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.528+0000 7fc25ee4c700 1 --2- 172.21.15.37:0/1693042859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5597f987b000 0x5597fa4c0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.528+0000 7fc25ee4c700 1 -- 172.21.15.37:0/1693042859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5597f987bc00 msgr2=0x5597fa4c0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:49.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.528+0000 7fc25ee4c700 1 --2- 172.21.15.37:0/1693042859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5597f987bc00 0x5597fa4c0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.529+0000 7fc25ee4c700 1 -- 172.21.15.37:0/1693042859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597f9729860 con 0x5597f987a800 2023-10-06T02:26:49.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.529+0000 7fc25ee4c700 1 --2- 172.21.15.37:0/1693042859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597f987a800 0x5597fa4c1600 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x5597fa484630 tx=0x5597fa497bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71533606d6b4ef83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.529+0000 7fc25be46700 1 -- 172.21.15.37:0/1693042859 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5597f973cf20 con 0x5597f987a800 2023-10-06T02:26:49.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.529+0000 7fc25be46700 1 -- 172.21.15.37:0/1693042859 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5597f975a900 con 0x5597f987a800 2023-10-06T02:26:49.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.529+0000 7fc25be46700 1 -- 172.21.15.37:0/1693042859 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5597f973d080 con 0x5597f987a800 2023-10-06T02:26:49.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.529+0000 7fc26517d240 1 -- 172.21.15.37:0/1693042859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5597f9728b60 con 0x5597f987a800 2023-10-06T02:26:49.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.529+0000 7fc26517d240 1 -- 172.21.15.37:0/1693042859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5597f9728340 con 0x5597f987a800 2023-10-06T02:26:49.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.529+0000 7fc26517d240 4 waiting for MDS map... 2023-10-06T02:26:49.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.529+0000 7fc25be46700 1 -- 172.21.15.37:0/1693042859 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x5597f9748c40 con 0x5597f987a800 2023-10-06T02:26:49.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.529+0000 7fc25be46700 1 -- 172.21.15.37:0/1693042859 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 32) v1 ==== 2559+0+0 (secure 0 0 0) 0x5597fa520000 con 0x5597f987a800 2023-10-06T02:26:49.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.529+0000 7fc26517d240 4 Got MDS map 32 2023-10-06T02:26:49.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.529+0000 7fc26517d240 10 main: JournalTool::main 2023-10-06T02:26:49.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.529+0000 7fc26517d240 4 main: JournalTool: connecting to RADOS... 2023-10-06T02:26:49.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.530+0000 7fc26517d240 1 Processor -- start 2023-10-06T02:26:49.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.530+0000 7fc26517d240 1 -- start start 2023-10-06T02:26:49.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.530+0000 7fc26517d240 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597f987b800 0x5597fa4c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.530+0000 7fc26517d240 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5597fa570000 0x5597fa4c2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.530+0000 7fc26517d240 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5597fa570400 0x5597fa4c2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.530+0000 7fc26517d240 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597f97443c0 con 0x5597f987b800 2023-10-06T02:26:49.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.530+0000 7fc26517d240 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597f9744dc0 con 0x5597fa570400 2023-10-06T02:26:49.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.530+0000 7fc26517d240 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597f9745e00 con 0x5597fa570000 2023-10-06T02:26:49.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.530+0000 7fc25de4a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597f987b800 0x5597fa4c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.530+0000 7fc25de4a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597f987b800 0x5597fa4c1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39058/0 (socket says 172.21.15.37:39058) 2023-10-06T02:26:49.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.530+0000 7fc25de4a700 1 -- 172.21.15.37:0/1354236225 learned_addr learned my addr 172.21.15.37:0/1354236225 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:49.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.531+0000 7fc25e64b700 1 --2- 172.21.15.37:0/1354236225 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5597fa570000 0x5597fa4c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.531+0000 7fc25de4a700 1 --2- 172.21.15.37:0/1354236225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5597fa570400 0x5597fa4c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.531+0000 7fc25de4a700 1 -- 172.21.15.37:0/1354236225 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5597fa570000 msgr2=0x5597fa4c2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:49.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.531+0000 7fc25de4a700 1 --2- 172.21.15.37:0/1354236225 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5597fa570000 0x5597fa4c2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.531+0000 7fc25de4a700 1 -- 172.21.15.37:0/1354236225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5597fa570400 msgr2=0x5597fa4c2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:49.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.531+0000 7fc25de4a700 1 --2- 172.21.15.37:0/1354236225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5597fa570400 0x5597fa4c2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.531+0000 7fc25de4a700 1 -- 172.21.15.37:0/1354236225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597f9729860 con 0x5597f987b800 2023-10-06T02:26:49.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.531+0000 7fc25de4a700 1 --2- 172.21.15.37:0/1354236225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597f987b800 0x5597fa4c1b80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x5597fa50b530 tx=0x5597fa57c060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43ca5c2e25e1d8f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.531+0000 7fc259e42700 1 -- 172.21.15.37:0/1354236225 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5597f973cf20 con 0x5597f987b800 2023-10-06T02:26:49.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.531+0000 7fc259e42700 1 -- 172.21.15.37:0/1354236225 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5597fa528300 con 0x5597f987b800 2023-10-06T02:26:49.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.531+0000 7fc259e42700 1 -- 172.21.15.37:0/1354236225 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5597f973d080 con 0x5597f987b800 2023-10-06T02:26:49.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.531+0000 7fc26517d240 1 -- 172.21.15.37:0/1354236225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597f987b800 msgr2=0x5597fa4c1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.531+0000 7fc26517d240 1 --2- 172.21.15.37:0/1354236225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597f987b800 0x5597fa4c1b80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x5597fa50b530 tx=0x5597fa57c060 comp rx=0 tx=0).stop 2023-10-06T02:26:49.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.531+0000 7fc26517d240 1 -- 172.21.15.37:0/1354236225 shutdown_connections 2023-10-06T02:26:49.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.531+0000 7fc26517d240 1 --2- 172.21.15.37:0/1354236225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5597fa570400 0x5597fa4c2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.531+0000 7fc26517d240 1 --2- 172.21.15.37:0/1354236225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597f987b800 0x5597fa4c1b80 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.531+0000 7fc26517d240 1 --2- 172.21.15.37:0/1354236225 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5597fa570000 0x5597fa4c2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.531+0000 7fc26517d240 1 -- 172.21.15.37:0/1354236225 >> 172.21.15.37:0/1354236225 conn(0x5597f987a400 msgr2=0x5597f97e5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:49.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.532+0000 7fc26517d240 1 -- 172.21.15.37:0/1354236225 shutdown_connections 2023-10-06T02:26:49.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.532+0000 7fc26517d240 1 -- 172.21.15.37:0/1354236225 wait complete. 2023-10-06T02:26:49.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.532+0000 7fc26517d240 1 Processor -- start 2023-10-06T02:26:49.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.532+0000 7fc26517d240 1 -- start start 2023-10-06T02:26:49.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc26517d240 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5597f987a400 0x5597fa4c2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc26517d240 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597fa58e000 0x5597fa4c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc26517d240 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5597fa58e400 0x5597fa4c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc26517d240 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597f9744000 con 0x5597fa58e000 2023-10-06T02:26:49.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc26517d240 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597f9745180 con 0x5597f987a400 2023-10-06T02:26:49.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc26517d240 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597f9745040 con 0x5597fa58e400 2023-10-06T02:26:49.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc25e64b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597fa58e000 0x5597fa4c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc25e64b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597fa58e000 0x5597fa4c2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39066/0 (socket says 172.21.15.37:39066) 2023-10-06T02:26:49.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc25e64b700 1 -- 172.21.15.37:0/3308920118 learned_addr learned my addr 172.21.15.37:0/3308920118 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:49.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc25de4a700 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5597f987a400 0x5597fa4c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc25de4a700 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5597fa58e400 0x5597fa4c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc25e64b700 1 -- 172.21.15.37:0/3308920118 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5597fa58e400 msgr2=0x5597fa4c2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc25e64b700 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5597fa58e400 0x5597fa4c2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc25e64b700 1 -- 172.21.15.37:0/3308920118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5597f987a400 msgr2=0x5597fa4c2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc25e64b700 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5597f987a400 0x5597fa4c2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc25e64b700 1 -- 172.21.15.37:0/3308920118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597f97289c0 con 0x5597fa58e000 2023-10-06T02:26:49.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc25de4a700 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5597fa58e400 0x5597fa4c2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:49.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc25e64b700 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597fa58e000 0x5597fa4c2680 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x5597fa5366f0 tx=0x5597fa57c120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc25863f700 1 -- 172.21.15.37:0/3308920118 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5597f973cf20 con 0x5597fa58e000 2023-10-06T02:26:49.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc25863f700 1 -- 172.21.15.37:0/3308920118 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5597f975a480 con 0x5597fa58e000 2023-10-06T02:26:49.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc26517d240 1 -- 172.21.15.37:0/3308920118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5597f9729a00 con 0x5597fa58e000 2023-10-06T02:26:49.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc25863f700 1 -- 172.21.15.37:0/3308920118 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5597f973d080 con 0x5597fa58e000 2023-10-06T02:26:49.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc26517d240 1 -- 172.21.15.37:0/3308920118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5597f9729ba0 con 0x5597fa58e000 2023-10-06T02:26:49.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.533+0000 7fc26517d240 4 main: JournalTool: resolving pool 9 2023-10-06T02:26:49.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.535+0000 7fc25863f700 1 -- 172.21.15.37:0/3308920118 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x5597fa47b080 con 0x5597fa58e000 2023-10-06T02:26:49.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.535+0000 7fc25863f700 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x5597fa598400 0x5597fa4c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.535+0000 7fc25863f700 1 -- 172.21.15.37:0/3308920118 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x5597f9748a80 con 0x5597fa58e000 2023-10-06T02:26:49.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.535+0000 7fc26517d240 4 main: JournalTool: creating IoCtx.. 2023-10-06T02:26:49.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.535+0000 7fc26517d240 4 main: Executing for rank 0 2023-10-06T02:26:49.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.535+0000 7fc26517d240 4 Filtering by inode '1099511627778' 2023-10-06T02:26:49.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.535+0000 7fc26517d240 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x5597fa58e800 0x5597fa4c3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.535+0000 7fc26517d240 1 -- 172.21.15.37:0/3308920118 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:1 9.f 9:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60) v8 -- 0x5597fa58ec00 con 0x5597fa58e800 2023-10-06T02:26:49.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.535+0000 7fc25de4a700 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x5597fa598400 0x5597fa4c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.535+0000 7fc25de4a700 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x5597fa58e800 0x5597fa4c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.536+0000 7fc25de4a700 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x5597fa598400 0x5597fa4c3700 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x5597fa50b680 tx=0x5597fa497a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.536+0000 7fc25de4a700 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x5597fa58e800 0x5597fa4c3180 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.536+0000 7fc25de4a700 1 -- 172.21.15.37:0/3308920118 <== osd.5 v2:172.21.15.191:6808/90853 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x5597fa4f8fc0 con 0x5597fa58e800 2023-10-06T02:26:49.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.536+0000 7fc26517d240 4 Pointer 400.00000000 is readable 2023-10-06T02:26:49.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.536+0000 7fc26517d240 4 JournalScanner::scan: reading header object '200.00000000' 2023-10-06T02:26:49.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.536+0000 7fc26517d240 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5597fa58f000 0x5597fa67a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.536+0000 7fc26517d240 1 -- 172.21.15.37:0/3308920118 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:2 9.14 9:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60) v8 -- 0x5597fa58f400 con 0x5597fa58f000 2023-10-06T02:26:49.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.536+0000 7fc25ee4c700 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5597fa58f000 0x5597fa67a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.536+0000 7fc25ee4c700 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5597fa58f000 0x5597fa67a000 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.537+0000 7fc25ee4c700 1 -- 172.21.15.37:0/3308920118 <== osd.1 v2:172.21.15.37:6808/90617 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x5597fa4f9200 con 0x5597fa58f000 2023-10-06T02:26:49.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.537+0000 7fc26517d240 10 Header 0x400000 0x405cec 0x406068 2023-10-06T02:26:49.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.537+0000 7fc26517d240 10 Starting journal scan from offset 0x405cec 2023-10-06T02:26:49.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.537+0000 7fc26517d240 1 -- 172.21.15.37:0/3308920118 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:3 9.14 9:2e2fa760:::200.00000001:head [read 23788~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60) v8 -- 0x5597fa58f800 con 0x5597fa58f000 2023-10-06T02:26:49.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.537+0000 7fc25ee4c700 1 -- 172.21.15.37:0/3308920118 <== osd.1 v2:172.21.15.37:6808/90617 2 ==== osd_op_reply(3 200.00000001 [read 23788~892 out=892b] v0'0 uv27 ondisk = 0) v8 ==== 156+0+892 (crc 0 0 0) 0x5597fa4f9200 con 0x5597fa58f000 2023-10-06T02:26:49.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.537+0000 7fc26517d240 4 Read 0x37c bytes from 200.00000001 gap=0 2023-10-06T02:26:49.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.537+0000 7fc26517d240 10 Parsing data, 0x37c bytes available 2023-10-06T02:26:49.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.537+0000 7fc26517d240 10 Attempting decode at 0x405cec 2023-10-06T02:26:49.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.537+0000 7fc26517d240 10 Consumed 0x37c bytes 2023-10-06T02:26:49.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.537+0000 7fc26517d240 10 Valid entry at 0x405cec 2023-10-06T02:26:49.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.537+0000 7fc26517d240 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x5597fa58fc00 0x5597fa67a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.537+0000 7fc26517d240 1 -- 172.21.15.37:0/3308920118 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:4 9.1b 9:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60) v8 -- 0x5597fa598800 con 0x5597fa58fc00 2023-10-06T02:26:49.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.537+0000 7fc25e64b700 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x5597fa58fc00 0x5597fa67a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.537+0000 7fc25e64b700 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x5597fa58fc00 0x5597fa67a580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc25e64b700 1 -- 172.21.15.37:0/3308920118 <== osd.3 v2:172.21.15.37:6817/90628 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5597fa4f9440 con 0x5597fa58fc00 2023-10-06T02:26:49.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 4 Reached end of journal objects 2023-10-06T02:26:49.570 INFO:teuthology.orchestra.run.smithi037.stdout:Events by type: 2023-10-06T02:26:49.570 INFO:teuthology.orchestra.run.smithi037.stdout:Errors: 0 2023-10-06T02:26:49.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 4 Scanned objects, 0 missing, 1 valid 2023-10-06T02:26:49.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 4 Events scanned, 0 gaps 2023-10-06T02:26:49.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 4 Found 1 valid events 2023-10-06T02:26:49.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 4 Selected 0 events events for processing 2023-10-06T02:26:49.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 4 0 events 2023-10-06T02:26:49.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 -- 172.21.15.37:0/3308920118 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5597fa58f000 msgr2=0x5597fa67a000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5597fa58f000 0x5597fa67a000 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 -- 172.21.15.37:0/3308920118 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x5597fa58fc00 msgr2=0x5597fa67a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x5597fa58fc00 0x5597fa67a580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 -- 172.21.15.37:0/3308920118 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x5597fa58e800 msgr2=0x5597fa4c3180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x5597fa58e800 0x5597fa4c3180 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc25e64b700 1 -- 172.21.15.37:0/3308920118 reap_dead start 2023-10-06T02:26:49.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 -- 172.21.15.37:0/3308920118 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x5597fa598400 msgr2=0x5597fa4c3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x5597fa598400 0x5597fa4c3700 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x5597fa50b680 tx=0x5597fa497a40 comp rx=0 tx=0).stop 2023-10-06T02:26:49.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 -- 172.21.15.37:0/3308920118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597fa58e000 msgr2=0x5597fa4c2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597fa58e000 0x5597fa4c2680 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x5597fa5366f0 tx=0x5597fa57c120 comp rx=0 tx=0).stop 2023-10-06T02:26:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 -- 172.21.15.37:0/3308920118 shutdown_connections 2023-10-06T02:26:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x5597fa598400 0x5597fa4c3700 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 --2- 172.21.15.37:0/3308920118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597fa58e000 0x5597fa4c2680 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 -- 172.21.15.37:0/3308920118 >> 172.21.15.37:0/3308920118 conn(0x5597f987b800 msgr2=0x5597f97e5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 -- 172.21.15.37:0/3308920118 shutdown_connections 2023-10-06T02:26:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 -- 172.21.15.37:0/3308920118 wait complete. 2023-10-06T02:26:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 -- 172.21.15.37:0/1693042859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597f987a800 msgr2=0x5597fa4c1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 --2- 172.21.15.37:0/1693042859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597f987a800 0x5597fa4c1600 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x5597fa484630 tx=0x5597fa497bc0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 -- 172.21.15.37:0/1693042859 shutdown_connections 2023-10-06T02:26:49.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 --2- 172.21.15.37:0/1693042859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5597f987a800 0x5597fa4c1600 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 --2- 172.21.15.37:0/1693042859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5597f987b000 0x5597fa4c0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 --2- 172.21.15.37:0/1693042859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5597f987bc00 0x5597fa4c0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 -- 172.21.15.37:0/1693042859 >> 172.21.15.37:0/1693042859 conn(0x5597f987a000 msgr2=0x5597f97e6000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:49.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 -- 172.21.15.37:0/1693042859 shutdown_connections 2023-10-06T02:26:49.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.538+0000 7fc26517d240 1 -- 172.21.15.37:0/1693042859 wait complete. 2023-10-06T02:26:49.587 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627778', 'summary'] in time 0:00:00.133714, result: Events by type: Errors: 0 2023-10-06T02:26:49.587 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds0_inotable - 2023-10-06T02:26:49.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.650+0000 7f5a418e9000 1 Processor -- start 2023-10-06T02:26:49.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.650+0000 7f5a418e9000 1 -- start start 2023-10-06T02:26:49.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.651+0000 7f5a418e9000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563ff3418ab0 0x563ff34441f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.651+0000 7f5a418e9000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563ff3444c90 0x563ff34eb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.651+0000 7f5a418e9000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff34eaeb0 0x563ff34eb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.651+0000 7f5a418e9000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff3361980 con 0x563ff3444c90 2023-10-06T02:26:49.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.651+0000 7f5a418e9000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff3361620 con 0x563ff34eaeb0 2023-10-06T02:26:49.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.651+0000 7f5a418e9000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ff3358400 con 0x563ff3418ab0 2023-10-06T02:26:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.651+0000 7f5a3a323700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563ff3444c90 0x563ff34eb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.651+0000 7f5a3a323700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563ff3444c90 0x563ff34eb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39074/0 (socket says 172.21.15.37:39074) 2023-10-06T02:26:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.651+0000 7f5a3a323700 1 -- 172.21.15.37:0/2265188071 learned_addr learned my addr 172.21.15.37:0/2265188071 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.651+0000 7f5a3b325700 1 --2- 172.21.15.37:0/2265188071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff34eaeb0 0x563ff34eb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.651+0000 7f5a3ab24700 1 --2- 172.21.15.37:0/2265188071 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563ff3418ab0 0x563ff34441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.651+0000 7f5a3a323700 1 -- 172.21.15.37:0/2265188071 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563ff3418ab0 msgr2=0x563ff34441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.651+0000 7f5a3a323700 1 --2- 172.21.15.37:0/2265188071 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563ff3418ab0 0x563ff34441f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.651+0000 7f5a3a323700 1 -- 172.21.15.37:0/2265188071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff34eaeb0 msgr2=0x563ff34eb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:49.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.651+0000 7f5a3a323700 1 --2- 172.21.15.37:0/2265188071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff34eaeb0 0x563ff34eb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.651+0000 7f5a3a323700 1 -- 172.21.15.37:0/2265188071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a34005db0 con 0x563ff3444c90 2023-10-06T02:26:49.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.652+0000 7f5a3a323700 1 --2- 172.21.15.37:0/2265188071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563ff3444c90 0x563ff34eb280 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400a750 tx=0x7f5a24005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c44c7fe5e3b76e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.652+0000 7f5a39321700 1 -- 172.21.15.37:0/2265188071 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2400f070 con 0x563ff3444c90 2023-10-06T02:26:49.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.652+0000 7f5a39321700 1 -- 172.21.15.37:0/2265188071 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a24008660 con 0x563ff3444c90 2023-10-06T02:26:49.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.652+0000 7f5a39321700 1 -- 172.21.15.37:0/2265188071 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a24008a00 con 0x563ff3444c90 2023-10-06T02:26:49.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.652+0000 7f5a418e9000 1 -- 172.21.15.37:0/2265188071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563ff3444c90 msgr2=0x563ff34eb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.652+0000 7f5a418e9000 1 --2- 172.21.15.37:0/2265188071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563ff3444c90 0x563ff34eb280 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400a750 tx=0x7f5a24005c80 comp rx=0 tx=0).stop 2023-10-06T02:26:49.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.652+0000 7f5a418e9000 1 -- 172.21.15.37:0/2265188071 shutdown_connections 2023-10-06T02:26:49.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.652+0000 7f5a418e9000 1 --2- 172.21.15.37:0/2265188071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff34eaeb0 0x563ff34eb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.652+0000 7f5a418e9000 1 --2- 172.21.15.37:0/2265188071 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563ff3418ab0 0x563ff34441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.652+0000 7f5a418e9000 1 --2- 172.21.15.37:0/2265188071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563ff3444c90 0x563ff34eb280 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.652+0000 7f5a418e9000 1 -- 172.21.15.37:0/2265188071 >> 172.21.15.37:0/2265188071 conn(0x563ff3446980 msgr2=0x563ff34431e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.652+0000 7f5a418e9000 1 -- 172.21.15.37:0/2265188071 shutdown_connections 2023-10-06T02:26:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.652+0000 7f5a418e9000 1 -- 172.21.15.37:0/2265188071 wait complete. 2023-10-06T02:26:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.653+0000 7f5a418e9000 1 Processor -- start 2023-10-06T02:26:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.653+0000 7f5a418e9000 1 -- start start 2023-10-06T02:26:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a418e9000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff3418ab0 0x563ff34d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a418e9000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563ff3444c90 0x563ff3457300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a418e9000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563ff34eaeb0 0x563ff3416a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a418e9000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff34d2080 con 0x563ff3444c90 2023-10-06T02:26:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a418e9000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff34438e0 con 0x563ff3418ab0 2023-10-06T02:26:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a418e9000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ff3415b10 con 0x563ff34eaeb0 2023-10-06T02:26:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a3a323700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563ff3444c90 0x563ff3457300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a3a323700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563ff3444c90 0x563ff3457300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39088/0 (socket says 172.21.15.37:39088) 2023-10-06T02:26:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a3a323700 1 -- 172.21.15.37:0/4050628689 learned_addr learned my addr 172.21.15.37:0/4050628689 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a3ab24700 1 --2- 172.21.15.37:0/4050628689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff3418ab0 0x563ff34d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a3b325700 1 --2- 172.21.15.37:0/4050628689 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563ff34eaeb0 0x563ff3416a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a3a323700 1 -- 172.21.15.37:0/4050628689 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563ff34eaeb0 msgr2=0x563ff3416a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a3a323700 1 --2- 172.21.15.37:0/4050628689 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563ff34eaeb0 0x563ff3416a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a3a323700 1 -- 172.21.15.37:0/4050628689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff3418ab0 msgr2=0x563ff34d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a3a323700 1 --2- 172.21.15.37:0/4050628689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff3418ab0 0x563ff34d1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a3a323700 1 -- 172.21.15.37:0/4050628689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2400a440 con 0x563ff3444c90 2023-10-06T02:26:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a3ab24700 1 --2- 172.21.15.37:0/4050628689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff3418ab0 0x563ff34d1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a3b325700 1 --2- 172.21.15.37:0/4050628689 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563ff34eaeb0 0x563ff3416a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a3a323700 1 --2- 172.21.15.37:0/4050628689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563ff3444c90 0x563ff3457300 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5a24000e10 tx=0x7f5a24018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a337fe700 1 -- 172.21.15.37:0/4050628689 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a24020700 con 0x563ff3444c90 2023-10-06T02:26:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a337fe700 1 -- 172.21.15.37:0/4050628689 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a24020880 con 0x563ff3444c90 2023-10-06T02:26:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a418e9000 1 -- 172.21.15.37:0/4050628689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563ff33703d0 con 0x563ff3444c90 2023-10-06T02:26:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a337fe700 1 -- 172.21.15.37:0/4050628689 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a24020c40 con 0x563ff3444c90 2023-10-06T02:26:49.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.654+0000 7f5a418e9000 1 -- 172.21.15.37:0/4050628689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563ff3363ae0 con 0x563ff3444c90 2023-10-06T02:26:49.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.656+0000 7f5a337fe700 1 -- 172.21.15.37:0/4050628689 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a24013070 con 0x563ff3444c90 2023-10-06T02:26:49.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.656+0000 7f5a337fe700 1 --2- 172.21.15.37:0/4050628689 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5a1c065890 0x7f5a1c067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.656+0000 7f5a337fe700 1 -- 172.21.15.37:0/4050628689 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f5a24084f20 con 0x563ff3444c90 2023-10-06T02:26:49.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.656+0000 7f5a418e9000 1 --2- 172.21.15.37:0/4050628689 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x563ff34fdeb0 0x563ff3440320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.656+0000 7f5a418e9000 1 -- 172.21.15.37:0/4050628689 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:1 9.13 9:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60) v8 -- 0x563ff3440860 con 0x563ff34fdeb0 2023-10-06T02:26:49.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.656+0000 7f5a3ab24700 1 --2- 172.21.15.37:0/4050628689 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5a1c065890 0x7f5a1c067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.656+0000 7f5a3b325700 1 --2- 172.21.15.37:0/4050628689 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x563ff34fdeb0 0x563ff3440320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.657+0000 7f5a3ab24700 1 --2- 172.21.15.37:0/4050628689 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5a1c065890 0x7f5a1c067d40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c000f80 tx=0x7f5a2c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.657+0000 7f5a3b325700 1 --2- 172.21.15.37:0/4050628689 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x563ff34fdeb0 0x563ff3440320 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.658+0000 7f5a3b325700 1 -- 172.21.15.37:0/4050628689 <== osd.7 v2:172.21.15.191:6813/90854 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v60'5 uv5 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5a34008bc0 con 0x563ff34fdeb0 2023-10-06T02:26:49.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.658+0000 7f5a418e9000 1 -- 172.21.15.37:0/4050628689 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x563ff34fdeb0 msgr2=0x563ff3440320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.658+0000 7f5a418e9000 1 --2- 172.21.15.37:0/4050628689 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x563ff34fdeb0 0x563ff3440320 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.659+0000 7f5a418e9000 1 -- 172.21.15.37:0/4050628689 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5a1c065890 msgr2=0x7f5a1c067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.659+0000 7f5a418e9000 1 --2- 172.21.15.37:0/4050628689 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5a1c065890 0x7f5a1c067d40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c000f80 tx=0x7f5a2c008040 comp rx=0 tx=0).stop 2023-10-06T02:26:49.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.659+0000 7f5a418e9000 1 -- 172.21.15.37:0/4050628689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563ff3444c90 msgr2=0x563ff3457300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.659+0000 7f5a418e9000 1 --2- 172.21.15.37:0/4050628689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563ff3444c90 0x563ff3457300 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5a24000e10 tx=0x7f5a24018000 comp rx=0 tx=0).stop 2023-10-06T02:26:49.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.659+0000 7f5a3b325700 1 -- 172.21.15.37:0/4050628689 reap_dead start 2023-10-06T02:26:49.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.659+0000 7f5a418e9000 1 -- 172.21.15.37:0/4050628689 shutdown_connections 2023-10-06T02:26:49.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.659+0000 7f5a418e9000 1 -- 172.21.15.37:0/4050628689 >> 172.21.15.37:0/4050628689 conn(0x563ff3446980 msgr2=0x563ff3444180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:49.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.659+0000 7f5a418e9000 1 -- 172.21.15.37:0/4050628689 shutdown_connections 2023-10-06T02:26:49.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.659+0000 7f5a418e9000 1 -- 172.21.15.37:0/4050628689 wait complete. 2023-10-06T02:26:49.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:26:49.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.866+0000 7f837e0c1700 1 Processor -- start 2023-10-06T02:26:49.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.866+0000 7f837e0c1700 1 -- start start 2023-10-06T02:26:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.867+0000 7f837e0c1700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f83781593c0 0x7f8378159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.867+0000 7f837e0c1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f83780b2380 0x7f83780b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.867+0000 7f837e0c1700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83780b07a0 con 0x7f83780ccb30 2023-10-06T02:26:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.867+0000 7f837e0c1700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83780cd6a0 con 0x7f83780b2380 2023-10-06T02:26:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.867+0000 7f837e0c1700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83780cd8a0 con 0x7f83781593c0 2023-10-06T02:26:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.867+0000 7f8376ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f83780b2380 0x7f83780b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.867+0000 7f8377fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f83780ccb30 0x7f83780ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38242/0 (socket says 172.21.15.37:38242) 2023-10-06T02:26:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.867+0000 7f8377fff700 1 -- 172.21.15.37:0/2063021516 learned_addr learned my addr 172.21.15.37:0/2063021516 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:26:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.867+0000 7f83777fe700 1 --2- 172.21.15.37:0/2063021516 >> v2:172.21.15.191:3300/0 conn(0x7f83781593c0 0x7f8378159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.867+0000 7f8376ffd700 1 -- 172.21.15.37:0/2063021516 >> v2:172.21.15.191:3300/0 conn(0x7f83781593c0 msgr2=0x7f8378159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:49.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.867+0000 7f8376ffd700 1 --2- 172.21.15.37:0/2063021516 >> v2:172.21.15.191:3300/0 conn(0x7f83781593c0 0x7f8378159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.868+0000 7f8376ffd700 1 -- 172.21.15.37:0/2063021516 >> v1:172.21.15.37:6789/0 conn(0x7f83780ccb30 legacy=0x7f83780ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.868+0000 7f8376ffd700 1 -- 172.21.15.37:0/2063021516 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83780afe70 con 0x7f83780b2380 2023-10-06T02:26:49.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.868+0000 7f83767fc700 1 -- 172.21.15.37:0/2063021516 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677522979 0 0) 0x7f83780b07a0 con 0x7f83780ccb30 2023-10-06T02:26:49.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.868+0000 7f8376ffd700 1 --2- 172.21.15.37:0/2063021516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83780b2380 0x7f83780b2820 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f837806d520 tx=0x7f836c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2867891ca95090d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.868+0000 7f83767fc700 1 -- 172.21.15.37:0/2063021516 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c00b6b0 con 0x7f83780b2380 2023-10-06T02:26:49.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.868+0000 7f83767fc700 1 -- 172.21.15.37:0/2063021516 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c00b810 con 0x7f83780b2380 2023-10-06T02:26:49.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.868+0000 7f83767fc700 1 -- 172.21.15.37:0/2063021516 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c00bbb0 con 0x7f83780b2380 2023-10-06T02:26:49.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.868+0000 7f837e0c1700 1 -- 172.21.15.37:0/2063021516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83780b2380 msgr2=0x7f83780b2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.868+0000 7f837e0c1700 1 --2- 172.21.15.37:0/2063021516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83780b2380 0x7f83780b2820 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f837806d520 tx=0x7f836c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.868+0000 7f837e0c1700 1 -- 172.21.15.37:0/2063021516 shutdown_connections 2023-10-06T02:26:49.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.868+0000 7f837e0c1700 1 --2- 172.21.15.37:0/2063021516 >> v2:172.21.15.191:3300/0 conn(0x7f83781593c0 0x7f8378159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.868+0000 7f837e0c1700 1 --2- 172.21.15.37:0/2063021516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83780b2380 0x7f83780b2820 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.868+0000 7f837e0c1700 1 -- 172.21.15.37:0/2063021516 >> 172.21.15.37:0/2063021516 conn(0x7f837806c0b0 msgr2=0x7f837806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:49.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.868+0000 7f837e0c1700 1 -- 172.21.15.37:0/2063021516 shutdown_connections 2023-10-06T02:26:49.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.868+0000 7f837e0c1700 1 -- 172.21.15.37:0/2063021516 wait complete. 2023-10-06T02:26:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.870+0000 7f837e0c1700 1 Processor -- start 2023-10-06T02:26:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.870+0000 7f837e0c1700 1 -- start start 2023-10-06T02:26:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.870+0000 7f837e0c1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83780b2380 0x7f83780c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.870+0000 7f837e0c1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83780ccb30 0x7f83780c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.870+0000 7f837e0c1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83781593c0 0x7f837814a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.870+0000 7f837e0c1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83780c9de0 con 0x7f83780ccb30 2023-10-06T02:26:49.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.870+0000 7f837e0c1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83780c47d0 con 0x7f83781593c0 2023-10-06T02:26:49.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.870+0000 7f837e0c1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83780c9b10 con 0x7f83780b2380 2023-10-06T02:26:49.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.870+0000 7f8376ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83780ccb30 0x7f83780c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.870+0000 7f8376ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83780ccb30 0x7f83780c95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39112/0 (socket says 172.21.15.37:39112) 2023-10-06T02:26:49.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.870+0000 7f8376ffd700 1 -- 172.21.15.37:0/55082807 learned_addr learned my addr 172.21.15.37:0/55082807 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:49.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.871+0000 7f83777fe700 1 --2- 172.21.15.37:0/55082807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83780b2380 0x7f83780c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.871+0000 7f8377fff700 1 --2- 172.21.15.37:0/55082807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83781593c0 0x7f837814a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.871+0000 7f8376ffd700 1 -- 172.21.15.37:0/55082807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83780b2380 msgr2=0x7f83780c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.871+0000 7f8376ffd700 1 --2- 172.21.15.37:0/55082807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83780b2380 0x7f83780c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.871+0000 7f8376ffd700 1 -- 172.21.15.37:0/55082807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83781593c0 msgr2=0x7f837814a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.871+0000 7f8376ffd700 1 --2- 172.21.15.37:0/55082807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83781593c0 0x7f837814a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.871+0000 7f8376ffd700 1 -- 172.21.15.37:0/55082807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c009420 con 0x7f83780ccb30 2023-10-06T02:26:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.871+0000 7f8376ffd700 1 --2- 172.21.15.37:0/55082807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83780ccb30 0x7f83780c95d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f83780894a0 tx=0x7f836c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.871+0000 7f835f7fe700 1 -- 172.21.15.37:0/55082807 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c00bb90 con 0x7f83780ccb30 2023-10-06T02:26:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.871+0000 7f835f7fe700 1 -- 172.21.15.37:0/55082807 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c011420 con 0x7f83780ccb30 2023-10-06T02:26:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.871+0000 7f837e0c1700 1 -- 172.21.15.37:0/55082807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83780c3ea0 con 0x7f83780ccb30 2023-10-06T02:26:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.871+0000 7f835f7fe700 1 -- 172.21.15.37:0/55082807 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c0117c0 con 0x7f83780ccb30 2023-10-06T02:26:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.871+0000 7f837e0c1700 1 -- 172.21.15.37:0/55082807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83780c4460 con 0x7f83780ccb30 2023-10-06T02:26:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.872+0000 7f837e0c1700 1 -- 172.21.15.37:0/55082807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8378088bb0 con 0x7f83780ccb30 2023-10-06T02:26:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.873+0000 7f835f7fe700 1 -- 172.21.15.37:0/55082807 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f836c011bb0 con 0x7f83780ccb30 2023-10-06T02:26:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.873+0000 7f835f7fe700 1 --2- 172.21.15.37:0/55082807 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8364066f30 0x7f83640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.873+0000 7f835f7fe700 1 -- 172.21.15.37:0/55082807 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f836c086040 con 0x7f83780ccb30 2023-10-06T02:26:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.873+0000 7f83777fe700 1 --2- 172.21.15.37:0/55082807 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8364066f30 0x7f83640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.874+0000 7f83777fe700 1 --2- 172.21.15.37:0/55082807 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8364066f30 0x7f83640693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8368006fd0 tx=0x7f8368008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:49.877+0000 7f835f7fe700 1 -- 172.21.15.37:0/55082807 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f836c053080 con 0x7f83780ccb30 2023-10-06T02:26:50.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.117+0000 7f837e0c1700 1 -- 172.21.15.37:0/55082807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f83780b0150 con 0x7f83780ccb30 2023-10-06T02:26:50.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.346+0000 7f835f7fe700 1 -- 172.21.15.37:0/55082807 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v33) v1 ==== 162+0+0 (secure 0 0 0) 0x7f836c011e60 con 0x7f83780ccb30 2023-10-06T02:26:50.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.348+0000 7f837e0c1700 1 -- 172.21.15.37:0/55082807 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8364066f30 msgr2=0x7f83640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:50.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.348+0000 7f837e0c1700 1 --2- 172.21.15.37:0/55082807 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8364066f30 0x7f83640693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8368006fd0 tx=0x7f8368008040 comp rx=0 tx=0).stop 2023-10-06T02:26:50.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.348+0000 7f837e0c1700 1 -- 172.21.15.37:0/55082807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83780ccb30 msgr2=0x7f83780c95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:50.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.348+0000 7f837e0c1700 1 --2- 172.21.15.37:0/55082807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83780ccb30 0x7f83780c95d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f83780894a0 tx=0x7f836c017000 comp rx=0 tx=0).stop 2023-10-06T02:26:50.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.348+0000 7f837e0c1700 1 -- 172.21.15.37:0/55082807 shutdown_connections 2023-10-06T02:26:50.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.348+0000 7f837e0c1700 1 --2- 172.21.15.37:0/55082807 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8364066f30 0x7f83640693e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.348+0000 7f837e0c1700 1 --2- 172.21.15.37:0/55082807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83781593c0 0x7f837814a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.348+0000 7f837e0c1700 1 --2- 172.21.15.37:0/55082807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83780b2380 0x7f83780c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.348+0000 7f837e0c1700 1 --2- 172.21.15.37:0/55082807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83780ccb30 0x7f83780c95d0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.348+0000 7f837e0c1700 1 -- 172.21.15.37:0/55082807 >> 172.21.15.37:0/55082807 conn(0x7f837806c0b0 msgr2=0x7f8378158860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:50.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.348+0000 7f837e0c1700 1 -- 172.21.15.37:0/55082807 shutdown_connections 2023-10-06T02:26:50.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.348+0000 7f837e0c1700 1 -- 172.21.15.37:0/55082807 wait complete. 2023-10-06T02:26:50.352 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:26:50.364 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:50.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.481+0000 7f72631a5700 1 Processor -- start 2023-10-06T02:26:50.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.481+0000 7f72631a5700 1 -- start start 2023-10-06T02:26:50.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.482+0000 7f72631a5700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f725c0cf9f0 0x7f725c0cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:50.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.482+0000 7f72631a5700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725c0c5300 con 0x7f725c1596d0 2023-10-06T02:26:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.482+0000 7f72631a5700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725c0c6160 con 0x7f725c159aa0 2023-10-06T02:26:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.482+0000 7f72631a5700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725c0d0370 con 0x7f725c0cf9f0 2023-10-06T02:26:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.482+0000 7f7260f41700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f725c1596d0 0x7f725c0b3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38256/0 (socket says 172.21.15.37:38256) 2023-10-06T02:26:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.482+0000 7f7260f41700 1 -- 172.21.15.37:0/3090368617 learned_addr learned my addr 172.21.15.37:0/3090368617 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:26:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f7261742700 1 --2- 172.21.15.37:0/3090368617 >> v2:172.21.15.191:3300/0 conn(0x7f725c0cf9f0 0x7f725c0cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725b7fe700 1 -- 172.21.15.37:0/3090368617 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2501850095 0 0) 0x7f725c0c5300 con 0x7f725c1596d0 2023-10-06T02:26:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725b7fe700 1 -- 172.21.15.37:0/3090368617 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7248003570 con 0x7f725c1596d0 2023-10-06T02:26:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725b7fe700 1 -- 172.21.15.37:0/3090368617 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3161288731 0 0) 0x7f7248003570 con 0x7f725c1596d0 2023-10-06T02:26:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725b7fe700 1 -- 172.21.15.37:0/3090368617 >> v2:172.21.15.191:3300/0 conn(0x7f725c0cf9f0 msgr2=0x7f725c0cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725b7fe700 1 --2- 172.21.15.37:0/3090368617 >> v2:172.21.15.191:3300/0 conn(0x7f725c0cf9f0 0x7f725c0cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725b7fe700 1 -- 172.21.15.37:0/3090368617 >> v1:172.21.15.191:6789/0 conn(0x7f725c159aa0 legacy=0x7f725c0c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725b7fe700 1 -- 172.21.15.37:0/3090368617 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725c0c5550 con 0x7f725c1596d0 2023-10-06T02:26:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725b7fe700 1 -- 172.21.15.37:0/3090368617 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f7244001470 con 0x7f725c1596d0 2023-10-06T02:26:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725b7fe700 1 -- 172.21.15.37:0/3090368617 >> v1:172.21.15.37:6789/0 conn(0x7f725c1596d0 legacy=0x7f725c0b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725b7fe700 1 --2- 172.21.15.37:0/3090368617 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7248003a60 0x7f7248003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725b7fe700 1 --2- 172.21.15.37:0/3090368617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7248004810 0x7f7248004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725b7fe700 1 --2- 172.21.15.37:0/3090368617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72480051c0 0x7f724800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725b7fe700 1 -- 172.21.15.37:0/3090368617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c0d0370 con 0x7f7248004810 2023-10-06T02:26:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725b7fe700 1 -- 172.21.15.37:0/3090368617 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724800c0d0 con 0x7f72480051c0 2023-10-06T02:26:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725b7fe700 1 -- 172.21.15.37:0/3090368617 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724800c290 con 0x7f7248003a60 2023-10-06T02:26:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725bfff700 1 --2- 172.21.15.37:0/3090368617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7248004810 0x7f7248004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:50.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f7260f41700 1 --2- 172.21.15.37:0/3090368617 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7248003a60 0x7f7248003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:50.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f7261742700 1 --2- 172.21.15.37:0/3090368617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72480051c0 0x7f724800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:50.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725bfff700 1 -- 172.21.15.37:0/3090368617 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7248003a60 msgr2=0x7f7248003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:50.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725bfff700 1 --2- 172.21.15.37:0/3090368617 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7248003a60 0x7f7248003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725bfff700 1 -- 172.21.15.37:0/3090368617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72480051c0 msgr2=0x7f724800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:50.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725bfff700 1 --2- 172.21.15.37:0/3090368617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72480051c0 0x7f724800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f725bfff700 1 -- 172.21.15.37:0/3090368617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7248003570 con 0x7f7248004810 2023-10-06T02:26:50.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.483+0000 7f7261742700 1 -- 172.21.15.37:0/3090368617 reap_dead start 2023-10-06T02:26:50.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.484+0000 7f725bfff700 1 --2- 172.21.15.37:0/3090368617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7248004810 0x7f7248004c80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f724c0018b0 tx=0x7f724c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8778c430754fde06 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:50.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.484+0000 7f725b7fe700 1 -- 172.21.15.37:0/3090368617 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c012420 con 0x7f7248004810 2023-10-06T02:26:50.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.484+0000 7f725b7fe700 1 -- 172.21.15.37:0/3090368617 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724c0125a0 con 0x7f7248004810 2023-10-06T02:26:50.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.484+0000 7f725b7fe700 1 -- 172.21.15.37:0/3090368617 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c012960 con 0x7f7248004810 2023-10-06T02:26:50.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.484+0000 7f72631a5700 1 -- 172.21.15.37:0/3090368617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7248004810 msgr2=0x7f7248004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:50.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.484+0000 7f72631a5700 1 --2- 172.21.15.37:0/3090368617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7248004810 0x7f7248004c80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f724c0018b0 tx=0x7f724c007d30 comp rx=0 tx=0).stop 2023-10-06T02:26:50.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.484+0000 7f72631a5700 1 -- 172.21.15.37:0/3090368617 shutdown_connections 2023-10-06T02:26:50.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.484+0000 7f72631a5700 1 --2- 172.21.15.37:0/3090368617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7248004810 0x7f7248004c80 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.484+0000 7f72631a5700 1 -- 172.21.15.37:0/3090368617 >> 172.21.15.37:0/3090368617 conn(0x7f725c06c890 msgr2=0x7f725c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:50.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.484+0000 7f72631a5700 1 -- 172.21.15.37:0/3090368617 shutdown_connections 2023-10-06T02:26:50.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.484+0000 7f72631a5700 1 -- 172.21.15.37:0/3090368617 wait complete. 2023-10-06T02:26:50.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.485+0000 7f72631a5700 1 Processor -- start 2023-10-06T02:26:50.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.486+0000 7f72631a5700 1 -- start start 2023-10-06T02:26:50.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.486+0000 7f72631a5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7248004810 0x7f725c147470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:50.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.486+0000 7f72631a5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f725c0b3300 0x7f725c1543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:50.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.486+0000 7f72631a5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f725c0b4bc0 0x7f725c0b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:50.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.486+0000 7f72631a5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c155260 con 0x7f725c0b3300 2023-10-06T02:26:50.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.486+0000 7f72631a5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c0b55a0 con 0x7f7248004810 2023-10-06T02:26:50.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.486+0000 7f72631a5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725c0b4480 con 0x7f725c0b4bc0 2023-10-06T02:26:50.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.486+0000 7f725bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f725c0b3300 0x7f725c1543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:50.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.486+0000 7f725bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f725c0b3300 0x7f725c1543a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39120/0 (socket says 172.21.15.37:39120) 2023-10-06T02:26:50.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.486+0000 7f725bfff700 1 -- 172.21.15.37:0/2230148021 learned_addr learned my addr 172.21.15.37:0/2230148021 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:50.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.487+0000 7f7261742700 1 --2- 172.21.15.37:0/2230148021 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f725c0b4bc0 0x7f725c0b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:50.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.487+0000 7f7260f41700 1 --2- 172.21.15.37:0/2230148021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7248004810 0x7f725c147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:50.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.487+0000 7f725bfff700 1 -- 172.21.15.37:0/2230148021 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f725c0b4bc0 msgr2=0x7f725c0b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:50.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.487+0000 7f725bfff700 1 --2- 172.21.15.37:0/2230148021 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f725c0b4bc0 0x7f725c0b5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.487+0000 7f725bfff700 1 -- 172.21.15.37:0/2230148021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7248004810 msgr2=0x7f725c147470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:50.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.487+0000 7f725bfff700 1 --2- 172.21.15.37:0/2230148021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7248004810 0x7f725c147470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.487+0000 7f725bfff700 1 -- 172.21.15.37:0/2230148021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725c1479b0 con 0x7f725c0b3300 2023-10-06T02:26:50.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.487+0000 7f7260f41700 1 --2- 172.21.15.37:0/2230148021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7248004810 0x7f725c147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:50.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.487+0000 7f725bfff700 1 --2- 172.21.15.37:0/2230148021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f725c0b3300 0x7f725c1543a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f724800c0a0 tx=0x7f724c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:50.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.487+0000 7f7258ff9700 1 -- 172.21.15.37:0/2230148021 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c00c780 con 0x7f725c0b3300 2023-10-06T02:26:50.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.487+0000 7f7258ff9700 1 -- 172.21.15.37:0/2230148021 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724c00c8e0 con 0x7f725c0b3300 2023-10-06T02:26:50.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.487+0000 7f72631a5700 1 -- 172.21.15.37:0/2230148021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f725c1548e0 con 0x7f725c0b3300 2023-10-06T02:26:50.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.487+0000 7f7258ff9700 1 -- 172.21.15.37:0/2230148021 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c00cc80 con 0x7f725c0b3300 2023-10-06T02:26:50.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.487+0000 7f72631a5700 1 -- 172.21.15.37:0/2230148021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f725c0b3b50 con 0x7f725c0b3300 2023-10-06T02:26:50.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.488+0000 7f72631a5700 1 -- 172.21.15.37:0/2230148021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f725c0b4630 con 0x7f725c0b3300 2023-10-06T02:26:50.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.488+0000 7f7258ff9700 1 -- 172.21.15.37:0/2230148021 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f724c01f410 con 0x7f725c0b3300 2023-10-06T02:26:50.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.489+0000 7f7258ff9700 1 --2- 172.21.15.37:0/2230148021 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f723c066f30 0x7f723c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:50.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.489+0000 7f7258ff9700 1 -- 172.21.15.37:0/2230148021 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f724c085db0 con 0x7f725c0b3300 2023-10-06T02:26:50.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.489+0000 7f7260f41700 1 --2- 172.21.15.37:0/2230148021 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f723c066f30 0x7f723c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:50.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.490+0000 7f7260f41700 1 --2- 172.21.15.37:0/2230148021 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f723c066f30 0x7f723c0693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7244000f60 tx=0x7f72440014c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:50.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.493+0000 7f7258ff9700 1 -- 172.21.15.37:0/2230148021 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f725c0b4630 con 0x7f725c0b3300 2023-10-06T02:26:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.732+0000 7f72631a5700 1 -- 172.21.15.37:0/2230148021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f725c1548e0 con 0x7f725c0b3300 2023-10-06T02:26:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.733+0000 7f7258ff9700 1 -- 172.21.15.37:0/2230148021 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f725c1548e0 con 0x7f725c0b3300 2023-10-06T02:26:50.735 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:26:50.735 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/1914186828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1914186828},{"type":"v1","addr":"172.21.15.191:6836","nonce":1914186828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3684230798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":3684230798},{"type":"v1","addr":"172.21.15.191:6837","nonce":3684230798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1883185549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1883185549},{"type":"v1","addr":"172.21.15.37:6834","nonce":1883185549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:25:48.166318+0000","modified":"2023-10-06T02:26:50.347536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6147":{"gid":6147,"name":"c","rank":0,"incarnation":34,"state":"up:replay","state_seq":1,"addr":"172.21.15.37:6835/2196855571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2196855571},{"type":"v1","addr":"172.21.15.37:6835","nonce":2196855571}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:26:50.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.735+0000 7f72631a5700 1 -- 172.21.15.37:0/2230148021 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f723c066f30 msgr2=0x7f723c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.735+0000 7f72631a5700 1 --2- 172.21.15.37:0/2230148021 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f723c066f30 0x7f723c0693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7244000f60 tx=0x7f72440014c0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.735+0000 7f72631a5700 1 -- 172.21.15.37:0/2230148021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f725c0b3300 msgr2=0x7f725c1543a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.735+0000 7f72631a5700 1 --2- 172.21.15.37:0/2230148021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f725c0b3300 0x7f725c1543a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f724800c0a0 tx=0x7f724c015000 comp rx=0 tx=0).stop 2023-10-06T02:26:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.735+0000 7f72631a5700 1 -- 172.21.15.37:0/2230148021 shutdown_connections 2023-10-06T02:26:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.735+0000 7f72631a5700 1 --2- 172.21.15.37:0/2230148021 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f725c0b4bc0 0x7f725c0b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.735+0000 7f72631a5700 1 --2- 172.21.15.37:0/2230148021 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f723c066f30 0x7f723c0693e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.735+0000 7f72631a5700 1 --2- 172.21.15.37:0/2230148021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7248004810 0x7f725c147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.735+0000 7f72631a5700 1 --2- 172.21.15.37:0/2230148021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f725c0b3300 0x7f725c1543a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.735+0000 7f72631a5700 1 -- 172.21.15.37:0/2230148021 >> 172.21.15.37:0/2230148021 conn(0x7f725c06c890 msgr2=0x7f725c15c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.735+0000 7f72631a5700 1 -- 172.21.15.37:0/2230148021 shutdown_connections 2023-10-06T02:26:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:50.735+0000 7f72631a5700 1 -- 172.21.15.37:0/2230148021 wait complete. 2023-10-06T02:26:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 34 2023-10-06T02:26:51.151 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:25:48.166318+0000', 'modified': '2023-10-06T02:26:50.347536+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 60, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6147}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6147': {'gid': 6147, 'name': 'c', 'rank': 0, 'incarnation': 34, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.37:6835/2196855571', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 2196855571}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 2196855571}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:26:51.282 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6147:up:replay 2023-10-06T02:26:51.765 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:26:51.789 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:26:52.283 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:52.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.415+0000 7f71e4fa1700 1 Processor -- start 2023-10-06T02:26:52.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.416+0000 7f71e4fa1700 1 -- start start 2023-10-06T02:26:52.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.416+0000 7f71e4fa1700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f71e0157060 0x7f71e0157430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.416+0000 7f71e4fa1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71e00b1040 0x7f71e015aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.416+0000 7f71e4fa1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f71e00b1d80 0x7f71e00b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.416+0000 7f71e4fa1700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e00b1610 con 0x7f71e00b1d80 2023-10-06T02:26:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.416+0000 7f71e4fa1700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e00b18f0 con 0x7f71e0157060 2023-10-06T02:26:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.416+0000 7f71e4fa1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e015b710 con 0x7f71e00b1040 2023-10-06T02:26:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.417+0000 7f71dffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f71e00b1d80 0x7f71e00b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.417+0000 7f71dffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f71e00b1d80 0x7f71e00b2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39128/0 (socket says 172.21.15.37:39128) 2023-10-06T02:26:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.417+0000 7f71dffff700 1 -- 172.21.15.37:0/3889191698 learned_addr learned my addr 172.21.15.37:0/3889191698 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.417+0000 7f71deffd700 1 --2- 172.21.15.37:0/3889191698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71e00b1040 0x7f71e015aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:52.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.417+0000 7f71df7fe700 1 --2- 172.21.15.37:0/3889191698 >> v2:172.21.15.191:3300/0 conn(0x7f71e0157060 0x7f71e0157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:52.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.417+0000 7f71dffff700 1 -- 172.21.15.37:0/3889191698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71e00b1040 msgr2=0x7f71e015aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:52.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.417+0000 7f71dffff700 1 --2- 172.21.15.37:0/3889191698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71e00b1040 0x7f71e015aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:52.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.417+0000 7f71dffff700 1 -- 172.21.15.37:0/3889191698 >> v2:172.21.15.191:3300/0 conn(0x7f71e0157060 msgr2=0x7f71e0157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:52.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.417+0000 7f71dffff700 1 --2- 172.21.15.37:0/3889191698 >> v2:172.21.15.191:3300/0 conn(0x7f71e0157060 0x7f71e0157430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:52.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.417+0000 7f71dffff700 1 -- 172.21.15.37:0/3889191698 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e015b9f0 con 0x7f71e00b1d80 2023-10-06T02:26:52.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.417+0000 7f71dffff700 1 --2- 172.21.15.37:0/3889191698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71e00b1d80 0x7f71e00b2200 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f71e00b15c0 tx=0x7f71d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c2562e9a491d2d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:52.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.417+0000 7f71de7fc700 1 -- 172.21.15.37:0/3889191698 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d800e070 con 0x7f71e00b1d80 2023-10-06T02:26:52.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.417+0000 7f71de7fc700 1 -- 172.21.15.37:0/3889191698 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d800ba50 con 0x7f71e00b1d80 2023-10-06T02:26:52.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.417+0000 7f71de7fc700 1 -- 172.21.15.37:0/3889191698 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d80092e0 con 0x7f71e00b1d80 2023-10-06T02:26:52.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.418+0000 7f71e4fa1700 1 -- 172.21.15.37:0/3889191698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71e00b1d80 msgr2=0x7f71e00b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:52.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.418+0000 7f71e4fa1700 1 --2- 172.21.15.37:0/3889191698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71e00b1d80 0x7f71e00b2200 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f71e00b15c0 tx=0x7f71d8009840 comp rx=0 tx=0).stop 2023-10-06T02:26:52.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.418+0000 7f71e4fa1700 1 -- 172.21.15.37:0/3889191698 shutdown_connections 2023-10-06T02:26:52.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.418+0000 7f71e4fa1700 1 --2- 172.21.15.37:0/3889191698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71e00b1d80 0x7f71e00b2200 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:52.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.418+0000 7f71e4fa1700 1 --2- 172.21.15.37:0/3889191698 >> v2:172.21.15.191:3300/0 conn(0x7f71e0157060 0x7f71e0157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:52.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.418+0000 7f71e4fa1700 1 --2- 172.21.15.37:0/3889191698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71e00b1040 0x7f71e015aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:52.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.418+0000 7f71e4fa1700 1 -- 172.21.15.37:0/3889191698 >> 172.21.15.37:0/3889191698 conn(0x7f71e00ce280 msgr2=0x7f71e00ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:52.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.418+0000 7f71e4fa1700 1 -- 172.21.15.37:0/3889191698 shutdown_connections 2023-10-06T02:26:52.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.418+0000 7f71e4fa1700 1 -- 172.21.15.37:0/3889191698 wait complete. 2023-10-06T02:26:52.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.419+0000 7f71e4fa1700 1 Processor -- start 2023-10-06T02:26:52.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.419+0000 7f71e4fa1700 1 -- start start 2023-10-06T02:26:52.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.420+0000 7f71e4fa1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71e00b1040 0x7f71e0145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:52.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.420+0000 7f71e4fa1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71e00b1d80 0x7f71e00c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:52.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.420+0000 7f71e4fa1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71e0157060 0x7f71e00b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:52.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.420+0000 7f71e4fa1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e00c89b0 con 0x7f71e00b1040 2023-10-06T02:26:52.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.420+0000 7f71e4fa1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e00c7da0 con 0x7f71e00b1d80 2023-10-06T02:26:52.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.420+0000 7f71e4fa1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e00c8080 con 0x7f71e0157060 2023-10-06T02:26:52.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.420+0000 7f71df7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71e00b1040 0x7f71e0145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:52.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.420+0000 7f71df7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71e00b1040 0x7f71e0145bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39142/0 (socket says 172.21.15.37:39142) 2023-10-06T02:26:52.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.420+0000 7f71df7fe700 1 -- 172.21.15.37:0/1624144269 learned_addr learned my addr 172.21.15.37:0/1624144269 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:52.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.420+0000 7f71dffff700 1 --2- 172.21.15.37:0/1624144269 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71e0157060 0x7f71e00b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:52.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.420+0000 7f71deffd700 1 --2- 172.21.15.37:0/1624144269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71e00b1d80 0x7f71e00c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:52.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.420+0000 7f71df7fe700 1 -- 172.21.15.37:0/1624144269 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71e0157060 msgr2=0x7f71e00b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:52.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.420+0000 7f71df7fe700 1 --2- 172.21.15.37:0/1624144269 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71e0157060 0x7f71e00b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:52.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.420+0000 7f71df7fe700 1 -- 172.21.15.37:0/1624144269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71e00b1d80 msgr2=0x7f71e00c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:52.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.420+0000 7f71df7fe700 1 --2- 172.21.15.37:0/1624144269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71e00b1d80 0x7f71e00c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:52.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.420+0000 7f71df7fe700 1 -- 172.21.15.37:0/1624144269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d8009ae0 con 0x7f71e00b1040 2023-10-06T02:26:52.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.420+0000 7f71deffd700 1 --2- 172.21.15.37:0/1624144269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71e00b1d80 0x7f71e00c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:52.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.420+0000 7f71df7fe700 1 --2- 172.21.15.37:0/1624144269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71e00b1040 0x7f71e0145bf0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f71d000d860 tx=0x7f71d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:52.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.421+0000 7f71c77fe700 1 -- 172.21.15.37:0/1624144269 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d00096a0 con 0x7f71e00b1040 2023-10-06T02:26:52.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.421+0000 7f71c77fe700 1 -- 172.21.15.37:0/1624144269 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d0009800 con 0x7f71e00b1040 2023-10-06T02:26:52.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.421+0000 7f71c77fe700 1 -- 172.21.15.37:0/1624144269 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d0009bc0 con 0x7f71e00b1040 2023-10-06T02:26:52.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.421+0000 7f71e4fa1700 1 -- 172.21.15.37:0/1624144269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e00c8360 con 0x7f71e00b1040 2023-10-06T02:26:52.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.421+0000 7f71e4fa1700 1 -- 172.21.15.37:0/1624144269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e0146130 con 0x7f71e00b1040 2023-10-06T02:26:52.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.422+0000 7f71e4fa1700 1 -- 172.21.15.37:0/1624144269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e0064b00 con 0x7f71e00b1040 2023-10-06T02:26:52.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.422+0000 7f71c77fe700 1 -- 172.21.15.37:0/1624144269 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71d001e460 con 0x7f71e00b1040 2023-10-06T02:26:52.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.422+0000 7f71c77fe700 1 --2- 172.21.15.37:0/1624144269 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f71cc066f30 0x7f71cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:52.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.422+0000 7f71c77fe700 1 -- 172.21.15.37:0/1624144269 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f71d0084e60 con 0x7f71e00b1040 2023-10-06T02:26:52.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.423+0000 7f71deffd700 1 --2- 172.21.15.37:0/1624144269 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f71cc066f30 0x7f71cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:52.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.423+0000 7f71deffd700 1 --2- 172.21.15.37:0/1624144269 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f71cc066f30 0x7f71cc0693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f71e00c8d30 tx=0x7f71d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:52.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.427+0000 7f71c77fe700 1 -- 172.21.15.37:0/1624144269 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71d0051ea0 con 0x7f71e00b1040 2023-10-06T02:26:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.663+0000 7f71e4fa1700 1 -- 172.21.15.37:0/1624144269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71e00c8800 con 0x7f71e00b1040 2023-10-06T02:26:52.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.664+0000 7f71c77fe700 1 -- 172.21.15.37:0/1624144269 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f71d00554c0 con 0x7f71e00b1040 2023-10-06T02:26:52.666 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:26:52.666 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/1914186828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1914186828},{"type":"v1","addr":"172.21.15.191:6836","nonce":1914186828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3684230798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":3684230798},{"type":"v1","addr":"172.21.15.191:6837","nonce":3684230798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1883185549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1883185549},{"type":"v1","addr":"172.21.15.37:6834","nonce":1883185549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:25:48.166318+0000","modified":"2023-10-06T02:26:52.352634+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6147":{"gid":6147,"name":"c","rank":0,"incarnation":34,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.37:6835/2196855571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2196855571},{"type":"v1","addr":"172.21.15.37:6835","nonce":2196855571}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:26:52.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.666+0000 7f71e4fa1700 1 -- 172.21.15.37:0/1624144269 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f71cc066f30 msgr2=0x7f71cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:52.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.666+0000 7f71e4fa1700 1 --2- 172.21.15.37:0/1624144269 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f71cc066f30 0x7f71cc0693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f71e00c8d30 tx=0x7f71d4008040 comp rx=0 tx=0).stop 2023-10-06T02:26:52.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.666+0000 7f71e4fa1700 1 -- 172.21.15.37:0/1624144269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71e00b1040 msgr2=0x7f71e0145bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.666+0000 7f71e4fa1700 1 --2- 172.21.15.37:0/1624144269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71e00b1040 0x7f71e0145bf0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f71d000d860 tx=0x7f71d0008040 comp rx=0 tx=0).stop 2023-10-06T02:26:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.666+0000 7f71e4fa1700 1 -- 172.21.15.37:0/1624144269 shutdown_connections 2023-10-06T02:26:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.666+0000 7f71e4fa1700 1 --2- 172.21.15.37:0/1624144269 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71e0157060 0x7f71e00b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.666+0000 7f71e4fa1700 1 --2- 172.21.15.37:0/1624144269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71e00b1040 0x7f71e0145bf0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.666+0000 7f71e4fa1700 1 --2- 172.21.15.37:0/1624144269 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f71cc066f30 0x7f71cc0693e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.666+0000 7f71e4fa1700 1 --2- 172.21.15.37:0/1624144269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71e00b1d80 0x7f71e00c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.666+0000 7f71e4fa1700 1 -- 172.21.15.37:0/1624144269 >> 172.21.15.37:0/1624144269 conn(0x7f71e00ce280 msgr2=0x7f71e00cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:52.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.666+0000 7f71e4fa1700 1 -- 172.21.15.37:0/1624144269 shutdown_connections 2023-10-06T02:26:52.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:52.666+0000 7f71e4fa1700 1 -- 172.21.15.37:0/1624144269 wait complete. 2023-10-06T02:26:52.672 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 36 2023-10-06T02:26:53.082 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:25:48.166318+0000', 'modified': '2023-10-06T02:26:52.352634+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 60, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6147}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6147': {'gid': 6147, 'name': 'c', 'rank': 0, 'incarnation': 34, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.37:6835/2196855571', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 2196855571}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 2196855571}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:26:53.082 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6147:up:rejoin 2023-10-06T02:26:54.083 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:26:54.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.215+0000 7f9ef6690700 1 Processor -- start 2023-10-06T02:26:54.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.215+0000 7f9ef6690700 1 -- start start 2023-10-06T02:26:54.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.216+0000 7f9ef6690700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9ef0159760 0x7f9ef015d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:54.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.216+0000 7f9ef6690700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ef015d8d0 0x7f9ef015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:54.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.216+0000 7f9ef6690700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ef00c5390 0x7f9ef00c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:54.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.216+0000 7f9ef6690700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef00cc2d0 con 0x7f9ef015d8d0 2023-10-06T02:26:54.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.216+0000 7f9ef6690700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef00cb650 con 0x7f9ef0159760 2023-10-06T02:26:54.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.216+0000 7f9ef6690700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00cb930 con 0x7f9ef00c5390 2023-10-06T02:26:54.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.216+0000 7f9eef7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ef015d8d0 0x7f9ef015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:54.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.216+0000 7f9eef7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ef015d8d0 0x7f9ef015dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39150/0 (socket says 172.21.15.37:39150) 2023-10-06T02:26:54.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.216+0000 7f9eef7fe700 1 -- 172.21.15.37:0/3007012067 learned_addr learned my addr 172.21.15.37:0/3007012067 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:54.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.217+0000 7f9ef4c2d700 1 --2- 172.21.15.37:0/3007012067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ef00c5390 0x7f9ef00c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:54.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.217+0000 7f9eeffff700 1 --2- 172.21.15.37:0/3007012067 >> v2:172.21.15.191:3300/0 conn(0x7f9ef0159760 0x7f9ef015d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:54.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.217+0000 7f9eef7fe700 1 -- 172.21.15.37:0/3007012067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ef00c5390 msgr2=0x7f9ef00c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:54.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.217+0000 7f9eef7fe700 1 --2- 172.21.15.37:0/3007012067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ef00c5390 0x7f9ef00c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.217+0000 7f9eef7fe700 1 -- 172.21.15.37:0/3007012067 >> v2:172.21.15.191:3300/0 conn(0x7f9ef0159760 msgr2=0x7f9ef015d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:54.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.217+0000 7f9eef7fe700 1 --2- 172.21.15.37:0/3007012067 >> v2:172.21.15.191:3300/0 conn(0x7f9ef0159760 0x7f9ef015d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.217+0000 7f9eef7fe700 1 -- 172.21.15.37:0/3007012067 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef00cbc10 con 0x7f9ef015d8d0 2023-10-06T02:26:54.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.217+0000 7f9ef4c2d700 1 --2- 172.21.15.37:0/3007012067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ef00c5390 0x7f9ef00c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:54.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.217+0000 7f9eeffff700 1 --2- 172.21.15.37:0/3007012067 >> v2:172.21.15.191:3300/0 conn(0x7f9ef0159760 0x7f9ef015d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.217+0000 7f9eef7fe700 1 --2- 172.21.15.37:0/3007012067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef015d8d0 0x7f9ef015dd50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00897f0 tx=0x7f9ee0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999f66f779c6d32a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.217+0000 7f9eeeffd700 1 -- 172.21.15.37:0/3007012067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee000b8f0 con 0x7f9ef015d8d0 2023-10-06T02:26:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.217+0000 7f9eeeffd700 1 -- 172.21.15.37:0/3007012067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee000ba50 con 0x7f9ef015d8d0 2023-10-06T02:26:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.217+0000 7f9eeeffd700 1 -- 172.21.15.37:0/3007012067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee000bdf0 con 0x7f9ef015d8d0 2023-10-06T02:26:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.218+0000 7f9ef6690700 1 -- 172.21.15.37:0/3007012067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef015d8d0 msgr2=0x7f9ef015dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.218+0000 7f9ef6690700 1 --2- 172.21.15.37:0/3007012067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef015d8d0 0x7f9ef015dd50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00897f0 tx=0x7f9ee0009250 comp rx=0 tx=0).stop 2023-10-06T02:26:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.218+0000 7f9ef6690700 1 -- 172.21.15.37:0/3007012067 shutdown_connections 2023-10-06T02:26:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.218+0000 7f9ef6690700 1 --2- 172.21.15.37:0/3007012067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ef00c5390 0x7f9ef00c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.218+0000 7f9ef6690700 1 --2- 172.21.15.37:0/3007012067 >> v2:172.21.15.191:3300/0 conn(0x7f9ef0159760 0x7f9ef015d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.218+0000 7f9ef6690700 1 --2- 172.21.15.37:0/3007012067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef015d8d0 0x7f9ef015dd50 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.218+0000 7f9ef6690700 1 -- 172.21.15.37:0/3007012067 >> 172.21.15.37:0/3007012067 conn(0x7f9ef006c890 msgr2=0x7f9ef00d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:54.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.218+0000 7f9ef6690700 1 -- 172.21.15.37:0/3007012067 shutdown_connections 2023-10-06T02:26:54.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.218+0000 7f9ef6690700 1 -- 172.21.15.37:0/3007012067 wait complete. 2023-10-06T02:26:54.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.219+0000 7f9ef6690700 1 Processor -- start 2023-10-06T02:26:54.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.219+0000 7f9ef6690700 1 -- start start 2023-10-06T02:26:54.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.220+0000 7f9ef6690700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ef00c5390 0x7f9ef015b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.220+0000 7f9ef6690700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef0159760 0x7f9ef00b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.220+0000 7f9ef6690700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ef015d8d0 0x7f9ef016a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.220+0000 7f9ef6690700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00b43a0 con 0x7f9ef0159760 2023-10-06T02:26:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.220+0000 7f9ef6690700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00b3790 con 0x7f9ef00c5390 2023-10-06T02:26:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.220+0000 7f9ef6690700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00b3a70 con 0x7f9ef015d8d0 2023-10-06T02:26:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.220+0000 7f9eef7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef0159760 0x7f9ef00b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.220+0000 7f9eef7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef0159760 0x7f9ef00b4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39158/0 (socket says 172.21.15.37:39158) 2023-10-06T02:26:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.220+0000 7f9eef7fe700 1 -- 172.21.15.37:0/2568940016 learned_addr learned my addr 172.21.15.37:0/2568940016 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.220+0000 7f9ef4c2d700 1 --2- 172.21.15.37:0/2568940016 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ef015d8d0 0x7f9ef016a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.220+0000 7f9eeffff700 1 --2- 172.21.15.37:0/2568940016 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ef00c5390 0x7f9ef015b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:54.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.220+0000 7f9eef7fe700 1 -- 172.21.15.37:0/2568940016 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ef015d8d0 msgr2=0x7f9ef016a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.220+0000 7f9eef7fe700 1 --2- 172.21.15.37:0/2568940016 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ef015d8d0 0x7f9ef016a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.220+0000 7f9eef7fe700 1 -- 172.21.15.37:0/2568940016 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ef00c5390 msgr2=0x7f9ef015b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.220+0000 7f9eef7fe700 1 --2- 172.21.15.37:0/2568940016 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ef00c5390 0x7f9ef015b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.220+0000 7f9eef7fe700 1 -- 172.21.15.37:0/2568940016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee00094f0 con 0x7f9ef0159760 2023-10-06T02:26:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.220+0000 7f9eef7fe700 1 --2- 172.21.15.37:0/2568940016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef0159760 0x7f9ef00b4830 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00090b0 tx=0x7f9ee0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.221+0000 7f9ee7fff700 1 -- 172.21.15.37:0/2568940016 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0011e60 con 0x7f9ef0159760 2023-10-06T02:26:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.221+0000 7f9ee7fff700 1 -- 172.21.15.37:0/2568940016 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee001a630 con 0x7f9ef0159760 2023-10-06T02:26:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.221+0000 7f9ef6690700 1 -- 172.21.15.37:0/2568940016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef00b3d50 con 0x7f9ef0159760 2023-10-06T02:26:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.221+0000 7f9ee7fff700 1 -- 172.21.15.37:0/2568940016 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee001a9f0 con 0x7f9ef0159760 2023-10-06T02:26:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.221+0000 7f9ef6690700 1 -- 172.21.15.37:0/2568940016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef01532f0 con 0x7f9ef0159760 2023-10-06T02:26:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.222+0000 7f9ef6690700 1 -- 172.21.15.37:0/2568940016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef006fbf0 con 0x7f9ef0159760 2023-10-06T02:26:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.222+0000 7f9ee7fff700 1 -- 172.21.15.37:0/2568940016 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ee0024440 con 0x7f9ef0159760 2023-10-06T02:26:54.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.222+0000 7f9ee7fff700 1 --2- 172.21.15.37:0/2568940016 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ed0066f30 0x7f9ed00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:54.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.222+0000 7f9ee7fff700 1 -- 172.21.15.37:0/2568940016 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f9ee0086350 con 0x7f9ef0159760 2023-10-06T02:26:54.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.223+0000 7f9eeffff700 1 --2- 172.21.15.37:0/2568940016 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ed0066f30 0x7f9ed00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:54.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.223+0000 7f9eeffff700 1 --2- 172.21.15.37:0/2568940016 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ed0066f30 0x7f9ed00693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8006fd0 tx=0x7f9ed8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:54.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.227+0000 7f9ee7fff700 1 -- 172.21.15.37:0/2568940016 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ee0053390 con 0x7f9ef0159760 2023-10-06T02:26:54.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.467+0000 7f9ef6690700 1 -- 172.21.15.37:0/2568940016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ef004bb80 con 0x7f9ef0159760 2023-10-06T02:26:54.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.468+0000 7f9ee7fff700 1 -- 172.21.15.37:0/2568940016 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f9ee002b340 con 0x7f9ef0159760 2023-10-06T02:26:54.469 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:26:54.469 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/1914186828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1914186828},{"type":"v1","addr":"172.21.15.191:6836","nonce":1914186828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3684230798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":3684230798},{"type":"v1","addr":"172.21.15.191:6837","nonce":3684230798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1883185549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1883185549},{"type":"v1","addr":"172.21.15.37:6834","nonce":1883185549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:25:48.166318+0000","modified":"2023-10-06T02:26:53.356058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":60,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6147":{"gid":6147,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6835/2196855571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2196855571},{"type":"v1","addr":"172.21.15.37:6835","nonce":2196855571}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:26:54.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.469+0000 7f9ef6690700 1 -- 172.21.15.37:0/2568940016 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ed0066f30 msgr2=0x7f9ed00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:54.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.469+0000 7f9ef6690700 1 --2- 172.21.15.37:0/2568940016 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ed0066f30 0x7f9ed00693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8006fd0 tx=0x7f9ed8008040 comp rx=0 tx=0).stop 2023-10-06T02:26:54.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.469+0000 7f9ef6690700 1 -- 172.21.15.37:0/2568940016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef0159760 msgr2=0x7f9ef00b4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:54.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.469+0000 7f9ef6690700 1 --2- 172.21.15.37:0/2568940016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef0159760 0x7f9ef00b4830 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00090b0 tx=0x7f9ee0017000 comp rx=0 tx=0).stop 2023-10-06T02:26:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.469+0000 7f9ef6690700 1 -- 172.21.15.37:0/2568940016 shutdown_connections 2023-10-06T02:26:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.469+0000 7f9ef6690700 1 --2- 172.21.15.37:0/2568940016 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ef015d8d0 0x7f9ef016a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.469+0000 7f9ef6690700 1 --2- 172.21.15.37:0/2568940016 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9ed0066f30 0x7f9ed00693e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.469+0000 7f9ef6690700 1 --2- 172.21.15.37:0/2568940016 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ef00c5390 0x7f9ef015b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.469+0000 7f9ef6690700 1 --2- 172.21.15.37:0/2568940016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef0159760 0x7f9ef00b4830 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.469+0000 7f9ef6690700 1 -- 172.21.15.37:0/2568940016 >> 172.21.15.37:0/2568940016 conn(0x7f9ef006c890 msgr2=0x7f9ef00c5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.470+0000 7f9ef6690700 1 -- 172.21.15.37:0/2568940016 shutdown_connections 2023-10-06T02:26:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:54.470+0000 7f9ef6690700 1 -- 172.21.15.37:0/2568940016 wait complete. 2023-10-06T02:26:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 37 2023-10-06T02:26:54.886 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:25:48.166318+0000', 'modified': '2023-10-06T02:26:53.356058+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 60, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6147}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6147': {'gid': 6147, 'name': 'c', 'rank': 0, 'incarnation': 34, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.37:6835/2196855571', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 2196855571}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 2196855571}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:26:54.886 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:26:54.887 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T02:26:55.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.010+0000 7f0808bf7700 1 Processor -- start 2023-10-06T02:26:55.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.010+0000 7f0808bf7700 1 -- start start 2023-10-06T02:26:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.011+0000 7f0808bf7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f080406dab0 0x7f08040cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.011+0000 7f0808bf7700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f080406de80 0x7f08040b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.011+0000 7f0808bf7700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08040cc250 con 0x7f08040cb080 2023-10-06T02:26:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.011+0000 7f0808bf7700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08040b0e00 con 0x7f080406dab0 2023-10-06T02:26:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.011+0000 7f0808bf7700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08040ccc20 con 0x7f080406de80 2023-10-06T02:26:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.011+0000 7f080259c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f080406dab0 0x7f08040cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.011+0000 7f0801d9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f08040cb080 0x7f08040b01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38258/0 (socket says 172.21.15.37:38258) 2023-10-06T02:26:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.011+0000 7f0801d9b700 1 -- 172.21.15.37:0/3164467855 learned_addr learned my addr 172.21.15.37:0/3164467855 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:26:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.012+0000 7f0802d9d700 1 --2- 172.21.15.37:0/3164467855 >> v2:172.21.15.191:3300/0 conn(0x7f080406de80 0x7f08040b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.012+0000 7f080259c700 1 -- 172.21.15.37:0/3164467855 >> v2:172.21.15.191:3300/0 conn(0x7f080406de80 msgr2=0x7f08040b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.012+0000 7f080259c700 1 --2- 172.21.15.37:0/3164467855 >> v2:172.21.15.191:3300/0 conn(0x7f080406de80 0x7f08040b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.012+0000 7f080259c700 1 -- 172.21.15.37:0/3164467855 >> v1:172.21.15.37:6789/0 conn(0x7f08040cb080 legacy=0x7f08040b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.012+0000 7f080159a700 1 -- 172.21.15.37:0/3164467855 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1911621445 0 0) 0x7f08040cc250 con 0x7f08040cb080 2023-10-06T02:26:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.012+0000 7f080259c700 1 -- 172.21.15.37:0/3164467855 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08040cb640 con 0x7f080406dab0 2023-10-06T02:26:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.012+0000 7f080259c700 1 --2- 172.21.15.37:0/3164467855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080406dab0 0x7f08040cc6e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f08040cc1c0 tx=0x7f07f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be131b7ab8a99f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.012+0000 7f080159a700 1 -- 172.21.15.37:0/3164467855 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f4011630 con 0x7f080406dab0 2023-10-06T02:26:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.012+0000 7f080159a700 1 -- 172.21.15.37:0/3164467855 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f4011790 con 0x7f080406dab0 2023-10-06T02:26:55.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.012+0000 7f080159a700 1 -- 172.21.15.37:0/3164467855 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f4011b30 con 0x7f080406dab0 2023-10-06T02:26:55.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.013+0000 7f0808bf7700 1 -- 172.21.15.37:0/3164467855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080406dab0 msgr2=0x7f08040cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.013+0000 7f0808bf7700 1 --2- 172.21.15.37:0/3164467855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080406dab0 0x7f08040cc6e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f08040cc1c0 tx=0x7f07f40091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.013+0000 7f0808bf7700 1 -- 172.21.15.37:0/3164467855 shutdown_connections 2023-10-06T02:26:55.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.013+0000 7f0808bf7700 1 --2- 172.21.15.37:0/3164467855 >> v2:172.21.15.191:3300/0 conn(0x7f080406de80 0x7f08040b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.013+0000 7f0808bf7700 1 --2- 172.21.15.37:0/3164467855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080406dab0 0x7f08040cc6e0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.013+0000 7f0808bf7700 1 -- 172.21.15.37:0/3164467855 >> 172.21.15.37:0/3164467855 conn(0x7f08040d0510 msgr2=0x7f08040d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.013+0000 7f0808bf7700 1 -- 172.21.15.37:0/3164467855 shutdown_connections 2023-10-06T02:26:55.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.013+0000 7f0808bf7700 1 -- 172.21.15.37:0/3164467855 wait complete. 2023-10-06T02:26:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.014+0000 7f0808bf7700 1 Processor -- start 2023-10-06T02:26:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.014+0000 7f0808bf7700 1 -- start start 2023-10-06T02:26:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.014+0000 7f0808bf7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f080406dab0 0x7f08040b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f0808bf7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080406de80 0x7f080414f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f0808bf7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08040cb080 0x7f08041501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f0808bf7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0804151570 con 0x7f080406de80 2023-10-06T02:26:55.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f0808bf7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080414f5d0 con 0x7f080406dab0 2023-10-06T02:26:55.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f0808bf7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08041506e0 con 0x7f08040cb080 2023-10-06T02:26:55.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f0801d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080406de80 0x7f080414f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f0801d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080406de80 0x7f080414f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39168/0 (socket says 172.21.15.37:39168) 2023-10-06T02:26:55.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f0801d9b700 1 -- 172.21.15.37:0/1758833908 learned_addr learned my addr 172.21.15.37:0/1758833908 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:55.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f080259c700 1 --2- 172.21.15.37:0/1758833908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f080406dab0 0x7f08040b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f0802d9d700 1 --2- 172.21.15.37:0/1758833908 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08040cb080 0x7f08041501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f0801d9b700 1 -- 172.21.15.37:0/1758833908 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08040cb080 msgr2=0x7f08041501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f0801d9b700 1 --2- 172.21.15.37:0/1758833908 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08040cb080 0x7f08041501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f0801d9b700 1 -- 172.21.15.37:0/1758833908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f080406dab0 msgr2=0x7f08040b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f0801d9b700 1 --2- 172.21.15.37:0/1758833908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f080406dab0 0x7f08040b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f0801d9b700 1 -- 172.21.15.37:0/1758833908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f4009420 con 0x7f080406de80 2023-10-06T02:26:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f0802d9d700 1 --2- 172.21.15.37:0/1758833908 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08040cb080 0x7f08041501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f0801d9b700 1 --2- 172.21.15.37:0/1758833908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080406de80 0x7f080414f090 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00c5e0 tx=0x7f07ec001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f07fa7fc700 1 -- 172.21.15.37:0/1758833908 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec005b30 con 0x7f080406de80 2023-10-06T02:26:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f07fa7fc700 1 -- 172.21.15.37:0/1758833908 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec005c90 con 0x7f080406de80 2023-10-06T02:26:55.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f0808bf7700 1 -- 172.21.15.37:0/1758833908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0804150960 con 0x7f080406de80 2023-10-06T02:26:55.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f07fa7fc700 1 -- 172.21.15.37:0/1758833908 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec007300 con 0x7f080406de80 2023-10-06T02:26:55.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.015+0000 7f0808bf7700 1 -- 172.21.15.37:0/1758833908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0804150f20 con 0x7f080406de80 2023-10-06T02:26:55.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.017+0000 7f07fa7fc700 1 -- 172.21.15.37:0/1758833908 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07ec01b3b0 con 0x7f080406de80 2023-10-06T02:26:55.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.017+0000 7f07fa7fc700 1 --2- 172.21.15.37:0/1758833908 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f07e4066f30 0x7f07e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.017+0000 7f07fa7fc700 1 -- 172.21.15.37:0/1758833908 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f07ec083c40 con 0x7f080406de80 2023-10-06T02:26:55.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.018+0000 7f080259c700 1 --2- 172.21.15.37:0/1758833908 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f07e4066f30 0x7f07e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.018+0000 7f080259c700 1 --2- 172.21.15.37:0/1758833908 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f07e4066f30 0x7f07e40693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f07f40093f0 tx=0x7f07f4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.019+0000 7f0811eefb80 1 Processor -- start 2023-10-06T02:26:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.019+0000 7f0811eefb80 1 -- start start 2023-10-06T02:26:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.020+0000 7f0811eefb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d361d3a840 0x55d361d3ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.020+0000 7f0811eefb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d361d3bcc0 0x55d361d8a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.020+0000 7f0811eefb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d8ac00 0x55d361d8b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.020+0000 7f0811eefb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d361c91a70 con 0x55d361d8ac00 2023-10-06T02:26:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.020+0000 7f0811eefb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d361c8f270 con 0x55d361d3bcc0 2023-10-06T02:26:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.020+0000 7f0811eefb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d361c8b060 con 0x55d361d3a840 2023-10-06T02:26:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.020+0000 7f0802d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d8ac00 0x55d361d8b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.020+0000 7f0802d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d8ac00 0x55d361d8b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39174/0 (socket says 172.21.15.37:39174) 2023-10-06T02:26:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.020+0000 7f0802d9d700 1 -- 172.21.15.37:0/1855177209 learned_addr learned my addr 172.21.15.37:0/1855177209 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.020+0000 7f0801d9b700 1 --2- 172.21.15.37:0/1855177209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d361d3bcc0 0x55d361d8a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.020+0000 7f080259c700 1 --2- 172.21.15.37:0/1855177209 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d361d3a840 0x55d361d3ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.020+0000 7f0802d9d700 1 -- 172.21.15.37:0/1855177209 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d361d3a840 msgr2=0x55d361d3ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.020+0000 7f0802d9d700 1 --2- 172.21.15.37:0/1855177209 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d361d3a840 0x55d361d3ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.020+0000 7f0802d9d700 1 -- 172.21.15.37:0/1855177209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d361d3bcc0 msgr2=0x55d361d8a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.020+0000 7f0802d9d700 1 --2- 172.21.15.37:0/1855177209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d361d3bcc0 0x55d361d8a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.020+0000 7f0802d9d700 1 -- 172.21.15.37:0/1855177209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d361b25270 con 0x55d361d8ac00 2023-10-06T02:26:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.020+0000 7f0802d9d700 1 --2- 172.21.15.37:0/1855177209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d8ac00 0x55d361d8b050 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f07fc007640 tx=0x7f07fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a5b7b522e954e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.021+0000 7f07e37fe700 1 -- 172.21.15.37:0/1855177209 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc00e030 con 0x55d361d8ac00 2023-10-06T02:26:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.021+0000 7f07e37fe700 1 -- 172.21.15.37:0/1855177209 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc015600 con 0x55d361d8ac00 2023-10-06T02:26:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.021+0000 7f07e37fe700 1 -- 172.21.15.37:0/1855177209 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc0159a0 con 0x55d361d8ac00 2023-10-06T02:26:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.021+0000 7f0811eefb80 1 -- 172.21.15.37:0/1855177209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d8ac00 msgr2=0x55d361d8b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.021+0000 7f0811eefb80 1 --2- 172.21.15.37:0/1855177209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d8ac00 0x55d361d8b050 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f07fc007640 tx=0x7f07fc00b040 comp rx=0 tx=0).stop 2023-10-06T02:26:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.021+0000 7f0811eefb80 1 -- 172.21.15.37:0/1855177209 shutdown_connections 2023-10-06T02:26:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.021+0000 7f0811eefb80 1 --2- 172.21.15.37:0/1855177209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d8ac00 0x55d361d8b050 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.021+0000 7f0811eefb80 1 --2- 172.21.15.37:0/1855177209 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d361d3a840 0x55d361d3ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.021+0000 7f0811eefb80 1 --2- 172.21.15.37:0/1855177209 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d361d3bcc0 0x55d361d8a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.021+0000 7f0811eefb80 1 -- 172.21.15.37:0/1855177209 >> 172.21.15.37:0/1855177209 conn(0x55d361d3c160 msgr2=0x55d361d3c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.021+0000 7f0811eefb80 1 -- 172.21.15.37:0/1855177209 shutdown_connections 2023-10-06T02:26:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.021+0000 7f0811eefb80 1 -- 172.21.15.37:0/1855177209 wait complete. 2023-10-06T02:26:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.022+0000 7f0811eefb80 1 -- start start 2023-10-06T02:26:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.022+0000 7f0811eefb80 1 Processor -- start 2023-10-06T02:26:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.023+0000 7f0811eefb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d3a840 0x55d361d884d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.023+0000 7f0811eefb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d361d3bcc0 0x55d361d94d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.023+0000 7f0811eefb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d361d8ac00 0x55d361d952c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.023+0000 7f0811eefb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d361c36890 con 0x55d361d3a840 2023-10-06T02:26:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.023+0000 7f0811eefb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d361c51ea0 con 0x55d361d3bcc0 2023-10-06T02:26:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.023+0000 7f0811eefb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d361b0de30 con 0x55d361d8ac00 2023-10-06T02:26:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.023+0000 7f0811eefb80 10 client.0 _ll_register_callbacks cb 0x55d361cfde70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:26:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.023+0000 7f080259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d3a840 0x55d361d884d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.023+0000 7f080259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d3a840 0x55d361d884d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39190/0 (socket says 172.21.15.37:39190) 2023-10-06T02:26:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.023+0000 7f080259c700 1 -- 172.21.15.37:0/3463532433 learned_addr learned my addr 172.21.15.37:0/3463532433 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.023+0000 7f0802d9d700 1 --2- 172.21.15.37:0/3463532433 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d361d8ac00 0x55d361d952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.023+0000 7f0801d9b700 1 --2- 172.21.15.37:0/3463532433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d361d3bcc0 0x55d361d94d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.023+0000 7f080259c700 1 -- 172.21.15.37:0/3463532433 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d361d8ac00 msgr2=0x55d361d952c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.023+0000 7f080259c700 1 --2- 172.21.15.37:0/3463532433 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d361d8ac00 0x55d361d952c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.023+0000 7f080259c700 1 -- 172.21.15.37:0/3463532433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d361d3bcc0 msgr2=0x55d361d94d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.023+0000 7f080259c700 1 --2- 172.21.15.37:0/3463532433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d361d3bcc0 0x55d361d94d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.023+0000 7f080259c700 1 -- 172.21.15.37:0/3463532433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07fc007340 con 0x55d361d3a840 2023-10-06T02:26:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.024+0000 7f080259c700 1 --2- 172.21.15.37:0/3463532433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d3a840 0x55d361d884d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009f50 tx=0x7f07f4021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3317663b3e14b768 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.024+0000 7f07e0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:26:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.024+0000 7f07e0ff9700 1 -- 172.21.15.37:0/3463532433 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f402f070 con 0x55d361d3a840 2023-10-06T02:26:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.024+0000 7f07e0ff9700 1 -- 172.21.15.37:0/3463532433 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f07f401a700 con 0x55d361d3a840 2023-10-06T02:26:55.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.024+0000 7f0811eefb80 1 -- 172.21.15.37:0/3463532433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d361d2f940 con 0x55d361d3a840 2023-10-06T02:26:55.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.024+0000 7f07e0ff9700 1 -- 172.21.15.37:0/3463532433 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07f4021070 con 0x55d361d3a840 2023-10-06T02:26:55.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.024+0000 7f0811eefb80 10 client.6222 fetch_fsmap learned FSMap version 37 2023-10-06T02:26:55.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.024+0000 7f0811eefb80 1 -- 172.21.15.37:0/3463532433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55d361ac7fe0 con 0x55d361d3a840 2023-10-06T02:26:55.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.024+0000 7f07e0ff9700 1 -- 172.21.15.37:0/3463532433 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d361d2f940 con 0x55d361d3a840 2023-10-06T02:26:55.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.024+0000 7f07e0ff9700 1 -- 172.21.15.37:0/3463532433 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f07f401aad0 con 0x55d361d3a840 2023-10-06T02:26:55.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.024+0000 7f0811eefb80 10 client.6222 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T02:26:55.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.024+0000 7f0811eefb80 10 client.6222 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:26:55.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.024+0000 7f0811eefb80 20 client.6222 populate_metadata read hostname 'smithi037' 2023-10-06T02:26:55.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.024+0000 7f0811eefb80 1 --2- 172.21.15.37:0/3463532433 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55d361d82160 0x55d361d7ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.024+0000 7f0811eefb80 4 client.6222 mds_command: new command op to 6147 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:26:55.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.024+0000 7f0811eefb80 1 -- 172.21.15.37:0/3463532433 --> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d361d0c870 con 0x55d361d82160 2023-10-06T02:26:55.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.024+0000 7f0801d9b700 1 --2- 172.21.15.37:0/3463532433 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55d361d82160 0x55d361d7ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.025+0000 7f07e0ff9700 10 client.6222 ms_handle_connect on v2:172.21.15.37:6833/2196855571 2023-10-06T02:26:55.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.025+0000 7f0801d9b700 1 --2- 172.21.15.37:0/3463532433 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55d361d82160 0x55d361d7ab60 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd357dceb0da6c2c server_cookie=ca5be64385687a12 in_seq=0 out_seq=0 2023-10-06T02:26:55.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.025+0000 7f07e0ff9700 1 -- 172.21.15.37:0/3463532433 <== mds.0 v2:172.21.15.37:6833/2196855571 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d361d0c870 con 0x55d361d82160 2023-10-06T02:26:55.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.025+0000 7f07e0ff9700 10 client.6222 handle_command_reply: tid=0 2023-10-06T02:26:55.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.025+0000 7f0811eefb80 1 client.6222 shutdown 2023-10-06T02:26:55.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.025+0000 7f0811eefb80 1 -- 172.21.15.37:0/3463532433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d3a840 msgr2=0x55d361d884d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.025+0000 7f0811eefb80 1 --2- 172.21.15.37:0/3463532433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d3a840 0x55d361d884d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009f50 tx=0x7f07f4021000 comp rx=0 tx=0).stop 2023-10-06T02:26:55.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.025+0000 7f0811eefb80 1 -- 172.21.15.37:0/3463532433 shutdown_connections 2023-10-06T02:26:55.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.025+0000 7f0811eefb80 1 --2- 172.21.15.37:0/3463532433 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d361d8ac00 0x55d361d952c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.025+0000 7f0811eefb80 1 --2- 172.21.15.37:0/3463532433 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55d361d82160 0x55d361d7ab60 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.025+0000 7f0811eefb80 1 --2- 172.21.15.37:0/3463532433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d3a840 0x55d361d884d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.025+0000 7f0811eefb80 1 --2- 172.21.15.37:0/3463532433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d361d3bcc0 0x55d361d94d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.025+0000 7f07e0ff9700 0 client.6222 ms_handle_reset on v2:172.21.15.37:6833/2196855571 2023-10-06T02:26:55.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.025+0000 7f0811eefb80 1 -- 172.21.15.37:0/3463532433 >> 172.21.15.37:0/3463532433 conn(0x55d361d3c160 msgr2=0x55d361d3b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.026+0000 7f0811eefb80 1 -- 172.21.15.37:0/3463532433 shutdown_connections 2023-10-06T02:26:55.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.026+0000 7f0811eefb80 1 -- 172.21.15.37:0/3463532433 wait complete. 2023-10-06T02:26:55.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.026+0000 7f0811eefb80 20 client.6222 trim_cache size 0 max 16384 2023-10-06T02:26:55.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.043+0000 7f0811eefb80 1 Processor -- start 2023-10-06T02:26:55.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.043+0000 7f0811eefb80 1 -- start start 2023-10-06T02:26:55.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.043+0000 7f0811eefb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d361d3a840 0x55d361d7dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.043+0000 7f0811eefb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d3bcc0 0x55d361d7e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.043+0000 7f0811eefb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d361d8ac00 0x55d361d36880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.043+0000 7f0811eefb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d361d8afd0 con 0x55d361d3bcc0 2023-10-06T02:26:55.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.043+0000 7f0811eefb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d361d3ba90 con 0x55d361d3a840 2023-10-06T02:26:55.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.043+0000 7f0811eefb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d361d38d20 con 0x55d361d8ac00 2023-10-06T02:26:55.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.043+0000 7f0801d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d3bcc0 0x55d361d7e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.043+0000 7f0801d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d3bcc0 0x55d361d7e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39194/0 (socket says 172.21.15.37:39194) 2023-10-06T02:26:55.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.043+0000 7f0801d9b700 1 -- 172.21.15.37:0/3036239325 learned_addr learned my addr 172.21.15.37:0/3036239325 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:55.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.044+0000 7f0801d9b700 1 -- 172.21.15.37:0/3036239325 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d361d8ac00 msgr2=0x55d361d36880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.044+0000 7f0801d9b700 1 --2- 172.21.15.37:0/3036239325 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d361d8ac00 0x55d361d36880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.044+0000 7f0801d9b700 1 -- 172.21.15.37:0/3036239325 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d361d3a840 msgr2=0x55d361d7dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.044+0000 7f0801d9b700 1 --2- 172.21.15.37:0/3036239325 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d361d3a840 0x55d361d7dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.044+0000 7f0801d9b700 1 -- 172.21.15.37:0/3036239325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d361c59780 con 0x55d361d3bcc0 2023-10-06T02:26:55.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.044+0000 7f0801d9b700 1 --2- 172.21.15.37:0/3036239325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d3bcc0 0x55d361d7e510 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f07ec050e40 tx=0x7f07ec081e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d418ff061c68df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.044+0000 7f07e3fff700 1 -- 172.21.15.37:0/3036239325 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec06e070 con 0x55d361d3bcc0 2023-10-06T02:26:55.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.044+0000 7f07e3fff700 1 -- 172.21.15.37:0/3036239325 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec0542a0 con 0x55d361d3bcc0 2023-10-06T02:26:55.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.044+0000 7f07e3fff700 1 -- 172.21.15.37:0/3036239325 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec005e00 con 0x55d361d3bcc0 2023-10-06T02:26:55.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.044+0000 7f0811eefb80 1 -- 172.21.15.37:0/3036239325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d3bcc0 msgr2=0x55d361d7e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.044+0000 7f0811eefb80 1 --2- 172.21.15.37:0/3036239325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d3bcc0 0x55d361d7e510 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f07ec050e40 tx=0x7f07ec081e90 comp rx=0 tx=0).stop 2023-10-06T02:26:55.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.044+0000 7f0811eefb80 1 -- 172.21.15.37:0/3036239325 shutdown_connections 2023-10-06T02:26:55.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.044+0000 7f0811eefb80 1 --2- 172.21.15.37:0/3036239325 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d361d8ac00 0x55d361d36880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.044+0000 7f0811eefb80 1 --2- 172.21.15.37:0/3036239325 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d361d3a840 0x55d361d7dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.044+0000 7f0811eefb80 1 --2- 172.21.15.37:0/3036239325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d3bcc0 0x55d361d7e510 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.044+0000 7f0811eefb80 1 -- 172.21.15.37:0/3036239325 >> 172.21.15.37:0/3036239325 conn(0x55d361d3c160 msgr2=0x55d361d3b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.044+0000 7f0811eefb80 1 -- 172.21.15.37:0/3036239325 shutdown_connections 2023-10-06T02:26:55.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.045+0000 7f0811eefb80 1 -- 172.21.15.37:0/3036239325 wait complete. 2023-10-06T02:26:55.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.045+0000 7f0811eefb80 1 -- start start 2023-10-06T02:26:55.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.045+0000 7f0811eefb80 1 Processor -- start 2023-10-06T02:26:55.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.046+0000 7f0811eefb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d361d3a840 0x55d361de62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.046+0000 7f0811eefb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d361d3bcc0 0x55d361d9b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.046+0000 7f0811eefb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d8ac00 0x55d361d9b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.046+0000 7f0811eefb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d361da01a0 con 0x55d361d8ac00 2023-10-06T02:26:55.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.046+0000 7f0811eefb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d361d85e90 con 0x55d361d3bcc0 2023-10-06T02:26:55.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.046+0000 7f0811eefb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d361d378c0 con 0x55d361d3a840 2023-10-06T02:26:55.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.046+0000 7f0811eefb80 10 client.0 _ll_register_callbacks cb 0x55d361cfde70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:26:55.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.046+0000 7f0802d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d8ac00 0x55d361d9b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.046+0000 7f0802d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d8ac00 0x55d361d9b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39196/0 (socket says 172.21.15.37:39196) 2023-10-06T02:26:55.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.046+0000 7f0802d9d700 1 -- 172.21.15.37:0/345829134 learned_addr learned my addr 172.21.15.37:0/345829134 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:55.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.046+0000 7f080259c700 1 --2- 172.21.15.37:0/345829134 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d361d3a840 0x55d361de62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.046+0000 7f0801d9b700 1 --2- 172.21.15.37:0/345829134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d361d3bcc0 0x55d361d9b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.046+0000 7f0802d9d700 1 -- 172.21.15.37:0/345829134 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d361d3a840 msgr2=0x55d361de62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.046+0000 7f0802d9d700 1 --2- 172.21.15.37:0/345829134 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d361d3a840 0x55d361de62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.046+0000 7f0802d9d700 1 -- 172.21.15.37:0/345829134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d361d3bcc0 msgr2=0x55d361d9b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.046+0000 7f0802d9d700 1 --2- 172.21.15.37:0/345829134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d361d3bcc0 0x55d361d9b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.046+0000 7f0802d9d700 1 -- 172.21.15.37:0/345829134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0804150f20 con 0x55d361d8ac00 2023-10-06T02:26:55.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.046+0000 7f0801d9b700 1 --2- 172.21.15.37:0/345829134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d361d3bcc0 0x55d361d9b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:55.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.047+0000 7f0802d9d700 1 --2- 172.21.15.37:0/345829134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d8ac00 0x55d361d9b570 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f07fc017000 tx=0x7f07fc01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135a068f296167d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.047+0000 7f07e0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:26:55.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.047+0000 7f07e0ff9700 1 -- 172.21.15.37:0/345829134 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc00e040 con 0x55d361d8ac00 2023-10-06T02:26:55.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.047+0000 7f07e0ff9700 1 -- 172.21.15.37:0/345829134 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f07fc00f070 con 0x55d361d8ac00 2023-10-06T02:26:55.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.047+0000 7f0811eefb80 1 -- 172.21.15.37:0/345829134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f07fc015600 con 0x55d361d8ac00 2023-10-06T02:26:55.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.047+0000 7f07e0ff9700 1 -- 172.21.15.37:0/345829134 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07fc029640 con 0x55d361d8ac00 2023-10-06T02:26:55.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.047+0000 7f0811eefb80 10 client.6228 fetch_fsmap learned FSMap version 37 2023-10-06T02:26:55.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.047+0000 7f0811eefb80 1 -- 172.21.15.37:0/345829134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55d361c40470 con 0x55d361d8ac00 2023-10-06T02:26:55.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.047+0000 7f07e0ff9700 1 -- 172.21.15.37:0/345829134 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc015600 con 0x55d361d8ac00 2023-10-06T02:26:55.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.047+0000 7f07e0ff9700 1 -- 172.21.15.37:0/345829134 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f07fc014070 con 0x55d361d8ac00 2023-10-06T02:26:55.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.047+0000 7f0811eefb80 10 client.6228 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T02:26:55.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.047+0000 7f0811eefb80 10 client.6228 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:26:55.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.047+0000 7f0811eefb80 20 client.6228 populate_metadata read hostname 'smithi037' 2023-10-06T02:26:55.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.047+0000 7f0811eefb80 1 --2- 172.21.15.37:0/345829134 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55d361d36c30 0x55d361d80410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.047+0000 7f0811eefb80 4 client.6228 mds_command: new command op to 6147 tid=0[{"prefix": "status"}] 2023-10-06T02:26:55.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.047+0000 7f0811eefb80 1 -- 172.21.15.37:0/345829134 --> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d361c2de00 con 0x55d361d36c30 2023-10-06T02:26:55.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.047+0000 7f080259c700 1 --2- 172.21.15.37:0/345829134 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55d361d36c30 0x55d361d80410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.048+0000 7f07e0ff9700 10 client.6228 ms_handle_connect on v2:172.21.15.37:6833/2196855571 2023-10-06T02:26:55.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.048+0000 7f080259c700 1 --2- 172.21.15.37:0/345829134 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55d361d36c30 0x55d361d80410 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5f23f066e4a4962 server_cookie=b5f8afeddbec6ca5 in_seq=0 out_seq=0 2023-10-06T02:26:55.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.048+0000 7f07e0ff9700 1 -- 172.21.15.37:0/345829134 <== mds.0 v2:172.21.15.37:6833/2196855571 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55d361c2de00 con 0x55d361d36c30 2023-10-06T02:26:55.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.048+0000 7f07e0ff9700 10 client.6228 handle_command_reply: tid=0 2023-10-06T02:26:55.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.048+0000 7f0811eefb80 1 client.6228 shutdown 2023-10-06T02:26:55.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.048+0000 7f0811eefb80 1 -- 172.21.15.37:0/345829134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d8ac00 msgr2=0x55d361d9b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.048+0000 7f0811eefb80 1 --2- 172.21.15.37:0/345829134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d8ac00 0x55d361d9b570 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f07fc017000 tx=0x7f07fc01b000 comp rx=0 tx=0).stop 2023-10-06T02:26:55.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.048+0000 7f0811eefb80 1 -- 172.21.15.37:0/345829134 shutdown_connections 2023-10-06T02:26:55.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.048+0000 7f0811eefb80 1 --2- 172.21.15.37:0/345829134 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55d361d36c30 0x55d361d80410 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.048+0000 7f0811eefb80 1 --2- 172.21.15.37:0/345829134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d361d8ac00 0x55d361d9b570 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.048+0000 7f07e0ff9700 0 client.6228 ms_handle_reset on v2:172.21.15.37:6833/2196855571 2023-10-06T02:26:55.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.048+0000 7f0811eefb80 1 --2- 172.21.15.37:0/345829134 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d361d3a840 0x55d361de62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.048+0000 7f0811eefb80 1 --2- 172.21.15.37:0/345829134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d361d3bcc0 0x55d361d9b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.048+0000 7f0811eefb80 1 -- 172.21.15.37:0/345829134 >> 172.21.15.37:0/345829134 conn(0x55d361d3c160 msgr2=0x55d361d3b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.048+0000 7f0811eefb80 1 -- 172.21.15.37:0/345829134 shutdown_connections 2023-10-06T02:26:55.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.048+0000 7f0811eefb80 1 -- 172.21.15.37:0/345829134 wait complete. 2023-10-06T02:26:55.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.048+0000 7f0811eefb80 20 client.6228 trim_cache size 0 max 16384 2023-10-06T02:26:55.058 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:26:55.058 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "d1f292a2-fd8c-430a-be88-f44de408e77c", 2023-10-06T02:26:55.058 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-10-06T02:26:55.058 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6147, 2023-10-06T02:26:55.058 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-10-06T02:26:55.058 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-10-06T02:26:55.058 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-10-06T02:26:55.058 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 4.6985180780000002, 2023-10-06T02:26:55.059 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 37, 2023-10-06T02:26:55.059 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 60, 2023-10-06T02:26:55.059 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 60, 2023-10-06T02:26:55.059 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 5.6710659120000004 2023-10-06T02:26:55.059 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:26:55.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.049+0000 7f0808bf7700 1 -- 172.21.15.37:0/1758833908 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f07e4066f30 msgr2=0x7f07e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.049+0000 7f0808bf7700 1 --2- 172.21.15.37:0/1758833908 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f07e4066f30 0x7f07e40693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f07f40093f0 tx=0x7f07f4017000 comp rx=0 tx=0).stop 2023-10-06T02:26:55.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.049+0000 7f0808bf7700 1 -- 172.21.15.37:0/1758833908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080406de80 msgr2=0x7f080414f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.049+0000 7f0808bf7700 1 --2- 172.21.15.37:0/1758833908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080406de80 0x7f080414f090 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00c5e0 tx=0x7f07ec001070 comp rx=0 tx=0).stop 2023-10-06T02:26:55.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.049+0000 7f0808bf7700 1 -- 172.21.15.37:0/1758833908 shutdown_connections 2023-10-06T02:26:55.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.049+0000 7f0808bf7700 1 --2- 172.21.15.37:0/1758833908 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f08040cb080 0x7f08041501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.049+0000 7f0808bf7700 1 --2- 172.21.15.37:0/1758833908 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f07e4066f30 0x7f07e40693e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.049+0000 7f0808bf7700 1 --2- 172.21.15.37:0/1758833908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f080406dab0 0x7f08040b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.049+0000 7f0808bf7700 1 --2- 172.21.15.37:0/1758833908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f080406de80 0x7f080414f090 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.049+0000 7f0808bf7700 1 -- 172.21.15.37:0/1758833908 >> 172.21.15.37:0/1758833908 conn(0x7f08040d0510 msgr2=0x7f08040c52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.049+0000 7f0808bf7700 1 -- 172.21.15.37:0/1758833908 shutdown_connections 2023-10-06T02:26:55.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.049+0000 7f0808bf7700 1 -- 172.21.15.37:0/1758833908 wait complete. 2023-10-06T02:26:55.062 DEBUG:teuthology.orchestra.run.smithi037:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-06T02:26:55.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start / repair,recursive 2023-10-06T02:26:55.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.186+0000 7feeef488700 1 Processor -- start 2023-10-06T02:26:55.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.186+0000 7feeef488700 1 -- start start 2023-10-06T02:26:55.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.187+0000 7feeef488700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feee8143340 0x7feee8067990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.187+0000 7feeef488700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee815e3f0 con 0x7feee8067ed0 2023-10-06T02:26:55.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.187+0000 7feeef488700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee8068340 con 0x7feee8142f70 2023-10-06T02:26:55.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.187+0000 7feeef488700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee80b13c0 con 0x7feee8143340 2023-10-06T02:26:55.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.187+0000 7feeeda25700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7feee8067ed0 0x7feee806d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38266/0 (socket says 172.21.15.37:38266) 2023-10-06T02:26:55.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.187+0000 7feeeda25700 1 -- 172.21.15.37:0/1337604816 learned_addr learned my addr 172.21.15.37:0/1337604816 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:26:55.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.187+0000 7feeeca23700 1 --2- 172.21.15.37:0/1337604816 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feee8143340 0x7feee8067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.187+0000 7feedffff700 1 -- 172.21.15.37:0/1337604816 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3070005156 0 0) 0x7feee815e3f0 con 0x7feee8067ed0 2023-10-06T02:26:55.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.187+0000 7feedffff700 1 -- 172.21.15.37:0/1337604816 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feed4003570 con 0x7feee8067ed0 2023-10-06T02:26:55.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.187+0000 7feedffff700 1 -- 172.21.15.37:0/1337604816 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124295543 0 0) 0x7feee8068340 con 0x7feee8142f70 2023-10-06T02:26:55.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.187+0000 7feedffff700 1 -- 172.21.15.37:0/1337604816 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feee815e3f0 con 0x7feee8142f70 2023-10-06T02:26:55.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.187+0000 7feeeca23700 1 -- 172.21.15.37:0/1337604816 >> v1:172.21.15.191:6789/0 conn(0x7feee8142f70 legacy=0x7feee80b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.187+0000 7feeeca23700 1 -- 172.21.15.37:0/1337604816 >> v1:172.21.15.37:6789/0 conn(0x7feee8067ed0 legacy=0x7feee806d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.187+0000 7feeeca23700 1 -- 172.21.15.37:0/1337604816 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee815d7e0 con 0x7feee8143340 2023-10-06T02:26:55.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.188+0000 7feeeca23700 1 --2- 172.21.15.37:0/1337604816 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feee8143340 0x7feee8067990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feed8009910 tx=0x7feed80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e124a38cd456272 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.188+0000 7feedffff700 1 -- 172.21.15.37:0/1337604816 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8011630 con 0x7feee8143340 2023-10-06T02:26:55.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.188+0000 7feedffff700 1 -- 172.21.15.37:0/1337604816 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed8011790 con 0x7feee8143340 2023-10-06T02:26:55.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.188+0000 7feedffff700 1 -- 172.21.15.37:0/1337604816 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8011b30 con 0x7feee8143340 2023-10-06T02:26:55.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.188+0000 7feeef488700 1 -- 172.21.15.37:0/1337604816 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feee8143340 msgr2=0x7feee8067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.188+0000 7feeef488700 1 --2- 172.21.15.37:0/1337604816 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feee8143340 0x7feee8067990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feed8009910 tx=0x7feed80091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.189+0000 7feeef488700 1 -- 172.21.15.37:0/1337604816 shutdown_connections 2023-10-06T02:26:55.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.189+0000 7feeef488700 1 --2- 172.21.15.37:0/1337604816 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feee8143340 0x7feee8067990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.189+0000 7feeef488700 1 -- 172.21.15.37:0/1337604816 >> 172.21.15.37:0/1337604816 conn(0x7feee80ce360 msgr2=0x7feee80ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.189+0000 7feeef488700 1 -- 172.21.15.37:0/1337604816 shutdown_connections 2023-10-06T02:26:55.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.189+0000 7feeef488700 1 -- 172.21.15.37:0/1337604816 wait complete. 2023-10-06T02:26:55.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.190+0000 7feeef488700 1 Processor -- start 2023-10-06T02:26:55.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.190+0000 7feeef488700 1 -- start start 2023-10-06T02:26:55.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feeef488700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feee8067ed0 0x7feee80c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feeef488700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee8142f70 0x7feee80c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feeef488700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feee8143340 0x7feee8158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feeef488700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee80c8590 con 0x7feee8142f70 2023-10-06T02:26:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feeef488700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee80c91c0 con 0x7feee8067ed0 2023-10-06T02:26:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feeef488700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee80c7a50 con 0x7feee8143340 2023-10-06T02:26:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feeeca23700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee8142f70 0x7feee80c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feeeca23700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee8142f70 0x7feee80c7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39204/0 (socket says 172.21.15.37:39204) 2023-10-06T02:26:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feeeca23700 1 -- 172.21.15.37:0/301590349 learned_addr learned my addr 172.21.15.37:0/301590349 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feeeda25700 1 --2- 172.21.15.37:0/301590349 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feee8143340 0x7feee8158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feeed224700 1 --2- 172.21.15.37:0/301590349 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feee8067ed0 0x7feee80c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feeeca23700 1 -- 172.21.15.37:0/301590349 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feee8143340 msgr2=0x7feee8158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feeeca23700 1 --2- 172.21.15.37:0/301590349 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feee8143340 0x7feee8158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feeeca23700 1 -- 172.21.15.37:0/301590349 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feee8067ed0 msgr2=0x7feee80c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feeeca23700 1 --2- 172.21.15.37:0/301590349 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feee8067ed0 0x7feee80c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feeeca23700 1 -- 172.21.15.37:0/301590349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed8009420 con 0x7feee8142f70 2023-10-06T02:26:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feeeca23700 1 --2- 172.21.15.37:0/301590349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee8142f70 0x7feee80c7510 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7feed8009f00 tx=0x7feed8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feedd7fa700 1 -- 172.21.15.37:0/301590349 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed801f070 con 0x7feee8142f70 2023-10-06T02:26:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feedd7fa700 1 -- 172.21.15.37:0/301590349 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed8002f70 con 0x7feee8142f70 2023-10-06T02:26:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feedd7fa700 1 -- 172.21.15.37:0/301590349 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8011900 con 0x7feee8142f70 2023-10-06T02:26:55.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feeef488700 1 -- 172.21.15.37:0/301590349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee80c7cf0 con 0x7feee8142f70 2023-10-06T02:26:55.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.191+0000 7feeef488700 1 -- 172.21.15.37:0/301590349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee80c82b0 con 0x7feee8142f70 2023-10-06T02:26:55.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.193+0000 7feedd7fa700 1 -- 172.21.15.37:0/301590349 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feed8023070 con 0x7feee8142f70 2023-10-06T02:26:55.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.193+0000 7feedd7fa700 1 --2- 172.21.15.37:0/301590349 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7feecc066f30 0x7feecc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.193+0000 7feedd7fa700 1 -- 172.21.15.37:0/301590349 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x7feed8085930 con 0x7feee8142f70 2023-10-06T02:26:55.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.193+0000 7feeed224700 1 --2- 172.21.15.37:0/301590349 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7feecc066f30 0x7feecc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.194+0000 7feeed224700 1 --2- 172.21.15.37:0/301590349 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7feecc066f30 0x7feecc0693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7feee4007fd0 tx=0x7feee4007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.195+0000 7feef8780b80 1 Processor -- start 2023-10-06T02:26:55.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.195+0000 7feef8780b80 1 -- start start 2023-10-06T02:26:55.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.196+0000 7feef8780b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708683910 0x55d708683ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.196+0000 7feef8780b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d708684d90 0x55d7086d3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.196+0000 7feef8780b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7086d3cd0 0x55d7086d4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.196+0000 7feef8780b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7085dab40 con 0x55d7086d3cd0 2023-10-06T02:26:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.196+0000 7feef8780b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7085d8340 con 0x55d708683910 2023-10-06T02:26:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.196+0000 7feef8780b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7085d4130 con 0x55d708684d90 2023-10-06T02:26:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.196+0000 7feeeda25700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7086d3cd0 0x55d7086d4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.196+0000 7feeeda25700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7086d3cd0 0x55d7086d4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39208/0 (socket says 172.21.15.37:39208) 2023-10-06T02:26:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.196+0000 7feeeda25700 1 -- 172.21.15.37:0/1241717535 learned_addr learned my addr 172.21.15.37:0/1241717535 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.196+0000 7feeed224700 1 --2- 172.21.15.37:0/1241717535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708683910 0x55d708683ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.196+0000 7feeeca23700 1 --2- 172.21.15.37:0/1241717535 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d708684d90 0x55d7086d3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.196+0000 7feeeda25700 1 -- 172.21.15.37:0/1241717535 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d708684d90 msgr2=0x55d7086d3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.196+0000 7feeeda25700 1 --2- 172.21.15.37:0/1241717535 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d708684d90 0x55d7086d3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.196+0000 7feeeda25700 1 -- 172.21.15.37:0/1241717535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708683910 msgr2=0x55d708683ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.196+0000 7feeeda25700 1 --2- 172.21.15.37:0/1241717535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708683910 0x55d708683ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.196+0000 7feeeda25700 1 -- 172.21.15.37:0/1241717535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d70846e340 con 0x55d7086d3cd0 2023-10-06T02:26:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.197+0000 7feeeda25700 1 --2- 172.21.15.37:0/1241717535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7086d3cd0 0x55d7086d4120 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7feee0002220 tx=0x7feee0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3de75c6d4a8a04 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.197+0000 7feed27fc700 1 -- 172.21.15.37:0/1241717535 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee000fd20 con 0x55d7086d3cd0 2023-10-06T02:26:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.197+0000 7feed27fc700 1 -- 172.21.15.37:0/1241717535 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee000fe80 con 0x55d7086d3cd0 2023-10-06T02:26:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.197+0000 7feed27fc700 1 -- 172.21.15.37:0/1241717535 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee0007300 con 0x55d7086d3cd0 2023-10-06T02:26:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.197+0000 7feef8780b80 1 -- 172.21.15.37:0/1241717535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7086d3cd0 msgr2=0x55d7086d4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.197+0000 7feef8780b80 1 --2- 172.21.15.37:0/1241717535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7086d3cd0 0x55d7086d4120 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7feee0002220 tx=0x7feee0009040 comp rx=0 tx=0).stop 2023-10-06T02:26:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.197+0000 7feef8780b80 1 -- 172.21.15.37:0/1241717535 shutdown_connections 2023-10-06T02:26:55.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.197+0000 7feef8780b80 1 --2- 172.21.15.37:0/1241717535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7086d3cd0 0x55d7086d4120 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.197+0000 7feef8780b80 1 --2- 172.21.15.37:0/1241717535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708683910 0x55d708683ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.197+0000 7feef8780b80 1 --2- 172.21.15.37:0/1241717535 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d708684d90 0x55d7086d3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.197+0000 7feef8780b80 1 -- 172.21.15.37:0/1241717535 >> 172.21.15.37:0/1241717535 conn(0x55d708685230 msgr2=0x55d708685600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.197+0000 7feef8780b80 1 -- 172.21.15.37:0/1241717535 shutdown_connections 2023-10-06T02:26:55.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.197+0000 7feef8780b80 1 -- 172.21.15.37:0/1241717535 wait complete. 2023-10-06T02:26:55.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.198+0000 7feef8780b80 1 -- start start 2023-10-06T02:26:55.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.198+0000 7feef8780b80 1 Processor -- start 2023-10-06T02:26:55.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.199+0000 7feef8780b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708683910 0x55d7086c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.199+0000 7feef8780b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d708684d90 0x55d7086c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.199+0000 7feef8780b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d7086d3cd0 0x55d7086c4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.199+0000 7feef8780b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d70857f960 con 0x55d708684d90 2023-10-06T02:26:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.199+0000 7feef8780b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d70859af70 con 0x55d708683910 2023-10-06T02:26:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.199+0000 7feef8780b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d708456f00 con 0x55d7086d3cd0 2023-10-06T02:26:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.199+0000 7feef8780b80 10 client.0 _ll_register_callbacks cb 0x55d708646f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:26:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.199+0000 7feeeca23700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d708684d90 0x55d7086c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.199+0000 7feeeca23700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d708684d90 0x55d7086c3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39224/0 (socket says 172.21.15.37:39224) 2023-10-06T02:26:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.199+0000 7feeeca23700 1 -- 172.21.15.37:0/1283522638 learned_addr learned my addr 172.21.15.37:0/1283522638 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.199+0000 7feeed224700 1 --2- 172.21.15.37:0/1283522638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708683910 0x55d7086c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.199+0000 7feeeda25700 1 --2- 172.21.15.37:0/1283522638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d7086d3cd0 0x55d7086c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.199+0000 7feeeca23700 1 -- 172.21.15.37:0/1283522638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d7086d3cd0 msgr2=0x55d7086c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.199+0000 7feeeca23700 1 --2- 172.21.15.37:0/1283522638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d7086d3cd0 0x55d7086c4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.199+0000 7feeeca23700 1 -- 172.21.15.37:0/1283522638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708683910 msgr2=0x55d7086c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.199+0000 7feeeca23700 1 --2- 172.21.15.37:0/1283522638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708683910 0x55d7086c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.199+0000 7feeeca23700 1 -- 172.21.15.37:0/1283522638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed4003570 con 0x55d708684d90 2023-10-06T02:26:55.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.199+0000 7feeeda25700 1 --2- 172.21.15.37:0/1283522638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d7086d3cd0 0x55d7086c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:55.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.200+0000 7feeeca23700 1 --2- 172.21.15.37:0/1283522638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d708684d90 0x55d7086c3bc0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7feed8052b30 tx=0x7feed8059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dcdea809c863ced server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.200+0000 7feec77fe700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:26:55.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.200+0000 7feec77fe700 1 -- 172.21.15.37:0/1283522638 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed805d5d0 con 0x55d708684d90 2023-10-06T02:26:55.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.200+0000 7feec77fe700 1 -- 172.21.15.37:0/1283522638 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x7feed80549d0 con 0x55d708684d90 2023-10-06T02:26:55.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.200+0000 7feef8780b80 1 -- 172.21.15.37:0/1283522638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d708678a10 con 0x55d708684d90 2023-10-06T02:26:55.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.200+0000 7feec77fe700 1 -- 172.21.15.37:0/1283522638 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7feed80722a0 con 0x55d708684d90 2023-10-06T02:26:55.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.200+0000 7feef8780b80 10 client.6240 fetch_fsmap learned FSMap version 37 2023-10-06T02:26:55.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.200+0000 7feef8780b80 1 -- 172.21.15.37:0/1283522638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55d7084110b0 con 0x55d708684d90 2023-10-06T02:26:55.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.200+0000 7feec77fe700 1 -- 172.21.15.37:0/1283522638 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d708678a10 con 0x55d708684d90 2023-10-06T02:26:55.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.200+0000 7feec77fe700 1 -- 172.21.15.37:0/1283522638 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7feed8055b20 con 0x55d708684d90 2023-10-06T02:26:55.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.200+0000 7feef8780b80 10 client.6240 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T02:26:55.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.200+0000 7feef8780b80 10 client.6240 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T02:26:55.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.200+0000 7feef8780b80 20 client.6240 populate_metadata read hostname 'smithi037' 2023-10-06T02:26:55.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.200+0000 7feef8780b80 1 --2- 172.21.15.37:0/1283522638 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55d7086a5da0 0x55d7086dd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.200+0000 7feef8780b80 4 client.6240 mds_command: new command op to 6147 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:26:55.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.200+0000 7feef8780b80 1 -- 172.21.15.37:0/1283522638 --> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d708655940 con 0x55d7086a5da0 2023-10-06T02:26:55.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.200+0000 7feeed224700 1 --2- 172.21.15.37:0/1283522638 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55d7086a5da0 0x55d7086dd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.201+0000 7feec77fe700 10 client.6240 ms_handle_connect on v2:172.21.15.37:6833/2196855571 2023-10-06T02:26:55.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.201+0000 7feeed224700 1 --2- 172.21.15.37:0/1283522638 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55d7086a5da0 0x55d7086dd290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30aade7e813fc149 server_cookie=44542270cdf2d2b4 in_seq=0 out_seq=0 2023-10-06T02:26:55.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.201+0000 7feec77fe700 1 -- 172.21.15.37:0/1283522638 <== mds.0 v2:172.21.15.37:6833/2196855571 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d708655940 con 0x55d7086a5da0 2023-10-06T02:26:55.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.201+0000 7feec77fe700 10 client.6240 handle_command_reply: tid=0 2023-10-06T02:26:55.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.201+0000 7feef8780b80 1 client.6240 shutdown 2023-10-06T02:26:55.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.202+0000 7feef8780b80 1 -- 172.21.15.37:0/1283522638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d708684d90 msgr2=0x55d7086c3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.202+0000 7feef8780b80 1 --2- 172.21.15.37:0/1283522638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d708684d90 0x55d7086c3bc0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7feed8052b30 tx=0x7feed8059040 comp rx=0 tx=0).stop 2023-10-06T02:26:55.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.202+0000 7feef8780b80 1 -- 172.21.15.37:0/1283522638 shutdown_connections 2023-10-06T02:26:55.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.202+0000 7feef8780b80 1 --2- 172.21.15.37:0/1283522638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d7086d3cd0 0x55d7086c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.202+0000 7feef8780b80 1 --2- 172.21.15.37:0/1283522638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708683910 0x55d7086c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.202+0000 7feef8780b80 1 --2- 172.21.15.37:0/1283522638 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55d7086a5da0 0x55d7086dd290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.202+0000 7feef8780b80 1 --2- 172.21.15.37:0/1283522638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d708684d90 0x55d7086c3bc0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.202+0000 7feec77fe700 0 client.6240 ms_handle_reset on v2:172.21.15.37:6833/2196855571 2023-10-06T02:26:55.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.202+0000 7feef8780b80 1 -- 172.21.15.37:0/1283522638 >> 172.21.15.37:0/1283522638 conn(0x55d708685230 msgr2=0x55d708684280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.202+0000 7feef8780b80 1 -- 172.21.15.37:0/1283522638 shutdown_connections 2023-10-06T02:26:55.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.202+0000 7feef8780b80 1 -- 172.21.15.37:0/1283522638 wait complete. 2023-10-06T02:26:55.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.202+0000 7feef8780b80 20 client.6240 trim_cache size 0 max 16384 2023-10-06T02:26:55.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.211+0000 7f44d3b25700 1 Processor -- start 2023-10-06T02:26:55.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.211+0000 7f44d3b25700 1 -- start start 2023-10-06T02:26:55.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.212+0000 7f44d3b25700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f44cc159620 0x7f44cc0ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.212+0000 7f44d3b25700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44cc0d0430 0x7f44cc0d0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.212+0000 7f44d3b25700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44cc0d0dd0 con 0x7f44cc1599f0 2023-10-06T02:26:55.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.212+0000 7f44d3b25700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44cc0ccb50 con 0x7f44cc159620 2023-10-06T02:26:55.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.212+0000 7f44d3b25700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc15a1c0 con 0x7f44cc0d0430 2023-10-06T02:26:55.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.212+0000 7f44d10c0700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f44cc1599f0 0x7f44cc0cb660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38270/0 (socket says 172.21.15.37:38270) 2023-10-06T02:26:55.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.212+0000 7f44d10c0700 1 -- 172.21.15.37:0/2020495587 learned_addr learned my addr 172.21.15.37:0/2020495587 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:26:55.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.212+0000 7f44d20c2700 1 --2- 172.21.15.37:0/2020495587 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44cc0d0430 0x7f44cc0d0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.212+0000 7f44d18c1700 1 --2- 172.21.15.37:0/2020495587 >> v2:172.21.15.191:3300/0 conn(0x7f44cc159620 0x7f44cc0ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.212+0000 7f44d08bf700 1 -- 172.21.15.37:0/2020495587 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734875777 0 0) 0x7f44bc001110 con 0x7f44cc1599f0 2023-10-06T02:26:55.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.212+0000 7f44d08bf700 1 -- 172.21.15.37:0/2020495587 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44b8003570 con 0x7f44cc1599f0 2023-10-06T02:26:55.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.212+0000 7f44d18c1700 1 -- 172.21.15.37:0/2020495587 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44cc0d0430 msgr2=0x7f44cc0d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.212+0000 7f44d18c1700 1 --2- 172.21.15.37:0/2020495587 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44cc0d0430 0x7f44cc0d0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.212+0000 7f44d18c1700 1 -- 172.21.15.37:0/2020495587 >> v1:172.21.15.37:6789/0 conn(0x7f44cc1599f0 legacy=0x7f44cc0cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.212+0000 7f44d18c1700 1 -- 172.21.15.37:0/2020495587 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc15a4a0 con 0x7f44cc159620 2023-10-06T02:26:55.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.212+0000 7f44d20c2700 1 --2- 172.21.15.37:0/2020495587 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44cc0d0430 0x7f44cc0d0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:26:55.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.213+0000 7f44d18c1700 1 --2- 172.21.15.37:0/2020495587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44cc159620 0x7f44cc0ce6c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f44c80098e0 tx=0x7f44c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b86e47d7bea716cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.213+0000 7f44d08bf700 1 -- 172.21.15.37:0/2020495587 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c8011630 con 0x7f44cc159620 2023-10-06T02:26:55.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.213+0000 7f44d08bf700 1 -- 172.21.15.37:0/2020495587 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c8011790 con 0x7f44cc159620 2023-10-06T02:26:55.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.213+0000 7f44d08bf700 1 -- 172.21.15.37:0/2020495587 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c8011b10 con 0x7f44cc159620 2023-10-06T02:26:55.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.213+0000 7f44d3b25700 1 -- 172.21.15.37:0/2020495587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44cc159620 msgr2=0x7f44cc0ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.213+0000 7f44d3b25700 1 --2- 172.21.15.37:0/2020495587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44cc159620 0x7f44cc0ce6c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f44c80098e0 tx=0x7f44c80091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.213+0000 7f44d3b25700 1 -- 172.21.15.37:0/2020495587 shutdown_connections 2023-10-06T02:26:55.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.213+0000 7f44d3b25700 1 --2- 172.21.15.37:0/2020495587 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44cc0d0430 0x7f44cc0d0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.213+0000 7f44d3b25700 1 --2- 172.21.15.37:0/2020495587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44cc159620 0x7f44cc0ce6c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.213+0000 7f44d3b25700 1 -- 172.21.15.37:0/2020495587 >> 172.21.15.37:0/2020495587 conn(0x7f44cc06c0b0 msgr2=0x7f44cc06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.214+0000 7f44d3b25700 1 -- 172.21.15.37:0/2020495587 shutdown_connections 2023-10-06T02:26:55.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.214+0000 7f44d3b25700 1 -- 172.21.15.37:0/2020495587 wait complete. 2023-10-06T02:26:55.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.215+0000 7f44d3b25700 1 Processor -- start 2023-10-06T02:26:55.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.215+0000 7f44d3b25700 1 -- start start 2023-10-06T02:26:55.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.215+0000 7f44d3b25700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44cc0d0430 0x7f44cc149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.215+0000 7f44d3b25700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44cc159620 0x7f44cc0c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.215+0000 7f44d3b25700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44cc1599f0 0x7f44cc0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.215+0000 7f44d3b25700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc0c7e60 con 0x7f44cc159620 2023-10-06T02:26:55.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.215+0000 7f44d3b25700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc0c7550 con 0x7f44cc0d0430 2023-10-06T02:26:55.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.215+0000 7f44d3b25700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc0ca280 con 0x7f44cc1599f0 2023-10-06T02:26:55.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.215+0000 7f44d10c0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44cc159620 0x7f44cc0c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.215+0000 7f44d10c0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44cc159620 0x7f44cc0c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39228/0 (socket says 172.21.15.37:39228) 2023-10-06T02:26:55.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.215+0000 7f44d10c0700 1 -- 172.21.15.37:0/2594868680 learned_addr learned my addr 172.21.15.37:0/2594868680 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:55.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.216+0000 7f44d20c2700 1 --2- 172.21.15.37:0/2594868680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44cc1599f0 0x7f44cc0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.216+0000 7f44d18c1700 1 --2- 172.21.15.37:0/2594868680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44cc0d0430 0x7f44cc149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.216+0000 7f44d10c0700 1 -- 172.21.15.37:0/2594868680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44cc1599f0 msgr2=0x7f44cc0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.216+0000 7f44d10c0700 1 --2- 172.21.15.37:0/2594868680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44cc1599f0 0x7f44cc0b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.216+0000 7f44d10c0700 1 -- 172.21.15.37:0/2594868680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44cc0d0430 msgr2=0x7f44cc149ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.216+0000 7f44d10c0700 1 --2- 172.21.15.37:0/2594868680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44cc0d0430 0x7f44cc149ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.216+0000 7f44d10c0700 1 -- 172.21.15.37:0/2594868680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c4009a20 con 0x7f44cc159620 2023-10-06T02:26:55.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.216+0000 7f44d10c0700 1 --2- 172.21.15.37:0/2594868680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44cc159620 0x7f44cc0c97e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00c7c0 tx=0x7f44bc007c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.216+0000 7f44c1ffb700 1 -- 172.21.15.37:0/2594868680 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc005b30 con 0x7f44cc159620 2023-10-06T02:26:55.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.216+0000 7f44d3b25700 1 -- 172.21.15.37:0/2594868680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c8009420 con 0x7f44cc159620 2023-10-06T02:26:55.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.216+0000 7f44c1ffb700 1 -- 172.21.15.37:0/2594868680 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44bc005c90 con 0x7f44cc159620 2023-10-06T02:26:55.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.216+0000 7f44c1ffb700 1 -- 172.21.15.37:0/2594868680 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc007300 con 0x7f44cc159620 2023-10-06T02:26:55.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.216+0000 7f44d3b25700 1 -- 172.21.15.37:0/2594868680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44cc0c7af0 con 0x7f44cc159620 2023-10-06T02:26:55.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.217+0000 7f44d3b25700 1 -- 172.21.15.37:0/2594868680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f44cc0c8010 con 0x7f44cc159620 2023-10-06T02:26:55.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.218+0000 7f44c1ffb700 1 -- 172.21.15.37:0/2594868680 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44bc007670 con 0x7f44cc159620 2023-10-06T02:26:55.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.219+0000 7f44c1ffb700 1 --2- 172.21.15.37:0/2594868680 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f44b0066f60 0x7f44b0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.219+0000 7f44c1ffb700 1 -- 172.21.15.37:0/2594868680 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f44bc083b40 con 0x7f44cc159620 2023-10-06T02:26:55.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.219+0000 7f44d18c1700 1 --2- 172.21.15.37:0/2594868680 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f44b0066f60 0x7f44b0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.219+0000 7f44c1ffb700 1 -- 172.21.15.37:0/2594868680 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+445 (secure 0 0 0) 0x7f44cc0c8010 con 0x7f44cc159620 2023-10-06T02:26:55.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.219+0000 7f44d3b25700 1 -- 172.21.15.37:0/2594868680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f44cc0d0dd0 con 0x7f44cc159620 2023-10-06T02:26:55.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.219+0000 7f44c1ffb700 1 -- 172.21.15.37:0/2594868680 <== mon.0 v2:172.21.15.37:3300/0 7 ==== log(2 entries from seq 532 at 2023-10-06T02:26:53.356112+0000) v1 ==== 389+0+0 (secure 0 0 0) 0x7f44bc054ea0 con 0x7f44cc159620 2023-10-06T02:26:55.231 INFO:teuthology.orchestra.run.smithi037.stdout: cluster: 2023-10-06T02:26:55.231 INFO:teuthology.orchestra.run.smithi037.stdout: id: d1f292a2-fd8c-430a-be88-f44de408e77c 2023-10-06T02:26:55.231 INFO:teuthology.orchestra.run.smithi037.stdout: health: HEALTH_OK 2023-10-06T02:26:55.231 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:26:55.231 INFO:teuthology.orchestra.run.smithi037.stdout: services: 2023-10-06T02:26:55.231 INFO:teuthology.orchestra.run.smithi037.stdout: mon: 3 daemons, quorum a,b,c (age 3m) 2023-10-06T02:26:55.232 INFO:teuthology.orchestra.run.smithi037.stdout: mgr: x(active, since 3m), standbys: y 2023-10-06T02:26:55.232 INFO:teuthology.orchestra.run.smithi037.stdout: mds: 1/1 daemons up, 3 standby 2023-10-06T02:26:55.232 INFO:teuthology.orchestra.run.smithi037.stdout: osd: 8 osds: 8 up (since 3m), 8 in (since 3m) 2023-10-06T02:26:55.232 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:26:55.232 INFO:teuthology.orchestra.run.smithi037.stdout: data: 2023-10-06T02:26:55.232 INFO:teuthology.orchestra.run.smithi037.stdout: volumes: 1/1 healthy 2023-10-06T02:26:55.233 INFO:teuthology.orchestra.run.smithi037.stdout: pools: 4 pools, 105 pgs 2023-10-06T02:26:55.233 INFO:teuthology.orchestra.run.smithi037.stdout: objects: 30 objects, 19 MiB 2023-10-06T02:26:55.233 INFO:teuthology.orchestra.run.smithi037.stdout: usage: 2.3 GiB used, 718 GiB / 720 GiB avail 2023-10-06T02:26:55.233 INFO:teuthology.orchestra.run.smithi037.stdout: pgs: 105 active+clean 2023-10-06T02:26:55.233 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:26:55.233 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:26:55.234 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:26:53.356112+0000 mon.a [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-06T02:26:55.234 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:26:53.356140+0000 mon.a [INF] Cluster is now healthy 2023-10-06T02:26:55.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.219+0000 7f44d18c1700 1 --2- 172.21.15.37:0/2594868680 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f44b0066f60 0x7f44b0069410 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f44c80091e0 tx=0x7f44c8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.220+0000 7feef8780b80 1 Processor -- start 2023-10-06T02:26:55.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.220+0000 7feef8780b80 1 -- start start 2023-10-06T02:26:55.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.221+0000 7feef8780b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708683910 0x55d70867c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.221+0000 7feef8780b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d708684d90 0x55d7086ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.221+0000 7feef8780b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d7086d3cd0 0x55d7086c1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.221+0000 7feef8780b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7086caa10 con 0x55d708684d90 2023-10-06T02:26:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.221+0000 7feef8780b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7086d3a70 con 0x55d708683910 2023-10-06T02:26:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.221+0000 7feef8780b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d70867c900 con 0x55d7086d3cd0 2023-10-06T02:26:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.221+0000 7feeeca23700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d708684d90 0x55d7086ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.221+0000 7feeeca23700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d708684d90 0x55d7086ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39234/0 (socket says 172.21.15.37:39234) 2023-10-06T02:26:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.221+0000 7feeeca23700 1 -- 172.21.15.37:0/3597043015 learned_addr learned my addr 172.21.15.37:0/3597043015 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.221+0000 7feeed224700 1 --2- 172.21.15.37:0/3597043015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708683910 0x55d70867c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.221+0000 7feeeca23700 1 -- 172.21.15.37:0/3597043015 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d7086d3cd0 msgr2=0x55d7086c1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.222+0000 7feeeca23700 1 --2- 172.21.15.37:0/3597043015 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d7086d3cd0 0x55d7086c1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.222+0000 7feeeca23700 1 -- 172.21.15.37:0/3597043015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708683910 msgr2=0x55d70867c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.222+0000 7feeeca23700 1 --2- 172.21.15.37:0/3597043015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708683910 0x55d70867c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.222+0000 7feeeca23700 1 -- 172.21.15.37:0/3597043015 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7085a2850 con 0x55d708684d90 2023-10-06T02:26:55.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.222+0000 7feeeca23700 1 --2- 172.21.15.37:0/3597043015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d708684d90 0x55d7086ce1b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7feed80562e0 tx=0x7feed8031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a1fb672479bf35 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.222+0000 7feed2ffd700 1 -- 172.21.15.37:0/3597043015 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed805d5d0 con 0x55d708684d90 2023-10-06T02:26:55.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.222+0000 7feed2ffd700 1 -- 172.21.15.37:0/3597043015 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed8068e80 con 0x55d708684d90 2023-10-06T02:26:55.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.222+0000 7feed2ffd700 1 -- 172.21.15.37:0/3597043015 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed80722a0 con 0x55d708684d90 2023-10-06T02:26:55.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.222+0000 7feef8780b80 1 -- 172.21.15.37:0/3597043015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d708684d90 msgr2=0x55d7086ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.222+0000 7feef8780b80 1 --2- 172.21.15.37:0/3597043015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d708684d90 0x55d7086ce1b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7feed80562e0 tx=0x7feed8031000 comp rx=0 tx=0).stop 2023-10-06T02:26:55.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.223+0000 7feef8780b80 1 -- 172.21.15.37:0/3597043015 shutdown_connections 2023-10-06T02:26:55.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.223+0000 7feef8780b80 1 --2- 172.21.15.37:0/3597043015 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d7086d3cd0 0x55d7086c1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.223+0000 7feef8780b80 1 --2- 172.21.15.37:0/3597043015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708683910 0x55d70867c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.223+0000 7feef8780b80 1 --2- 172.21.15.37:0/3597043015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d708684d90 0x55d7086ce1b0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.223+0000 7feef8780b80 1 -- 172.21.15.37:0/3597043015 >> 172.21.15.37:0/3597043015 conn(0x55d708685230 msgr2=0x55d7086c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.223+0000 7feef8780b80 1 -- 172.21.15.37:0/3597043015 shutdown_connections 2023-10-06T02:26:55.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.223+0000 7feef8780b80 1 -- 172.21.15.37:0/3597043015 wait complete. 2023-10-06T02:26:55.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.223+0000 7feef8780b80 1 -- start start 2023-10-06T02:26:55.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.223+0000 7feef8780b80 1 Processor -- start 2023-10-06T02:26:55.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.224+0000 7feef8780b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d708683910 0x55d7086d8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.224+0000 7feef8780b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708684d90 0x55d7086ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.224+0000 7feef8780b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7086d3cd0 0x55d7086cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.224+0000 7feef8780b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7086c3250 con 0x55d7086d3cd0 2023-10-06T02:26:55.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.224+0000 7feef8780b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7086c36b0 con 0x55d708684d90 2023-10-06T02:26:55.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.224+0000 7feef8780b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7086ce250 con 0x55d708683910 2023-10-06T02:26:55.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.224+0000 7feef8780b80 10 client.0 _ll_register_callbacks cb 0x55d708646f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:26:55.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.224+0000 7feeeda25700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7086d3cd0 0x55d7086cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.224+0000 7feeeda25700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7086d3cd0 0x55d7086cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39250/0 (socket says 172.21.15.37:39250) 2023-10-06T02:26:55.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.224+0000 7feeeda25700 1 -- 172.21.15.37:0/496508690 learned_addr learned my addr 172.21.15.37:0/496508690 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:55.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.224+0000 7feeed224700 1 --2- 172.21.15.37:0/496508690 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d708683910 0x55d7086d8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.224+0000 7feeeca23700 1 --2- 172.21.15.37:0/496508690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708684d90 0x55d7086ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feeeda25700 1 -- 172.21.15.37:0/496508690 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d708683910 msgr2=0x55d7086d8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feeeda25700 1 --2- 172.21.15.37:0/496508690 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d708683910 0x55d7086d8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feeeda25700 1 -- 172.21.15.37:0/496508690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708684d90 msgr2=0x55d7086ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feeeda25700 1 --2- 172.21.15.37:0/496508690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708684d90 0x55d7086ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feeeda25700 1 -- 172.21.15.37:0/496508690 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7084110b0 con 0x55d7086d3cd0 2023-10-06T02:26:55.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feeed224700 1 --2- 172.21.15.37:0/496508690 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d708683910 0x55d7086d8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:55.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feeeca23700 1 --2- 172.21.15.37:0/496508690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708684d90 0x55d7086ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:55.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feeeda25700 1 --2- 172.21.15.37:0/496508690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7086d3cd0 0x55d7086cd300 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7feee0000f80 tx=0x7feee0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2a9c52c65172a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feec77fe700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:26:55.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feec77fe700 1 -- 172.21.15.37:0/496508690 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee0024070 con 0x55d7086d3cd0 2023-10-06T02:26:55.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feec77fe700 1 -- 172.21.15.37:0/496508690 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x7feee00076f0 con 0x55d7086d3cd0 2023-10-06T02:26:55.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feef8780b80 1 -- 172.21.15.37:0/496508690 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d708576ed0 con 0x55d7086d3cd0 2023-10-06T02:26:55.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feec77fe700 1 -- 172.21.15.37:0/496508690 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7feee0004e90 con 0x55d7086d3cd0 2023-10-06T02:26:55.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feef8780b80 10 client.6252 fetch_fsmap learned FSMap version 37 2023-10-06T02:26:55.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feef8780b80 1 -- 172.21.15.37:0/496508690 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55d708589540 con 0x55d7086d3cd0 2023-10-06T02:26:55.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feec77fe700 1 -- 172.21.15.37:0/496508690 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d708576ed0 con 0x55d7086d3cd0 2023-10-06T02:26:55.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feec77fe700 1 -- 172.21.15.37:0/496508690 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7feee0027020 con 0x55d7086d3cd0 2023-10-06T02:26:55.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feef8780b80 10 client.6252 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T02:26:55.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feef8780b80 10 client.6252 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T02:26:55.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feef8780b80 20 client.6252 populate_metadata read hostname 'smithi037' 2023-10-06T02:26:55.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feef8780b80 1 --2- 172.21.15.37:0/496508690 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55d7086846d0 0x55d7086a8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feef8780b80 4 client.6252 mds_command: new command op to 6147 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2023-10-06T02:26:55.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feef8780b80 1 -- 172.21.15.37:0/496508690 --> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x55d708576bf0 con 0x55d7086846d0 2023-10-06T02:26:55.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.225+0000 7feeed224700 1 --2- 172.21.15.37:0/496508690 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55d7086846d0 0x55d7086a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.226+0000 7feeed224700 1 --2- 172.21.15.37:0/496508690 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55d7086846d0 0x55d7086a8840 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa9b6271f44e9e26 server_cookie=b5f0c76d4da975f8 in_seq=0 out_seq=0 2023-10-06T02:26:55.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.226+0000 7feec77fe700 10 client.6252 ms_handle_connect on v2:172.21.15.37:6833/2196855571 2023-10-06T02:26:55.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.227+0000 7feec77fe700 1 -- 172.21.15.37:0/496508690 <== mds.0 v2:172.21.15.37:6833/2196855571 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55d708576bf0 con 0x55d7086846d0 2023-10-06T02:26:55.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.227+0000 7feec77fe700 10 client.6252 handle_command_reply: tid=0 2023-10-06T02:26:55.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.227+0000 7feef8780b80 1 client.6252 shutdown 2023-10-06T02:26:55.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.227+0000 7feef8780b80 1 -- 172.21.15.37:0/496508690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7086d3cd0 msgr2=0x55d7086cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.227+0000 7feef8780b80 1 --2- 172.21.15.37:0/496508690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7086d3cd0 0x55d7086cd300 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7feee0000f80 tx=0x7feee0018000 comp rx=0 tx=0).stop 2023-10-06T02:26:55.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.227+0000 7feef8780b80 1 -- 172.21.15.37:0/496508690 shutdown_connections 2023-10-06T02:26:55.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.227+0000 7feef8780b80 1 --2- 172.21.15.37:0/496508690 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55d7086846d0 0x55d7086a8840 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.227+0000 7feef8780b80 1 --2- 172.21.15.37:0/496508690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7086d3cd0 0x55d7086cd300 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.227+0000 7feef8780b80 1 --2- 172.21.15.37:0/496508690 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d708683910 0x55d7086d8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.227+0000 7feef8780b80 1 --2- 172.21.15.37:0/496508690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d708684d90 0x55d7086ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.227+0000 7feef8780b80 1 -- 172.21.15.37:0/496508690 >> 172.21.15.37:0/496508690 conn(0x55d708685230 msgr2=0x55d7086c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.227+0000 7feec77fe700 0 client.6252 ms_handle_reset on v2:172.21.15.37:6833/2196855571 2023-10-06T02:26:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.227+0000 7feef8780b80 1 -- 172.21.15.37:0/496508690 shutdown_connections 2023-10-06T02:26:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.227+0000 7feef8780b80 1 -- 172.21.15.37:0/496508690 wait complete. 2023-10-06T02:26:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.227+0000 7feef8780b80 20 client.6252 trim_cache size 0 max 16384 2023-10-06T02:26:55.259 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:26:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2023-10-06T02:26:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "b4d9c711-fb72-4ae0-8a45-ec7d6b5e3b44", 2023-10-06T02:26:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2023-10-06T02:26:55.259 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:26:55.260 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-10-06T02:26:55.228+0000 7f708652b700 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2023-10-06T02:26:55.260 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-10-06T02:26:55.228+0000 7f708652b700 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2023-10-06T02:26:55.260 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-10-06T02:26:55.228+0000 7f708652b700 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2023-10-06T02:26:55.260 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-10-06T02:26:55.228+0000 7f708652b700 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2023-10-06T02:26:55.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.228+0000 7feeef488700 1 -- 172.21.15.37:0/301590349 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7feecc066f30 msgr2=0x7feecc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.228+0000 7feeef488700 1 --2- 172.21.15.37:0/301590349 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7feecc066f30 0x7feecc0693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7feee4007fd0 tx=0x7feee4007d50 comp rx=0 tx=0).stop 2023-10-06T02:26:55.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.228+0000 7feeef488700 1 -- 172.21.15.37:0/301590349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee8142f70 msgr2=0x7feee80c7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.228+0000 7feeef488700 1 --2- 172.21.15.37:0/301590349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee8142f70 0x7feee80c7510 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7feed8009f00 tx=0x7feed8017000 comp rx=0 tx=0).stop 2023-10-06T02:26:55.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.228+0000 7feeef488700 1 -- 172.21.15.37:0/301590349 shutdown_connections 2023-10-06T02:26:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.228+0000 7feeef488700 1 --2- 172.21.15.37:0/301590349 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feee8143340 0x7feee8158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.228+0000 7feeef488700 1 --2- 172.21.15.37:0/301590349 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7feecc066f30 0x7feecc0693e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.228+0000 7feeef488700 1 --2- 172.21.15.37:0/301590349 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feee8067ed0 0x7feee80c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.228+0000 7feeef488700 1 --2- 172.21.15.37:0/301590349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee8142f70 0x7feee80c7510 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.228+0000 7feeef488700 1 -- 172.21.15.37:0/301590349 >> 172.21.15.37:0/301590349 conn(0x7feee80ce360 msgr2=0x7feee80aeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.228+0000 7feeef488700 1 -- 172.21.15.37:0/301590349 shutdown_connections 2023-10-06T02:26:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.228+0000 7feeef488700 1 -- 172.21.15.37:0/301590349 wait complete. 2023-10-06T02:26:55.265 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-10-06T02:26:55.352 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-10-06T02:26:55.350+0000 7f7089d32700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:26:55.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.384+0000 7f9d344ea700 1 Processor -- start 2023-10-06T02:26:55.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.384+0000 7f9d344ea700 1 -- start start 2023-10-06T02:26:55.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.385+0000 7f9d344ea700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9d2c159500 0x7f9d2c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.385+0000 7f9d344ea700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9d2c0ca660 0x7f9d2c0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.385+0000 7f9d344ea700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2c0a9a60 con 0x7f9d2c1598d0 2023-10-06T02:26:55.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.385+0000 7f9d344ea700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d2c06b640 con 0x7f9d2c159500 2023-10-06T02:26:55.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.385+0000 7f9d344ea700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c0cb040 con 0x7f9d2c0ca660 2023-10-06T02:26:55.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d31a85700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9d2c1598d0 0x7f9d2c06a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51268/0 (socket says 172.21.15.37:51268) 2023-10-06T02:26:55.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d31a85700 1 -- 172.21.15.37:0/985489086 learned_addr learned my addr 172.21.15.37:0/985489086 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:26:55.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d32286700 1 --2- 172.21.15.37:0/985489086 >> v2:172.21.15.191:3300/0 conn(0x7f9d2c159500 0x7f9d2c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d32a87700 1 --2- 172.21.15.37:0/985489086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9d2c0ca660 0x7f9d2c0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d31284700 1 -- 172.21.15.37:0/985489086 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328148446 0 0) 0x7f9d2c0a9a60 con 0x7f9d2c1598d0 2023-10-06T02:26:55.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d31284700 1 -- 172.21.15.37:0/985489086 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d14003570 con 0x7f9d2c1598d0 2023-10-06T02:26:55.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d31284700 1 -- 172.21.15.37:0/985489086 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3958255339 0 0) 0x7f9d14003570 con 0x7f9d2c1598d0 2023-10-06T02:26:55.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d31284700 1 -- 172.21.15.37:0/985489086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9d2c0ca660 msgr2=0x7f9d2c0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d31284700 1 --2- 172.21.15.37:0/985489086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9d2c0ca660 0x7f9d2c0cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d31284700 1 -- 172.21.15.37:0/985489086 >> v2:172.21.15.191:3300/0 conn(0x7f9d2c159500 msgr2=0x7f9d2c06d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d31284700 1 --2- 172.21.15.37:0/985489086 >> v2:172.21.15.191:3300/0 conn(0x7f9d2c159500 0x7f9d2c06d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d31284700 1 -- 172.21.15.37:0/985489086 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2c06ada0 con 0x7f9d2c1598d0 2023-10-06T02:26:55.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d31284700 1 -- 172.21.15.37:0/985489086 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f9d20001470 con 0x7f9d2c1598d0 2023-10-06T02:26:55.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d32286700 1 --2- 172.21.15.37:0/985489086 >> v2:172.21.15.191:3300/0 conn(0x7f9d2c159500 0x7f9d2c06d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:26:55.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d31284700 1 -- 172.21.15.37:0/985489086 >> v1:172.21.15.37:6789/0 conn(0x7f9d2c1598d0 legacy=0x7f9d2c06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d31284700 1 --2- 172.21.15.37:0/985489086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d14003a90 0x7f9d14003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d31284700 1 --2- 172.21.15.37:0/985489086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d14004810 0x7f9d14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d31284700 1 --2- 172.21.15.37:0/985489086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9d2c0ca660 0x7f9d140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d31284700 1 -- 172.21.15.37:0/985489086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c06b640 con 0x7f9d14004810 2023-10-06T02:26:55.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d31284700 1 -- 172.21.15.37:0/985489086 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c0cb040 con 0x7f9d14003a90 2023-10-06T02:26:55.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d31284700 1 -- 172.21.15.37:0/985489086 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1400ba90 con 0x7f9d2c0ca660 2023-10-06T02:26:55.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d31a85700 1 --2- 172.21.15.37:0/985489086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d14004810 0x7f9d14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d32286700 1 --2- 172.21.15.37:0/985489086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d14003a90 0x7f9d14003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.386+0000 7f9d32a87700 1 --2- 172.21.15.37:0/985489086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9d2c0ca660 0x7f9d140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.387+0000 7f9d31a85700 1 -- 172.21.15.37:0/985489086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9d2c0ca660 msgr2=0x7f9d140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.387+0000 7f9d31a85700 1 --2- 172.21.15.37:0/985489086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9d2c0ca660 0x7f9d140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.387+0000 7f9d31a85700 1 -- 172.21.15.37:0/985489086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d14003a90 msgr2=0x7f9d14003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.387+0000 7f9d31a85700 1 --2- 172.21.15.37:0/985489086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d14003a90 0x7f9d14003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.387+0000 7f9d31a85700 1 -- 172.21.15.37:0/985489086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d14003570 con 0x7f9d14004810 2023-10-06T02:26:55.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.387+0000 7f9d31a85700 1 --2- 172.21.15.37:0/985489086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d14004810 0x7f9d14004c80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000c390 tx=0x7f9d20001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2dbfa57e4b47c28 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.387+0000 7f9d31284700 1 -- 172.21.15.37:0/985489086 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2000cc00 con 0x7f9d14004810 2023-10-06T02:26:55.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.387+0000 7f9d31284700 1 -- 172.21.15.37:0/985489086 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2000cd60 con 0x7f9d14004810 2023-10-06T02:26:55.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.387+0000 7f9d31284700 1 -- 172.21.15.37:0/985489086 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d20005b50 con 0x7f9d14004810 2023-10-06T02:26:55.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.387+0000 7f9d344ea700 1 -- 172.21.15.37:0/985489086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d14004810 msgr2=0x7f9d14004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.387+0000 7f9d344ea700 1 --2- 172.21.15.37:0/985489086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d14004810 0x7f9d14004c80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000c390 tx=0x7f9d20001e50 comp rx=0 tx=0).stop 2023-10-06T02:26:55.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.387+0000 7f9d32a87700 1 -- 172.21.15.37:0/985489086 reap_dead start 2023-10-06T02:26:55.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.388+0000 7f9d344ea700 1 -- 172.21.15.37:0/985489086 shutdown_connections 2023-10-06T02:26:55.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.388+0000 7f9d344ea700 1 -- 172.21.15.37:0/985489086 >> 172.21.15.37:0/985489086 conn(0x7f9d2c0c9410 msgr2=0x7f9d2c0c9810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.388+0000 7f9d344ea700 1 -- 172.21.15.37:0/985489086 shutdown_connections 2023-10-06T02:26:55.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.388+0000 7f9d344ea700 1 -- 172.21.15.37:0/985489086 wait complete. 2023-10-06T02:26:55.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.389+0000 7f9d344ea700 1 Processor -- start 2023-10-06T02:26:55.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.389+0000 7f9d344ea700 1 -- start start 2023-10-06T02:26:55.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.389+0000 7f9d344ea700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d14004810 0x7f9d2c158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.389+0000 7f9d344ea700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9d2c15b2c0 0x7f9d2c15bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.389+0000 7f9d344ea700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d2c0ad400 0x7f9d2c0ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.389+0000 7f9d344ea700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c0adde0 con 0x7f9d14004810 2023-10-06T02:26:55.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.389+0000 7f9d344ea700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c169f30 con 0x7f9d2c0ad400 2023-10-06T02:26:55.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.389+0000 7f9d344ea700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c15c190 con 0x7f9d2c15b2c0 2023-10-06T02:26:55.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.390+0000 7f9d32286700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d14004810 0x7f9d2c158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.390+0000 7f9d32286700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d14004810 0x7f9d2c158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57596/0 (socket says 172.21.15.37:57596) 2023-10-06T02:26:55.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.390+0000 7f9d32286700 1 -- 172.21.15.37:0/1124958503 learned_addr learned my addr 172.21.15.37:0/1124958503 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:55.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.390+0000 7f9d32a87700 1 --2- 172.21.15.37:0/1124958503 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d2c0ad400 0x7f9d2c0ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.390+0000 7f9d31a85700 1 --2- 172.21.15.37:0/1124958503 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9d2c15b2c0 0x7f9d2c15bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.390+0000 7f9d32286700 1 -- 172.21.15.37:0/1124958503 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9d2c15b2c0 msgr2=0x7f9d2c15bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.390+0000 7f9d32286700 1 --2- 172.21.15.37:0/1124958503 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9d2c15b2c0 0x7f9d2c15bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.390+0000 7f9d32286700 1 -- 172.21.15.37:0/1124958503 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d2c0ad400 msgr2=0x7f9d2c0ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.390+0000 7f9d32286700 1 --2- 172.21.15.37:0/1124958503 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d2c0ad400 0x7f9d2c0ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.390+0000 7f9d32286700 1 -- 172.21.15.37:0/1124958503 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2c15c430 con 0x7f9d14004810 2023-10-06T02:26:55.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.390+0000 7f9d32286700 1 --2- 172.21.15.37:0/1124958503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d14004810 0x7f9d2c158610 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9d24011d70 tx=0x7f9d240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.390+0000 7f9d2a7fc700 1 -- 172.21.15.37:0/1124958503 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24011e70 con 0x7f9d14004810 2023-10-06T02:26:55.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.390+0000 7f9d2a7fc700 1 -- 172.21.15.37:0/1124958503 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2400fba0 con 0x7f9d14004810 2023-10-06T02:26:55.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.390+0000 7f9d344ea700 1 -- 172.21.15.37:0/1124958503 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2c15c710 con 0x7f9d14004810 2023-10-06T02:26:55.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.390+0000 7f9d2a7fc700 1 -- 172.21.15.37:0/1124958503 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24014440 con 0x7f9d14004810 2023-10-06T02:26:55.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.390+0000 7f9d344ea700 1 -- 172.21.15.37:0/1124958503 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2c169b90 con 0x7f9d14004810 2023-10-06T02:26:55.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.392+0000 7f9d2a7fc700 1 -- 172.21.15.37:0/1124958503 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d24014830 con 0x7f9d14004810 2023-10-06T02:26:55.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.392+0000 7f9d2a7fc700 1 --2- 172.21.15.37:0/1124958503 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9d18066f30 0x7f9d180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.392+0000 7f9d2a7fc700 1 -- 172.21.15.37:0/1124958503 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f9d24018030 con 0x7f9d14004810 2023-10-06T02:26:55.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.392+0000 7f9d31a85700 1 --2- 172.21.15.37:0/1124958503 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9d18066f30 0x7f9d180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.393+0000 7f9d31a85700 1 --2- 172.21.15.37:0/1124958503 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9d18066f30 0x7f9d180693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9d20007cd0 tx=0x7f9d20015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.394+0000 7f9d3d7e2b80 1 Processor -- start 2023-10-06T02:26:55.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.394+0000 7f9d3d7e2b80 1 -- start start 2023-10-06T02:26:55.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.395+0000 7f9d3d7e2b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffcfc890 0x55b5ffcfcc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.395+0000 7f9d3d7e2b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfdd10 0x55b5ffd4c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.395+0000 7f9d3d7e2b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffd4cc50 0x55b5ffd4d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.395+0000 7f9d3d7e2b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ffc53ac0 con 0x55b5ffcfdd10 2023-10-06T02:26:55.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.395+0000 7f9d3d7e2b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ffc512c0 con 0x55b5ffd4cc50 2023-10-06T02:26:55.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.395+0000 7f9d3d7e2b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5ffc4d0b0 con 0x55b5ffcfc890 2023-10-06T02:26:55.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.395+0000 7f9d31a85700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfdd10 0x55b5ffd4c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.395+0000 7f9d31a85700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfdd10 0x55b5ffd4c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57598/0 (socket says 172.21.15.37:57598) 2023-10-06T02:26:55.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.395+0000 7f9d31a85700 1 -- 172.21.15.37:0/3191580967 learned_addr learned my addr 172.21.15.37:0/3191580967 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:55.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.395+0000 7f9d32286700 1 --2- 172.21.15.37:0/3191580967 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffcfc890 0x55b5ffcfcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.395+0000 7f9d32a87700 1 --2- 172.21.15.37:0/3191580967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffd4cc50 0x55b5ffd4d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.395+0000 7f9d31a85700 1 -- 172.21.15.37:0/3191580967 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffcfc890 msgr2=0x55b5ffcfcc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.395+0000 7f9d31a85700 1 --2- 172.21.15.37:0/3191580967 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffcfc890 0x55b5ffcfcc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.395+0000 7f9d31a85700 1 -- 172.21.15.37:0/3191580967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffd4cc50 msgr2=0x55b5ffd4d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.395+0000 7f9d31a85700 1 --2- 172.21.15.37:0/3191580967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffd4cc50 0x55b5ffd4d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.395+0000 7f9d31a85700 1 -- 172.21.15.37:0/3191580967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5ffae72c0 con 0x55b5ffcfdd10 2023-10-06T02:26:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.395+0000 7f9d31a85700 1 --2- 172.21.15.37:0/3191580967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfdd10 0x55b5ffd4c710 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000c980 tx=0x7f9d20021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb50377cb1bd80d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.395+0000 7f9d137fe700 1 -- 172.21.15.37:0/3191580967 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d20001710 con 0x55b5ffcfdd10 2023-10-06T02:26:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.396+0000 7f9d137fe700 1 -- 172.21.15.37:0/3191580967 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d20004c40 con 0x55b5ffcfdd10 2023-10-06T02:26:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.396+0000 7f9d137fe700 1 -- 172.21.15.37:0/3191580967 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d200070d0 con 0x55b5ffcfdd10 2023-10-06T02:26:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.396+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/3191580967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfdd10 msgr2=0x55b5ffd4c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.396+0000 7f9d3d7e2b80 1 --2- 172.21.15.37:0/3191580967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfdd10 0x55b5ffd4c710 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000c980 tx=0x7f9d20021040 comp rx=0 tx=0).stop 2023-10-06T02:26:55.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.396+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/3191580967 shutdown_connections 2023-10-06T02:26:55.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.396+0000 7f9d3d7e2b80 1 --2- 172.21.15.37:0/3191580967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffd4cc50 0x55b5ffd4d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.396+0000 7f9d3d7e2b80 1 --2- 172.21.15.37:0/3191580967 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffcfc890 0x55b5ffcfcc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.396+0000 7f9d3d7e2b80 1 --2- 172.21.15.37:0/3191580967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfdd10 0x55b5ffd4c710 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.396+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/3191580967 >> 172.21.15.37:0/3191580967 conn(0x55b5ffcfe1b0 msgr2=0x55b5ffcfe580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.396+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/3191580967 shutdown_connections 2023-10-06T02:26:55.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.396+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/3191580967 wait complete. 2023-10-06T02:26:55.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.397+0000 7f9d3d7e2b80 1 -- start start 2023-10-06T02:26:55.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.397+0000 7f9d3d7e2b80 1 Processor -- start 2023-10-06T02:26:55.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d3d7e2b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffcfc890 0x55b5ffcf93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d3d7e2b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffcfdd10 0x55b5ffcf9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d3d7e2b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffd4cc50 0x55b5ffd49e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d3d7e2b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ffbf88e0 con 0x55b5ffd4cc50 2023-10-06T02:26:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d3d7e2b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ffc13ef0 con 0x55b5ffcfdd10 2023-10-06T02:26:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d3d7e2b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5ffacfe80 con 0x55b5ffcfc890 2023-10-06T02:26:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d3d7e2b80 10 client.0 _ll_register_callbacks cb 0x55b5ffcbfec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:26:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d32a87700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffd4cc50 0x55b5ffd49e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d32a87700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffd4cc50 0x55b5ffd49e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57608/0 (socket says 172.21.15.37:57608) 2023-10-06T02:26:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d32a87700 1 -- 172.21.15.37:0/699043483 learned_addr learned my addr 172.21.15.37:0/699043483 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d32286700 1 --2- 172.21.15.37:0/699043483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffcfc890 0x55b5ffcf93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d31a85700 1 --2- 172.21.15.37:0/699043483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffcfdd10 0x55b5ffcf9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d32a87700 1 -- 172.21.15.37:0/699043483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffcfc890 msgr2=0x55b5ffcf93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d32a87700 1 --2- 172.21.15.37:0/699043483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffcfc890 0x55b5ffcf93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d32a87700 1 -- 172.21.15.37:0/699043483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffcfdd10 msgr2=0x55b5ffcf9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d32a87700 1 --2- 172.21.15.37:0/699043483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffcfdd10 0x55b5ffcf9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d32a87700 1 -- 172.21.15.37:0/699043483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d14003570 con 0x55b5ffd4cc50 2023-10-06T02:26:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d32286700 1 --2- 172.21.15.37:0/699043483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffcfc890 0x55b5ffcf93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d31a85700 1 --2- 172.21.15.37:0/699043483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffcfdd10 0x55b5ffcf9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d32a87700 1 --2- 172.21.15.37:0/699043483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffd4cc50 0x55b5ffd49e40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009350 tx=0x7f9d1c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd83211881da7de0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.398+0000 7f9d10ff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:26:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.399+0000 7f9d10ff9700 1 -- 172.21.15.37:0/699043483 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c00e040 con 0x55b5ffd4cc50 2023-10-06T02:26:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.399+0000 7f9d10ff9700 1 -- 172.21.15.37:0/699043483 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f9d1c021d30 con 0x55b5ffd4cc50 2023-10-06T02:26:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.399+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/699043483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b5ffcf1990 con 0x55b5ffd4cc50 2023-10-06T02:26:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.399+0000 7f9d10ff9700 1 -- 172.21.15.37:0/699043483 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d1c015ec0 con 0x55b5ffd4cc50 2023-10-06T02:26:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.399+0000 7f9d3d7e2b80 10 client.6264 fetch_fsmap learned FSMap version 37 2023-10-06T02:26:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.399+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/699043483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55b5ffa8a030 con 0x55b5ffd4cc50 2023-10-06T02:26:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.399+0000 7f9d10ff9700 1 -- 172.21.15.37:0/699043483 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b5ffcf1990 con 0x55b5ffd4cc50 2023-10-06T02:26:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.399+0000 7f9d10ff9700 1 -- 172.21.15.37:0/699043483 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9d1c01f5f0 con 0x55b5ffd4cc50 2023-10-06T02:26:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.399+0000 7f9d3d7e2b80 10 client.6264 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T02:26:55.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.399+0000 7f9d3d7e2b80 10 client.6264 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T02:26:55.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.399+0000 7f9d3d7e2b80 20 client.6264 populate_metadata read hostname 'smithi037' 2023-10-06T02:26:55.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.399+0000 7f9d3d7e2b80 1 --2- 172.21.15.37:0/699043483 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55b5ffd25de0 0x55b5ffd3ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.399+0000 7f9d3d7e2b80 4 client.6264 mds_command: new command op to 6147 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:26:55.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.399+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/699043483 --> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b5ffcce8c0 con 0x55b5ffd25de0 2023-10-06T02:26:55.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.399+0000 7f9d32286700 1 --2- 172.21.15.37:0/699043483 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55b5ffd25de0 0x55b5ffd3ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.399+0000 7f9d10ff9700 10 client.6264 ms_handle_connect on v2:172.21.15.37:6833/2196855571 2023-10-06T02:26:55.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.399+0000 7f9d32286700 1 --2- 172.21.15.37:0/699043483 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55b5ffd25de0 0x55b5ffd3ccb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f022ca27b7846e5f server_cookie=f67f7f13fee5c6c3 in_seq=0 out_seq=0 2023-10-06T02:26:55.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.400+0000 7f9d10ff9700 1 -- 172.21.15.37:0/699043483 <== mds.0 v2:172.21.15.37:6833/2196855571 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55b5ffcce8c0 con 0x55b5ffd25de0 2023-10-06T02:26:55.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.400+0000 7f9d10ff9700 10 client.6264 handle_command_reply: tid=0 2023-10-06T02:26:55.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.400+0000 7f9d3d7e2b80 1 client.6264 shutdown 2023-10-06T02:26:55.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.400+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/699043483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffd4cc50 msgr2=0x55b5ffd49e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.400+0000 7f9d3d7e2b80 1 --2- 172.21.15.37:0/699043483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffd4cc50 0x55b5ffd49e40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009350 tx=0x7f9d1c00b040 comp rx=0 tx=0).stop 2023-10-06T02:26:55.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.400+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/699043483 shutdown_connections 2023-10-06T02:26:55.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.400+0000 7f9d3d7e2b80 1 --2- 172.21.15.37:0/699043483 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55b5ffd25de0 0x55b5ffd3ccb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.400+0000 7f9d3d7e2b80 1 --2- 172.21.15.37:0/699043483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffd4cc50 0x55b5ffd49e40 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.400+0000 7f9d3d7e2b80 1 --2- 172.21.15.37:0/699043483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffcfc890 0x55b5ffcf93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.400+0000 7f9d3d7e2b80 1 --2- 172.21.15.37:0/699043483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffcfdd10 0x55b5ffcf9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.400+0000 7f9d10ff9700 0 client.6264 ms_handle_reset on v2:172.21.15.37:6833/2196855571 2023-10-06T02:26:55.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.400+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/699043483 >> 172.21.15.37:0/699043483 conn(0x55b5ffcfe1b0 msgr2=0x55b5ffcfd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.400+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/699043483 shutdown_connections 2023-10-06T02:26:55.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.400+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/699043483 wait complete. 2023-10-06T02:26:55.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.401+0000 7f9d3d7e2b80 20 client.6264 trim_cache size 0 max 16384 2023-10-06T02:26:55.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.417+0000 7f9d3d7e2b80 1 Processor -- start 2023-10-06T02:26:55.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.417+0000 7f9d3d7e2b80 1 -- start start 2023-10-06T02:26:55.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.417+0000 7f9d3d7e2b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfc890 0x55b5ffd5c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.417+0000 7f9d3d7e2b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffcfdd10 0x55b5ffd5cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.417+0000 7f9d3d7e2b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffd4cc50 0x55b5ffd45330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.417+0000 7f9d3d7e2b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ffcf1700 con 0x55b5ffcfc890 2023-10-06T02:26:55.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.417+0000 7f9d3d7e2b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ffcfee80 con 0x55b5ffd4cc50 2023-10-06T02:26:55.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.417+0000 7f9d3d7e2b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5ffcdc330 con 0x55b5ffcfdd10 2023-10-06T02:26:55.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.418+0000 7f9d32286700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfc890 0x55b5ffd5c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.418+0000 7f9d32286700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfc890 0x55b5ffd5c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57622/0 (socket says 172.21.15.37:57622) 2023-10-06T02:26:55.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.418+0000 7f9d32286700 1 -- 172.21.15.37:0/955518375 learned_addr learned my addr 172.21.15.37:0/955518375 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:55.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.418+0000 7f9d32a87700 1 --2- 172.21.15.37:0/955518375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffd4cc50 0x55b5ffd45330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.418+0000 7f9d31a85700 1 --2- 172.21.15.37:0/955518375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffcfdd10 0x55b5ffd5cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.418+0000 7f9d32286700 1 -- 172.21.15.37:0/955518375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffcfdd10 msgr2=0x55b5ffd5cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.418+0000 7f9d32286700 1 --2- 172.21.15.37:0/955518375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffcfdd10 0x55b5ffd5cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.418+0000 7f9d32286700 1 -- 172.21.15.37:0/955518375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffd4cc50 msgr2=0x55b5ffd45330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.418+0000 7f9d32286700 1 --2- 172.21.15.37:0/955518375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffd4cc50 0x55b5ffd45330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.418+0000 7f9d32286700 1 -- 172.21.15.37:0/955518375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5ffd2cf40 con 0x55b5ffcfc890 2023-10-06T02:26:55.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.418+0000 7f9d31a85700 1 --2- 172.21.15.37:0/955518375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffcfdd10 0x55b5ffd5cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:26:55.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.418+0000 7f9d32286700 1 --2- 172.21.15.37:0/955518375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfc890 0x55b5ffd5c820 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9d2400f800 tx=0x7f9d2405b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e7902053b2b034 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.418+0000 7f9d13fff700 1 -- 172.21.15.37:0/955518375 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24055b30 con 0x55b5ffcfc890 2023-10-06T02:26:55.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.418+0000 7f9d13fff700 1 -- 172.21.15.37:0/955518375 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d240850d0 con 0x55b5ffcfc890 2023-10-06T02:26:55.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.418+0000 7f9d13fff700 1 -- 172.21.15.37:0/955518375 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24059240 con 0x55b5ffcfc890 2023-10-06T02:26:55.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.419+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/955518375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfc890 msgr2=0x55b5ffd5c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.419+0000 7f9d3d7e2b80 1 --2- 172.21.15.37:0/955518375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfc890 0x55b5ffd5c820 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9d2400f800 tx=0x7f9d2405b040 comp rx=0 tx=0).stop 2023-10-06T02:26:55.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.419+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/955518375 shutdown_connections 2023-10-06T02:26:55.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.419+0000 7f9d3d7e2b80 1 --2- 172.21.15.37:0/955518375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffd4cc50 0x55b5ffd45330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.419+0000 7f9d3d7e2b80 1 --2- 172.21.15.37:0/955518375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfc890 0x55b5ffd5c820 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.419+0000 7f9d3d7e2b80 1 --2- 172.21.15.37:0/955518375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffcfdd10 0x55b5ffd5cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.419+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/955518375 >> 172.21.15.37:0/955518375 conn(0x55b5ffcfe1b0 msgr2=0x55b5ffcfd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.419+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/955518375 shutdown_connections 2023-10-06T02:26:55.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.419+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/955518375 wait complete. 2023-10-06T02:26:55.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.419+0000 7f9d3d7e2b80 1 -- start start 2023-10-06T02:26:55.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.419+0000 7f9d3d7e2b80 1 Processor -- start 2023-10-06T02:26:55.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.420+0000 7f9d3d7e2b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfc890 0x55b5ffd92590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.420+0000 7f9d3d7e2b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffcfdd10 0x55b5ffd5c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.420+0000 7f9d3d7e2b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffd4cc50 0x55b5ffd5cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.420+0000 7f9d3d7e2b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ffd92ad0 con 0x55b5ffcfc890 2023-10-06T02:26:55.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.420+0000 7f9d3d7e2b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ffd51260 con 0x55b5ffcfdd10 2023-10-06T02:26:55.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.420+0000 7f9d3d7e2b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5ffd24800 con 0x55b5ffd4cc50 2023-10-06T02:26:55.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.420+0000 7f9d3d7e2b80 10 client.0 _ll_register_callbacks cb 0x55b5ffcbfec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:26:55.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.420+0000 7f9d32286700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfc890 0x55b5ffd92590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.420+0000 7f9d32286700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfc890 0x55b5ffd92590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57636/0 (socket says 172.21.15.37:57636) 2023-10-06T02:26:55.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.420+0000 7f9d32286700 1 -- 172.21.15.37:0/57284282 learned_addr learned my addr 172.21.15.37:0/57284282 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:26:55.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.420+0000 7f9d32a87700 1 --2- 172.21.15.37:0/57284282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffd4cc50 0x55b5ffd5cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.420+0000 7f9d31a85700 1 --2- 172.21.15.37:0/57284282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffcfdd10 0x55b5ffd5c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d32286700 1 -- 172.21.15.37:0/57284282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffd4cc50 msgr2=0x55b5ffd5cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d32286700 1 --2- 172.21.15.37:0/57284282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffd4cc50 0x55b5ffd5cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d32286700 1 -- 172.21.15.37:0/57284282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffcfdd10 msgr2=0x55b5ffd5c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:26:55.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d32286700 1 --2- 172.21.15.37:0/57284282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffcfdd10 0x55b5ffd5c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d32286700 1 -- 172.21.15.37:0/57284282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2c169b90 con 0x55b5ffcfc890 2023-10-06T02:26:55.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d31a85700 1 --2- 172.21.15.37:0/57284282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffcfdd10 0x55b5ffd5c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:26:55.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d32286700 1 --2- 172.21.15.37:0/57284282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfc890 0x55b5ffd92590 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9d24054340 tx=0x7f9d24085000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf51f2b5bce61c0c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:26:55.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d10ff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:26:55.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d10ff9700 1 -- 172.21.15.37:0/57284282 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24059240 con 0x55b5ffcfc890 2023-10-06T02:26:55.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d10ff9700 1 -- 172.21.15.37:0/57284282 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f9d240832c0 con 0x55b5ffcfc890 2023-10-06T02:26:55.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/57284282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9d20004c40 con 0x55b5ffcfc890 2023-10-06T02:26:55.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d10ff9700 1 -- 172.21.15.37:0/57284282 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d24054390 con 0x55b5ffcfc890 2023-10-06T02:26:55.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d3d7e2b80 10 client.6270 fetch_fsmap learned FSMap version 37 2023-10-06T02:26:55.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/57284282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55b5ffc1b7d0 con 0x55b5ffcfc890 2023-10-06T02:26:55.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d10ff9700 1 -- 172.21.15.37:0/57284282 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d24070080 con 0x55b5ffcfc890 2023-10-06T02:26:55.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d10ff9700 1 -- 172.21.15.37:0/57284282 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9d2406c1d0 con 0x55b5ffcfc890 2023-10-06T02:26:55.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d3d7e2b80 10 client.6270 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T02:26:55.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d3d7e2b80 10 client.6270 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T02:26:55.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d3d7e2b80 20 client.6270 populate_metadata read hostname 'smithi037' 2023-10-06T02:26:55.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d3d7e2b80 1 --2- 172.21.15.37:0/57284282 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55b5ffcfd380 0x55b5ffdacbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:26:55.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d3d7e2b80 4 client.6270 mds_command: new command op to 6147 tid=0[{"prefix": "scrub status"}] 2023-10-06T02:26:55.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/57284282 --> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b5ffbefe50 con 0x55b5ffcfd380 2023-10-06T02:26:55.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.421+0000 7f9d31a85700 1 --2- 172.21.15.37:0/57284282 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55b5ffcfd380 0x55b5ffdacbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:26:55.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.422+0000 7f9d10ff9700 10 client.6270 ms_handle_connect on v2:172.21.15.37:6833/2196855571 2023-10-06T02:26:55.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.422+0000 7f9d31a85700 1 --2- 172.21.15.37:0/57284282 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55b5ffcfd380 0x55b5ffdacbb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44bc5cbfc1ea1af5 server_cookie=c0f3b510fc1d1ead in_seq=0 out_seq=0 2023-10-06T02:26:55.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.422+0000 7f9d10ff9700 1 -- 172.21.15.37:0/57284282 <== mds.0 v2:172.21.15.37:6833/2196855571 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x55b5ffbefe50 con 0x55b5ffcfd380 2023-10-06T02:26:55.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.422+0000 7f9d10ff9700 10 client.6270 handle_command_reply: tid=0 2023-10-06T02:26:55.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.422+0000 7f9d3d7e2b80 1 client.6270 shutdown 2023-10-06T02:26:55.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.422+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/57284282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfc890 msgr2=0x55b5ffd92590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.422+0000 7f9d3d7e2b80 1 --2- 172.21.15.37:0/57284282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfc890 0x55b5ffd92590 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9d24054340 tx=0x7f9d24085000 comp rx=0 tx=0).stop 2023-10-06T02:26:55.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.422+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/57284282 shutdown_connections 2023-10-06T02:26:55.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.422+0000 7f9d3d7e2b80 1 --2- 172.21.15.37:0/57284282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b5ffd4cc50 0x55b5ffd5cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.422+0000 7f9d3d7e2b80 1 --2- 172.21.15.37:0/57284282 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x55b5ffcfd380 0x55b5ffdacbb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.422+0000 7f9d3d7e2b80 1 --2- 172.21.15.37:0/57284282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5ffcfc890 0x55b5ffd92590 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.422+0000 7f9d3d7e2b80 1 --2- 172.21.15.37:0/57284282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5ffcfdd10 0x55b5ffd5c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.422+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/57284282 >> 172.21.15.37:0/57284282 conn(0x55b5ffcfe1b0 msgr2=0x55b5ffcfe580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.422+0000 7f9d10ff9700 0 client.6270 ms_handle_reset on v2:172.21.15.37:6833/2196855571 2023-10-06T02:26:55.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.422+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/57284282 shutdown_connections 2023-10-06T02:26:55.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.422+0000 7f9d3d7e2b80 1 -- 172.21.15.37:0/57284282 wait complete. 2023-10-06T02:26:55.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.422+0000 7f9d3d7e2b80 20 client.6270 trim_cache size 0 max 16384 2023-10-06T02:26:55.436 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:26:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T02:26:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2023-10-06T02:26:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "b4d9c711-fb72-4ae0-8a45-ec7d6b5e3b44": { 2023-10-06T02:26:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2023-10-06T02:26:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "b4d9c711-fb72-4ae0-8a45-ec7d6b5e3b44", 2023-10-06T02:26:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,repair" 2023-10-06T02:26:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:26:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:26:55.438 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:26:55.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.423+0000 7f9d344ea700 1 -- 172.21.15.37:0/1124958503 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9d18066f30 msgr2=0x7f9d180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.423+0000 7f9d344ea700 1 --2- 172.21.15.37:0/1124958503 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9d18066f30 0x7f9d180693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9d20007cd0 tx=0x7f9d20015000 comp rx=0 tx=0).stop 2023-10-06T02:26:55.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.423+0000 7f9d344ea700 1 -- 172.21.15.37:0/1124958503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d14004810 msgr2=0x7f9d2c158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:26:55.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.423+0000 7f9d344ea700 1 --2- 172.21.15.37:0/1124958503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d14004810 0x7f9d2c158610 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9d24011d70 tx=0x7f9d240091a0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.423+0000 7f9d344ea700 1 -- 172.21.15.37:0/1124958503 shutdown_connections 2023-10-06T02:26:55.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.423+0000 7f9d344ea700 1 --2- 172.21.15.37:0/1124958503 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9d18066f30 0x7f9d180693e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.423+0000 7f9d344ea700 1 --2- 172.21.15.37:0/1124958503 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d2c0ad400 0x7f9d2c0ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.423+0000 7f9d344ea700 1 --2- 172.21.15.37:0/1124958503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d14004810 0x7f9d2c158610 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.423+0000 7f9d344ea700 1 --2- 172.21.15.37:0/1124958503 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9d2c15b2c0 0x7f9d2c15bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:26:55.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.423+0000 7f9d344ea700 1 -- 172.21.15.37:0/1124958503 >> 172.21.15.37:0/1124958503 conn(0x7f9d2c0c9410 msgr2=0x7f9d2c0c1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:26:55.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.423+0000 7f9d344ea700 1 -- 172.21.15.37:0/1124958503 shutdown_connections 2023-10-06T02:26:55.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:55.423+0000 7f9d344ea700 1 -- 172.21.15.37:0/1124958503 wait complete. 2023-10-06T02:26:55.441 INFO:tasks.cephfs.filesystem:scrub status for tag:b4d9c711-fb72-4ae0-8a45-ec7d6b5e3b44 - {'path': '/', 'tag': 'b4d9c711-fb72-4ae0-8a45-ec7d6b5e3b44', 'options': 'recursive,repair'} 2023-10-06T02:26:56.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:26:56.363+0000 7f44c1ffb700 1 -- 172.21.15.37:0/2594868680 <== mon.0 v2:172.21.15.37:3300/0 8 ==== log(8 entries from seq 1 at 2023-10-06T02:26:55.227962+0000) v1 ==== 1407+0+0 (secure 0 0 0) 0x7f44bc0547a0 con 0x7f44cc159620 2023-10-06T02:26:56.388 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:26:55.227962+0000 mds.c [INF] scrub queued for path: / 2023-10-06T02:26:56.388 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:26:55.227968+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2023-10-06T02:26:56.389 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:26:55.227975+0000 mds.c [INF] scrub summary: active paths [/] 2023-10-06T02:26:56.389 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:26:55.229524+0000 mds.c [ERR] scrub: inode wrongly marked free: 0x10000000002 2023-10-06T02:26:56.389 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:26:55.229532+0000 mds.c [ERR] inode table repaired for inode: 0x10000000002 2023-10-06T02:26:56.389 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:26:55.229603+0000 mds.c [ERR] scrub: inode wrongly marked free: 0x10000000001 2023-10-06T02:26:56.389 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:26:55.229609+0000 mds.c [ERR] inode table repaired for inode: 0x10000000001 2023-10-06T02:26:56.389 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:26:55.229647+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2023-10-06T02:27:00.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:00.662+0000 7f44c1ffb700 1 -- 172.21.15.37:0/2594868680 <== mon.0 v2:172.21.15.37:3300/0 9 ==== log(1 entries from seq 9 at 2023-10-06T02:26:59.380534+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7f44bc0528e0 con 0x7f44cc159620 2023-10-06T02:27:00.662 INFO:teuthology.orchestra.run.smithi037.stdout:2023-10-06T02:26:59.380534+0000 mds.c [INF] scrub summary: idle 2023-10-06T02:27:21.868 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:27:21.871 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:27:25.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-10-06T02:27:25.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.575+0000 7f0665981700 1 Processor -- start 2023-10-06T02:27:25.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.575+0000 7f0665981700 1 -- start start 2023-10-06T02:27:25.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.576+0000 7f0665981700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06600b2a90 0x7f0660159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.576+0000 7f0665981700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f06600ccb30 0x7f06600ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.576+0000 7f0665981700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06600b07a0 con 0x7f06601593c0 2023-10-06T02:27:25.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.576+0000 7f0665981700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06600cd8a0 con 0x7f06600b2a90 2023-10-06T02:27:25.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.576+0000 7f0665981700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06600afe70 con 0x7f06600ccb30 2023-10-06T02:27:25.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.576+0000 7f065e7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06600b2a90 0x7f0660159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.576+0000 7f065e7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06600b2a90 0x7f0660159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34694/0 (socket says 172.21.15.37:34694) 2023-10-06T02:27:25.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.576+0000 7f065e7fc700 1 -- 172.21.15.37:0/610032474 learned_addr learned my addr 172.21.15.37:0/610032474 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:25.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.576+0000 7f065f7fe700 1 --2- 172.21.15.37:0/610032474 >> v2:172.21.15.191:3300/0 conn(0x7f06600ccb30 0x7f06600ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.576+0000 7f065e7fc700 1 -- 172.21.15.37:0/610032474 >> v2:172.21.15.191:3300/0 conn(0x7f06600ccb30 msgr2=0x7f06600ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:25.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.576+0000 7f065e7fc700 1 --2- 172.21.15.37:0/610032474 >> v2:172.21.15.191:3300/0 conn(0x7f06600ccb30 0x7f06600ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.576+0000 7f065e7fc700 1 -- 172.21.15.37:0/610032474 >> v1:172.21.15.191:6789/0 conn(0x7f06601593c0 legacy=0x7f06600b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.576+0000 7f065e7fc700 1 -- 172.21.15.37:0/610032474 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06600b0150 con 0x7f06600b2a90 2023-10-06T02:27:25.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.576+0000 7f065e7fc700 1 --2- 172.21.15.37:0/610032474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06600b2a90 0x7f0660159790 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f06600c74a0 tx=0x7f0648009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a75298d5a44045 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.577+0000 7f065dffb700 1 -- 172.21.15.37:0/610032474 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064800b860 con 0x7f06600b2a90 2023-10-06T02:27:25.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.577+0000 7f065dffb700 1 -- 172.21.15.37:0/610032474 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064800b9c0 con 0x7f06600b2a90 2023-10-06T02:27:25.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.577+0000 7f065dffb700 1 -- 172.21.15.37:0/610032474 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064800bd60 con 0x7f06600b2a90 2023-10-06T02:27:25.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.577+0000 7f0665981700 1 -- 172.21.15.37:0/610032474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06600b2a90 msgr2=0x7f0660159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.577+0000 7f0665981700 1 --2- 172.21.15.37:0/610032474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06600b2a90 0x7f0660159790 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f06600c74a0 tx=0x7f0648009250 comp rx=0 tx=0).stop 2023-10-06T02:27:25.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.577+0000 7f0665981700 1 -- 172.21.15.37:0/610032474 shutdown_connections 2023-10-06T02:27:25.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.577+0000 7f0665981700 1 --2- 172.21.15.37:0/610032474 >> v2:172.21.15.191:3300/0 conn(0x7f06600ccb30 0x7f06600ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.577+0000 7f0665981700 1 --2- 172.21.15.37:0/610032474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06600b2a90 0x7f0660159790 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.577+0000 7f0665981700 1 -- 172.21.15.37:0/610032474 >> 172.21.15.37:0/610032474 conn(0x7f066006c0b0 msgr2=0x7f066006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:25.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.577+0000 7f0665981700 1 -- 172.21.15.37:0/610032474 shutdown_connections 2023-10-06T02:27:25.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.577+0000 7f0665981700 1 -- 172.21.15.37:0/610032474 wait complete. 2023-10-06T02:27:25.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.579+0000 7f0665981700 1 Processor -- start 2023-10-06T02:27:25.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.579+0000 7f0665981700 1 -- start start 2023-10-06T02:27:25.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.579+0000 7f0665981700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06600b2a90 0x7f066016ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.579+0000 7f0665981700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06600ccb30 0x7f0660169d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.579+0000 7f0665981700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06601593c0 0x7f06600c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.579+0000 7f0665981700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06600c7760 con 0x7f06600ccb30 2023-10-06T02:27:25.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.579+0000 7f0665981700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06600c99e0 con 0x7f06601593c0 2023-10-06T02:27:25.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.579+0000 7f0665981700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06600c8ec0 con 0x7f06600b2a90 2023-10-06T02:27:25.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.580+0000 7f065e7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06600ccb30 0x7f0660169d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.580+0000 7f065e7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06600ccb30 0x7f0660169d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34704/0 (socket says 172.21.15.37:34704) 2023-10-06T02:27:25.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.580+0000 7f065e7fc700 1 -- 172.21.15.37:0/3243022457 learned_addr learned my addr 172.21.15.37:0/3243022457 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:25.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.580+0000 7f065f7fe700 1 --2- 172.21.15.37:0/3243022457 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06601593c0 0x7f06600c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.580+0000 7f065effd700 1 --2- 172.21.15.37:0/3243022457 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06600b2a90 0x7f066016ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.580+0000 7f065e7fc700 1 -- 172.21.15.37:0/3243022457 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06600b2a90 msgr2=0x7f066016ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.580+0000 7f065e7fc700 1 --2- 172.21.15.37:0/3243022457 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06600b2a90 0x7f066016ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.580+0000 7f065e7fc700 1 -- 172.21.15.37:0/3243022457 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06601593c0 msgr2=0x7f06600c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.580+0000 7f065e7fc700 1 --2- 172.21.15.37:0/3243022457 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06601593c0 0x7f06600c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.580+0000 7f065e7fc700 1 -- 172.21.15.37:0/3243022457 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06480094f0 con 0x7f06600ccb30 2023-10-06T02:27:25.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.580+0000 7f065effd700 1 --2- 172.21.15.37:0/3243022457 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06600b2a90 0x7f066016ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:25.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.580+0000 7f065e7fc700 1 --2- 172.21.15.37:0/3243022457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06600ccb30 0x7f0660169d90 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0648006fd0 tx=0x7f0648017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.580+0000 7f0656ffd700 1 -- 172.21.15.37:0/3243022457 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648024440 con 0x7f06600ccb30 2023-10-06T02:27:25.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.580+0000 7f0656ffd700 1 -- 172.21.15.37:0/3243022457 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06480245a0 con 0x7f06600ccb30 2023-10-06T02:27:25.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.580+0000 7f0665981700 1 -- 172.21.15.37:0/3243022457 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06600c9140 con 0x7f06600ccb30 2023-10-06T02:27:25.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.580+0000 7f0656ffd700 1 -- 172.21.15.37:0/3243022457 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648024960 con 0x7f06600ccb30 2023-10-06T02:27:25.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.580+0000 7f0665981700 1 -- 172.21.15.37:0/3243022457 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06600c9700 con 0x7f06600ccb30 2023-10-06T02:27:25.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.582+0000 7f0656ffd700 1 -- 172.21.15.37:0/3243022457 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f064801a420 con 0x7f06600ccb30 2023-10-06T02:27:25.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.582+0000 7f0656ffd700 1 --2- 172.21.15.37:0/3243022457 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0640066f60 0x7f0640069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.582+0000 7f0656ffd700 1 -- 172.21.15.37:0/3243022457 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f0648086640 con 0x7f06600ccb30 2023-10-06T02:27:25.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.582+0000 7f065effd700 1 --2- 172.21.15.37:0/3243022457 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0640066f60 0x7f0640069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.583+0000 7f065effd700 1 --2- 172.21.15.37:0/3243022457 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0640066f60 0x7f0640069410 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0650007fd0 tx=0x7f0650009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.584+0000 7f066ec79b80 1 Processor -- start 2023-10-06T02:27:25.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.584+0000 7f066ec79b80 1 -- start start 2023-10-06T02:27:25.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.585+0000 7f066ec79b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 0x562cce4dfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.585+0000 7f066ec79b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562cce4e0d10 0x562cce52f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.585+0000 7f066ec79b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce52fc50 0x562cce5300a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.585+0000 7f066ec79b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cce436ac0 con 0x562cce4df890 2023-10-06T02:27:25.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.585+0000 7f066ec79b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cce4342c0 con 0x562cce52fc50 2023-10-06T02:27:25.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.585+0000 7f066ec79b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x562cce4300b0 con 0x562cce4e0d10 2023-10-06T02:27:25.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.585+0000 7f065effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 0x562cce4dfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.585+0000 7f065effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 0x562cce4dfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34712/0 (socket says 172.21.15.37:34712) 2023-10-06T02:27:25.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.585+0000 7f065effd700 1 -- 172.21.15.37:0/602464067 learned_addr learned my addr 172.21.15.37:0/602464067 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:25.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.585+0000 7f065e7fc700 1 --2- 172.21.15.37:0/602464067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562cce4e0d10 0x562cce52f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.585+0000 7f065f7fe700 1 --2- 172.21.15.37:0/602464067 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce52fc50 0x562cce5300a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.585+0000 7f065effd700 1 -- 172.21.15.37:0/602464067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562cce4e0d10 msgr2=0x562cce52f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:25.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.585+0000 7f065effd700 1 --2- 172.21.15.37:0/602464067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562cce4e0d10 0x562cce52f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.585+0000 7f065effd700 1 -- 172.21.15.37:0/602464067 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce52fc50 msgr2=0x562cce5300a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:25.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.585+0000 7f065effd700 1 --2- 172.21.15.37:0/602464067 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce52fc50 0x562cce5300a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.585+0000 7f065effd700 1 -- 172.21.15.37:0/602464067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562cce2ca2c0 con 0x562cce4df890 2023-10-06T02:27:25.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.585+0000 7f065effd700 1 --2- 172.21.15.37:0/602464067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 0x562cce4dfc60 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f065000ee50 tx=0x7f0650014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f490ab28b99b37 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.586+0000 7f063ffff700 1 -- 172.21.15.37:0/602464067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06500017c0 con 0x562cce4df890 2023-10-06T02:27:25.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.586+0000 7f063ffff700 1 -- 172.21.15.37:0/602464067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0650013e50 con 0x562cce4df890 2023-10-06T02:27:25.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.586+0000 7f063ffff700 1 -- 172.21.15.37:0/602464067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065001f620 con 0x562cce4df890 2023-10-06T02:27:25.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.586+0000 7f066ec79b80 1 -- 172.21.15.37:0/602464067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 msgr2=0x562cce4dfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.586+0000 7f066ec79b80 1 --2- 172.21.15.37:0/602464067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 0x562cce4dfc60 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f065000ee50 tx=0x7f0650014000 comp rx=0 tx=0).stop 2023-10-06T02:27:25.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.586+0000 7f066ec79b80 1 -- 172.21.15.37:0/602464067 shutdown_connections 2023-10-06T02:27:25.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.586+0000 7f066ec79b80 1 --2- 172.21.15.37:0/602464067 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce52fc50 0x562cce5300a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.586+0000 7f066ec79b80 1 --2- 172.21.15.37:0/602464067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 0x562cce4dfc60 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.586+0000 7f066ec79b80 1 --2- 172.21.15.37:0/602464067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562cce4e0d10 0x562cce52f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.586+0000 7f066ec79b80 1 -- 172.21.15.37:0/602464067 >> 172.21.15.37:0/602464067 conn(0x562cce4e11b0 msgr2=0x562cce4e1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:25.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.586+0000 7f066ec79b80 1 -- 172.21.15.37:0/602464067 shutdown_connections 2023-10-06T02:27:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.587+0000 7f066ec79b80 1 -- 172.21.15.37:0/602464067 wait complete. 2023-10-06T02:27:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.587+0000 7f066ec79b80 1 -- start start 2023-10-06T02:27:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.587+0000 7f066ec79b80 1 Processor -- start 2023-10-06T02:27:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.588+0000 7f066ec79b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 0x562cce539f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.588+0000 7f066ec79b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce4e0d10 0x562cce5052f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.588+0000 7f066ec79b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562cce52fc50 0x562cce539360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.588+0000 7f066ec79b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cce3db8e0 con 0x562cce4df890 2023-10-06T02:27:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.588+0000 7f066ec79b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cce3f6ef0 con 0x562cce4e0d10 2023-10-06T02:27:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.588+0000 7f066ec79b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x562cce2b2e80 con 0x562cce52fc50 2023-10-06T02:27:25.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.588+0000 7f066ec79b80 10 client.0 _ll_register_callbacks cb 0x562cce4a2ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:27:25.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.588+0000 7f065effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 0x562cce539f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.588+0000 7f065effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 0x562cce539f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34718/0 (socket says 172.21.15.37:34718) 2023-10-06T02:27:25.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.588+0000 7f065effd700 1 -- 172.21.15.37:0/310969693 learned_addr learned my addr 172.21.15.37:0/310969693 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:25.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.588+0000 7f065e7fc700 1 --2- 172.21.15.37:0/310969693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce4e0d10 0x562cce5052f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.588+0000 7f065f7fe700 1 --2- 172.21.15.37:0/310969693 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562cce52fc50 0x562cce539360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.588+0000 7f065effd700 1 -- 172.21.15.37:0/310969693 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562cce52fc50 msgr2=0x562cce539360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:25.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.588+0000 7f065effd700 1 --2- 172.21.15.37:0/310969693 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562cce52fc50 0x562cce539360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.588+0000 7f065effd700 1 -- 172.21.15.37:0/310969693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce4e0d10 msgr2=0x562cce5052f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:25.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.588+0000 7f065effd700 1 --2- 172.21.15.37:0/310969693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce4e0d10 0x562cce5052f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.588+0000 7f065effd700 1 -- 172.21.15.37:0/310969693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065000f040 con 0x562cce4df890 2023-10-06T02:27:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.589+0000 7f065effd700 1 --2- 172.21.15.37:0/310969693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 0x562cce539f10 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f0650022040 tx=0x7f065001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cdeff6d7552bb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.589+0000 7f063d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:27:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.589+0000 7f063d7fa700 1 -- 172.21.15.37:0/310969693 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065001fcb0 con 0x562cce4df890 2023-10-06T02:27:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.589+0000 7f063d7fa700 1 -- 172.21.15.37:0/310969693 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f065001b040 con 0x562cce4df890 2023-10-06T02:27:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.589+0000 7f066ec79b80 1 -- 172.21.15.37:0/310969693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562cce4d4990 con 0x562cce4df890 2023-10-06T02:27:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.589+0000 7f063d7fa700 1 -- 172.21.15.37:0/310969693 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f065001fe10 con 0x562cce4df890 2023-10-06T02:27:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.589+0000 7f066ec79b80 10 client.6282 fetch_fsmap learned FSMap version 37 2023-10-06T02:27:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.589+0000 7f066ec79b80 1 -- 172.21.15.37:0/310969693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x562cce26d030 con 0x562cce4df890 2023-10-06T02:27:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.589+0000 7f063d7fa700 1 -- 172.21.15.37:0/310969693 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562cce4d4990 con 0x562cce4df890 2023-10-06T02:27:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.589+0000 7f063d7fa700 1 -- 172.21.15.37:0/310969693 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f065002a630 con 0x562cce4df890 2023-10-06T02:27:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.589+0000 7f066ec79b80 10 client.6282 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T02:27:25.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.589+0000 7f066ec79b80 10 client.6282 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T02:27:25.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.589+0000 7f066ec79b80 20 client.6282 populate_metadata read hostname 'smithi037' 2023-10-06T02:27:25.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.589+0000 7f066ec79b80 1 --2- 172.21.15.37:0/310969693 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x562cce51fba0 0x562cce51da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.589+0000 7f066ec79b80 4 client.6282 mds_command: new command op to 6147 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:27:25.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.589+0000 7f066ec79b80 1 -- 172.21.15.37:0/310969693 --> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562cce4b18c0 con 0x562cce51fba0 2023-10-06T02:27:25.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.589+0000 7f065e7fc700 1 --2- 172.21.15.37:0/310969693 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x562cce51fba0 0x562cce51da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.590+0000 7f063d7fa700 10 client.6282 ms_handle_connect on v2:172.21.15.37:6833/2196855571 2023-10-06T02:27:25.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.590+0000 7f065e7fc700 1 --2- 172.21.15.37:0/310969693 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x562cce51fba0 0x562cce51da60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=638e9a3740246743 server_cookie=e06919ff26b2b909 in_seq=0 out_seq=0 2023-10-06T02:27:25.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.590+0000 7f063d7fa700 1 -- 172.21.15.37:0/310969693 <== mds.0 v2:172.21.15.37:6833/2196855571 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x562cce4b18c0 con 0x562cce51fba0 2023-10-06T02:27:25.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.590+0000 7f063d7fa700 10 client.6282 handle_command_reply: tid=0 2023-10-06T02:27:25.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.590+0000 7f066ec79b80 1 client.6282 shutdown 2023-10-06T02:27:25.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.590+0000 7f066ec79b80 1 -- 172.21.15.37:0/310969693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 msgr2=0x562cce539f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.590+0000 7f066ec79b80 1 --2- 172.21.15.37:0/310969693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 0x562cce539f10 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f0650022040 tx=0x7f065001e000 comp rx=0 tx=0).stop 2023-10-06T02:27:25.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.591+0000 7f066ec79b80 1 -- 172.21.15.37:0/310969693 shutdown_connections 2023-10-06T02:27:25.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.591+0000 7f066ec79b80 1 --2- 172.21.15.37:0/310969693 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562cce52fc50 0x562cce539360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.591+0000 7f066ec79b80 1 --2- 172.21.15.37:0/310969693 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x562cce51fba0 0x562cce51da60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.591+0000 7f066ec79b80 1 --2- 172.21.15.37:0/310969693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 0x562cce539f10 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.591+0000 7f066ec79b80 1 --2- 172.21.15.37:0/310969693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce4e0d10 0x562cce5052f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.591+0000 7f063d7fa700 0 client.6282 ms_handle_reset on v2:172.21.15.37:6833/2196855571 2023-10-06T02:27:25.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.591+0000 7f066ec79b80 1 -- 172.21.15.37:0/310969693 >> 172.21.15.37:0/310969693 conn(0x562cce4e11b0 msgr2=0x562cce508b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:25.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.591+0000 7f066ec79b80 1 -- 172.21.15.37:0/310969693 shutdown_connections 2023-10-06T02:27:25.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.591+0000 7f066ec79b80 1 -- 172.21.15.37:0/310969693 wait complete. 2023-10-06T02:27:25.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.591+0000 7f066ec79b80 20 client.6282 trim_cache size 0 max 16384 2023-10-06T02:27:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.607+0000 7f066ec79b80 1 Processor -- start 2023-10-06T02:27:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.607+0000 7f066ec79b80 1 -- start start 2023-10-06T02:27:25.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.607+0000 7f066ec79b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce4df890 0x562cce4e01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.607+0000 7f066ec79b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562cce4e0d10 0x562cce4dc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.607+0000 7f066ec79b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce52fc50 0x562cce4dcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.607+0000 7f066ec79b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cce523860 con 0x562cce52fc50 2023-10-06T02:27:25.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.607+0000 7f066ec79b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cce4b82d0 con 0x562cce4df890 2023-10-06T02:27:25.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.607+0000 7f066ec79b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x562cce524170 con 0x562cce4e0d10 2023-10-06T02:27:25.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.608+0000 7f065f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce52fc50 0x562cce4dcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.608+0000 7f065f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce52fc50 0x562cce4dcda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34724/0 (socket says 172.21.15.37:34724) 2023-10-06T02:27:25.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.608+0000 7f065f7fe700 1 -- 172.21.15.37:0/1060172014 learned_addr learned my addr 172.21.15.37:0/1060172014 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.608+0000 7f065effd700 1 --2- 172.21.15.37:0/1060172014 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce4df890 0x562cce4e01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.608+0000 7f065e7fc700 1 --2- 172.21.15.37:0/1060172014 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562cce4e0d10 0x562cce4dc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.608+0000 7f065f7fe700 1 -- 172.21.15.37:0/1060172014 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562cce4e0d10 msgr2=0x562cce4dc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.608+0000 7f065f7fe700 1 --2- 172.21.15.37:0/1060172014 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562cce4e0d10 0x562cce4dc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.608+0000 7f065f7fe700 1 -- 172.21.15.37:0/1060172014 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce4df890 msgr2=0x562cce4e01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.608+0000 7f065f7fe700 1 --2- 172.21.15.37:0/1060172014 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce4df890 0x562cce4e01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.608+0000 7f065f7fe700 1 -- 172.21.15.37:0/1060172014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562cce3fe7d0 con 0x562cce52fc50 2023-10-06T02:27:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.608+0000 7f065f7fe700 1 --2- 172.21.15.37:0/1060172014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce52fc50 0x562cce4dcda0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0658007a80 tx=0x7f0658008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613347345643dcfa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.608+0000 7f0654ff9700 1 -- 172.21.15.37:0/1060172014 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0658014aa0 con 0x562cce52fc50 2023-10-06T02:27:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.608+0000 7f0654ff9700 1 -- 172.21.15.37:0/1060172014 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0658014c00 con 0x562cce52fc50 2023-10-06T02:27:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.608+0000 7f0654ff9700 1 -- 172.21.15.37:0/1060172014 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0658016430 con 0x562cce52fc50 2023-10-06T02:27:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.609+0000 7f066ec79b80 1 -- 172.21.15.37:0/1060172014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce52fc50 msgr2=0x562cce4dcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.609+0000 7f066ec79b80 1 --2- 172.21.15.37:0/1060172014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce52fc50 0x562cce4dcda0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0658007a80 tx=0x7f0658008040 comp rx=0 tx=0).stop 2023-10-06T02:27:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.609+0000 7f066ec79b80 1 -- 172.21.15.37:0/1060172014 shutdown_connections 2023-10-06T02:27:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.609+0000 7f066ec79b80 1 --2- 172.21.15.37:0/1060172014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce52fc50 0x562cce4dcda0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.609+0000 7f066ec79b80 1 --2- 172.21.15.37:0/1060172014 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce4df890 0x562cce4e01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.609+0000 7f066ec79b80 1 --2- 172.21.15.37:0/1060172014 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562cce4e0d10 0x562cce4dc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.609+0000 7f066ec79b80 1 -- 172.21.15.37:0/1060172014 >> 172.21.15.37:0/1060172014 conn(0x562cce4e11b0 msgr2=0x562cce50f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.609+0000 7f066ec79b80 1 -- 172.21.15.37:0/1060172014 shutdown_connections 2023-10-06T02:27:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.609+0000 7f066ec79b80 1 -- 172.21.15.37:0/1060172014 wait complete. 2023-10-06T02:27:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.609+0000 7f066ec79b80 1 -- start start 2023-10-06T02:27:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.609+0000 7f066ec79b80 1 Processor -- start 2023-10-06T02:27:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.610+0000 7f066ec79b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 0x562cce585a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.610+0000 7f066ec79b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562cce4e0d10 0x562cce51c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.610+0000 7f066ec79b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce52fc50 0x562cce51c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.610+0000 7f066ec79b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cce58c740 con 0x562cce4df890 2023-10-06T02:27:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.610+0000 7f066ec79b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cce58c3d0 con 0x562cce52fc50 2023-10-06T02:27:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.610+0000 7f066ec79b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x562cce4e0970 con 0x562cce4e0d10 2023-10-06T02:27:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.610+0000 7f066ec79b80 10 client.0 _ll_register_callbacks cb 0x562cce4a2ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:27:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.610+0000 7f065effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 0x562cce585a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.610+0000 7f065effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 0x562cce585a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34738/0 (socket says 172.21.15.37:34738) 2023-10-06T02:27:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.610+0000 7f065effd700 1 -- 172.21.15.37:0/4051329793 learned_addr learned my addr 172.21.15.37:0/4051329793 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.611+0000 7f065f7fe700 1 --2- 172.21.15.37:0/4051329793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce52fc50 0x562cce51c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.611+0000 7f065e7fc700 1 --2- 172.21.15.37:0/4051329793 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562cce4e0d10 0x562cce51c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.611+0000 7f065effd700 1 -- 172.21.15.37:0/4051329793 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562cce4e0d10 msgr2=0x562cce51c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.611+0000 7f065effd700 1 --2- 172.21.15.37:0/4051329793 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562cce4e0d10 0x562cce51c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.611+0000 7f065effd700 1 -- 172.21.15.37:0/4051329793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce52fc50 msgr2=0x562cce51c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.611+0000 7f065effd700 1 --2- 172.21.15.37:0/4051329793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce52fc50 0x562cce51c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.611+0000 7f065effd700 1 -- 172.21.15.37:0/4051329793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065800e040 con 0x562cce4df890 2023-10-06T02:27:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.611+0000 7f065f7fe700 1 --2- 172.21.15.37:0/4051329793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce52fc50 0x562cce51c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.611+0000 7f065effd700 1 --2- 172.21.15.37:0/4051329793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 0x562cce585a70 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0650037040 tx=0x7f065002a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aecb15b7f2d42fac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.611+0000 7f063d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:27:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.611+0000 7f063d7fa700 1 -- 172.21.15.37:0/4051329793 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065001f620 con 0x562cce4df890 2023-10-06T02:27:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.611+0000 7f063d7fa700 1 -- 172.21.15.37:0/4051329793 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f0650041030 con 0x562cce4df890 2023-10-06T02:27:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.611+0000 7f066ec79b80 1 -- 172.21.15.37:0/4051329793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0650013e50 con 0x562cce4df890 2023-10-06T02:27:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.611+0000 7f063d7fa700 1 -- 172.21.15.37:0/4051329793 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f065002ab40 con 0x562cce4df890 2023-10-06T02:27:25.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.611+0000 7f066ec79b80 10 client.6288 fetch_fsmap learned FSMap version 37 2023-10-06T02:27:25.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.611+0000 7f066ec79b80 1 -- 172.21.15.37:0/4051329793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x562cce3e54c0 con 0x562cce4df890 2023-10-06T02:27:25.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.611+0000 7f063d7fa700 1 -- 172.21.15.37:0/4051329793 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0650013e50 con 0x562cce4df890 2023-10-06T02:27:25.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.611+0000 7f063d7fa700 1 -- 172.21.15.37:0/4051329793 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0650044370 con 0x562cce4df890 2023-10-06T02:27:25.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.611+0000 7f066ec79b80 10 client.6288 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T02:27:25.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f066ec79b80 10 client.6288 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-10-06T02:27:25.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f066ec79b80 20 client.6288 populate_metadata read hostname 'smithi037' 2023-10-06T02:27:25.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f066ec79b80 1 --2- 172.21.15.37:0/4051329793 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x562cce539350 0x562cce5345a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f066ec79b80 4 client.6288 mds_command: new command op to 6147 tid=0[{"prefix": "scrub status"}] 2023-10-06T02:27:25.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f066ec79b80 1 -- 172.21.15.37:0/4051329793 --> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562cce3d2e50 con 0x562cce539350 2023-10-06T02:27:25.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f065e7fc700 1 --2- 172.21.15.37:0/4051329793 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x562cce539350 0x562cce5345a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f063d7fa700 10 client.6288 ms_handle_connect on v2:172.21.15.37:6833/2196855571 2023-10-06T02:27:25.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f065e7fc700 1 --2- 172.21.15.37:0/4051329793 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x562cce539350 0x562cce5345a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dd3acb7509329f9 server_cookie=7b63ed8ecd749f26 in_seq=0 out_seq=0 2023-10-06T02:27:25.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f063d7fa700 1 -- 172.21.15.37:0/4051329793 <== mds.0 v2:172.21.15.37:6833/2196855571 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x562cce3d2e50 con 0x562cce539350 2023-10-06T02:27:25.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f063d7fa700 10 client.6288 handle_command_reply: tid=0 2023-10-06T02:27:25.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f066ec79b80 1 client.6288 shutdown 2023-10-06T02:27:25.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f066ec79b80 1 -- 172.21.15.37:0/4051329793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 msgr2=0x562cce585a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f066ec79b80 1 --2- 172.21.15.37:0/4051329793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 0x562cce585a70 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0650037040 tx=0x7f065002a000 comp rx=0 tx=0).stop 2023-10-06T02:27:25.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f066ec79b80 1 -- 172.21.15.37:0/4051329793 shutdown_connections 2023-10-06T02:27:25.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f066ec79b80 1 --2- 172.21.15.37:0/4051329793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562cce52fc50 0x562cce51c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f066ec79b80 1 --2- 172.21.15.37:0/4051329793 >> [v2:172.21.15.37:6833/2196855571,v1:172.21.15.37:6835/2196855571] conn(0x562cce539350 0x562cce5345a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f066ec79b80 1 --2- 172.21.15.37:0/4051329793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cce4df890 0x562cce585a70 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f063d7fa700 0 client.6288 ms_handle_reset on v2:172.21.15.37:6833/2196855571 2023-10-06T02:27:25.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f066ec79b80 1 --2- 172.21.15.37:0/4051329793 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x562cce4e0d10 0x562cce51c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f066ec79b80 1 -- 172.21.15.37:0/4051329793 >> 172.21.15.37:0/4051329793 conn(0x562cce4e11b0 msgr2=0x562cce4e2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:25.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f066ec79b80 1 -- 172.21.15.37:0/4051329793 shutdown_connections 2023-10-06T02:27:25.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.612+0000 7f066ec79b80 1 -- 172.21.15.37:0/4051329793 wait complete. 2023-10-06T02:27:25.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.613+0000 7f066ec79b80 20 client.6288 trim_cache size 0 max 16384 2023-10-06T02:27:25.621 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:27:25.621 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2023-10-06T02:27:25.621 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2023-10-06T02:27:25.621 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:27:25.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.613+0000 7f0665981700 1 -- 172.21.15.37:0/3243022457 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0640066f60 msgr2=0x7f0640069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.613+0000 7f0665981700 1 --2- 172.21.15.37:0/3243022457 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0640066f60 0x7f0640069410 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0650007fd0 tx=0x7f0650009040 comp rx=0 tx=0).stop 2023-10-06T02:27:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.613+0000 7f0665981700 1 -- 172.21.15.37:0/3243022457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06600ccb30 msgr2=0x7f0660169d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.613+0000 7f0665981700 1 --2- 172.21.15.37:0/3243022457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06600ccb30 0x7f0660169d90 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0648006fd0 tx=0x7f0648017000 comp rx=0 tx=0).stop 2023-10-06T02:27:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.613+0000 7f0665981700 1 -- 172.21.15.37:0/3243022457 shutdown_connections 2023-10-06T02:27:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.613+0000 7f0665981700 1 --2- 172.21.15.37:0/3243022457 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0640066f60 0x7f0640069410 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.613+0000 7f0665981700 1 --2- 172.21.15.37:0/3243022457 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06601593c0 0x7f06600c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.613+0000 7f0665981700 1 --2- 172.21.15.37:0/3243022457 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06600b2a90 0x7f066016ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.613+0000 7f0665981700 1 --2- 172.21.15.37:0/3243022457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06600ccb30 0x7f0660169d90 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.613+0000 7f0665981700 1 -- 172.21.15.37:0/3243022457 >> 172.21.15.37:0/3243022457 conn(0x7f066006c0b0 msgr2=0x7f06600cf510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.613+0000 7f0665981700 1 -- 172.21.15.37:0/3243022457 shutdown_connections 2023-10-06T02:27:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.613+0000 7f0665981700 1 -- 172.21.15.37:0/3243022457 wait complete. 2023-10-06T02:27:25.625 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T02:27:25.726 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:27:25.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.849+0000 7ff79759e700 1 Processor -- start 2023-10-06T02:27:25.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.849+0000 7ff79759e700 1 -- start start 2023-10-06T02:27:25.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.850+0000 7ff79759e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff7981570c0 0x7ff79815ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.850+0000 7ff79759e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7980c8ac0 con 0x7ff7980636a0 2023-10-06T02:27:25.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.850+0000 7ff79759e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7980c8d60 con 0x7ff79815baa0 2023-10-06T02:27:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.850+0000 7ff79759e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7980abe40 con 0x7ff7981570c0 2023-10-06T02:27:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.850+0000 7ff795d9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff7980636a0 0x7ff79815b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38490/0 (socket says 172.21.15.37:38490) 2023-10-06T02:27:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.850+0000 7ff795d9b700 1 -- 172.21.15.37:0/2187010037 learned_addr learned my addr 172.21.15.37:0/2187010037 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.850+0000 7ff79659c700 1 --2- 172.21.15.37:0/2187010037 >> v2:172.21.15.191:3300/0 conn(0x7ff7981570c0 0x7ff79815ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.850+0000 7ff79559a700 1 -- 172.21.15.37:0/2187010037 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294765990 0 0) 0x7ff7980c8ac0 con 0x7ff7980636a0 2023-10-06T02:27:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.850+0000 7ff79559a700 1 -- 172.21.15.37:0/2187010037 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff780003570 con 0x7ff7980636a0 2023-10-06T02:27:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79559a700 1 -- 172.21.15.37:0/2187010037 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963502726 0 0) 0x7ff7980c8d60 con 0x7ff79815baa0 2023-10-06T02:27:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79559a700 1 -- 172.21.15.37:0/2187010037 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7980c8ac0 con 0x7ff79815baa0 2023-10-06T02:27:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79559a700 1 -- 172.21.15.37:0/2187010037 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4211046471 0 0) 0x7ff780003570 con 0x7ff7980636a0 2023-10-06T02:27:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79559a700 1 -- 172.21.15.37:0/2187010037 >> v2:172.21.15.191:3300/0 conn(0x7ff7981570c0 msgr2=0x7ff79815ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79559a700 1 --2- 172.21.15.37:0/2187010037 >> v2:172.21.15.191:3300/0 conn(0x7ff7981570c0 0x7ff79815ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79559a700 1 -- 172.21.15.37:0/2187010037 >> v1:172.21.15.191:6789/0 conn(0x7ff79815baa0 legacy=0x7ff798069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79559a700 1 -- 172.21.15.37:0/2187010037 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7980c9000 con 0x7ff7980636a0 2023-10-06T02:27:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79559a700 1 -- 172.21.15.37:0/2187010037 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7ff78c001470 con 0x7ff7980636a0 2023-10-06T02:27:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79659c700 1 --2- 172.21.15.37:0/2187010037 >> v2:172.21.15.191:3300/0 conn(0x7ff7981570c0 0x7ff79815ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79559a700 1 -- 172.21.15.37:0/2187010037 >> v1:172.21.15.37:6789/0 conn(0x7ff7980636a0 legacy=0x7ff79815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79559a700 1 --2- 172.21.15.37:0/2187010037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff780003bf0 0x7ff780003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79559a700 1 --2- 172.21.15.37:0/2187010037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff780004810 0x7ff780004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79559a700 1 --2- 172.21.15.37:0/2187010037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7800051c0 0x7ff78000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79559a700 1 -- 172.21.15.37:0/2187010037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7980abe40 con 0x7ff7800051c0 2023-10-06T02:27:25.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79559a700 1 -- 172.21.15.37:0/2187010037 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78000c160 con 0x7ff780004810 2023-10-06T02:27:25.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79559a700 1 -- 172.21.15.37:0/2187010037 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78000c320 con 0x7ff780003bf0 2023-10-06T02:27:25.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79659c700 1 --2- 172.21.15.37:0/2187010037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff780003bf0 0x7ff780003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff795d9b700 1 --2- 172.21.15.37:0/2187010037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff780004810 0x7ff780004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff796d9d700 1 --2- 172.21.15.37:0/2187010037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7800051c0 0x7ff78000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79659c700 1 -- 172.21.15.37:0/2187010037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff780004810 msgr2=0x7ff780004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:25.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79659c700 1 --2- 172.21.15.37:0/2187010037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff780004810 0x7ff780004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79659c700 1 -- 172.21.15.37:0/2187010037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7800051c0 msgr2=0x7ff78000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:25.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79659c700 1 --2- 172.21.15.37:0/2187010037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7800051c0 0x7ff78000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79659c700 1 -- 172.21.15.37:0/2187010037 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780003570 con 0x7ff780003bf0 2023-10-06T02:27:25.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff796d9d700 1 --2- 172.21.15.37:0/2187010037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7800051c0 0x7ff78000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:25.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff796d9d700 1 -- 172.21.15.37:0/2187010037 reap_dead start 2023-10-06T02:27:25.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.851+0000 7ff79659c700 1 --2- 172.21.15.37:0/2187010037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff780003bf0 0x7ff780003fe0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff788006f00 tx=0x7ff7880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68a2b66c0263b2cb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.852+0000 7ff79559a700 1 -- 172.21.15.37:0/2187010037 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788009740 con 0x7ff780003bf0 2023-10-06T02:27:25.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.852+0000 7ff79559a700 1 -- 172.21.15.37:0/2187010037 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78800e920 con 0x7ff780003bf0 2023-10-06T02:27:25.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.852+0000 7ff79559a700 1 -- 172.21.15.37:0/2187010037 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78800ece0 con 0x7ff780003bf0 2023-10-06T02:27:25.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.852+0000 7ff79759e700 1 -- 172.21.15.37:0/2187010037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff780003bf0 msgr2=0x7ff780003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.852+0000 7ff79759e700 1 --2- 172.21.15.37:0/2187010037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff780003bf0 0x7ff780003fe0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff788006f00 tx=0x7ff7880091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.852+0000 7ff79759e700 1 -- 172.21.15.37:0/2187010037 shutdown_connections 2023-10-06T02:27:25.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.852+0000 7ff79759e700 1 --2- 172.21.15.37:0/2187010037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff780003bf0 0x7ff780003fe0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.852+0000 7ff79759e700 1 -- 172.21.15.37:0/2187010037 >> 172.21.15.37:0/2187010037 conn(0x7ff7980cd240 msgr2=0x7ff7980c9220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:25.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.852+0000 7ff79759e700 1 -- 172.21.15.37:0/2187010037 shutdown_connections 2023-10-06T02:27:25.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.852+0000 7ff79759e700 1 -- 172.21.15.37:0/2187010037 wait complete. 2023-10-06T02:27:25.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.853+0000 7ff79759e700 1 Processor -- start 2023-10-06T02:27:25.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.853+0000 7ff79759e700 1 -- start start 2023-10-06T02:27:25.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.854+0000 7ff79759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff780003bf0 0x7ff79815ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.854+0000 7ff79759e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff79806d0c0 0x7ff7981588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.854+0000 7ff79759e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff798167850 0x7ff798153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.854+0000 7ff79759e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79815b250 con 0x7ff780003bf0 2023-10-06T02:27:25.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.854+0000 7ff79759e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff798158df0 con 0x7ff798167850 2023-10-06T02:27:25.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.854+0000 7ff79759e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7980c5660 con 0x7ff79806d0c0 2023-10-06T02:27:25.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.854+0000 7ff79659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff780003bf0 0x7ff79815ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.854+0000 7ff79659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff780003bf0 0x7ff79815ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34764/0 (socket says 172.21.15.37:34764) 2023-10-06T02:27:25.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.854+0000 7ff79659c700 1 -- 172.21.15.37:0/252382171 learned_addr learned my addr 172.21.15.37:0/252382171 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:25.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.854+0000 7ff795d9b700 1 --2- 172.21.15.37:0/252382171 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff79806d0c0 0x7ff7981588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.854+0000 7ff796d9d700 1 --2- 172.21.15.37:0/252382171 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff798167850 0x7ff798153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.855+0000 7ff79659c700 1 -- 172.21.15.37:0/252382171 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff79806d0c0 msgr2=0x7ff7981588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.855+0000 7ff79659c700 1 --2- 172.21.15.37:0/252382171 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff79806d0c0 0x7ff7981588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.855+0000 7ff79659c700 1 -- 172.21.15.37:0/252382171 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff798167850 msgr2=0x7ff798153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:25.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.855+0000 7ff79659c700 1 --2- 172.21.15.37:0/252382171 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff798167850 0x7ff798153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:25.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.855+0000 7ff79659c700 1 -- 172.21.15.37:0/252382171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79815b480 con 0x7ff780003bf0 2023-10-06T02:27:25.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.855+0000 7ff79659c700 1 --2- 172.21.15.37:0/252382171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff780003bf0 0x7ff79815ad10 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff78000c4b0 tx=0x7ff78801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.855+0000 7ff7867fc700 1 -- 172.21.15.37:0/252382171 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788022070 con 0x7ff780003bf0 2023-10-06T02:27:25.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.855+0000 7ff7867fc700 1 -- 172.21.15.37:0/252382171 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff788013be0 con 0x7ff780003bf0 2023-10-06T02:27:25.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.855+0000 7ff79759e700 1 -- 172.21.15.37:0/252382171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff79815b760 con 0x7ff780003bf0 2023-10-06T02:27:25.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.855+0000 7ff7867fc700 1 -- 172.21.15.37:0/252382171 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78801c450 con 0x7ff780003bf0 2023-10-06T02:27:25.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.855+0000 7ff79759e700 1 -- 172.21.15.37:0/252382171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7980c52f0 con 0x7ff780003bf0 2023-10-06T02:27:25.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.856+0000 7ff79759e700 1 -- 172.21.15.37:0/252382171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7980c5940 con 0x7ff780003bf0 2023-10-06T02:27:25.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.857+0000 7ff7867fc700 1 -- 172.21.15.37:0/252382171 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff788026070 con 0x7ff780003bf0 2023-10-06T02:27:25.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.857+0000 7ff7867fc700 1 --2- 172.21.15.37:0/252382171 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff778066f30 0x7ff7780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:25.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.857+0000 7ff7867fc700 1 -- 172.21.15.37:0/252382171 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6260+0+0 (secure 0 0 0) 0x7ff788085fc0 con 0x7ff780003bf0 2023-10-06T02:27:25.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.857+0000 7ff795d9b700 1 --2- 172.21.15.37:0/252382171 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff778066f30 0x7ff7780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:25.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.858+0000 7ff795d9b700 1 --2- 172.21.15.37:0/252382171 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff778066f30 0x7ff7780693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff78c000e50 tx=0x7ff78c001e10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:25.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:25.861+0000 7ff7867fc700 1 -- 172.21.15.37:0/252382171 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7880b75a0 con 0x7ff780003bf0 2023-10-06T02:27:26.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.099+0000 7ff79759e700 1 -- 172.21.15.37:0/252382171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff798064b00 con 0x7ff780003bf0 2023-10-06T02:27:26.100 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-10-06T02:27:26.100+0000 7f292cc58700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:27:26.106 INFO:tasks.ceph.mds.c.smithi037.stderr: -839> 2023-10-06T02:26:55.228+0000 7f708652b700 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2023-10-06T02:27:26.106 INFO:tasks.ceph.mds.c.smithi037.stderr: -836> 2023-10-06T02:26:55.228+0000 7f708652b700 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2023-10-06T02:27:26.107 INFO:tasks.ceph.mds.c.smithi037.stderr: -820> 2023-10-06T02:26:55.228+0000 7f708652b700 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2023-10-06T02:27:26.107 INFO:tasks.ceph.mds.c.smithi037.stderr: -817> 2023-10-06T02:26:55.228+0000 7f708652b700 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2023-10-06T02:27:26.107 INFO:tasks.ceph.mds.c.smithi037.stderr: -796> 2023-10-06T02:26:55.350+0000 7f7089d32700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:27:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.106+0000 7ff7867fc700 1 -- 172.21.15.37:0/252382171 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff788017090 con 0x7ff780003bf0 2023-10-06T02:27:26.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.109+0000 7ff79759e700 1 -- 172.21.15.37:0/252382171 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff778066f30 msgr2=0x7ff7780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.109+0000 7ff79759e700 1 --2- 172.21.15.37:0/252382171 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff778066f30 0x7ff7780693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff78c000e50 tx=0x7ff78c001e10 comp rx=0 tx=0).stop 2023-10-06T02:27:26.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.109+0000 7ff79759e700 1 -- 172.21.15.37:0/252382171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff780003bf0 msgr2=0x7ff79815ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.109+0000 7ff79759e700 1 --2- 172.21.15.37:0/252382171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff780003bf0 0x7ff79815ad10 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff78000c4b0 tx=0x7ff78801a000 comp rx=0 tx=0).stop 2023-10-06T02:27:26.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.109+0000 7ff79759e700 1 -- 172.21.15.37:0/252382171 shutdown_connections 2023-10-06T02:27:26.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.109+0000 7ff79759e700 1 --2- 172.21.15.37:0/252382171 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff778066f30 0x7ff7780693e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.109+0000 7ff79759e700 1 --2- 172.21.15.37:0/252382171 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff798167850 0x7ff798153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.109+0000 7ff79759e700 1 --2- 172.21.15.37:0/252382171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff780003bf0 0x7ff79815ad10 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.109+0000 7ff79759e700 1 --2- 172.21.15.37:0/252382171 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff79806d0c0 0x7ff7981588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.109+0000 7ff79759e700 1 -- 172.21.15.37:0/252382171 >> 172.21.15.37:0/252382171 conn(0x7ff7980cd240 msgr2=0x7ff79806ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:26.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.109+0000 7ff79759e700 1 -- 172.21.15.37:0/252382171 shutdown_connections 2023-10-06T02:27:26.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.109+0000 7ff79759e700 1 -- 172.21.15.37:0/252382171 wait complete. 2023-10-06T02:27:26.111 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:27:26.123 DEBUG:teuthology.orchestra.run.smithi037:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show inode 2023-10-06T02:27:26.128 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-10-06T02:27:26.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.158+0000 7f84bb6c5240 1 -- start start 2023-10-06T02:27:26.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.158+0000 7f84bb6c5240 1 Processor -- start 2023-10-06T02:27:26.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.158+0000 7f84bb6c5240 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558adc3f4400 0x558adc3d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.158+0000 7f84bb6c5240 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558adc3f4800 0x558adc3d0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.158+0000 7f84bb6c5240 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adc3f4c00 0x558adc3d1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.158+0000 7f84bb6c5240 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adb65fcc0 con 0x558adc3f4c00 2023-10-06T02:27:26.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.158+0000 7f84bb6c5240 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adb65f540 con 0x558adc3f4400 2023-10-06T02:27:26.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.158+0000 7f84bb6c5240 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x558adb65fe00 con 0x558adc3f4800 2023-10-06T02:27:26.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.158+0000 7f84b5394700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adc3f4c00 0x558adc3d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.158+0000 7f84b5394700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adc3f4c00 0x558adc3d1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34812/0 (socket says 172.21.15.37:34812) 2023-10-06T02:27:26.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.158+0000 7f84b5394700 1 -- 172.21.15.37:0/600485701 learned_addr learned my addr 172.21.15.37:0/600485701 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:26.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.159+0000 7f84b4b93700 1 --2- 172.21.15.37:0/600485701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558adc3f4400 0x558adc3d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.159+0000 7f84b4392700 1 --2- 172.21.15.37:0/600485701 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558adc3f4800 0x558adc3d0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.159+0000 7f84b5394700 1 -- 172.21.15.37:0/600485701 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558adc3f4800 msgr2=0x558adc3d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:26.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.159+0000 7f84b5394700 1 --2- 172.21.15.37:0/600485701 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558adc3f4800 0x558adc3d0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.159+0000 7f84b5394700 1 -- 172.21.15.37:0/600485701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558adc3f4400 msgr2=0x558adc3d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:26.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.159+0000 7f84b5394700 1 --2- 172.21.15.37:0/600485701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558adc3f4400 0x558adc3d0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.159+0000 7f84b5394700 1 -- 172.21.15.37:0/600485701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558adb642340 con 0x558adc3f4c00 2023-10-06T02:27:26.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.159+0000 7f84b4392700 1 --2- 172.21.15.37:0/600485701 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558adc3f4800 0x558adc3d0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:26.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.159+0000 7f84b5394700 1 --2- 172.21.15.37:0/600485701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adc3f4c00 0x558adc3d1080 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x558adc3abd10 tx=0x558adc3b1a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd9f2f2365262e2b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:26.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.159+0000 7f84b238e700 1 -- 172.21.15.37:0/600485701 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558adb657080 con 0x558adc3f4c00 2023-10-06T02:27:26.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.159+0000 7f84b238e700 1 -- 172.21.15.37:0/600485701 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558adb674f00 con 0x558adc3f4c00 2023-10-06T02:27:26.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.159+0000 7f84b238e700 1 -- 172.21.15.37:0/600485701 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558adb657600 con 0x558adc3f4c00 2023-10-06T02:27:26.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.159+0000 7f84bb6c5240 1 -- 172.21.15.37:0/600485701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558adb642000 con 0x558adc3f4c00 2023-10-06T02:27:26.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.159+0000 7f84bb6c5240 1 -- 172.21.15.37:0/600485701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x558adb642ea0 con 0x558adc3f4c00 2023-10-06T02:27:26.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.159+0000 7f84bb6c5240 4 waiting for MDS map... 2023-10-06T02:27:26.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.159+0000 7f84b238e700 1 -- 172.21.15.37:0/600485701 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(61..61 src has 1..61) v4 ==== 6346+0+0 (secure 0 0 0) 0x558adb662c40 con 0x558adc3f4c00 2023-10-06T02:27:26.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.159+0000 7f84b238e700 1 -- 172.21.15.37:0/600485701 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 38) v1 ==== 2559+0+0 (secure 0 0 0) 0x558adc404300 con 0x558adc3f4c00 2023-10-06T02:27:26.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.159+0000 7f84bb6c5240 4 Got MDS map 38 2023-10-06T02:27:26.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.159+0000 7f84bb6c5240 10 main: main 2023-10-06T02:27:26.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.159+0000 7f84bb6c5240 4 main: connecting to RADOS... 2023-10-06T02:27:26.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.160+0000 7f84bb6c5240 1 Processor -- start 2023-10-06T02:27:26.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.160+0000 7f84bb6c5240 1 -- start start 2023-10-06T02:27:26.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.160+0000 7f84bb6c5240 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558adc3f5800 0x558adc3d1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.160+0000 7f84bb6c5240 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adc3f5c00 0x558adc3d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.161+0000 7f84bb6c5240 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558adc484000 0x558adc3d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.161+0000 7f84bb6c5240 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adb65fb80 con 0x558adc3f5c00 2023-10-06T02:27:26.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.161+0000 7f84bb6c5240 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adb65f540 con 0x558adc484000 2023-10-06T02:27:26.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.161+0000 7f84bb6c5240 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x558adb65fcc0 con 0x558adc3f5800 2023-10-06T02:27:26.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.161+0000 7f84b4b93700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adc3f5c00 0x558adc3d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.161+0000 7f84b4b93700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adc3f5c00 0x558adc3d1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34828/0 (socket says 172.21.15.37:34828) 2023-10-06T02:27:26.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.161+0000 7f84b4b93700 1 -- 172.21.15.37:0/3931347712 learned_addr learned my addr 172.21.15.37:0/3931347712 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:26.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.161+0000 7f84b4392700 1 --2- 172.21.15.37:0/3931347712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558adc484000 0x558adc3d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.161+0000 7f84b4392700 1 --2- 172.21.15.37:0/3931347712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558adc3f5800 0x558adc3d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.161+0000 7f84b4b93700 1 -- 172.21.15.37:0/3931347712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558adc3f5800 msgr2=0x558adc3d1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:26.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.161+0000 7f84b4b93700 1 --2- 172.21.15.37:0/3931347712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558adc3f5800 0x558adc3d1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.161+0000 7f84b4b93700 1 -- 172.21.15.37:0/3931347712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558adc484000 msgr2=0x558adc3d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:26.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.161+0000 7f84b4b93700 1 --2- 172.21.15.37:0/3931347712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558adc484000 0x558adc3d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.161+0000 7f84b4b93700 1 -- 172.21.15.37:0/3931347712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558adb643860 con 0x558adc3f5c00 2023-10-06T02:27:26.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.161+0000 7f84b4b93700 1 --2- 172.21.15.37:0/3931347712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adc3f5c00 0x558adc3d1b80 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x558adc425260 tx=0x558adc3b1860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a28da06f760f782 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:26.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.161+0000 7f84b038a700 1 -- 172.21.15.37:0/3931347712 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558adb657080 con 0x558adc3f5c00 2023-10-06T02:27:26.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.161+0000 7f84b038a700 1 -- 172.21.15.37:0/3931347712 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558adb674600 con 0x558adc3f5c00 2023-10-06T02:27:26.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.161+0000 7f84b038a700 1 -- 172.21.15.37:0/3931347712 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558adb657600 con 0x558adc3f5c00 2023-10-06T02:27:26.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.162+0000 7f84bb6c5240 1 -- 172.21.15.37:0/3931347712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adc3f5c00 msgr2=0x558adc3d1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.162+0000 7f84bb6c5240 1 --2- 172.21.15.37:0/3931347712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adc3f5c00 0x558adc3d1b80 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x558adc425260 tx=0x558adc3b1860 comp rx=0 tx=0).stop 2023-10-06T02:27:26.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.162+0000 7f84bb6c5240 1 -- 172.21.15.37:0/3931347712 shutdown_connections 2023-10-06T02:27:26.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.162+0000 7f84bb6c5240 1 --2- 172.21.15.37:0/3931347712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558adc484000 0x558adc3d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.162+0000 7f84bb6c5240 1 --2- 172.21.15.37:0/3931347712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558adc3f5800 0x558adc3d1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.162+0000 7f84bb6c5240 1 --2- 172.21.15.37:0/3931347712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adc3f5c00 0x558adc3d1b80 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.162+0000 7f84bb6c5240 1 -- 172.21.15.37:0/3931347712 >> 172.21.15.37:0/3931347712 conn(0x558adc3f5000 msgr2=0x558adb6ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:26.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.162+0000 7f84bb6c5240 1 -- 172.21.15.37:0/3931347712 shutdown_connections 2023-10-06T02:27:26.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.162+0000 7f84bb6c5240 1 -- 172.21.15.37:0/3931347712 wait complete. 2023-10-06T02:27:26.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.162+0000 7f84bb6c5240 1 Processor -- start 2023-10-06T02:27:26.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.162+0000 7f84bb6c5240 1 -- start start 2023-10-06T02:27:26.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.163+0000 7f84bb6c5240 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558adc3f5c00 0x558adc3d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.163+0000 7f84bb6c5240 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adc3f5800 0x558adc3d2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.163+0000 7f84bb6c5240 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558adc484000 0x558adc3d2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.163+0000 7f84bb6c5240 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adb65edc0 con 0x558adc3f5800 2023-10-06T02:27:26.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.163+0000 7f84bb6c5240 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x558adb65e3c0 con 0x558adc484000 2023-10-06T02:27:26.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.163+0000 7f84bb6c5240 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x558adb65e000 con 0x558adc3f5c00 2023-10-06T02:27:26.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.163+0000 7f84b4b93700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adc3f5800 0x558adc3d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.163+0000 7f84b4b93700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adc3f5800 0x558adc3d2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34830/0 (socket says 172.21.15.37:34830) 2023-10-06T02:27:26.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.163+0000 7f84b4b93700 1 -- 172.21.15.37:0/686444714 learned_addr learned my addr 172.21.15.37:0/686444714 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:26.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.163+0000 7f84b4392700 1 --2- 172.21.15.37:0/686444714 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558adc484000 0x558adc3d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.163+0000 7f84b4392700 1 --2- 172.21.15.37:0/686444714 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558adc3f5c00 0x558adc3d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.163+0000 7f84b4b93700 1 -- 172.21.15.37:0/686444714 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558adc3f5c00 msgr2=0x558adc3d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.163+0000 7f84b4b93700 1 --2- 172.21.15.37:0/686444714 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558adc3f5c00 0x558adc3d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.163+0000 7f84b4b93700 1 -- 172.21.15.37:0/686444714 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558adc484000 msgr2=0x558adc3d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.163+0000 7f84b4b93700 1 --2- 172.21.15.37:0/686444714 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558adc484000 0x558adc3d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.163+0000 7f84b4b93700 1 -- 172.21.15.37:0/686444714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558adb6429c0 con 0x558adc3f5800 2023-10-06T02:27:26.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.163+0000 7f84b4392700 1 --2- 172.21.15.37:0/686444714 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558adc484000 0x558adc3d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:26.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.163+0000 7f84b4b93700 1 --2- 172.21.15.37:0/686444714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adc3f5800 0x558adc3d2680 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x558adc425f20 tx=0x558adb796060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:26.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.164+0000 7f84aeb87700 1 -- 172.21.15.37:0/686444714 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558adb656dc0 con 0x558adc3f5800 2023-10-06T02:27:26.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.164+0000 7f84aeb87700 1 -- 172.21.15.37:0/686444714 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558adc42a480 con 0x558adc3f5800 2023-10-06T02:27:26.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.164+0000 7f84bb6c5240 1 -- 172.21.15.37:0/686444714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558adb643a00 con 0x558adc3f5800 2023-10-06T02:27:26.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.164+0000 7f84aeb87700 1 -- 172.21.15.37:0/686444714 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558adb657080 con 0x558adc3f5800 2023-10-06T02:27:26.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.164+0000 7f84bb6c5240 1 -- 172.21.15.37:0/686444714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558adb643860 con 0x558adc3f5800 2023-10-06T02:27:26.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.164+0000 7f84bb6c5240 4 main: resolving pool 9 2023-10-06T02:27:26.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.165+0000 7f84aeb87700 1 -- 172.21.15.37:0/686444714 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x558adc395080 con 0x558adc3f5800 2023-10-06T02:27:26.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.165+0000 7f84aeb87700 1 --2- 172.21.15.37:0/686444714 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x558adc4b0400 0x558adc3d3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.165+0000 7f84aeb87700 1 -- 172.21.15.37:0/686444714 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6346+0+0 (secure 0 0 0) 0x558adb662a80 con 0x558adc3f5800 2023-10-06T02:27:26.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.165+0000 7f84bb6c5240 4 main: creating IoCtx.. 2023-10-06T02:27:26.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.165+0000 7f84bb6c5240 1 --2- 172.21.15.37:0/686444714 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x558adc484400 0x558adc3d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.165+0000 7f84bb6c5240 1 -- 172.21.15.37:0/686444714 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:1 9.13 9:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61) v8 -- 0x558adc484800 con 0x558adc484400 2023-10-06T02:27:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.165+0000 7f84b4392700 1 --2- 172.21.15.37:0/686444714 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x558adc4b0400 0x558adc3d3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.166+0000 7f84b4392700 1 --2- 172.21.15.37:0/686444714 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x558adc484400 0x558adc3d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.166+0000 7f84b4392700 1 --2- 172.21.15.37:0/686444714 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x558adc4b0400 0x558adc3d3700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x558adc3ab260 tx=0x558adc49b380 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.166+0000 7f84b4392700 1 --2- 172.21.15.37:0/686444714 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x558adc484400 0x558adc3d1b80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.169+0000 7f84b4392700 1 -- 172.21.15.37:0/686444714 <== osd.7 v2:172.21.15.191:6813/90854 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv7 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x558adc3d8fc0 con 0x558adc484400 2023-10-06T02:27:26.185 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:27:26.185 INFO:teuthology.orchestra.run.smithi037.stdout: "0": { 2023-10-06T02:27:26.185 INFO:teuthology.orchestra.run.smithi037.stdout: "data": { 2023-10-06T02:27:26.186 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 5, 2023-10-06T02:27:26.186 INFO:teuthology.orchestra.run.smithi037.stdout: "inotable": { 2023-10-06T02:27:26.186 INFO:teuthology.orchestra.run.smithi037.stdout: "projected_free": [ 2023-10-06T02:27:26.186 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:26.186 INFO:teuthology.orchestra.run.smithi037.stdout: "start": 1099511627779, 2023-10-06T02:27:26.186 INFO:teuthology.orchestra.run.smithi037.stdout: "len": 1099511627773 2023-10-06T02:27:26.187 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:26.187 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2023-10-06T02:27:26.187 INFO:teuthology.orchestra.run.smithi037.stdout: "free": [ 2023-10-06T02:27:26.187 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:26.187 INFO:teuthology.orchestra.run.smithi037.stdout: "start": 1099511627779, 2023-10-06T02:27:26.188 INFO:teuthology.orchestra.run.smithi037.stdout: "len": 1099511627773 2023-10-06T02:27:26.188 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:26.188 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-06T02:27:26.188 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:26.188 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:26.188 INFO:teuthology.orchestra.run.smithi037.stdout: "result": 0 2023-10-06T02:27:26.189 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:26.189 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:27:26.189 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:26.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.169+0000 7f84bb6c5240 1 -- 172.21.15.37:0/686444714 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x558adc484400 msgr2=0x558adc3d1b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.169+0000 7f84bb6c5240 1 --2- 172.21.15.37:0/686444714 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x558adc484400 0x558adc3d1b80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.169+0000 7f84bb6c5240 1 -- 172.21.15.37:0/686444714 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x558adc4b0400 msgr2=0x558adc3d3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.169+0000 7f84bb6c5240 1 --2- 172.21.15.37:0/686444714 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x558adc4b0400 0x558adc3d3700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x558adc3ab260 tx=0x558adc49b380 comp rx=0 tx=0).stop 2023-10-06T02:27:26.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.169+0000 7f84bb6c5240 1 -- 172.21.15.37:0/686444714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adc3f5800 msgr2=0x558adc3d2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.169+0000 7f84bb6c5240 1 --2- 172.21.15.37:0/686444714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adc3f5800 0x558adc3d2680 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x558adc425f20 tx=0x558adb796060 comp rx=0 tx=0).stop 2023-10-06T02:27:26.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.169+0000 7f84b4b93700 1 -- 172.21.15.37:0/686444714 reap_dead start 2023-10-06T02:27:26.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.169+0000 7f84bb6c5240 1 -- 172.21.15.37:0/686444714 shutdown_connections 2023-10-06T02:27:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.169+0000 7f84bb6c5240 1 -- 172.21.15.37:0/686444714 >> 172.21.15.37:0/686444714 conn(0x558adc3f5000 msgr2=0x558adb6ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.169+0000 7f84bb6c5240 1 -- 172.21.15.37:0/686444714 shutdown_connections 2023-10-06T02:27:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.169+0000 7f84bb6c5240 1 -- 172.21.15.37:0/686444714 wait complete. 2023-10-06T02:27:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.170+0000 7f84bb6c5240 1 -- 172.21.15.37:0/600485701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adc3f4c00 msgr2=0x558adc3d1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.170+0000 7f84bb6c5240 1 --2- 172.21.15.37:0/600485701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adc3f4c00 0x558adc3d1080 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x558adc3abd10 tx=0x558adc3b1a40 comp rx=0 tx=0).stop 2023-10-06T02:27:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.170+0000 7f84bb6c5240 1 -- 172.21.15.37:0/600485701 shutdown_connections 2023-10-06T02:27:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.170+0000 7f84bb6c5240 1 --2- 172.21.15.37:0/600485701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adc3f4c00 0x558adc3d1080 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.170+0000 7f84bb6c5240 1 --2- 172.21.15.37:0/600485701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558adc3f4400 0x558adc3d0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.170+0000 7f84bb6c5240 1 --2- 172.21.15.37:0/600485701 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558adc3f4800 0x558adc3d0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.170+0000 7f84bb6c5240 1 -- 172.21.15.37:0/600485701 >> 172.21.15.37:0/600485701 conn(0x558adc3f4000 msgr2=0x558adb6ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.170+0000 7f84bb6c5240 1 -- 172.21.15.37:0/600485701 shutdown_connections 2023-10-06T02:27:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.170+0000 7f84bb6c5240 1 -- 172.21.15.37:0/600485701 wait complete. 2023-10-06T02:27:26.197 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'inode'] in time 0:00:00.074254, result: { "0": { "data": { "version": 5, "inotable": { "projected_free": [ { "start": 1099511627779, "len": 1099511627773 } ], "free": [ { "start": 1099511627779, "len": 1099511627773 } ] } }, "result": 0 } } 2023-10-06T02:27:26.197 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:27:26.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:27:26.271 DEBUG:teuthology.orchestra.run.smithi191:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:27:26.321 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:27:26.321 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:27:26.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:26.321 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:27:26.336 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:27:26.336 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:27:26.337 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:27:26.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:26.337 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:27:26.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:27:26.353 INFO:teuthology.orchestra.run.smithi191.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T02:27:26.354 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:27:26.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:26.354 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T02:27:26.392 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:27:26.392 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T02:27:26.393 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:27:26.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:26.393 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T02:27:26.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:27:26.410 INFO:teuthology.orchestra.run.smithi191.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T02:27:26.410 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:26.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.552+0000 7fb04359e700 1 Processor -- start 2023-10-06T02:27:26.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.552+0000 7fb04359e700 1 -- start start 2023-10-06T02:27:26.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.553+0000 7fb04359e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb0440b2270 0x7fb04406d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.553+0000 7fb04359e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb04406db80 0x7fb0440cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.553+0000 7fb04359e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04406e4c0 con 0x7fb044159510 2023-10-06T02:27:26.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.553+0000 7fb04359e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0440b26c0 con 0x7fb04406db80 2023-10-06T02:27:26.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.553+0000 7fb04359e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04406e000 con 0x7fb0440b2270 2023-10-06T02:27:26.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.553+0000 7fb042d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb04406db80 0x7fb0440cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.553+0000 7fb042d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb04406db80 0x7fb0440cbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34834/0 (socket says 172.21.15.37:34834) 2023-10-06T02:27:26.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.553+0000 7fb042d9d700 1 -- 172.21.15.37:0/490316407 learned_addr learned my addr 172.21.15.37:0/490316407 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:26.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.553+0000 7fb041d9b700 1 --2- 172.21.15.37:0/490316407 >> v2:172.21.15.191:3300/0 conn(0x7fb0440b2270 0x7fb04406d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.553+0000 7fb042d9d700 1 -- 172.21.15.37:0/490316407 >> v2:172.21.15.191:3300/0 conn(0x7fb0440b2270 msgr2=0x7fb04406d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:26.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.553+0000 7fb042d9d700 1 --2- 172.21.15.37:0/490316407 >> v2:172.21.15.191:3300/0 conn(0x7fb0440b2270 0x7fb04406d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.553+0000 7fb042d9d700 1 -- 172.21.15.37:0/490316407 >> v1:172.21.15.191:6789/0 conn(0x7fb044159510 legacy=0x7fb04415da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:26.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.553+0000 7fb042d9d700 1 -- 172.21.15.37:0/490316407 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0440cb900 con 0x7fb04406db80 2023-10-06T02:27:26.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.553+0000 7fb042d9d700 1 --2- 172.21.15.37:0/490316407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04406db80 0x7fb0440cbd90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb04415cfc0 tx=0x7fb03c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c64ad2839d1966 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:26.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.554+0000 7fb04159a700 1 -- 172.21.15.37:0/490316407 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c00e070 con 0x7fb04406db80 2023-10-06T02:27:26.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.554+0000 7fb04159a700 1 -- 172.21.15.37:0/490316407 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c00ba00 con 0x7fb04406db80 2023-10-06T02:27:26.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.554+0000 7fb04159a700 1 -- 172.21.15.37:0/490316407 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c0092e0 con 0x7fb04406db80 2023-10-06T02:27:26.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.554+0000 7fb04359e700 1 -- 172.21.15.37:0/490316407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04406db80 msgr2=0x7fb0440cbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.554+0000 7fb04359e700 1 --2- 172.21.15.37:0/490316407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04406db80 0x7fb0440cbd90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb04415cfc0 tx=0x7fb03c009840 comp rx=0 tx=0).stop 2023-10-06T02:27:26.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.554+0000 7fb04359e700 1 -- 172.21.15.37:0/490316407 shutdown_connections 2023-10-06T02:27:26.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.554+0000 7fb04359e700 1 --2- 172.21.15.37:0/490316407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04406db80 0x7fb0440cbd90 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.554+0000 7fb04359e700 1 --2- 172.21.15.37:0/490316407 >> v2:172.21.15.191:3300/0 conn(0x7fb0440b2270 0x7fb04406d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.554+0000 7fb04359e700 1 -- 172.21.15.37:0/490316407 >> 172.21.15.37:0/490316407 conn(0x7fb04406c0b0 msgr2=0x7fb04406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:26.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.554+0000 7fb04359e700 1 -- 172.21.15.37:0/490316407 shutdown_connections 2023-10-06T02:27:26.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.554+0000 7fb04359e700 1 -- 172.21.15.37:0/490316407 wait complete. 2023-10-06T02:27:26.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.555+0000 7fb04359e700 1 Processor -- start 2023-10-06T02:27:26.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.555+0000 7fb04359e700 1 -- start start 2023-10-06T02:27:26.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.556+0000 7fb04359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04406db80 0x7fb0440c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.556+0000 7fb04359e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0440b2270 0x7fb0441518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.556+0000 7fb04359e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb044159510 0x7fb0440c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.556+0000 7fb04359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0440c6240 con 0x7fb04406db80 2023-10-06T02:27:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.556+0000 7fb04359e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb044151e30 con 0x7fb0440b2270 2023-10-06T02:27:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.556+0000 7fb04359e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0440c5630 con 0x7fb044159510 2023-10-06T02:27:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.556+0000 7fb04259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04406db80 0x7fb0440c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.556+0000 7fb04259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04406db80 0x7fb0440c66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34850/0 (socket says 172.21.15.37:34850) 2023-10-06T02:27:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.556+0000 7fb04259c700 1 -- 172.21.15.37:0/617569948 learned_addr learned my addr 172.21.15.37:0/617569948 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.556+0000 7fb041d9b700 1 --2- 172.21.15.37:0/617569948 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0440b2270 0x7fb0441518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.556+0000 7fb042d9d700 1 --2- 172.21.15.37:0/617569948 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb044159510 0x7fb0440c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.556+0000 7fb04259c700 1 -- 172.21.15.37:0/617569948 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb044159510 msgr2=0x7fb0440c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.556+0000 7fb04259c700 1 --2- 172.21.15.37:0/617569948 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb044159510 0x7fb0440c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.556+0000 7fb04259c700 1 -- 172.21.15.37:0/617569948 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0440b2270 msgr2=0x7fb0441518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.556+0000 7fb04259c700 1 --2- 172.21.15.37:0/617569948 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0440b2270 0x7fb0441518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.556+0000 7fb04259c700 1 -- 172.21.15.37:0/617569948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c009ae0 con 0x7fb04406db80 2023-10-06T02:27:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.557+0000 7fb04259c700 1 --2- 172.21.15.37:0/617569948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04406db80 0x7fb0440c66d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb03400c600 tx=0x7fb034007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.557+0000 7fb03a7fc700 1 -- 172.21.15.37:0/617569948 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb034011590 con 0x7fb04406db80 2023-10-06T02:27:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.557+0000 7fb03a7fc700 1 -- 172.21.15.37:0/617569948 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb034011710 con 0x7fb04406db80 2023-10-06T02:27:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.557+0000 7fb04359e700 1 -- 172.21.15.37:0/617569948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0440c5910 con 0x7fb04406db80 2023-10-06T02:27:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.557+0000 7fb03a7fc700 1 -- 172.21.15.37:0/617569948 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb034011ad0 con 0x7fb04406db80 2023-10-06T02:27:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.557+0000 7fb04359e700 1 -- 172.21.15.37:0/617569948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0440c5ed0 con 0x7fb04406db80 2023-10-06T02:27:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.558+0000 7fb04359e700 1 -- 172.21.15.37:0/617569948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0440c6520 con 0x7fb04406db80 2023-10-06T02:27:26.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.558+0000 7fb03a7fc700 1 -- 172.21.15.37:0/617569948 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb03401c460 con 0x7fb04406db80 2023-10-06T02:27:26.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.559+0000 7fb03a7fc700 1 --2- 172.21.15.37:0/617569948 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb024066f30 0x7fb0240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.559+0000 7fb03a7fc700 1 -- 172.21.15.37:0/617569948 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6346+0+0 (secure 0 0 0) 0x7fb034084560 con 0x7fb04406db80 2023-10-06T02:27:26.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.559+0000 7fb041d9b700 1 --2- 172.21.15.37:0/617569948 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb024066f30 0x7fb0240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.559+0000 7fb041d9b700 1 --2- 172.21.15.37:0/617569948 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb024066f30 0x7fb0240693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb0440c40a0 tx=0x7fb02c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:26.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.563+0000 7fb03a7fc700 1 -- 172.21.15.37:0/617569948 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb034051550 con 0x7fb04406db80 2023-10-06T02:27:26.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.804+0000 7fb04359e700 1 -- 172.21.15.37:0/617569948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb044064b00 con 0x7fb04406db80 2023-10-06T02:27:26.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.804+0000 7fb03a7fc700 1 -- 172.21.15.37:0/617569948 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+3840 (secure 0 0 0) 0x7fb034054b70 con 0x7fb04406db80 2023-10-06T02:27:26.805 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:26.805 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/1914186828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1914186828},{"type":"v1","addr":"172.21.15.191:6836","nonce":1914186828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3684230798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":3684230798},{"type":"v1","addr":"172.21.15.191:6837","nonce":3684230798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1883185549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1883185549},{"type":"v1","addr":"172.21.15.37:6834","nonce":1883185549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":38,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:25:48.166318+0000","modified":"2023-10-06T02:27:26.100977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:27:26.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.806+0000 7fb04359e700 1 -- 172.21.15.37:0/617569948 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb024066f30 msgr2=0x7fb0240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.806+0000 7fb04359e700 1 --2- 172.21.15.37:0/617569948 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb024066f30 0x7fb0240693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb0440c40a0 tx=0x7fb02c008040 comp rx=0 tx=0).stop 2023-10-06T02:27:26.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.806+0000 7fb04359e700 1 -- 172.21.15.37:0/617569948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04406db80 msgr2=0x7fb0440c66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.806+0000 7fb04359e700 1 --2- 172.21.15.37:0/617569948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04406db80 0x7fb0440c66d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb03400c600 tx=0x7fb034007f60 comp rx=0 tx=0).stop 2023-10-06T02:27:26.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.806+0000 7fb04359e700 1 -- 172.21.15.37:0/617569948 shutdown_connections 2023-10-06T02:27:26.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.806+0000 7fb04359e700 1 --2- 172.21.15.37:0/617569948 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb044159510 0x7fb0440c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.806+0000 7fb04359e700 1 --2- 172.21.15.37:0/617569948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04406db80 0x7fb0440c66d0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.806+0000 7fb04359e700 1 --2- 172.21.15.37:0/617569948 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb024066f30 0x7fb0240693e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.806+0000 7fb04359e700 1 --2- 172.21.15.37:0/617569948 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0440b2270 0x7fb0441518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.806+0000 7fb04359e700 1 -- 172.21.15.37:0/617569948 >> 172.21.15.37:0/617569948 conn(0x7fb04406c0b0 msgr2=0x7fb0440cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:26.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.806+0000 7fb04359e700 1 -- 172.21.15.37:0/617569948 shutdown_connections 2023-10-06T02:27:26.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.806+0000 7fb04359e700 1 -- 172.21.15.37:0/617569948 wait complete. 2023-10-06T02:27:26.808 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 38 2023-10-06T02:27:26.819 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:27:26.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.937+0000 7f73edb8c700 1 Processor -- start 2023-10-06T02:27:26.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.937+0000 7f73edb8c700 1 -- start start 2023-10-06T02:27:26.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.938+0000 7f73edb8c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73e81595a0 0x7f73e80b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.938+0000 7f73edb8c700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e815e180 con 0x7f73e806d890 2023-10-06T02:27:26.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.938+0000 7f73edb8c700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e806ced0 con 0x7f73e80cc5a0 2023-10-06T02:27:26.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.938+0000 7f73edb8c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e80b1000 con 0x7f73e81595a0 2023-10-06T02:27:26.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.938+0000 7f73e6ffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f73e806d890 0x7f73e806c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38500/0 (socket says 172.21.15.37:38500) 2023-10-06T02:27:26.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.938+0000 7f73e6ffd700 1 -- 172.21.15.37:0/2259258013 learned_addr learned my addr 172.21.15.37:0/2259258013 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:26.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e77fe700 1 --2- 172.21.15.37:0/2259258013 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73e81595a0 0x7f73e80b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e67fc700 1 -- 172.21.15.37:0/2259258013 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3701661731 0 0) 0x7f73e815e180 con 0x7f73e806d890 2023-10-06T02:27:26.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e67fc700 1 -- 172.21.15.37:0/2259258013 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73d0003570 con 0x7f73e806d890 2023-10-06T02:27:26.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e67fc700 1 -- 172.21.15.37:0/2259258013 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3532530871 0 0) 0x7f73d0003570 con 0x7f73e806d890 2023-10-06T02:27:26.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e67fc700 1 -- 172.21.15.37:0/2259258013 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73e81595a0 msgr2=0x7f73e80b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:26.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e67fc700 1 --2- 172.21.15.37:0/2259258013 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73e81595a0 0x7f73e80b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e67fc700 1 -- 172.21.15.37:0/2259258013 >> v1:172.21.15.191:6789/0 conn(0x7f73e80cc5a0 legacy=0x7f73e806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e67fc700 1 -- 172.21.15.37:0/2259258013 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e815d570 con 0x7f73e806d890 2023-10-06T02:27:26.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e67fc700 1 -- 172.21.15.37:0/2259258013 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f73dc001470 con 0x7f73e806d890 2023-10-06T02:27:26.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e67fc700 1 -- 172.21.15.37:0/2259258013 >> v1:172.21.15.37:6789/0 conn(0x7f73e806d890 legacy=0x7f73e806c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e67fc700 1 --2- 172.21.15.37:0/2259258013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73d0003a90 0x7f73d0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e67fc700 1 --2- 172.21.15.37:0/2259258013 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73e81595a0 0x7f73d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e67fc700 1 --2- 172.21.15.37:0/2259258013 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73d0004d50 0x7f73d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e67fc700 1 -- 172.21.15.37:0/2259258013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e80b1000 con 0x7f73d0003a90 2023-10-06T02:27:26.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e67fc700 1 -- 172.21.15.37:0/2259258013 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d000bb70 con 0x7f73d0004d50 2023-10-06T02:27:26.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e67fc700 1 -- 172.21.15.37:0/2259258013 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d000bd30 con 0x7f73e81595a0 2023-10-06T02:27:26.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e77fe700 1 --2- 172.21.15.37:0/2259258013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73d0003a90 0x7f73d0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e6ffd700 1 --2- 172.21.15.37:0/2259258013 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73e81595a0 0x7f73d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e7fff700 1 --2- 172.21.15.37:0/2259258013 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73d0004d50 0x7f73d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e77fe700 1 -- 172.21.15.37:0/2259258013 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73e81595a0 msgr2=0x7f73d0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e77fe700 1 --2- 172.21.15.37:0/2259258013 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73e81595a0 0x7f73d0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e77fe700 1 -- 172.21.15.37:0/2259258013 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73d0004d50 msgr2=0x7f73d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e77fe700 1 --2- 172.21.15.37:0/2259258013 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73d0004d50 0x7f73d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.939+0000 7f73e77fe700 1 -- 172.21.15.37:0/2259258013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d0003570 con 0x7f73d0003a90 2023-10-06T02:27:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.940+0000 7f73e6ffd700 1 --2- 172.21.15.37:0/2259258013 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73e81595a0 0x7f73d0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.940+0000 7f73e77fe700 1 --2- 172.21.15.37:0/2259258013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73d0003a90 0x7f73d0003e60 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f73d8009c00 tx=0x7f73d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d02ffff8be34f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.940+0000 7f73e67fc700 1 -- 172.21.15.37:0/2259258013 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d800e710 con 0x7f73d0003a90 2023-10-06T02:27:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.940+0000 7f73e67fc700 1 -- 172.21.15.37:0/2259258013 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d800e870 con 0x7f73d0003a90 2023-10-06T02:27:26.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.940+0000 7f73e67fc700 1 -- 172.21.15.37:0/2259258013 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d800ec30 con 0x7f73d0003a90 2023-10-06T02:27:26.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.940+0000 7f73edb8c700 1 -- 172.21.15.37:0/2259258013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73d0003a90 msgr2=0x7f73d0003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.940+0000 7f73edb8c700 1 --2- 172.21.15.37:0/2259258013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73d0003a90 0x7f73d0003e60 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f73d8009c00 tx=0x7f73d80091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.940+0000 7f73e7fff700 1 -- 172.21.15.37:0/2259258013 reap_dead start 2023-10-06T02:27:26.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.940+0000 7f73edb8c700 1 -- 172.21.15.37:0/2259258013 shutdown_connections 2023-10-06T02:27:26.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.940+0000 7f73edb8c700 1 -- 172.21.15.37:0/2259258013 >> 172.21.15.37:0/2259258013 conn(0x7f73e80d04d0 msgr2=0x7f73e80d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:26.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.940+0000 7f73edb8c700 1 -- 172.21.15.37:0/2259258013 shutdown_connections 2023-10-06T02:27:26.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.940+0000 7f73edb8c700 1 -- 172.21.15.37:0/2259258013 wait complete. 2023-10-06T02:27:26.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.942+0000 7f73edb8c700 1 Processor -- start 2023-10-06T02:27:26.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.942+0000 7f73edb8c700 1 -- start start 2023-10-06T02:27:26.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.942+0000 7f73edb8c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73d0003a90 0x7f73e80c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.942+0000 7f73edb8c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73e8149990 0x7f73e80c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.942+0000 7f73edb8c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73e80c4170 0x7f73e80c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.942+0000 7f73edb8c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e80c5220 con 0x7f73d0003a90 2023-10-06T02:27:26.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.942+0000 7f73edb8c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e80c4610 con 0x7f73e80c4170 2023-10-06T02:27:26.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.942+0000 7f73edb8c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e80c48f0 con 0x7f73e8149990 2023-10-06T02:27:26.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.942+0000 7f73e77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73d0003a90 0x7f73e80c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.942+0000 7f73e77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73d0003a90 0x7f73e80c56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34862/0 (socket says 172.21.15.37:34862) 2023-10-06T02:27:26.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.942+0000 7f73e77fe700 1 -- 172.21.15.37:0/1219254468 learned_addr learned my addr 172.21.15.37:0/1219254468 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:26.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.943+0000 7f73e7fff700 1 --2- 172.21.15.37:0/1219254468 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73e80c4170 0x7f73e80c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.943+0000 7f73e6ffd700 1 --2- 172.21.15.37:0/1219254468 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73e8149990 0x7f73e80c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.943+0000 7f73e77fe700 1 -- 172.21.15.37:0/1219254468 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73e8149990 msgr2=0x7f73e80c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.943+0000 7f73e77fe700 1 --2- 172.21.15.37:0/1219254468 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73e8149990 0x7f73e80c3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.943+0000 7f73e77fe700 1 -- 172.21.15.37:0/1219254468 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73e80c4170 msgr2=0x7f73e80c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:26.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.943+0000 7f73e77fe700 1 --2- 172.21.15.37:0/1219254468 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73e80c4170 0x7f73e80c61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:26.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.943+0000 7f73e77fe700 1 -- 172.21.15.37:0/1219254468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e80c4bd0 con 0x7f73d0003a90 2023-10-06T02:27:26.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.943+0000 7f73e77fe700 1 --2- 172.21.15.37:0/1219254468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73d0003a90 0x7f73e80c56b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f73d800e4b0 tx=0x7f73d801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:26.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.943+0000 7f73cf7fe700 1 -- 172.21.15.37:0/1219254468 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d8023070 con 0x7f73d0003a90 2023-10-06T02:27:26.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.943+0000 7f73cf7fe700 1 -- 172.21.15.37:0/1219254468 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d800ec10 con 0x7f73d0003a90 2023-10-06T02:27:26.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.943+0000 7f73edb8c700 1 -- 172.21.15.37:0/1219254468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e80c4eb0 con 0x7f73d0003a90 2023-10-06T02:27:26.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.943+0000 7f73cf7fe700 1 -- 172.21.15.37:0/1219254468 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d800e710 con 0x7f73d0003a90 2023-10-06T02:27:26.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.943+0000 7f73edb8c700 1 -- 172.21.15.37:0/1219254468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e8155cf0 con 0x7f73d0003a90 2023-10-06T02:27:26.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.944+0000 7f73edb8c700 1 -- 172.21.15.37:0/1219254468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e8088b20 con 0x7f73d0003a90 2023-10-06T02:27:26.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.944+0000 7f73cf7fe700 1 -- 172.21.15.37:0/1219254468 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73d8013680 con 0x7f73d0003a90 2023-10-06T02:27:26.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.945+0000 7f73cf7fe700 1 --2- 172.21.15.37:0/1219254468 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f73d4066f30 0x7f73d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:26.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.945+0000 7f73cf7fe700 1 -- 172.21.15.37:0/1219254468 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6346+0+0 (secure 0 0 0) 0x7f73d8085e60 con 0x7f73d0003a90 2023-10-06T02:27:26.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.945+0000 7f73e6ffd700 1 --2- 172.21.15.37:0/1219254468 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f73d4066f30 0x7f73d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:26.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.946+0000 7f73e6ffd700 1 --2- 172.21.15.37:0/1219254468 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f73d4066f30 0x7f73d40693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f73dc001ed0 tx=0x7f73dc001db0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:26.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:26.949+0000 7f73cf7fe700 1 -- 172.21.15.37:0/1219254468 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73d8052ed0 con 0x7f73d0003a90 2023-10-06T02:27:27.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.146+0000 7f73edb8c700 1 -- 172.21.15.37:0/1219254468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73e815d850 con 0x7f73d0003a90 2023-10-06T02:27:27.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.147+0000 7f73cf7fe700 1 -- 172.21.15.37:0/1219254468 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+17318 (secure 0 0 0) 0x7f73d8017020 con 0x7f73d0003a90 2023-10-06T02:27:27.148 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:27.148 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":61,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:27:26.100797+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:25:45.900917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T02:25:47.150749+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.1","mappings":[{"from":4,"to":3}]},{"pgid":"10.10","mappings":[{"from":4,"to":3}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/2196855571":"2023-10-07T02:27:26.100770+0000","172.21.15.37:6833/2196855571":"2023-10-07T02:27:26.100770+0000","172.21.15.37:6833/3956166862":"2023-10-07T02:26:49.342208+0000","172.21.15.37:6835/3956166862":"2023-10-07T02:26:49.342208+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:27:27.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.149+0000 7f73edb8c700 1 -- 172.21.15.37:0/1219254468 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f73d4066f30 msgr2=0x7f73d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.149+0000 7f73edb8c700 1 --2- 172.21.15.37:0/1219254468 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f73d4066f30 0x7f73d40693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f73dc001ed0 tx=0x7f73dc001db0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.149+0000 7f73edb8c700 1 -- 172.21.15.37:0/1219254468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73d0003a90 msgr2=0x7f73e80c56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.149+0000 7f73edb8c700 1 --2- 172.21.15.37:0/1219254468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73d0003a90 0x7f73e80c56b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f73d800e4b0 tx=0x7f73d801a000 comp rx=0 tx=0).stop 2023-10-06T02:27:27.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.149+0000 7f73edb8c700 1 -- 172.21.15.37:0/1219254468 shutdown_connections 2023-10-06T02:27:27.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.149+0000 7f73edb8c700 1 --2- 172.21.15.37:0/1219254468 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f73d4066f30 0x7f73d40693e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.149+0000 7f73edb8c700 1 --2- 172.21.15.37:0/1219254468 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73e80c4170 0x7f73e80c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.149+0000 7f73edb8c700 1 --2- 172.21.15.37:0/1219254468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73d0003a90 0x7f73e80c56b0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.149+0000 7f73edb8c700 1 --2- 172.21.15.37:0/1219254468 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73e8149990 0x7f73e80c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.149+0000 7f73edb8c700 1 -- 172.21.15.37:0/1219254468 >> 172.21.15.37:0/1219254468 conn(0x7f73e80d04d0 msgr2=0x7f73e81565c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:27.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.149+0000 7f73edb8c700 1 -- 172.21.15.37:0/1219254468 shutdown_connections 2023-10-06T02:27:27.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.149+0000 7f73edb8c700 1 -- 172.21.15.37:0/1219254468 wait complete. 2023-10-06T02:27:27.162 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:23:08.066048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:23:08.561964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:25:45.900917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:25:47.150749+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:27:27.162 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:27:27.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.285+0000 7f0dc2f9f700 1 Processor -- start 2023-10-06T02:27:27.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.286+0000 7f0dc2f9f700 1 -- start start 2023-10-06T02:27:27.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.286+0000 7f0dc2f9f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0dbc1593c0 0x7f0dbc159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.286+0000 7f0dc2f9f700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0dbc0b2380 0x7f0dbc0b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.286+0000 7f0dc2f9f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0dbc0ccb30 0x7f0dbc0ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.286+0000 7f0dc2f9f700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dbc0b07a0 con 0x7f0dbc0ccb30 2023-10-06T02:27:27.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.286+0000 7f0dc2f9f700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dbc0cd8a0 con 0x7f0dbc0b2380 2023-10-06T02:27:27.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.286+0000 7f0dc2f9f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc0afe70 con 0x7f0dbc1593c0 2023-10-06T02:27:27.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.286+0000 7f0dc153c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0dbc0ccb30 0x7f0dbc0ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.287+0000 7f0dc153c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0dbc0ccb30 0x7f0dbc0ccfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34872/0 (socket says 172.21.15.37:34872) 2023-10-06T02:27:27.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.287+0000 7f0dc153c700 1 -- 172.21.15.37:0/726481698 learned_addr learned my addr 172.21.15.37:0/726481698 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:27.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.287+0000 7f0dbbfff700 1 --2- 172.21.15.37:0/726481698 >> v2:172.21.15.191:3300/0 conn(0x7f0dbc0b2380 0x7f0dbc0b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.287+0000 7f0dc0d3b700 1 --2- 172.21.15.37:0/726481698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0dbc1593c0 0x7f0dbc159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.287+0000 7f0dc153c700 1 -- 172.21.15.37:0/726481698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0dbc1593c0 msgr2=0x7f0dbc159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:27.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.287+0000 7f0dc153c700 1 --2- 172.21.15.37:0/726481698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0dbc1593c0 0x7f0dbc159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.287+0000 7f0dc153c700 1 -- 172.21.15.37:0/726481698 >> v2:172.21.15.191:3300/0 conn(0x7f0dbc0b2380 msgr2=0x7f0dbc0b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:27.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.287+0000 7f0dc153c700 1 --2- 172.21.15.37:0/726481698 >> v2:172.21.15.191:3300/0 conn(0x7f0dbc0b2380 0x7f0dbc0b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.287+0000 7f0dc153c700 1 -- 172.21.15.37:0/726481698 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc0b0150 con 0x7f0dbc0ccb30 2023-10-06T02:27:27.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.287+0000 7f0dbbfff700 1 --2- 172.21.15.37:0/726481698 >> v2:172.21.15.191:3300/0 conn(0x7f0dbc0b2380 0x7f0dbc0b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:27.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.287+0000 7f0dc153c700 1 --2- 172.21.15.37:0/726481698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dbc0ccb30 0x7f0dbc0ccfb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc06d430 tx=0x7f0db4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5cda2ea07d8ec5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:27.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.287+0000 7f0dbb7fe700 1 -- 172.21.15.37:0/726481698 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db400e070 con 0x7f0dbc0ccb30 2023-10-06T02:27:27.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.287+0000 7f0dbb7fe700 1 -- 172.21.15.37:0/726481698 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db400ba50 con 0x7f0dbc0ccb30 2023-10-06T02:27:27.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.287+0000 7f0dbb7fe700 1 -- 172.21.15.37:0/726481698 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db40092e0 con 0x7f0dbc0ccb30 2023-10-06T02:27:27.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.288+0000 7f0dc2f9f700 1 -- 172.21.15.37:0/726481698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dbc0ccb30 msgr2=0x7f0dbc0ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.288+0000 7f0dc2f9f700 1 --2- 172.21.15.37:0/726481698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dbc0ccb30 0x7f0dbc0ccfb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc06d430 tx=0x7f0db4009840 comp rx=0 tx=0).stop 2023-10-06T02:27:27.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.288+0000 7f0dc2f9f700 1 -- 172.21.15.37:0/726481698 shutdown_connections 2023-10-06T02:27:27.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.288+0000 7f0dc2f9f700 1 --2- 172.21.15.37:0/726481698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dbc0ccb30 0x7f0dbc0ccfb0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.288+0000 7f0dc2f9f700 1 --2- 172.21.15.37:0/726481698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0dbc1593c0 0x7f0dbc159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.288+0000 7f0dc2f9f700 1 --2- 172.21.15.37:0/726481698 >> v2:172.21.15.191:3300/0 conn(0x7f0dbc0b2380 0x7f0dbc0b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.288+0000 7f0dc2f9f700 1 -- 172.21.15.37:0/726481698 >> 172.21.15.37:0/726481698 conn(0x7f0dbc06c0b0 msgr2=0x7f0dbc06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:27.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.288+0000 7f0dc2f9f700 1 -- 172.21.15.37:0/726481698 shutdown_connections 2023-10-06T02:27:27.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.288+0000 7f0dc2f9f700 1 -- 172.21.15.37:0/726481698 wait complete. 2023-10-06T02:27:27.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.289+0000 7f0dc2f9f700 1 Processor -- start 2023-10-06T02:27:27.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.289+0000 7f0dc2f9f700 1 -- start start 2023-10-06T02:27:27.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.290+0000 7f0dc2f9f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0dbc0b2380 0x7f0dbc16c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.290+0000 7f0dc2f9f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0dbc0ccb30 0x7f0dbc15cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.290+0000 7f0dc2f9f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dbc1593c0 0x7f0dbc0c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.290+0000 7f0dc2f9f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc15e3c0 con 0x7f0dbc1593c0 2023-10-06T02:27:27.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.290+0000 7f0dc2f9f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc15d7b0 con 0x7f0dbc0ccb30 2023-10-06T02:27:27.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.290+0000 7f0dc2f9f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc15da90 con 0x7f0dbc0b2380 2023-10-06T02:27:27.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.290+0000 7f0dc153c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dbc1593c0 0x7f0dbc0c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.290+0000 7f0dc153c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dbc1593c0 0x7f0dbc0c8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34878/0 (socket says 172.21.15.37:34878) 2023-10-06T02:27:27.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.290+0000 7f0dc153c700 1 -- 172.21.15.37:0/1424244750 learned_addr learned my addr 172.21.15.37:0/1424244750 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:27.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.290+0000 7f0dc0d3b700 1 --2- 172.21.15.37:0/1424244750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0dbc0b2380 0x7f0dbc16c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.290+0000 7f0dbbfff700 1 --2- 172.21.15.37:0/1424244750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0dbc0ccb30 0x7f0dbc15cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.290+0000 7f0dc153c700 1 -- 172.21.15.37:0/1424244750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0dbc0b2380 msgr2=0x7f0dbc16c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.290+0000 7f0dc153c700 1 --2- 172.21.15.37:0/1424244750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0dbc0b2380 0x7f0dbc16c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.290+0000 7f0dc153c700 1 -- 172.21.15.37:0/1424244750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0dbc0ccb30 msgr2=0x7f0dbc15cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.290+0000 7f0dc153c700 1 --2- 172.21.15.37:0/1424244750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0dbc0ccb30 0x7f0dbc15cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.290+0000 7f0dc153c700 1 -- 172.21.15.37:0/1424244750 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db4009ae0 con 0x7f0dbc1593c0 2023-10-06T02:27:27.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.290+0000 7f0dc153c700 1 --2- 172.21.15.37:0/1424244750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dbc1593c0 0x7f0dbc0c8a10 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0894a0 tx=0x7f0db4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:27.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.291+0000 7f0db8ff9700 1 -- 172.21.15.37:0/1424244750 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db40032f0 con 0x7f0dbc1593c0 2023-10-06T02:27:27.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.291+0000 7f0db8ff9700 1 -- 172.21.15.37:0/1424244750 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db4008ce0 con 0x7f0dbc1593c0 2023-10-06T02:27:27.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.291+0000 7f0dc2f9f700 1 -- 172.21.15.37:0/1424244750 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dbc15dd70 con 0x7f0dbc1593c0 2023-10-06T02:27:27.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.291+0000 7f0db8ff9700 1 -- 172.21.15.37:0/1424244750 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db40266b0 con 0x7f0dbc1593c0 2023-10-06T02:27:27.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.291+0000 7f0dc2f9f700 1 -- 172.21.15.37:0/1424244750 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dbc15c040 con 0x7f0dbc1593c0 2023-10-06T02:27:27.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.291+0000 7f0dc2f9f700 1 -- 172.21.15.37:0/1424244750 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dbc15e570 con 0x7f0dbc1593c0 2023-10-06T02:27:27.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.292+0000 7f0db8ff9700 1 -- 172.21.15.37:0/1424244750 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0db4003040 con 0x7f0dbc1593c0 2023-10-06T02:27:27.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.292+0000 7f0db8ff9700 1 --2- 172.21.15.37:0/1424244750 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0da8066f30 0x7f0da80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.293+0000 7f0db8ff9700 1 -- 172.21.15.37:0/1424244750 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6346+0+0 (secure 0 0 0) 0x7f0db4086690 con 0x7f0dbc1593c0 2023-10-06T02:27:27.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.293+0000 7f0dc0d3b700 1 --2- 172.21.15.37:0/1424244750 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0da8066f30 0x7f0da80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.293+0000 7f0dc0d3b700 1 --2- 172.21.15.37:0/1424244750 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0da8066f30 0x7f0da80693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0dac006fd0 tx=0x7f0dac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:27.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.297+0000 7f0db8ff9700 1 -- 172.21.15.37:0/1424244750 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0dbc15e570 con 0x7f0dbc1593c0 2023-10-06T02:27:27.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.490+0000 7f0dc2f9f700 1 -- 172.21.15.37:0/1424244750 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0dbc15e570 con 0x7f0dbc1593c0 2023-10-06T02:27:27.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.491+0000 7f0db8ff9700 1 -- 172.21.15.37:0/1424244750 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v61) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0dbc15e570 con 0x7f0dbc1593c0 2023-10-06T02:27:27.491 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T02:27:27.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.493+0000 7f0dc2f9f700 1 -- 172.21.15.37:0/1424244750 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0da8066f30 msgr2=0x7f0da80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.493+0000 7f0dc2f9f700 1 --2- 172.21.15.37:0/1424244750 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0da8066f30 0x7f0da80693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0dac006fd0 tx=0x7f0dac008040 comp rx=0 tx=0).stop 2023-10-06T02:27:27.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.493+0000 7f0dc2f9f700 1 -- 172.21.15.37:0/1424244750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dbc1593c0 msgr2=0x7f0dbc0c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.493+0000 7f0dc2f9f700 1 --2- 172.21.15.37:0/1424244750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dbc1593c0 0x7f0dbc0c8a10 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0894a0 tx=0x7f0db4018000 comp rx=0 tx=0).stop 2023-10-06T02:27:27.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.493+0000 7f0dc2f9f700 1 -- 172.21.15.37:0/1424244750 shutdown_connections 2023-10-06T02:27:27.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.493+0000 7f0dc2f9f700 1 --2- 172.21.15.37:0/1424244750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dbc1593c0 0x7f0dbc0c8a10 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.493+0000 7f0dc2f9f700 1 --2- 172.21.15.37:0/1424244750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0dbc0b2380 0x7f0dbc16c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.493+0000 7f0dc2f9f700 1 --2- 172.21.15.37:0/1424244750 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0da8066f30 0x7f0da80693e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.493+0000 7f0dc2f9f700 1 --2- 172.21.15.37:0/1424244750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0dbc0ccb30 0x7f0dbc15cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.493+0000 7f0dc2f9f700 1 -- 172.21.15.37:0/1424244750 >> 172.21.15.37:0/1424244750 conn(0x7f0dbc06c0b0 msgr2=0x7f0dbc1585c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:27.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.493+0000 7f0dc2f9f700 1 -- 172.21.15.37:0/1424244750 shutdown_connections 2023-10-06T02:27:27.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.493+0000 7f0dc2f9f700 1 -- 172.21.15.37:0/1424244750 wait complete. 2023-10-06T02:27:27.506 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:27:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.626+0000 7f6f6e8b4700 1 Processor -- start 2023-10-06T02:27:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.627+0000 7f6f6e8b4700 1 -- start start 2023-10-06T02:27:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.627+0000 7f6f6e8b4700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6f680c90f0 0x7f6f680cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.627+0000 7f6f6e8b4700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6806ddd0 con 0x7f6f68142bf0 2023-10-06T02:27:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.627+0000 7f6f6e8b4700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6806d1c0 con 0x7f6f68142fc0 2023-10-06T02:27:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.627+0000 7f6f6e8b4700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6806d4a0 con 0x7f6f680c90f0 2023-10-06T02:27:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.627+0000 7f6f67fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6f68142bf0 0x7f6f6806e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38512/0 (socket says 172.21.15.37:38512) 2023-10-06T02:27:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.628+0000 7f6f67fff700 1 -- 172.21.15.37:0/3385200494 learned_addr learned my addr 172.21.15.37:0/3385200494 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.628+0000 7f6f6ce51700 1 --2- 172.21.15.37:0/3385200494 >> v2:172.21.15.191:3300/0 conn(0x7f6f680c90f0 0x7f6f680cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.628+0000 7f6f66ffd700 1 -- 172.21.15.37:0/3385200494 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646140573 0 0) 0x7f6f6806ddd0 con 0x7f6f68142bf0 2023-10-06T02:27:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.628+0000 7f6f66ffd700 1 -- 172.21.15.37:0/3385200494 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f50003570 con 0x7f6f68142bf0 2023-10-06T02:27:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.628+0000 7f6f66ffd700 1 -- 172.21.15.37:0/3385200494 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529635656 0 0) 0x7f6f6806d1c0 con 0x7f6f68142fc0 2023-10-06T02:27:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.628+0000 7f6f66ffd700 1 -- 172.21.15.37:0/3385200494 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f6806ddd0 con 0x7f6f68142fc0 2023-10-06T02:27:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.628+0000 7f6f6ce51700 1 -- 172.21.15.37:0/3385200494 >> v1:172.21.15.191:6789/0 conn(0x7f6f68142fc0 legacy=0x7f6f680c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.628+0000 7f6f6ce51700 1 -- 172.21.15.37:0/3385200494 >> v1:172.21.15.37:6789/0 conn(0x7f6f68142bf0 legacy=0x7f6f6806e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.628+0000 7f6f6ce51700 1 -- 172.21.15.37:0/3385200494 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6806d780 con 0x7f6f680c90f0 2023-10-06T02:27:27.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.628+0000 7f6f6ce51700 1 --2- 172.21.15.37:0/3385200494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f680c90f0 0x7f6f680cada0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6f60009e60 tx=0x7f6f60009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43e29d9b16292c09 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:27.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.628+0000 7f6f66ffd700 1 -- 172.21.15.37:0/3385200494 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6000e070 con 0x7f6f680c90f0 2023-10-06T02:27:27.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.628+0000 7f6f66ffd700 1 -- 172.21.15.37:0/3385200494 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6000bab0 con 0x7f6f680c90f0 2023-10-06T02:27:27.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.628+0000 7f6f66ffd700 1 -- 172.21.15.37:0/3385200494 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6000be50 con 0x7f6f680c90f0 2023-10-06T02:27:27.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.629+0000 7f6f6e8b4700 1 -- 172.21.15.37:0/3385200494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f680c90f0 msgr2=0x7f6f680cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.629+0000 7f6f6e8b4700 1 --2- 172.21.15.37:0/3385200494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f680c90f0 0x7f6f680cada0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6f60009e60 tx=0x7f6f60009780 comp rx=0 tx=0).stop 2023-10-06T02:27:27.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.629+0000 7f6f6e8b4700 1 -- 172.21.15.37:0/3385200494 shutdown_connections 2023-10-06T02:27:27.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.629+0000 7f6f6e8b4700 1 --2- 172.21.15.37:0/3385200494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f680c90f0 0x7f6f680cada0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.629+0000 7f6f6e8b4700 1 -- 172.21.15.37:0/3385200494 >> 172.21.15.37:0/3385200494 conn(0x7f6f680ce3a0 msgr2=0x7f6f680ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:27.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.629+0000 7f6f6e8b4700 1 -- 172.21.15.37:0/3385200494 shutdown_connections 2023-10-06T02:27:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.629+0000 7f6f6e8b4700 1 -- 172.21.15.37:0/3385200494 wait complete. 2023-10-06T02:27:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.630+0000 7f6f6e8b4700 1 Processor -- start 2023-10-06T02:27:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.630+0000 7f6f6e8b4700 1 -- start start 2023-10-06T02:27:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.631+0000 7f6f6e8b4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f680c90f0 0x7f6f680adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.631+0000 7f6f6e8b4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6f68142bf0 0x7f6f680b3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.631+0000 7f6f6e8b4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f68142fc0 0x7f6f68159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.631+0000 7f6f6e8b4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680b3790 con 0x7f6f68142fc0 2023-10-06T02:27:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.631+0000 7f6f6e8b4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f681595b0 con 0x7f6f680c90f0 2023-10-06T02:27:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.631+0000 7f6f6e8b4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680aed90 con 0x7f6f68142bf0 2023-10-06T02:27:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.631+0000 7f6f6ce51700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f68142fc0 0x7f6f68159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.631+0000 7f6f6ce51700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f68142fc0 0x7f6f68159070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34890/0 (socket says 172.21.15.37:34890) 2023-10-06T02:27:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.631+0000 7f6f6ce51700 1 -- 172.21.15.37:0/1876837349 learned_addr learned my addr 172.21.15.37:0/1876837349 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.631+0000 7f6f67fff700 1 --2- 172.21.15.37:0/1876837349 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f680c90f0 0x7f6f680adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.631+0000 7f6f677fe700 1 --2- 172.21.15.37:0/1876837349 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6f68142bf0 0x7f6f680b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.631+0000 7f6f6ce51700 1 -- 172.21.15.37:0/1876837349 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6f68142bf0 msgr2=0x7f6f680b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.631+0000 7f6f6ce51700 1 --2- 172.21.15.37:0/1876837349 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6f68142bf0 0x7f6f680b3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.631+0000 7f6f6ce51700 1 -- 172.21.15.37:0/1876837349 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f680c90f0 msgr2=0x7f6f680adaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.631+0000 7f6f6ce51700 1 --2- 172.21.15.37:0/1876837349 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f680c90f0 0x7f6f680adaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.631+0000 7f6f6ce51700 1 -- 172.21.15.37:0/1876837349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f60009a20 con 0x7f6f68142fc0 2023-10-06T02:27:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.631+0000 7f6f6ce51700 1 --2- 172.21.15.37:0/1876837349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f68142fc0 0x7f6f68159070 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000b610 tx=0x7f6f60019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.632+0000 7f6f4ffff700 1 -- 172.21.15.37:0/1876837349 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f60009780 con 0x7f6f68142fc0 2023-10-06T02:27:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.632+0000 7f6f4ffff700 1 -- 172.21.15.37:0/1876837349 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f60012d30 con 0x7f6f68142fc0 2023-10-06T02:27:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.632+0000 7f6f6e8b4700 1 -- 172.21.15.37:0/1876837349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f680ae180 con 0x7f6f68142fc0 2023-10-06T02:27:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.632+0000 7f6f4ffff700 1 -- 172.21.15.37:0/1876837349 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f60012ea0 con 0x7f6f68142fc0 2023-10-06T02:27:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.632+0000 7f6f6e8b4700 1 -- 172.21.15.37:0/1876837349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f680ae740 con 0x7f6f68142fc0 2023-10-06T02:27:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.633+0000 7f6f6e8b4700 1 -- 172.21.15.37:0/1876837349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f680aeed0 con 0x7f6f68142fc0 2023-10-06T02:27:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.633+0000 7f6f4ffff700 1 -- 172.21.15.37:0/1876837349 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f600248e0 con 0x7f6f68142fc0 2023-10-06T02:27:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.633+0000 7f6f4ffff700 1 --2- 172.21.15.37:0/1876837349 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6f54067000 0x7f6f540694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.633+0000 7f6f4ffff700 1 -- 172.21.15.37:0/1876837349 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6346+0+0 (secure 0 0 0) 0x7f6f600860f0 con 0x7f6f68142fc0 2023-10-06T02:27:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.634+0000 7f6f67fff700 1 --2- 172.21.15.37:0/1876837349 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6f54067000 0x7f6f540694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.634+0000 7f6f67fff700 1 --2- 172.21.15.37:0/1876837349 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6f54067000 0x7f6f540694b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c007fd0 tx=0x7f6f5c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.638+0000 7f6f4ffff700 1 -- 172.21.15.37:0/1876837349 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f680aeed0 con 0x7f6f68142fc0 2023-10-06T02:27:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.833+0000 7f6f6e8b4700 1 -- 172.21.15.37:0/1876837349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f680aeed0 con 0x7f6f68142fc0 2023-10-06T02:27:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.834+0000 7f6f4ffff700 1 -- 172.21.15.37:0/1876837349 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f680aeed0 con 0x7f6f68142fc0 2023-10-06T02:27:27.834 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T02:27:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.836+0000 7f6f6e8b4700 1 -- 172.21.15.37:0/1876837349 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6f54067000 msgr2=0x7f6f540694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.836+0000 7f6f6e8b4700 1 --2- 172.21.15.37:0/1876837349 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6f54067000 0x7f6f540694b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c007fd0 tx=0x7f6f5c009040 comp rx=0 tx=0).stop 2023-10-06T02:27:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.836+0000 7f6f6e8b4700 1 -- 172.21.15.37:0/1876837349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f68142fc0 msgr2=0x7f6f68159070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.836+0000 7f6f6e8b4700 1 --2- 172.21.15.37:0/1876837349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f68142fc0 0x7f6f68159070 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000b610 tx=0x7f6f60019000 comp rx=0 tx=0).stop 2023-10-06T02:27:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.836+0000 7f6f6e8b4700 1 -- 172.21.15.37:0/1876837349 shutdown_connections 2023-10-06T02:27:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.836+0000 7f6f6e8b4700 1 --2- 172.21.15.37:0/1876837349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f68142fc0 0x7f6f68159070 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.836+0000 7f6f6e8b4700 1 --2- 172.21.15.37:0/1876837349 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6f54067000 0x7f6f540694b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.836+0000 7f6f6e8b4700 1 --2- 172.21.15.37:0/1876837349 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f680c90f0 0x7f6f680adaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.836+0000 7f6f6e8b4700 1 --2- 172.21.15.37:0/1876837349 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6f68142bf0 0x7f6f680b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.836+0000 7f6f6e8b4700 1 -- 172.21.15.37:0/1876837349 >> 172.21.15.37:0/1876837349 conn(0x7f6f680ce3a0 msgr2=0x7f6f680ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.836+0000 7f6f6e8b4700 1 -- 172.21.15.37:0/1876837349 shutdown_connections 2023-10-06T02:27:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.836+0000 7f6f6e8b4700 1 -- 172.21.15.37:0/1876837349 wait complete. 2023-10-06T02:27:27.848 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:27:27.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.970+0000 7f3bfe208700 1 Processor -- start 2023-10-06T02:27:27.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.970+0000 7f3bfe208700 1 -- start start 2023-10-06T02:27:27.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.971+0000 7f3bfe208700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3bf81593c0 0x7f3bf8159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.971+0000 7f3bfe208700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bf80b2380 0x7f3bf80b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.971+0000 7f3bfe208700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f3bf80ccb30 0x7f3bf80ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.971+0000 7f3bfe208700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf80b07a0 con 0x7f3bf81593c0 2023-10-06T02:27:27.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.971+0000 7f3bfe208700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf80cd8a0 con 0x7f3bf80ccb30 2023-10-06T02:27:27.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.971+0000 7f3bfe208700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf80afe70 con 0x7f3bf80b2380 2023-10-06T02:27:27.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.971+0000 7f3bf77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3bf81593c0 0x7f3bf8159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.971+0000 7f3bf77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3bf81593c0 0x7f3bf8159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34904/0 (socket says 172.21.15.37:34904) 2023-10-06T02:27:27.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.971+0000 7f3bf77fe700 1 -- 172.21.15.37:0/2331658456 learned_addr learned my addr 172.21.15.37:0/2331658456 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:27.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.971+0000 7f3bf6ffd700 1 --2- 172.21.15.37:0/2331658456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bf80b2380 0x7f3bf80b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.971+0000 7f3bf7fff700 1 --2- 172.21.15.37:0/2331658456 >> v2:172.21.15.191:3300/0 conn(0x7f3bf80ccb30 0x7f3bf80ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.971+0000 7f3bf77fe700 1 -- 172.21.15.37:0/2331658456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bf80b2380 msgr2=0x7f3bf80b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:27.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.971+0000 7f3bf77fe700 1 --2- 172.21.15.37:0/2331658456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bf80b2380 0x7f3bf80b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.971+0000 7f3bf77fe700 1 -- 172.21.15.37:0/2331658456 >> v2:172.21.15.191:3300/0 conn(0x7f3bf80ccb30 msgr2=0x7f3bf80ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:27.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.971+0000 7f3bf77fe700 1 --2- 172.21.15.37:0/2331658456 >> v2:172.21.15.191:3300/0 conn(0x7f3bf80ccb30 0x7f3bf80ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.971+0000 7f3bf77fe700 1 -- 172.21.15.37:0/2331658456 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf80b0150 con 0x7f3bf81593c0 2023-10-06T02:27:27.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.971+0000 7f3bf77fe700 1 --2- 172.21.15.37:0/2331658456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf81593c0 0x7f3bf8159790 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80cc940 tx=0x7f3be8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2760507daecf31 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:27.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.971+0000 7f3bf67fc700 1 -- 172.21.15.37:0/2331658456 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be800b860 con 0x7f3bf81593c0 2023-10-06T02:27:27.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.972+0000 7f3bf67fc700 1 -- 172.21.15.37:0/2331658456 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be800b9c0 con 0x7f3bf81593c0 2023-10-06T02:27:27.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.972+0000 7f3bf67fc700 1 -- 172.21.15.37:0/2331658456 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be800bd60 con 0x7f3bf81593c0 2023-10-06T02:27:27.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.972+0000 7f3bfe208700 1 -- 172.21.15.37:0/2331658456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf81593c0 msgr2=0x7f3bf8159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.972+0000 7f3bfe208700 1 --2- 172.21.15.37:0/2331658456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf81593c0 0x7f3bf8159790 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80cc940 tx=0x7f3be8009250 comp rx=0 tx=0).stop 2023-10-06T02:27:27.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.972+0000 7f3bfe208700 1 -- 172.21.15.37:0/2331658456 shutdown_connections 2023-10-06T02:27:27.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.972+0000 7f3bfe208700 1 --2- 172.21.15.37:0/2331658456 >> v2:172.21.15.191:3300/0 conn(0x7f3bf80ccb30 0x7f3bf80ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.972+0000 7f3bfe208700 1 --2- 172.21.15.37:0/2331658456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf81593c0 0x7f3bf8159790 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.972+0000 7f3bfe208700 1 --2- 172.21.15.37:0/2331658456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bf80b2380 0x7f3bf80b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.972+0000 7f3bfe208700 1 -- 172.21.15.37:0/2331658456 >> 172.21.15.37:0/2331658456 conn(0x7f3bf806c0b0 msgr2=0x7f3bf806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:27.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.972+0000 7f3bfe208700 1 -- 172.21.15.37:0/2331658456 shutdown_connections 2023-10-06T02:27:27.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.972+0000 7f3bfe208700 1 -- 172.21.15.37:0/2331658456 wait complete. 2023-10-06T02:27:27.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.973+0000 7f3bfe208700 1 Processor -- start 2023-10-06T02:27:27.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.973+0000 7f3bfe208700 1 -- start start 2023-10-06T02:27:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.974+0000 7f3bfe208700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80b2380 0x7f3bf80c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.974+0000 7f3bfe208700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bf80ccb30 0x7f3bf8157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.974+0000 7f3bfe208700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bf81593c0 0x7f3bf815ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.974+0000 7f3bfe208700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf81696d0 con 0x7f3bf80b2380 2023-10-06T02:27:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.974+0000 7f3bfe208700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf8158310 con 0x7f3bf81593c0 2023-10-06T02:27:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.974+0000 7f3bfe208700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf815b280 con 0x7f3bf80ccb30 2023-10-06T02:27:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.974+0000 7f3bf77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80b2380 0x7f3bf80c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.974+0000 7f3bf77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80b2380 0x7f3bf80c64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34920/0 (socket says 172.21.15.37:34920) 2023-10-06T02:27:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.974+0000 7f3bf77fe700 1 -- 172.21.15.37:0/1348271282 learned_addr learned my addr 172.21.15.37:0/1348271282 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.974+0000 7f3bf6ffd700 1 --2- 172.21.15.37:0/1348271282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bf80ccb30 0x7f3bf8157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.974+0000 7f3bf7fff700 1 --2- 172.21.15.37:0/1348271282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bf81593c0 0x7f3bf815ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.974+0000 7f3bf77fe700 1 -- 172.21.15.37:0/1348271282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bf80ccb30 msgr2=0x7f3bf8157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.975+0000 7f3bf77fe700 1 --2- 172.21.15.37:0/1348271282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bf80ccb30 0x7f3bf8157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.975+0000 7f3bf77fe700 1 -- 172.21.15.37:0/1348271282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bf81593c0 msgr2=0x7f3bf815ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.975+0000 7f3bf77fe700 1 --2- 172.21.15.37:0/1348271282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bf81593c0 0x7f3bf815ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.975+0000 7f3bf77fe700 1 -- 172.21.15.37:0/1348271282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be80094f0 con 0x7f3bf80b2380 2023-10-06T02:27:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.975+0000 7f3bf77fe700 1 --2- 172.21.15.37:0/1348271282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80b2380 0x7f3bf80c64b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80894a0 tx=0x7f3be8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.975+0000 7f3bdf7fe700 1 -- 172.21.15.37:0/1348271282 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8011dc0 con 0x7f3bf80b2380 2023-10-06T02:27:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.975+0000 7f3bdf7fe700 1 -- 172.21.15.37:0/1348271282 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be8024440 con 0x7f3bf80b2380 2023-10-06T02:27:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.975+0000 7f3bfe208700 1 -- 172.21.15.37:0/1348271282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf80c6b70 con 0x7f3bf80b2380 2023-10-06T02:27:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.975+0000 7f3bdf7fe700 1 -- 172.21.15.37:0/1348271282 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8024800 con 0x7f3bf80b2380 2023-10-06T02:27:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.975+0000 7f3bfe208700 1 -- 172.21.15.37:0/1348271282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf80c7130 con 0x7f3bf80b2380 2023-10-06T02:27:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.976+0000 7f3bfe208700 1 -- 172.21.15.37:0/1348271282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf80c7350 con 0x7f3bf80b2380 2023-10-06T02:27:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.976+0000 7f3bdf7fe700 1 -- 172.21.15.37:0/1348271282 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3be801a420 con 0x7f3bf80b2380 2023-10-06T02:27:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.976+0000 7f3bdf7fe700 1 --2- 172.21.15.37:0/1348271282 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3be4066f30 0x7f3be40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.977+0000 7f3bdf7fe700 1 -- 172.21.15.37:0/1348271282 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6346+0+0 (secure 0 0 0) 0x7f3be8086510 con 0x7f3bf80b2380 2023-10-06T02:27:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.977+0000 7f3bf6ffd700 1 --2- 172.21.15.37:0/1348271282 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3be4066f30 0x7f3be40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.977+0000 7f3bf6ffd700 1 --2- 172.21.15.37:0/1348271282 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3be4066f30 0x7f3be40693e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80b3ca0 tx=0x7f3bec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:27.981+0000 7f3bdf7fe700 1 -- 172.21.15.37:0/1348271282 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3be8053500 con 0x7f3bf80b2380 2023-10-06T02:27:28.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.175+0000 7f3bfe208700 1 -- 172.21.15.37:0/1348271282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3bf80b0430 con 0x7f3bf80b2380 2023-10-06T02:27:28.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.176+0000 7f3bdf7fe700 1 -- 172.21.15.37:0/1348271282 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3be8056b20 con 0x7f3bf80b2380 2023-10-06T02:27:28.176 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T02:27:28.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.178+0000 7f3bfe208700 1 -- 172.21.15.37:0/1348271282 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3be4066f30 msgr2=0x7f3be40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.178+0000 7f3bfe208700 1 --2- 172.21.15.37:0/1348271282 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3be4066f30 0x7f3be40693e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80b3ca0 tx=0x7f3bec008040 comp rx=0 tx=0).stop 2023-10-06T02:27:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.178+0000 7f3bfe208700 1 -- 172.21.15.37:0/1348271282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80b2380 msgr2=0x7f3bf80c64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.178+0000 7f3bfe208700 1 --2- 172.21.15.37:0/1348271282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80b2380 0x7f3bf80c64b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80894a0 tx=0x7f3be8017000 comp rx=0 tx=0).stop 2023-10-06T02:27:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.178+0000 7f3bfe208700 1 -- 172.21.15.37:0/1348271282 shutdown_connections 2023-10-06T02:27:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.178+0000 7f3bfe208700 1 --2- 172.21.15.37:0/1348271282 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3be4066f30 0x7f3be40693e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.178+0000 7f3bfe208700 1 --2- 172.21.15.37:0/1348271282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bf81593c0 0x7f3bf815ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.178+0000 7f3bfe208700 1 --2- 172.21.15.37:0/1348271282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80b2380 0x7f3bf80c64b0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.178+0000 7f3bfe208700 1 --2- 172.21.15.37:0/1348271282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bf80ccb30 0x7f3bf8157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.178+0000 7f3bfe208700 1 -- 172.21.15.37:0/1348271282 >> 172.21.15.37:0/1348271282 conn(0x7f3bf806c0b0 msgr2=0x7f3bf80b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.178+0000 7f3bfe208700 1 -- 172.21.15.37:0/1348271282 shutdown_connections 2023-10-06T02:27:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.178+0000 7f3bfe208700 1 -- 172.21.15.37:0/1348271282 wait complete. 2023-10-06T02:27:28.191 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:27:28.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.312+0000 7f18a4aa6700 1 Processor -- start 2023-10-06T02:27:28.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.312+0000 7f18a4aa6700 1 -- start start 2023-10-06T02:27:28.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.313+0000 7f18a4aa6700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18a0159610 0x7f18a00b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:28.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.313+0000 7f18a4aa6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18a00b3310 0x7f18a00b4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:28.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.313+0000 7f18a4aa6700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a00b43b0 con 0x7f18a01599e0 2023-10-06T02:27:28.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.313+0000 7f18a4aa6700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a00cde50 con 0x7f18a0159610 2023-10-06T02:27:28.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.313+0000 7f18a4aa6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00b1020 con 0x7f18a00b3310 2023-10-06T02:27:28.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.313+0000 7f189e59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18a0159610 0x7f18a00b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:28.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.313+0000 7f189dd9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f18a01599e0 0x7f18a00d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38516/0 (socket says 172.21.15.37:38516) 2023-10-06T02:27:28.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.313+0000 7f189dd9b700 1 -- 172.21.15.37:0/3819685284 learned_addr learned my addr 172.21.15.37:0/3819685284 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:28.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.313+0000 7f189ed9d700 1 --2- 172.21.15.37:0/3819685284 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18a00b3310 0x7f18a00b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:28.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.313+0000 7f189e59c700 1 -- 172.21.15.37:0/3819685284 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18a00b3310 msgr2=0x7f18a00b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:28.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.313+0000 7f189e59c700 1 --2- 172.21.15.37:0/3819685284 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18a00b3310 0x7f18a00b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.313+0000 7f189e59c700 1 -- 172.21.15.37:0/3819685284 >> v1:172.21.15.37:6789/0 conn(0x7f18a01599e0 legacy=0x7f18a00d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.313+0000 7f189d59a700 1 -- 172.21.15.37:0/3819685284 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581342636 0 0) 0x7f18a00b43b0 con 0x7f18a01599e0 2023-10-06T02:27:28.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.313+0000 7f189e59c700 1 -- 172.21.15.37:0/3819685284 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a00b37a0 con 0x7f18a0159610 2023-10-06T02:27:28.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.313+0000 7f189e59c700 1 --2- 172.21.15.37:0/3819685284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a0159610 0x7f18a00b0ae0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f18900098e0 tx=0x7f18900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c881702c31e4352 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:28.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.313+0000 7f189d59a700 1 -- 172.21.15.37:0/3819685284 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1890009e80 con 0x7f18a0159610 2023-10-06T02:27:28.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.313+0000 7f189d59a700 1 -- 172.21.15.37:0/3819685284 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189000b860 con 0x7f18a0159610 2023-10-06T02:27:28.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.313+0000 7f189d59a700 1 -- 172.21.15.37:0/3819685284 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189000bbe0 con 0x7f18a0159610 2023-10-06T02:27:28.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.314+0000 7f18a4aa6700 1 -- 172.21.15.37:0/3819685284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a0159610 msgr2=0x7f18a00b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.314+0000 7f18a4aa6700 1 --2- 172.21.15.37:0/3819685284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a0159610 0x7f18a00b0ae0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f18900098e0 tx=0x7f18900091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.314+0000 7f18a4aa6700 1 -- 172.21.15.37:0/3819685284 shutdown_connections 2023-10-06T02:27:28.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.314+0000 7f18a4aa6700 1 --2- 172.21.15.37:0/3819685284 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18a00b3310 0x7f18a00b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.314+0000 7f18a4aa6700 1 --2- 172.21.15.37:0/3819685284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a0159610 0x7f18a00b0ae0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.314+0000 7f18a4aa6700 1 -- 172.21.15.37:0/3819685284 >> 172.21.15.37:0/3819685284 conn(0x7f18a006c0b0 msgr2=0x7f18a006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:28.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.314+0000 7f18a4aa6700 1 -- 172.21.15.37:0/3819685284 shutdown_connections 2023-10-06T02:27:28.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.314+0000 7f18a4aa6700 1 -- 172.21.15.37:0/3819685284 wait complete. 2023-10-06T02:27:28.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.315+0000 7f18a4aa6700 1 Processor -- start 2023-10-06T02:27:28.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.315+0000 7f18a4aa6700 1 -- start start 2023-10-06T02:27:28.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.316+0000 7f18a4aa6700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18a00b3310 0x7f18a014d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:28.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.316+0000 7f18a4aa6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a0159610 0x7f18a00c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:28.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.316+0000 7f18a4aa6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18a01599e0 0x7f18a0155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:28.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.316+0000 7f18a4aa6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00ca090 con 0x7f18a0159610 2023-10-06T02:27:28.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.316+0000 7f18a4aa6700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00c9480 con 0x7f18a00b3310 2023-10-06T02:27:28.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.316+0000 7f18a4aa6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00c9760 con 0x7f18a01599e0 2023-10-06T02:27:28.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.316+0000 7f189dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a0159610 0x7f18a00c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:28.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.316+0000 7f189dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a0159610 0x7f18a00c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34948/0 (socket says 172.21.15.37:34948) 2023-10-06T02:27:28.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.316+0000 7f189dd9b700 1 -- 172.21.15.37:0/3555383421 learned_addr learned my addr 172.21.15.37:0/3555383421 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:28.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.316+0000 7f189ed9d700 1 --2- 172.21.15.37:0/3555383421 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18a01599e0 0x7f18a0155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:28.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.316+0000 7f189e59c700 1 --2- 172.21.15.37:0/3555383421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18a00b3310 0x7f18a014d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:28.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.316+0000 7f189dd9b700 1 -- 172.21.15.37:0/3555383421 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18a01599e0 msgr2=0x7f18a0155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.316+0000 7f189dd9b700 1 --2- 172.21.15.37:0/3555383421 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18a01599e0 0x7f18a0155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.316+0000 7f189dd9b700 1 -- 172.21.15.37:0/3555383421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18a00b3310 msgr2=0x7f18a014d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.316+0000 7f189dd9b700 1 --2- 172.21.15.37:0/3555383421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18a00b3310 0x7f18a014d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.316+0000 7f189dd9b700 1 -- 172.21.15.37:0/3555383421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1890009420 con 0x7f18a0159610 2023-10-06T02:27:28.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.316+0000 7f189e59c700 1 --2- 172.21.15.37:0/3555383421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18a00b3310 0x7f18a014d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:28.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.316+0000 7f189ed9d700 1 --2- 172.21.15.37:0/3555383421 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18a01599e0 0x7f18a0155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:28.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.317+0000 7f189dd9b700 1 --2- 172.21.15.37:0/3555383421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a0159610 0x7f18a00c89b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f189400c810 tx=0x7f1894007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:28.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.317+0000 7f188e7fc700 1 -- 172.21.15.37:0/3555383421 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894005c00 con 0x7f18a0159610 2023-10-06T02:27:28.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.317+0000 7f188e7fc700 1 -- 172.21.15.37:0/3555383421 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1894005d60 con 0x7f18a0159610 2023-10-06T02:27:28.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.317+0000 7f18a4aa6700 1 -- 172.21.15.37:0/3555383421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a00c9a40 con 0x7f18a0159610 2023-10-06T02:27:28.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.317+0000 7f188e7fc700 1 -- 172.21.15.37:0/3555383421 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894007340 con 0x7f18a0159610 2023-10-06T02:27:28.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.317+0000 7f18a4aa6700 1 -- 172.21.15.37:0/3555383421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a014de60 con 0x7f18a0159610 2023-10-06T02:27:28.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.318+0000 7f18a4aa6700 1 -- 172.21.15.37:0/3555383421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a0088b30 con 0x7f18a0159610 2023-10-06T02:27:28.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.318+0000 7f188e7fc700 1 -- 172.21.15.37:0/3555383421 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f189401b400 con 0x7f18a0159610 2023-10-06T02:27:28.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.319+0000 7f188e7fc700 1 --2- 172.21.15.37:0/3555383421 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1880066f30 0x7f18800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:28.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.319+0000 7f188e7fc700 1 -- 172.21.15.37:0/3555383421 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6346+0+0 (secure 0 0 0) 0x7f1894084330 con 0x7f18a0159610 2023-10-06T02:27:28.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.319+0000 7f189e59c700 1 --2- 172.21.15.37:0/3555383421 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1880066f30 0x7f18800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:28.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.319+0000 7f189e59c700 1 --2- 172.21.15.37:0/3555383421 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1880066f30 0x7f18800693e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1890003080 tx=0x7f1890017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.323+0000 7f188e7fc700 1 -- 172.21.15.37:0/3555383421 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1894051300 con 0x7f18a0159610 2023-10-06T02:27:28.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.517+0000 7f18a4aa6700 1 -- 172.21.15.37:0/3555383421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f18a00b3a80 con 0x7f18a0159610 2023-10-06T02:27:28.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.517+0000 7f188e7fc700 1 -- 172.21.15.37:0/3555383421 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1894054920 con 0x7f18a0159610 2023-10-06T02:27:28.518 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T02:27:28.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.519+0000 7f18a4aa6700 1 -- 172.21.15.37:0/3555383421 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1880066f30 msgr2=0x7f18800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.519+0000 7f18a4aa6700 1 --2- 172.21.15.37:0/3555383421 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1880066f30 0x7f18800693e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1890003080 tx=0x7f1890017000 comp rx=0 tx=0).stop 2023-10-06T02:27:28.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.519+0000 7f18a4aa6700 1 -- 172.21.15.37:0/3555383421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a0159610 msgr2=0x7f18a00c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.519+0000 7f18a4aa6700 1 --2- 172.21.15.37:0/3555383421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a0159610 0x7f18a00c89b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f189400c810 tx=0x7f1894007d90 comp rx=0 tx=0).stop 2023-10-06T02:27:28.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.519+0000 7f18a4aa6700 1 -- 172.21.15.37:0/3555383421 shutdown_connections 2023-10-06T02:27:28.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.519+0000 7f18a4aa6700 1 --2- 172.21.15.37:0/3555383421 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18a01599e0 0x7f18a0155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.519+0000 7f18a4aa6700 1 --2- 172.21.15.37:0/3555383421 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1880066f30 0x7f18800693e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.519+0000 7f18a4aa6700 1 --2- 172.21.15.37:0/3555383421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18a00b3310 0x7f18a014d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.519+0000 7f18a4aa6700 1 --2- 172.21.15.37:0/3555383421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a0159610 0x7f18a00c89b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.519+0000 7f18a4aa6700 1 -- 172.21.15.37:0/3555383421 >> 172.21.15.37:0/3555383421 conn(0x7f18a006c0b0 msgr2=0x7f18a015d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:28.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.519+0000 7f18a4aa6700 1 -- 172.21.15.37:0/3555383421 shutdown_connections 2023-10-06T02:27:28.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.519+0000 7f18a4aa6700 1 -- 172.21.15.37:0/3555383421 wait complete. 2023-10-06T02:27:28.531 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:28.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.651+0000 7fb4685c8700 1 Processor -- start 2023-10-06T02:27:28.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.651+0000 7fb4685c8700 1 -- start start 2023-10-06T02:27:28.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.652+0000 7fb4685c8700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb46006ad60 0x7fb46015dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:28.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.652+0000 7fb4685c8700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46006a8d0 con 0x7fb4601596d0 2023-10-06T02:27:28.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.652+0000 7fb4685c8700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb460069fa0 con 0x7fb4600c63d0 2023-10-06T02:27:28.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.652+0000 7fb4685c8700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46006b6d0 con 0x7fb46006ad60 2023-10-06T02:27:28.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.652+0000 7fb466364700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb4601596d0 0x7fb4600c5cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38522/0 (socket says 172.21.15.37:38522) 2023-10-06T02:27:28.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.652+0000 7fb466364700 1 -- 172.21.15.37:0/3472814226 learned_addr learned my addr 172.21.15.37:0/3472814226 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:28.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.652+0000 7fb466b65700 1 --2- 172.21.15.37:0/3472814226 >> v2:172.21.15.191:3300/0 conn(0x7fb46006ad60 0x7fb46015dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:28.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.652+0000 7fb465362700 1 -- 172.21.15.37:0/3472814226 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110602845 0 0) 0x7fb46006a8d0 con 0x7fb4601596d0 2023-10-06T02:27:28.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.652+0000 7fb465362700 1 -- 172.21.15.37:0/3472814226 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb44c003570 con 0x7fb4601596d0 2023-10-06T02:27:28.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.652+0000 7fb465362700 1 -- 172.21.15.37:0/3472814226 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250528638 0 0) 0x7fb460069fa0 con 0x7fb4600c63d0 2023-10-06T02:27:28.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.652+0000 7fb465362700 1 -- 172.21.15.37:0/3472814226 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb46006a8d0 con 0x7fb4600c63d0 2023-10-06T02:27:28.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.652+0000 7fb466b65700 1 -- 172.21.15.37:0/3472814226 >> v1:172.21.15.191:6789/0 conn(0x7fb4600c63d0 legacy=0x7fb4600c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.652+0000 7fb466b65700 1 -- 172.21.15.37:0/3472814226 >> v1:172.21.15.37:6789/0 conn(0x7fb4601596d0 legacy=0x7fb4600c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.652+0000 7fb466b65700 1 -- 172.21.15.37:0/3472814226 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46006a280 con 0x7fb46006ad60 2023-10-06T02:27:28.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.652+0000 7fb466b65700 1 --2- 172.21.15.37:0/3472814226 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb46006ad60 0x7fb46015dc20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb458009e60 tx=0x7fb458009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17428983c59aa5ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:28.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.653+0000 7fb465362700 1 -- 172.21.15.37:0/3472814226 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45800e070 con 0x7fb46006ad60 2023-10-06T02:27:28.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.653+0000 7fb465362700 1 -- 172.21.15.37:0/3472814226 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45800bab0 con 0x7fb46006ad60 2023-10-06T02:27:28.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.653+0000 7fb465362700 1 -- 172.21.15.37:0/3472814226 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45800be70 con 0x7fb46006ad60 2023-10-06T02:27:28.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.653+0000 7fb4685c8700 1 -- 172.21.15.37:0/3472814226 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb46006ad60 msgr2=0x7fb46015dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.653+0000 7fb4685c8700 1 --2- 172.21.15.37:0/3472814226 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb46006ad60 0x7fb46015dc20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb458009e60 tx=0x7fb458009780 comp rx=0 tx=0).stop 2023-10-06T02:27:28.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.653+0000 7fb4685c8700 1 -- 172.21.15.37:0/3472814226 shutdown_connections 2023-10-06T02:27:28.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.653+0000 7fb4685c8700 1 --2- 172.21.15.37:0/3472814226 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb46006ad60 0x7fb46015dc20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.653+0000 7fb4685c8700 1 -- 172.21.15.37:0/3472814226 >> 172.21.15.37:0/3472814226 conn(0x7fb4600cd490 msgr2=0x7fb4600c9430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:28.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.653+0000 7fb4685c8700 1 -- 172.21.15.37:0/3472814226 shutdown_connections 2023-10-06T02:27:28.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.653+0000 7fb4685c8700 1 -- 172.21.15.37:0/3472814226 wait complete. 2023-10-06T02:27:28.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.654+0000 7fb4685c8700 1 Processor -- start 2023-10-06T02:27:28.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.654+0000 7fb4685c8700 1 -- start start 2023-10-06T02:27:28.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.655+0000 7fb4685c8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb46006ad60 0x7fb4600cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:28.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.655+0000 7fb4685c8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4600c63d0 0x7fb4600ad330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:28.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.655+0000 7fb4685c8700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4601596d0 0x7fb46014d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:28.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.655+0000 7fb4685c8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4600cc620 con 0x7fb4600c63d0 2023-10-06T02:27:28.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.655+0000 7fb4685c8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4600ad870 con 0x7fb46006ad60 2023-10-06T02:27:28.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.655+0000 7fb4685c8700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4600adaf0 con 0x7fb4601596d0 2023-10-06T02:27:28.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.655+0000 7fb465b63700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4600c63d0 0x7fb4600ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:28.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.655+0000 7fb465b63700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4600c63d0 0x7fb4600ad330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34954/0 (socket says 172.21.15.37:34954) 2023-10-06T02:27:28.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.655+0000 7fb465b63700 1 -- 172.21.15.37:0/4066064810 learned_addr learned my addr 172.21.15.37:0/4066064810 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:28.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.656+0000 7fb466b65700 1 --2- 172.21.15.37:0/4066064810 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4601596d0 0x7fb46014d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:28.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.656+0000 7fb466364700 1 --2- 172.21.15.37:0/4066064810 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb46006ad60 0x7fb4600cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:28.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.656+0000 7fb465b63700 1 -- 172.21.15.37:0/4066064810 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4601596d0 msgr2=0x7fb46014d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.656+0000 7fb465b63700 1 --2- 172.21.15.37:0/4066064810 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4601596d0 0x7fb46014d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.656+0000 7fb465b63700 1 -- 172.21.15.37:0/4066064810 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb46006ad60 msgr2=0x7fb4600cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.656+0000 7fb465b63700 1 --2- 172.21.15.37:0/4066064810 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb46006ad60 0x7fb4600cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.656+0000 7fb465b63700 1 -- 172.21.15.37:0/4066064810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb458009a20 con 0x7fb4600c63d0 2023-10-06T02:27:28.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.656+0000 7fb465b63700 1 --2- 172.21.15.37:0/4066064810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4600c63d0 0x7fb4600ad330 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb45000c790 tx=0x7fb450007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:28.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.656+0000 7fb4567fc700 1 -- 172.21.15.37:0/4066064810 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb450010510 con 0x7fb4600c63d0 2023-10-06T02:27:28.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.656+0000 7fb4567fc700 1 -- 172.21.15.37:0/4066064810 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb450010670 con 0x7fb4600c63d0 2023-10-06T02:27:28.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.656+0000 7fb4685c8700 1 -- 172.21.15.37:0/4066064810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4600addd0 con 0x7fb4600c63d0 2023-10-06T02:27:28.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.656+0000 7fb4567fc700 1 -- 172.21.15.37:0/4066064810 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb450010a10 con 0x7fb4600c63d0 2023-10-06T02:27:28.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.656+0000 7fb4685c8700 1 -- 172.21.15.37:0/4066064810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4600ae390 con 0x7fb4600c63d0 2023-10-06T02:27:28.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.657+0000 7fb4685c8700 1 -- 172.21.15.37:0/4066064810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb460068c30 con 0x7fb4600c63d0 2023-10-06T02:27:28.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.657+0000 7fb4567fc700 1 -- 172.21.15.37:0/4066064810 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb45001b400 con 0x7fb4600c63d0 2023-10-06T02:27:28.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.658+0000 7fb4567fc700 1 --2- 172.21.15.37:0/4066064810 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb444066f30 0x7fb4440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:28.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.658+0000 7fb4567fc700 1 -- 172.21.15.37:0/4066064810 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6346+0+0 (secure 0 0 0) 0x7fb450084580 con 0x7fb4600c63d0 2023-10-06T02:27:28.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.658+0000 7fb466364700 1 --2- 172.21.15.37:0/4066064810 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb444066f30 0x7fb4440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:28.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.659+0000 7fb466364700 1 --2- 172.21.15.37:0/4066064810 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb444066f30 0x7fb4440693e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0058d0 tx=0x7fb45c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:28.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.662+0000 7fb4567fc700 1 -- 172.21.15.37:0/4066064810 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb450051570 con 0x7fb4600c63d0 2023-10-06T02:27:28.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.898+0000 7fb4685c8700 1 -- 172.21.15.37:0/4066064810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb46004bb80 con 0x7fb4600c63d0 2023-10-06T02:27:28.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.899+0000 7fb4567fc700 1 -- 172.21.15.37:0/4066064810 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fb450054b90 con 0x7fb4600c63d0 2023-10-06T02:27:28.900 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:28.900 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":39,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/1914186828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1914186828},{"type":"v1","addr":"172.21.15.191:6836","nonce":1914186828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3684230798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":3684230798},{"type":"v1","addr":"172.21.15.191:6837","nonce":3684230798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1883185549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1883185549},{"type":"v1","addr":"172.21.15.37:6834","nonce":1883185549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6300,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2017427746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2017427746},{"type":"v1","addr":"172.21.15.37:6835","nonce":2017427746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":38,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:25:48.166318+0000","modified":"2023-10-06T02:27:26.100977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:27:28.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.901+0000 7fb4685c8700 1 -- 172.21.15.37:0/4066064810 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb444066f30 msgr2=0x7fb4440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.901+0000 7fb4685c8700 1 --2- 172.21.15.37:0/4066064810 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb444066f30 0x7fb4440693e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0058d0 tx=0x7fb45c009040 comp rx=0 tx=0).stop 2023-10-06T02:27:28.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.901+0000 7fb4685c8700 1 -- 172.21.15.37:0/4066064810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4600c63d0 msgr2=0x7fb4600ad330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:28.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.901+0000 7fb4685c8700 1 --2- 172.21.15.37:0/4066064810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4600c63d0 0x7fb4600ad330 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb45000c790 tx=0x7fb450007e10 comp rx=0 tx=0).stop 2023-10-06T02:27:28.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.901+0000 7fb4685c8700 1 -- 172.21.15.37:0/4066064810 shutdown_connections 2023-10-06T02:27:28.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.901+0000 7fb4685c8700 1 --2- 172.21.15.37:0/4066064810 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4601596d0 0x7fb46014d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.901+0000 7fb4685c8700 1 --2- 172.21.15.37:0/4066064810 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb444066f30 0x7fb4440693e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.901+0000 7fb4685c8700 1 --2- 172.21.15.37:0/4066064810 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb46006ad60 0x7fb4600cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.901+0000 7fb4685c8700 1 --2- 172.21.15.37:0/4066064810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4600c63d0 0x7fb4600ad330 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:28.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.901+0000 7fb4685c8700 1 -- 172.21.15.37:0/4066064810 >> 172.21.15.37:0/4066064810 conn(0x7fb4600cd490 msgr2=0x7fb4600c9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:28.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.901+0000 7fb4685c8700 1 -- 172.21.15.37:0/4066064810 shutdown_connections 2023-10-06T02:27:28.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:28.901+0000 7fb4685c8700 1 -- 172.21.15.37:0/4066064810 wait complete. 2023-10-06T02:27:28.903 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 39 2023-10-06T02:27:28.914 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:27:29.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.033+0000 7f7fcdf88700 1 Processor -- start 2023-10-06T02:27:29.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.033+0000 7f7fcdf88700 1 -- start start 2023-10-06T02:27:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.034+0000 7f7fcdf88700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f7fc80cf9f0 0x7f7fc80cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.034+0000 7f7fcdf88700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc80c5300 con 0x7f7fc81596d0 2023-10-06T02:27:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.034+0000 7f7fcdf88700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc80c6160 con 0x7f7fc8159aa0 2023-10-06T02:27:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.034+0000 7f7fcdf88700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc80d0370 con 0x7f7fc80cf9f0 2023-10-06T02:27:29.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.034+0000 7f7fc77fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7fc81596d0 0x7f7fc80b3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38536/0 (socket says 172.21.15.37:38536) 2023-10-06T02:27:29.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.034+0000 7f7fc77fe700 1 -- 172.21.15.37:0/260751133 learned_addr learned my addr 172.21.15.37:0/260751133 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:29.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.034+0000 7f7fc7fff700 1 --2- 172.21.15.37:0/260751133 >> v2:172.21.15.191:3300/0 conn(0x7f7fc80cf9f0 0x7f7fc80cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.034+0000 7f7fc67fc700 1 -- 172.21.15.37:0/260751133 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3430826266 0 0) 0x7f7fc80c5300 con 0x7f7fc81596d0 2023-10-06T02:27:29.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.034+0000 7f7fc67fc700 1 -- 172.21.15.37:0/260751133 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fb0003570 con 0x7f7fc81596d0 2023-10-06T02:27:29.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.034+0000 7f7fc7fff700 1 -- 172.21.15.37:0/260751133 >> v1:172.21.15.191:6789/0 conn(0x7f7fc8159aa0 legacy=0x7f7fc80c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.034+0000 7f7fc67fc700 1 -- 172.21.15.37:0/260751133 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3824263790 0 0) 0x7f7fb0003570 con 0x7f7fc81596d0 2023-10-06T02:27:29.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.034+0000 7f7fc7fff700 1 -- 172.21.15.37:0/260751133 >> v1:172.21.15.37:6789/0 conn(0x7f7fc81596d0 legacy=0x7f7fc80b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.034+0000 7f7fc7fff700 1 -- 172.21.15.37:0/260751133 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc80c5550 con 0x7f7fc80cf9f0 2023-10-06T02:27:29.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.035+0000 7f7fc7fff700 1 --2- 172.21.15.37:0/260751133 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fc80cf9f0 0x7f7fc80cfe30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009e60 tx=0x7f7fc0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afc9e7c0a1f740a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.035+0000 7f7fc67fc700 1 -- 172.21.15.37:0/260751133 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc000e070 con 0x7f7fc80cf9f0 2023-10-06T02:27:29.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.035+0000 7f7fc67fc700 1 -- 172.21.15.37:0/260751133 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc000b850 con 0x7f7fc80cf9f0 2023-10-06T02:27:29.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.035+0000 7f7fc67fc700 1 -- 172.21.15.37:0/260751133 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8001470 con 0x7f7fc80cf9f0 2023-10-06T02:27:29.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.035+0000 7f7fcdf88700 1 -- 172.21.15.37:0/260751133 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fc80cf9f0 msgr2=0x7f7fc80cfe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.035+0000 7f7fcdf88700 1 --2- 172.21.15.37:0/260751133 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fc80cf9f0 0x7f7fc80cfe30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009e60 tx=0x7f7fc0009780 comp rx=0 tx=0).stop 2023-10-06T02:27:29.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.035+0000 7f7fcdf88700 1 -- 172.21.15.37:0/260751133 shutdown_connections 2023-10-06T02:27:29.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.035+0000 7f7fcdf88700 1 --2- 172.21.15.37:0/260751133 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fc80cf9f0 0x7f7fc80cfe30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.035+0000 7f7fcdf88700 1 -- 172.21.15.37:0/260751133 >> 172.21.15.37:0/260751133 conn(0x7f7fc806c890 msgr2=0x7f7fc80d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:29.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.035+0000 7f7fcdf88700 1 -- 172.21.15.37:0/260751133 shutdown_connections 2023-10-06T02:27:29.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.035+0000 7f7fcdf88700 1 -- 172.21.15.37:0/260751133 wait complete. 2023-10-06T02:27:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.037+0000 7f7fcdf88700 1 Processor -- start 2023-10-06T02:27:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.037+0000 7f7fcdf88700 1 -- start start 2023-10-06T02:27:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.037+0000 7f7fcdf88700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fc80cf9f0 0x7f7fc8154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.037+0000 7f7fcdf88700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fc81596d0 0x7f7fc815b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.037+0000 7f7fcdf88700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fc8159aa0 0x7f7fc809cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.037+0000 7f7fcdf88700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc815afc0 con 0x7f7fc8159aa0 2023-10-06T02:27:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.037+0000 7f7fcdf88700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc809c6a0 con 0x7f7fc81596d0 2023-10-06T02:27:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.037+0000 7f7fcdf88700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc809bdb0 con 0x7f7fc80cf9f0 2023-10-06T02:27:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.037+0000 7f7fc7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fc8159aa0 0x7f7fc809cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.038+0000 7f7fc7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fc8159aa0 0x7f7fc809cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34960/0 (socket says 172.21.15.37:34960) 2023-10-06T02:27:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.038+0000 7f7fc7fff700 1 -- 172.21.15.37:0/4264039194 learned_addr learned my addr 172.21.15.37:0/4264039194 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.038+0000 7f7fc77fe700 1 --2- 172.21.15.37:0/4264039194 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fc80cf9f0 0x7f7fc8154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.038+0000 7f7fc6ffd700 1 --2- 172.21.15.37:0/4264039194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fc81596d0 0x7f7fc815b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.038+0000 7f7fc7fff700 1 -- 172.21.15.37:0/4264039194 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fc80cf9f0 msgr2=0x7f7fc8154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.038+0000 7f7fc7fff700 1 --2- 172.21.15.37:0/4264039194 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fc80cf9f0 0x7f7fc8154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.038+0000 7f7fc7fff700 1 -- 172.21.15.37:0/4264039194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fc81596d0 msgr2=0x7f7fc815b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.038+0000 7f7fc7fff700 1 --2- 172.21.15.37:0/4264039194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fc81596d0 0x7f7fc815b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.038+0000 7f7fc7fff700 1 -- 172.21.15.37:0/4264039194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc0009a20 con 0x7f7fc8159aa0 2023-10-06T02:27:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.038+0000 7f7fc7fff700 1 --2- 172.21.15.37:0/4264039194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fc8159aa0 0x7f7fc809cb30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00099f0 tx=0x7f7fc0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.038+0000 7f7faf7fe700 1 -- 172.21.15.37:0/4264039194 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc001f410 con 0x7f7fc8159aa0 2023-10-06T02:27:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.038+0000 7f7faf7fe700 1 -- 172.21.15.37:0/4264039194 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc001f570 con 0x7f7fc8159aa0 2023-10-06T02:27:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.038+0000 7f7fcdf88700 1 -- 172.21.15.37:0/4264039194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc815ace0 con 0x7f7fc8159aa0 2023-10-06T02:27:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.038+0000 7f7faf7fe700 1 -- 172.21.15.37:0/4264039194 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc001f930 con 0x7f7fc8159aa0 2023-10-06T02:27:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.038+0000 7f7fcdf88700 1 -- 172.21.15.37:0/4264039194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc809c330 con 0x7f7fc8159aa0 2023-10-06T02:27:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.039+0000 7f7fcdf88700 1 -- 172.21.15.37:0/4264039194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc809c810 con 0x7f7fc8159aa0 2023-10-06T02:27:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.040+0000 7f7faf7fe700 1 -- 172.21.15.37:0/4264039194 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7fc001fd20 con 0x7f7fc8159aa0 2023-10-06T02:27:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.040+0000 7f7faf7fe700 1 --2- 172.21.15.37:0/4264039194 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7fb4066f30 0x7f7fb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.040+0000 7f7faf7fe700 1 -- 172.21.15.37:0/4264039194 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6346+0+0 (secure 0 0 0) 0x7f7fc0086960 con 0x7f7fc8159aa0 2023-10-06T02:27:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.040+0000 7f7fc77fe700 1 --2- 172.21.15.37:0/4264039194 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7fb4066f30 0x7f7fb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.041+0000 7f7fc77fe700 1 --2- 172.21.15.37:0/4264039194 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7fb4066f30 0x7f7fb40693e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8004dd0 tx=0x7f7fb8001a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.044+0000 7f7faf7fe700 1 -- 172.21.15.37:0/4264039194 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7fc0053a10 con 0x7f7fc8159aa0 2023-10-06T02:27:29.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.240+0000 7f7fcdf88700 1 -- 172.21.15.37:0/4264039194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fc806fbf0 con 0x7f7fc8159aa0 2023-10-06T02:27:29.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.241+0000 7f7faf7fe700 1 -- 172.21.15.37:0/4264039194 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+17318 (secure 0 0 0) 0x7f7fc0023090 con 0x7f7fc8159aa0 2023-10-06T02:27:29.242 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:29.242 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":61,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:27:26.100797+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:25:45.900917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T02:25:47.150749+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.1","mappings":[{"from":4,"to":3}]},{"pgid":"10.10","mappings":[{"from":4,"to":3}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/2196855571":"2023-10-07T02:27:26.100770+0000","172.21.15.37:6833/2196855571":"2023-10-07T02:27:26.100770+0000","172.21.15.37:6833/3956166862":"2023-10-07T02:26:49.342208+0000","172.21.15.37:6835/3956166862":"2023-10-07T02:26:49.342208+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:27:29.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.243+0000 7f7fcdf88700 1 -- 172.21.15.37:0/4264039194 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7fb4066f30 msgr2=0x7f7fb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.243+0000 7f7fcdf88700 1 --2- 172.21.15.37:0/4264039194 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7fb4066f30 0x7f7fb40693e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8004dd0 tx=0x7f7fb8001a00 comp rx=0 tx=0).stop 2023-10-06T02:27:29.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.243+0000 7f7fcdf88700 1 -- 172.21.15.37:0/4264039194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fc8159aa0 msgr2=0x7f7fc809cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.243+0000 7f7fcdf88700 1 --2- 172.21.15.37:0/4264039194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fc8159aa0 0x7f7fc809cb30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00099f0 tx=0x7f7fc0017000 comp rx=0 tx=0).stop 2023-10-06T02:27:29.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.243+0000 7f7fcdf88700 1 -- 172.21.15.37:0/4264039194 shutdown_connections 2023-10-06T02:27:29.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.243+0000 7f7fcdf88700 1 --2- 172.21.15.37:0/4264039194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fc8159aa0 0x7f7fc809cb30 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.243+0000 7f7fcdf88700 1 --2- 172.21.15.37:0/4264039194 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fc80cf9f0 0x7f7fc8154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.243+0000 7f7fcdf88700 1 --2- 172.21.15.37:0/4264039194 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7fb4066f30 0x7f7fb40693e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.243+0000 7f7fcdf88700 1 --2- 172.21.15.37:0/4264039194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fc81596d0 0x7f7fc815b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.243+0000 7f7fcdf88700 1 -- 172.21.15.37:0/4264039194 >> 172.21.15.37:0/4264039194 conn(0x7f7fc806c890 msgr2=0x7f7fc8154b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:29.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.243+0000 7f7fcdf88700 1 -- 172.21.15.37:0/4264039194 shutdown_connections 2023-10-06T02:27:29.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.243+0000 7f7fcdf88700 1 -- 172.21.15.37:0/4264039194 wait complete. 2023-10-06T02:27:29.256 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:27:29.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:29.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.374+0000 7f00e12af700 1 Processor -- start 2023-10-06T02:27:29.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.374+0000 7f00e12af700 1 -- start start 2023-10-06T02:27:29.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.375+0000 7f00e12af700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00dc159eb0 0x7f00dc164760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.375+0000 7f00e12af700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00dc15d7a0 con 0x7f00dc159a40 2023-10-06T02:27:29.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.375+0000 7f00e12af700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00dc15da80 con 0x7f00dc159670 2023-10-06T02:27:29.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.375+0000 7f00e12af700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc15dd60 con 0x7f00dc159eb0 2023-10-06T02:27:29.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.375+0000 7f00da7fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f00dc159a40 0x7f00dc067a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38546/0 (socket says 172.21.15.37:38546) 2023-10-06T02:27:29.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.375+0000 7f00da7fc700 1 -- 172.21.15.37:0/196602577 learned_addr learned my addr 172.21.15.37:0/196602577 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:29.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00db7fe700 1 --2- 172.21.15.37:0/196602577 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00dc159eb0 0x7f00dc164760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00d9ffb700 1 -- 172.21.15.37:0/196602577 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1443320755 0 0) 0x7f00dc15d7a0 con 0x7f00dc159a40 2023-10-06T02:27:29.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00d9ffb700 1 -- 172.21.15.37:0/196602577 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00c8003570 con 0x7f00dc159a40 2023-10-06T02:27:29.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00d9ffb700 1 -- 172.21.15.37:0/196602577 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3222022508 0 0) 0x7f00c8003570 con 0x7f00dc159a40 2023-10-06T02:27:29.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00d9ffb700 1 -- 172.21.15.37:0/196602577 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00dc159eb0 msgr2=0x7f00dc164760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:29.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00d9ffb700 1 --2- 172.21.15.37:0/196602577 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00dc159eb0 0x7f00dc164760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00d9ffb700 1 -- 172.21.15.37:0/196602577 >> v1:172.21.15.191:6789/0 conn(0x7f00dc159670 legacy=0x7f00dc0b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00d9ffb700 1 -- 172.21.15.37:0/196602577 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc15e040 con 0x7f00dc159a40 2023-10-06T02:27:29.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00d9ffb700 1 -- 172.21.15.37:0/196602577 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f00c4001470 con 0x7f00dc159a40 2023-10-06T02:27:29.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00d9ffb700 1 -- 172.21.15.37:0/196602577 >> v1:172.21.15.37:6789/0 conn(0x7f00dc159a40 legacy=0x7f00dc067a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00d9ffb700 1 --2- 172.21.15.37:0/196602577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00c8003a90 0x7f00c8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00d9ffb700 1 --2- 172.21.15.37:0/196602577 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00dc159eb0 0x7f00c8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00d9ffb700 1 --2- 172.21.15.37:0/196602577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c8004d50 0x7f00c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00d9ffb700 1 -- 172.21.15.37:0/196602577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc15dd60 con 0x7f00c8004d50 2023-10-06T02:27:29.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00d9ffb700 1 -- 172.21.15.37:0/196602577 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c800bba0 con 0x7f00c8003a90 2023-10-06T02:27:29.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00d9ffb700 1 -- 172.21.15.37:0/196602577 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c800bd60 con 0x7f00dc159eb0 2023-10-06T02:27:29.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00db7fe700 1 --2- 172.21.15.37:0/196602577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c8004d50 0x7f00c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00daffd700 1 --2- 172.21.15.37:0/196602577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00c8003a90 0x7f00c8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00da7fc700 1 --2- 172.21.15.37:0/196602577 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00dc159eb0 0x7f00c8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00db7fe700 1 -- 172.21.15.37:0/196602577 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00dc159eb0 msgr2=0x7f00c8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:29.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00db7fe700 1 --2- 172.21.15.37:0/196602577 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00dc159eb0 0x7f00c8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00db7fe700 1 -- 172.21.15.37:0/196602577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00c8003a90 msgr2=0x7f00c8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00db7fe700 1 --2- 172.21.15.37:0/196602577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00c8003a90 0x7f00c8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.376+0000 7f00db7fe700 1 -- 172.21.15.37:0/196602577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c8003570 con 0x7f00c8004d50 2023-10-06T02:27:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.377+0000 7f00db7fe700 1 --2- 172.21.15.37:0/196602577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c8004d50 0x7f00c80051c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f00dc06e8b0 tx=0x7f00cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4f0f4721ac7359 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.377+0000 7f00d9ffb700 1 -- 172.21.15.37:0/196602577 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc00ea90 con 0x7f00c8004d50 2023-10-06T02:27:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.377+0000 7f00d9ffb700 1 -- 172.21.15.37:0/196602577 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc00f040 con 0x7f00c8004d50 2023-10-06T02:27:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.377+0000 7f00d9ffb700 1 -- 172.21.15.37:0/196602577 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc00ee40 con 0x7f00c8004d50 2023-10-06T02:27:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.377+0000 7f00e12af700 1 -- 172.21.15.37:0/196602577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c8004d50 msgr2=0x7f00c80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.377+0000 7f00e12af700 1 --2- 172.21.15.37:0/196602577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c8004d50 0x7f00c80051c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f00dc06e8b0 tx=0x7f00cc00b040 comp rx=0 tx=0).stop 2023-10-06T02:27:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.377+0000 7f00db7fe700 1 -- 172.21.15.37:0/196602577 reap_dead start 2023-10-06T02:27:29.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.377+0000 7f00e12af700 1 -- 172.21.15.37:0/196602577 shutdown_connections 2023-10-06T02:27:29.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.377+0000 7f00e12af700 1 -- 172.21.15.37:0/196602577 >> 172.21.15.37:0/196602577 conn(0x7f00dc0ce330 msgr2=0x7f00dc0ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:29.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.377+0000 7f00e12af700 1 -- 172.21.15.37:0/196602577 shutdown_connections 2023-10-06T02:27:29.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.377+0000 7f00e12af700 1 -- 172.21.15.37:0/196602577 wait complete. 2023-10-06T02:27:29.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.379+0000 7f00e12af700 1 Processor -- start 2023-10-06T02:27:29.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.379+0000 7f00e12af700 1 -- start start 2023-10-06T02:27:29.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.379+0000 7f00e12af700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c8004d50 0x7f00dc158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.379+0000 7f00e12af700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00dc1574f0 0x7f00dc0aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.379+0000 7f00e12af700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00dc154e30 0x7f00dc14fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.379+0000 7f00e12af700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc1579d0 con 0x7f00c8004d50 2023-10-06T02:27:29.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.379+0000 7f00e12af700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc157cb0 con 0x7f00dc154e30 2023-10-06T02:27:29.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.379+0000 7f00e12af700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc157f90 con 0x7f00dc1574f0 2023-10-06T02:27:29.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.380+0000 7f00daffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c8004d50 0x7f00dc158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.380+0000 7f00daffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c8004d50 0x7f00dc158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34982/0 (socket says 172.21.15.37:34982) 2023-10-06T02:27:29.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.380+0000 7f00daffd700 1 -- 172.21.15.37:0/3828648766 learned_addr learned my addr 172.21.15.37:0/3828648766 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:29.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.380+0000 7f00da7fc700 1 --2- 172.21.15.37:0/3828648766 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00dc1574f0 0x7f00dc0aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.380+0000 7f00db7fe700 1 --2- 172.21.15.37:0/3828648766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00dc154e30 0x7f00dc14fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.380+0000 7f00daffd700 1 -- 172.21.15.37:0/3828648766 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00dc1574f0 msgr2=0x7f00dc0aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.380+0000 7f00daffd700 1 --2- 172.21.15.37:0/3828648766 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00dc1574f0 0x7f00dc0aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.380+0000 7f00daffd700 1 -- 172.21.15.37:0/3828648766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00dc154e30 msgr2=0x7f00dc14fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.380+0000 7f00daffd700 1 --2- 172.21.15.37:0/3828648766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00dc154e30 0x7f00dc14fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.380+0000 7f00daffd700 1 -- 172.21.15.37:0/3828648766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc158270 con 0x7f00c8004d50 2023-10-06T02:27:29.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.380+0000 7f00daffd700 1 --2- 172.21.15.37:0/3828648766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c8004d50 0x7f00dc158a70 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f00d40028c0 tx=0x7f00d4007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.380+0000 7f00d2ffd700 1 -- 172.21.15.37:0/3828648766 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d400f690 con 0x7f00c8004d50 2023-10-06T02:27:29.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.380+0000 7f00d2ffd700 1 -- 172.21.15.37:0/3828648766 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d400f7f0 con 0x7f00c8004d50 2023-10-06T02:27:29.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.380+0000 7f00e12af700 1 -- 172.21.15.37:0/3828648766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00dc158550 con 0x7f00c8004d50 2023-10-06T02:27:29.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.380+0000 7f00d2ffd700 1 -- 172.21.15.37:0/3828648766 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d400fb70 con 0x7f00c8004d50 2023-10-06T02:27:29.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.380+0000 7f00e12af700 1 -- 172.21.15.37:0/3828648766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00dc155280 con 0x7f00c8004d50 2023-10-06T02:27:29.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.381+0000 7f00e12af700 1 -- 172.21.15.37:0/3828648766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00dc06a9d0 con 0x7f00c8004d50 2023-10-06T02:27:29.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.382+0000 7f00d2ffd700 1 -- 172.21.15.37:0/3828648766 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00d401c400 con 0x7f00c8004d50 2023-10-06T02:27:29.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.382+0000 7f00d2ffd700 1 --2- 172.21.15.37:0/3828648766 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f00bc066f30 0x7f00bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.382+0000 7f00d2ffd700 1 -- 172.21.15.37:0/3828648766 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6346+0+0 (secure 0 0 0) 0x7f00d4084b40 con 0x7f00c8004d50 2023-10-06T02:27:29.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.382+0000 7f00da7fc700 1 --2- 172.21.15.37:0/3828648766 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f00bc066f30 0x7f00bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.383+0000 7f00da7fc700 1 --2- 172.21.15.37:0/3828648766 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f00bc066f30 0x7f00bc0693e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f00dc157900 tx=0x7f00dc15e320 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.386+0000 7f00d2ffd700 1 -- 172.21.15.37:0/3828648766 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00d4051ca0 con 0x7f00c8004d50 2023-10-06T02:27:29.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.623+0000 7f00e12af700 1 -- 172.21.15.37:0/3828648766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00dc04bb80 con 0x7f00c8004d50 2023-10-06T02:27:29.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.624+0000 7f00d2ffd700 1 -- 172.21.15.37:0/3828648766 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f00d40552c0 con 0x7f00c8004d50 2023-10-06T02:27:29.625 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:29.625 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":39,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/1914186828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1914186828},{"type":"v1","addr":"172.21.15.191:6836","nonce":1914186828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3684230798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":3684230798},{"type":"v1","addr":"172.21.15.191:6837","nonce":3684230798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1883185549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1883185549},{"type":"v1","addr":"172.21.15.37:6834","nonce":1883185549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6300,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2017427746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2017427746},{"type":"v1","addr":"172.21.15.37:6835","nonce":2017427746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":38,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:25:48.166318+0000","modified":"2023-10-06T02:27:26.100977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:27:29.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.626+0000 7f00e12af700 1 -- 172.21.15.37:0/3828648766 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f00bc066f30 msgr2=0x7f00bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.626+0000 7f00e12af700 1 --2- 172.21.15.37:0/3828648766 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f00bc066f30 0x7f00bc0693e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f00dc157900 tx=0x7f00dc15e320 comp rx=0 tx=0).stop 2023-10-06T02:27:29.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.626+0000 7f00e12af700 1 -- 172.21.15.37:0/3828648766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c8004d50 msgr2=0x7f00dc158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.626+0000 7f00e12af700 1 --2- 172.21.15.37:0/3828648766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c8004d50 0x7f00dc158a70 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f00d40028c0 tx=0x7f00d4007d80 comp rx=0 tx=0).stop 2023-10-06T02:27:29.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.626+0000 7f00e12af700 1 -- 172.21.15.37:0/3828648766 shutdown_connections 2023-10-06T02:27:29.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.626+0000 7f00e12af700 1 --2- 172.21.15.37:0/3828648766 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f00bc066f30 0x7f00bc0693e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.626+0000 7f00e12af700 1 --2- 172.21.15.37:0/3828648766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00dc154e30 0x7f00dc14fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.626+0000 7f00e12af700 1 --2- 172.21.15.37:0/3828648766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c8004d50 0x7f00dc158a70 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.626+0000 7f00e12af700 1 --2- 172.21.15.37:0/3828648766 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00dc1574f0 0x7f00dc0aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.626+0000 7f00e12af700 1 -- 172.21.15.37:0/3828648766 >> 172.21.15.37:0/3828648766 conn(0x7f00dc0ce330 msgr2=0x7f00dc15b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:29.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.626+0000 7f00e12af700 1 -- 172.21.15.37:0/3828648766 shutdown_connections 2023-10-06T02:27:29.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.626+0000 7f00e12af700 1 -- 172.21.15.37:0/3828648766 wait complete. 2023-10-06T02:27:29.628 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 39 2023-10-06T02:27:29.640 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:29.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.759+0000 7fca73116700 1 Processor -- start 2023-10-06T02:27:29.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.760+0000 7fca73116700 1 -- start start 2023-10-06T02:27:29.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.760+0000 7fca73116700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca6c0c8820 0x7fca6c0cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.760+0000 7fca73116700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6c159b00 con 0x7fca6c069750 2023-10-06T02:27:29.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.760+0000 7fca73116700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6c069bc0 con 0x7fca6c0ae000 2023-10-06T02:27:29.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.760+0000 7fca73116700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c06f0a0 con 0x7fca6c0c8820 2023-10-06T02:27:29.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.760+0000 7fca6bfff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fca6c069750 0x7fca6c0c8bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38552/0 (socket says 172.21.15.37:38552) 2023-10-06T02:27:29.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.761+0000 7fca6bfff700 1 -- 172.21.15.37:0/2729317944 learned_addr learned my addr 172.21.15.37:0/2729317944 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:29.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.761+0000 7fca6b7fe700 1 -- 172.21.15.37:0/2729317944 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577882074 0 0) 0x7fca6c159b00 con 0x7fca6c069750 2023-10-06T02:27:29.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.761+0000 7fca70eb2700 1 --2- 172.21.15.37:0/2729317944 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca6c0c8820 0x7fca6c0cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.761+0000 7fca6b7fe700 1 -- 172.21.15.37:0/2729317944 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca54003570 con 0x7fca6c069750 2023-10-06T02:27:29.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.761+0000 7fca6b7fe700 1 -- 172.21.15.37:0/2729317944 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3184749271 0 0) 0x7fca54003570 con 0x7fca6c069750 2023-10-06T02:27:29.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.761+0000 7fca6b7fe700 1 -- 172.21.15.37:0/2729317944 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca6c0c8820 msgr2=0x7fca6c0cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:29.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.761+0000 7fca6b7fe700 1 --2- 172.21.15.37:0/2729317944 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca6c0c8820 0x7fca6c0cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.761+0000 7fca6b7fe700 1 -- 172.21.15.37:0/2729317944 >> v1:172.21.15.191:6789/0 conn(0x7fca6c0ae000 legacy=0x7fca6c0ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.761+0000 7fca6b7fe700 1 -- 172.21.15.37:0/2729317944 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c0adb00 con 0x7fca6c069750 2023-10-06T02:27:29.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.761+0000 7fca6b7fe700 1 -- 172.21.15.37:0/2729317944 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7fca60001470 con 0x7fca6c069750 2023-10-06T02:27:29.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.761+0000 7fca6b7fe700 1 -- 172.21.15.37:0/2729317944 >> v1:172.21.15.37:6789/0 conn(0x7fca6c069750 legacy=0x7fca6c0c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.761+0000 7fca6b7fe700 1 --2- 172.21.15.37:0/2729317944 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca6c0c8820 0x7fca54003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.761+0000 7fca6b7fe700 1 --2- 172.21.15.37:0/2729317944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca54004010 0x7fca54004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.761+0000 7fca6b7fe700 1 --2- 172.21.15.37:0/2729317944 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca54004d50 0x7fca540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.761+0000 7fca6b7fe700 1 -- 172.21.15.37:0/2729317944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c06f0a0 con 0x7fca54004010 2023-10-06T02:27:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.761+0000 7fca6b7fe700 1 -- 172.21.15.37:0/2729317944 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5400bbf0 con 0x7fca54004d50 2023-10-06T02:27:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.761+0000 7fca6b7fe700 1 -- 172.21.15.37:0/2729317944 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5400bdb0 con 0x7fca6c0c8820 2023-10-06T02:27:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.761+0000 7fca6bfff700 1 --2- 172.21.15.37:0/2729317944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca54004010 0x7fca54004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.761+0000 7fca70eb2700 1 --2- 172.21.15.37:0/2729317944 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca6c0c8820 0x7fca54003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.761+0000 7fca716b3700 1 --2- 172.21.15.37:0/2729317944 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca54004d50 0x7fca540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.762+0000 7fca6bfff700 1 -- 172.21.15.37:0/2729317944 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca6c0c8820 msgr2=0x7fca54003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.762+0000 7fca6bfff700 1 --2- 172.21.15.37:0/2729317944 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca6c0c8820 0x7fca54003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.762+0000 7fca6bfff700 1 -- 172.21.15.37:0/2729317944 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca54004d50 msgr2=0x7fca540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:29.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.762+0000 7fca6bfff700 1 --2- 172.21.15.37:0/2729317944 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca54004d50 0x7fca540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.762+0000 7fca6bfff700 1 -- 172.21.15.37:0/2729317944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca54003570 con 0x7fca54004010 2023-10-06T02:27:29.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.762+0000 7fca6bfff700 1 --2- 172.21.15.37:0/2729317944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca54004010 0x7fca54004810 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fca6000c390 tx=0x7fca60001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b62398f2e006a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.762+0000 7fca6b7fe700 1 -- 172.21.15.37:0/2729317944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6000cc60 con 0x7fca54004010 2023-10-06T02:27:29.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.762+0000 7fca6b7fe700 1 -- 172.21.15.37:0/2729317944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6000cdc0 con 0x7fca54004010 2023-10-06T02:27:29.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.762+0000 7fca6b7fe700 1 -- 172.21.15.37:0/2729317944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca60005b50 con 0x7fca54004010 2023-10-06T02:27:29.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.762+0000 7fca73116700 1 -- 172.21.15.37:0/2729317944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca54004010 msgr2=0x7fca54004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.762+0000 7fca73116700 1 --2- 172.21.15.37:0/2729317944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca54004010 0x7fca54004810 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fca6000c390 tx=0x7fca60001e50 comp rx=0 tx=0).stop 2023-10-06T02:27:29.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.762+0000 7fca716b3700 1 -- 172.21.15.37:0/2729317944 reap_dead start 2023-10-06T02:27:29.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.762+0000 7fca73116700 1 -- 172.21.15.37:0/2729317944 shutdown_connections 2023-10-06T02:27:29.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.762+0000 7fca73116700 1 -- 172.21.15.37:0/2729317944 >> 172.21.15.37:0/2729317944 conn(0x7fca6c06c0b0 msgr2=0x7fca6c06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:29.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.762+0000 7fca73116700 1 -- 172.21.15.37:0/2729317944 shutdown_connections 2023-10-06T02:27:29.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.763+0000 7fca73116700 1 -- 172.21.15.37:0/2729317944 wait complete. 2023-10-06T02:27:29.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.764+0000 7fca73116700 1 Processor -- start 2023-10-06T02:27:29.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.764+0000 7fca73116700 1 -- start start 2023-10-06T02:27:29.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.764+0000 7fca73116700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca54004010 0x7fca6c15ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.764+0000 7fca73116700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca6c169c30 0x7fca6c15c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.764+0000 7fca73116700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca6c155690 0x7fca6c15ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.764+0000 7fca73116700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c16a130 con 0x7fca54004010 2023-10-06T02:27:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.764+0000 7fca73116700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c16a410 con 0x7fca6c169c30 2023-10-06T02:27:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.764+0000 7fca73116700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c16a6f0 con 0x7fca6c155690 2023-10-06T02:27:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.765+0000 7fca70eb2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca54004010 0x7fca6c15ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.765+0000 7fca70eb2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca54004010 0x7fca6c15ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35014/0 (socket says 172.21.15.37:35014) 2023-10-06T02:27:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.765+0000 7fca70eb2700 1 -- 172.21.15.37:0/246371828 learned_addr learned my addr 172.21.15.37:0/246371828 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.765+0000 7fca6bfff700 1 --2- 172.21.15.37:0/246371828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca6c169c30 0x7fca6c15c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.765+0000 7fca716b3700 1 --2- 172.21.15.37:0/246371828 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca6c155690 0x7fca6c15ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.765+0000 7fca70eb2700 1 -- 172.21.15.37:0/246371828 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca6c155690 msgr2=0x7fca6c15ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.765+0000 7fca70eb2700 1 --2- 172.21.15.37:0/246371828 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca6c155690 0x7fca6c15ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.765+0000 7fca70eb2700 1 -- 172.21.15.37:0/246371828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca6c169c30 msgr2=0x7fca6c15c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.765+0000 7fca70eb2700 1 --2- 172.21.15.37:0/246371828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca6c169c30 0x7fca6c15c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.765+0000 7fca70eb2700 1 -- 172.21.15.37:0/246371828 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c16a9d0 con 0x7fca54004010 2023-10-06T02:27:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.765+0000 7fca70eb2700 1 --2- 172.21.15.37:0/246371828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca54004010 0x7fca6c15ea10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fca5c011d40 tx=0x7fca5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.765+0000 7fca68ff9700 1 -- 172.21.15.37:0/246371828 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c00fa10 con 0x7fca54004010 2023-10-06T02:27:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.765+0000 7fca68ff9700 1 -- 172.21.15.37:0/246371828 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5c00fb70 con 0x7fca54004010 2023-10-06T02:27:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.765+0000 7fca73116700 1 -- 172.21.15.37:0/246371828 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6c15ef50 con 0x7fca54004010 2023-10-06T02:27:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.765+0000 7fca68ff9700 1 -- 172.21.15.37:0/246371828 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c014440 con 0x7fca54004010 2023-10-06T02:27:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.765+0000 7fca73116700 1 -- 172.21.15.37:0/246371828 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6c16d3f0 con 0x7fca54004010 2023-10-06T02:27:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.766+0000 7fca73116700 1 -- 172.21.15.37:0/246371828 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca6c16b030 con 0x7fca54004010 2023-10-06T02:27:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.767+0000 7fca68ff9700 1 -- 172.21.15.37:0/246371828 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca5c014870 con 0x7fca54004010 2023-10-06T02:27:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.767+0000 7fca68ff9700 1 --2- 172.21.15.37:0/246371828 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fca58066f30 0x7fca580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.767+0000 7fca68ff9700 1 -- 172.21.15.37:0/246371828 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6346+0+0 (secure 0 0 0) 0x7fca5c018030 con 0x7fca54004010 2023-10-06T02:27:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.767+0000 7fca6bfff700 1 --2- 172.21.15.37:0/246371828 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fca58066f30 0x7fca580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:29.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.768+0000 7fca6bfff700 1 --2- 172.21.15.37:0/246371828 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fca58066f30 0x7fca580693e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fca60007cd0 tx=0x7fca60015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:29.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:29.771+0000 7fca68ff9700 1 -- 172.21.15.37:0/246371828 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca5c0521c0 con 0x7fca54004010 2023-10-06T02:27:30.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.008+0000 7fca73116700 1 -- 172.21.15.37:0/246371828 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca6c0add00 con 0x7fca54004010 2023-10-06T02:27:30.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.008+0000 7fca68ff9700 1 -- 172.21.15.37:0/246371828 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fca5c0557e0 con 0x7fca54004010 2023-10-06T02:27:30.009 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:30.009 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":39,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/1914186828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1914186828},{"type":"v1","addr":"172.21.15.191:6836","nonce":1914186828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3684230798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":3684230798},{"type":"v1","addr":"172.21.15.191:6837","nonce":3684230798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1883185549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1883185549},{"type":"v1","addr":"172.21.15.37:6834","nonce":1883185549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6300,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2017427746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2017427746},{"type":"v1","addr":"172.21.15.37:6835","nonce":2017427746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":38,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:25:48.166318+0000","modified":"2023-10-06T02:27:26.100977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:27:30.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.010+0000 7fca73116700 1 -- 172.21.15.37:0/246371828 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fca58066f30 msgr2=0x7fca580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.010+0000 7fca73116700 1 --2- 172.21.15.37:0/246371828 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fca58066f30 0x7fca580693e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fca60007cd0 tx=0x7fca60015000 comp rx=0 tx=0).stop 2023-10-06T02:27:30.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.010+0000 7fca73116700 1 -- 172.21.15.37:0/246371828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca54004010 msgr2=0x7fca6c15ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.010+0000 7fca73116700 1 --2- 172.21.15.37:0/246371828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca54004010 0x7fca6c15ea10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fca5c011d40 tx=0x7fca5c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.010+0000 7fca73116700 1 -- 172.21.15.37:0/246371828 shutdown_connections 2023-10-06T02:27:30.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.010+0000 7fca73116700 1 --2- 172.21.15.37:0/246371828 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca6c155690 0x7fca6c15ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.010+0000 7fca73116700 1 --2- 172.21.15.37:0/246371828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca54004010 0x7fca6c15ea10 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.010+0000 7fca73116700 1 --2- 172.21.15.37:0/246371828 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fca58066f30 0x7fca580693e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.010+0000 7fca73116700 1 --2- 172.21.15.37:0/246371828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca6c169c30 0x7fca6c15c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.010+0000 7fca73116700 1 -- 172.21.15.37:0/246371828 >> 172.21.15.37:0/246371828 conn(0x7fca6c06c0b0 msgr2=0x7fca6c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:30.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.010+0000 7fca73116700 1 -- 172.21.15.37:0/246371828 shutdown_connections 2023-10-06T02:27:30.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.010+0000 7fca73116700 1 -- 172.21.15.37:0/246371828 wait complete. 2023-10-06T02:27:30.013 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 39 2023-10-06T02:27:30.023 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:27:30.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.142+0000 7fe94098f700 1 Processor -- start 2023-10-06T02:27:30.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.142+0000 7fe94098f700 1 -- start start 2023-10-06T02:27:30.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.143+0000 7fe94098f700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe93c159370 0x7fe93c159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.143+0000 7fe94098f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe93c0b0620 0x7fe93c15db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.143+0000 7fe94098f700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe93c0cb200 con 0x7fe93c0b2270 2023-10-06T02:27:30.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.143+0000 7fe94098f700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe93c0b5c00 con 0x7fe93c0b0620 2023-10-06T02:27:30.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.143+0000 7fe94098f700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe93c0cb7c0 con 0x7fe93c159370 2023-10-06T02:27:30.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.143+0000 7fe93b59e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe93c0b0620 0x7fe93c15db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.143+0000 7fe93a59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe93c0b2270 0x7fe93c0aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38566/0 (socket says 172.21.15.37:38566) 2023-10-06T02:27:30.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.143+0000 7fe93a59c700 1 -- 172.21.15.37:0/384992025 learned_addr learned my addr 172.21.15.37:0/384992025 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:30.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.143+0000 7fe93ad9d700 1 --2- 172.21.15.37:0/384992025 >> v2:172.21.15.191:3300/0 conn(0x7fe93c159370 0x7fe93c159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.143+0000 7fe93b59e700 1 -- 172.21.15.37:0/384992025 >> v2:172.21.15.191:3300/0 conn(0x7fe93c159370 msgr2=0x7fe93c159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.143+0000 7fe93b59e700 1 --2- 172.21.15.37:0/384992025 >> v2:172.21.15.191:3300/0 conn(0x7fe93c159370 0x7fe93c159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.143+0000 7fe93b59e700 1 -- 172.21.15.37:0/384992025 >> v1:172.21.15.37:6789/0 conn(0x7fe93c0b2270 legacy=0x7fe93c0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.143+0000 7fe93b59e700 1 -- 172.21.15.37:0/384992025 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93c15e0d0 con 0x7fe93c0b0620 2023-10-06T02:27:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.143+0000 7fe93b59e700 1 --2- 172.21.15.37:0/384992025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0b0620 0x7fe93c15db90 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0d13a0 tx=0x7fe9340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1929ff9fc492e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.143+0000 7fe939d9b700 1 -- 172.21.15.37:0/384992025 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93400b6b0 con 0x7fe93c0b0620 2023-10-06T02:27:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.144+0000 7fe939d9b700 1 -- 172.21.15.37:0/384992025 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93400b810 con 0x7fe93c0b0620 2023-10-06T02:27:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.144+0000 7fe939d9b700 1 -- 172.21.15.37:0/384992025 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93400bbb0 con 0x7fe93c0b0620 2023-10-06T02:27:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.144+0000 7fe94098f700 1 -- 172.21.15.37:0/384992025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0b0620 msgr2=0x7fe93c15db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.144+0000 7fe94098f700 1 --2- 172.21.15.37:0/384992025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0b0620 0x7fe93c15db90 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0d13a0 tx=0x7fe9340091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.144+0000 7fe94098f700 1 -- 172.21.15.37:0/384992025 shutdown_connections 2023-10-06T02:27:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.144+0000 7fe94098f700 1 --2- 172.21.15.37:0/384992025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0b0620 0x7fe93c15db90 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.144+0000 7fe94098f700 1 --2- 172.21.15.37:0/384992025 >> v2:172.21.15.191:3300/0 conn(0x7fe93c159370 0x7fe93c159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.144+0000 7fe94098f700 1 -- 172.21.15.37:0/384992025 >> 172.21.15.37:0/384992025 conn(0x7fe93c06c0b0 msgr2=0x7fe93c06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:30.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.144+0000 7fe94098f700 1 -- 172.21.15.37:0/384992025 shutdown_connections 2023-10-06T02:27:30.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.144+0000 7fe94098f700 1 -- 172.21.15.37:0/384992025 wait complete. 2023-10-06T02:27:30.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.145+0000 7fe94098f700 1 Processor -- start 2023-10-06T02:27:30.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.145+0000 7fe94098f700 1 -- start start 2023-10-06T02:27:30.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.146+0000 7fe94098f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0b0620 0x7fe93c14faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.146+0000 7fe94098f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe93c0b2270 0x7fe93c15bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.146+0000 7fe94098f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe93c159370 0x7fe93c0d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.146+0000 7fe94098f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c15c630 con 0x7fe93c0b0620 2023-10-06T02:27:30.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.146+0000 7fe94098f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c0cfe50 con 0x7fe93c0b2270 2023-10-06T02:27:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.146+0000 7fe94098f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c0cf280 con 0x7fe93c159370 2023-10-06T02:27:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.146+0000 7fe93ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0b0620 0x7fe93c14faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.146+0000 7fe93ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0b0620 0x7fe93c14faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35028/0 (socket says 172.21.15.37:35028) 2023-10-06T02:27:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.146+0000 7fe93ad9d700 1 -- 172.21.15.37:0/3396100747 learned_addr learned my addr 172.21.15.37:0/3396100747 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.147+0000 7fe93b59e700 1 --2- 172.21.15.37:0/3396100747 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe93c159370 0x7fe93c0d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.147+0000 7fe93ad9d700 1 -- 172.21.15.37:0/3396100747 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe93c159370 msgr2=0x7fe93c0d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.147+0000 7fe93a59c700 1 --2- 172.21.15.37:0/3396100747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe93c0b2270 0x7fe93c15bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.147+0000 7fe93ad9d700 1 --2- 172.21.15.37:0/3396100747 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe93c159370 0x7fe93c0d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.147+0000 7fe93ad9d700 1 -- 172.21.15.37:0/3396100747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe93c0b2270 msgr2=0x7fe93c15bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.147+0000 7fe93ad9d700 1 --2- 172.21.15.37:0/3396100747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe93c0b2270 0x7fe93c15bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.147+0000 7fe93ad9d700 1 -- 172.21.15.37:0/3396100747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe934009420 con 0x7fe93c0b0620 2023-10-06T02:27:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.147+0000 7fe93b59e700 1 --2- 172.21.15.37:0/3396100747 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe93c159370 0x7fe93c0d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.147+0000 7fe93ad9d700 1 --2- 172.21.15.37:0/3396100747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0b0620 0x7fe93c14faf0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe92c009fa0 tx=0x7fe92c009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.147+0000 7fe932ffd700 1 -- 172.21.15.37:0/3396100747 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c00ed20 con 0x7fe93c0b0620 2023-10-06T02:27:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.147+0000 7fe932ffd700 1 -- 172.21.15.37:0/3396100747 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92c00ee80 con 0x7fe93c0b0620 2023-10-06T02:27:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.147+0000 7fe94098f700 1 -- 172.21.15.37:0/3396100747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93c0cf520 con 0x7fe93c0b0620 2023-10-06T02:27:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.147+0000 7fe932ffd700 1 -- 172.21.15.37:0/3396100747 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c014670 con 0x7fe93c0b0620 2023-10-06T02:27:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.147+0000 7fe94098f700 1 -- 172.21.15.37:0/3396100747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93c0cfb60 con 0x7fe93c0b0620 2023-10-06T02:27:30.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.148+0000 7fe94098f700 1 -- 172.21.15.37:0/3396100747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe93c150090 con 0x7fe93c0b0620 2023-10-06T02:27:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.148+0000 7fe932ffd700 1 -- 172.21.15.37:0/3396100747 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe92c0149e0 con 0x7fe93c0b0620 2023-10-06T02:27:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.149+0000 7fe932ffd700 1 --2- 172.21.15.37:0/3396100747 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe91c066f30 0x7fe91c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.149+0000 7fe932ffd700 1 -- 172.21.15.37:0/3396100747 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6346+0+0 (secure 0 0 0) 0x7fe92c084ef0 con 0x7fe93c0b0620 2023-10-06T02:27:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.149+0000 7fe93a59c700 1 --2- 172.21.15.37:0/3396100747 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe91c066f30 0x7fe91c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.149+0000 7fe93a59c700 1 --2- 172.21.15.37:0/3396100747 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe91c066f30 0x7fe91c0693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe93c16d2f0 tx=0x7fe924009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:30.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.153+0000 7fe932ffd700 1 -- 172.21.15.37:0/3396100747 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe92c051ee0 con 0x7fe93c0b0620 2023-10-06T02:27:30.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.347+0000 7fe94098f700 1 -- 172.21.15.37:0/3396100747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe93c064b00 con 0x7fe93c0b0620 2023-10-06T02:27:30.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.348+0000 7fe932ffd700 1 -- 172.21.15.37:0/3396100747 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+17318 (secure 0 0 0) 0x7fe92c055500 con 0x7fe93c0b0620 2023-10-06T02:27:30.349 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:30.349 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":61,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:27:26.100797+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:25:45.900917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T02:25:47.150749+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.1","mappings":[{"from":4,"to":3}]},{"pgid":"10.10","mappings":[{"from":4,"to":3}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/2196855571":"2023-10-07T02:27:26.100770+0000","172.21.15.37:6833/2196855571":"2023-10-07T02:27:26.100770+0000","172.21.15.37:6833/3956166862":"2023-10-07T02:26:49.342208+0000","172.21.15.37:6835/3956166862":"2023-10-07T02:26:49.342208+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:27:30.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.350+0000 7fe94098f700 1 -- 172.21.15.37:0/3396100747 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe91c066f30 msgr2=0x7fe91c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.350+0000 7fe94098f700 1 --2- 172.21.15.37:0/3396100747 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe91c066f30 0x7fe91c0693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe93c16d2f0 tx=0x7fe924009040 comp rx=0 tx=0).stop 2023-10-06T02:27:30.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.350+0000 7fe94098f700 1 -- 172.21.15.37:0/3396100747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0b0620 msgr2=0x7fe93c14faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.350+0000 7fe94098f700 1 --2- 172.21.15.37:0/3396100747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0b0620 0x7fe93c14faf0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe92c009fa0 tx=0x7fe92c009880 comp rx=0 tx=0).stop 2023-10-06T02:27:30.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.350+0000 7fe94098f700 1 -- 172.21.15.37:0/3396100747 shutdown_connections 2023-10-06T02:27:30.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.350+0000 7fe94098f700 1 --2- 172.21.15.37:0/3396100747 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe93c159370 0x7fe93c0d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.350+0000 7fe94098f700 1 --2- 172.21.15.37:0/3396100747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0b0620 0x7fe93c14faf0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.350+0000 7fe94098f700 1 --2- 172.21.15.37:0/3396100747 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe91c066f30 0x7fe91c0693e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.350+0000 7fe94098f700 1 --2- 172.21.15.37:0/3396100747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe93c0b2270 0x7fe93c15bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.350+0000 7fe94098f700 1 -- 172.21.15.37:0/3396100747 >> 172.21.15.37:0/3396100747 conn(0x7fe93c06c0b0 msgr2=0x7fe93c0b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:30.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.350+0000 7fe94098f700 1 -- 172.21.15.37:0/3396100747 shutdown_connections 2023-10-06T02:27:30.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.350+0000 7fe94098f700 1 -- 172.21.15.37:0/3396100747 wait complete. 2023-10-06T02:27:30.363 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:27:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.482+0000 7f5ea0368700 1 Processor -- start 2023-10-06T02:27:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.483+0000 7f5ea0368700 1 -- start start 2023-10-06T02:27:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.483+0000 7f5ea0368700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e9806dab0 0x7f5e980cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.484+0000 7f5ea0368700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5e9806de80 0x7f5e980b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.484+0000 7f5ea0368700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e980cc250 con 0x7f5e980cb080 2023-10-06T02:27:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.484+0000 7f5ea0368700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e980b0e00 con 0x7f5e9806dab0 2023-10-06T02:27:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.484+0000 7f5ea0368700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e980ccc20 con 0x7f5e9806de80 2023-10-06T02:27:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.484+0000 7f5e9e104700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e9806dab0 0x7f5e980cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.484+0000 7f5e9e104700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e9806dab0 0x7f5e980cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35038/0 (socket says 172.21.15.37:35038) 2023-10-06T02:27:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.484+0000 7f5e9e104700 1 -- 172.21.15.37:0/2095811136 learned_addr learned my addr 172.21.15.37:0/2095811136 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.484+0000 7f5e9e905700 1 --2- 172.21.15.37:0/2095811136 >> v2:172.21.15.191:3300/0 conn(0x7f5e9806de80 0x7f5e980b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.484+0000 7f5e9e104700 1 -- 172.21.15.37:0/2095811136 >> v2:172.21.15.191:3300/0 conn(0x7f5e9806de80 msgr2=0x7f5e980b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.484+0000 7f5e9e104700 1 --2- 172.21.15.37:0/2095811136 >> v2:172.21.15.191:3300/0 conn(0x7f5e9806de80 0x7f5e980b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.484+0000 7f5e9e104700 1 -- 172.21.15.37:0/2095811136 >> v1:172.21.15.191:6789/0 conn(0x7f5e980cb080 legacy=0x7f5e980b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.484+0000 7f5e9e104700 1 -- 172.21.15.37:0/2095811136 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e980cb640 con 0x7f5e9806dab0 2023-10-06T02:27:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.484+0000 7f5e9e104700 1 --2- 172.21.15.37:0/2095811136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e9806dab0 0x7f5e980cc6e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5e980cc1c0 tx=0x7f5e88009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64daaa080c38ee02 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.484+0000 7f5e9d102700 1 -- 172.21.15.37:0/2095811136 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8800e070 con 0x7f5e9806dab0 2023-10-06T02:27:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.484+0000 7f5e9d102700 1 -- 172.21.15.37:0/2095811136 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8800ba20 con 0x7f5e9806dab0 2023-10-06T02:27:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.484+0000 7f5e9d102700 1 -- 172.21.15.37:0/2095811136 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e880092e0 con 0x7f5e9806dab0 2023-10-06T02:27:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.485+0000 7f5ea0368700 1 -- 172.21.15.37:0/2095811136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e9806dab0 msgr2=0x7f5e980cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.485+0000 7f5ea0368700 1 --2- 172.21.15.37:0/2095811136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e9806dab0 0x7f5e980cc6e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5e980cc1c0 tx=0x7f5e88009840 comp rx=0 tx=0).stop 2023-10-06T02:27:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.485+0000 7f5ea0368700 1 -- 172.21.15.37:0/2095811136 shutdown_connections 2023-10-06T02:27:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.485+0000 7f5ea0368700 1 --2- 172.21.15.37:0/2095811136 >> v2:172.21.15.191:3300/0 conn(0x7f5e9806de80 0x7f5e980b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.485+0000 7f5ea0368700 1 --2- 172.21.15.37:0/2095811136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e9806dab0 0x7f5e980cc6e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.485+0000 7f5ea0368700 1 -- 172.21.15.37:0/2095811136 >> 172.21.15.37:0/2095811136 conn(0x7f5e980d0510 msgr2=0x7f5e980d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:30.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.485+0000 7f5ea0368700 1 -- 172.21.15.37:0/2095811136 shutdown_connections 2023-10-06T02:27:30.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.485+0000 7f5ea0368700 1 -- 172.21.15.37:0/2095811136 wait complete. 2023-10-06T02:27:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.486+0000 7f5ea0368700 1 Processor -- start 2023-10-06T02:27:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.486+0000 7f5ea0368700 1 -- start start 2023-10-06T02:27:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.487+0000 7f5ea0368700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e9806dab0 0x7f5e9814f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.487+0000 7f5ea0368700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e9806de80 0x7f5e98151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.487+0000 7f5ea0368700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e980cb080 0x7f5e981522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.487+0000 7f5ea0368700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e980b5c70 con 0x7f5e980cb080 2023-10-06T02:27:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.487+0000 7f5ea0368700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e98153c20 con 0x7f5e9806dab0 2023-10-06T02:27:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.487+0000 7f5ea0368700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e981508a0 con 0x7f5e9806de80 2023-10-06T02:27:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.487+0000 7f5e9e905700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e980cb080 0x7f5e981522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.487+0000 7f5e9e905700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e980cb080 0x7f5e981522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35048/0 (socket says 172.21.15.37:35048) 2023-10-06T02:27:30.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.487+0000 7f5e9e905700 1 -- 172.21.15.37:0/308350031 learned_addr learned my addr 172.21.15.37:0/308350031 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:30.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.487+0000 7f5e9e104700 1 --2- 172.21.15.37:0/308350031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e9806dab0 0x7f5e9814f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.487+0000 7f5e9d903700 1 --2- 172.21.15.37:0/308350031 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e9806de80 0x7f5e98151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.487+0000 7f5e9e905700 1 -- 172.21.15.37:0/308350031 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e9806de80 msgr2=0x7f5e98151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.487+0000 7f5e9e905700 1 --2- 172.21.15.37:0/308350031 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e9806de80 0x7f5e98151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.487+0000 7f5e9e905700 1 -- 172.21.15.37:0/308350031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e9806dab0 msgr2=0x7f5e9814f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:30.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.487+0000 7f5e9e905700 1 --2- 172.21.15.37:0/308350031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e9806dab0 0x7f5e9814f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.487+0000 7f5e9e905700 1 -- 172.21.15.37:0/308350031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e88009ae0 con 0x7f5e980cb080 2023-10-06T02:27:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.487+0000 7f5e9d903700 1 --2- 172.21.15.37:0/308350031 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e9806de80 0x7f5e98151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.487+0000 7f5e9e104700 1 --2- 172.21.15.37:0/308350031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e9806dab0 0x7f5e9814f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.487+0000 7f5e9e905700 1 --2- 172.21.15.37:0/308350031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e980cb080 0x7f5e981522d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000ea50 tx=0x7f5e900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.488+0000 7f5e967fc700 1 -- 172.21.15.37:0/308350031 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9000c850 con 0x7f5e980cb080 2023-10-06T02:27:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.488+0000 7f5e967fc700 1 -- 172.21.15.37:0/308350031 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9000c9b0 con 0x7f5e980cb080 2023-10-06T02:27:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.488+0000 7f5e967fc700 1 -- 172.21.15.37:0/308350031 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9000cd70 con 0x7f5e980cb080 2023-10-06T02:27:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.488+0000 7f5ea0368700 1 -- 172.21.15.37:0/308350031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e98150b80 con 0x7f5e980cb080 2023-10-06T02:27:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.488+0000 7f5ea0368700 1 -- 172.21.15.37:0/308350031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e98151140 con 0x7f5e980cb080 2023-10-06T02:27:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.489+0000 7f5ea0368700 1 -- 172.21.15.37:0/308350031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e98153e20 con 0x7f5e980cb080 2023-10-06T02:27:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.489+0000 7f5e967fc700 1 -- 172.21.15.37:0/308350031 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5e90013680 con 0x7f5e980cb080 2023-10-06T02:27:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.489+0000 7f5e967fc700 1 --2- 172.21.15.37:0/308350031 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5e84066f30 0x7f5e840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.489+0000 7f5e967fc700 1 -- 172.21.15.37:0/308350031 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6346+0+0 (secure 0 0 0) 0x7f5e90084b50 con 0x7f5e980cb080 2023-10-06T02:27:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.490+0000 7f5e9e104700 1 --2- 172.21.15.37:0/308350031 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5e84066f30 0x7f5e840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.490+0000 7f5e9e104700 1 --2- 172.21.15.37:0/308350031 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5e84066f30 0x7f5e840693e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5e88009880 tx=0x7f5e88018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.494+0000 7f5e967fc700 1 -- 172.21.15.37:0/308350031 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e98153e20 con 0x7f5e980cb080 2023-10-06T02:27:30.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:30.731+0000 7f5ea0368700 1 -- 172.21.15.37:0/308350031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5e98153de0 con 0x7f5e980cb080 2023-10-06T02:27:31.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.723+0000 7f5e967fc700 1 -- 172.21.15.37:0/308350031 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5e90051b40 con 0x7f5e980cb080 2023-10-06T02:27:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.726+0000 7f5ea0368700 1 -- 172.21.15.37:0/308350031 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5e84066f30 msgr2=0x7f5e840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.726+0000 7f5ea0368700 1 --2- 172.21.15.37:0/308350031 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5e84066f30 0x7f5e840693e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5e88009880 tx=0x7f5e88018000 comp rx=0 tx=0).stop 2023-10-06T02:27:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.726+0000 7f5ea0368700 1 -- 172.21.15.37:0/308350031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e980cb080 msgr2=0x7f5e981522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.726+0000 7f5ea0368700 1 --2- 172.21.15.37:0/308350031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e980cb080 0x7f5e981522d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000ea50 tx=0x7f5e900091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.726+0000 7f5ea0368700 1 -- 172.21.15.37:0/308350031 shutdown_connections 2023-10-06T02:27:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.726+0000 7f5ea0368700 1 --2- 172.21.15.37:0/308350031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e980cb080 0x7f5e981522d0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.726+0000 7f5ea0368700 1 --2- 172.21.15.37:0/308350031 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5e84066f30 0x7f5e840693e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.726+0000 7f5ea0368700 1 --2- 172.21.15.37:0/308350031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e9806dab0 0x7f5e9814f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.726+0000 7f5ea0368700 1 --2- 172.21.15.37:0/308350031 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e9806de80 0x7f5e98151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.726+0000 7f5ea0368700 1 -- 172.21.15.37:0/308350031 >> 172.21.15.37:0/308350031 conn(0x7f5e980d0510 msgr2=0x7f5e980c60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.726+0000 7f5ea0368700 1 -- 172.21.15.37:0/308350031 shutdown_connections 2023-10-06T02:27:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.726+0000 7f5ea0368700 1 -- 172.21.15.37:0/308350031 wait complete. 2023-10-06T02:27:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:27:31.741 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:27:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.870+0000 7f2f4d855700 1 Processor -- start 2023-10-06T02:27:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.870+0000 7f2f4d855700 1 -- start start 2023-10-06T02:27:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.871+0000 7f2f4d855700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f481593c0 0x7f2f48159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.871+0000 7f2f4d855700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2f480b2380 0x7f2f480b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.871+0000 7f2f4d855700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f480ccb30 0x7f2f480ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.871+0000 7f2f4d855700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f480b07a0 con 0x7f2f481593c0 2023-10-06T02:27:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.871+0000 7f2f4d855700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f480cd8a0 con 0x7f2f480b2380 2023-10-06T02:27:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.871+0000 7f2f4d855700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f480afe70 con 0x7f2f480ccb30 2023-10-06T02:27:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.871+0000 7f2f46ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f481593c0 0x7f2f48159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.871+0000 7f2f46ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f481593c0 0x7f2f48159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35054/0 (socket says 172.21.15.37:35054) 2023-10-06T02:27:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.871+0000 7f2f46ffd700 1 -- 172.21.15.37:0/1860596965 learned_addr learned my addr 172.21.15.37:0/1860596965 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.871+0000 7f2f467fc700 1 --2- 172.21.15.37:0/1860596965 >> v2:172.21.15.191:3300/0 conn(0x7f2f480b2380 0x7f2f480b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.871+0000 7f2f477fe700 1 --2- 172.21.15.37:0/1860596965 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f480ccb30 0x7f2f480ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.871+0000 7f2f46ffd700 1 -- 172.21.15.37:0/1860596965 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f480ccb30 msgr2=0x7f2f480ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.871+0000 7f2f46ffd700 1 --2- 172.21.15.37:0/1860596965 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f480ccb30 0x7f2f480ccfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.871+0000 7f2f46ffd700 1 -- 172.21.15.37:0/1860596965 >> v2:172.21.15.191:3300/0 conn(0x7f2f480b2380 msgr2=0x7f2f480b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.871+0000 7f2f46ffd700 1 --2- 172.21.15.37:0/1860596965 >> v2:172.21.15.191:3300/0 conn(0x7f2f480b2380 0x7f2f480b2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.871+0000 7f2f46ffd700 1 -- 172.21.15.37:0/1860596965 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f480b0150 con 0x7f2f481593c0 2023-10-06T02:27:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.872+0000 7f2f46ffd700 1 --2- 172.21.15.37:0/1860596965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f481593c0 0x7f2f48159790 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f2f480b2170 tx=0x7f2f38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b01f832909455ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.872+0000 7f2f45ffb700 1 -- 172.21.15.37:0/1860596965 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3800b860 con 0x7f2f481593c0 2023-10-06T02:27:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.872+0000 7f2f45ffb700 1 -- 172.21.15.37:0/1860596965 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3800b9c0 con 0x7f2f481593c0 2023-10-06T02:27:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.872+0000 7f2f45ffb700 1 -- 172.21.15.37:0/1860596965 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3800bd60 con 0x7f2f481593c0 2023-10-06T02:27:31.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.872+0000 7f2f4d855700 1 -- 172.21.15.37:0/1860596965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f481593c0 msgr2=0x7f2f48159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:31.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.872+0000 7f2f4d855700 1 --2- 172.21.15.37:0/1860596965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f481593c0 0x7f2f48159790 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f2f480b2170 tx=0x7f2f38009250 comp rx=0 tx=0).stop 2023-10-06T02:27:31.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.872+0000 7f2f4d855700 1 -- 172.21.15.37:0/1860596965 shutdown_connections 2023-10-06T02:27:31.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.872+0000 7f2f4d855700 1 --2- 172.21.15.37:0/1860596965 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f480ccb30 0x7f2f480ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.872+0000 7f2f4d855700 1 --2- 172.21.15.37:0/1860596965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f481593c0 0x7f2f48159790 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.872+0000 7f2f4d855700 1 --2- 172.21.15.37:0/1860596965 >> v2:172.21.15.191:3300/0 conn(0x7f2f480b2380 0x7f2f480b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.872+0000 7f2f4d855700 1 -- 172.21.15.37:0/1860596965 >> 172.21.15.37:0/1860596965 conn(0x7f2f4806c0b0 msgr2=0x7f2f4806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:31.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.872+0000 7f2f4d855700 1 -- 172.21.15.37:0/1860596965 shutdown_connections 2023-10-06T02:27:31.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.872+0000 7f2f4d855700 1 -- 172.21.15.37:0/1860596965 wait complete. 2023-10-06T02:27:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.874+0000 7f2f4d855700 1 Processor -- start 2023-10-06T02:27:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.874+0000 7f2f4d855700 1 -- start start 2023-10-06T02:27:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.874+0000 7f2f4d855700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f480b2380 0x7f2f4815eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.874+0000 7f2f4d855700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f480ccb30 0x7f2f4815c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.874+0000 7f2f4d855700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f481593c0 0x7f2f48157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.874+0000 7f2f4d855700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4815e1a0 con 0x7f2f481593c0 2023-10-06T02:27:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.874+0000 7f2f4d855700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4815ea40 con 0x7f2f480ccb30 2023-10-06T02:27:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.874+0000 7f2f4d855700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4816af00 con 0x7f2f480b2380 2023-10-06T02:27:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.874+0000 7f2f477fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f481593c0 0x7f2f48157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.875+0000 7f2f477fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f481593c0 0x7f2f48157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35062/0 (socket says 172.21.15.37:35062) 2023-10-06T02:27:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.875+0000 7f2f477fe700 1 -- 172.21.15.37:0/2033903231 learned_addr learned my addr 172.21.15.37:0/2033903231 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.875+0000 7f2f467fc700 1 --2- 172.21.15.37:0/2033903231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f480ccb30 0x7f2f4815c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.875+0000 7f2f46ffd700 1 --2- 172.21.15.37:0/2033903231 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f480b2380 0x7f2f4815eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.875+0000 7f2f477fe700 1 -- 172.21.15.37:0/2033903231 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f480b2380 msgr2=0x7f2f4815eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.875+0000 7f2f477fe700 1 --2- 172.21.15.37:0/2033903231 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f480b2380 0x7f2f4815eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.875+0000 7f2f477fe700 1 -- 172.21.15.37:0/2033903231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f480ccb30 msgr2=0x7f2f4815c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.875+0000 7f2f477fe700 1 --2- 172.21.15.37:0/2033903231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f480ccb30 0x7f2f4815c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.875+0000 7f2f477fe700 1 -- 172.21.15.37:0/2033903231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f380094f0 con 0x7f2f481593c0 2023-10-06T02:27:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.875+0000 7f2f477fe700 1 --2- 172.21.15.37:0/2033903231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f481593c0 0x7f2f48157890 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000cee0 tx=0x7f2f40007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.875+0000 7f2f2effd700 1 -- 172.21.15.37:0/2033903231 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4000ad50 con 0x7f2f481593c0 2023-10-06T02:27:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.875+0000 7f2f2effd700 1 -- 172.21.15.37:0/2033903231 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f40016430 con 0x7f2f481593c0 2023-10-06T02:27:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.875+0000 7f2f2effd700 1 -- 172.21.15.37:0/2033903231 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f400167d0 con 0x7f2f481593c0 2023-10-06T02:27:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.875+0000 7f2f4d855700 1 -- 172.21.15.37:0/2033903231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4815e3f0 con 0x7f2f481593c0 2023-10-06T02:27:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.875+0000 7f2f4d855700 1 -- 172.21.15.37:0/2033903231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f48157dd0 con 0x7f2f481593c0 2023-10-06T02:27:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.876+0000 7f2f4d855700 1 -- 172.21.15.37:0/2033903231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4815ebd0 con 0x7f2f481593c0 2023-10-06T02:27:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.877+0000 7f2f2effd700 1 -- 172.21.15.37:0/2033903231 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f40003020 con 0x7f2f481593c0 2023-10-06T02:27:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.877+0000 7f2f2effd700 1 --2- 172.21.15.37:0/2033903231 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2f34066f30 0x7f2f340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.877+0000 7f2f2effd700 1 -- 172.21.15.37:0/2033903231 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6346+0+0 (secure 0 0 0) 0x7f2f40012070 con 0x7f2f481593c0 2023-10-06T02:27:31.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.877+0000 7f2f46ffd700 1 --2- 172.21.15.37:0/2033903231 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2f34066f30 0x7f2f340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:31.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.878+0000 7f2f46ffd700 1 --2- 172.21.15.37:0/2033903231 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2f34066f30 0x7f2f340693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2f480b2170 tx=0x7f2f38017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:31.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:31.882+0000 7f2f2effd700 1 -- 172.21.15.37:0/2033903231 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f40052570 con 0x7f2f481593c0 2023-10-06T02:27:32.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.119+0000 7f2f4d855700 1 -- 172.21.15.37:0/2033903231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2f480b0430 con 0x7f2f481593c0 2023-10-06T02:27:32.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.729+0000 7f2f2effd700 1 -- 172.21.15.37:0/2033903231 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2f40055b90 con 0x7f2f481593c0 2023-10-06T02:27:32.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.731+0000 7f2f4d855700 1 -- 172.21.15.37:0/2033903231 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2f34066f30 msgr2=0x7f2f340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:32.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.731+0000 7f2f4d855700 1 --2- 172.21.15.37:0/2033903231 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2f34066f30 0x7f2f340693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2f480b2170 tx=0x7f2f38017000 comp rx=0 tx=0).stop 2023-10-06T02:27:32.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.731+0000 7f2f4d855700 1 -- 172.21.15.37:0/2033903231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f481593c0 msgr2=0x7f2f48157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:32.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.731+0000 7f2f4d855700 1 --2- 172.21.15.37:0/2033903231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f481593c0 0x7f2f48157890 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000cee0 tx=0x7f2f40007870 comp rx=0 tx=0).stop 2023-10-06T02:27:32.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.732+0000 7f2f4d855700 1 -- 172.21.15.37:0/2033903231 shutdown_connections 2023-10-06T02:27:32.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.732+0000 7f2f4d855700 1 --2- 172.21.15.37:0/2033903231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f481593c0 0x7f2f48157890 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.732+0000 7f2f4d855700 1 --2- 172.21.15.37:0/2033903231 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f480b2380 0x7f2f4815eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.732+0000 7f2f4d855700 1 --2- 172.21.15.37:0/2033903231 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2f34066f30 0x7f2f340693e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.732+0000 7f2f4d855700 1 --2- 172.21.15.37:0/2033903231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f480ccb30 0x7f2f4815c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.732+0000 7f2f4d855700 1 -- 172.21.15.37:0/2033903231 >> 172.21.15.37:0/2033903231 conn(0x7f2f4806c0b0 msgr2=0x7f2f48158720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:32.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.732+0000 7f2f4d855700 1 -- 172.21.15.37:0/2033903231 shutdown_connections 2023-10-06T02:27:32.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.732+0000 7f2f4d855700 1 -- 172.21.15.37:0/2033903231 wait complete. 2023-10-06T02:27:32.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:27:32.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.876+0000 7fe594f13700 1 Processor -- start 2023-10-06T02:27:32.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.876+0000 7fe594f13700 1 -- start start 2023-10-06T02:27:32.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.877+0000 7fe594f13700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe5901593a0 0x7fe5900b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:32.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.877+0000 7fe594f13700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5900d0ba0 0x7fe59015d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:32.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.877+0000 7fe594f13700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5900cbbc0 con 0x7fe590159770 2023-10-06T02:27:32.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.877+0000 7fe594f13700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5900b0710 con 0x7fe5901593a0 2023-10-06T02:27:32.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.877+0000 7fe594f13700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900cb290 con 0x7fe5900d0ba0 2023-10-06T02:27:32.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58dd9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe590159770 0x7fe5900d0490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38582/0 (socket says 172.21.15.37:38582) 2023-10-06T02:27:32.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58dd9b700 1 -- 172.21.15.37:0/1174600964 learned_addr learned my addr 172.21.15.37:0/1174600964 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:32.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58d59a700 1 -- 172.21.15.37:0/1174600964 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1480636563 0 0) 0x7fe5900cbbc0 con 0x7fe590159770 2023-10-06T02:27:32.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58e59c700 1 --2- 172.21.15.37:0/1174600964 >> v2:172.21.15.191:3300/0 conn(0x7fe5901593a0 0x7fe5900b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:32.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58ed9d700 1 --2- 172.21.15.37:0/1174600964 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5900d0ba0 0x7fe59015d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:32.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58d59a700 1 -- 172.21.15.37:0/1174600964 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe57c003570 con 0x7fe590159770 2023-10-06T02:27:32.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58d59a700 1 -- 172.21.15.37:0/1174600964 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 854007209 0 0) 0x7fe57c003570 con 0x7fe590159770 2023-10-06T02:27:32.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58d59a700 1 -- 172.21.15.37:0/1174600964 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5900d0ba0 msgr2=0x7fe59015d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:32.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58d59a700 1 --2- 172.21.15.37:0/1174600964 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5900d0ba0 0x7fe59015d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58d59a700 1 -- 172.21.15.37:0/1174600964 >> v2:172.21.15.191:3300/0 conn(0x7fe5901593a0 msgr2=0x7fe5900b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:32.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58d59a700 1 --2- 172.21.15.37:0/1174600964 >> v2:172.21.15.191:3300/0 conn(0x7fe5901593a0 0x7fe5900b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58d59a700 1 -- 172.21.15.37:0/1174600964 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5900cb570 con 0x7fe590159770 2023-10-06T02:27:32.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58d59a700 1 -- 172.21.15.37:0/1174600964 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7fe578001470 con 0x7fe590159770 2023-10-06T02:27:32.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58d59a700 1 -- 172.21.15.37:0/1174600964 >> v1:172.21.15.37:6789/0 conn(0x7fe590159770 legacy=0x7fe5900d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:32.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58d59a700 1 --2- 172.21.15.37:0/1174600964 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5900d0ba0 0x7fe57c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:32.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58d59a700 1 --2- 172.21.15.37:0/1174600964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe57c003fe0 0x7fe57c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:32.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58d59a700 1 --2- 172.21.15.37:0/1174600964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe57c004d50 0x7fe57c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:32.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58d59a700 1 -- 172.21.15.37:0/1174600964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900b0710 con 0x7fe57c003fe0 2023-10-06T02:27:32.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58d59a700 1 -- 172.21.15.37:0/1174600964 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900cb290 con 0x7fe57c004d50 2023-10-06T02:27:32.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58d59a700 1 -- 172.21.15.37:0/1174600964 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c00ba90 con 0x7fe5900d0ba0 2023-10-06T02:27:32.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58dd9b700 1 --2- 172.21.15.37:0/1174600964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe57c003fe0 0x7fe57c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:32.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58ed9d700 1 --2- 172.21.15.37:0/1174600964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe57c004d50 0x7fe57c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:32.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.878+0000 7fe58e59c700 1 --2- 172.21.15.37:0/1174600964 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5900d0ba0 0x7fe57c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:32.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.879+0000 7fe58dd9b700 1 -- 172.21.15.37:0/1174600964 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5900d0ba0 msgr2=0x7fe57c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:32.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.879+0000 7fe58dd9b700 1 --2- 172.21.15.37:0/1174600964 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5900d0ba0 0x7fe57c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.879+0000 7fe58dd9b700 1 -- 172.21.15.37:0/1174600964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe57c004d50 msgr2=0x7fe57c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:32.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.879+0000 7fe58dd9b700 1 --2- 172.21.15.37:0/1174600964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe57c004d50 0x7fe57c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.879+0000 7fe58dd9b700 1 -- 172.21.15.37:0/1174600964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c003570 con 0x7fe57c003fe0 2023-10-06T02:27:32.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.879+0000 7fe58e59c700 1 --2- 172.21.15.37:0/1174600964 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5900d0ba0 0x7fe57c003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:32.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.879+0000 7fe58dd9b700 1 --2- 172.21.15.37:0/1174600964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe57c003fe0 0x7fe57c004810 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe57800c3c0 tx=0x7fe578001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ade66a352f2f5b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:32.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.879+0000 7fe58d59a700 1 -- 172.21.15.37:0/1174600964 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57800cc30 con 0x7fe57c003fe0 2023-10-06T02:27:32.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.879+0000 7fe58d59a700 1 -- 172.21.15.37:0/1174600964 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57800cd90 con 0x7fe57c003fe0 2023-10-06T02:27:32.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.879+0000 7fe58d59a700 1 -- 172.21.15.37:0/1174600964 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe578005b50 con 0x7fe57c003fe0 2023-10-06T02:27:32.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.879+0000 7fe594f13700 1 -- 172.21.15.37:0/1174600964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe57c003fe0 msgr2=0x7fe57c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:32.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.879+0000 7fe594f13700 1 --2- 172.21.15.37:0/1174600964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe57c003fe0 0x7fe57c004810 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe57800c3c0 tx=0x7fe578001e50 comp rx=0 tx=0).stop 2023-10-06T02:27:32.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.879+0000 7fe58ed9d700 1 -- 172.21.15.37:0/1174600964 reap_dead start 2023-10-06T02:27:32.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.880+0000 7fe594f13700 1 -- 172.21.15.37:0/1174600964 shutdown_connections 2023-10-06T02:27:32.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.880+0000 7fe594f13700 1 -- 172.21.15.37:0/1174600964 >> 172.21.15.37:0/1174600964 conn(0x7fe59006c0b0 msgr2=0x7fe59006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:32.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.880+0000 7fe594f13700 1 -- 172.21.15.37:0/1174600964 shutdown_connections 2023-10-06T02:27:32.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.880+0000 7fe594f13700 1 -- 172.21.15.37:0/1174600964 wait complete. 2023-10-06T02:27:32.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.881+0000 7fe594f13700 1 Processor -- start 2023-10-06T02:27:32.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.881+0000 7fe594f13700 1 -- start start 2023-10-06T02:27:32.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.881+0000 7fe594f13700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe57c003fe0 0x7fe590138dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:32.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.881+0000 7fe594f13700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5900b32d0 0x7fe5900b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:32.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.881+0000 7fe594f13700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5900b3ea0 0x7fe5900b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:32.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.881+0000 7fe594f13700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900b4830 con 0x7fe5900b32d0 2023-10-06T02:27:32.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.881+0000 7fe594f13700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900b61e0 con 0x7fe57c003fe0 2023-10-06T02:27:32.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.881+0000 7fe594f13700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900c7680 con 0x7fe5900b3ea0 2023-10-06T02:27:32.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.881+0000 7fe58dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5900b32d0 0x7fe5900b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:32.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.881+0000 7fe58dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5900b32d0 0x7fe5900b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35078/0 (socket says 172.21.15.37:35078) 2023-10-06T02:27:32.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.881+0000 7fe58dd9b700 1 -- 172.21.15.37:0/2883224398 learned_addr learned my addr 172.21.15.37:0/2883224398 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:32.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.882+0000 7fe58e59c700 1 --2- 172.21.15.37:0/2883224398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe57c003fe0 0x7fe590138dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.882+0000 7fe58ed9d700 1 --2- 172.21.15.37:0/2883224398 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5900b3ea0 0x7fe5900b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.882+0000 7fe58dd9b700 1 -- 172.21.15.37:0/2883224398 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5900b3ea0 msgr2=0x7fe5900b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.882+0000 7fe58dd9b700 1 --2- 172.21.15.37:0/2883224398 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5900b3ea0 0x7fe5900b42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.882+0000 7fe58dd9b700 1 -- 172.21.15.37:0/2883224398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe57c003fe0 msgr2=0x7fe590138dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.882+0000 7fe58dd9b700 1 --2- 172.21.15.37:0/2883224398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe57c003fe0 0x7fe590138dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.882+0000 7fe58dd9b700 1 -- 172.21.15.37:0/2883224398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5900c7960 con 0x7fe5900b32d0 2023-10-06T02:27:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.882+0000 7fe58ed9d700 1 --2- 172.21.15.37:0/2883224398 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5900b3ea0 0x7fe5900b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.882+0000 7fe58dd9b700 1 --2- 172.21.15.37:0/2883224398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5900b32d0 0x7fe5900b3740 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fe578007cd0 tx=0x7fe578015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.882+0000 7fe5867fc700 1 -- 172.21.15.37:0/2883224398 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57800cc30 con 0x7fe5900b32d0 2023-10-06T02:27:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.882+0000 7fe5867fc700 1 -- 172.21.15.37:0/2883224398 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5780072e0 con 0x7fe5900b32d0 2023-10-06T02:27:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.882+0000 7fe594f13700 1 -- 172.21.15.37:0/2883224398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5900c7c40 con 0x7fe5900b32d0 2023-10-06T02:27:32.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.882+0000 7fe5867fc700 1 -- 172.21.15.37:0/2883224398 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe578007680 con 0x7fe5900b32d0 2023-10-06T02:27:32.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.882+0000 7fe594f13700 1 -- 172.21.15.37:0/2883224398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5900c8200 con 0x7fe5900b32d0 2023-10-06T02:27:32.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.883+0000 7fe594f13700 1 -- 172.21.15.37:0/2883224398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe590088b90 con 0x7fe5900b32d0 2023-10-06T02:27:32.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.883+0000 7fe5867fc700 1 -- 172.21.15.37:0/2883224398 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe578019070 con 0x7fe5900b32d0 2023-10-06T02:27:32.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.884+0000 7fe5867fc700 1 --2- 172.21.15.37:0/2883224398 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe570066f30 0x7fe5700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:32.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.884+0000 7fe5867fc700 1 -- 172.21.15.37:0/2883224398 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6346+0+0 (secure 0 0 0) 0x7fe578085f90 con 0x7fe5900b32d0 2023-10-06T02:27:32.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.884+0000 7fe58e59c700 1 --2- 172.21.15.37:0/2883224398 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe570066f30 0x7fe5700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:32.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.885+0000 7fe58e59c700 1 --2- 172.21.15.37:0/2883224398 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe570066f30 0x7fe5700693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe5800077e0 tx=0x7fe58000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:32.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:32.888+0000 7fe5867fc700 1 -- 172.21.15.37:0/2883224398 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5780b75a0 con 0x7fe5900b32d0 2023-10-06T02:27:33.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.083+0000 7fe594f13700 1 -- 172.21.15.37:0/2883224398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe5900b4830 con 0x7fe5900b32d0 2023-10-06T02:27:33.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.734+0000 7fe5867fc700 1 -- 172.21.15.37:0/2883224398 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v62) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe578052f80 con 0x7fe5900b32d0 2023-10-06T02:27:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.738+0000 7fe594f13700 1 -- 172.21.15.37:0/2883224398 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe570066f30 msgr2=0x7fe5700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.738+0000 7fe594f13700 1 --2- 172.21.15.37:0/2883224398 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe570066f30 0x7fe5700693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe5800077e0 tx=0x7fe58000b040 comp rx=0 tx=0).stop 2023-10-06T02:27:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.738+0000 7fe594f13700 1 -- 172.21.15.37:0/2883224398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5900b32d0 msgr2=0x7fe5900b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.738+0000 7fe594f13700 1 --2- 172.21.15.37:0/2883224398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5900b32d0 0x7fe5900b3740 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fe578007cd0 tx=0x7fe578015000 comp rx=0 tx=0).stop 2023-10-06T02:27:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.738+0000 7fe594f13700 1 -- 172.21.15.37:0/2883224398 shutdown_connections 2023-10-06T02:27:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.738+0000 7fe594f13700 1 --2- 172.21.15.37:0/2883224398 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5900b3ea0 0x7fe5900b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.738+0000 7fe594f13700 1 --2- 172.21.15.37:0/2883224398 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe570066f30 0x7fe5700693e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.738+0000 7fe594f13700 1 --2- 172.21.15.37:0/2883224398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe57c003fe0 0x7fe590138dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.738+0000 7fe594f13700 1 --2- 172.21.15.37:0/2883224398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5900b32d0 0x7fe5900b3740 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.738+0000 7fe594f13700 1 -- 172.21.15.37:0/2883224398 >> 172.21.15.37:0/2883224398 conn(0x7fe59006c0b0 msgr2=0x7fe5900c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.738+0000 7fe594f13700 1 -- 172.21.15.37:0/2883224398 shutdown_connections 2023-10-06T02:27:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.738+0000 7fe594f13700 1 -- 172.21.15.37:0/2883224398 wait complete. 2023-10-06T02:27:33.740 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:27:33.752 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:27:33.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.878+0000 7f5ed54dc700 1 Processor -- start 2023-10-06T02:27:34.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.879+0000 7f5ed54dc700 1 -- start start 2023-10-06T02:27:34.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.879+0000 7f5ed54dc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ed0159550 0x7f5ed0159920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.879+0000 7f5ed54dc700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed00b29b0 con 0x7f5ed00b24d0 2023-10-06T02:27:34.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.879+0000 7f5ed54dc700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed00b2c90 con 0x7f5ed006c7c0 2023-10-06T02:27:34.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.879+0000 7f5ed54dc700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00cb620 con 0x7f5ed0159550 2023-10-06T02:27:34.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.879+0000 7f5ece7fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5ed00b24d0 0x7f5ed006c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38588/0 (socket says 172.21.15.37:38588) 2023-10-06T02:27:34.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.879+0000 7f5ece7fc700 1 -- 172.21.15.37:0/1038593827 learned_addr learned my addr 172.21.15.37:0/1038593827 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:34.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5eceffd700 1 --2- 172.21.15.37:0/1038593827 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ed0159550 0x7f5ed0159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5ecdffb700 1 -- 172.21.15.37:0/1038593827 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831979092 0 0) 0x7f5ed00b29b0 con 0x7f5ed00b24d0 2023-10-06T02:27:34.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5ecdffb700 1 -- 172.21.15.37:0/1038593827 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ebc003570 con 0x7f5ed00b24d0 2023-10-06T02:27:34.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5ecdffb700 1 -- 172.21.15.37:0/1038593827 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645779937 0 0) 0x7f5ed00b2c90 con 0x7f5ed006c7c0 2023-10-06T02:27:34.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5ecdffb700 1 -- 172.21.15.37:0/1038593827 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ed00b29b0 con 0x7f5ed006c7c0 2023-10-06T02:27:34.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5ecdffb700 1 -- 172.21.15.37:0/1038593827 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3559714682 0 0) 0x7f5ebc003570 con 0x7f5ed00b24d0 2023-10-06T02:27:34.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5ecdffb700 1 -- 172.21.15.37:0/1038593827 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ed0159550 msgr2=0x7f5ed0159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:34.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5ecdffb700 1 --2- 172.21.15.37:0/1038593827 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ed0159550 0x7f5ed0159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5ecdffb700 1 -- 172.21.15.37:0/1038593827 >> v1:172.21.15.191:6789/0 conn(0x7f5ed006c7c0 legacy=0x7f5ed00cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5ecdffb700 1 -- 172.21.15.37:0/1038593827 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed00cb900 con 0x7f5ed00b24d0 2023-10-06T02:27:34.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5ecdffb700 1 -- 172.21.15.37:0/1038593827 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f5eb8001470 con 0x7f5ed00b24d0 2023-10-06T02:27:34.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5ecdffb700 1 -- 172.21.15.37:0/1038593827 >> v1:172.21.15.37:6789/0 conn(0x7f5ed00b24d0 legacy=0x7f5ed006c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5ecdffb700 1 --2- 172.21.15.37:0/1038593827 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ebc003c20 0x7f5ebc004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5ecdffb700 1 --2- 172.21.15.37:0/1038593827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ebc004810 0x7f5ebc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5ecdffb700 1 --2- 172.21.15.37:0/1038593827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ebc0051c0 0x7f5ebc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5ecdffb700 1 -- 172.21.15.37:0/1038593827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00cb620 con 0x7f5ebc0051c0 2023-10-06T02:27:34.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5ecdffb700 1 -- 172.21.15.37:0/1038593827 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc00c130 con 0x7f5ebc004810 2023-10-06T02:27:34.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5ecdffb700 1 -- 172.21.15.37:0/1038593827 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc00c2c0 con 0x7f5ebc003c20 2023-10-06T02:27:34.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5eceffd700 1 --2- 172.21.15.37:0/1038593827 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ed0159550 0x7f5ed0159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:34.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5ecf7fe700 1 --2- 172.21.15.37:0/1038593827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ebc0051c0 0x7f5ebc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5ece7fc700 1 --2- 172.21.15.37:0/1038593827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ebc004810 0x7f5ebc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.880+0000 7f5eceffd700 1 --2- 172.21.15.37:0/1038593827 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ebc003c20 0x7f5ebc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.881+0000 7f5ecf7fe700 1 -- 172.21.15.37:0/1038593827 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ebc003c20 msgr2=0x7f5ebc004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:34.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.881+0000 7f5ecf7fe700 1 --2- 172.21.15.37:0/1038593827 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ebc003c20 0x7f5ebc004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.881+0000 7f5ecf7fe700 1 -- 172.21.15.37:0/1038593827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ebc004810 msgr2=0x7f5ebc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:34.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.881+0000 7f5ecf7fe700 1 --2- 172.21.15.37:0/1038593827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ebc004810 0x7f5ebc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.881+0000 7f5ecf7fe700 1 -- 172.21.15.37:0/1038593827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc003570 con 0x7f5ebc0051c0 2023-10-06T02:27:34.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.881+0000 7f5ecf7fe700 1 --2- 172.21.15.37:0/1038593827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ebc0051c0 0x7f5ebc00ba60 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5ed006cbc0 tx=0x7f5ec8007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c166c4417e2b7c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:34.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.881+0000 7f5ecdffb700 1 -- 172.21.15.37:0/1038593827 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec800c5d0 con 0x7f5ebc0051c0 2023-10-06T02:27:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.881+0000 7f5ecdffb700 1 -- 172.21.15.37:0/1038593827 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec800c730 con 0x7f5ebc0051c0 2023-10-06T02:27:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.881+0000 7f5ecdffb700 1 -- 172.21.15.37:0/1038593827 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec800caf0 con 0x7f5ebc0051c0 2023-10-06T02:27:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.881+0000 7f5ed54dc700 1 -- 172.21.15.37:0/1038593827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ebc0051c0 msgr2=0x7f5ebc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.881+0000 7f5ed54dc700 1 --2- 172.21.15.37:0/1038593827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ebc0051c0 0x7f5ebc00ba60 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5ed006cbc0 tx=0x7f5ec8007d10 comp rx=0 tx=0).stop 2023-10-06T02:27:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.881+0000 7f5ecf7fe700 1 -- 172.21.15.37:0/1038593827 reap_dead start 2023-10-06T02:27:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.881+0000 7f5ed54dc700 1 -- 172.21.15.37:0/1038593827 shutdown_connections 2023-10-06T02:27:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.881+0000 7f5ed54dc700 1 -- 172.21.15.37:0/1038593827 >> 172.21.15.37:0/1038593827 conn(0x7f5ed006d900 msgr2=0x7f5ed006dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.882+0000 7f5ed54dc700 1 -- 172.21.15.37:0/1038593827 shutdown_connections 2023-10-06T02:27:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.882+0000 7f5ed54dc700 1 -- 172.21.15.37:0/1038593827 wait complete. 2023-10-06T02:27:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.883+0000 7f5ed54dc700 1 Processor -- start 2023-10-06T02:27:34.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.883+0000 7f5ed54dc700 1 -- start start 2023-10-06T02:27:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.883+0000 7f5ed54dc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ed01557e0 0x7f5ed00c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.883+0000 7f5ed54dc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ed0155bb0 0x7f5ed00cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.883+0000 7f5ed54dc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ed00c8420 0x7f5ed00cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.883+0000 7f5ed54dc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00c9670 con 0x7f5ed00c8420 2023-10-06T02:27:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.883+0000 7f5ed54dc700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00c89f0 con 0x7f5ed01557e0 2023-10-06T02:27:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.883+0000 7f5ed54dc700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00c8cd0 con 0x7f5ed0155bb0 2023-10-06T02:27:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.884+0000 7f5ecf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ed00c8420 0x7f5ed00cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.884+0000 7f5ecf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ed00c8420 0x7f5ed00cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35108/0 (socket says 172.21.15.37:35108) 2023-10-06T02:27:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.884+0000 7f5ecf7fe700 1 -- 172.21.15.37:0/1506745591 learned_addr learned my addr 172.21.15.37:0/1506745591 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.884+0000 7f5ece7fc700 1 --2- 172.21.15.37:0/1506745591 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ed0155bb0 0x7f5ed00cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.884+0000 7f5eceffd700 1 --2- 172.21.15.37:0/1506745591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ed01557e0 0x7f5ed00c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.884+0000 7f5ecf7fe700 1 -- 172.21.15.37:0/1506745591 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ed0155bb0 msgr2=0x7f5ed00cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.884+0000 7f5ecf7fe700 1 --2- 172.21.15.37:0/1506745591 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ed0155bb0 0x7f5ed00cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.884+0000 7f5ecf7fe700 1 -- 172.21.15.37:0/1506745591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ed01557e0 msgr2=0x7f5ed00c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.884+0000 7f5ecf7fe700 1 --2- 172.21.15.37:0/1506745591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ed01557e0 0x7f5ed00c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.884+0000 7f5ecf7fe700 1 -- 172.21.15.37:0/1506745591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed00c8fb0 con 0x7f5ed00c8420 2023-10-06T02:27:34.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.884+0000 7f5ecf7fe700 1 --2- 172.21.15.37:0/1506745591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ed00c8420 0x7f5ed00cd230 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0057c0 tx=0x7f5ec8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:34.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.884+0000 7f5ec6ffd700 1 -- 172.21.15.37:0/1506745591 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec800c5d0 con 0x7f5ed00c8420 2023-10-06T02:27:34.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.884+0000 7f5ec6ffd700 1 -- 172.21.15.37:0/1506745591 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec80013b0 con 0x7f5ed00c8420 2023-10-06T02:27:34.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.884+0000 7f5ed54dc700 1 -- 172.21.15.37:0/1506745591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed00c9290 con 0x7f5ed00c8420 2023-10-06T02:27:34.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.884+0000 7f5ec6ffd700 1 -- 172.21.15.37:0/1506745591 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec800caf0 con 0x7f5ed00c8420 2023-10-06T02:27:34.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.884+0000 7f5ed54dc700 1 -- 172.21.15.37:0/1506745591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed0159ea0 con 0x7f5ed00c8420 2023-10-06T02:27:34.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.885+0000 7f5ed54dc700 1 -- 172.21.15.37:0/1506745591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed00c97b0 con 0x7f5ed00c8420 2023-10-06T02:27:34.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.886+0000 7f5ec6ffd700 1 -- 172.21.15.37:0/1506745591 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ec8019030 con 0x7f5ed00c8420 2023-10-06T02:27:34.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.886+0000 7f5ec6ffd700 1 --2- 172.21.15.37:0/1506745591 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5eb0066f30 0x7f5eb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.886+0000 7f5ec6ffd700 1 -- 172.21.15.37:0/1506745591 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5879+0+0 (secure 0 0 0) 0x7f5ec8084d80 con 0x7f5ed00c8420 2023-10-06T02:27:34.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.886+0000 7f5eceffd700 1 --2- 172.21.15.37:0/1506745591 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5eb0066f30 0x7f5eb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.887+0000 7f5eceffd700 1 --2- 172.21.15.37:0/1506745591 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5eb0066f30 0x7f5eb00693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5ed006bdc0 tx=0x7f5ec000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:34.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:33.890+0000 7f5ec6ffd700 1 -- 172.21.15.37:0/1506745591 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ec8051f40 con 0x7f5ed00c8420 2023-10-06T02:27:34.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.082+0000 7f5ed54dc700 1 -- 172.21.15.37:0/1506745591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5ed004bb80 con 0x7f5ed00c8420 2023-10-06T02:27:34.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.744+0000 7f5ec6ffd700 1 -- 172.21.15.37:0/1506745591 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v63) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5ec8055560 con 0x7f5ed00c8420 2023-10-06T02:27:34.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.747+0000 7f5ed54dc700 1 -- 172.21.15.37:0/1506745591 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5eb0066f30 msgr2=0x7f5eb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.747+0000 7f5ed54dc700 1 --2- 172.21.15.37:0/1506745591 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5eb0066f30 0x7f5eb00693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5ed006bdc0 tx=0x7f5ec000b040 comp rx=0 tx=0).stop 2023-10-06T02:27:34.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.747+0000 7f5ed54dc700 1 -- 172.21.15.37:0/1506745591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ed00c8420 msgr2=0x7f5ed00cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.747+0000 7f5ed54dc700 1 --2- 172.21.15.37:0/1506745591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ed00c8420 0x7f5ed00cd230 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0057c0 tx=0x7f5ec8015000 comp rx=0 tx=0).stop 2023-10-06T02:27:34.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.748+0000 7f5ed54dc700 1 -- 172.21.15.37:0/1506745591 shutdown_connections 2023-10-06T02:27:34.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.748+0000 7f5ed54dc700 1 --2- 172.21.15.37:0/1506745591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ed00c8420 0x7f5ed00cd230 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.748+0000 7f5ed54dc700 1 --2- 172.21.15.37:0/1506745591 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5eb0066f30 0x7f5eb00693e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.748+0000 7f5ed54dc700 1 --2- 172.21.15.37:0/1506745591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ed01557e0 0x7f5ed00c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.748+0000 7f5ed54dc700 1 --2- 172.21.15.37:0/1506745591 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ed0155bb0 0x7f5ed00cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.748+0000 7f5ed54dc700 1 -- 172.21.15.37:0/1506745591 >> 172.21.15.37:0/1506745591 conn(0x7f5ed006d900 msgr2=0x7f5ed006c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:34.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.748+0000 7f5ed54dc700 1 -- 172.21.15.37:0/1506745591 shutdown_connections 2023-10-06T02:27:34.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.748+0000 7f5ed54dc700 1 -- 172.21.15.37:0/1506745591 wait complete. 2023-10-06T02:27:34.750 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-10-06T02:27:34.765 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:27:34.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.894+0000 7f2c699b7700 1 Processor -- start 2023-10-06T02:27:34.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.894+0000 7f2c699b7700 1 -- start start 2023-10-06T02:27:34.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.895+0000 7f2c699b7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c641593c0 0x7f2c64159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.895+0000 7f2c699b7700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2c640ccb30 0x7f2c640ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.895+0000 7f2c699b7700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640b07a0 con 0x7f2c640b2380 2023-10-06T02:27:34.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.895+0000 7f2c699b7700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c640cd8a0 con 0x7f2c641593c0 2023-10-06T02:27:34.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.895+0000 7f2c699b7700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c640afe70 con 0x7f2c640ccb30 2023-10-06T02:27:34.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.895+0000 7f2c62ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c641593c0 0x7f2c64159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.895+0000 7f2c627fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2c640b2380 0x7f2c640b2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38600/0 (socket says 172.21.15.37:38600) 2023-10-06T02:27:34.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.895+0000 7f2c627fc700 1 -- 172.21.15.37:0/3397429332 learned_addr learned my addr 172.21.15.37:0/3397429332 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:34.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.895+0000 7f2c637fe700 1 --2- 172.21.15.37:0/3397429332 >> v2:172.21.15.191:3300/0 conn(0x7f2c640ccb30 0x7f2c640ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.895+0000 7f2c62ffd700 1 -- 172.21.15.37:0/3397429332 >> v2:172.21.15.191:3300/0 conn(0x7f2c640ccb30 msgr2=0x7f2c640ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:34.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.895+0000 7f2c62ffd700 1 --2- 172.21.15.37:0/3397429332 >> v2:172.21.15.191:3300/0 conn(0x7f2c640ccb30 0x7f2c640ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.895+0000 7f2c62ffd700 1 -- 172.21.15.37:0/3397429332 >> v1:172.21.15.37:6789/0 conn(0x7f2c640b2380 legacy=0x7f2c640b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.895+0000 7f2c62ffd700 1 -- 172.21.15.37:0/3397429332 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c640b0150 con 0x7f2c641593c0 2023-10-06T02:27:34.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.895+0000 7f2c62ffd700 1 --2- 172.21.15.37:0/3397429332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c641593c0 0x7f2c64159790 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f2c640c74a0 tx=0x7f2c54009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8819277eb67d7d36 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:34.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.896+0000 7f2c61ffb700 1 -- 172.21.15.37:0/3397429332 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5400e070 con 0x7f2c641593c0 2023-10-06T02:27:34.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.896+0000 7f2c61ffb700 1 -- 172.21.15.37:0/3397429332 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5400bc30 con 0x7f2c641593c0 2023-10-06T02:27:34.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.896+0000 7f2c61ffb700 1 -- 172.21.15.37:0/3397429332 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c54012430 con 0x7f2c641593c0 2023-10-06T02:27:34.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.896+0000 7f2c699b7700 1 -- 172.21.15.37:0/3397429332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c641593c0 msgr2=0x7f2c64159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.896+0000 7f2c699b7700 1 --2- 172.21.15.37:0/3397429332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c641593c0 0x7f2c64159790 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f2c640c74a0 tx=0x7f2c54009780 comp rx=0 tx=0).stop 2023-10-06T02:27:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.896+0000 7f2c699b7700 1 -- 172.21.15.37:0/3397429332 shutdown_connections 2023-10-06T02:27:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.896+0000 7f2c699b7700 1 --2- 172.21.15.37:0/3397429332 >> v2:172.21.15.191:3300/0 conn(0x7f2c640ccb30 0x7f2c640ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.896+0000 7f2c699b7700 1 --2- 172.21.15.37:0/3397429332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c641593c0 0x7f2c64159790 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.896+0000 7f2c699b7700 1 -- 172.21.15.37:0/3397429332 >> 172.21.15.37:0/3397429332 conn(0x7f2c6406c0b0 msgr2=0x7f2c6406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.896+0000 7f2c699b7700 1 -- 172.21.15.37:0/3397429332 shutdown_connections 2023-10-06T02:27:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.896+0000 7f2c699b7700 1 -- 172.21.15.37:0/3397429332 wait complete. 2023-10-06T02:27:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.897+0000 7f2c699b7700 1 Processor -- start 2023-10-06T02:27:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.897+0000 7f2c699b7700 1 -- start start 2023-10-06T02:27:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.898+0000 7f2c699b7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c640b2380 0x7f2c6415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.898+0000 7f2c699b7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c640ccb30 0x7f2c640c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.898+0000 7f2c699b7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c641593c0 0x7f2c640c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.898+0000 7f2c699b7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c640c4500 con 0x7f2c640ccb30 2023-10-06T02:27:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.898+0000 7f2c699b7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c640c5930 con 0x7f2c640b2380 2023-10-06T02:27:34.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.898+0000 7f2c699b7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c640c46f0 con 0x7f2c641593c0 2023-10-06T02:27:34.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.898+0000 7f2c627fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c640ccb30 0x7f2c640c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.898+0000 7f2c627fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c640ccb30 0x7f2c640c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35134/0 (socket says 172.21.15.37:35134) 2023-10-06T02:27:34.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.898+0000 7f2c627fc700 1 -- 172.21.15.37:0/4270133125 learned_addr learned my addr 172.21.15.37:0/4270133125 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:34.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.898+0000 7f2c627fc700 1 -- 172.21.15.37:0/4270133125 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c641593c0 msgr2=0x7f2c640c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.898+0000 7f2c62ffd700 1 --2- 172.21.15.37:0/4270133125 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c640b2380 0x7f2c6415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.899+0000 7f2c637fe700 1 --2- 172.21.15.37:0/4270133125 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c641593c0 0x7f2c640c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.899+0000 7f2c627fc700 1 --2- 172.21.15.37:0/4270133125 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c641593c0 0x7f2c640c3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.899+0000 7f2c627fc700 1 -- 172.21.15.37:0/4270133125 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c640b2380 msgr2=0x7f2c6415d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.899+0000 7f2c627fc700 1 --2- 172.21.15.37:0/4270133125 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c640b2380 0x7f2c6415d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.899+0000 7f2c627fc700 1 -- 172.21.15.37:0/4270133125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c54009a20 con 0x7f2c640ccb30 2023-10-06T02:27:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.899+0000 7f2c62ffd700 1 --2- 172.21.15.37:0/4270133125 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c640b2380 0x7f2c6415d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.899+0000 7f2c627fc700 1 --2- 172.21.15.37:0/4270133125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c640ccb30 0x7f2c640c9140 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00c7c0 tx=0x7f2c4c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.899+0000 7f2c5affd700 1 -- 172.21.15.37:0/4270133125 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c005b30 con 0x7f2c640ccb30 2023-10-06T02:27:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.899+0000 7f2c5affd700 1 -- 172.21.15.37:0/4270133125 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4c005cb0 con 0x7f2c640ccb30 2023-10-06T02:27:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.899+0000 7f2c699b7700 1 -- 172.21.15.37:0/4270133125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c640c49d0 con 0x7f2c640ccb30 2023-10-06T02:27:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.899+0000 7f2c5affd700 1 -- 172.21.15.37:0/4270133125 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c004a80 con 0x7f2c640ccb30 2023-10-06T02:27:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.899+0000 7f2c699b7700 1 -- 172.21.15.37:0/4270133125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c640c4f90 con 0x7f2c640ccb30 2023-10-06T02:27:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.900+0000 7f2c699b7700 1 -- 172.21.15.37:0/4270133125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c64088bb0 con 0x7f2c640ccb30 2023-10-06T02:27:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.900+0000 7f2c5affd700 1 -- 172.21.15.37:0/4270133125 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c4c0070f0 con 0x7f2c640ccb30 2023-10-06T02:27:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.901+0000 7f2c5affd700 1 --2- 172.21.15.37:0/4270133125 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2c44066f30 0x7f2c440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.901+0000 7f2c5affd700 1 -- 172.21.15.37:0/4270133125 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f2c4c083870 con 0x7f2c640ccb30 2023-10-06T02:27:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.901+0000 7f2c62ffd700 1 --2- 172.21.15.37:0/4270133125 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2c44066f30 0x7f2c440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.901+0000 7f2c62ffd700 1 --2- 172.21.15.37:0/4270133125 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2c44066f30 0x7f2c440693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2c640c74a0 tx=0x7f2c54019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:34.905+0000 7f2c5affd700 1 -- 172.21.15.37:0/4270133125 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c4c050ca0 con 0x7f2c640ccb30 2023-10-06T02:27:35.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.101+0000 7f2c699b7700 1 -- 172.21.15.37:0/4270133125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f2c640c5a70 con 0x7f2c640ccb30 2023-10-06T02:27:35.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.105+0000 7f2c5affd700 1 -- 172.21.15.37:0/4270133125 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2c4c018020 con 0x7f2c640ccb30 2023-10-06T02:27:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.107+0000 7f2c699b7700 1 -- 172.21.15.37:0/4270133125 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2c44066f30 msgr2=0x7f2c440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.107+0000 7f2c699b7700 1 --2- 172.21.15.37:0/4270133125 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2c44066f30 0x7f2c440693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2c640c74a0 tx=0x7f2c54019000 comp rx=0 tx=0).stop 2023-10-06T02:27:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.107+0000 7f2c699b7700 1 -- 172.21.15.37:0/4270133125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c640ccb30 msgr2=0x7f2c640c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.107+0000 7f2c699b7700 1 --2- 172.21.15.37:0/4270133125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c640ccb30 0x7f2c640c9140 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00c7c0 tx=0x7f2c4c007f70 comp rx=0 tx=0).stop 2023-10-06T02:27:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.107+0000 7f2c699b7700 1 -- 172.21.15.37:0/4270133125 shutdown_connections 2023-10-06T02:27:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.107+0000 7f2c699b7700 1 --2- 172.21.15.37:0/4270133125 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c641593c0 0x7f2c640c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.107+0000 7f2c699b7700 1 --2- 172.21.15.37:0/4270133125 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2c44066f30 0x7f2c440693e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.107+0000 7f2c699b7700 1 --2- 172.21.15.37:0/4270133125 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c640b2380 0x7f2c6415d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.107+0000 7f2c699b7700 1 --2- 172.21.15.37:0/4270133125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c640ccb30 0x7f2c640c9140 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.107+0000 7f2c699b7700 1 -- 172.21.15.37:0/4270133125 >> 172.21.15.37:0/4270133125 conn(0x7f2c6406c0b0 msgr2=0x7f2c640cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.107+0000 7f2c699b7700 1 -- 172.21.15.37:0/4270133125 shutdown_connections 2023-10-06T02:27:35.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.107+0000 7f2c699b7700 1 -- 172.21.15.37:0/4270133125 wait complete. 2023-10-06T02:27:35.119 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2023-10-06T02:27:35.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.238+0000 7f0749a75700 1 Processor -- start 2023-10-06T02:27:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.238+0000 7f0749a75700 1 -- start start 2023-10-06T02:27:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.239+0000 7f0749a75700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07440c63a0 0x7f074415daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.239+0000 7f0749a75700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f074415dfe0 0x7f07440cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.239+0000 7f0749a75700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07440cb650 con 0x7f0744159760 2023-10-06T02:27:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.239+0000 7f0749a75700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07440cc2d0 con 0x7f074415dfe0 2023-10-06T02:27:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.239+0000 7f0749a75700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07440cb930 con 0x7f07440c63a0 2023-10-06T02:27:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.239+0000 7f0743fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f074415dfe0 0x7f07440cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.239+0000 7f0743fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f074415dfe0 0x7f07440cebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43450/0 (socket says 172.21.15.37:43450) 2023-10-06T02:27:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.239+0000 7f0743fff700 1 -- 172.21.15.37:0/2794187875 learned_addr learned my addr 172.21.15.37:0/2794187875 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.239+0000 7f0742ffd700 1 --2- 172.21.15.37:0/2794187875 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07440c63a0 0x7f074415daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.239+0000 7f0743fff700 1 -- 172.21.15.37:0/2794187875 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07440c63a0 msgr2=0x7f074415daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.239+0000 7f0743fff700 1 --2- 172.21.15.37:0/2794187875 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07440c63a0 0x7f074415daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.239+0000 7f0743fff700 1 -- 172.21.15.37:0/2794187875 >> v1:172.21.15.191:6789/0 conn(0x7f0744159760 legacy=0x7f074415d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.239+0000 7f0743fff700 1 -- 172.21.15.37:0/2794187875 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07440cbc10 con 0x7f074415dfe0 2023-10-06T02:27:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.239+0000 7f0743fff700 1 --2- 172.21.15.37:0/2794187875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f074415dfe0 0x7f07440cebf0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f073c009f20 tx=0x7f073c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9feeab655cb4eb6f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.240+0000 7f07427fc700 1 -- 172.21.15.37:0/2794187875 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c00e070 con 0x7f074415dfe0 2023-10-06T02:27:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.240+0000 7f07427fc700 1 -- 172.21.15.37:0/2794187875 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c00bb10 con 0x7f074415dfe0 2023-10-06T02:27:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.240+0000 7f07427fc700 1 -- 172.21.15.37:0/2794187875 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c0092e0 con 0x7f074415dfe0 2023-10-06T02:27:35.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.240+0000 7f0749a75700 1 -- 172.21.15.37:0/2794187875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f074415dfe0 msgr2=0x7f07440cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.240+0000 7f0749a75700 1 --2- 172.21.15.37:0/2794187875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f074415dfe0 0x7f07440cebf0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f073c009f20 tx=0x7f073c009840 comp rx=0 tx=0).stop 2023-10-06T02:27:35.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.240+0000 7f0749a75700 1 -- 172.21.15.37:0/2794187875 shutdown_connections 2023-10-06T02:27:35.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.240+0000 7f0749a75700 1 --2- 172.21.15.37:0/2794187875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f074415dfe0 0x7f07440cebf0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.240+0000 7f0749a75700 1 --2- 172.21.15.37:0/2794187875 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07440c63a0 0x7f074415daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.240+0000 7f0749a75700 1 -- 172.21.15.37:0/2794187875 >> 172.21.15.37:0/2794187875 conn(0x7f074406c890 msgr2=0x7f07440d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:35.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.240+0000 7f0749a75700 1 -- 172.21.15.37:0/2794187875 shutdown_connections 2023-10-06T02:27:35.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.240+0000 7f0749a75700 1 -- 172.21.15.37:0/2794187875 wait complete. 2023-10-06T02:27:35.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.241+0000 7f0749a75700 1 Processor -- start 2023-10-06T02:27:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.242+0000 7f0749a75700 1 -- start start 2023-10-06T02:27:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.242+0000 7f0749a75700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07440c63a0 0x7f074414d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.242+0000 7f0749a75700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0744159760 0x7f07440b4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.242+0000 7f0749a75700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f074415dfe0 0x7f07440ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.242+0000 7f0749a75700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0744153fe0 con 0x7f0744159760 2023-10-06T02:27:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.242+0000 7f0749a75700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0744154470 con 0x7f074415dfe0 2023-10-06T02:27:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.242+0000 7f0749a75700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074414d680 con 0x7f07440c63a0 2023-10-06T02:27:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.242+0000 7f0742ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0744159760 0x7f07440b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.242+0000 7f0742ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0744159760 0x7f07440b4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43454/0 (socket says 172.21.15.37:43454) 2023-10-06T02:27:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.242+0000 7f0742ffd700 1 -- 172.21.15.37:0/2686870742 learned_addr learned my addr 172.21.15.37:0/2686870742 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.243+0000 7f0743fff700 1 --2- 172.21.15.37:0/2686870742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f074415dfe0 0x7f07440ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.243+0000 7f07437fe700 1 --2- 172.21.15.37:0/2686870742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07440c63a0 0x7f074414d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.243+0000 7f0742ffd700 1 -- 172.21.15.37:0/2686870742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07440c63a0 msgr2=0x7f074414d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.243+0000 7f0742ffd700 1 --2- 172.21.15.37:0/2686870742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07440c63a0 0x7f074414d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.243+0000 7f0742ffd700 1 -- 172.21.15.37:0/2686870742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f074415dfe0 msgr2=0x7f07440ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.243+0000 7f0742ffd700 1 --2- 172.21.15.37:0/2686870742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f074415dfe0 0x7f07440ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.243+0000 7f0742ffd700 1 -- 172.21.15.37:0/2686870742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c009ae0 con 0x7f0744159760 2023-10-06T02:27:35.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.243+0000 7f0742ffd700 1 --2- 172.21.15.37:0/2686870742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0744159760 0x7f07440b4600 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f073800d890 tx=0x7f0738008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:35.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.243+0000 7f072b7fe700 1 -- 172.21.15.37:0/2686870742 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073800b600 con 0x7f0744159760 2023-10-06T02:27:35.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.243+0000 7f072b7fe700 1 -- 172.21.15.37:0/2686870742 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073800b760 con 0x7f0744159760 2023-10-06T02:27:35.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.243+0000 7f0749a75700 1 -- 172.21.15.37:0/2686870742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07440c9790 con 0x7f0744159760 2023-10-06T02:27:35.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.243+0000 7f072b7fe700 1 -- 172.21.15.37:0/2686870742 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073800bae0 con 0x7f0744159760 2023-10-06T02:27:35.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.243+0000 7f0749a75700 1 -- 172.21.15.37:0/2686870742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0744153990 con 0x7f0744159760 2023-10-06T02:27:35.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.244+0000 7f0749a75700 1 -- 172.21.15.37:0/2686870742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074406fbf0 con 0x7f0744159760 2023-10-06T02:27:35.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.244+0000 7f072b7fe700 1 -- 172.21.15.37:0/2686870742 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f073801e460 con 0x7f0744159760 2023-10-06T02:27:35.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.245+0000 7f072b7fe700 1 --2- 172.21.15.37:0/2686870742 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0730066f30 0x7f07300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.245+0000 7f072b7fe700 1 -- 172.21.15.37:0/2686870742 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f0738084aa0 con 0x7f0744159760 2023-10-06T02:27:35.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.245+0000 7f07437fe700 1 --2- 172.21.15.37:0/2686870742 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0730066f30 0x7f07300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.246+0000 7f07437fe700 1 --2- 172.21.15.37:0/2686870742 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0730066f30 0x7f07300693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f074414e360 tx=0x7f0734009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.249+0000 7f072b7fe700 1 -- 172.21.15.37:0/2686870742 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0738051e50 con 0x7f0744159760 2023-10-06T02:27:35.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.520+0000 7f0749a75700 1 -- 172.21.15.37:0/2686870742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) v1 -- 0x7f0744153420 con 0x7f0744159760 2023-10-06T02:27:35.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.744+0000 7f072b7fe700 1 -- 172.21.15.37:0/2686870742 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v216) v1 ==== 146+0+0 (secure 0 0 0) 0x7f0738055470 con 0x7f0744159760 2023-10-06T02:27:35.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.746+0000 7f0749a75700 1 -- 172.21.15.37:0/2686870742 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0730066f30 msgr2=0x7f07300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.746+0000 7f0749a75700 1 --2- 172.21.15.37:0/2686870742 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0730066f30 0x7f07300693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f074414e360 tx=0x7f0734009040 comp rx=0 tx=0).stop 2023-10-06T02:27:35.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.746+0000 7f0749a75700 1 -- 172.21.15.37:0/2686870742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0744159760 msgr2=0x7f07440b4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.746+0000 7f0749a75700 1 --2- 172.21.15.37:0/2686870742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0744159760 0x7f07440b4600 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f073800d890 tx=0x7f0738008040 comp rx=0 tx=0).stop 2023-10-06T02:27:35.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.746+0000 7f0749a75700 1 -- 172.21.15.37:0/2686870742 shutdown_connections 2023-10-06T02:27:35.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.746+0000 7f0749a75700 1 --2- 172.21.15.37:0/2686870742 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0730066f30 0x7f07300693e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.746+0000 7f0749a75700 1 --2- 172.21.15.37:0/2686870742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f074415dfe0 0x7f07440ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.746+0000 7f0749a75700 1 --2- 172.21.15.37:0/2686870742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07440c63a0 0x7f074414d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.746+0000 7f0749a75700 1 --2- 172.21.15.37:0/2686870742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0744159760 0x7f07440b4600 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.746+0000 7f0749a75700 1 -- 172.21.15.37:0/2686870742 >> 172.21.15.37:0/2686870742 conn(0x7f074406c890 msgr2=0x7f07440cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:35.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.746+0000 7f0749a75700 1 -- 172.21.15.37:0/2686870742 shutdown_connections 2023-10-06T02:27:35.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.746+0000 7f0749a75700 1 -- 172.21.15.37:0/2686870742 wait complete. 2023-10-06T02:27:35.759 INFO:tasks.cephfs_test_runner:test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2023-10-06T02:27:35.759 INFO:tasks.cephfs_test_runner:Starting test: test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-10-06T02:27:35.760 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2023-10-06T02:27:35.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.879+0000 7f3acd304700 1 Processor -- start 2023-10-06T02:27:35.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.879+0000 7f3acd304700 1 -- start start 2023-10-06T02:27:35.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.880+0000 7f3acd304700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3ac80af4d0 0x7f3ac80b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.880+0000 7f3acd304700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ac80b40a0 con 0x7f3ac80af8a0 2023-10-06T02:27:35.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.880+0000 7f3acd304700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ac80b31b0 con 0x7f3ac80d0a50 2023-10-06T02:27:35.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.880+0000 7f3acd304700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac80b1a60 con 0x7f3ac80af4d0 2023-10-06T02:27:35.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.880+0000 7f3ac6ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3ac80af4d0 0x7f3ac80b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.880+0000 7f3ac67fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3ac80af8a0 0x7f3ac80d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47592/0 (socket says 172.21.15.37:47592) 2023-10-06T02:27:35.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.880+0000 7f3ac67fc700 1 -- 172.21.15.37:0/2105610379 learned_addr learned my addr 172.21.15.37:0/2105610379 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:35.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.881+0000 7f3ac6ffd700 1 -- 172.21.15.37:0/2105610379 >> v1:172.21.15.191:6789/0 conn(0x7f3ac80d0a50 legacy=0x7f3ac80b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.881+0000 7f3ac6ffd700 1 -- 172.21.15.37:0/2105610379 >> v1:172.21.15.37:6789/0 conn(0x7f3ac80af8a0 legacy=0x7f3ac80d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.881+0000 7f3ac5ffb700 1 -- 172.21.15.37:0/2105610379 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706880814 0 0) 0x7f3ac80b40a0 con 0x7f3ac80af8a0 2023-10-06T02:27:35.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.881+0000 7f3ac6ffd700 1 -- 172.21.15.37:0/2105610379 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac80b3490 con 0x7f3ac80af4d0 2023-10-06T02:27:35.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.881+0000 7f3ac6ffd700 1 --2- 172.21.15.37:0/2105610379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ac80af4d0 0x7f3ac80b2470 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009e60 tx=0x7f3ac0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722e9dccdc3b41a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:35.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.881+0000 7f3ac5ffb700 1 -- 172.21.15.37:0/2105610379 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac000e070 con 0x7f3ac80af4d0 2023-10-06T02:27:35.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.881+0000 7f3ac5ffb700 1 -- 172.21.15.37:0/2105610379 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac000bc30 con 0x7f3ac80af4d0 2023-10-06T02:27:35.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.881+0000 7f3ac5ffb700 1 -- 172.21.15.37:0/2105610379 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0012430 con 0x7f3ac80af4d0 2023-10-06T02:27:35.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.881+0000 7f3acd304700 1 -- 172.21.15.37:0/2105610379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ac80af4d0 msgr2=0x7f3ac80b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.881+0000 7f3acd304700 1 --2- 172.21.15.37:0/2105610379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ac80af4d0 0x7f3ac80b2470 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009e60 tx=0x7f3ac0009780 comp rx=0 tx=0).stop 2023-10-06T02:27:35.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.882+0000 7f3acd304700 1 -- 172.21.15.37:0/2105610379 shutdown_connections 2023-10-06T02:27:35.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.882+0000 7f3acd304700 1 --2- 172.21.15.37:0/2105610379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ac80af4d0 0x7f3ac80b2470 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.882+0000 7f3acd304700 1 -- 172.21.15.37:0/2105610379 >> 172.21.15.37:0/2105610379 conn(0x7f3ac806c0b0 msgr2=0x7f3ac806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:35.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.882+0000 7f3acd304700 1 -- 172.21.15.37:0/2105610379 shutdown_connections 2023-10-06T02:27:35.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.882+0000 7f3acd304700 1 -- 172.21.15.37:0/2105610379 wait complete. 2023-10-06T02:27:35.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.883+0000 7f3acd304700 1 Processor -- start 2023-10-06T02:27:35.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.883+0000 7f3acd304700 1 -- start start 2023-10-06T02:27:35.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.883+0000 7f3acd304700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3ac80af4d0 0x7f3ac80c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3acd304700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ac80af8a0 0x7f3ac815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3acd304700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ac80d0a50 0x7f3ac80c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3acd304700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac816aee0 con 0x7f3ac80d0a50 2023-10-06T02:27:35.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3acd304700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac816a2d0 con 0x7f3ac80af8a0 2023-10-06T02:27:35.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3acd304700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac816a5b0 con 0x7f3ac80af4d0 2023-10-06T02:27:35.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3ac77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ac80d0a50 0x7f3ac80c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3ac77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ac80d0a50 0x7f3ac80c5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43468/0 (socket says 172.21.15.37:43468) 2023-10-06T02:27:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3ac77fe700 1 -- 172.21.15.37:0/1089678715 learned_addr learned my addr 172.21.15.37:0/1089678715 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3ac6ffd700 1 --2- 172.21.15.37:0/1089678715 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3ac80af4d0 0x7f3ac80c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3ac67fc700 1 --2- 172.21.15.37:0/1089678715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ac80af8a0 0x7f3ac815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3ac77fe700 1 -- 172.21.15.37:0/1089678715 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3ac80af4d0 msgr2=0x7f3ac80c3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3ac77fe700 1 --2- 172.21.15.37:0/1089678715 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3ac80af4d0 0x7f3ac80c3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3ac77fe700 1 -- 172.21.15.37:0/1089678715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ac80af8a0 msgr2=0x7f3ac815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3ac77fe700 1 --2- 172.21.15.37:0/1089678715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ac80af8a0 0x7f3ac815ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3ac77fe700 1 -- 172.21.15.37:0/1089678715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac0009a20 con 0x7f3ac80d0a50 2023-10-06T02:27:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3ac77fe700 1 --2- 172.21.15.37:0/1089678715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ac80d0a50 0x7f3ac80c5aa0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800c4c0 tx=0x7f3ab8007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3abeffd700 1 -- 172.21.15.37:0/1089678715 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab800ce70 con 0x7f3ac80d0a50 2023-10-06T02:27:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3abeffd700 1 -- 172.21.15.37:0/1089678715 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab8011590 con 0x7f3ac80d0a50 2023-10-06T02:27:35.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3acd304700 1 -- 172.21.15.37:0/1089678715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac816a890 con 0x7f3ac80d0a50 2023-10-06T02:27:35.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3abeffd700 1 -- 172.21.15.37:0/1089678715 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8011970 con 0x7f3ac80d0a50 2023-10-06T02:27:35.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.884+0000 7f3acd304700 1 -- 172.21.15.37:0/1089678715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac80c4220 con 0x7f3ac80d0a50 2023-10-06T02:27:35.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.885+0000 7f3acd304700 1 -- 172.21.15.37:0/1089678715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac8064b00 con 0x7f3ac80d0a50 2023-10-06T02:27:35.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.886+0000 7f3abeffd700 1 -- 172.21.15.37:0/1089678715 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ab8011ce0 con 0x7f3ac80d0a50 2023-10-06T02:27:35.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.886+0000 7f3abeffd700 1 --2- 172.21.15.37:0/1089678715 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3aa8066f30 0x7f3aa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:35.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.886+0000 7f3abeffd700 1 -- 172.21.15.37:0/1089678715 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f3ab80836d0 con 0x7f3ac80d0a50 2023-10-06T02:27:35.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.886+0000 7f3ac6ffd700 1 --2- 172.21.15.37:0/1089678715 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3aa8066f30 0x7f3aa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:35.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.887+0000 7f3ac6ffd700 1 --2- 172.21.15.37:0/1089678715 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3aa8066f30 0x7f3aa80693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009e60 tx=0x7f3ac0019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:35.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:35.890+0000 7f3abeffd700 1 -- 172.21.15.37:0/1089678715 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ab8050a80 con 0x7f3ac80d0a50 2023-10-06T02:27:36.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.169+0000 7f3acd304700 1 -- 172.21.15.37:0/1089678715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) v1 -- 0x7f3ac80b3770 con 0x7f3ac80d0a50 2023-10-06T02:27:36.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.754+0000 7f3abeffd700 1 -- 172.21.15.37:0/1089678715 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v217) v1 ==== 147+0+0 (secure 0 0 0) 0x7f3ab80170d0 con 0x7f3ac80d0a50 2023-10-06T02:27:36.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.756+0000 7f3acd304700 1 -- 172.21.15.37:0/1089678715 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3aa8066f30 msgr2=0x7f3aa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:36.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.756+0000 7f3acd304700 1 --2- 172.21.15.37:0/1089678715 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3aa8066f30 0x7f3aa80693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009e60 tx=0x7f3ac0019000 comp rx=0 tx=0).stop 2023-10-06T02:27:36.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.756+0000 7f3acd304700 1 -- 172.21.15.37:0/1089678715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ac80d0a50 msgr2=0x7f3ac80c5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:36.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.756+0000 7f3acd304700 1 --2- 172.21.15.37:0/1089678715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ac80d0a50 0x7f3ac80c5aa0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800c4c0 tx=0x7f3ab8007f50 comp rx=0 tx=0).stop 2023-10-06T02:27:36.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.757+0000 7f3acd304700 1 -- 172.21.15.37:0/1089678715 shutdown_connections 2023-10-06T02:27:36.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.757+0000 7f3acd304700 1 --2- 172.21.15.37:0/1089678715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ac80d0a50 0x7f3ac80c5aa0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:36.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.757+0000 7f3acd304700 1 --2- 172.21.15.37:0/1089678715 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3ac80af4d0 0x7f3ac80c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:36.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.757+0000 7f3acd304700 1 --2- 172.21.15.37:0/1089678715 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3aa8066f30 0x7f3aa80693e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:36.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.757+0000 7f3acd304700 1 --2- 172.21.15.37:0/1089678715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ac80af8a0 0x7f3ac815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:36.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.757+0000 7f3acd304700 1 -- 172.21.15.37:0/1089678715 >> 172.21.15.37:0/1089678715 conn(0x7f3ac806c0b0 msgr2=0x7f3ac80cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:36.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.757+0000 7f3acd304700 1 -- 172.21.15.37:0/1089678715 shutdown_connections 2023-10-06T02:27:36.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.757+0000 7f3acd304700 1 -- 172.21.15.37:0/1089678715 wait complete. 2023-10-06T02:27:36.770 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:27:36.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.895+0000 7f1a45d8a700 1 Processor -- start 2023-10-06T02:27:36.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.895+0000 7f1a45d8a700 1 -- start start 2023-10-06T02:27:36.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.895+0000 7f1a45d8a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a40159610 0x7f1a400b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.895+0000 7f1a45d8a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1a401599e0 0x7f1a400d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.895+0000 7f1a45d8a700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a400b43b0 con 0x7f1a400b3310 2023-10-06T02:27:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.895+0000 7f1a45d8a700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a400cde50 con 0x7f1a40159610 2023-10-06T02:27:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.895+0000 7f1a45d8a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a400b1020 con 0x7f1a401599e0 2023-10-06T02:27:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.896+0000 7f1a3f7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a40159610 0x7f1a400b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.896+0000 7f1a3f7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a40159610 0x7f1a400b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43482/0 (socket says 172.21.15.37:43482) 2023-10-06T02:27:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.896+0000 7f1a3f7fe700 1 -- 172.21.15.37:0/2701195889 learned_addr learned my addr 172.21.15.37:0/2701195889 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.896+0000 7f1a3effd700 1 --2- 172.21.15.37:0/2701195889 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1a401599e0 0x7f1a400d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.896+0000 7f1a3f7fe700 1 -- 172.21.15.37:0/2701195889 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1a401599e0 msgr2=0x7f1a400d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.896+0000 7f1a3f7fe700 1 --2- 172.21.15.37:0/2701195889 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1a401599e0 0x7f1a400d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.896+0000 7f1a3f7fe700 1 -- 172.21.15.37:0/2701195889 >> v1:172.21.15.191:6789/0 conn(0x7f1a400b3310 legacy=0x7f1a4015d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.896+0000 7f1a3f7fe700 1 -- 172.21.15.37:0/2701195889 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a400b37a0 con 0x7f1a40159610 2023-10-06T02:27:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.896+0000 7f1a3f7fe700 1 --2- 172.21.15.37:0/2701195889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a40159610 0x7f1a400b0ae0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1a300099b0 tx=0x7f1a30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2438b46b809672 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.896+0000 7f1a3e7fc700 1 -- 172.21.15.37:0/2701195889 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3000b820 con 0x7f1a40159610 2023-10-06T02:27:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.896+0000 7f1a3e7fc700 1 -- 172.21.15.37:0/2701195889 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3000b980 con 0x7f1a40159610 2023-10-06T02:27:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.896+0000 7f1a3e7fc700 1 -- 172.21.15.37:0/2701195889 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3000bd20 con 0x7f1a40159610 2023-10-06T02:27:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.897+0000 7f1a45d8a700 1 -- 172.21.15.37:0/2701195889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a40159610 msgr2=0x7f1a400b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.897+0000 7f1a45d8a700 1 --2- 172.21.15.37:0/2701195889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a40159610 0x7f1a400b0ae0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1a300099b0 tx=0x7f1a30009250 comp rx=0 tx=0).stop 2023-10-06T02:27:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.897+0000 7f1a45d8a700 1 -- 172.21.15.37:0/2701195889 shutdown_connections 2023-10-06T02:27:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.897+0000 7f1a45d8a700 1 --2- 172.21.15.37:0/2701195889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a40159610 0x7f1a400b0ae0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.897+0000 7f1a45d8a700 1 --2- 172.21.15.37:0/2701195889 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1a401599e0 0x7f1a400d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.897+0000 7f1a45d8a700 1 -- 172.21.15.37:0/2701195889 >> 172.21.15.37:0/2701195889 conn(0x7f1a4006c0b0 msgr2=0x7f1a4006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.897+0000 7f1a45d8a700 1 -- 172.21.15.37:0/2701195889 shutdown_connections 2023-10-06T02:27:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.897+0000 7f1a45d8a700 1 -- 172.21.15.37:0/2701195889 wait complete. 2023-10-06T02:27:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.898+0000 7f1a45d8a700 1 Processor -- start 2023-10-06T02:27:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.898+0000 7f1a45d8a700 1 -- start start 2023-10-06T02:27:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a45d8a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1a400b3310 0x7f1a400c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a45d8a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1a40159610 0x7f1a400c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a45d8a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a401599e0 0x7f1a400c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a45d8a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a400c4c30 con 0x7f1a401599e0 2023-10-06T02:27:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a45d8a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a400c4f10 con 0x7f1a40159610 2023-10-06T02:27:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a45d8a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a400c51f0 con 0x7f1a400b3310 2023-10-06T02:27:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a3ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a401599e0 0x7f1a400c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a3ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a401599e0 0x7f1a400c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43496/0 (socket says 172.21.15.37:43496) 2023-10-06T02:27:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a3ffff700 1 -- 172.21.15.37:0/3239551172 learned_addr learned my addr 172.21.15.37:0/3239551172 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a3f7fe700 1 --2- 172.21.15.37:0/3239551172 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1a400b3310 0x7f1a400c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a3effd700 1 --2- 172.21.15.37:0/3239551172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1a40159610 0x7f1a400c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a3ffff700 1 -- 172.21.15.37:0/3239551172 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1a400b3310 msgr2=0x7f1a400c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:36.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a3ffff700 1 --2- 172.21.15.37:0/3239551172 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1a400b3310 0x7f1a400c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:36.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a3ffff700 1 -- 172.21.15.37:0/3239551172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1a40159610 msgr2=0x7f1a400c4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:36.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a3ffff700 1 --2- 172.21.15.37:0/3239551172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1a40159610 0x7f1a400c4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:36.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a3ffff700 1 -- 172.21.15.37:0/3239551172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a300094f0 con 0x7f1a401599e0 2023-10-06T02:27:36.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a3effd700 1 --2- 172.21.15.37:0/3239551172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1a40159610 0x7f1a400c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:36.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a3ffff700 1 --2- 172.21.15.37:0/3239551172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a401599e0 0x7f1a400c8520 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1a3800c930 tx=0x7f1a380026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:36.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a277fe700 1 -- 172.21.15.37:0/3239551172 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3800ce70 con 0x7f1a401599e0 2023-10-06T02:27:36.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a277fe700 1 -- 172.21.15.37:0/3239551172 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3800a7e0 con 0x7f1a401599e0 2023-10-06T02:27:36.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.899+0000 7f1a45d8a700 1 -- 172.21.15.37:0/3239551172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a400c54d0 con 0x7f1a401599e0 2023-10-06T02:27:36.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.900+0000 7f1a277fe700 1 -- 172.21.15.37:0/3239551172 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3800aba0 con 0x7f1a401599e0 2023-10-06T02:27:36.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.900+0000 7f1a45d8a700 1 -- 172.21.15.37:0/3239551172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a400c6210 con 0x7f1a401599e0 2023-10-06T02:27:36.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.901+0000 7f1a45d8a700 1 -- 172.21.15.37:0/3239551172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a400c59f0 con 0x7f1a401599e0 2023-10-06T02:27:36.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.901+0000 7f1a277fe700 1 -- 172.21.15.37:0/3239551172 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a38012420 con 0x7f1a401599e0 2023-10-06T02:27:36.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.901+0000 7f1a277fe700 1 --2- 172.21.15.37:0/3239551172 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1a2c066f30 0x7f1a2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:36.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.901+0000 7f1a277fe700 1 -- 172.21.15.37:0/3239551172 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f1a380847c0 con 0x7f1a401599e0 2023-10-06T02:27:36.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.902+0000 7f1a3f7fe700 1 --2- 172.21.15.37:0/3239551172 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1a2c066f30 0x7f1a2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:36.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.902+0000 7f1a3f7fe700 1 --2- 172.21.15.37:0/3239551172 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1a2c066f30 0x7f1a2c0693e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1a300099b0 tx=0x7f1a30016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:36.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:36.906+0000 7f1a277fe700 1 -- 172.21.15.37:0/3239551172 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a400c59f0 con 0x7f1a401599e0 2023-10-06T02:27:37.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.099+0000 7f1a45d8a700 1 -- 172.21.15.37:0/3239551172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1a400c59f0 con 0x7f1a401599e0 2023-10-06T02:27:37.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.105+0000 7f1a277fe700 1 -- 172.21.15.37:0/3239551172 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1a400c59f0 con 0x7f1a401599e0 2023-10-06T02:27:37.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.107+0000 7f1a45d8a700 1 -- 172.21.15.37:0/3239551172 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1a2c066f30 msgr2=0x7f1a2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.107+0000 7f1a45d8a700 1 --2- 172.21.15.37:0/3239551172 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1a2c066f30 0x7f1a2c0693e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1a300099b0 tx=0x7f1a30016000 comp rx=0 tx=0).stop 2023-10-06T02:27:37.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.107+0000 7f1a45d8a700 1 -- 172.21.15.37:0/3239551172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a401599e0 msgr2=0x7f1a400c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.107+0000 7f1a45d8a700 1 --2- 172.21.15.37:0/3239551172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a401599e0 0x7f1a400c8520 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1a3800c930 tx=0x7f1a380026e0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.107+0000 7f1a45d8a700 1 -- 172.21.15.37:0/3239551172 shutdown_connections 2023-10-06T02:27:37.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.107+0000 7f1a45d8a700 1 --2- 172.21.15.37:0/3239551172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a401599e0 0x7f1a400c8520 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.107+0000 7f1a45d8a700 1 --2- 172.21.15.37:0/3239551172 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1a400b3310 0x7f1a400c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.107+0000 7f1a45d8a700 1 --2- 172.21.15.37:0/3239551172 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1a2c066f30 0x7f1a2c0693e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.107+0000 7f1a45d8a700 1 --2- 172.21.15.37:0/3239551172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1a40159610 0x7f1a400c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.107+0000 7f1a45d8a700 1 -- 172.21.15.37:0/3239551172 >> 172.21.15.37:0/3239551172 conn(0x7f1a4006c0b0 msgr2=0x7f1a4015bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:37.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.107+0000 7f1a45d8a700 1 -- 172.21.15.37:0/3239551172 shutdown_connections 2023-10-06T02:27:37.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.107+0000 7f1a45d8a700 1 -- 172.21.15.37:0/3239551172 wait complete. 2023-10-06T02:27:37.120 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:27:37.120 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:27:37.160 DEBUG:teuthology.orchestra.run.smithi191:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:27:37.205 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:27:37.205 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:27:37.205 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:37.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.323+0000 7fbf3e9e7700 1 Processor -- start 2023-10-06T02:27:37.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.323+0000 7fbf3e9e7700 1 -- start start 2023-10-06T02:27:37.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.324+0000 7fbf3e9e7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf380c63a0 0x7fbf3815daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.324+0000 7fbf3e9e7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf3815dfe0 0x7fbf380cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.324+0000 7fbf3e9e7700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf380cb650 con 0x7fbf38159760 2023-10-06T02:27:37.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.324+0000 7fbf3e9e7700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf380cc2d0 con 0x7fbf3815dfe0 2023-10-06T02:27:37.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.324+0000 7fbf3e9e7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf380cb930 con 0x7fbf380c63a0 2023-10-06T02:27:37.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.324+0000 7fbf3cf84700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf3815dfe0 0x7fbf380cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.324+0000 7fbf3cf84700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf3815dfe0 0x7fbf380cebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43510/0 (socket says 172.21.15.37:43510) 2023-10-06T02:27:37.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.324+0000 7fbf3cf84700 1 -- 172.21.15.37:0/2249824978 learned_addr learned my addr 172.21.15.37:0/2249824978 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:37.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.325+0000 7fbf377fe700 1 --2- 172.21.15.37:0/2249824978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf380c63a0 0x7fbf3815daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.325+0000 7fbf3cf84700 1 -- 172.21.15.37:0/2249824978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf380c63a0 msgr2=0x7fbf3815daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:37.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.325+0000 7fbf3cf84700 1 --2- 172.21.15.37:0/2249824978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf380c63a0 0x7fbf3815daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.325+0000 7fbf3cf84700 1 -- 172.21.15.37:0/2249824978 >> v1:172.21.15.191:6789/0 conn(0x7fbf38159760 legacy=0x7fbf3815d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.325+0000 7fbf3cf84700 1 -- 172.21.15.37:0/2249824978 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf380cbc10 con 0x7fbf3815dfe0 2023-10-06T02:27:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.325+0000 7fbf377fe700 1 --2- 172.21.15.37:0/2249824978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf380c63a0 0x7fbf3815daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.325+0000 7fbf3cf84700 1 --2- 172.21.15.37:0/2249824978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf3815dfe0 0x7fbf380cebf0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009f20 tx=0x7fbf30009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4bbeaab078662c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.325+0000 7fbf36ffd700 1 -- 172.21.15.37:0/2249824978 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3000e070 con 0x7fbf3815dfe0 2023-10-06T02:27:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.325+0000 7fbf36ffd700 1 -- 172.21.15.37:0/2249824978 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3000bb10 con 0x7fbf3815dfe0 2023-10-06T02:27:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.325+0000 7fbf36ffd700 1 -- 172.21.15.37:0/2249824978 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf300092e0 con 0x7fbf3815dfe0 2023-10-06T02:27:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.326+0000 7fbf3e9e7700 1 -- 172.21.15.37:0/2249824978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf3815dfe0 msgr2=0x7fbf380cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.326+0000 7fbf3e9e7700 1 --2- 172.21.15.37:0/2249824978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf3815dfe0 0x7fbf380cebf0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009f20 tx=0x7fbf30009840 comp rx=0 tx=0).stop 2023-10-06T02:27:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.326+0000 7fbf3e9e7700 1 -- 172.21.15.37:0/2249824978 shutdown_connections 2023-10-06T02:27:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.326+0000 7fbf3e9e7700 1 --2- 172.21.15.37:0/2249824978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf3815dfe0 0x7fbf380cebf0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.326+0000 7fbf3e9e7700 1 --2- 172.21.15.37:0/2249824978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf380c63a0 0x7fbf3815daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.326+0000 7fbf3e9e7700 1 -- 172.21.15.37:0/2249824978 >> 172.21.15.37:0/2249824978 conn(0x7fbf3806c890 msgr2=0x7fbf380d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:37.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.326+0000 7fbf3e9e7700 1 -- 172.21.15.37:0/2249824978 shutdown_connections 2023-10-06T02:27:37.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.326+0000 7fbf3e9e7700 1 -- 172.21.15.37:0/2249824978 wait complete. 2023-10-06T02:27:37.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.327+0000 7fbf3e9e7700 1 Processor -- start 2023-10-06T02:27:37.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.327+0000 7fbf3e9e7700 1 -- start start 2023-10-06T02:27:37.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf3e9e7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf380c63a0 0x7fbf3814a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf3e9e7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf38159760 0x7fbf380b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf3e9e7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf3815dfe0 0x7fbf380b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf3e9e7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf380b5af0 con 0x7fbf380c63a0 2023-10-06T02:27:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf3e9e7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3814a5c0 con 0x7fbf3815dfe0 2023-10-06T02:27:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf3e9e7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf38150a60 con 0x7fbf38159760 2023-10-06T02:27:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf37fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf380c63a0 0x7fbf3814a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf37fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf380c63a0 0x7fbf3814a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43522/0 (socket says 172.21.15.37:43522) 2023-10-06T02:27:37.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf37fff700 1 -- 172.21.15.37:0/107468056 learned_addr learned my addr 172.21.15.37:0/107468056 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:37.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf377fe700 1 --2- 172.21.15.37:0/107468056 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf38159760 0x7fbf380b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf3cf84700 1 --2- 172.21.15.37:0/107468056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf3815dfe0 0x7fbf380b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf37fff700 1 -- 172.21.15.37:0/107468056 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf38159760 msgr2=0x7fbf380b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf37fff700 1 --2- 172.21.15.37:0/107468056 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf38159760 0x7fbf380b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf37fff700 1 -- 172.21.15.37:0/107468056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf3815dfe0 msgr2=0x7fbf380b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf37fff700 1 --2- 172.21.15.37:0/107468056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf3815dfe0 0x7fbf380b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf37fff700 1 -- 172.21.15.37:0/107468056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf30009ae0 con 0x7fbf380c63a0 2023-10-06T02:27:37.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf37fff700 1 --2- 172.21.15.37:0/107468056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf380c63a0 0x7fbf3814a080 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800c590 tx=0x7fbf2800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf2ffff700 1 -- 172.21.15.37:0/107468056 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf28011590 con 0x7fbf380c63a0 2023-10-06T02:27:37.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf2ffff700 1 -- 172.21.15.37:0/107468056 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf280116f0 con 0x7fbf380c63a0 2023-10-06T02:27:37.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf3e9e7700 1 -- 172.21.15.37:0/107468056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf380b4ee0 con 0x7fbf380c63a0 2023-10-06T02:27:37.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.328+0000 7fbf2ffff700 1 -- 172.21.15.37:0/107468056 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf28011ab0 con 0x7fbf380c63a0 2023-10-06T02:27:37.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.329+0000 7fbf3e9e7700 1 -- 172.21.15.37:0/107468056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf380b54a0 con 0x7fbf380c63a0 2023-10-06T02:27:37.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.329+0000 7fbf3e9e7700 1 -- 172.21.15.37:0/107468056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf3806fbf0 con 0x7fbf380c63a0 2023-10-06T02:27:37.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.330+0000 7fbf2ffff700 1 -- 172.21.15.37:0/107468056 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf2801b3b0 con 0x7fbf380c63a0 2023-10-06T02:27:37.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.330+0000 7fbf2ffff700 1 --2- 172.21.15.37:0/107468056 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbf18066f30 0x7fbf180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.330+0000 7fbf2ffff700 1 -- 172.21.15.37:0/107468056 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fbf28083950 con 0x7fbf380c63a0 2023-10-06T02:27:37.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.330+0000 7fbf377fe700 1 --2- 172.21.15.37:0/107468056 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbf18066f30 0x7fbf180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.331+0000 7fbf377fe700 1 --2- 172.21.15.37:0/107468056 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbf18066f30 0x7fbf180693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbf20006f00 tx=0x7fbf20008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.334+0000 7fbf2ffff700 1 -- 172.21.15.37:0/107468056 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf28050d00 con 0x7fbf380c63a0 2023-10-06T02:27:37.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.572+0000 7fbf3e9e7700 1 -- 172.21.15.37:0/107468056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf3804bb80 con 0x7fbf380c63a0 2023-10-06T02:27:37.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.573+0000 7fbf2ffff700 1 -- 172.21.15.37:0/107468056 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fbf28017020 con 0x7fbf380c63a0 2023-10-06T02:27:37.574 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:37.575 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/1914186828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1914186828},{"type":"v1","addr":"172.21.15.191:6836","nonce":1914186828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3684230798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":3684230798},{"type":"v1","addr":"172.21.15.191:6837","nonce":3684230798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1883185549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1883185549},{"type":"v1","addr":"172.21.15.37:6834","nonce":1883185549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6300,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2017427746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2017427746},{"type":"v1","addr":"172.21.15.37:6835","nonce":2017427746}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[]} 2023-10-06T02:27:37.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.575+0000 7fbf3e9e7700 1 -- 172.21.15.37:0/107468056 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbf18066f30 msgr2=0x7fbf180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.575+0000 7fbf3e9e7700 1 --2- 172.21.15.37:0/107468056 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbf18066f30 0x7fbf180693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbf20006f00 tx=0x7fbf20008040 comp rx=0 tx=0).stop 2023-10-06T02:27:37.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.575+0000 7fbf3e9e7700 1 -- 172.21.15.37:0/107468056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf380c63a0 msgr2=0x7fbf3814a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.575+0000 7fbf3e9e7700 1 --2- 172.21.15.37:0/107468056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf380c63a0 0x7fbf3814a080 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800c590 tx=0x7fbf2800c950 comp rx=0 tx=0).stop 2023-10-06T02:27:37.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.575+0000 7fbf3e9e7700 1 -- 172.21.15.37:0/107468056 shutdown_connections 2023-10-06T02:27:37.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.575+0000 7fbf3e9e7700 1 --2- 172.21.15.37:0/107468056 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbf18066f30 0x7fbf180693e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.575+0000 7fbf3e9e7700 1 --2- 172.21.15.37:0/107468056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf3815dfe0 0x7fbf380b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.575+0000 7fbf3e9e7700 1 --2- 172.21.15.37:0/107468056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf380c63a0 0x7fbf3814a080 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.575+0000 7fbf3e9e7700 1 --2- 172.21.15.37:0/107468056 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf38159760 0x7fbf380b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.575+0000 7fbf3e9e7700 1 -- 172.21.15.37:0/107468056 >> 172.21.15.37:0/107468056 conn(0x7fbf3806c890 msgr2=0x7fbf380c96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:37.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.575+0000 7fbf3e9e7700 1 -- 172.21.15.37:0/107468056 shutdown_connections 2023-10-06T02:27:37.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.575+0000 7fbf3e9e7700 1 -- 172.21.15.37:0/107468056 wait complete. 2023-10-06T02:27:37.578 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 41 2023-10-06T02:27:37.589 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:27:37.589 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:27:37.589 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:27:37.589 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:27:37.590 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:27:37.590 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:27:37.590 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:27:37.590 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:27:37.590 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:27:37.590 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:27:37.591 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:27:37.591 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:27:37.591 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:27:37.591 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:27:37.591 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:27:37.591 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:27:37.601 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:27:37.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:27:37.601 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:27:37.602 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:27:37.603 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:27:37.603 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:27:37.604 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:27:37.604 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:27:37.643 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:27:37.644 DEBUG:teuthology.parallel:result is None 2023-10-06T02:27:37.645 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:27:37.645 DEBUG:teuthology.parallel:result is None 2023-10-06T02:27:37.646 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:27:37.646 DEBUG:teuthology.parallel:result is None 2023-10-06T02:27:37.647 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:27:37.647 DEBUG:teuthology.parallel:result is None 2023-10-06T02:27:37.647 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:27:37.719 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-10-06T02:27:37.720 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-10-06T02:27:37.729 INFO:tasks.ceph.mds.d.smithi191.stdout:starting mds.d at 2023-10-06T02:27:37.729 INFO:tasks.ceph.mds.b.smithi191.stdout:starting mds.b at 2023-10-06T02:27:37.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.773+0000 7f3fbf340700 1 Processor -- start 2023-10-06T02:27:37.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.773+0000 7f3fbf340700 1 -- start start 2023-10-06T02:27:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.774+0000 7f3fbf340700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3fb80c37c0 0x7f3fb80c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.774+0000 7f3fbf340700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3fb8140f90 0x7f3fb80ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.774+0000 7f3fbf340700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb80c8fd0 con 0x7f3fb8140bc0 2023-10-06T02:27:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.774+0000 7f3fbf340700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb80ca780 con 0x7f3fb8140f90 2023-10-06T02:27:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.774+0000 7f3fbf340700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb80caa60 con 0x7f3fb80c37c0 2023-10-06T02:27:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.774+0000 7f3fbd8dd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3fb8140f90 0x7f3fb80ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.774+0000 7f3fbc8db700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3fb80c37c0 0x7f3fb80c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.774+0000 7f3fbd0dc700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f3fb8140bc0 0x7f3fb80c30b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:41100/0 (socket says 172.21.15.37:41100) 2023-10-06T02:27:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.774+0000 7f3fbd0dc700 1 -- 172.21.15.37:0/3361631380 learned_addr learned my addr 172.21.15.37:0/3361631380 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.775+0000 7f3fbd8dd700 1 -- 172.21.15.37:0/3361631380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3fb80c37c0 msgr2=0x7f3fb80c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.775+0000 7f3fbd8dd700 1 --2- 172.21.15.37:0/3361631380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3fb80c37c0 0x7f3fb80c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.775+0000 7f3fbd8dd700 1 -- 172.21.15.37:0/3361631380 >> v1:172.21.15.191:6789/0 conn(0x7f3fb8140bc0 legacy=0x7f3fb80c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.775+0000 7f3fbd8dd700 1 -- 172.21.15.37:0/3361631380 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb80cad40 con 0x7f3fb8140f90 2023-10-06T02:27:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.775+0000 7f3fbd8dd700 1 --2- 172.21.15.37:0/3361631380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fb8140f90 0x7f3fb80ca0a0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009e60 tx=0x7f3fb0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87947265a7755874 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.776+0000 7f3faffff700 1 -- 172.21.15.37:0/3361631380 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb000e070 con 0x7f3fb8140f90 2023-10-06T02:27:37.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.776+0000 7f3faffff700 1 -- 172.21.15.37:0/3361631380 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb000bb60 con 0x7f3fb8140f90 2023-10-06T02:27:37.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.776+0000 7f3faffff700 1 -- 172.21.15.37:0/3361631380 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0012430 con 0x7f3fb8140f90 2023-10-06T02:27:37.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.777+0000 7f3fbf340700 1 -- 172.21.15.37:0/3361631380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fb8140f90 msgr2=0x7f3fb80ca0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.777+0000 7f3fbf340700 1 --2- 172.21.15.37:0/3361631380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fb8140f90 0x7f3fb80ca0a0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009e60 tx=0x7f3fb0009780 comp rx=0 tx=0).stop 2023-10-06T02:27:37.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.777+0000 7f3fbf340700 1 -- 172.21.15.37:0/3361631380 shutdown_connections 2023-10-06T02:27:37.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.777+0000 7f3fbf340700 1 --2- 172.21.15.37:0/3361631380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fb8140f90 0x7f3fb80ca0a0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.777+0000 7f3fbf340700 1 --2- 172.21.15.37:0/3361631380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3fb80c37c0 0x7f3fb80c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.777+0000 7f3fbf340700 1 -- 172.21.15.37:0/3361631380 >> 172.21.15.37:0/3361631380 conn(0x7f3fb8067b30 msgr2=0x7f3fb8067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:37.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.777+0000 7f3fbf340700 1 -- 172.21.15.37:0/3361631380 shutdown_connections 2023-10-06T02:27:37.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.777+0000 7f3fbf340700 1 -- 172.21.15.37:0/3361631380 wait complete. 2023-10-06T02:27:37.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.778+0000 7f3fbf340700 1 Processor -- start 2023-10-06T02:27:37.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.779+0000 7f3fbf340700 1 -- start start 2023-10-06T02:27:37.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.779+0000 7f3fbf340700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3fb80c37c0 0x7f3fb816a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.779+0000 7f3fbf340700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fb8140bc0 0x7f3fb8134ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.779+0000 7f3fbf340700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3fb8140f90 0x7f3fb815ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.779+0000 7f3fbf340700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb815a2c0 con 0x7f3fb8140bc0 2023-10-06T02:27:37.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.779+0000 7f3fbf340700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb8159dd0 con 0x7f3fb80c37c0 2023-10-06T02:27:37.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.779+0000 7f3fbf340700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb806dd70 con 0x7f3fb8140f90 2023-10-06T02:27:37.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.780+0000 7f3fbc8db700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fb8140bc0 0x7f3fb8134ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.780+0000 7f3fbc8db700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fb8140bc0 0x7f3fb8134ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43586/0 (socket says 172.21.15.37:43586) 2023-10-06T02:27:37.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.780+0000 7f3fbc8db700 1 -- 172.21.15.37:0/2020764078 learned_addr learned my addr 172.21.15.37:0/2020764078 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:37.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.780+0000 7f3fbd0dc700 1 --2- 172.21.15.37:0/2020764078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3fb80c37c0 0x7f3fb816a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.780+0000 7f3fbd8dd700 1 --2- 172.21.15.37:0/2020764078 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3fb8140f90 0x7f3fb815ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.780+0000 7f3fbc8db700 1 -- 172.21.15.37:0/2020764078 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3fb8140f90 msgr2=0x7f3fb815ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.780+0000 7f3fbc8db700 1 --2- 172.21.15.37:0/2020764078 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3fb8140f90 0x7f3fb815ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.780+0000 7f3fbc8db700 1 -- 172.21.15.37:0/2020764078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3fb80c37c0 msgr2=0x7f3fb816a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:37.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.780+0000 7f3fbc8db700 1 --2- 172.21.15.37:0/2020764078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3fb80c37c0 0x7f3fb816a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:37.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.780+0000 7f3fbc8db700 1 -- 172.21.15.37:0/2020764078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb0009a20 con 0x7f3fb8140bc0 2023-10-06T02:27:37.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.780+0000 7f3fbc8db700 1 --2- 172.21.15.37:0/2020764078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fb8140bc0 0x7f3fb8134ae0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800ec80 tx=0x7f3fa80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.780+0000 7f3fad7fa700 1 -- 172.21.15.37:0/2020764078 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa8009690 con 0x7f3fb8140bc0 2023-10-06T02:27:37.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.780+0000 7f3fad7fa700 1 -- 172.21.15.37:0/2020764078 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa800c850 con 0x7f3fb8140bc0 2023-10-06T02:27:37.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.780+0000 7f3fbf340700 1 -- 172.21.15.37:0/2020764078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb8159fe0 con 0x7f3fb8140bc0 2023-10-06T02:27:37.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.780+0000 7f3fad7fa700 1 -- 172.21.15.37:0/2020764078 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa800cc10 con 0x7f3fb8140bc0 2023-10-06T02:27:37.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.780+0000 7f3fbf340700 1 -- 172.21.15.37:0/2020764078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb815cff0 con 0x7f3fb8140bc0 2023-10-06T02:27:37.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.781+0000 7f3fbf340700 1 -- 172.21.15.37:0/2020764078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb80c8950 con 0x7f3fb8140bc0 2023-10-06T02:27:37.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.782+0000 7f3fad7fa700 1 -- 172.21.15.37:0/2020764078 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fa8013470 con 0x7f3fb8140bc0 2023-10-06T02:27:37.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.782+0000 7f3fad7fa700 1 --2- 172.21.15.37:0/2020764078 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3f9c066f30 0x7f3f9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:37.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.782+0000 7f3fad7fa700 1 -- 172.21.15.37:0/2020764078 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f3fa80845d0 con 0x7f3fb8140bc0 2023-10-06T02:27:37.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.782+0000 7f3fbd0dc700 1 --2- 172.21.15.37:0/2020764078 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3f9c066f30 0x7f3f9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:37.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.783+0000 7f3fbd0dc700 1 --2- 172.21.15.37:0/2020764078 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3f9c066f30 0x7f3f9c0693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4007130 tx=0x7f3fb4007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:37.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.786+0000 7f3fad7fa700 1 -- 172.21.15.37:0/2020764078 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fa8051980 con 0x7f3fb8140bc0 2023-10-06T02:27:37.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:37.997+0000 7f3fbf340700 1 -- 172.21.15.37:0/2020764078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3fb806deb0 con 0x7f3fb8140bc0 2023-10-06T02:27:38.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.777+0000 7f3fad7fa700 1 -- 172.21.15.37:0/2020764078 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v68) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3fa8054fa0 con 0x7f3fb8140bc0 2023-10-06T02:27:38.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.780+0000 7f3fbf340700 1 -- 172.21.15.37:0/2020764078 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3f9c066f30 msgr2=0x7f3f9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.780+0000 7f3fbf340700 1 --2- 172.21.15.37:0/2020764078 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3f9c066f30 0x7f3f9c0693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4007130 tx=0x7f3fb4007eb0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.780+0000 7f3fbf340700 1 -- 172.21.15.37:0/2020764078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fb8140bc0 msgr2=0x7f3fb8134ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.780+0000 7f3fbf340700 1 --2- 172.21.15.37:0/2020764078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fb8140bc0 0x7f3fb8134ae0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800ec80 tx=0x7f3fa80091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.780+0000 7f3fbf340700 1 -- 172.21.15.37:0/2020764078 shutdown_connections 2023-10-06T02:27:38.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.780+0000 7f3fbf340700 1 --2- 172.21.15.37:0/2020764078 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3fb8140f90 0x7f3fb815ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.780+0000 7f3fbf340700 1 --2- 172.21.15.37:0/2020764078 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3f9c066f30 0x7f3f9c0693e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.780+0000 7f3fbf340700 1 --2- 172.21.15.37:0/2020764078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3fb80c37c0 0x7f3fb816a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.780+0000 7f3fbf340700 1 --2- 172.21.15.37:0/2020764078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fb8140bc0 0x7f3fb8134ae0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.780+0000 7f3fbf340700 1 -- 172.21.15.37:0/2020764078 >> 172.21.15.37:0/2020764078 conn(0x7f3fb8067b30 msgr2=0x7f3fb813f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:38.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.781+0000 7f3fbf340700 1 -- 172.21.15.37:0/2020764078 shutdown_connections 2023-10-06T02:27:38.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.781+0000 7f3fbf340700 1 -- 172.21.15.37:0/2020764078 wait complete. 2023-10-06T02:27:38.783 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-10-06T02:27:38.797 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:27:38.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.921+0000 7f9394fed700 1 Processor -- start 2023-10-06T02:27:38.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.921+0000 7f9394fed700 1 -- start start 2023-10-06T02:27:38.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.922+0000 7f9394fed700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f93901596d0 0x7f93900b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.922+0000 7f9394fed700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93900c5300 con 0x7f93900b3840 2023-10-06T02:27:38.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.922+0000 7f9394fed700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93900c6160 con 0x7f9390159aa0 2023-10-06T02:27:38.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.922+0000 7f9394fed700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93900c5550 con 0x7f93901596d0 2023-10-06T02:27:38.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.922+0000 7f938dd9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f93900b3840 0x7f93900c65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47608/0 (socket says 172.21.15.37:47608) 2023-10-06T02:27:38.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.922+0000 7f938dd9b700 1 -- 172.21.15.37:0/2979253809 learned_addr learned my addr 172.21.15.37:0/2979253809 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:38.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938e59c700 1 --2- 172.21.15.37:0/2979253809 >> v2:172.21.15.191:3300/0 conn(0x7f93901596d0 0x7f93900b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938d59a700 1 -- 172.21.15.37:0/2979253809 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385091915 0 0) 0x7f93900c5300 con 0x7f93900b3840 2023-10-06T02:27:38.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938d59a700 1 -- 172.21.15.37:0/2979253809 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f937c003570 con 0x7f93900b3840 2023-10-06T02:27:38.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938d59a700 1 -- 172.21.15.37:0/2979253809 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109996154 0 0) 0x7f93900c6160 con 0x7f9390159aa0 2023-10-06T02:27:38.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938d59a700 1 -- 172.21.15.37:0/2979253809 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93900c5300 con 0x7f9390159aa0 2023-10-06T02:27:38.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938d59a700 1 -- 172.21.15.37:0/2979253809 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1115292228 0 0) 0x7f937c003570 con 0x7f93900b3840 2023-10-06T02:27:38.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938d59a700 1 -- 172.21.15.37:0/2979253809 >> v2:172.21.15.191:3300/0 conn(0x7f93901596d0 msgr2=0x7f93900b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:38.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938d59a700 1 --2- 172.21.15.37:0/2979253809 >> v2:172.21.15.191:3300/0 conn(0x7f93901596d0 0x7f93900b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938d59a700 1 -- 172.21.15.37:0/2979253809 >> v1:172.21.15.191:6789/0 conn(0x7f9390159aa0 legacy=0x7f93900cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938d59a700 1 -- 172.21.15.37:0/2979253809 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93900c5830 con 0x7f93900b3840 2023-10-06T02:27:38.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938d59a700 1 -- 172.21.15.37:0/2979253809 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f9378001470 con 0x7f93900b3840 2023-10-06T02:27:38.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938e59c700 1 --2- 172.21.15.37:0/2979253809 >> v2:172.21.15.191:3300/0 conn(0x7f93901596d0 0x7f93900b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:38.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938d59a700 1 -- 172.21.15.37:0/2979253809 >> v1:172.21.15.37:6789/0 conn(0x7f93900b3840 legacy=0x7f93900c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938d59a700 1 --2- 172.21.15.37:0/2979253809 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f937c003bf0 0x7f937c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938d59a700 1 --2- 172.21.15.37:0/2979253809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f937c004810 0x7f937c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938d59a700 1 --2- 172.21.15.37:0/2979253809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f937c0051c0 0x7f937c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938d59a700 1 -- 172.21.15.37:0/2979253809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93900c5550 con 0x7f937c0051c0 2023-10-06T02:27:38.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938d59a700 1 -- 172.21.15.37:0/2979253809 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937c00c0b0 con 0x7f937c004810 2023-10-06T02:27:38.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938d59a700 1 -- 172.21.15.37:0/2979253809 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937c00c270 con 0x7f937c003bf0 2023-10-06T02:27:38.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938ed9d700 1 --2- 172.21.15.37:0/2979253809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f937c0051c0 0x7f937c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938dd9b700 1 --2- 172.21.15.37:0/2979253809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f937c004810 0x7f937c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938e59c700 1 --2- 172.21.15.37:0/2979253809 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f937c003bf0 0x7f937c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938ed9d700 1 -- 172.21.15.37:0/2979253809 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f937c003bf0 msgr2=0x7f937c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:38.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.923+0000 7f938ed9d700 1 --2- 172.21.15.37:0/2979253809 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f937c003bf0 0x7f937c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.924+0000 7f938ed9d700 1 -- 172.21.15.37:0/2979253809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f937c004810 msgr2=0x7f937c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:38.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.924+0000 7f938ed9d700 1 --2- 172.21.15.37:0/2979253809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f937c004810 0x7f937c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.924+0000 7f938ed9d700 1 -- 172.21.15.37:0/2979253809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c003570 con 0x7f937c0051c0 2023-10-06T02:27:38.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.924+0000 7f938ed9d700 1 -- 172.21.15.37:0/2979253809 reap_dead start 2023-10-06T02:27:38.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.924+0000 7f938ed9d700 1 --2- 172.21.15.37:0/2979253809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f937c0051c0 0x7f937c00ba60 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f939008aa30 tx=0x7f93800017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d504af64f9290f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:38.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.924+0000 7f938d59a700 1 -- 172.21.15.37:0/2979253809 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9380001ab0 con 0x7f937c0051c0 2023-10-06T02:27:38.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.924+0000 7f938d59a700 1 -- 172.21.15.37:0/2979253809 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938000c8b0 con 0x7f937c0051c0 2023-10-06T02:27:38.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.924+0000 7f938d59a700 1 -- 172.21.15.37:0/2979253809 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938000cc30 con 0x7f937c0051c0 2023-10-06T02:27:38.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.924+0000 7f9394fed700 1 -- 172.21.15.37:0/2979253809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f937c0051c0 msgr2=0x7f937c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.924+0000 7f9394fed700 1 --2- 172.21.15.37:0/2979253809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f937c0051c0 0x7f937c00ba60 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f939008aa30 tx=0x7f93800017a0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.924+0000 7f9394fed700 1 -- 172.21.15.37:0/2979253809 shutdown_connections 2023-10-06T02:27:38.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.924+0000 7f9394fed700 1 --2- 172.21.15.37:0/2979253809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f937c0051c0 0x7f937c00ba60 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.924+0000 7f9394fed700 1 -- 172.21.15.37:0/2979253809 >> 172.21.15.37:0/2979253809 conn(0x7f939006c890 msgr2=0x7f93900d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:38.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.924+0000 7f9394fed700 1 -- 172.21.15.37:0/2979253809 shutdown_connections 2023-10-06T02:27:38.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.924+0000 7f9394fed700 1 -- 172.21.15.37:0/2979253809 wait complete. 2023-10-06T02:27:38.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.925+0000 7f9394fed700 1 Processor -- start 2023-10-06T02:27:38.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.926+0000 7f9394fed700 1 -- start start 2023-10-06T02:27:38.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.926+0000 7f9394fed700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f937c0051c0 0x7f939009d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.926+0000 7f9394fed700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f93900b4e50 0x7f9390154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.926+0000 7f9394fed700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93900cb860 0x7f93900cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.926+0000 7f9394fed700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93900cc240 con 0x7f93900cb860 2023-10-06T02:27:38.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.926+0000 7f9394fed700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93900b53e0 con 0x7f937c0051c0 2023-10-06T02:27:38.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.926+0000 7f9394fed700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93900b56c0 con 0x7f93900b4e50 2023-10-06T02:27:38.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.926+0000 7f938ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93900cb860 0x7f93900cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.926+0000 7f938ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93900cb860 0x7f93900cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43594/0 (socket says 172.21.15.37:43594) 2023-10-06T02:27:38.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.926+0000 7f938ed9d700 1 -- 172.21.15.37:0/4114890386 learned_addr learned my addr 172.21.15.37:0/4114890386 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:38.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.926+0000 7f938dd9b700 1 --2- 172.21.15.37:0/4114890386 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f93900b4e50 0x7f9390154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.926+0000 7f938e59c700 1 --2- 172.21.15.37:0/4114890386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f937c0051c0 0x7f939009d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.927+0000 7f938ed9d700 1 -- 172.21.15.37:0/4114890386 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f93900b4e50 msgr2=0x7f9390154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.927+0000 7f938ed9d700 1 --2- 172.21.15.37:0/4114890386 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f93900b4e50 0x7f9390154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.927+0000 7f938ed9d700 1 -- 172.21.15.37:0/4114890386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f937c0051c0 msgr2=0x7f939009d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:38.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.927+0000 7f938ed9d700 1 --2- 172.21.15.37:0/4114890386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f937c0051c0 0x7f939009d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:38.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.927+0000 7f938ed9d700 1 -- 172.21.15.37:0/4114890386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93900b59a0 con 0x7f93900cb860 2023-10-06T02:27:38.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.927+0000 7f938ed9d700 1 --2- 172.21.15.37:0/4114890386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93900cb860 0x7f93900cbd00 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9390088460 tx=0x7f9380016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:38.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.927+0000 7f93867fc700 1 -- 172.21.15.37:0/4114890386 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938000cc30 con 0x7f93900cb860 2023-10-06T02:27:38.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.927+0000 7f93867fc700 1 -- 172.21.15.37:0/4114890386 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938000c6d0 con 0x7f93900cb860 2023-10-06T02:27:38.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.927+0000 7f93867fc700 1 -- 172.21.15.37:0/4114890386 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9380006e10 con 0x7f93900cb860 2023-10-06T02:27:38.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.927+0000 7f9394fed700 1 -- 172.21.15.37:0/4114890386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93900b5c80 con 0x7f93900cb860 2023-10-06T02:27:38.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.927+0000 7f9394fed700 1 -- 172.21.15.37:0/4114890386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9390154990 con 0x7f93900cb860 2023-10-06T02:27:38.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.928+0000 7f9394fed700 1 -- 172.21.15.37:0/4114890386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9390154bb0 con 0x7f93900cb860 2023-10-06T02:27:38.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.928+0000 7f93867fc700 1 -- 172.21.15.37:0/4114890386 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9380003030 con 0x7f93900cb860 2023-10-06T02:27:38.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.929+0000 7f93867fc700 1 --2- 172.21.15.37:0/4114890386 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9370066f30 0x7f93700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:38.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.929+0000 7f93867fc700 1 -- 172.21.15.37:0/4114890386 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9380085f80 con 0x7f93900cb860 2023-10-06T02:27:38.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.929+0000 7f938e59c700 1 --2- 172.21.15.37:0/4114890386 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9370066f30 0x7f93700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:38.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.930+0000 7f938e59c700 1 --2- 172.21.15.37:0/4114890386 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9370066f30 0x7f93700693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9388006f00 tx=0x7f93880091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:38.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:38.933+0000 7f93867fc700 1 -- 172.21.15.37:0/4114890386 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93800533e0 con 0x7f93900cb860 2023-10-06T02:27:39.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.204+0000 7f9394fed700 1 -- 172.21.15.37:0/4114890386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9390154bb0 con 0x7f93900cb860 2023-10-06T02:27:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.205+0000 7f93867fc700 1 -- 172.21.15.37:0/4114890386 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f9380056a00 con 0x7f93900cb860 2023-10-06T02:27:39.206 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:39.206 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:27:39.206 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-10-06T02:27:39.207 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:39.207 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-10-06T02:27:39.207 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lkQF5HRAAmDbVzKumixz+mz8C9Ibu4w==", 2023-10-06T02:27:39.207 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:27:39.207 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:27:39.207 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T02:27:39.207 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T02:27:39.207 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:27:39.208 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:39.208 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:39.208 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:39.208 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-10-06T02:27:39.208 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lpPDVKBAAdg+chey8icfN9/u/REprEw==", 2023-10-06T02:27:39.208 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:27:39.208 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:27:39.208 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T02:27:39.208 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T02:27:39.209 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:27:39.209 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:39.209 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:39.209 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:39.209 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-10-06T02:27:39.209 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lSQ5oJBAAvXZ5RKQNOEujDD8kM0QU+Q==", 2023-10-06T02:27:39.209 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:27:39.209 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:27:39.209 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T02:27:39.210 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T02:27:39.210 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:27:39.210 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:39.210 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:39.210 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:39.210 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-10-06T02:27:39.210 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lE5adLxAAb6XIxhNYBl7FVcprFY526g==", 2023-10-06T02:27:39.210 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:27:39.210 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:27:39.210 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T02:27:39.211 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T02:27:39.211 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:27:39.211 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:39.211 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:39.211 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:39.212 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-10-06T02:27:39.212 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBjbx9lLEJuDRAA5astKYoPcHwja09KROk+tQ==", 2023-10-06T02:27:39.212 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:27:39.212 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:27:39.212 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:27:39.212 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:27:39.212 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:39.212 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:39.212 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:39.213 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-10-06T02:27:39.213 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBmbx9lwdVEDBAA5TMlEiE5UAavPJzdV22Gtw==", 2023-10-06T02:27:39.213 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:27:39.213 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:27:39.213 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:27:39.213 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:27:39.213 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:39.213 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:39.213 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:39.213 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-10-06T02:27:39.214 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBpbx9lF5UeChAA1fYYSrtxmm7yMS4pn/hacQ==", 2023-10-06T02:27:39.214 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:27:39.214 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:27:39.214 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:27:39.214 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:27:39.214 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:39.214 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:39.214 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:39.215 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-10-06T02:27:39.215 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBsbx9l3oTYCBAADYVyJ6Yt2sZfXhundjqceQ==", 2023-10-06T02:27:39.215 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:27:39.215 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:27:39.215 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:27:39.215 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:27:39.215 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:39.215 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:39.215 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:39.215 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-10-06T02:27:39.216 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBybx9lhrfuCBAA7A97uVPnZDT9ia70W5180A==", 2023-10-06T02:27:39.216 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:27:39.216 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:27:39.216 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:27:39.216 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:27:39.216 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:39.216 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:39.216 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:39.216 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-10-06T02:27:39.217 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQB1bx9lEntaBxAAzvIEHp4iJvnev2yuqPL3tA==", 2023-10-06T02:27:39.217 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:27:39.217 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:27:39.217 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:27:39.217 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:27:39.217 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:39.217 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:39.217 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:39.218 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-10-06T02:27:39.218 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQB4bx9lZaxXBxAAE+FsUplhP39hVXuZ4btCqQ==", 2023-10-06T02:27:39.218 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:27:39.218 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:27:39.218 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:27:39.218 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:27:39.218 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:39.218 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:39.218 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:39.218 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-10-06T02:27:39.219 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQB7bx9lAtvBBhAAZzUs75blYnu3OocrsTVHSg==", 2023-10-06T02:27:39.219 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:27:39.219 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-10-06T02:27:39.219 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-10-06T02:27:39.219 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:27:39.219 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:39.219 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:39.219 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:39.219 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-10-06T02:27:39.219 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9llHl0MxAAPrpwRuKiAcn+W0aDwzBvvQ==", 2023-10-06T02:27:39.220 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:27:39.220 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:27:39.220 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2023-10-06T02:27:39.220 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T02:27:39.220 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:39.220 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:39.220 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:39.220 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-10-06T02:27:39.221 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBgbx9lgp1AABAA+oAQVt7MWVsWnRxbWVLNbA==", 2023-10-06T02:27:39.221 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:27:39.221 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:27:39.221 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T02:27:39.221 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T02:27:39.221 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T02:27:39.222 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:39.222 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:39.222 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:39.222 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-10-06T02:27:39.222 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lByLlOBAAeTJLSorscEidED7VHIPKCg==", 2023-10-06T02:27:39.222 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:27:39.222 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:27:39.223 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T02:27:39.223 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T02:27:39.223 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T02:27:39.223 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:39.223 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:39.223 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:39.223 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-10-06T02:27:39.223 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBgbx9l6LuWBRAAvYfXvGvgMYDPlB4CgKaNqw==", 2023-10-06T02:27:39.223 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:27:39.224 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-10-06T02:27:39.224 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-10-06T02:27:39.224 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-10-06T02:27:39.224 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-10-06T02:27:39.224 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:39.224 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:39.224 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:39.224 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-10-06T02:27:39.224 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lgayZAhAA9VQix+78KreRH/YEeftPQA==", 2023-10-06T02:27:39.225 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:27:39.225 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T02:27:39.225 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-10-06T02:27:39.225 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-10-06T02:27:39.225 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:27:39.225 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:39.225 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:39.225 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:39.225 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-10-06T02:27:39.226 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9lg7hcGhAAelKPvNX7CL80KycBGoQ8cw==", 2023-10-06T02:27:39.226 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:27:39.226 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T02:27:39.226 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-10-06T02:27:39.226 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:27:39.226 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:39.226 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:39.226 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:39.226 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-10-06T02:27:39.226 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBfbx9l5BH7FhAAotvMdV8pKCJzZUqTviL3CQ==", 2023-10-06T02:27:39.227 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-10-06T02:27:39.227 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-10-06T02:27:39.227 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-10-06T02:27:39.227 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-10-06T02:27:39.227 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:39.227 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:39.227 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-10-06T02:27:39.227 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:27:39.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.207+0000 7f9394fed700 1 -- 172.21.15.37:0/4114890386 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9370066f30 msgr2=0x7f93700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:39.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.207+0000 7f9394fed700 1 --2- 172.21.15.37:0/4114890386 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9370066f30 0x7f93700693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9388006f00 tx=0x7f93880091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.207+0000 7f9394fed700 1 -- 172.21.15.37:0/4114890386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93900cb860 msgr2=0x7f93900cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:39.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.207+0000 7f9394fed700 1 --2- 172.21.15.37:0/4114890386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93900cb860 0x7f93900cbd00 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9390088460 tx=0x7f9380016000 comp rx=0 tx=0).stop 2023-10-06T02:27:39.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.207+0000 7f9394fed700 1 -- 172.21.15.37:0/4114890386 shutdown_connections 2023-10-06T02:27:39.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.207+0000 7f9394fed700 1 --2- 172.21.15.37:0/4114890386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93900cb860 0x7f93900cbd00 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.207+0000 7f9394fed700 1 --2- 172.21.15.37:0/4114890386 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9370066f30 0x7f93700693e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.207+0000 7f9394fed700 1 --2- 172.21.15.37:0/4114890386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f937c0051c0 0x7f939009d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.207+0000 7f9394fed700 1 --2- 172.21.15.37:0/4114890386 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f93900b4e50 0x7f9390154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.207+0000 7f9394fed700 1 -- 172.21.15.37:0/4114890386 >> 172.21.15.37:0/4114890386 conn(0x7f939006c890 msgr2=0x7f9390154e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:39.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.207+0000 7f9394fed700 1 -- 172.21.15.37:0/4114890386 shutdown_connections 2023-10-06T02:27:39.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.207+0000 7f9394fed700 1 -- 172.21.15.37:0/4114890386 wait complete. 2023-10-06T02:27:39.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:27:39.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.348+0000 7f1715a8d700 1 Processor -- start 2023-10-06T02:27:39.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.348+0000 7f1715a8d700 1 -- start start 2023-10-06T02:27:39.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.349+0000 7f1715a8d700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f17101596d0 0x7f17100b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:39.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.349+0000 7f1715a8d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1710159aa0 0x7f17100cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:39.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.349+0000 7f1715a8d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17100c5300 con 0x7f17100b3840 2023-10-06T02:27:39.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.349+0000 7f1715a8d700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17100c6160 con 0x7f1710159aa0 2023-10-06T02:27:39.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.349+0000 7f1715a8d700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17100c5550 con 0x7f17101596d0 2023-10-06T02:27:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.349+0000 7f170ffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1710159aa0 0x7f17100cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.349+0000 7f170effd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f17100b3840 0x7f17100c65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47618/0 (socket says 172.21.15.37:47618) 2023-10-06T02:27:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.349+0000 7f170effd700 1 -- 172.21.15.37:0/4134629202 learned_addr learned my addr 172.21.15.37:0/4134629202 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.349+0000 7f170ffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1710159aa0 0x7f17100cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43600/0 (socket says 172.21.15.37:43600) 2023-10-06T02:27:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.349+0000 7f170f7fe700 1 --2- 172.21.15.37:0/4134629202 >> v2:172.21.15.191:3300/0 conn(0x7f17101596d0 0x7f17100b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.350+0000 7f170ffff700 1 -- 172.21.15.37:0/4134629202 >> v2:172.21.15.191:3300/0 conn(0x7f17101596d0 msgr2=0x7f17100b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.350+0000 7f170ffff700 1 --2- 172.21.15.37:0/4134629202 >> v2:172.21.15.191:3300/0 conn(0x7f17101596d0 0x7f17100b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.350+0000 7f170ffff700 1 -- 172.21.15.37:0/4134629202 >> v1:172.21.15.37:6789/0 conn(0x7f17100b3840 legacy=0x7f17100c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.350+0000 7f170ffff700 1 -- 172.21.15.37:0/4134629202 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17100c5830 con 0x7f1710159aa0 2023-10-06T02:27:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.350+0000 7f170e7fc700 1 -- 172.21.15.37:0/4134629202 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 108061081 0 0) 0x7f17100c5300 con 0x7f17100b3840 2023-10-06T02:27:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.350+0000 7f170f7fe700 1 --2- 172.21.15.37:0/4134629202 >> v2:172.21.15.191:3300/0 conn(0x7f17101596d0 0x7f17100b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.350+0000 7f170ffff700 1 --2- 172.21.15.37:0/4134629202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1710159aa0 0x7f17100cf9f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f17100896e0 tx=0x7f1708009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e3e367d33fb228 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:39.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.350+0000 7f170e7fc700 1 -- 172.21.15.37:0/4134629202 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170800e070 con 0x7f1710159aa0 2023-10-06T02:27:39.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.350+0000 7f170e7fc700 1 -- 172.21.15.37:0/4134629202 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170800bc30 con 0x7f1710159aa0 2023-10-06T02:27:39.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.350+0000 7f170e7fc700 1 -- 172.21.15.37:0/4134629202 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1708012430 con 0x7f1710159aa0 2023-10-06T02:27:39.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.350+0000 7f1715a8d700 1 -- 172.21.15.37:0/4134629202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1710159aa0 msgr2=0x7f17100cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:39.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.350+0000 7f1715a8d700 1 --2- 172.21.15.37:0/4134629202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1710159aa0 0x7f17100cf9f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f17100896e0 tx=0x7f1708009780 comp rx=0 tx=0).stop 2023-10-06T02:27:39.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.351+0000 7f1715a8d700 1 -- 172.21.15.37:0/4134629202 shutdown_connections 2023-10-06T02:27:39.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.351+0000 7f1715a8d700 1 --2- 172.21.15.37:0/4134629202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1710159aa0 0x7f17100cf9f0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.351+0000 7f1715a8d700 1 --2- 172.21.15.37:0/4134629202 >> v2:172.21.15.191:3300/0 conn(0x7f17101596d0 0x7f17100b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.351+0000 7f1715a8d700 1 -- 172.21.15.37:0/4134629202 >> 172.21.15.37:0/4134629202 conn(0x7f171006c890 msgr2=0x7f17100d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:39.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.351+0000 7f1715a8d700 1 -- 172.21.15.37:0/4134629202 shutdown_connections 2023-10-06T02:27:39.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.351+0000 7f1715a8d700 1 -- 172.21.15.37:0/4134629202 wait complete. 2023-10-06T02:27:39.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.352+0000 7f1715a8d700 1 Processor -- start 2023-10-06T02:27:39.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.352+0000 7f1715a8d700 1 -- start start 2023-10-06T02:27:39.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f1715a8d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17100b3840 0x7f1710154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:39.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f1715a8d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17101596d0 0x7f171014eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:39.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f1715a8d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1710159aa0 0x7f171015a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:39.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f1715a8d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17101535a0 con 0x7f17100b3840 2023-10-06T02:27:39.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f1715a8d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1710153880 con 0x7f1710159aa0 2023-10-06T02:27:39.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f1715a8d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1710153b60 con 0x7f17101596d0 2023-10-06T02:27:39.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f170f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17100b3840 0x7f1710154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:39.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f170f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17100b3840 0x7f1710154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43612/0 (socket says 172.21.15.37:43612) 2023-10-06T02:27:39.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f170f7fe700 1 -- 172.21.15.37:0/144712816 learned_addr learned my addr 172.21.15.37:0/144712816 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:39.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f170ffff700 1 --2- 172.21.15.37:0/144712816 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1710159aa0 0x7f171015a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:39.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f170effd700 1 --2- 172.21.15.37:0/144712816 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17101596d0 0x7f171014eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:39.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f170f7fe700 1 -- 172.21.15.37:0/144712816 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17101596d0 msgr2=0x7f171014eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:39.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f170f7fe700 1 --2- 172.21.15.37:0/144712816 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17101596d0 0x7f171014eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f170f7fe700 1 -- 172.21.15.37:0/144712816 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1710159aa0 msgr2=0x7f171015a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:39.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f170f7fe700 1 --2- 172.21.15.37:0/144712816 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1710159aa0 0x7f171015a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f170f7fe700 1 -- 172.21.15.37:0/144712816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1708009a20 con 0x7f17100b3840 2023-10-06T02:27:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f170f7fe700 1 --2- 172.21.15.37:0/144712816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17100b3840 0x7f1710154640 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f170000e8d0 tx=0x7f1700008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f16f77fe700 1 -- 172.21.15.37:0/144712816 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1700013410 con 0x7f17100b3840 2023-10-06T02:27:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f16f77fe700 1 -- 172.21.15.37:0/144712816 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1700013570 con 0x7f17100b3840 2023-10-06T02:27:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f1715a8d700 1 -- 172.21.15.37:0/144712816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1710153e40 con 0x7f17100b3840 2023-10-06T02:27:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f16f77fe700 1 -- 172.21.15.37:0/144712816 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000138f0 con 0x7f17100b3840 2023-10-06T02:27:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.353+0000 7f1715a8d700 1 -- 172.21.15.37:0/144712816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1710153230 con 0x7f17100b3840 2023-10-06T02:27:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.354+0000 7f1715a8d700 1 -- 172.21.15.37:0/144712816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f171006fbf0 con 0x7f17100b3840 2023-10-06T02:27:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.355+0000 7f16f77fe700 1 -- 172.21.15.37:0/144712816 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1700013d20 con 0x7f17100b3840 2023-10-06T02:27:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.355+0000 7f16f77fe700 1 --2- 172.21.15.37:0/144712816 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f16fc066f30 0x7f16fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.355+0000 7f16f77fe700 1 -- 172.21.15.37:0/144712816 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1700084080 con 0x7f17100b3840 2023-10-06T02:27:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.356+0000 7f170effd700 1 --2- 172.21.15.37:0/144712816 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f16fc066f30 0x7f16fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:39.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.356+0000 7f170effd700 1 --2- 172.21.15.37:0/144712816 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f16fc066f30 0x7f16fc0693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f17100cbdd0 tx=0x7f1704009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:39.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.360+0000 7f16f77fe700 1 -- 172.21.15.37:0/144712816 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17000514e0 con 0x7f17100b3840 2023-10-06T02:27:39.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.552+0000 7f1715a8d700 1 -- 172.21.15.37:0/144712816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17100d13e0 con 0x7f17100b3840 2023-10-06T02:27:39.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.553+0000 7f16f77fe700 1 -- 172.21.15.37:0/144712816 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+13651 (secure 0 0 0) 0x7f1700054b00 con 0x7f17100b3840 2023-10-06T02:27:39.554 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:39.554 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":68,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:27:38.776044+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:27:39.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.555+0000 7f1715a8d700 1 -- 172.21.15.37:0/144712816 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f16fc066f30 msgr2=0x7f16fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.555+0000 7f1715a8d700 1 --2- 172.21.15.37:0/144712816 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f16fc066f30 0x7f16fc0693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f17100cbdd0 tx=0x7f1704009040 comp rx=0 tx=0).stop 2023-10-06T02:27:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.555+0000 7f1715a8d700 1 -- 172.21.15.37:0/144712816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17100b3840 msgr2=0x7f1710154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.555+0000 7f1715a8d700 1 --2- 172.21.15.37:0/144712816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17100b3840 0x7f1710154640 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f170000e8d0 tx=0x7f1700008040 comp rx=0 tx=0).stop 2023-10-06T02:27:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.555+0000 7f1715a8d700 1 -- 172.21.15.37:0/144712816 shutdown_connections 2023-10-06T02:27:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.555+0000 7f1715a8d700 1 --2- 172.21.15.37:0/144712816 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f16fc066f30 0x7f16fc0693e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.555+0000 7f1715a8d700 1 --2- 172.21.15.37:0/144712816 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1710159aa0 0x7f171015a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.555+0000 7f1715a8d700 1 --2- 172.21.15.37:0/144712816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17100b3840 0x7f1710154640 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.555+0000 7f1715a8d700 1 --2- 172.21.15.37:0/144712816 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17101596d0 0x7f171014eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.555+0000 7f1715a8d700 1 -- 172.21.15.37:0/144712816 >> 172.21.15.37:0/144712816 conn(0x7f171006c890 msgr2=0x7f17100cff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.555+0000 7f1715a8d700 1 -- 172.21.15.37:0/144712816 shutdown_connections 2023-10-06T02:27:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.555+0000 7f1715a8d700 1 -- 172.21.15.37:0/144712816 wait complete. 2023-10-06T02:27:39.569 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:23:08.066048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:23:08.561964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T02:27:39.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:27:39.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.690+0000 7f4269d52700 1 Processor -- start 2023-10-06T02:27:39.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.690+0000 7f4269d52700 1 -- start start 2023-10-06T02:27:39.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.691+0000 7f4269d52700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42640cb170 0x7f42640cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:39.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.691+0000 7f4269d52700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f42640ccdd0 0x7f4264163250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:39.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.691+0000 7f4269d52700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42640b2da0 con 0x7f42640b29d0 2023-10-06T02:27:39.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.691+0000 7f4269d52700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4264099bd0 con 0x7f42640ccdd0 2023-10-06T02:27:39.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.691+0000 7f4269d52700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4264159a70 con 0x7f42640cb170 2023-10-06T02:27:39.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.691+0000 7f4268d50700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f42640b29d0 0x7f42640ce8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47622/0 (socket says 172.21.15.37:47622) 2023-10-06T02:27:39.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.691+0000 7f4268d50700 1 -- 172.21.15.37:0/2290211986 learned_addr learned my addr 172.21.15.37:0/2290211986 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:39.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.691+0000 7f4269551700 1 --2- 172.21.15.37:0/2290211986 >> v2:172.21.15.37:3300/0 conn(0x7f42640ccdd0 0x7f4264163250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:39.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.691+0000 7f42637fe700 1 -- 172.21.15.37:0/2290211986 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1873458696 0 0) 0x7f425c001110 con 0x7f42640b29d0 2023-10-06T02:27:39.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.691+0000 7f4263fff700 1 --2- 172.21.15.37:0/2290211986 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42640cb170 0x7f42640cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:39.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.691+0000 7f42637fe700 1 -- 172.21.15.37:0/2290211986 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4250003570 con 0x7f42640b29d0 2023-10-06T02:27:39.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.691+0000 7f4269551700 1 -- 172.21.15.37:0/2290211986 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42640cb170 msgr2=0x7f42640cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:39.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.691+0000 7f4269551700 1 --2- 172.21.15.37:0/2290211986 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42640cb170 0x7f42640cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.691+0000 7f4269551700 1 -- 172.21.15.37:0/2290211986 >> v1:172.21.15.37:6789/0 conn(0x7f42640b29d0 legacy=0x7f42640ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:39.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.691+0000 7f4269551700 1 -- 172.21.15.37:0/2290211986 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42640cb5e0 con 0x7f42640ccdd0 2023-10-06T02:27:39.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.692+0000 7f4269551700 1 --2- 172.21.15.37:0/2290211986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42640ccdd0 0x7f4264163250 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f424c0098e0 tx=0x7f424c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b748d49d4386a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:39.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.692+0000 7f42637fe700 1 -- 172.21.15.37:0/2290211986 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c00b640 con 0x7f42640ccdd0 2023-10-06T02:27:39.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.692+0000 7f42637fe700 1 -- 172.21.15.37:0/2290211986 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c00b7a0 con 0x7f42640ccdd0 2023-10-06T02:27:39.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.692+0000 7f42637fe700 1 -- 172.21.15.37:0/2290211986 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c00bb40 con 0x7f42640ccdd0 2023-10-06T02:27:39.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.692+0000 7f4269d52700 1 -- 172.21.15.37:0/2290211986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42640ccdd0 msgr2=0x7f4264163250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:39.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.692+0000 7f4269d52700 1 --2- 172.21.15.37:0/2290211986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42640ccdd0 0x7f4264163250 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f424c0098e0 tx=0x7f424c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.692+0000 7f4269d52700 1 -- 172.21.15.37:0/2290211986 shutdown_connections 2023-10-06T02:27:39.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.692+0000 7f4269d52700 1 --2- 172.21.15.37:0/2290211986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42640ccdd0 0x7f4264163250 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.692+0000 7f4269d52700 1 --2- 172.21.15.37:0/2290211986 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42640cb170 0x7f42640cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.692+0000 7f4269d52700 1 -- 172.21.15.37:0/2290211986 >> 172.21.15.37:0/2290211986 conn(0x7f4264099610 msgr2=0x7f426406c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:39.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.692+0000 7f4269d52700 1 -- 172.21.15.37:0/2290211986 shutdown_connections 2023-10-06T02:27:39.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.692+0000 7f4269d52700 1 -- 172.21.15.37:0/2290211986 wait complete. 2023-10-06T02:27:39.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.693+0000 7f4269d52700 1 Processor -- start 2023-10-06T02:27:39.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.694+0000 7f4269d52700 1 -- start start 2023-10-06T02:27:39.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.694+0000 7f4269d52700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42640b29d0 0x7f426414b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:39.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.694+0000 7f4269d52700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42640cb170 0x7f42640b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:39.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.694+0000 7f4269d52700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42640ccdd0 0x7f426406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:39.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.694+0000 7f4269d52700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42640b5ca0 con 0x7f42640b29d0 2023-10-06T02:27:39.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.694+0000 7f4269d52700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42640b5090 con 0x7f42640cb170 2023-10-06T02:27:39.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.694+0000 7f4269d52700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42640b5370 con 0x7f42640ccdd0 2023-10-06T02:27:39.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.694+0000 7f4268d50700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42640b29d0 0x7f426414b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:39.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.694+0000 7f4268d50700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42640b29d0 0x7f426414b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43636/0 (socket says 172.21.15.37:43636) 2023-10-06T02:27:39.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.694+0000 7f4268d50700 1 -- 172.21.15.37:0/3310958502 learned_addr learned my addr 172.21.15.37:0/3310958502 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:39.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.695+0000 7f4268d50700 1 -- 172.21.15.37:0/3310958502 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42640ccdd0 msgr2=0x7f426406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:39.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.695+0000 7f4268d50700 1 --2- 172.21.15.37:0/3310958502 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42640ccdd0 0x7f426406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.695+0000 7f4268d50700 1 -- 172.21.15.37:0/3310958502 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42640cb170 msgr2=0x7f42640b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:39.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.695+0000 7f4268d50700 1 --2- 172.21.15.37:0/3310958502 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42640cb170 0x7f42640b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.695+0000 7f4268d50700 1 -- 172.21.15.37:0/3310958502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c009420 con 0x7f42640b29d0 2023-10-06T02:27:39.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.695+0000 7f4268d50700 1 --2- 172.21.15.37:0/3310958502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42640b29d0 0x7f426414b030 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f425c00c7c0 tx=0x7f425c007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:39.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.695+0000 7f4260ff9700 1 -- 172.21.15.37:0/3310958502 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c005b30 con 0x7f42640b29d0 2023-10-06T02:27:39.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.695+0000 7f4260ff9700 1 -- 172.21.15.37:0/3310958502 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c005c90 con 0x7f42640b29d0 2023-10-06T02:27:39.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.695+0000 7f4269d52700 1 -- 172.21.15.37:0/3310958502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42640b5650 con 0x7f42640b29d0 2023-10-06T02:27:39.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.695+0000 7f4260ff9700 1 -- 172.21.15.37:0/3310958502 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c007340 con 0x7f42640b29d0 2023-10-06T02:27:39.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.695+0000 7f4269d52700 1 -- 172.21.15.37:0/3310958502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42640b4c40 con 0x7f42640b29d0 2023-10-06T02:27:39.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.696+0000 7f4269d52700 1 -- 172.21.15.37:0/3310958502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42640884f0 con 0x7f42640b29d0 2023-10-06T02:27:39.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.696+0000 7f4260ff9700 1 -- 172.21.15.37:0/3310958502 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f425c01b400 con 0x7f42640b29d0 2023-10-06T02:27:39.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.697+0000 7f4260ff9700 1 --2- 172.21.15.37:0/3310958502 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4244066f30 0x7f42440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:39.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.697+0000 7f4260ff9700 1 -- 172.21.15.37:0/3310958502 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f425c083cc0 con 0x7f42640b29d0 2023-10-06T02:27:39.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.697+0000 7f4263fff700 1 --2- 172.21.15.37:0/3310958502 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4244066f30 0x7f42440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:39.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.697+0000 7f4263fff700 1 --2- 172.21.15.37:0/3310958502 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4244066f30 0x7f42440693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f426414b570 tx=0x7f4254009a10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:39.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.701+0000 7f4260ff9700 1 -- 172.21.15.37:0/3310958502 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f425c0511a0 con 0x7f42640b29d0 2023-10-06T02:27:39.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.894+0000 7f4269d52700 1 -- 172.21.15.37:0/3310958502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f42640b2da0 con 0x7f42640b29d0 2023-10-06T02:27:39.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.894+0000 7f4260ff9700 1 -- 172.21.15.37:0/3310958502 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v68) v1 ==== 92+0+10 (secure 0 0 0) 0x7f42640b2da0 con 0x7f42640b29d0 2023-10-06T02:27:39.896 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T02:27:39.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.896+0000 7f4269d52700 1 -- 172.21.15.37:0/3310958502 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4244066f30 msgr2=0x7f42440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:39.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.896+0000 7f4269d52700 1 --2- 172.21.15.37:0/3310958502 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4244066f30 0x7f42440693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f426414b570 tx=0x7f4254009a10 comp rx=0 tx=0).stop 2023-10-06T02:27:39.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.896+0000 7f4269d52700 1 -- 172.21.15.37:0/3310958502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42640b29d0 msgr2=0x7f426414b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:39.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.896+0000 7f4269d52700 1 --2- 172.21.15.37:0/3310958502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42640b29d0 0x7f426414b030 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f425c00c7c0 tx=0x7f425c007c70 comp rx=0 tx=0).stop 2023-10-06T02:27:39.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.896+0000 7f4269d52700 1 -- 172.21.15.37:0/3310958502 shutdown_connections 2023-10-06T02:27:39.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.896+0000 7f4269d52700 1 --2- 172.21.15.37:0/3310958502 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42640ccdd0 0x7f426406e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.896+0000 7f4269d52700 1 --2- 172.21.15.37:0/3310958502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42640b29d0 0x7f426414b030 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.896+0000 7f4269d52700 1 --2- 172.21.15.37:0/3310958502 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4244066f30 0x7f42440693e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.896+0000 7f4269d52700 1 --2- 172.21.15.37:0/3310958502 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42640cb170 0x7f42640b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:39.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.896+0000 7f4269d52700 1 -- 172.21.15.37:0/3310958502 >> 172.21.15.37:0/3310958502 conn(0x7f4264099610 msgr2=0x7f4264158ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:39.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.896+0000 7f4269d52700 1 -- 172.21.15.37:0/3310958502 shutdown_connections 2023-10-06T02:27:39.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:39.896+0000 7f4269d52700 1 -- 172.21.15.37:0/3310958502 wait complete. 2023-10-06T02:27:39.909 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:27:40.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.030+0000 7f25610c6700 1 Processor -- start 2023-10-06T02:27:40.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.030+0000 7f25610c6700 1 -- start start 2023-10-06T02:27:40.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.030+0000 7f25610c6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f255c1599e0 0x7f255c0b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.030+0000 7f25610c6700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f255c0b3310 0x7f255c0b4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.030+0000 7f25610c6700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c0b43b0 con 0x7f255c159610 2023-10-06T02:27:40.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.030+0000 7f25610c6700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255c0cde50 con 0x7f255c0b3310 2023-10-06T02:27:40.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.030+0000 7f25610c6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0b1020 con 0x7f255c1599e0 2023-10-06T02:27:40.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.031+0000 7f255b59e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f255c0b3310 0x7f255c0b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.031+0000 7f255b59e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f255c0b3310 0x7f255c0b4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43640/0 (socket says 172.21.15.37:43640) 2023-10-06T02:27:40.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.031+0000 7f255b59e700 1 -- 172.21.15.37:0/3907572942 learned_addr learned my addr 172.21.15.37:0/3907572942 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:40.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.031+0000 7f255259c700 1 --2- 172.21.15.37:0/3907572942 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f255c1599e0 0x7f255c0b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.031+0000 7f255b59e700 1 -- 172.21.15.37:0/3907572942 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f255c1599e0 msgr2=0x7f255c0b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:40.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.031+0000 7f255b59e700 1 --2- 172.21.15.37:0/3907572942 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f255c1599e0 0x7f255c0b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.031+0000 7f255b59e700 1 -- 172.21.15.37:0/3907572942 >> v1:172.21.15.191:6789/0 conn(0x7f255c159610 legacy=0x7f255c0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.031+0000 7f255b59e700 1 -- 172.21.15.37:0/3907572942 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c0b37a0 con 0x7f255c0b3310 2023-10-06T02:27:40.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.031+0000 7f255b59e700 1 --2- 172.21.15.37:0/3907572942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f255c0b3310 0x7f255c0b4840 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2554009f20 tx=0x7f2554009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122cc3c6a91f7f2c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:40.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.031+0000 7f255a59c700 1 -- 172.21.15.37:0/3907572942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255400e070 con 0x7f255c0b3310 2023-10-06T02:27:40.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.031+0000 7f255a59c700 1 -- 172.21.15.37:0/3907572942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255400b9d0 con 0x7f255c0b3310 2023-10-06T02:27:40.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.031+0000 7f255a59c700 1 -- 172.21.15.37:0/3907572942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25540092e0 con 0x7f255c0b3310 2023-10-06T02:27:40.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.032+0000 7f25610c6700 1 -- 172.21.15.37:0/3907572942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f255c0b3310 msgr2=0x7f255c0b4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.032+0000 7f25610c6700 1 --2- 172.21.15.37:0/3907572942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f255c0b3310 0x7f255c0b4840 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2554009f20 tx=0x7f2554009840 comp rx=0 tx=0).stop 2023-10-06T02:27:40.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.032+0000 7f25610c6700 1 -- 172.21.15.37:0/3907572942 shutdown_connections 2023-10-06T02:27:40.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.032+0000 7f25610c6700 1 --2- 172.21.15.37:0/3907572942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f255c0b3310 0x7f255c0b4840 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.032+0000 7f25610c6700 1 --2- 172.21.15.37:0/3907572942 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f255c1599e0 0x7f255c0b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.032+0000 7f25610c6700 1 -- 172.21.15.37:0/3907572942 >> 172.21.15.37:0/3907572942 conn(0x7f255c06c0b0 msgr2=0x7f255c06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:40.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.032+0000 7f25610c6700 1 -- 172.21.15.37:0/3907572942 shutdown_connections 2023-10-06T02:27:40.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.032+0000 7f25610c6700 1 -- 172.21.15.37:0/3907572942 wait complete. 2023-10-06T02:27:40.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.033+0000 7f25610c6700 1 Processor -- start 2023-10-06T02:27:40.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.033+0000 7f25610c6700 1 -- start start 2023-10-06T02:27:40.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.034+0000 7f25610c6700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f255c0b3310 0x7f255c14e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.034+0000 7f25610c6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f255c159610 0x7f255c14f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.034+0000 7f25610c6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f255c1599e0 0x7f255c15ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.034+0000 7f25610c6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c14ee70 con 0x7f255c159610 2023-10-06T02:27:40.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.034+0000 7f25610c6700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0c95e0 con 0x7f255c0b3310 2023-10-06T02:27:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.034+0000 7f25610c6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c169eb0 con 0x7f255c1599e0 2023-10-06T02:27:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.034+0000 7f255259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f255c159610 0x7f255c14f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.034+0000 7f255259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f255c159610 0x7f255c14f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43650/0 (socket says 172.21.15.37:43650) 2023-10-06T02:27:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.034+0000 7f255259c700 1 -- 172.21.15.37:0/1231985439 learned_addr learned my addr 172.21.15.37:0/1231985439 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.034+0000 7f255ad9d700 1 --2- 172.21.15.37:0/1231985439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f255c0b3310 0x7f255c14e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.034+0000 7f255b59e700 1 --2- 172.21.15.37:0/1231985439 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f255c1599e0 0x7f255c15ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.034+0000 7f255259c700 1 -- 172.21.15.37:0/1231985439 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f255c1599e0 msgr2=0x7f255c15ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.034+0000 7f255259c700 1 --2- 172.21.15.37:0/1231985439 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f255c1599e0 0x7f255c15ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.034+0000 7f255259c700 1 -- 172.21.15.37:0/1231985439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f255c0b3310 msgr2=0x7f255c14e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.034+0000 7f255259c700 1 --2- 172.21.15.37:0/1231985439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f255c0b3310 0x7f255c14e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.034+0000 7f255259c700 1 -- 172.21.15.37:0/1231985439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2554009ae0 con 0x7f255c159610 2023-10-06T02:27:40.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.034+0000 7f255ad9d700 1 --2- 172.21.15.37:0/1231985439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f255c0b3310 0x7f255c14e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:40.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.034+0000 7f255259c700 1 --2- 172.21.15.37:0/1231985439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f255c159610 0x7f255c14f220 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f254400e930 tx=0x7f25440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:40.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.034+0000 7f25537fe700 1 -- 172.21.15.37:0/1231985439 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400eed0 con 0x7f255c159610 2023-10-06T02:27:40.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.035+0000 7f25537fe700 1 -- 172.21.15.37:0/1231985439 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254400c850 con 0x7f255c159610 2023-10-06T02:27:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.035+0000 7f25610c6700 1 -- 172.21.15.37:0/1231985439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255c14e870 con 0x7f255c159610 2023-10-06T02:27:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.035+0000 7f25537fe700 1 -- 172.21.15.37:0/1231985439 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400cbf0 con 0x7f255c159610 2023-10-06T02:27:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.035+0000 7f25610c6700 1 -- 172.21.15.37:0/1231985439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255c0c8d30 con 0x7f255c159610 2023-10-06T02:27:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.036+0000 7f25610c6700 1 -- 172.21.15.37:0/1231985439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255c0c9770 con 0x7f255c159610 2023-10-06T02:27:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.036+0000 7f25537fe700 1 -- 172.21.15.37:0/1231985439 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2544013470 con 0x7f255c159610 2023-10-06T02:27:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.036+0000 7f25537fe700 1 --2- 172.21.15.37:0/1231985439 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f253c066f30 0x7f253c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.036+0000 7f25537fe700 1 -- 172.21.15.37:0/1231985439 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f25440845b0 con 0x7f255c159610 2023-10-06T02:27:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.037+0000 7f255ad9d700 1 --2- 172.21.15.37:0/1231985439 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f253c066f30 0x7f253c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.037+0000 7f255ad9d700 1 --2- 172.21.15.37:0/1231985439 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f253c066f30 0x7f253c0693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f254c007fd0 tx=0x7f254c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.041+0000 7f25537fe700 1 -- 172.21.15.37:0/1231985439 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2544051a10 con 0x7f255c159610 2023-10-06T02:27:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.234+0000 7f25610c6700 1 -- 172.21.15.37:0/1231985439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f255c0b3a80 con 0x7f255c159610 2023-10-06T02:27:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.234+0000 7f25537fe700 1 -- 172.21.15.37:0/1231985439 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2544055030 con 0x7f255c159610 2023-10-06T02:27:40.236 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T02:27:40.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.236+0000 7f25610c6700 1 -- 172.21.15.37:0/1231985439 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f253c066f30 msgr2=0x7f253c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.236+0000 7f25610c6700 1 --2- 172.21.15.37:0/1231985439 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f253c066f30 0x7f253c0693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f254c007fd0 tx=0x7f254c009040 comp rx=0 tx=0).stop 2023-10-06T02:27:40.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.236+0000 7f25610c6700 1 -- 172.21.15.37:0/1231985439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f255c159610 msgr2=0x7f255c14f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.236+0000 7f25610c6700 1 --2- 172.21.15.37:0/1231985439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f255c159610 0x7f255c14f220 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f254400e930 tx=0x7f25440091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.236+0000 7f25610c6700 1 -- 172.21.15.37:0/1231985439 shutdown_connections 2023-10-06T02:27:40.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.236+0000 7f25610c6700 1 --2- 172.21.15.37:0/1231985439 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f255c1599e0 0x7f255c15ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.236+0000 7f25610c6700 1 --2- 172.21.15.37:0/1231985439 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f253c066f30 0x7f253c0693e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.236+0000 7f25610c6700 1 --2- 172.21.15.37:0/1231985439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f255c0b3310 0x7f255c14e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.236+0000 7f25610c6700 1 --2- 172.21.15.37:0/1231985439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f255c159610 0x7f255c14f220 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.236+0000 7f25610c6700 1 -- 172.21.15.37:0/1231985439 >> 172.21.15.37:0/1231985439 conn(0x7f255c06c0b0 msgr2=0x7f255c0cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.236+0000 7f25610c6700 1 -- 172.21.15.37:0/1231985439 shutdown_connections 2023-10-06T02:27:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.236+0000 7f25610c6700 1 -- 172.21.15.37:0/1231985439 wait complete. 2023-10-06T02:27:40.250 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:27:40.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.367+0000 7f1fb9e20700 1 Processor -- start 2023-10-06T02:27:40.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.367+0000 7f1fb9e20700 1 -- start start 2023-10-06T02:27:40.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.368+0000 7f1fb9e20700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1fb4159760 0x7f1fb415d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.368+0000 7f1fb9e20700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1fb415d8d0 0x7f1fb415dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.368+0000 7f1fb9e20700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb40cb650 con 0x7f1fb40c5390 2023-10-06T02:27:40.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.368+0000 7f1fb9e20700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb40cc2d0 con 0x7f1fb4159760 2023-10-06T02:27:40.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.368+0000 7f1fb9e20700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb415e260 con 0x7f1fb415d8d0 2023-10-06T02:27:40.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.368+0000 7f1fb37fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1fb4159760 0x7f1fb415d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.368+0000 7f1fb37fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1fb4159760 0x7f1fb415d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43656/0 (socket says 172.21.15.37:43656) 2023-10-06T02:27:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.368+0000 7f1fb37fe700 1 -- 172.21.15.37:0/1586809662 learned_addr learned my addr 172.21.15.37:0/1586809662 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.368+0000 7f1fb2ffd700 1 --2- 172.21.15.37:0/1586809662 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1fb415d8d0 0x7f1fb415dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.368+0000 7f1fb37fe700 1 -- 172.21.15.37:0/1586809662 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1fb415d8d0 msgr2=0x7f1fb415dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.368+0000 7f1fb37fe700 1 --2- 172.21.15.37:0/1586809662 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1fb415d8d0 0x7f1fb415dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.368+0000 7f1fb37fe700 1 -- 172.21.15.37:0/1586809662 >> v1:172.21.15.191:6789/0 conn(0x7f1fb40c5390 legacy=0x7f1fb40c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.368+0000 7f1fb37fe700 1 -- 172.21.15.37:0/1586809662 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb40cb930 con 0x7f1fb4159760 2023-10-06T02:27:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.369+0000 7f1fb37fe700 1 --2- 172.21.15.37:0/1586809662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb4159760 0x7f1fb415d390 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40099b0 tx=0x7f1fa4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402f3e5eba93ab40 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.369+0000 7f1fb27fc700 1 -- 172.21.15.37:0/1586809662 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa400b8b0 con 0x7f1fb4159760 2023-10-06T02:27:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.369+0000 7f1fb27fc700 1 -- 172.21.15.37:0/1586809662 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa400ba10 con 0x7f1fb4159760 2023-10-06T02:27:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.369+0000 7f1fb27fc700 1 -- 172.21.15.37:0/1586809662 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa400bdb0 con 0x7f1fb4159760 2023-10-06T02:27:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.369+0000 7f1fb9e20700 1 -- 172.21.15.37:0/1586809662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb4159760 msgr2=0x7f1fb415d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.369+0000 7f1fb9e20700 1 --2- 172.21.15.37:0/1586809662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb4159760 0x7f1fb415d390 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40099b0 tx=0x7f1fa4009250 comp rx=0 tx=0).stop 2023-10-06T02:27:40.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.369+0000 7f1fb9e20700 1 -- 172.21.15.37:0/1586809662 shutdown_connections 2023-10-06T02:27:40.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.369+0000 7f1fb9e20700 1 --2- 172.21.15.37:0/1586809662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb4159760 0x7f1fb415d390 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.369+0000 7f1fb9e20700 1 --2- 172.21.15.37:0/1586809662 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1fb415d8d0 0x7f1fb415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.369+0000 7f1fb9e20700 1 -- 172.21.15.37:0/1586809662 >> 172.21.15.37:0/1586809662 conn(0x7f1fb406c890 msgr2=0x7f1fb40d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:40.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.369+0000 7f1fb9e20700 1 -- 172.21.15.37:0/1586809662 shutdown_connections 2023-10-06T02:27:40.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.369+0000 7f1fb9e20700 1 -- 172.21.15.37:0/1586809662 wait complete. 2023-10-06T02:27:40.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.371+0000 7f1fb9e20700 1 Processor -- start 2023-10-06T02:27:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.371+0000 7f1fb9e20700 1 -- start start 2023-10-06T02:27:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.371+0000 7f1fb9e20700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb40c5390 0x7f1fb40b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.371+0000 7f1fb9e20700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1fb4159760 0x7f1fb415c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.371+0000 7f1fb9e20700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1fb415d8d0 0x7f1fb4156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.371+0000 7f1fb9e20700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40b5c70 con 0x7f1fb40c5390 2023-10-06T02:27:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.371+0000 7f1fb9e20700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40b52a0 con 0x7f1fb415d8d0 2023-10-06T02:27:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.371+0000 7f1fb9e20700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40b4690 con 0x7f1fb4159760 2023-10-06T02:27:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.371+0000 7f1fb37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb40c5390 0x7f1fb40b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.371+0000 7f1fb37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb40c5390 0x7f1fb40b5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43660/0 (socket says 172.21.15.37:43660) 2023-10-06T02:27:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.372+0000 7f1fb37fe700 1 -- 172.21.15.37:0/3020416706 learned_addr learned my addr 172.21.15.37:0/3020416706 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.372+0000 7f1fb2ffd700 1 --2- 172.21.15.37:0/3020416706 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1fb4159760 0x7f1fb415c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.372+0000 7f1fb3fff700 1 --2- 172.21.15.37:0/3020416706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1fb415d8d0 0x7f1fb4156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.372+0000 7f1fb37fe700 1 -- 172.21.15.37:0/3020416706 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1fb4159760 msgr2=0x7f1fb415c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.372+0000 7f1fb37fe700 1 --2- 172.21.15.37:0/3020416706 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1fb4159760 0x7f1fb415c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.372+0000 7f1fb37fe700 1 -- 172.21.15.37:0/3020416706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1fb415d8d0 msgr2=0x7f1fb4156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.372+0000 7f1fb37fe700 1 --2- 172.21.15.37:0/3020416706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1fb415d8d0 0x7f1fb4156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.372+0000 7f1fb37fe700 1 -- 172.21.15.37:0/3020416706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa40094f0 con 0x7f1fb40c5390 2023-10-06T02:27:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.372+0000 7f1fb3fff700 1 --2- 172.21.15.37:0/3020416706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1fb415d8d0 0x7f1fb4156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.372+0000 7f1fb37fe700 1 --2- 172.21.15.37:0/3020416706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb40c5390 0x7f1fb40b5730 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4088880 tx=0x7f1fa4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.372+0000 7f1f9b7fe700 1 -- 172.21.15.37:0/3020416706 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4011db0 con 0x7f1fb40c5390 2023-10-06T02:27:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.372+0000 7f1f9b7fe700 1 -- 172.21.15.37:0/3020416706 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa4020070 con 0x7f1fb40c5390 2023-10-06T02:27:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.372+0000 7f1f9b7fe700 1 -- 172.21.15.37:0/3020416706 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa401c6a0 con 0x7f1fb40c5390 2023-10-06T02:27:40.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.372+0000 7f1fb9e20700 1 -- 172.21.15.37:0/3020416706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb40b4970 con 0x7f1fb40c5390 2023-10-06T02:27:40.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.372+0000 7f1fb9e20700 1 -- 172.21.15.37:0/3020416706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb40b4f30 con 0x7f1fb40c5390 2023-10-06T02:27:40.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.373+0000 7f1fb9e20700 1 -- 172.21.15.37:0/3020416706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb40b5580 con 0x7f1fb40c5390 2023-10-06T02:27:40.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.374+0000 7f1f9b7fe700 1 -- 172.21.15.37:0/3020416706 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fa4022030 con 0x7f1fb40c5390 2023-10-06T02:27:40.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.374+0000 7f1f9b7fe700 1 --2- 172.21.15.37:0/3020416706 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1fa0066f30 0x7f1fa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.374+0000 7f1f9b7fe700 1 -- 172.21.15.37:0/3020416706 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1fa4085af0 con 0x7f1fb40c5390 2023-10-06T02:27:40.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.374+0000 7f1fb2ffd700 1 --2- 172.21.15.37:0/3020416706 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1fa0066f30 0x7f1fa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.375+0000 7f1fb2ffd700 1 --2- 172.21.15.37:0/3020416706 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1fa0066f30 0x7f1fa00693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4088230 tx=0x7f1fa8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:40.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.378+0000 7f1f9b7fe700 1 -- 172.21.15.37:0/3020416706 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1fa4052f50 con 0x7f1fb40c5390 2023-10-06T02:27:40.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.573+0000 7f1fb9e20700 1 -- 172.21.15.37:0/3020416706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1fb406fbf0 con 0x7f1fb40c5390 2023-10-06T02:27:40.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.574+0000 7f1f9b7fe700 1 -- 172.21.15.37:0/3020416706 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) v1 ==== 84+0+126 (secure 0 0 0) 0x7f1fa402b090 con 0x7f1fb40c5390 2023-10-06T02:27:40.576 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:40.576 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-10-06T02:27:40.576 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:40.576 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-10-06T02:27:40.576 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-10-06T02:27:40.576 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:40.576 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-10-06T02:27:40.576 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-10-06T02:27:40.576 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-10-06T02:27:40.576 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:40.576 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-10-06T02:27:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.576+0000 7f1fb9e20700 1 -- 172.21.15.37:0/3020416706 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1fa0066f30 msgr2=0x7f1fa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.576+0000 7f1fb9e20700 1 --2- 172.21.15.37:0/3020416706 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1fa0066f30 0x7f1fa00693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4088230 tx=0x7f1fa8008040 comp rx=0 tx=0).stop 2023-10-06T02:27:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.576+0000 7f1fb9e20700 1 -- 172.21.15.37:0/3020416706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb40c5390 msgr2=0x7f1fb40b5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.576+0000 7f1fb9e20700 1 --2- 172.21.15.37:0/3020416706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb40c5390 0x7f1fb40b5730 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4088880 tx=0x7f1fa4016000 comp rx=0 tx=0).stop 2023-10-06T02:27:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.576+0000 7f1fb9e20700 1 -- 172.21.15.37:0/3020416706 shutdown_connections 2023-10-06T02:27:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.576+0000 7f1fb9e20700 1 --2- 172.21.15.37:0/3020416706 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1fa0066f30 0x7f1fa00693e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.576+0000 7f1fb9e20700 1 --2- 172.21.15.37:0/3020416706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1fb415d8d0 0x7f1fb4156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.576+0000 7f1fb9e20700 1 --2- 172.21.15.37:0/3020416706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb40c5390 0x7f1fb40b5730 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.576+0000 7f1fb9e20700 1 --2- 172.21.15.37:0/3020416706 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1fb4159760 0x7f1fb415c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.576+0000 7f1fb9e20700 1 -- 172.21.15.37:0/3020416706 >> 172.21.15.37:0/3020416706 conn(0x7f1fb406c890 msgr2=0x7f1fb40ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:40.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.576+0000 7f1fb9e20700 1 -- 172.21.15.37:0/3020416706 shutdown_connections 2023-10-06T02:27:40.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.576+0000 7f1fb9e20700 1 -- 172.21.15.37:0/3020416706 wait complete. 2023-10-06T02:27:40.589 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:27:40.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:27:40.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.710+0000 7fa1df2b5700 1 Processor -- start 2023-10-06T02:27:40.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.710+0000 7fa1df2b5700 1 -- start start 2023-10-06T02:27:40.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.711+0000 7fa1df2b5700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa1d80b0b80 0x7fa1d80ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.711+0000 7fa1df2b5700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d815dcf0 con 0x7fa1d8159380 2023-10-06T02:27:40.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.711+0000 7fa1df2b5700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d815d0e0 con 0x7fa1d8159750 2023-10-06T02:27:40.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.711+0000 7fa1df2b5700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d815d3c0 con 0x7fa1d80b0b80 2023-10-06T02:27:40.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.711+0000 7fa1de2b3700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa1d8159380 0x7fa1d80b2320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47624/0 (socket says 172.21.15.37:47624) 2023-10-06T02:27:40.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.711+0000 7fa1de2b3700 1 -- 172.21.15.37:0/740545574 learned_addr learned my addr 172.21.15.37:0/740545574 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:40.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.711+0000 7fa1ddab2700 1 --2- 172.21.15.37:0/740545574 >> v2:172.21.15.191:3300/0 conn(0x7fa1d80b0b80 0x7fa1d80ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.711+0000 7fa1dd2b1700 1 -- 172.21.15.37:0/740545574 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047676329 0 0) 0x7fa1d815dcf0 con 0x7fa1d8159380 2023-10-06T02:27:40.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.711+0000 7fa1dd2b1700 1 -- 172.21.15.37:0/740545574 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1c0003570 con 0x7fa1d8159380 2023-10-06T02:27:40.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1dd2b1700 1 -- 172.21.15.37:0/740545574 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704551636 0 0) 0x7fa1d815d0e0 con 0x7fa1d8159750 2023-10-06T02:27:40.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1dd2b1700 1 -- 172.21.15.37:0/740545574 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1d815dcf0 con 0x7fa1d8159750 2023-10-06T02:27:40.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1dd2b1700 1 -- 172.21.15.37:0/740545574 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2535074988 0 0) 0x7fa1c0003570 con 0x7fa1d8159380 2023-10-06T02:27:40.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1dd2b1700 1 -- 172.21.15.37:0/740545574 >> v2:172.21.15.191:3300/0 conn(0x7fa1d80b0b80 msgr2=0x7fa1d80ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:40.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1dd2b1700 1 --2- 172.21.15.37:0/740545574 >> v2:172.21.15.191:3300/0 conn(0x7fa1d80b0b80 0x7fa1d80ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1dd2b1700 1 -- 172.21.15.37:0/740545574 >> v1:172.21.15.191:6789/0 conn(0x7fa1d8159750 legacy=0x7fa1d80cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1dd2b1700 1 -- 172.21.15.37:0/740545574 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d815d6a0 con 0x7fa1d8159380 2023-10-06T02:27:40.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1dd2b1700 1 -- 172.21.15.37:0/740545574 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7fa1d0001470 con 0x7fa1d8159380 2023-10-06T02:27:40.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1ddab2700 1 --2- 172.21.15.37:0/740545574 >> v2:172.21.15.191:3300/0 conn(0x7fa1d80b0b80 0x7fa1d80ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:40.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1dd2b1700 1 -- 172.21.15.37:0/740545574 >> v1:172.21.15.37:6789/0 conn(0x7fa1d8159380 legacy=0x7fa1d80b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1dd2b1700 1 --2- 172.21.15.37:0/740545574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1c0003bf0 0x7fa1c0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1dd2b1700 1 --2- 172.21.15.37:0/740545574 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1c0004810 0x7fa1c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1dd2b1700 1 --2- 172.21.15.37:0/740545574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1c00051c0 0x7fa1c000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1dd2b1700 1 -- 172.21.15.37:0/740545574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d815d3c0 con 0x7fa1c00051c0 2023-10-06T02:27:40.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1dd2b1700 1 -- 172.21.15.37:0/740545574 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c000c0b0 con 0x7fa1c0003bf0 2023-10-06T02:27:40.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1dd2b1700 1 -- 172.21.15.37:0/740545574 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c000c270 con 0x7fa1c0004810 2023-10-06T02:27:40.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1deab4700 1 --2- 172.21.15.37:0/740545574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1c00051c0 0x7fa1c000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1de2b3700 1 --2- 172.21.15.37:0/740545574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1c0003bf0 0x7fa1c0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1ddab2700 1 --2- 172.21.15.37:0/740545574 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1c0004810 0x7fa1c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1deab4700 1 -- 172.21.15.37:0/740545574 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1c0004810 msgr2=0x7fa1c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:40.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1deab4700 1 --2- 172.21.15.37:0/740545574 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1c0004810 0x7fa1c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1deab4700 1 -- 172.21.15.37:0/740545574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1c0003bf0 msgr2=0x7fa1c0003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:40.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1deab4700 1 --2- 172.21.15.37:0/740545574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1c0003bf0 0x7fa1c0003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1deab4700 1 -- 172.21.15.37:0/740545574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c0003570 con 0x7fa1c00051c0 2023-10-06T02:27:40.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1deab4700 1 -- 172.21.15.37:0/740545574 reap_dead start 2023-10-06T02:27:40.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.712+0000 7fa1deab4700 1 --2- 172.21.15.37:0/740545574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1c00051c0 0x7fa1c000ba60 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8002120 tx=0x7fa1c80017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ae4654f05e8099 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:40.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.713+0000 7fa1dd2b1700 1 -- 172.21.15.37:0/740545574 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8001ab0 con 0x7fa1c00051c0 2023-10-06T02:27:40.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.713+0000 7fa1dd2b1700 1 -- 172.21.15.37:0/740545574 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c800c980 con 0x7fa1c00051c0 2023-10-06T02:27:40.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.713+0000 7fa1dd2b1700 1 -- 172.21.15.37:0/740545574 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c800cd00 con 0x7fa1c00051c0 2023-10-06T02:27:40.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.713+0000 7fa1df2b5700 1 -- 172.21.15.37:0/740545574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1c00051c0 msgr2=0x7fa1c000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.713+0000 7fa1df2b5700 1 --2- 172.21.15.37:0/740545574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1c00051c0 0x7fa1c000ba60 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8002120 tx=0x7fa1c80017a0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.713+0000 7fa1df2b5700 1 -- 172.21.15.37:0/740545574 shutdown_connections 2023-10-06T02:27:40.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.713+0000 7fa1df2b5700 1 --2- 172.21.15.37:0/740545574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1c00051c0 0x7fa1c000ba60 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.713+0000 7fa1df2b5700 1 -- 172.21.15.37:0/740545574 >> 172.21.15.37:0/740545574 conn(0x7fa1d806c0b0 msgr2=0x7fa1d806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:40.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.713+0000 7fa1df2b5700 1 -- 172.21.15.37:0/740545574 shutdown_connections 2023-10-06T02:27:40.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.713+0000 7fa1df2b5700 1 -- 172.21.15.37:0/740545574 wait complete. 2023-10-06T02:27:40.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.714+0000 7fa1df2b5700 1 Processor -- start 2023-10-06T02:27:40.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.714+0000 7fa1df2b5700 1 -- start start 2023-10-06T02:27:40.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.715+0000 7fa1df2b5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1c00051c0 0x7fa1d816a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.715+0000 7fa1df2b5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1d80c9cb0 0x7fa1d80cde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.715+0000 7fa1df2b5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d80ce3b0 0x7fa1d816d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.715+0000 7fa1df2b5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d80ce850 con 0x7fa1d80ce3b0 2023-10-06T02:27:40.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.715+0000 7fa1df2b5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d8156100 con 0x7fa1d80c9cb0 2023-10-06T02:27:40.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.715+0000 7fa1df2b5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d80d06f0 con 0x7fa1c00051c0 2023-10-06T02:27:40.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.715+0000 7fa1deab4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d80ce3b0 0x7fa1d816d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.715+0000 7fa1deab4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d80ce3b0 0x7fa1d816d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43676/0 (socket says 172.21.15.37:43676) 2023-10-06T02:27:40.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.715+0000 7fa1deab4700 1 -- 172.21.15.37:0/471386910 learned_addr learned my addr 172.21.15.37:0/471386910 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:40.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.715+0000 7fa1de2b3700 1 --2- 172.21.15.37:0/471386910 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1c00051c0 0x7fa1d816a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.715+0000 7fa1ddab2700 1 --2- 172.21.15.37:0/471386910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1d80c9cb0 0x7fa1d80cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.715+0000 7fa1deab4700 1 -- 172.21.15.37:0/471386910 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1c00051c0 msgr2=0x7fa1d816a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.715+0000 7fa1deab4700 1 --2- 172.21.15.37:0/471386910 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1c00051c0 0x7fa1d816a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.715+0000 7fa1deab4700 1 -- 172.21.15.37:0/471386910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1d80c9cb0 msgr2=0x7fa1d80cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:40.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.716+0000 7fa1deab4700 1 --2- 172.21.15.37:0/471386910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1d80c9cb0 0x7fa1d80cde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:40.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.716+0000 7fa1deab4700 1 -- 172.21.15.37:0/471386910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d816ada0 con 0x7fa1d80ce3b0 2023-10-06T02:27:40.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.716+0000 7fa1de2b3700 1 --2- 172.21.15.37:0/471386910 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1c00051c0 0x7fa1d816a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:40.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.716+0000 7fa1ddab2700 1 --2- 172.21.15.37:0/471386910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1d80c9cb0 0x7fa1d80cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:40.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.716+0000 7fa1deab4700 1 --2- 172.21.15.37:0/471386910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d80ce3b0 0x7fa1d816d410 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa1d815d020 tx=0x7fa1c8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:40.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.716+0000 7fa1d67fc700 1 -- 172.21.15.37:0/471386910 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c800c6d0 con 0x7fa1d80ce3b0 2023-10-06T02:27:40.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.716+0000 7fa1d67fc700 1 -- 172.21.15.37:0/471386910 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c8006db0 con 0x7fa1d80ce3b0 2023-10-06T02:27:40.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.716+0000 7fa1df2b5700 1 -- 172.21.15.37:0/471386910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d80cfae0 con 0x7fa1d80ce3b0 2023-10-06T02:27:40.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.716+0000 7fa1d67fc700 1 -- 172.21.15.37:0/471386910 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c801e660 con 0x7fa1d80ce3b0 2023-10-06T02:27:40.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.716+0000 7fa1df2b5700 1 -- 172.21.15.37:0/471386910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d80d00a0 con 0x7fa1d80ce3b0 2023-10-06T02:27:40.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.717+0000 7fa1df2b5700 1 -- 172.21.15.37:0/471386910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d8064b00 con 0x7fa1d80ce3b0 2023-10-06T02:27:40.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.717+0000 7fa1d67fc700 1 -- 172.21.15.37:0/471386910 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa1c8003030 con 0x7fa1d80ce3b0 2023-10-06T02:27:40.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.718+0000 7fa1d67fc700 1 --2- 172.21.15.37:0/471386910 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa1c4066f30 0x7fa1c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:40.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.718+0000 7fa1d67fc700 1 -- 172.21.15.37:0/471386910 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa1c8086280 con 0x7fa1d80ce3b0 2023-10-06T02:27:40.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.718+0000 7fa1de2b3700 1 --2- 172.21.15.37:0/471386910 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa1c4066f30 0x7fa1c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:40.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.718+0000 7fa1de2b3700 1 --2- 172.21.15.37:0/471386910 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa1c4066f30 0x7fa1c40693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0000e10 tx=0x7fa1d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:40.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.722+0000 7fa1d67fc700 1 -- 172.21.15.37:0/471386910 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa1c80536f0 con 0x7fa1d80ce3b0 2023-10-06T02:27:40.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:40.920+0000 7fa1df2b5700 1 -- 172.21.15.37:0/471386910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa1d8064b00 con 0x7fa1d80ce3b0 2023-10-06T02:27:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.788+0000 7fa1d67fc700 1 -- 172.21.15.37:0/471386910 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa1c8056d10 con 0x7fa1d80ce3b0 2023-10-06T02:27:41.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.792+0000 7fa1df2b5700 1 -- 172.21.15.37:0/471386910 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa1c4066f30 msgr2=0x7fa1c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.792+0000 7fa1df2b5700 1 --2- 172.21.15.37:0/471386910 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa1c4066f30 0x7fa1c40693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0000e10 tx=0x7fa1d0009040 comp rx=0 tx=0).stop 2023-10-06T02:27:41.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.792+0000 7fa1df2b5700 1 -- 172.21.15.37:0/471386910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d80ce3b0 msgr2=0x7fa1d816d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.792+0000 7fa1df2b5700 1 --2- 172.21.15.37:0/471386910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d80ce3b0 0x7fa1d816d410 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa1d815d020 tx=0x7fa1c8016000 comp rx=0 tx=0).stop 2023-10-06T02:27:41.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.793+0000 7fa1df2b5700 1 -- 172.21.15.37:0/471386910 shutdown_connections 2023-10-06T02:27:41.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.793+0000 7fa1df2b5700 1 --2- 172.21.15.37:0/471386910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d80ce3b0 0x7fa1d816d410 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.793+0000 7fa1df2b5700 1 --2- 172.21.15.37:0/471386910 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1c00051c0 0x7fa1d816a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.793+0000 7fa1df2b5700 1 --2- 172.21.15.37:0/471386910 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa1c4066f30 0x7fa1c40693e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.793+0000 7fa1df2b5700 1 --2- 172.21.15.37:0/471386910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1d80c9cb0 0x7fa1d80cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.793+0000 7fa1df2b5700 1 -- 172.21.15.37:0/471386910 >> 172.21.15.37:0/471386910 conn(0x7fa1d806c0b0 msgr2=0x7fa1d80b5360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:41.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.793+0000 7fa1df2b5700 1 -- 172.21.15.37:0/471386910 shutdown_connections 2023-10-06T02:27:41.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.793+0000 7fa1df2b5700 1 -- 172.21.15.37:0/471386910 wait complete. 2023-10-06T02:27:41.797 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-10-06T02:27:41.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:27:41.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.942+0000 7f8af232d700 1 Processor -- start 2023-10-06T02:27:41.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.942+0000 7f8af232d700 1 -- start start 2023-10-06T02:27:41.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.943+0000 7f8af232d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8aec1559d0 0x7f8aec06e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.943+0000 7f8af232d700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8aec155da0 0x7f8aec06eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.943+0000 7f8af232d700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aec0c73e0 con 0x7f8aec069e10 2023-10-06T02:27:41.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.943+0000 7f8af232d700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aec0c67d0 con 0x7f8aec155da0 2023-10-06T02:27:41.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.943+0000 7f8af232d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec0c6ab0 con 0x7f8aec1559d0 2023-10-06T02:27:41.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.943+0000 7f8aebfff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8aec1559d0 0x7f8aec06e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.943+0000 7f8aeb7fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8aec155da0 0x7f8aec06eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.943+0000 7f8af08ca700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f8aec069e10 0x7f8aec06a2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:41168/0 (socket says 172.21.15.37:41168) 2023-10-06T02:27:41.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.943+0000 7f8aebfff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8aec1559d0 0x7f8aec06e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:47520/0 (socket says 172.21.15.37:47520) 2023-10-06T02:27:41.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.943+0000 7f8af08ca700 1 -- 172.21.15.37:0/3376469808 learned_addr learned my addr 172.21.15.37:0/3376469808 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:41.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.943+0000 7f8aeaffd700 1 -- 172.21.15.37:0/3376469808 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1139681739 0 0) 0x7f8aec0c73e0 con 0x7f8aec069e10 2023-10-06T02:27:41.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.943+0000 7f8aeaffd700 1 -- 172.21.15.37:0/3376469808 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ad4003570 con 0x7f8aec069e10 2023-10-06T02:27:41.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.943+0000 7f8aebfff700 1 -- 172.21.15.37:0/3376469808 >> v2:172.21.15.191:3300/0 conn(0x7f8aec155da0 msgr2=0x7f8aec06eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:41.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.943+0000 7f8aebfff700 1 --2- 172.21.15.37:0/3376469808 >> v2:172.21.15.191:3300/0 conn(0x7f8aec155da0 0x7f8aec06eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.943+0000 7f8aebfff700 1 -- 172.21.15.37:0/3376469808 >> v1:172.21.15.191:6789/0 conn(0x7f8aec069e10 legacy=0x7f8aec06a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.943+0000 7f8aebfff700 1 -- 172.21.15.37:0/3376469808 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec0c6d90 con 0x7f8aec1559d0 2023-10-06T02:27:41.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.943+0000 7f8aeb7fe700 1 --2- 172.21.15.37:0/3376469808 >> v2:172.21.15.191:3300/0 conn(0x7f8aec155da0 0x7f8aec06eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:41.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.943+0000 7f8aebfff700 1 --2- 172.21.15.37:0/3376469808 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8aec1559d0 0x7f8aec06e5e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00aa90 tx=0x7f8adc00a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f7beeca8520bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:41.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.944+0000 7f8aeaffd700 1 -- 172.21.15.37:0/3376469808 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc00c970 con 0x7f8aec1559d0 2023-10-06T02:27:41.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.944+0000 7f8aeaffd700 1 -- 172.21.15.37:0/3376469808 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc00cad0 con 0x7f8aec1559d0 2023-10-06T02:27:41.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.944+0000 7f8aeaffd700 1 -- 172.21.15.37:0/3376469808 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc00ce70 con 0x7f8aec1559d0 2023-10-06T02:27:41.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.944+0000 7f8af232d700 1 -- 172.21.15.37:0/3376469808 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8aec1559d0 msgr2=0x7f8aec06e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.944+0000 7f8af232d700 1 --2- 172.21.15.37:0/3376469808 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8aec1559d0 0x7f8aec06e5e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00aa90 tx=0x7f8adc00a330 comp rx=0 tx=0).stop 2023-10-06T02:27:41.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.944+0000 7f8af232d700 1 -- 172.21.15.37:0/3376469808 shutdown_connections 2023-10-06T02:27:41.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.944+0000 7f8af232d700 1 --2- 172.21.15.37:0/3376469808 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8aec1559d0 0x7f8aec06e5e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.944+0000 7f8af232d700 1 --2- 172.21.15.37:0/3376469808 >> v2:172.21.15.191:3300/0 conn(0x7f8aec155da0 0x7f8aec06eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.944+0000 7f8af232d700 1 -- 172.21.15.37:0/3376469808 >> 172.21.15.37:0/3376469808 conn(0x7f8aec0cc100 msgr2=0x7f8aec0cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:41.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.944+0000 7f8af232d700 1 -- 172.21.15.37:0/3376469808 shutdown_connections 2023-10-06T02:27:41.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.944+0000 7f8af232d700 1 -- 172.21.15.37:0/3376469808 wait complete. 2023-10-06T02:27:41.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.945+0000 7f8af232d700 1 Processor -- start 2023-10-06T02:27:41.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.946+0000 7f8af232d700 1 -- start start 2023-10-06T02:27:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.946+0000 7f8af232d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8aec069e10 0x7f8aec164dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.946+0000 7f8af232d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aec1559d0 0x7f8aec0af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.946+0000 7f8af232d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8aec155da0 0x7f8aec0a9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.946+0000 7f8af232d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec0b0340 con 0x7f8aec1559d0 2023-10-06T02:27:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.946+0000 7f8af232d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec0b0620 con 0x7f8aec155da0 2023-10-06T02:27:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.946+0000 7f8af232d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec0b0900 con 0x7f8aec069e10 2023-10-06T02:27:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.946+0000 7f8aeb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aec1559d0 0x7f8aec0af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.946+0000 7f8aeb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aec1559d0 0x7f8aec0af870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43682/0 (socket says 172.21.15.37:43682) 2023-10-06T02:27:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.946+0000 7f8aeb7fe700 1 -- 172.21.15.37:0/2385423553 learned_addr learned my addr 172.21.15.37:0/2385423553 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.947+0000 7f8af08ca700 1 --2- 172.21.15.37:0/2385423553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8aec155da0 0x7f8aec0a9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.947+0000 7f8aebfff700 1 --2- 172.21.15.37:0/2385423553 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8aec069e10 0x7f8aec164dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.947+0000 7f8aeb7fe700 1 -- 172.21.15.37:0/2385423553 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8aec069e10 msgr2=0x7f8aec164dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.947+0000 7f8aeb7fe700 1 --2- 172.21.15.37:0/2385423553 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8aec069e10 0x7f8aec164dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.947+0000 7f8aeb7fe700 1 -- 172.21.15.37:0/2385423553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8aec155da0 msgr2=0x7f8aec0a9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.947+0000 7f8aeb7fe700 1 --2- 172.21.15.37:0/2385423553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8aec155da0 0x7f8aec0a9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.947+0000 7f8aeb7fe700 1 -- 172.21.15.37:0/2385423553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae0009420 con 0x7f8aec1559d0 2023-10-06T02:27:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.947+0000 7f8aeb7fe700 1 --2- 172.21.15.37:0/2385423553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aec1559d0 0x7f8aec0af870 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8ae000ec50 tx=0x7f8ae00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.947+0000 7f8ad3fff700 1 -- 172.21.15.37:0/2385423553 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae000c850 con 0x7f8aec1559d0 2023-10-06T02:27:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.947+0000 7f8ad3fff700 1 -- 172.21.15.37:0/2385423553 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae000c9b0 con 0x7f8aec1559d0 2023-10-06T02:27:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.947+0000 7f8af232d700 1 -- 172.21.15.37:0/2385423553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8adc00a5d0 con 0x7f8aec1559d0 2023-10-06T02:27:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.947+0000 7f8ad3fff700 1 -- 172.21.15.37:0/2385423553 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae000cd50 con 0x7f8aec1559d0 2023-10-06T02:27:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.947+0000 7f8af232d700 1 -- 172.21.15.37:0/2385423553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aec0b0c90 con 0x7f8aec1559d0 2023-10-06T02:27:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.948+0000 7f8af232d700 1 -- 172.21.15.37:0/2385423553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aec0c5870 con 0x7f8aec1559d0 2023-10-06T02:27:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.949+0000 7f8ad3fff700 1 -- 172.21.15.37:0/2385423553 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ae0013680 con 0x7f8aec1559d0 2023-10-06T02:27:41.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.949+0000 7f8ad3fff700 1 --2- 172.21.15.37:0/2385423553 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8ad8066f30 0x7f8ad80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:41.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.949+0000 7f8ad3fff700 1 -- 172.21.15.37:0/2385423553 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f8ae0084770 con 0x7f8aec1559d0 2023-10-06T02:27:41.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.950+0000 7f8aebfff700 1 --2- 172.21.15.37:0/2385423553 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8ad8066f30 0x7f8ad80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:41.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.950+0000 7f8aebfff700 1 --2- 172.21.15.37:0/2385423553 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8ad8066f30 0x7f8ad80693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00a370 tx=0x7f8adc01a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:41.954+0000 7f8ad3fff700 1 -- 172.21.15.37:0/2385423553 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ae0051a60 con 0x7f8aec1559d0 2023-10-06T02:27:42.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.153+0000 7f8af232d700 1 -- 172.21.15.37:0/2385423553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8aec070c30 con 0x7f8aec1559d0 2023-10-06T02:27:42.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.797+0000 7f8ad3fff700 1 -- 172.21.15.37:0/2385423553 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v70) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8ae0055080 con 0x7f8aec1559d0 2023-10-06T02:27:42.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.805+0000 7f8af232d700 1 -- 172.21.15.37:0/2385423553 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8ad8066f30 msgr2=0x7f8ad80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:42.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.805+0000 7f8af232d700 1 --2- 172.21.15.37:0/2385423553 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8ad8066f30 0x7f8ad80693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00a370 tx=0x7f8adc01a000 comp rx=0 tx=0).stop 2023-10-06T02:27:42.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.805+0000 7f8af232d700 1 -- 172.21.15.37:0/2385423553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aec1559d0 msgr2=0x7f8aec0af870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:42.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.805+0000 7f8af232d700 1 --2- 172.21.15.37:0/2385423553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aec1559d0 0x7f8aec0af870 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8ae000ec50 tx=0x7f8ae00091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.806+0000 7f8af232d700 1 -- 172.21.15.37:0/2385423553 shutdown_connections 2023-10-06T02:27:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.806+0000 7f8af232d700 1 --2- 172.21.15.37:0/2385423553 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8ad8066f30 0x7f8ad80693e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.806+0000 7f8af232d700 1 --2- 172.21.15.37:0/2385423553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8aec155da0 0x7f8aec0a9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.806+0000 7f8af232d700 1 --2- 172.21.15.37:0/2385423553 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8aec069e10 0x7f8aec164dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.806+0000 7f8af232d700 1 --2- 172.21.15.37:0/2385423553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aec1559d0 0x7f8aec0af870 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.806+0000 7f8af232d700 1 -- 172.21.15.37:0/2385423553 >> 172.21.15.37:0/2385423553 conn(0x7f8aec0cc100 msgr2=0x7f8aec150c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:42.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.807+0000 7f8af232d700 1 -- 172.21.15.37:0/2385423553 shutdown_connections 2023-10-06T02:27:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.809+0000 7f8af232d700 1 -- 172.21.15.37:0/2385423553 wait complete. 2023-10-06T02:27:42.814 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-10-06T02:27:42.827 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:27:42.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.951+0000 7f524252d700 1 Processor -- start 2023-10-06T02:27:42.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.951+0000 7f524252d700 1 -- start start 2023-10-06T02:27:42.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.952+0000 7f524252d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f523c142bf0 0x7f523c142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:42.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.952+0000 7f524252d700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f523c0c90f0 0x7f523c06e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:42.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.952+0000 7f524252d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523c06ddd0 con 0x7f523c06e260 2023-10-06T02:27:42.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.952+0000 7f524252d700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523c06d1c0 con 0x7f523c142bf0 2023-10-06T02:27:42.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.952+0000 7f524252d700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523c06d4a0 con 0x7f523c0c90f0 2023-10-06T02:27:42.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.952+0000 7f523bfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f523c142bf0 0x7f523c142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:42.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.952+0000 7f523b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f523c06e260 0x7f523c0c89e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47634/0 (socket says 172.21.15.37:47634) 2023-10-06T02:27:42.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.952+0000 7f523b7fe700 1 -- 172.21.15.37:0/3394095853 learned_addr learned my addr 172.21.15.37:0/3394095853 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:42.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.952+0000 7f5240aca700 1 --2- 172.21.15.37:0/3394095853 >> v2:172.21.15.191:3300/0 conn(0x7f523c0c90f0 0x7f523c06e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:42.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.953+0000 7f523bfff700 1 -- 172.21.15.37:0/3394095853 >> v2:172.21.15.191:3300/0 conn(0x7f523c0c90f0 msgr2=0x7f523c06e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:42.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.953+0000 7f523bfff700 1 --2- 172.21.15.37:0/3394095853 >> v2:172.21.15.191:3300/0 conn(0x7f523c0c90f0 0x7f523c06e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.953+0000 7f523bfff700 1 -- 172.21.15.37:0/3394095853 >> v1:172.21.15.37:6789/0 conn(0x7f523c06e260 legacy=0x7f523c0c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:42.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.953+0000 7f523bfff700 1 -- 172.21.15.37:0/3394095853 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c06d780 con 0x7f523c142bf0 2023-10-06T02:27:42.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.953+0000 7f523affd700 1 -- 172.21.15.37:0/3394095853 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817233179 0 0) 0x7f523c06ddd0 con 0x7f523c06e260 2023-10-06T02:27:42.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.953+0000 7f523bfff700 1 --2- 172.21.15.37:0/3394095853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523c142bf0 0x7f523c142fc0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f523c0cdb40 tx=0x7f522c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43116467c96947cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:42.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.953+0000 7f523affd700 1 -- 172.21.15.37:0/3394095853 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c00b6b0 con 0x7f523c142bf0 2023-10-06T02:27:42.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.953+0000 7f523affd700 1 -- 172.21.15.37:0/3394095853 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c00b810 con 0x7f523c142bf0 2023-10-06T02:27:42.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.953+0000 7f523affd700 1 -- 172.21.15.37:0/3394095853 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c00bbb0 con 0x7f523c142bf0 2023-10-06T02:27:42.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.953+0000 7f524252d700 1 -- 172.21.15.37:0/3394095853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523c142bf0 msgr2=0x7f523c142fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:42.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.953+0000 7f524252d700 1 --2- 172.21.15.37:0/3394095853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523c142bf0 0x7f523c142fc0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f523c0cdb40 tx=0x7f522c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.953+0000 7f524252d700 1 -- 172.21.15.37:0/3394095853 shutdown_connections 2023-10-06T02:27:42.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.953+0000 7f524252d700 1 --2- 172.21.15.37:0/3394095853 >> v2:172.21.15.191:3300/0 conn(0x7f523c0c90f0 0x7f523c06e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.953+0000 7f524252d700 1 --2- 172.21.15.37:0/3394095853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523c142bf0 0x7f523c142fc0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.953+0000 7f524252d700 1 -- 172.21.15.37:0/3394095853 >> 172.21.15.37:0/3394095853 conn(0x7f523c0ce3a0 msgr2=0x7f523c0ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:42.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.953+0000 7f524252d700 1 -- 172.21.15.37:0/3394095853 shutdown_connections 2023-10-06T02:27:42.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.953+0000 7f524252d700 1 -- 172.21.15.37:0/3394095853 wait complete. 2023-10-06T02:27:42.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.955+0000 7f524252d700 1 Processor -- start 2023-10-06T02:27:42.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.955+0000 7f524252d700 1 -- start start 2023-10-06T02:27:42.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.955+0000 7f524252d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523c06e260 0x7f523c0b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:42.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.955+0000 7f524252d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f523c0c90f0 0x7f523c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:42.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.955+0000 7f524252d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f523c142bf0 0x7f523c0c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:42.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.955+0000 7f524252d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c0ae8e0 con 0x7f523c06e260 2023-10-06T02:27:42.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.955+0000 7f524252d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c0b16e0 con 0x7f523c0c90f0 2023-10-06T02:27:42.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.955+0000 7f524252d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523c0b19c0 con 0x7f523c142bf0 2023-10-06T02:27:42.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.956+0000 7f523bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523c06e260 0x7f523c0b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:42.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.956+0000 7f523bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523c06e260 0x7f523c0b35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43700/0 (socket says 172.21.15.37:43700) 2023-10-06T02:27:42.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.956+0000 7f523bfff700 1 -- 172.21.15.37:0/4270092188 learned_addr learned my addr 172.21.15.37:0/4270092188 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:42.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.956+0000 7f523bfff700 1 -- 172.21.15.37:0/4270092188 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f523c142bf0 msgr2=0x7f523c0c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:42.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.956+0000 7f523bfff700 1 --2- 172.21.15.37:0/4270092188 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f523c142bf0 0x7f523c0c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.956+0000 7f523bfff700 1 -- 172.21.15.37:0/4270092188 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f523c0c90f0 msgr2=0x7f523c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:42.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.956+0000 7f523b7fe700 1 --2- 172.21.15.37:0/4270092188 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f523c0c90f0 0x7f523c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:42.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.956+0000 7f523bfff700 1 --2- 172.21.15.37:0/4270092188 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f523c0c90f0 0x7f523c15bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:42.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.956+0000 7f523bfff700 1 -- 172.21.15.37:0/4270092188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c009420 con 0x7f523c06e260 2023-10-06T02:27:42.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.956+0000 7f523bfff700 1 --2- 172.21.15.37:0/4270092188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523c06e260 0x7f523c0b35d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f523c067ad0 tx=0x7f522c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:42.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.956+0000 7f5223fff700 1 -- 172.21.15.37:0/4270092188 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c00b980 con 0x7f523c06e260 2023-10-06T02:27:42.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.956+0000 7f5223fff700 1 -- 172.21.15.37:0/4270092188 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c00bb20 con 0x7f523c06e260 2023-10-06T02:27:42.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.956+0000 7f524252d700 1 -- 172.21.15.37:0/4270092188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523c0b1ca0 con 0x7f523c06e260 2023-10-06T02:27:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.956+0000 7f5223fff700 1 -- 172.21.15.37:0/4270092188 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c026680 con 0x7f523c06e260 2023-10-06T02:27:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.956+0000 7f524252d700 1 -- 172.21.15.37:0/4270092188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523c0b3b10 con 0x7f523c06e260 2023-10-06T02:27:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.957+0000 7f524252d700 1 -- 172.21.15.37:0/4270092188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523c06a660 con 0x7f523c06e260 2023-10-06T02:27:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.958+0000 7f5223fff700 1 -- 172.21.15.37:0/4270092188 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f522c023030 con 0x7f523c06e260 2023-10-06T02:27:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.958+0000 7f5223fff700 1 --2- 172.21.15.37:0/4270092188 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5228066f60 0x7f5228069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.958+0000 7f5223fff700 1 -- 172.21.15.37:0/4270092188 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f522c086290 con 0x7f523c06e260 2023-10-06T02:27:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.958+0000 7f523b7fe700 1 --2- 172.21.15.37:0/4270092188 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5228066f60 0x7f5228069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:42.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.959+0000 7f523b7fe700 1 --2- 172.21.15.37:0/4270092188 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5228066f60 0x7f5228069410 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f523c0c3ee0 tx=0x7f5230009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:42.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:42.962+0000 7f5223fff700 1 -- 172.21.15.37:0/4270092188 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f522c053460 con 0x7f523c06e260 2023-10-06T02:27:43.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.198+0000 7f524252d700 1 -- 172.21.15.37:0/4270092188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f523c06da60 con 0x7f523c06e260 2023-10-06T02:27:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.801+0000 7f5223fff700 1 -- 172.21.15.37:0/4270092188 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v43) v1 ==== 174+0+0 (secure 0 0 0) 0x7f522c056a80 con 0x7f523c06e260 2023-10-06T02:27:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.805+0000 7f524252d700 1 -- 172.21.15.37:0/4270092188 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5228066f60 msgr2=0x7f5228069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.805+0000 7f524252d700 1 --2- 172.21.15.37:0/4270092188 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5228066f60 0x7f5228069410 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f523c0c3ee0 tx=0x7f5230009040 comp rx=0 tx=0).stop 2023-10-06T02:27:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.805+0000 7f524252d700 1 -- 172.21.15.37:0/4270092188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523c06e260 msgr2=0x7f523c0b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.805+0000 7f524252d700 1 --2- 172.21.15.37:0/4270092188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523c06e260 0x7f523c0b35d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f523c067ad0 tx=0x7f522c017000 comp rx=0 tx=0).stop 2023-10-06T02:27:43.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.819+0000 7f524252d700 1 -- 172.21.15.37:0/4270092188 shutdown_connections 2023-10-06T02:27:43.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.819+0000 7f524252d700 1 --2- 172.21.15.37:0/4270092188 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f523c142bf0 0x7f523c0c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:43.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.819+0000 7f524252d700 1 --2- 172.21.15.37:0/4270092188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523c06e260 0x7f523c0b35d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:43.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.819+0000 7f524252d700 1 --2- 172.21.15.37:0/4270092188 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5228066f60 0x7f5228069410 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:43.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.819+0000 7f524252d700 1 --2- 172.21.15.37:0/4270092188 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f523c0c90f0 0x7f523c15bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:43.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.819+0000 7f524252d700 1 -- 172.21.15.37:0/4270092188 >> 172.21.15.37:0/4270092188 conn(0x7f523c0ce3a0 msgr2=0x7f523c0c3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:43.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.820+0000 7f524252d700 1 -- 172.21.15.37:0/4270092188 shutdown_connections 2023-10-06T02:27:43.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.820+0000 7f524252d700 1 -- 172.21.15.37:0/4270092188 wait complete. 2023-10-06T02:27:43.832 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 11 and data pool 12 2023-10-06T02:27:43.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:27:43.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.963+0000 7f26af2d3700 1 Processor -- start 2023-10-06T02:27:43.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.963+0000 7f26af2d3700 1 -- start start 2023-10-06T02:27:43.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.964+0000 7f26af2d3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a81598c0 0x7f26a80ad480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:43.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.965+0000 7f26af2d3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f26a806b7a0 0x7f26a806c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:43.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.965+0000 7f26af2d3700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a806ca60 con 0x7f26a806c0b0 2023-10-06T02:27:43.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.965+0000 7f26af2d3700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a815d4d0 con 0x7f26a806b7a0 2023-10-06T02:27:43.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.965+0000 7f26af2d3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a815e330 con 0x7f26a81598c0 2023-10-06T02:27:43.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.965+0000 7f26ad06f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a81598c0 0x7f26a80ad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:43.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.965+0000 7f26ac86e700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f26a806c0b0 0x7f26a8159c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47636/0 (socket says 172.21.15.37:47636) 2023-10-06T02:27:43.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.965+0000 7f26ac86e700 1 -- 172.21.15.37:0/3466926694 learned_addr learned my addr 172.21.15.37:0/3466926694 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:43.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.965+0000 7f26ad870700 1 --2- 172.21.15.37:0/3466926694 >> v2:172.21.15.37:3300/0 conn(0x7f26a806b7a0 0x7f26a806c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:43.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.965+0000 7f26a7fff700 1 -- 172.21.15.37:0/3466926694 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974024000 0 0) 0x7f26a806ca60 con 0x7f26a806c0b0 2023-10-06T02:27:43.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.965+0000 7f26a7fff700 1 -- 172.21.15.37:0/3466926694 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2690003570 con 0x7f26a806c0b0 2023-10-06T02:27:43.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.965+0000 7f26ad870700 1 -- 172.21.15.37:0/3466926694 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a81598c0 msgr2=0x7f26a80ad480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:43.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.965+0000 7f26ad870700 1 --2- 172.21.15.37:0/3466926694 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a81598c0 0x7f26a80ad480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:43.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.965+0000 7f26ad870700 1 -- 172.21.15.37:0/3466926694 >> v1:172.21.15.37:6789/0 conn(0x7f26a806c0b0 legacy=0x7f26a8159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:43.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.965+0000 7f26ad870700 1 -- 172.21.15.37:0/3466926694 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a815d720 con 0x7f26a806b7a0 2023-10-06T02:27:43.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.965+0000 7f26ad870700 1 --2- 172.21.15.37:0/3466926694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26a806b7a0 0x7f26a806c520 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f2698009e60 tx=0x7f2698009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428633976732797b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:43.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.965+0000 7f26a7fff700 1 -- 172.21.15.37:0/3466926694 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269800e070 con 0x7f26a806b7a0 2023-10-06T02:27:43.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.965+0000 7f26a7fff700 1 -- 172.21.15.37:0/3466926694 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269800bab0 con 0x7f26a806b7a0 2023-10-06T02:27:43.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.965+0000 7f26a7fff700 1 -- 172.21.15.37:0/3466926694 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269800be70 con 0x7f26a806b7a0 2023-10-06T02:27:43.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.966+0000 7f26af2d3700 1 -- 172.21.15.37:0/3466926694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26a806b7a0 msgr2=0x7f26a806c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:43.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.966+0000 7f26af2d3700 1 --2- 172.21.15.37:0/3466926694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26a806b7a0 0x7f26a806c520 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f2698009e60 tx=0x7f2698009780 comp rx=0 tx=0).stop 2023-10-06T02:27:43.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.966+0000 7f26af2d3700 1 -- 172.21.15.37:0/3466926694 shutdown_connections 2023-10-06T02:27:43.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.966+0000 7f26af2d3700 1 --2- 172.21.15.37:0/3466926694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26a806b7a0 0x7f26a806c520 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:43.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.966+0000 7f26af2d3700 1 --2- 172.21.15.37:0/3466926694 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a81598c0 0x7f26a80ad480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:43.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.966+0000 7f26af2d3700 1 -- 172.21.15.37:0/3466926694 >> 172.21.15.37:0/3466926694 conn(0x7f26a806dc40 msgr2=0x7f26a8067660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:43.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.966+0000 7f26af2d3700 1 -- 172.21.15.37:0/3466926694 shutdown_connections 2023-10-06T02:27:43.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.966+0000 7f26af2d3700 1 -- 172.21.15.37:0/3466926694 wait complete. 2023-10-06T02:27:43.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.967+0000 7f26af2d3700 1 Processor -- start 2023-10-06T02:27:43.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.967+0000 7f26af2d3700 1 -- start start 2023-10-06T02:27:43.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.968+0000 7f26af2d3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26a806b7a0 0x7f26a813ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:43.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.968+0000 7f26af2d3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a806c0b0 0x7f26a80ac060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:43.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.968+0000 7f26af2d3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26a81598c0 0x7f26a80b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:43.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.968+0000 7f26af2d3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a81404e0 con 0x7f26a806b7a0 2023-10-06T02:27:43.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.968+0000 7f26af2d3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a80b04c0 con 0x7f26a81598c0 2023-10-06T02:27:43.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.968+0000 7f26af2d3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a80b07a0 con 0x7f26a806c0b0 2023-10-06T02:27:43.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.968+0000 7f26ad06f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26a806b7a0 0x7f26a813ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:43.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.968+0000 7f26ad06f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26a806b7a0 0x7f26a813ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43718/0 (socket says 172.21.15.37:43718) 2023-10-06T02:27:43.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.968+0000 7f26ad06f700 1 -- 172.21.15.37:0/1195603392 learned_addr learned my addr 172.21.15.37:0/1195603392 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:43.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.968+0000 7f26ad870700 1 --2- 172.21.15.37:0/1195603392 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26a81598c0 0x7f26a80b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:43.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.968+0000 7f26ac86e700 1 --2- 172.21.15.37:0/1195603392 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a806c0b0 0x7f26a80ac060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:43.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.969+0000 7f26ad06f700 1 -- 172.21.15.37:0/1195603392 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a806c0b0 msgr2=0x7f26a80ac060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:43.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.969+0000 7f26ad06f700 1 --2- 172.21.15.37:0/1195603392 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a806c0b0 0x7f26a80ac060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:43.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.969+0000 7f26ad06f700 1 -- 172.21.15.37:0/1195603392 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26a81598c0 msgr2=0x7f26a80b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:43.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.969+0000 7f26ad06f700 1 --2- 172.21.15.37:0/1195603392 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26a81598c0 0x7f26a80b1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:43.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.969+0000 7f26ad06f700 1 -- 172.21.15.37:0/1195603392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2698009a20 con 0x7f26a806b7a0 2023-10-06T02:27:43.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.969+0000 7f26ad06f700 1 --2- 172.21.15.37:0/1195603392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26a806b7a0 0x7f26a813ffa0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f26a000ec80 tx=0x7f26a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:43.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.969+0000 7f26a57fa700 1 -- 172.21.15.37:0/1195603392 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a000c850 con 0x7f26a806b7a0 2023-10-06T02:27:43.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.969+0000 7f26a57fa700 1 -- 172.21.15.37:0/1195603392 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a000c9b0 con 0x7f26a806b7a0 2023-10-06T02:27:43.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.969+0000 7f26a57fa700 1 -- 172.21.15.37:0/1195603392 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a000cd50 con 0x7f26a806b7a0 2023-10-06T02:27:43.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.969+0000 7f26af2d3700 1 -- 172.21.15.37:0/1195603392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a80b0a80 con 0x7f26a806b7a0 2023-10-06T02:27:43.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.969+0000 7f26af2d3700 1 -- 172.21.15.37:0/1195603392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a80b1040 con 0x7f26a806b7a0 2023-10-06T02:27:43.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.970+0000 7f26af2d3700 1 -- 172.21.15.37:0/1195603392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a815ae10 con 0x7f26a806b7a0 2023-10-06T02:27:43.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.970+0000 7f26a57fa700 1 -- 172.21.15.37:0/1195603392 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26a0013680 con 0x7f26a806b7a0 2023-10-06T02:27:43.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.971+0000 7f26a57fa700 1 --2- 172.21.15.37:0/1195603392 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2694066f30 0x7f26940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:43.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.971+0000 7f26a57fa700 1 -- 172.21.15.37:0/1195603392 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f26a00848c0 con 0x7f26a806b7a0 2023-10-06T02:27:43.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.971+0000 7f26ac86e700 1 --2- 172.21.15.37:0/1195603392 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2694066f30 0x7f26940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:43.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.971+0000 7f26ac86e700 1 --2- 172.21.15.37:0/1195603392 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2694066f30 0x7f26940693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f26a80b2fe0 tx=0x7f269c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:43.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:43.975+0000 7f26a57fa700 1 -- 172.21.15.37:0/1195603392 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26a00519d0 con 0x7f26a806b7a0 2023-10-06T02:27:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.170+0000 7f26af2d3700 1 -- 172.21.15.37:0/1195603392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26a8070c30 con 0x7f26a806b7a0 2023-10-06T02:27:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.171+0000 7f26a57fa700 1 -- 172.21.15.37:0/1195603392 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16882 (secure 0 0 0) 0x7f26a0054ff0 con 0x7f26a806b7a0 2023-10-06T02:27:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:44.173 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":71,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:27:43.200519+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:27:40.951347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T02:27:42.184642+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:27:44.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.173+0000 7f26af2d3700 1 -- 172.21.15.37:0/1195603392 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2694066f30 msgr2=0x7f26940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:44.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.173+0000 7f26af2d3700 1 --2- 172.21.15.37:0/1195603392 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2694066f30 0x7f26940693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f26a80b2fe0 tx=0x7f269c009040 comp rx=0 tx=0).stop 2023-10-06T02:27:44.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.173+0000 7f26af2d3700 1 -- 172.21.15.37:0/1195603392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26a806b7a0 msgr2=0x7f26a813ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:44.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.173+0000 7f26af2d3700 1 --2- 172.21.15.37:0/1195603392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26a806b7a0 0x7f26a813ffa0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f26a000ec80 tx=0x7f26a00091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:44.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.174+0000 7f26af2d3700 1 -- 172.21.15.37:0/1195603392 shutdown_connections 2023-10-06T02:27:44.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.174+0000 7f26af2d3700 1 --2- 172.21.15.37:0/1195603392 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2694066f30 0x7f26940693e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:44.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.174+0000 7f26af2d3700 1 --2- 172.21.15.37:0/1195603392 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26a81598c0 0x7f26a80b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:44.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.174+0000 7f26af2d3700 1 --2- 172.21.15.37:0/1195603392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26a806b7a0 0x7f26a813ffa0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:44.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.174+0000 7f26af2d3700 1 --2- 172.21.15.37:0/1195603392 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a806c0b0 0x7f26a80ac060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:44.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.174+0000 7f26af2d3700 1 -- 172.21.15.37:0/1195603392 >> 172.21.15.37:0/1195603392 conn(0x7f26a806dc40 msgr2=0x7f26a8152d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:44.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.174+0000 7f26af2d3700 1 -- 172.21.15.37:0/1195603392 shutdown_connections 2023-10-06T02:27:44.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.174+0000 7f26af2d3700 1 -- 172.21.15.37:0/1195603392 wait complete. 2023-10-06T02:27:44.187 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:27:44.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.304+0000 7f1272938700 1 Processor -- start 2023-10-06T02:27:44.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.304+0000 7f1272938700 1 -- start start 2023-10-06T02:27:44.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.305+0000 7f1272938700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f126c1596d0 0x7f126c0b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:44.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.305+0000 7f1272938700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f126c159aa0 0x7f126c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:44.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.305+0000 7f1272938700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126c0c5300 con 0x7f126c0b3840 2023-10-06T02:27:44.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.305+0000 7f1272938700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c0c6160 con 0x7f126c1596d0 2023-10-06T02:27:44.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.305+0000 7f1272938700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c0c5550 con 0x7f126c159aa0 2023-10-06T02:27:44.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.305+0000 7f126bfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f126c1596d0 0x7f126c0b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:44.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.305+0000 7f126b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f126c0b3840 0x7f126c0c65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47652/0 (socket says 172.21.15.37:47652) 2023-10-06T02:27:44.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.305+0000 7f126b7fe700 1 -- 172.21.15.37:0/3067674509 learned_addr learned my addr 172.21.15.37:0/3067674509 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:44.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.306+0000 7f1270ed5700 1 --2- 172.21.15.37:0/3067674509 >> v2:172.21.15.191:3300/0 conn(0x7f126c159aa0 0x7f126c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:44.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.306+0000 7f126bfff700 1 -- 172.21.15.37:0/3067674509 >> v2:172.21.15.191:3300/0 conn(0x7f126c159aa0 msgr2=0x7f126c0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:44.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.306+0000 7f126bfff700 1 --2- 172.21.15.37:0/3067674509 >> v2:172.21.15.191:3300/0 conn(0x7f126c159aa0 0x7f126c0cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:44.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.306+0000 7f126bfff700 1 -- 172.21.15.37:0/3067674509 >> v1:172.21.15.37:6789/0 conn(0x7f126c0b3840 legacy=0x7f126c0c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:44.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.306+0000 7f126bfff700 1 -- 172.21.15.37:0/3067674509 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c0c5830 con 0x7f126c1596d0 2023-10-06T02:27:44.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.306+0000 7f126affd700 1 -- 172.21.15.37:0/3067674509 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307832319 0 0) 0x7f126c0c5300 con 0x7f126c0b3840 2023-10-06T02:27:44.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.306+0000 7f1270ed5700 1 --2- 172.21.15.37:0/3067674509 >> v2:172.21.15.191:3300/0 conn(0x7f126c159aa0 0x7f126c0cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:44.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.306+0000 7f126bfff700 1 --2- 172.21.15.37:0/3067674509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f126c1596d0 0x7f126c0b3300 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f126c070c30 tx=0x7f125c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5767def66b1ff702 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:44.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.306+0000 7f126affd700 1 -- 172.21.15.37:0/3067674509 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c00b6b0 con 0x7f126c1596d0 2023-10-06T02:27:44.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.306+0000 7f126affd700 1 -- 172.21.15.37:0/3067674509 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c00b810 con 0x7f126c1596d0 2023-10-06T02:27:44.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.306+0000 7f126affd700 1 -- 172.21.15.37:0/3067674509 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c00bbb0 con 0x7f126c1596d0 2023-10-06T02:27:44.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.307+0000 7f1272938700 1 -- 172.21.15.37:0/3067674509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f126c1596d0 msgr2=0x7f126c0b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:44.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.307+0000 7f1272938700 1 --2- 172.21.15.37:0/3067674509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f126c1596d0 0x7f126c0b3300 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f126c070c30 tx=0x7f125c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:44.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.307+0000 7f1272938700 1 -- 172.21.15.37:0/3067674509 shutdown_connections 2023-10-06T02:27:44.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.307+0000 7f1272938700 1 --2- 172.21.15.37:0/3067674509 >> v2:172.21.15.191:3300/0 conn(0x7f126c159aa0 0x7f126c0cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:44.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.307+0000 7f1272938700 1 --2- 172.21.15.37:0/3067674509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f126c1596d0 0x7f126c0b3300 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:44.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.307+0000 7f1272938700 1 -- 172.21.15.37:0/3067674509 >> 172.21.15.37:0/3067674509 conn(0x7f126c06c890 msgr2=0x7f126c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.307+0000 7f1272938700 1 -- 172.21.15.37:0/3067674509 shutdown_connections 2023-10-06T02:27:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.307+0000 7f1272938700 1 -- 172.21.15.37:0/3067674509 wait complete. 2023-10-06T02:27:44.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.308+0000 7f1272938700 1 Processor -- start 2023-10-06T02:27:44.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.308+0000 7f1272938700 1 -- start start 2023-10-06T02:27:44.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f1272938700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f126c0b3840 0x7f126c099fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:44.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f1272938700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f126c1596d0 0x7f126c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:44.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f1272938700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f126c159aa0 0x7f126c0b4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:44.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f1272938700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c1544f0 con 0x7f126c159aa0 2023-10-06T02:27:44.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f1272938700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c09bfc0 con 0x7f126c0b3840 2023-10-06T02:27:44.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f1272938700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c09c2a0 con 0x7f126c1596d0 2023-10-06T02:27:44.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f1270ed5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f126c159aa0 0x7f126c0b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:44.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f1270ed5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f126c159aa0 0x7f126c0b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43736/0 (socket says 172.21.15.37:43736) 2023-10-06T02:27:44.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f1270ed5700 1 -- 172.21.15.37:0/3640353059 learned_addr learned my addr 172.21.15.37:0/3640353059 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:44.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f126bfff700 1 --2- 172.21.15.37:0/3640353059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f126c0b3840 0x7f126c099fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:44.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f126b7fe700 1 --2- 172.21.15.37:0/3640353059 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f126c1596d0 0x7f126c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:44.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f1270ed5700 1 -- 172.21.15.37:0/3640353059 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f126c1596d0 msgr2=0x7f126c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:44.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f1270ed5700 1 --2- 172.21.15.37:0/3640353059 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f126c1596d0 0x7f126c0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:44.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f1270ed5700 1 -- 172.21.15.37:0/3640353059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f126c0b3840 msgr2=0x7f126c099fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:44.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f1270ed5700 1 --2- 172.21.15.37:0/3640353059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f126c0b3840 0x7f126c099fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:44.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f1270ed5700 1 -- 172.21.15.37:0/3640353059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c009420 con 0x7f126c159aa0 2023-10-06T02:27:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f126bfff700 1 --2- 172.21.15.37:0/3640353059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f126c0b3840 0x7f126c099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f1270ed5700 1 --2- 172.21.15.37:0/3640353059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f126c159aa0 0x7f126c0b4170 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f126400d150 tx=0x7f1264009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f1263fff700 1 -- 172.21.15.37:0/3640353059 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126400dd90 con 0x7f126c159aa0 2023-10-06T02:27:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f1263fff700 1 -- 172.21.15.37:0/3640353059 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126400f040 con 0x7f126c159aa0 2023-10-06T02:27:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f1263fff700 1 -- 172.21.15.37:0/3640353059 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1264015650 con 0x7f126c159aa0 2023-10-06T02:27:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f1272938700 1 -- 172.21.15.37:0/3640353059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126c09c580 con 0x7f126c159aa0 2023-10-06T02:27:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.309+0000 7f1272938700 1 -- 172.21.15.37:0/3640353059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c09cb40 con 0x7f126c159aa0 2023-10-06T02:27:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.310+0000 7f1272938700 1 -- 172.21.15.37:0/3640353059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c15a2c0 con 0x7f126c159aa0 2023-10-06T02:27:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.311+0000 7f1263fff700 1 -- 172.21.15.37:0/3640353059 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1264015a40 con 0x7f126c159aa0 2023-10-06T02:27:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.311+0000 7f1263fff700 1 --2- 172.21.15.37:0/3640353059 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f124c066f30 0x7f124c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.311+0000 7f1263fff700 1 -- 172.21.15.37:0/3640353059 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1264085070 con 0x7f126c159aa0 2023-10-06T02:27:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.311+0000 7f126bfff700 1 --2- 172.21.15.37:0/3640353059 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f124c066f30 0x7f124c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.312+0000 7f126bfff700 1 --2- 172.21.15.37:0/3640353059 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f124c066f30 0x7f124c0693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f125c003080 tx=0x7f125c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.316+0000 7f1263fff700 1 -- 172.21.15.37:0/3640353059 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12640520e0 con 0x7f126c159aa0 2023-10-06T02:27:44.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.509+0000 7f1272938700 1 -- 172.21.15.37:0/3640353059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f126c09cd60 con 0x7f126c159aa0 2023-10-06T02:27:44.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.510+0000 7f1263fff700 1 -- 172.21.15.37:0/3640353059 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16882 (secure 0 0 0) 0x7f1264055700 con 0x7f126c159aa0 2023-10-06T02:27:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:44.511 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":71,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:27:43.200519+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:27:40.951347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T02:27:42.184642+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:27:44.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.512+0000 7f1272938700 1 -- 172.21.15.37:0/3640353059 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f124c066f30 msgr2=0x7f124c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:44.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.512+0000 7f1272938700 1 --2- 172.21.15.37:0/3640353059 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f124c066f30 0x7f124c0693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f125c003080 tx=0x7f125c017000 comp rx=0 tx=0).stop 2023-10-06T02:27:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.512+0000 7f1272938700 1 -- 172.21.15.37:0/3640353059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f126c159aa0 msgr2=0x7f126c0b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.512+0000 7f1272938700 1 --2- 172.21.15.37:0/3640353059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f126c159aa0 0x7f126c0b4170 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f126400d150 tx=0x7f1264009a50 comp rx=0 tx=0).stop 2023-10-06T02:27:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.512+0000 7f1272938700 1 -- 172.21.15.37:0/3640353059 shutdown_connections 2023-10-06T02:27:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.512+0000 7f1272938700 1 --2- 172.21.15.37:0/3640353059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f126c159aa0 0x7f126c0b4170 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.512+0000 7f1272938700 1 --2- 172.21.15.37:0/3640353059 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f124c066f30 0x7f124c0693e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.512+0000 7f1272938700 1 --2- 172.21.15.37:0/3640353059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f126c0b3840 0x7f126c099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.512+0000 7f1272938700 1 --2- 172.21.15.37:0/3640353059 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f126c1596d0 0x7f126c0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.512+0000 7f1272938700 1 -- 172.21.15.37:0/3640353059 >> 172.21.15.37:0/3640353059 conn(0x7f126c06c890 msgr2=0x7f126c0d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.512+0000 7f1272938700 1 -- 172.21.15.37:0/3640353059 shutdown_connections 2023-10-06T02:27:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.512+0000 7f1272938700 1 -- 172.21.15.37:0/3640353059 wait complete. 2023-10-06T02:27:44.526 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:27:44.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.646+0000 7f59133c4700 1 Processor -- start 2023-10-06T02:27:44.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.646+0000 7f59133c4700 1 -- start start 2023-10-06T02:27:44.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.647+0000 7f59133c4700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f590c0b29d0 0x7f590c0ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:44.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.647+0000 7f59133c4700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f590c0ccdd0 0x7f590c163250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:44.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.647+0000 7f59133c4700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f590c0b2da0 con 0x7f590c0cb170 2023-10-06T02:27:44.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.647+0000 7f59133c4700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590c099bd0 con 0x7f590c0ccdd0 2023-10-06T02:27:44.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.647+0000 7f59133c4700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590c159a70 con 0x7f590c0b29d0 2023-10-06T02:27:44.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.647+0000 7f5912bc3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f590c0ccdd0 0x7f590c163250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:44.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.647+0000 7f5912bc3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f590c0ccdd0 0x7f590c163250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43740/0 (socket says 172.21.15.37:43740) 2023-10-06T02:27:44.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.647+0000 7f5912bc3700 1 -- 172.21.15.37:0/1250304275 learned_addr learned my addr 172.21.15.37:0/1250304275 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:44.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.647+0000 7f59123c2700 1 --2- 172.21.15.37:0/1250304275 >> v2:172.21.15.191:3300/0 conn(0x7f590c0b29d0 0x7f590c0ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:44.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.647+0000 7f5912bc3700 1 -- 172.21.15.37:0/1250304275 >> v2:172.21.15.191:3300/0 conn(0x7f590c0b29d0 msgr2=0x7f590c0ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:44.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.647+0000 7f5912bc3700 1 --2- 172.21.15.37:0/1250304275 >> v2:172.21.15.191:3300/0 conn(0x7f590c0b29d0 0x7f590c0ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:44.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.647+0000 7f5912bc3700 1 -- 172.21.15.37:0/1250304275 >> v1:172.21.15.191:6789/0 conn(0x7f590c0cb170 legacy=0x7f590c0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:44.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.647+0000 7f5912bc3700 1 -- 172.21.15.37:0/1250304275 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c0cb5e0 con 0x7f590c0ccdd0 2023-10-06T02:27:44.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.648+0000 7f5912bc3700 1 --2- 172.21.15.37:0/1250304275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f590c0ccdd0 0x7f590c163250 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f590c063e30 tx=0x7f58fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b393c13f049bde9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:44.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.648+0000 7f59113c0700 1 -- 172.21.15.37:0/1250304275 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc00b860 con 0x7f590c0ccdd0 2023-10-06T02:27:44.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.648+0000 7f59113c0700 1 -- 172.21.15.37:0/1250304275 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58fc00b9c0 con 0x7f590c0ccdd0 2023-10-06T02:27:44.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.648+0000 7f59113c0700 1 -- 172.21.15.37:0/1250304275 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc00bd60 con 0x7f590c0ccdd0 2023-10-06T02:27:44.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.648+0000 7f59133c4700 1 -- 172.21.15.37:0/1250304275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f590c0ccdd0 msgr2=0x7f590c163250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:44.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.648+0000 7f59133c4700 1 --2- 172.21.15.37:0/1250304275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f590c0ccdd0 0x7f590c163250 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f590c063e30 tx=0x7f58fc009250 comp rx=0 tx=0).stop 2023-10-06T02:27:44.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.648+0000 7f59133c4700 1 -- 172.21.15.37:0/1250304275 shutdown_connections 2023-10-06T02:27:44.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.648+0000 7f59133c4700 1 --2- 172.21.15.37:0/1250304275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f590c0ccdd0 0x7f590c163250 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:44.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.648+0000 7f59133c4700 1 --2- 172.21.15.37:0/1250304275 >> v2:172.21.15.191:3300/0 conn(0x7f590c0b29d0 0x7f590c0ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:44.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.648+0000 7f59133c4700 1 -- 172.21.15.37:0/1250304275 >> 172.21.15.37:0/1250304275 conn(0x7f590c099610 msgr2=0x7f590c06c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:44.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.648+0000 7f59133c4700 1 -- 172.21.15.37:0/1250304275 shutdown_connections 2023-10-06T02:27:44.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.648+0000 7f59133c4700 1 -- 172.21.15.37:0/1250304275 wait complete. 2023-10-06T02:27:44.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.649+0000 7f59133c4700 1 Processor -- start 2023-10-06T02:27:44.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.649+0000 7f59133c4700 1 -- start start 2023-10-06T02:27:44.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.650+0000 7f59133c4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f590c0b29d0 0x7f590c169860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:44.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.650+0000 7f59133c4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f590c0cb170 0x7f590c156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:44.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.650+0000 7f59133c4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f590c0ccdd0 0x7f590c0b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:44.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.650+0000 7f59133c4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c0b6080 con 0x7f590c0ccdd0 2023-10-06T02:27:44.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.650+0000 7f59133c4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c0c9150 con 0x7f590c0b29d0 2023-10-06T02:27:44.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.650+0000 7f59133c4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590c169da0 con 0x7f590c0cb170 2023-10-06T02:27:44.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.650+0000 7f5912bc3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f590c0ccdd0 0x7f590c0b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:44.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.650+0000 7f5912bc3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f590c0ccdd0 0x7f590c0b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43750/0 (socket says 172.21.15.37:43750) 2023-10-06T02:27:44.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.650+0000 7f5912bc3700 1 -- 172.21.15.37:0/4288845271 learned_addr learned my addr 172.21.15.37:0/4288845271 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:44.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.650+0000 7f59123c2700 1 --2- 172.21.15.37:0/4288845271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f590c0b29d0 0x7f590c169860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:44.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.650+0000 7f5911bc1700 1 --2- 172.21.15.37:0/4288845271 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f590c0cb170 0x7f590c156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:44.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.650+0000 7f5912bc3700 1 -- 172.21.15.37:0/4288845271 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f590c0cb170 msgr2=0x7f590c156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:44.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.650+0000 7f5912bc3700 1 --2- 172.21.15.37:0/4288845271 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f590c0cb170 0x7f590c156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:44.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.650+0000 7f5912bc3700 1 -- 172.21.15.37:0/4288845271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f590c0b29d0 msgr2=0x7f590c169860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:44.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.650+0000 7f5912bc3700 1 --2- 172.21.15.37:0/4288845271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f590c0b29d0 0x7f590c169860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:44.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.651+0000 7f5912bc3700 1 -- 172.21.15.37:0/4288845271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc0094f0 con 0x7f590c0ccdd0 2023-10-06T02:27:44.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.651+0000 7f5911bc1700 1 --2- 172.21.15.37:0/4288845271 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f590c0cb170 0x7f590c156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:44.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.651+0000 7f5912bc3700 1 --2- 172.21.15.37:0/4288845271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f590c0ccdd0 0x7f590c0b4060 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009290 tx=0x7f58fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:44.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.651+0000 7f590a7fc700 1 -- 172.21.15.37:0/4288845271 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc01a700 con 0x7f590c0ccdd0 2023-10-06T02:27:44.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.651+0000 7f590a7fc700 1 -- 172.21.15.37:0/4288845271 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58fc01a860 con 0x7f590c0ccdd0 2023-10-06T02:27:44.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.651+0000 7f590a7fc700 1 -- 172.21.15.37:0/4288845271 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc01ac20 con 0x7f590c0ccdd0 2023-10-06T02:27:44.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.651+0000 7f59133c4700 1 -- 172.21.15.37:0/4288845271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590c0b5da0 con 0x7f590c0ccdd0 2023-10-06T02:27:44.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.651+0000 7f59133c4700 1 -- 172.21.15.37:0/4288845271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590c0c8de0 con 0x7f590c0ccdd0 2023-10-06T02:27:44.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.652+0000 7f59133c4700 1 -- 172.21.15.37:0/4288845271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590c0c8960 con 0x7f590c0ccdd0 2023-10-06T02:27:44.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.652+0000 7f590a7fc700 1 -- 172.21.15.37:0/4288845271 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f58fc02d440 con 0x7f590c0ccdd0 2023-10-06T02:27:44.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.653+0000 7f590a7fc700 1 --2- 172.21.15.37:0/4288845271 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f58f8066f30 0x7f58f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:44.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.653+0000 7f590a7fc700 1 -- 172.21.15.37:0/4288845271 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f58fc0864e0 con 0x7f590c0ccdd0 2023-10-06T02:27:44.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.653+0000 7f59123c2700 1 --2- 172.21.15.37:0/4288845271 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f58f8066f30 0x7f58f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:44.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.653+0000 7f59123c2700 1 --2- 172.21.15.37:0/4288845271 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f58f8066f30 0x7f58f80693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f590c158a20 tx=0x7f5904009720 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:44.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.657+0000 7f590a7fc700 1 -- 172.21.15.37:0/4288845271 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f590c0c8960 con 0x7f590c0ccdd0 2023-10-06T02:27:44.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:44.898+0000 7f59133c4700 1 -- 172.21.15.37:0/4288845271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f590c0c8960 con 0x7f590c0ccdd0 2023-10-06T02:27:45.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.838+0000 7f590a7fc700 1 -- 172.21.15.37:0/4288845271 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v46) v1 ==== 118+0+0 (secure 0 0 0) 0x7f590c0c8960 con 0x7f590c0ccdd0 2023-10-06T02:27:45.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.840+0000 7f59133c4700 1 -- 172.21.15.37:0/4288845271 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f58f8066f30 msgr2=0x7f58f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:45.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.840+0000 7f59133c4700 1 --2- 172.21.15.37:0/4288845271 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f58f8066f30 0x7f58f80693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f590c158a20 tx=0x7f5904009720 comp rx=0 tx=0).stop 2023-10-06T02:27:45.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.840+0000 7f59133c4700 1 -- 172.21.15.37:0/4288845271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f590c0ccdd0 msgr2=0x7f590c0b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:45.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.840+0000 7f59133c4700 1 --2- 172.21.15.37:0/4288845271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f590c0ccdd0 0x7f590c0b4060 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009290 tx=0x7f58fc017000 comp rx=0 tx=0).stop 2023-10-06T02:27:45.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.840+0000 7f59133c4700 1 -- 172.21.15.37:0/4288845271 shutdown_connections 2023-10-06T02:27:45.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.840+0000 7f59133c4700 1 --2- 172.21.15.37:0/4288845271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f590c0ccdd0 0x7f590c0b4060 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:45.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.840+0000 7f59133c4700 1 --2- 172.21.15.37:0/4288845271 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f58f8066f30 0x7f58f80693e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:45.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.840+0000 7f59133c4700 1 --2- 172.21.15.37:0/4288845271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f590c0b29d0 0x7f590c169860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:45.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.840+0000 7f59133c4700 1 --2- 172.21.15.37:0/4288845271 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f590c0cb170 0x7f590c156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:45.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.840+0000 7f59133c4700 1 -- 172.21.15.37:0/4288845271 >> 172.21.15.37:0/4288845271 conn(0x7f590c099610 msgr2=0x7f590c158d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:45.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.840+0000 7f59133c4700 1 -- 172.21.15.37:0/4288845271 shutdown_connections 2023-10-06T02:27:45.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.841+0000 7f59133c4700 1 -- 172.21.15.37:0/4288845271 wait complete. 2023-10-06T02:27:45.857 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:27:45.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.985+0000 7f325a9d6700 1 Processor -- start 2023-10-06T02:27:45.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.985+0000 7f325a9d6700 1 -- start start 2023-10-06T02:27:45.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f325a9d6700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f32540c78a0 0x7f3254159870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:45.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f325a9d6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32540cb540 0x7f32540c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f325a9d6700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32540c8940 con 0x7f32541594a0 2023-10-06T02:27:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f325a9d6700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32540c7d30 con 0x7f32540c78a0 2023-10-06T02:27:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f325a9d6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32540c8010 con 0x7f32540cb540 2023-10-06T02:27:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f3253fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f32541594a0 0x7f32540cae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47780/0 (socket says 172.21.15.37:47780) 2023-10-06T02:27:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f3253fff700 1 -- 172.21.15.37:0/1213585178 learned_addr learned my addr 172.21.15.37:0/1213585178 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f3252ffd700 1 -- 172.21.15.37:0/1213585178 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685648359 0 0) 0x7f32540c8940 con 0x7f32541594a0 2023-10-06T02:27:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f3252ffd700 1 -- 172.21.15.37:0/1213585178 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f323c003570 con 0x7f32541594a0 2023-10-06T02:27:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f3258f73700 1 --2- 172.21.15.37:0/1213585178 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32540cb540 0x7f32540c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f32537fe700 1 --2- 172.21.15.37:0/1213585178 >> v2:172.21.15.191:3300/0 conn(0x7f32540c78a0 0x7f3254159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f3252ffd700 1 -- 172.21.15.37:0/1213585178 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3421211396 0 0) 0x7f323c003570 con 0x7f32541594a0 2023-10-06T02:27:45.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f3252ffd700 1 -- 172.21.15.37:0/1213585178 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32540cb540 msgr2=0x7f32540c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f3252ffd700 1 --2- 172.21.15.37:0/1213585178 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32540cb540 0x7f32540c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f3252ffd700 1 -- 172.21.15.37:0/1213585178 >> v2:172.21.15.191:3300/0 conn(0x7f32540c78a0 msgr2=0x7f3254159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f3252ffd700 1 --2- 172.21.15.37:0/1213585178 >> v2:172.21.15.191:3300/0 conn(0x7f32540c78a0 0x7f3254159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f3252ffd700 1 -- 172.21.15.37:0/1213585178 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32540c82f0 con 0x7f32541594a0 2023-10-06T02:27:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f3252ffd700 1 -- 172.21.15.37:0/1213585178 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f3244001470 con 0x7f32541594a0 2023-10-06T02:27:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f3258f73700 1 --2- 172.21.15.37:0/1213585178 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32540cb540 0x7f32540c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f32537fe700 1 --2- 172.21.15.37:0/1213585178 >> v2:172.21.15.191:3300/0 conn(0x7f32540c78a0 0x7f3254159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f3252ffd700 1 -- 172.21.15.37:0/1213585178 >> v1:172.21.15.37:6789/0 conn(0x7f32541594a0 legacy=0x7f32540cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f3252ffd700 1 --2- 172.21.15.37:0/1213585178 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32540cb540 0x7f323c003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f3252ffd700 1 --2- 172.21.15.37:0/1213585178 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f323c004120 0x7f323c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:45.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f3252ffd700 1 --2- 172.21.15.37:0/1213585178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f323c004d50 0x7f323c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f3252ffd700 1 -- 172.21.15.37:0/1213585178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32540c7d30 con 0x7f323c004d50 2023-10-06T02:27:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f3252ffd700 1 -- 172.21.15.37:0/1213585178 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32540c8010 con 0x7f323c004120 2023-10-06T02:27:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.986+0000 7f3252ffd700 1 -- 172.21.15.37:0/1213585178 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c00bc70 con 0x7f32540cb540 2023-10-06T02:27:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.987+0000 7f3258f73700 1 --2- 172.21.15.37:0/1213585178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f323c004d50 0x7f323c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.987+0000 7f3253fff700 1 --2- 172.21.15.37:0/1213585178 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32540cb540 0x7f323c003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.987+0000 7f32537fe700 1 --2- 172.21.15.37:0/1213585178 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f323c004120 0x7f323c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.987+0000 7f3258f73700 1 -- 172.21.15.37:0/1213585178 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32540cb540 msgr2=0x7f323c003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.987+0000 7f3258f73700 1 --2- 172.21.15.37:0/1213585178 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32540cb540 0x7f323c003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.987+0000 7f3258f73700 1 -- 172.21.15.37:0/1213585178 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f323c004120 msgr2=0x7f323c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.987+0000 7f3258f73700 1 --2- 172.21.15.37:0/1213585178 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f323c004120 0x7f323c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.987+0000 7f3258f73700 1 -- 172.21.15.37:0/1213585178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c003570 con 0x7f323c004d50 2023-10-06T02:27:45.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.987+0000 7f3258f73700 1 --2- 172.21.15.37:0/1213585178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f323c004d50 0x7f323c0051c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f324c007580 tx=0x7f324c0097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b13e0705f99c5a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:45.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.987+0000 7f3252ffd700 1 -- 172.21.15.37:0/1213585178 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c009ae0 con 0x7f323c004d50 2023-10-06T02:27:45.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.987+0000 7f3252ffd700 1 -- 172.21.15.37:0/1213585178 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c007dd0 con 0x7f323c004d50 2023-10-06T02:27:45.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.987+0000 7f3252ffd700 1 -- 172.21.15.37:0/1213585178 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c014630 con 0x7f323c004d50 2023-10-06T02:27:45.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.988+0000 7f325a9d6700 1 -- 172.21.15.37:0/1213585178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f323c004d50 msgr2=0x7f323c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:45.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.988+0000 7f325a9d6700 1 --2- 172.21.15.37:0/1213585178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f323c004d50 0x7f323c0051c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f324c007580 tx=0x7f324c0097d0 comp rx=0 tx=0).stop 2023-10-06T02:27:45.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.988+0000 7f3258f73700 1 -- 172.21.15.37:0/1213585178 reap_dead start 2023-10-06T02:27:45.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.988+0000 7f325a9d6700 1 -- 172.21.15.37:0/1213585178 shutdown_connections 2023-10-06T02:27:45.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.988+0000 7f325a9d6700 1 -- 172.21.15.37:0/1213585178 >> 172.21.15.37:0/1213585178 conn(0x7f32540680f0 msgr2=0x7f325406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:45.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.988+0000 7f325a9d6700 1 -- 172.21.15.37:0/1213585178 shutdown_connections 2023-10-06T02:27:45.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.988+0000 7f325a9d6700 1 -- 172.21.15.37:0/1213585178 wait complete. 2023-10-06T02:27:45.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.989+0000 7f325a9d6700 1 Processor -- start 2023-10-06T02:27:45.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.989+0000 7f325a9d6700 1 -- start start 2023-10-06T02:27:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.990+0000 7f325a9d6700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3254154f00 0x7f325416a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.990+0000 7f325a9d6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32540aaff0 0x7f32540b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.990+0000 7f325a9d6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32540ab460 0x7f32540b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.990+0000 7f325a9d6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32540ac470 con 0x7f32540ab460 2023-10-06T02:27:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.990+0000 7f325a9d6700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32540c4310 con 0x7f3254154f00 2023-10-06T02:27:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.990+0000 7f325a9d6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32540acae0 con 0x7f32540aaff0 2023-10-06T02:27:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.990+0000 7f3258f73700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32540ab460 0x7f32540b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.990+0000 7f3258f73700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32540ab460 0x7f32540b26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52978/0 (socket says 172.21.15.37:52978) 2023-10-06T02:27:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.990+0000 7f3258f73700 1 -- 172.21.15.37:0/1408549742 learned_addr learned my addr 172.21.15.37:0/1408549742 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.990+0000 7f3253fff700 1 --2- 172.21.15.37:0/1408549742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3254154f00 0x7f325416a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.990+0000 7f32537fe700 1 --2- 172.21.15.37:0/1408549742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32540aaff0 0x7f32540b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.990+0000 7f3258f73700 1 -- 172.21.15.37:0/1408549742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32540aaff0 msgr2=0x7f32540b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.990+0000 7f3258f73700 1 --2- 172.21.15.37:0/1408549742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32540aaff0 0x7f32540b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.990+0000 7f3258f73700 1 -- 172.21.15.37:0/1408549742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3254154f00 msgr2=0x7f325416a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.990+0000 7f3258f73700 1 --2- 172.21.15.37:0/1408549742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3254154f00 0x7f325416a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.990+0000 7f3258f73700 1 -- 172.21.15.37:0/1408549742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32540ad940 con 0x7f32540ab460 2023-10-06T02:27:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.990+0000 7f32537fe700 1 --2- 172.21.15.37:0/1408549742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32540aaff0 0x7f32540b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.990+0000 7f3253fff700 1 --2- 172.21.15.37:0/1408549742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3254154f00 0x7f325416a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.990+0000 7f3258f73700 1 --2- 172.21.15.37:0/1408549742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32540ab460 0x7f32540b26d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f324c014000 tx=0x7f324c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.990+0000 7f323bfff700 1 -- 172.21.15.37:0/1408549742 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c009ae0 con 0x7f32540ab460 2023-10-06T02:27:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.991+0000 7f323bfff700 1 -- 172.21.15.37:0/1408549742 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c014e20 con 0x7f32540ab460 2023-10-06T02:27:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.991+0000 7f325a9d6700 1 -- 172.21.15.37:0/1408549742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32540acd30 con 0x7f32540ab460 2023-10-06T02:27:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.991+0000 7f323bfff700 1 -- 172.21.15.37:0/1408549742 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c013e10 con 0x7f32540ab460 2023-10-06T02:27:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.991+0000 7f325a9d6700 1 -- 172.21.15.37:0/1408549742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32540ad2f0 con 0x7f32540ab460 2023-10-06T02:27:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.991+0000 7f325a9d6700 1 -- 172.21.15.37:0/1408549742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3254070c30 con 0x7f32540ab460 2023-10-06T02:27:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.992+0000 7f323bfff700 1 -- 172.21.15.37:0/1408549742 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f324c003040 con 0x7f32540ab460 2023-10-06T02:27:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.992+0000 7f323bfff700 1 --2- 172.21.15.37:0/1408549742 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3240066f30 0x7f32400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.992+0000 7f323bfff700 1 -- 172.21.15.37:0/1408549742 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f324c086620 con 0x7f32540ab460 2023-10-06T02:27:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.993+0000 7f3253fff700 1 --2- 172.21.15.37:0/1408549742 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3240066f30 0x7f32400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.993+0000 7f3253fff700 1 --2- 172.21.15.37:0/1408549742 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3240066f30 0x7f32400693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3244000e10 tx=0x7f3244009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:46.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:45.996+0000 7f323bfff700 1 -- 172.21.15.37:0/1408549742 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f324c053730 con 0x7f32540ab460 2023-10-06T02:27:46.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.237+0000 7f325a9d6700 1 -- 172.21.15.37:0/1408549742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f32540b3070 con 0x7f32540ab460 2023-10-06T02:27:46.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.842+0000 7f323bfff700 1 -- 172.21.15.37:0/1408549742 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v47) v1 ==== 122+0+0 (secure 0 0 0) 0x7f324c056d50 con 0x7f32540ab460 2023-10-06T02:27:46.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.845+0000 7f325a9d6700 1 -- 172.21.15.37:0/1408549742 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3240066f30 msgr2=0x7f32400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.845+0000 7f325a9d6700 1 --2- 172.21.15.37:0/1408549742 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3240066f30 0x7f32400693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3244000e10 tx=0x7f3244009040 comp rx=0 tx=0).stop 2023-10-06T02:27:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.845+0000 7f325a9d6700 1 -- 172.21.15.37:0/1408549742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32540ab460 msgr2=0x7f32540b26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.845+0000 7f325a9d6700 1 --2- 172.21.15.37:0/1408549742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32540ab460 0x7f32540b26d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f324c014000 tx=0x7f324c018000 comp rx=0 tx=0).stop 2023-10-06T02:27:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.845+0000 7f325a9d6700 1 -- 172.21.15.37:0/1408549742 shutdown_connections 2023-10-06T02:27:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.845+0000 7f325a9d6700 1 --2- 172.21.15.37:0/1408549742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32540ab460 0x7f32540b26d0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.845+0000 7f325a9d6700 1 --2- 172.21.15.37:0/1408549742 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3240066f30 0x7f32400693e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.845+0000 7f325a9d6700 1 --2- 172.21.15.37:0/1408549742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3254154f00 0x7f325416a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.845+0000 7f325a9d6700 1 --2- 172.21.15.37:0/1408549742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32540aaff0 0x7f32540b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.845+0000 7f325a9d6700 1 -- 172.21.15.37:0/1408549742 >> 172.21.15.37:0/1408549742 conn(0x7f32540680f0 msgr2=0x7f32541584e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.845+0000 7f325a9d6700 1 -- 172.21.15.37:0/1408549742 shutdown_connections 2023-10-06T02:27:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.845+0000 7f325a9d6700 1 -- 172.21.15.37:0/1408549742 wait complete. 2023-10-06T02:27:46.860 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:46.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.984+0000 7f327d5a0700 1 Processor -- start 2023-10-06T02:27:46.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.984+0000 7f327d5a0700 1 -- start start 2023-10-06T02:27:46.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.984+0000 7f327d5a0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32780cd9f0 0x7f327806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:46.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.984+0000 7f327d5a0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3278159b10 0x7f32780b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:46.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.984+0000 7f327d5a0700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3278159ff0 con 0x7f32780cddc0 2023-10-06T02:27:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.984+0000 7f327d5a0700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f327815a2d0 con 0x7f3278159b10 2023-10-06T02:27:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.984+0000 7f327d5a0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327815a5b0 con 0x7f32780cd9f0 2023-10-06T02:27:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.985+0000 7f32777fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3278159b10 0x7f32780b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.985+0000 7f32777fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3278159b10 0x7f32780b17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52984/0 (socket says 172.21.15.37:52984) 2023-10-06T02:27:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.985+0000 7f32777fe700 1 -- 172.21.15.37:0/4172965916 learned_addr learned my addr 172.21.15.37:0/4172965916 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.985+0000 7f32777fe700 1 -- 172.21.15.37:0/4172965916 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32780cd9f0 msgr2=0x7f327806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.985+0000 7f32777fe700 1 --2- 172.21.15.37:0/4172965916 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32780cd9f0 0x7f327806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.985+0000 7f32777fe700 1 -- 172.21.15.37:0/4172965916 >> v1:172.21.15.191:6789/0 conn(0x7f32780cddc0 legacy=0x7f3278067990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.985+0000 7f32777fe700 1 -- 172.21.15.37:0/4172965916 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327815a890 con 0x7f3278159b10 2023-10-06T02:27:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.985+0000 7f32777fe700 1 --2- 172.21.15.37:0/4172965916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3278159b10 0x7f32780b17d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f326c0099b0 tx=0x7f326c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8323bb60b138dd74 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.985+0000 7f3276ffd700 1 -- 172.21.15.37:0/4172965916 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c00b820 con 0x7f3278159b10 2023-10-06T02:27:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.985+0000 7f3276ffd700 1 -- 172.21.15.37:0/4172965916 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c00b980 con 0x7f3278159b10 2023-10-06T02:27:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.985+0000 7f3276ffd700 1 -- 172.21.15.37:0/4172965916 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c00bd20 con 0x7f3278159b10 2023-10-06T02:27:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.986+0000 7f327d5a0700 1 -- 172.21.15.37:0/4172965916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3278159b10 msgr2=0x7f32780b17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.986+0000 7f327d5a0700 1 --2- 172.21.15.37:0/4172965916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3278159b10 0x7f32780b17d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f326c0099b0 tx=0x7f326c009250 comp rx=0 tx=0).stop 2023-10-06T02:27:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.986+0000 7f327d5a0700 1 -- 172.21.15.37:0/4172965916 shutdown_connections 2023-10-06T02:27:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.986+0000 7f327d5a0700 1 --2- 172.21.15.37:0/4172965916 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32780cd9f0 0x7f327806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.986+0000 7f327d5a0700 1 --2- 172.21.15.37:0/4172965916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3278159b10 0x7f32780b17d0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.986+0000 7f327d5a0700 1 -- 172.21.15.37:0/4172965916 >> 172.21.15.37:0/4172965916 conn(0x7f32780ce280 msgr2=0x7f32780ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.986+0000 7f327d5a0700 1 -- 172.21.15.37:0/4172965916 shutdown_connections 2023-10-06T02:27:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.986+0000 7f327d5a0700 1 -- 172.21.15.37:0/4172965916 wait complete. 2023-10-06T02:27:46.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.987+0000 7f327d5a0700 1 Processor -- start 2023-10-06T02:27:46.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.987+0000 7f327d5a0700 1 -- start start 2023-10-06T02:27:46.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.988+0000 7f327d5a0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32780cd9f0 0x7f3278151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:46.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.988+0000 7f327d5a0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32780cddc0 0x7f327813a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:46.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.988+0000 7f327d5a0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3278159b10 0x7f32781522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:46.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.988+0000 7f327d5a0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327813d260 con 0x7f32780cddc0 2023-10-06T02:27:46.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.988+0000 7f327d5a0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3278151460 con 0x7f32780cd9f0 2023-10-06T02:27:46.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.988+0000 7f327d5a0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3278151c60 con 0x7f3278159b10 2023-10-06T02:27:46.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.988+0000 7f32777fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32780cddc0 0x7f327813a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:46.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.988+0000 7f32777fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32780cddc0 0x7f327813a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52992/0 (socket says 172.21.15.37:52992) 2023-10-06T02:27:46.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.988+0000 7f32777fe700 1 -- 172.21.15.37:0/4202327682 learned_addr learned my addr 172.21.15.37:0/4202327682 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:46.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.988+0000 7f327cd9f700 1 --2- 172.21.15.37:0/4202327682 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3278159b10 0x7f32781522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:46.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.988+0000 7f3277fff700 1 --2- 172.21.15.37:0/4202327682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32780cd9f0 0x7f3278151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.988+0000 7f32777fe700 1 -- 172.21.15.37:0/4202327682 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3278159b10 msgr2=0x7f32781522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.988+0000 7f32777fe700 1 --2- 172.21.15.37:0/4202327682 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3278159b10 0x7f32781522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.988+0000 7f32777fe700 1 -- 172.21.15.37:0/4202327682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32780cd9f0 msgr2=0x7f3278151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.988+0000 7f32777fe700 1 --2- 172.21.15.37:0/4202327682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32780cd9f0 0x7f3278151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.988+0000 7f32777fe700 1 -- 172.21.15.37:0/4202327682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326c0094f0 con 0x7f32780cddc0 2023-10-06T02:27:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.988+0000 7f32777fe700 1 --2- 172.21.15.37:0/4202327682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32780cddc0 0x7f327813a5e0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f326c009290 tx=0x7f326c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.988+0000 7f325ffff700 1 -- 172.21.15.37:0/4202327682 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c026480 con 0x7f32780cddc0 2023-10-06T02:27:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.989+0000 7f325ffff700 1 -- 172.21.15.37:0/4202327682 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c01f070 con 0x7f32780cddc0 2023-10-06T02:27:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.989+0000 7f327d5a0700 1 -- 172.21.15.37:0/4202327682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f327813d3f0 con 0x7f32780cddc0 2023-10-06T02:27:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.989+0000 7f325ffff700 1 -- 172.21.15.37:0/4202327682 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c026850 con 0x7f32780cddc0 2023-10-06T02:27:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.989+0000 7f327d5a0700 1 -- 172.21.15.37:0/4202327682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32781506b0 con 0x7f32780cddc0 2023-10-06T02:27:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.990+0000 7f327d5a0700 1 -- 172.21.15.37:0/4202327682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32780b0000 con 0x7f32780cddc0 2023-10-06T02:27:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.990+0000 7f325ffff700 1 -- 172.21.15.37:0/4202327682 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f326c01a440 con 0x7f32780cddc0 2023-10-06T02:27:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.990+0000 7f325ffff700 1 --2- 172.21.15.37:0/4202327682 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3264066f30 0x7f32640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.990+0000 7f325ffff700 1 -- 172.21.15.37:0/4202327682 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f326c021070 con 0x7f32780cddc0 2023-10-06T02:27:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.990+0000 7f3277fff700 1 --2- 172.21.15.37:0/4202327682 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3264066f30 0x7f32640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.991+0000 7f3277fff700 1 --2- 172.21.15.37:0/4202327682 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3264066f30 0x7f32640693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f32781591b0 tx=0x7f3268008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:46.995+0000 7f325ffff700 1 -- 172.21.15.37:0/4202327682 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f326c053e00 con 0x7f32780cddc0 2023-10-06T02:27:47.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.231+0000 7f327d5a0700 1 -- 172.21.15.37:0/4202327682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f327804bb80 con 0x7f32780cddc0 2023-10-06T02:27:47.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.231+0000 7f325ffff700 1 -- 172.21.15.37:0/4202327682 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f326c02b020 con 0x7f32780cddc0 2023-10-06T02:27:47.233 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:47.233 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3055524642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3055524642},{"type":"v1","addr":"172.21.15.37:6835","nonce":3055524642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2821947660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2821947660},{"type":"v1","addr":"172.21.15.191:6836","nonce":2821947660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6453,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4246185831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4246185831},{"type":"v1","addr":"172.21.15.37:6834","nonce":4246185831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:27:43.200836+0000","modified":"2023-10-06T02:27:46.838015+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6465},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6465":{"gid":6465,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6837/2764715102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2764715102},{"type":"v1","addr":"172.21.15.191:6837","nonce":2764715102}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:27:47.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.233+0000 7f327d5a0700 1 -- 172.21.15.37:0/4202327682 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3264066f30 msgr2=0x7f32640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:47.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.233+0000 7f327d5a0700 1 --2- 172.21.15.37:0/4202327682 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3264066f30 0x7f32640693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f32781591b0 tx=0x7f3268008040 comp rx=0 tx=0).stop 2023-10-06T02:27:47.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.233+0000 7f327d5a0700 1 -- 172.21.15.37:0/4202327682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32780cddc0 msgr2=0x7f327813a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:47.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.233+0000 7f327d5a0700 1 --2- 172.21.15.37:0/4202327682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32780cddc0 0x7f327813a5e0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f326c009290 tx=0x7f326c016000 comp rx=0 tx=0).stop 2023-10-06T02:27:47.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.233+0000 7f327d5a0700 1 -- 172.21.15.37:0/4202327682 shutdown_connections 2023-10-06T02:27:47.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.233+0000 7f327d5a0700 1 --2- 172.21.15.37:0/4202327682 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3278159b10 0x7f32781522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.233+0000 7f327d5a0700 1 --2- 172.21.15.37:0/4202327682 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3264066f30 0x7f32640693e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.233+0000 7f327d5a0700 1 --2- 172.21.15.37:0/4202327682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32780cd9f0 0x7f3278151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.233+0000 7f327d5a0700 1 --2- 172.21.15.37:0/4202327682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32780cddc0 0x7f327813a5e0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.234+0000 7f327d5a0700 1 -- 172.21.15.37:0/4202327682 >> 172.21.15.37:0/4202327682 conn(0x7f32780ce280 msgr2=0x7f3278153a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:47.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.234+0000 7f327d5a0700 1 -- 172.21.15.37:0/4202327682 shutdown_connections 2023-10-06T02:27:47.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.234+0000 7f327d5a0700 1 -- 172.21.15.37:0/4202327682 wait complete. 2023-10-06T02:27:47.236 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 47 2023-10-06T02:27:47.247 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:27:47.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.365+0000 7f9291d90700 1 Processor -- start 2023-10-06T02:27:47.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.365+0000 7f9291d90700 1 -- start start 2023-10-06T02:27:47.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.365+0000 7f9291d90700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f928c159760 0x7f928c15d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:47.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.366+0000 7f9291d90700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f928c15d8d0 0x7f928c15dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:47.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.366+0000 7f9291d90700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f928c0c5390 0x7f928c0c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:47.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.366+0000 7f9291d90700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928c0cc2d0 con 0x7f928c15d8d0 2023-10-06T02:27:47.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.366+0000 7f9291d90700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928c0cb650 con 0x7f928c159760 2023-10-06T02:27:47.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.366+0000 7f9291d90700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c0cb930 con 0x7f928c0c5390 2023-10-06T02:27:47.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.366+0000 7f928affd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f928c15d8d0 0x7f928c15dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:47.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.366+0000 7f928affd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f928c15d8d0 0x7f928c15dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53002/0 (socket says 172.21.15.37:53002) 2023-10-06T02:27:47.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.366+0000 7f928affd700 1 -- 172.21.15.37:0/1816383843 learned_addr learned my addr 172.21.15.37:0/1816383843 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:47.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.366+0000 7f928bfff700 1 --2- 172.21.15.37:0/1816383843 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f928c0c5390 0x7f928c0c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:47.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.366+0000 7f928b7fe700 1 --2- 172.21.15.37:0/1816383843 >> v2:172.21.15.191:3300/0 conn(0x7f928c159760 0x7f928c15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:47.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.366+0000 7f928affd700 1 -- 172.21.15.37:0/1816383843 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f928c0c5390 msgr2=0x7f928c0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:47.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.366+0000 7f928affd700 1 --2- 172.21.15.37:0/1816383843 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f928c0c5390 0x7f928c0c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.366+0000 7f928affd700 1 -- 172.21.15.37:0/1816383843 >> v2:172.21.15.191:3300/0 conn(0x7f928c159760 msgr2=0x7f928c15d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:47.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.366+0000 7f928affd700 1 --2- 172.21.15.37:0/1816383843 >> v2:172.21.15.191:3300/0 conn(0x7f928c159760 0x7f928c15d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.366+0000 7f928affd700 1 -- 172.21.15.37:0/1816383843 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c0cbc10 con 0x7f928c15d8d0 2023-10-06T02:27:47.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.366+0000 7f928affd700 1 --2- 172.21.15.37:0/1816383843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c15d8d0 0x7f928c15dd50 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f928c0897f0 tx=0x7f9280009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea4cc38d0287dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:47.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.366+0000 7f928a7fc700 1 -- 172.21.15.37:0/1816383843 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928000b6d0 con 0x7f928c15d8d0 2023-10-06T02:27:47.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.366+0000 7f928a7fc700 1 -- 172.21.15.37:0/1816383843 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928000b830 con 0x7f928c15d8d0 2023-10-06T02:27:47.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.366+0000 7f928a7fc700 1 -- 172.21.15.37:0/1816383843 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928000bbf0 con 0x7f928c15d8d0 2023-10-06T02:27:47.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.367+0000 7f9291d90700 1 -- 172.21.15.37:0/1816383843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c15d8d0 msgr2=0x7f928c15dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:47.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.367+0000 7f9291d90700 1 --2- 172.21.15.37:0/1816383843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c15d8d0 0x7f928c15dd50 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f928c0897f0 tx=0x7f9280009250 comp rx=0 tx=0).stop 2023-10-06T02:27:47.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.367+0000 7f9291d90700 1 -- 172.21.15.37:0/1816383843 shutdown_connections 2023-10-06T02:27:47.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.367+0000 7f9291d90700 1 --2- 172.21.15.37:0/1816383843 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f928c0c5390 0x7f928c0c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.367+0000 7f9291d90700 1 --2- 172.21.15.37:0/1816383843 >> v2:172.21.15.191:3300/0 conn(0x7f928c159760 0x7f928c15d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.367+0000 7f9291d90700 1 --2- 172.21.15.37:0/1816383843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c15d8d0 0x7f928c15dd50 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.367+0000 7f9291d90700 1 -- 172.21.15.37:0/1816383843 >> 172.21.15.37:0/1816383843 conn(0x7f928c06c890 msgr2=0x7f928c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:47.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.367+0000 7f9291d90700 1 -- 172.21.15.37:0/1816383843 shutdown_connections 2023-10-06T02:27:47.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.367+0000 7f9291d90700 1 -- 172.21.15.37:0/1816383843 wait complete. 2023-10-06T02:27:47.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.368+0000 7f9291d90700 1 Processor -- start 2023-10-06T02:27:47.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.368+0000 7f9291d90700 1 -- start start 2023-10-06T02:27:47.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.369+0000 7f9291d90700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f928c0c5390 0x7f928c0b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:47.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.369+0000 7f9291d90700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f928c159760 0x7f928c152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:47.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.369+0000 7f9291d90700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c15d8d0 0x7f928c158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:47.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.369+0000 7f9291d90700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c152970 con 0x7f928c15d8d0 2023-10-06T02:27:47.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.369+0000 7f9291d90700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c159bc0 con 0x7f928c159760 2023-10-06T02:27:47.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.369+0000 7f9291d90700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c158fd0 con 0x7f928c0c5390 2023-10-06T02:27:47.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.369+0000 7f928bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c15d8d0 0x7f928c158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:47.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.369+0000 7f928bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c15d8d0 0x7f928c158a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53016/0 (socket says 172.21.15.37:53016) 2023-10-06T02:27:47.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.369+0000 7f928bfff700 1 -- 172.21.15.37:0/2928769193 learned_addr learned my addr 172.21.15.37:0/2928769193 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:47.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.369+0000 7f928affd700 1 --2- 172.21.15.37:0/2928769193 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f928c159760 0x7f928c152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:47.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.369+0000 7f928b7fe700 1 --2- 172.21.15.37:0/2928769193 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f928c0c5390 0x7f928c0b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:47.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.369+0000 7f928bfff700 1 -- 172.21.15.37:0/2928769193 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f928c0c5390 msgr2=0x7f928c0b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:47.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.369+0000 7f928bfff700 1 --2- 172.21.15.37:0/2928769193 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f928c0c5390 0x7f928c0b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.369+0000 7f928bfff700 1 -- 172.21.15.37:0/2928769193 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f928c159760 msgr2=0x7f928c152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:47.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.369+0000 7f928bfff700 1 --2- 172.21.15.37:0/2928769193 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f928c159760 0x7f928c152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.369+0000 7f928bfff700 1 -- 172.21.15.37:0/2928769193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92800094f0 con 0x7f928c15d8d0 2023-10-06T02:27:47.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.369+0000 7f928bfff700 1 --2- 172.21.15.37:0/2928769193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c15d8d0 0x7f928c158a90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9284009e90 tx=0x7f928400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:47.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.370+0000 7f92737fe700 1 -- 172.21.15.37:0/2928769193 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928400cc20 con 0x7f928c15d8d0 2023-10-06T02:27:47.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.370+0000 7f92737fe700 1 -- 172.21.15.37:0/2928769193 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928400f040 con 0x7f928c15d8d0 2023-10-06T02:27:47.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.370+0000 7f92737fe700 1 -- 172.21.15.37:0/2928769193 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284014480 con 0x7f928c15d8d0 2023-10-06T02:27:47.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.370+0000 7f9291d90700 1 -- 172.21.15.37:0/2928769193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928c0b4920 con 0x7f928c15d8d0 2023-10-06T02:27:47.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.370+0000 7f9291d90700 1 -- 172.21.15.37:0/2928769193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928c0b4ee0 con 0x7f928c15d8d0 2023-10-06T02:27:47.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.371+0000 7f9291d90700 1 -- 172.21.15.37:0/2928769193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928c159d30 con 0x7f928c15d8d0 2023-10-06T02:27:47.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.371+0000 7f92737fe700 1 -- 172.21.15.37:0/2928769193 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9284014830 con 0x7f928c15d8d0 2023-10-06T02:27:47.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.371+0000 7f92737fe700 1 --2- 172.21.15.37:0/2928769193 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9278066f30 0x7f92780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:47.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.372+0000 7f92737fe700 1 -- 172.21.15.37:0/2928769193 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9284085120 con 0x7f928c15d8d0 2023-10-06T02:27:47.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.372+0000 7f928b7fe700 1 --2- 172.21.15.37:0/2928769193 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9278066f30 0x7f92780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:47.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.372+0000 7f928b7fe700 1 --2- 172.21.15.37:0/2928769193 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9278066f30 0x7f92780693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f927c009cb0 tx=0x7f927c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:47.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.376+0000 7f92737fe700 1 -- 172.21.15.37:0/2928769193 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9284055cc0 con 0x7f928c15d8d0 2023-10-06T02:27:47.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.570+0000 7f9291d90700 1 -- 172.21.15.37:0/2928769193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f928c06fbf0 con 0x7f928c15d8d0 2023-10-06T02:27:47.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.571+0000 7f92737fe700 1 -- 172.21.15.37:0/2928769193 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16869 (secure 0 0 0) 0x7f9284055850 con 0x7f928c15d8d0 2023-10-06T02:27:47.572 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:47.573 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":72,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:27:44.795505+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:27:40.951347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T02:27:42.184642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:27:47.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.573+0000 7f9291d90700 1 -- 172.21.15.37:0/2928769193 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9278066f30 msgr2=0x7f92780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:47.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.573+0000 7f9291d90700 1 --2- 172.21.15.37:0/2928769193 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9278066f30 0x7f92780693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f927c009cb0 tx=0x7f927c008040 comp rx=0 tx=0).stop 2023-10-06T02:27:47.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.573+0000 7f9291d90700 1 -- 172.21.15.37:0/2928769193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c15d8d0 msgr2=0x7f928c158a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:47.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.573+0000 7f9291d90700 1 --2- 172.21.15.37:0/2928769193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c15d8d0 0x7f928c158a90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9284009e90 tx=0x7f928400b040 comp rx=0 tx=0).stop 2023-10-06T02:27:47.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.573+0000 7f9291d90700 1 -- 172.21.15.37:0/2928769193 shutdown_connections 2023-10-06T02:27:47.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.573+0000 7f9291d90700 1 --2- 172.21.15.37:0/2928769193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c15d8d0 0x7f928c158a90 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.573+0000 7f9291d90700 1 --2- 172.21.15.37:0/2928769193 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f928c0c5390 0x7f928c0b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.573+0000 7f9291d90700 1 --2- 172.21.15.37:0/2928769193 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9278066f30 0x7f92780693e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.573+0000 7f9291d90700 1 --2- 172.21.15.37:0/2928769193 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f928c159760 0x7f928c152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.573+0000 7f9291d90700 1 -- 172.21.15.37:0/2928769193 >> 172.21.15.37:0/2928769193 conn(0x7f928c06c890 msgr2=0x7f928c0c9620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:47.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.573+0000 7f9291d90700 1 -- 172.21.15.37:0/2928769193 shutdown_connections 2023-10-06T02:27:47.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.573+0000 7f9291d90700 1 -- 172.21.15.37:0/2928769193 wait complete. 2023-10-06T02:27:47.587 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:27:47.587 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:27:47.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.704+0000 7f9bb175f700 1 Processor -- start 2023-10-06T02:27:47.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.704+0000 7f9bb175f700 1 -- start start 2023-10-06T02:27:47.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.705+0000 7f9bb175f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9bac0cb580 0x7f9bac0cb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:47.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.705+0000 7f9bb175f700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9bac0cd970 0x7f9bac158f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:47.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.705+0000 7f9bb175f700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bac0cf9a0 con 0x7f9bac0d0a40 2023-10-06T02:27:47.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.705+0000 7f9bb175f700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bac0cfc80 con 0x7f9bac0cb580 2023-10-06T02:27:47.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.705+0000 7f9bb175f700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bac0cff60 con 0x7f9bac0cd970 2023-10-06T02:27:47.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.705+0000 7f9baaffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9bac0cb580 0x7f9bac0cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:47.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.705+0000 7f9baaffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9bac0cb580 0x7f9bac0cb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53020/0 (socket says 172.21.15.37:53020) 2023-10-06T02:27:47.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.705+0000 7f9baaffd700 1 -- 172.21.15.37:0/3639451102 learned_addr learned my addr 172.21.15.37:0/3639451102 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.705+0000 7f9bab7fe700 1 --2- 172.21.15.37:0/3639451102 >> v2:172.21.15.191:3300/0 conn(0x7f9bac0cd970 0x7f9bac158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.705+0000 7f9baaffd700 1 -- 172.21.15.37:0/3639451102 >> v2:172.21.15.191:3300/0 conn(0x7f9bac0cd970 msgr2=0x7f9bac158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.705+0000 7f9baaffd700 1 --2- 172.21.15.37:0/3639451102 >> v2:172.21.15.191:3300/0 conn(0x7f9bac0cd970 0x7f9bac158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.705+0000 7f9baaffd700 1 -- 172.21.15.37:0/3639451102 >> v1:172.21.15.191:6789/0 conn(0x7f9bac0d0a40 legacy=0x7f9bac0cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.706+0000 7f9baaffd700 1 -- 172.21.15.37:0/3639451102 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac0d0240 con 0x7f9bac0cb580 2023-10-06T02:27:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.706+0000 7f9baaffd700 1 --2- 172.21.15.37:0/3639451102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bac0cb580 0x7f9bac0cb950 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0ca940 tx=0x7f9ba4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7ef03edba5127d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.706+0000 7f9ba9ffb700 1 -- 172.21.15.37:0/3639451102 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba400b860 con 0x7f9bac0cb580 2023-10-06T02:27:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.706+0000 7f9ba9ffb700 1 -- 172.21.15.37:0/3639451102 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba400b9c0 con 0x7f9bac0cb580 2023-10-06T02:27:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.706+0000 7f9ba9ffb700 1 -- 172.21.15.37:0/3639451102 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba400bd60 con 0x7f9bac0cb580 2023-10-06T02:27:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.706+0000 7f9bb175f700 1 -- 172.21.15.37:0/3639451102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bac0cb580 msgr2=0x7f9bac0cb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.706+0000 7f9bb175f700 1 --2- 172.21.15.37:0/3639451102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bac0cb580 0x7f9bac0cb950 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0ca940 tx=0x7f9ba4009250 comp rx=0 tx=0).stop 2023-10-06T02:27:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.706+0000 7f9bb175f700 1 -- 172.21.15.37:0/3639451102 shutdown_connections 2023-10-06T02:27:47.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.706+0000 7f9bb175f700 1 --2- 172.21.15.37:0/3639451102 >> v2:172.21.15.191:3300/0 conn(0x7f9bac0cd970 0x7f9bac158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.706+0000 7f9bb175f700 1 --2- 172.21.15.37:0/3639451102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bac0cb580 0x7f9bac0cb950 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.706+0000 7f9bb175f700 1 -- 172.21.15.37:0/3639451102 >> 172.21.15.37:0/3639451102 conn(0x7f9bac06c0b0 msgr2=0x7f9bac06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:47.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.706+0000 7f9bb175f700 1 -- 172.21.15.37:0/3639451102 shutdown_connections 2023-10-06T02:27:47.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.706+0000 7f9bb175f700 1 -- 172.21.15.37:0/3639451102 wait complete. 2023-10-06T02:27:47.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.708+0000 7f9bb175f700 1 Processor -- start 2023-10-06T02:27:47.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.708+0000 7f9bb175f700 1 -- start start 2023-10-06T02:27:47.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.708+0000 7f9bb175f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bac0cd970 0x7f9bac16db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:47.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.708+0000 7f9bb175f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9bac0d0a40 0x7f9bac141c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:47.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.708+0000 7f9bb175f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9bac154ce0 0x7f9bac0c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:47.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.708+0000 7f9bb175f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac16e0a0 con 0x7f9bac0cd970 2023-10-06T02:27:47.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.708+0000 7f9bb175f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac0c9b20 con 0x7f9bac0d0a40 2023-10-06T02:27:47.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.708+0000 7f9bb175f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac1551e0 con 0x7f9bac154ce0 2023-10-06T02:27:47.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.709+0000 7f9baaffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bac0cd970 0x7f9bac16db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:47.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.709+0000 7f9baaffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bac0cd970 0x7f9bac16db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53032/0 (socket says 172.21.15.37:53032) 2023-10-06T02:27:47.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.709+0000 7f9baaffd700 1 -- 172.21.15.37:0/4260018112 learned_addr learned my addr 172.21.15.37:0/4260018112 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:47.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.709+0000 7f9baa7fc700 1 --2- 172.21.15.37:0/4260018112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9bac0d0a40 0x7f9bac141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:47.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.709+0000 7f9bab7fe700 1 --2- 172.21.15.37:0/4260018112 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9bac154ce0 0x7f9bac0c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:47.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.709+0000 7f9baaffd700 1 -- 172.21.15.37:0/4260018112 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9bac154ce0 msgr2=0x7f9bac0c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:47.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.709+0000 7f9baaffd700 1 --2- 172.21.15.37:0/4260018112 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9bac154ce0 0x7f9bac0c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.709+0000 7f9baaffd700 1 -- 172.21.15.37:0/4260018112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9bac0d0a40 msgr2=0x7f9bac141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:47.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.709+0000 7f9baaffd700 1 --2- 172.21.15.37:0/4260018112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9bac0d0a40 0x7f9bac141c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.709+0000 7f9baaffd700 1 -- 172.21.15.37:0/4260018112 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba40094f0 con 0x7f9bac0cd970 2023-10-06T02:27:47.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.709+0000 7f9baaffd700 1 --2- 172.21.15.37:0/4260018112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bac0cd970 0x7f9bac16db60 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0cde10 tx=0x7f9ba4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:47.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.709+0000 7f9ba2ffd700 1 -- 172.21.15.37:0/4260018112 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4011e40 con 0x7f9bac0cd970 2023-10-06T02:27:47.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.709+0000 7f9ba2ffd700 1 -- 172.21.15.37:0/4260018112 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba4024440 con 0x7f9bac0cd970 2023-10-06T02:27:47.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.709+0000 7f9bb175f700 1 -- 172.21.15.37:0/4260018112 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bac1554c0 con 0x7f9bac0cd970 2023-10-06T02:27:47.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.709+0000 7f9ba2ffd700 1 -- 172.21.15.37:0/4260018112 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4024800 con 0x7f9bac0cd970 2023-10-06T02:27:47.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.709+0000 7f9bb175f700 1 -- 172.21.15.37:0/4260018112 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bac156ed0 con 0x7f9bac0cd970 2023-10-06T02:27:47.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.710+0000 7f9bb175f700 1 -- 172.21.15.37:0/4260018112 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bac088480 con 0x7f9bac0cd970 2023-10-06T02:27:47.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.711+0000 7f9ba2ffd700 1 -- 172.21.15.37:0/4260018112 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ba402d440 con 0x7f9bac0cd970 2023-10-06T02:27:47.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.711+0000 7f9ba2ffd700 1 --2- 172.21.15.37:0/4260018112 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9b8c066f30 0x7f9b8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:47.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.711+0000 7f9ba2ffd700 1 -- 172.21.15.37:0/4260018112 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9ba4085fc0 con 0x7f9bac0cd970 2023-10-06T02:27:47.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.711+0000 7f9baa7fc700 1 --2- 172.21.15.37:0/4260018112 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9b8c066f30 0x7f9b8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:47.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.712+0000 7f9baa7fc700 1 --2- 172.21.15.37:0/4260018112 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9b8c066f30 0x7f9b8c0693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0d0ea0 tx=0x7f9b94007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:47.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.715+0000 7f9ba2ffd700 1 -- 172.21.15.37:0/4260018112 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ba40b75a0 con 0x7f9bac0cd970 2023-10-06T02:27:47.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.907+0000 7f9bb175f700 1 -- 172.21.15.37:0/4260018112 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9bac064b00 con 0x7f9b8c066f30 2023-10-06T02:27:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.916+0000 7f9ba2ffd700 1 -- 172.21.15.37:0/4260018112 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309022 (secure 0 0 0) 0x7f9bac064b00 con 0x7f9b8c066f30 2023-10-06T02:27:47.921 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.919+0000 7f9bb175f700 1 -- 172.21.15.37:0/4260018112 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9b8c066f30 msgr2=0x7f9b8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.919+0000 7f9bb175f700 1 --2- 172.21.15.37:0/4260018112 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9b8c066f30 0x7f9b8c0693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0d0ea0 tx=0x7f9b94007ec0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.919+0000 7f9bb175f700 1 -- 172.21.15.37:0/4260018112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bac0cd970 msgr2=0x7f9bac16db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.919+0000 7f9bb175f700 1 --2- 172.21.15.37:0/4260018112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bac0cd970 0x7f9bac16db60 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0cde10 tx=0x7f9ba4017000 comp rx=0 tx=0).stop 2023-10-06T02:27:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.919+0000 7f9bb175f700 1 -- 172.21.15.37:0/4260018112 shutdown_connections 2023-10-06T02:27:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.919+0000 7f9bb175f700 1 --2- 172.21.15.37:0/4260018112 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9bac154ce0 0x7f9bac0c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.919+0000 7f9bb175f700 1 --2- 172.21.15.37:0/4260018112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bac0cd970 0x7f9bac16db60 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.919+0000 7f9bb175f700 1 --2- 172.21.15.37:0/4260018112 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9b8c066f30 0x7f9b8c0693e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.919+0000 7f9bb175f700 1 --2- 172.21.15.37:0/4260018112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9bac0d0a40 0x7f9bac141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.919+0000 7f9bb175f700 1 -- 172.21.15.37:0/4260018112 >> 172.21.15.37:0/4260018112 conn(0x7f9bac06c0b0 msgr2=0x7f9bac0b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:47.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.920+0000 7f9bb175f700 1 -- 172.21.15.37:0/4260018112 shutdown_connections 2023-10-06T02:27:47.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:47.920+0000 7f9bb175f700 1 -- 172.21.15.37:0/4260018112 wait complete. 2023-10-06T02:27:47.925 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:27:47.933 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2023-10-06T02:27:46.575715+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2386084,"kb_used_data":7780,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752588636,"statfs":{"total":773094113280,"available":770650763264,"internally_reserved":0,"allocated":7966720,"data_stored":4190453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.786925"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802518+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:53.218389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.807980+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:00.209850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.796866+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:36.224572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.798550+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:53.218389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802678+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:04.289183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801743+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:17.054182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801456+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:59.316808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802858+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:45:34.837248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801293+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:11.571663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.798313+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:33.606927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.807955+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:44.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797984+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:46.415629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802208+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:54.211724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801195+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:00.209850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.809053+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:17.377369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802426+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:33.606927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802907+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:28.926179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797755+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:46.464705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.803032+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:03.886385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800763+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:30.519208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.803836+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:36:48.718543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.805193+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:47.636151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802680+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:40.040632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.808461+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:28.225535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801398+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:01.723335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797772+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:54.179105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.807304+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:34.837998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800268+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:03.752060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800980+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:09.747047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.805049+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:09.747047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.796734+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:28:34.237238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801944+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:46.415629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797008+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:14.723560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813044+0000","last_change":"2023-10-06T02:27:42.813044+0000","last_active":"2023-10-06T02:27:42.813044+0000","last_peered":"2023-10-06T02:27:42.813044+0000","last_clean":"2023-10-06T02:27:42.813044+0000","last_became_active":"2023-10-06T02:27:42.812776+0000","last_became_peered":"2023-10-06T02:27:42.812776+0000","last_unstale":"2023-10-06T02:27:42.813044+0000","last_undegraded":"2023-10-06T02:27:42.813044+0000","last_fullsized":"2023-10-06T02:27:42.813044+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:47.491511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799411+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:33.606927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.812884+0000","last_change":"2023-10-06T02:27:42.812884+0000","last_active":"2023-10-06T02:27:42.812884+0000","last_peered":"2023-10-06T02:27:42.812884+0000","last_clean":"2023-10-06T02:27:42.812884+0000","last_became_active":"2023-10-06T02:27:42.812665+0000","last_became_peered":"2023-10-06T02:27:42.812665+0000","last_unstale":"2023-10-06T02:27:42.812884+0000","last_undegraded":"2023-10-06T02:27:42.812884+0000","last_fullsized":"2023-10-06T02:27:42.812884+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:29.170337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802146+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:15.684258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.815975+0000","last_change":"2023-10-06T02:27:42.815975+0000","last_active":"2023-10-06T02:27:42.815975+0000","last_peered":"2023-10-06T02:27:42.815975+0000","last_clean":"2023-10-06T02:27:42.815975+0000","last_became_active":"2023-10-06T02:27:42.815717+0000","last_became_peered":"2023-10-06T02:27:42.815717+0000","last_unstale":"2023-10-06T02:27:42.815975+0000","last_undegraded":"2023-10-06T02:27:42.815975+0000","last_fullsized":"2023-10-06T02:27:42.815975+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:43.563364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802182+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:09.677215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.814055+0000","last_change":"2023-10-06T02:27:42.814055+0000","last_active":"2023-10-06T02:27:42.814055+0000","last_peered":"2023-10-06T02:27:42.814055+0000","last_clean":"2023-10-06T02:27:42.814055+0000","last_became_active":"2023-10-06T02:27:42.813793+0000","last_became_peered":"2023-10-06T02:27:42.813793+0000","last_unstale":"2023-10-06T02:27:42.814055+0000","last_undegraded":"2023-10-06T02:27:42.814055+0000","last_fullsized":"2023-10-06T02:27:42.814055+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:30.927523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800029+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:53.218389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.811221+0000","last_change":"2023-10-06T02:27:42.811221+0000","last_active":"2023-10-06T02:27:42.811221+0000","last_peered":"2023-10-06T02:27:42.811221+0000","last_clean":"2023-10-06T02:27:42.811221+0000","last_became_active":"2023-10-06T02:27:42.810661+0000","last_became_peered":"2023-10-06T02:27:42.810661+0000","last_unstale":"2023-10-06T02:27:42.811221+0000","last_undegraded":"2023-10-06T02:27:42.811221+0000","last_fullsized":"2023-10-06T02:27:42.811221+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:25.281591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800116+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:20.572015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.811978+0000","last_change":"2023-10-06T02:27:42.811978+0000","last_active":"2023-10-06T02:27:42.811978+0000","last_peered":"2023-10-06T02:27:42.811978+0000","last_clean":"2023-10-06T02:27:42.811978+0000","last_became_active":"2023-10-06T02:27:42.811662+0000","last_became_peered":"2023-10-06T02:27:42.811662+0000","last_unstale":"2023-10-06T02:27:42.811978+0000","last_undegraded":"2023-10-06T02:27:42.811978+0000","last_fullsized":"2023-10-06T02:27:42.811978+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:31.613891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802265+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:37:46.334285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813508+0000","last_change":"2023-10-06T02:27:42.813508+0000","last_active":"2023-10-06T02:27:42.813508+0000","last_peered":"2023-10-06T02:27:42.813508+0000","last_clean":"2023-10-06T02:27:42.813508+0000","last_became_active":"2023-10-06T02:27:42.813249+0000","last_became_peered":"2023-10-06T02:27:42.813249+0000","last_unstale":"2023-10-06T02:27:42.813508+0000","last_undegraded":"2023-10-06T02:27:42.813508+0000","last_fullsized":"2023-10-06T02:27:42.813508+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:29.170337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801313+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:59.814849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.811677+0000","last_change":"2023-10-06T02:27:42.811677+0000","last_active":"2023-10-06T02:27:42.811677+0000","last_peered":"2023-10-06T02:27:42.811677+0000","last_clean":"2023-10-06T02:27:42.811677+0000","last_became_active":"2023-10-06T02:27:42.811370+0000","last_became_peered":"2023-10-06T02:27:42.811370+0000","last_unstale":"2023-10-06T02:27:42.811677+0000","last_undegraded":"2023-10-06T02:27:42.811677+0000","last_fullsized":"2023-10-06T02:27:42.811677+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:55:16.818646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800463+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:50.633626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813430+0000","last_change":"2023-10-06T02:27:42.813430+0000","last_active":"2023-10-06T02:27:42.813430+0000","last_peered":"2023-10-06T02:27:42.813430+0000","last_clean":"2023-10-06T02:27:42.813430+0000","last_became_active":"2023-10-06T02:27:42.813263+0000","last_became_peered":"2023-10-06T02:27:42.813263+0000","last_unstale":"2023-10-06T02:27:42.813430+0000","last_undegraded":"2023-10-06T02:27:42.813430+0000","last_fullsized":"2023-10-06T02:27:42.813430+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:28.180005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.798675+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:17.967348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.812967+0000","last_change":"2023-10-06T02:27:42.812967+0000","last_active":"2023-10-06T02:27:42.812967+0000","last_peered":"2023-10-06T02:27:42.812967+0000","last_clean":"2023-10-06T02:27:42.812967+0000","last_became_active":"2023-10-06T02:27:42.812686+0000","last_became_peered":"2023-10-06T02:27:42.812686+0000","last_unstale":"2023-10-06T02:27:42.812967+0000","last_undegraded":"2023-10-06T02:27:42.812967+0000","last_fullsized":"2023-10-06T02:27:42.812967+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:36:47.713799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800249+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:44.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.815152+0000","last_change":"2023-10-06T02:27:42.815152+0000","last_active":"2023-10-06T02:27:42.815152+0000","last_peered":"2023-10-06T02:27:42.815152+0000","last_clean":"2023-10-06T02:27:42.815152+0000","last_became_active":"2023-10-06T02:27:42.814822+0000","last_became_peered":"2023-10-06T02:27:42.814822+0000","last_unstale":"2023-10-06T02:27:42.815152+0000","last_undegraded":"2023-10-06T02:27:42.815152+0000","last_fullsized":"2023-10-06T02:27:42.815152+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:48.778361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.796949+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:56.326934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.806783+0000","last_change":"2023-10-06T02:27:42.806783+0000","last_active":"2023-10-06T02:27:42.806783+0000","last_peered":"2023-10-06T02:27:42.806783+0000","last_clean":"2023-10-06T02:27:42.806783+0000","last_became_active":"2023-10-06T02:27:42.806497+0000","last_became_peered":"2023-10-06T02:27:42.806497+0000","last_unstale":"2023-10-06T02:27:42.806783+0000","last_undegraded":"2023-10-06T02:27:42.806783+0000","last_fullsized":"2023-10-06T02:27:42.806783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:43:44.444253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797396+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:44.568108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.805768+0000","last_change":"2023-10-06T02:27:42.805768+0000","last_active":"2023-10-06T02:27:42.805768+0000","last_peered":"2023-10-06T02:27:42.805768+0000","last_clean":"2023-10-06T02:27:42.805768+0000","last_became_active":"2023-10-06T02:27:42.805483+0000","last_became_peered":"2023-10-06T02:27:42.805483+0000","last_unstale":"2023-10-06T02:27:42.805768+0000","last_undegraded":"2023-10-06T02:27:42.805768+0000","last_fullsized":"2023-10-06T02:27:42.805768+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:39.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800542+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:41.827434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.812082+0000","last_change":"2023-10-06T02:27:42.812082+0000","last_active":"2023-10-06T02:27:42.812082+0000","last_peered":"2023-10-06T02:27:42.812082+0000","last_clean":"2023-10-06T02:27:42.812082+0000","last_became_active":"2023-10-06T02:27:42.811811+0000","last_became_peered":"2023-10-06T02:27:42.811811+0000","last_unstale":"2023-10-06T02:27:42.812082+0000","last_undegraded":"2023-10-06T02:27:42.812082+0000","last_fullsized":"2023-10-06T02:27:42.812082+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:39.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799930+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:12:06.792194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813049+0000","last_change":"2023-10-06T02:27:42.813049+0000","last_active":"2023-10-06T02:27:42.813049+0000","last_peered":"2023-10-06T02:27:42.813049+0000","last_clean":"2023-10-06T02:27:42.813049+0000","last_became_active":"2023-10-06T02:27:42.812763+0000","last_became_peered":"2023-10-06T02:27:42.812763+0000","last_unstale":"2023-10-06T02:27:42.813049+0000","last_undegraded":"2023-10-06T02:27:42.813049+0000","last_fullsized":"2023-10-06T02:27:42.813049+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:09.771266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799859+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:58.171529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.812011+0000","last_change":"2023-10-06T02:27:42.812011+0000","last_active":"2023-10-06T02:27:42.812011+0000","last_peered":"2023-10-06T02:27:42.812011+0000","last_clean":"2023-10-06T02:27:42.812011+0000","last_became_active":"2023-10-06T02:27:42.810343+0000","last_became_peered":"2023-10-06T02:27:42.810343+0000","last_unstale":"2023-10-06T02:27:42.812011+0000","last_undegraded":"2023-10-06T02:27:42.812011+0000","last_fullsized":"2023-10-06T02:27:42.812011+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:31.613891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802247+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:46.057716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.809942+0000","last_change":"2023-10-06T02:27:42.809942+0000","last_active":"2023-10-06T02:27:42.809942+0000","last_peered":"2023-10-06T02:27:42.809942+0000","last_clean":"2023-10-06T02:27:42.809942+0000","last_became_active":"2023-10-06T02:27:42.809577+0000","last_became_peered":"2023-10-06T02:27:42.809577+0000","last_unstale":"2023-10-06T02:27:42.809942+0000","last_undegraded":"2023-10-06T02:27:42.809942+0000","last_fullsized":"2023-10-06T02:27:42.809942+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:28.180005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801000+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:55:31.826969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.810405+0000","last_change":"2023-10-06T02:27:42.810405+0000","last_active":"2023-10-06T02:27:42.810405+0000","last_peered":"2023-10-06T02:27:42.810405+0000","last_clean":"2023-10-06T02:27:42.810405+0000","last_became_active":"2023-10-06T02:27:42.810102+0000","last_became_peered":"2023-10-06T02:27:42.810102+0000","last_unstale":"2023-10-06T02:27:42.810405+0000","last_undegraded":"2023-10-06T02:27:42.810405+0000","last_fullsized":"2023-10-06T02:27:42.810405+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:28.180005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801182+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:31.134356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813189+0000","last_change":"2023-10-06T02:27:42.813189+0000","last_active":"2023-10-06T02:27:42.813189+0000","last_peered":"2023-10-06T02:27:42.813189+0000","last_clean":"2023-10-06T02:27:42.813189+0000","last_became_active":"2023-10-06T02:27:42.812916+0000","last_became_peered":"2023-10-06T02:27:42.812916+0000","last_unstale":"2023-10-06T02:27:42.813189+0000","last_undegraded":"2023-10-06T02:27:42.813189+0000","last_fullsized":"2023-10-06T02:27:42.813189+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:36:47.713799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799613+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:44.568108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.812184+0000","last_change":"2023-10-06T02:27:42.812184+0000","last_active":"2023-10-06T02:27:42.812184+0000","last_peered":"2023-10-06T02:27:42.812184+0000","last_clean":"2023-10-06T02:27:42.812184+0000","last_became_active":"2023-10-06T02:27:42.811906+0000","last_became_peered":"2023-10-06T02:27:42.811906+0000","last_unstale":"2023-10-06T02:27:42.812184+0000","last_undegraded":"2023-10-06T02:27:42.812184+0000","last_fullsized":"2023-10-06T02:27:42.812184+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:31.613891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799848+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:28.136884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.809545+0000","last_change":"2023-10-06T02:27:42.809545+0000","last_active":"2023-10-06T02:27:42.809545+0000","last_peered":"2023-10-06T02:27:42.809545+0000","last_clean":"2023-10-06T02:27:42.809545+0000","last_became_active":"2023-10-06T02:27:42.809216+0000","last_became_peered":"2023-10-06T02:27:42.809216+0000","last_unstale":"2023-10-06T02:27:42.809545+0000","last_undegraded":"2023-10-06T02:27:42.809545+0000","last_fullsized":"2023-10-06T02:27:42.809545+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:12.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800065+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:11.236431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813522+0000","last_change":"2023-10-06T02:27:42.813522+0000","last_active":"2023-10-06T02:27:42.813522+0000","last_peered":"2023-10-06T02:27:42.813522+0000","last_clean":"2023-10-06T02:27:42.813522+0000","last_became_active":"2023-10-06T02:27:42.813279+0000","last_became_peered":"2023-10-06T02:27:42.813279+0000","last_unstale":"2023-10-06T02:27:42.813522+0000","last_undegraded":"2023-10-06T02:27:42.813522+0000","last_fullsized":"2023-10-06T02:27:42.813522+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:59.272780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797159+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:42.464983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.811203+0000","last_change":"2023-10-06T02:27:42.811203+0000","last_active":"2023-10-06T02:27:42.811203+0000","last_peered":"2023-10-06T02:27:42.811203+0000","last_clean":"2023-10-06T02:27:42.811203+0000","last_became_active":"2023-10-06T02:27:42.810876+0000","last_became_peered":"2023-10-06T02:27:42.810876+0000","last_unstale":"2023-10-06T02:27:42.811203+0000","last_undegraded":"2023-10-06T02:27:42.811203+0000","last_fullsized":"2023-10-06T02:27:42.811203+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:28.067756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.796962+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:26.286335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.806843+0000","last_change":"2023-10-06T02:27:42.806843+0000","last_active":"2023-10-06T02:27:42.806843+0000","last_peered":"2023-10-06T02:27:42.806843+0000","last_clean":"2023-10-06T02:27:42.806843+0000","last_became_active":"2023-10-06T02:27:42.806561+0000","last_became_peered":"2023-10-06T02:27:42.806561+0000","last_unstale":"2023-10-06T02:27:42.806843+0000","last_undegraded":"2023-10-06T02:27:42.806843+0000","last_fullsized":"2023-10-06T02:27:42.806843+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:25.987778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800749+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:17.377369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.810765+0000","last_change":"2023-10-06T02:27:42.810765+0000","last_active":"2023-10-06T02:27:42.810765+0000","last_peered":"2023-10-06T02:27:42.810765+0000","last_clean":"2023-10-06T02:27:42.810765+0000","last_became_active":"2023-10-06T02:27:42.810012+0000","last_became_peered":"2023-10-06T02:27:42.810012+0000","last_unstale":"2023-10-06T02:27:42.810765+0000","last_undegraded":"2023-10-06T02:27:42.810765+0000","last_fullsized":"2023-10-06T02:27:42.810765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:16.962604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":56,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.791844+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:27:41.791844+0000","last_peered":"2023-10-06T02:27:41.791844+0000","last_clean":"2023-10-06T02:27:41.791844+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:27:41.791844+0000","last_undegraded":"2023-10-06T02:27:41.791844+0000","last_fullsized":"2023-10-06T02:27:41.791844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802069+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:55:50.706021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.806707+0000","last_change":"2023-10-06T02:27:42.806707+0000","last_active":"2023-10-06T02:27:42.806707+0000","last_peered":"2023-10-06T02:27:42.806707+0000","last_clean":"2023-10-06T02:27:42.806707+0000","last_became_active":"2023-10-06T02:27:42.806408+0000","last_became_peered":"2023-10-06T02:27:42.806408+0000","last_unstale":"2023-10-06T02:27:42.806707+0000","last_undegraded":"2023-10-06T02:27:42.806707+0000","last_fullsized":"2023-10-06T02:27:42.806707+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:41.460239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.795556+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:27:41.795556+0000","last_peered":"2023-10-06T02:27:41.795556+0000","last_clean":"2023-10-06T02:27:41.795556+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:27:41.795556+0000","last_undegraded":"2023-10-06T02:27:41.795556+0000","last_fullsized":"2023-10-06T02:27:41.795556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799401+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:46.415629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.809927+0000","last_change":"2023-10-06T02:27:42.809927+0000","last_active":"2023-10-06T02:27:42.809927+0000","last_peered":"2023-10-06T02:27:42.809927+0000","last_clean":"2023-10-06T02:27:42.809927+0000","last_became_active":"2023-10-06T02:27:42.809606+0000","last_became_peered":"2023-10-06T02:27:42.809606+0000","last_unstale":"2023-10-06T02:27:42.809927+0000","last_undegraded":"2023-10-06T02:27:42.809927+0000","last_fullsized":"2023-10-06T02:27:42.809927+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:08.742302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.796821+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:27:41.796821+0000","last_peered":"2023-10-06T02:27:41.796821+0000","last_clean":"2023-10-06T02:27:41.796821+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:27:41.796821+0000","last_undegraded":"2023-10-06T02:27:41.796821+0000","last_fullsized":"2023-10-06T02:27:41.796821+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":201,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.794607+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:27:41.794607+0000","last_peered":"2023-10-06T02:27:41.794607+0000","last_clean":"2023-10-06T02:27:41.794607+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:27:41.794607+0000","last_undegraded":"2023-10-06T02:27:41.794607+0000","last_fullsized":"2023-10-06T02:27:41.794607+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800805+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:16.944536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.810776+0000","last_change":"2023-10-06T02:27:42.810776+0000","last_active":"2023-10-06T02:27:42.810776+0000","last_peered":"2023-10-06T02:27:42.810776+0000","last_clean":"2023-10-06T02:27:42.810776+0000","last_became_active":"2023-10-06T02:27:42.810461+0000","last_became_peered":"2023-10-06T02:27:42.810461+0000","last_unstale":"2023-10-06T02:27:42.810776+0000","last_undegraded":"2023-10-06T02:27:42.810776+0000","last_fullsized":"2023-10-06T02:27:42.810776+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:00.718591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":51,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.794738+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:27:41.794738+0000","last_peered":"2023-10-06T02:27:41.794738+0000","last_clean":"2023-10-06T02:27:41.794738+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:27:41.794738+0000","last_undegraded":"2023-10-06T02:27:41.794738+0000","last_fullsized":"2023-10-06T02:27:41.794738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.804625+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:50.633626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.810898+0000","last_change":"2023-10-06T02:27:42.810898+0000","last_active":"2023-10-06T02:27:42.810898+0000","last_peered":"2023-10-06T02:27:42.810898+0000","last_clean":"2023-10-06T02:27:42.810898+0000","last_became_active":"2023-10-06T02:27:42.810582+0000","last_became_peered":"2023-10-06T02:27:42.810582+0000","last_unstale":"2023-10-06T02:27:42.810898+0000","last_undegraded":"2023-10-06T02:27:42.810898+0000","last_fullsized":"2023-10-06T02:27:42.810898+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:33.833254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":51,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.794696+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:27:41.794696+0000","last_peered":"2023-10-06T02:27:41.794696+0000","last_clean":"2023-10-06T02:27:41.794696+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:27:41.794696+0000","last_undegraded":"2023-10-06T02:27:41.794696+0000","last_fullsized":"2023-10-06T02:27:41.794696+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799338+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:54.179105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.810030+0000","last_change":"2023-10-06T02:27:42.810030+0000","last_active":"2023-10-06T02:27:42.810030+0000","last_peered":"2023-10-06T02:27:42.810030+0000","last_clean":"2023-10-06T02:27:42.810030+0000","last_became_active":"2023-10-06T02:27:42.809757+0000","last_became_peered":"2023-10-06T02:27:42.809757+0000","last_unstale":"2023-10-06T02:27:42.810030+0000","last_undegraded":"2023-10-06T02:27:42.810030+0000","last_fullsized":"2023-10-06T02:27:42.810030+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:49.628882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":62,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.792604+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:27:41.792604+0000","last_peered":"2023-10-06T02:27:41.792604+0000","last_clean":"2023-10-06T02:27:41.792604+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:27:41.792604+0000","last_undegraded":"2023-10-06T02:27:41.792604+0000","last_fullsized":"2023-10-06T02:27:41.792604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801580+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:28.225535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.806975+0000","last_change":"2023-10-06T02:27:42.806975+0000","last_active":"2023-10-06T02:27:42.806975+0000","last_peered":"2023-10-06T02:27:42.806975+0000","last_clean":"2023-10-06T02:27:42.806975+0000","last_became_active":"2023-10-06T02:27:42.806684+0000","last_became_peered":"2023-10-06T02:27:42.806684+0000","last_unstale":"2023-10-06T02:27:42.806975+0000","last_undegraded":"2023-10-06T02:27:42.806975+0000","last_fullsized":"2023-10-06T02:27:42.806975+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:25.314623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.796714+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:27:41.796714+0000","last_peered":"2023-10-06T02:27:41.796714+0000","last_clean":"2023-10-06T02:27:41.796714+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:27:41.796714+0000","last_undegraded":"2023-10-06T02:27:41.796714+0000","last_fullsized":"2023-10-06T02:27:41.796714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799894+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:12:09.790709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.811306+0000","last_change":"2023-10-06T02:27:42.811306+0000","last_active":"2023-10-06T02:27:42.811306+0000","last_peered":"2023-10-06T02:27:42.811306+0000","last_clean":"2023-10-06T02:27:42.811306+0000","last_became_active":"2023-10-06T02:27:42.811022+0000","last_became_peered":"2023-10-06T02:27:42.811022+0000","last_unstale":"2023-10-06T02:27:42.811306+0000","last_undegraded":"2023-10-06T02:27:42.811306+0000","last_fullsized":"2023-10-06T02:27:42.811306+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:08.022668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.796854+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:27:41.796854+0000","last_peered":"2023-10-06T02:27:41.796854+0000","last_clean":"2023-10-06T02:27:41.796854+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:27:41.796854+0000","last_undegraded":"2023-10-06T02:27:41.796854+0000","last_fullsized":"2023-10-06T02:27:41.796854+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298700,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073140,"statfs":{"total":96636764160,"available":96330895360,"internally_reserved":0,"allocated":1445888,"data_stored":968744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.311,"15min":0.311},"max":{"1min":0.69899999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.56899999999999995,"15min":0.55000000000000004},"min":{"1min":0.49199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.77400000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56100000000000005}]},{"osd":1,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54800000000000004,"15min":0.52200000000000002},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72299999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55800000000000005,"15min":0.54200000000000004},"min":{"1min":0.41999999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71499999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56799999999999995,"15min":0.55400000000000005},"min":{"1min":0.40999999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73099999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57599999999999996,"15min":0.55600000000000005},"min":{"1min":0.51900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76200000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59299999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72599999999999998,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57799999999999996,"15min":0.56399999999999995},"min":{"1min":0.372,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71699999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.34000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.68700000000000006,"5min":1.014,"15min":1.014},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64000000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.371,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66800000000000004,"5min":0.747,"15min":0.747},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55100000000000005,"15min":0.56399999999999995},"min":{"1min":0.39500000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69799999999999995,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.41399999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57499999999999996,"15min":0.58699999999999997},"min":{"1min":0.41499999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73599999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58399999999999996,"15min":0.59499999999999997},"min":{"1min":0.39300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.748,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.39800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298116,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073724,"statfs":{"total":96636764160,"available":96331493376,"internally_reserved":0,"allocated":847872,"data_stored":377023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64400000000000002,"15min":0.73599999999999999},"min":{"1min":0.41799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.77000000000000002,"5min":5.859,"15min":5.859},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.55800000000000005,"15min":0.54200000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79100000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.53900000000000003,"15min":0.52100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.754,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55200000000000005,"15min":0.53500000000000003},"min":{"1min":0.39000000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80700000000000005,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.499}]},{"osd":2,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77100000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85899999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.47699999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57599999999999996,"15min":0.55200000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83299999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82599999999999996,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.56299999999999994}]},{"osd":4,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67800000000000005,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.435},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.32500000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.73799999999999999,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.36299999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76600000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54800000000000004,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75600000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.58299999999999996},"min":{"1min":0.39200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.626},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298688,"kb_used_data":1400,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073152,"statfs":{"total":96636764160,"available":96330907648,"internally_reserved":0,"allocated":1433600,"data_stored":962128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36599999999999999,"15min":0.379},"min":{"1min":0.25800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.52500000000000002,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.53900000000000003,"15min":0.67300000000000004},"min":{"1min":0.32400000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58299999999999996,"5min":7.6900000000000004,"15min":7.6900000000000004},"last":0.27800000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.497,"15min":0.629},"min":{"1min":0.30099999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.50600000000000001,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.56200000000000006,"15min":0.70199999999999996},"min":{"1min":0.308,"5min":0.251,"15min":0.251},"max":{"1min":0.59499999999999997,"5min":7.758,"15min":7.758},"last":0.35799999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.59199999999999997,"15min":0.72899999999999998},"min":{"1min":0.35799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64700000000000002,"5min":7.7869999999999999,"15min":7.7869999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.42499999999999999},"min":{"1min":0.35499999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.625,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.29399999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.84599999999999997,"15min":1.0700000000000001},"min":{"1min":0.44,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76700000000000002,"5min":11.678000000000001,"15min":11.678000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.76400000000000001,"15min":0.90400000000000003},"min":{"1min":0.50900000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85399999999999998,"5min":7.6529999999999996,"15min":7.6529999999999996},"last":0.443}]},{"osd":5,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.42399999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81799999999999995,"5min":1.399,"15min":1.399},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.80600000000000005,"15min":0.93899999999999995},"min":{"1min":0.495,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84099999999999997,"5min":7.508,"15min":7.508},"last":0.48599999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.78000000000000003,"15min":0.91500000000000004},"min":{"1min":0.47399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83699999999999997,"5min":7.7270000000000003,"15min":7.7270000000000003},"last":0.501},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67300000000000004,"15min":0.68700000000000006},"min":{"1min":0.49399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.873,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.45700000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.497,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.92200000000000004,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.82999999999999996,"15min":0.96099999999999997},"min":{"1min":0.57199999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89200000000000002,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298104,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073736,"statfs":{"total":96636764160,"available":96331505664,"internally_reserved":0,"allocated":835584,"data_stored":370407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.35799999999999998,"15min":0.34699999999999998},"min":{"1min":0.23699999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.53400000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.38,"15min":0.36499999999999999},"min":{"1min":0.29399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51700000000000002,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.307}]},{"osd":2,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.39800000000000002,"15min":0.38900000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57299999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.57199999999999995,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.36799999999999999,"15min":0.35499999999999998},"min":{"1min":0.27500000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.52800000000000002,"5min":0.622,"15min":0.622},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.41199999999999998,"15min":0.39700000000000002},"min":{"1min":0.312,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60899999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95999999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64600000000000002,"15min":0.63900000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94599999999999995,"5min":1.008,"15min":1.008},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81899999999999995,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.621,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93100000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.505}]},{"osd":6,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.47899999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.98899999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.46500000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88700000000000001,"5min":1,"15min":1},"last":0.439}]},{"osd":7,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91600000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.97399999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.56499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":378376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.34799999999999998,"15min":0.33900000000000002},"min":{"1min":0.28899999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38,"15min":0.38200000000000001},"min":{"1min":0.29099999999999998,"5min":0.218,"15min":0.218},"max":{"1min":0.48499999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.29399999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.35999999999999999,"15min":0.34999999999999998},"min":{"1min":0.27200000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.311},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.40500000000000003,"15min":0.40000000000000002},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59199999999999997,"5min":0.621,"15min":0.621},"last":0.375}]},{"osd":3,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42499999999999999,"15min":0.41099999999999998},"min":{"1min":0.35099999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.373,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85199999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88700000000000001,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.58399999999999996,"5min":0.437,"15min":0.437},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.52500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.95399999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.56200000000000006}]},{"osd":6,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.498,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95699999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.52600000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.60999999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.498,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91700000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.503,"5min":0.439,"15min":0.439},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.57399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298116,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073724,"statfs":{"total":96636764160,"available":96331493376,"internally_reserved":0,"allocated":847872,"data_stored":377023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.52900000000000003,"15min":0.69099999999999995},"min":{"1min":0.216,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.61799999999999999,"5min":10.164999999999999,"15min":10.164999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40600000000000003,"15min":0.41099999999999998},"min":{"1min":0.26600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.57899999999999996,"5min":1.266,"15min":1.266},"last":0.318}]},{"osd":1,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42099999999999999,"15min":0.42899999999999999},"min":{"1min":0.27800000000000002,"5min":0.191,"15min":0.191},"max":{"1min":0.58399999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.42999999999999999,"15min":0.432},"min":{"1min":0.311,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66600000000000004,"5min":1.319,"15min":1.319},"last":0.376}]},{"osd":2,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.442,"15min":0.44},"min":{"1min":0.36099999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.627,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.47999999999999998,"15min":0.48899999999999999},"min":{"1min":0.33300000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.68700000000000006,"5min":1.5,"15min":1.5},"last":0.30599999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63700000000000001,"15min":0.63200000000000001},"min":{"1min":0.49299999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88800000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.503},{"interface":"front","average":{"1min":0.629,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.44600000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93100000000000005,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.501,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86299999999999999,"5min":1.538,"15min":1.538},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.64300000000000002},"min":{"1min":0.499,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84299999999999997,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.625,"15min":0.61399999999999999},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.88900000000000001,"5min":1.111,"15min":1.111},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90600000000000003,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.58299999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.47699999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.876,"5min":1.21,"15min":1.21},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.48599999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86199999999999999,"5min":1.135,"15min":1.135},"last":0.49199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":378376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.78800000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54100000000000004,"15min":0.51300000000000001},"min":{"1min":0.42099999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.51500000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.53300000000000003,"15min":0.501},"min":{"1min":0.40600000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.48199999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59099999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.40500000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.75800000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.46600000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77000000000000002,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.497,"15min":0.48999999999999999},"min":{"1min":0.43099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76800000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.443},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.79100000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.47399999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.36399999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75600000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.372,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76700000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.48799999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.34200000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80100000000000005,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.34599999999999997,"5min":0.308,"15min":0.308},"max":{"1min":0.83999999999999997,"5min":1.04,"15min":1.04},"last":0.45700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":378376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.51600000000000001,"15min":0.498},"min":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51300000000000001,"15min":0.49099999999999999},"min":{"1min":0.45600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.52300000000000002,"15min":0.49399999999999999},"min":{"1min":0.42899999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.51300000000000001,"15min":0.498},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.50800000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.58899999999999997,"15min":0.57399999999999995},"min":{"1min":0.46200000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.623}]},{"osd":3,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.53400000000000003,"15min":0.51600000000000001},"min":{"1min":0.40699999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.64600000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.47799999999999998,"15min":0.48899999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.60399999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51100000000000001,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69299999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.56699999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.32200000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.71099999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54700000000000004,"15min":0.56699999999999995},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68999999999999995,"5min":0.873,"15min":0.873},"last":0.41799999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54300000000000004,"15min":0.56299999999999994},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69699999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57299999999999995,"15min":0.60099999999999998},"min":{"1min":0.38,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67600000000000005,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:27:47.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:27:48.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.090+0000 7f35d8de0700 1 Processor -- start 2023-10-06T02:27:48.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.091+0000 7f35d8de0700 1 -- start start 2023-10-06T02:27:48.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.091+0000 7f35d8de0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35d4159760 0x7f35d415d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.091+0000 7f35d8de0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f35d415d8d0 0x7f35d415dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.091+0000 7f35d8de0700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f35d40c5390 0x7f35d40c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.091+0000 7f35d8de0700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d40cc2d0 con 0x7f35d415d8d0 2023-10-06T02:27:48.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.091+0000 7f35d8de0700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d415e260 con 0x7f35d40c5390 2023-10-06T02:27:48.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.091+0000 7f35d8de0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40cb650 con 0x7f35d4159760 2023-10-06T02:27:48.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.092+0000 7f35d1d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f35d415d8d0 0x7f35d415dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.092+0000 7f35d1d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f35d415d8d0 0x7f35d415dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53040/0 (socket says 172.21.15.37:53040) 2023-10-06T02:27:48.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.092+0000 7f35d1d9b700 1 -- 172.21.15.37:0/1352795198 learned_addr learned my addr 172.21.15.37:0/1352795198 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:48.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.092+0000 7f35d2d9d700 1 --2- 172.21.15.37:0/1352795198 >> v2:172.21.15.191:3300/0 conn(0x7f35d40c5390 0x7f35d40c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.092+0000 7f35d1d9b700 1 -- 172.21.15.37:0/1352795198 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35d4159760 msgr2=0x7f35d415d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:48.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.092+0000 7f35d1d9b700 1 --2- 172.21.15.37:0/1352795198 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35d4159760 0x7f35d415d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.092+0000 7f35d1d9b700 1 -- 172.21.15.37:0/1352795198 >> v2:172.21.15.191:3300/0 conn(0x7f35d40c5390 msgr2=0x7f35d40c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:48.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.092+0000 7f35d1d9b700 1 --2- 172.21.15.37:0/1352795198 >> v2:172.21.15.191:3300/0 conn(0x7f35d40c5390 0x7f35d40c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.092+0000 7f35d1d9b700 1 -- 172.21.15.37:0/1352795198 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d40cb930 con 0x7f35d415d8d0 2023-10-06T02:27:48.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.092+0000 7f35d1d9b700 1 --2- 172.21.15.37:0/1352795198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d415d8d0 0x7f35d415dd20 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f35d4089980 tx=0x7f35bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6490ce9dab98016d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:48.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.092+0000 7f35d159a700 1 -- 172.21.15.37:0/1352795198 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc00b8f0 con 0x7f35d415d8d0 2023-10-06T02:27:48.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.092+0000 7f35d159a700 1 -- 172.21.15.37:0/1352795198 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35bc00ba50 con 0x7f35d415d8d0 2023-10-06T02:27:48.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.092+0000 7f35d159a700 1 -- 172.21.15.37:0/1352795198 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc00bdf0 con 0x7f35d415d8d0 2023-10-06T02:27:48.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.093+0000 7f35d8de0700 1 -- 172.21.15.37:0/1352795198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d415d8d0 msgr2=0x7f35d415dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.093+0000 7f35d8de0700 1 --2- 172.21.15.37:0/1352795198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d415d8d0 0x7f35d415dd20 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f35d4089980 tx=0x7f35bc009250 comp rx=0 tx=0).stop 2023-10-06T02:27:48.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.093+0000 7f35d8de0700 1 -- 172.21.15.37:0/1352795198 shutdown_connections 2023-10-06T02:27:48.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.093+0000 7f35d8de0700 1 --2- 172.21.15.37:0/1352795198 >> v2:172.21.15.191:3300/0 conn(0x7f35d40c5390 0x7f35d40c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.093+0000 7f35d8de0700 1 --2- 172.21.15.37:0/1352795198 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35d4159760 0x7f35d415d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.093+0000 7f35d8de0700 1 --2- 172.21.15.37:0/1352795198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d415d8d0 0x7f35d415dd20 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.093+0000 7f35d8de0700 1 -- 172.21.15.37:0/1352795198 >> 172.21.15.37:0/1352795198 conn(0x7f35d406c890 msgr2=0x7f35d40d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:48.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.093+0000 7f35d8de0700 1 -- 172.21.15.37:0/1352795198 shutdown_connections 2023-10-06T02:27:48.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.093+0000 7f35d8de0700 1 -- 172.21.15.37:0/1352795198 wait complete. 2023-10-06T02:27:48.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.094+0000 7f35d8de0700 1 Processor -- start 2023-10-06T02:27:48.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.094+0000 7f35d8de0700 1 -- start start 2023-10-06T02:27:48.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35d8de0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35d40c5390 0x7f35d40b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35d8de0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d4159760 0x7f35d415aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35d8de0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35d415d8d0 0x7f35d4144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35d8de0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40b3300 con 0x7f35d4159760 2023-10-06T02:27:48.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35d8de0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d415b3c0 con 0x7f35d415d8d0 2023-10-06T02:27:48.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35d8de0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40b3550 con 0x7f35d40c5390 2023-10-06T02:27:48.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35d1d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d4159760 0x7f35d415aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35d1d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d4159760 0x7f35d415aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53046/0 (socket says 172.21.15.37:53046) 2023-10-06T02:27:48.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35d1d9b700 1 -- 172.21.15.37:0/1916909517 learned_addr learned my addr 172.21.15.37:0/1916909517 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:48.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35d2d9d700 1 --2- 172.21.15.37:0/1916909517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35d415d8d0 0x7f35d4144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35d259c700 1 --2- 172.21.15.37:0/1916909517 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35d40c5390 0x7f35d40b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35d1d9b700 1 -- 172.21.15.37:0/1916909517 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35d40c5390 msgr2=0x7f35d40b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35d1d9b700 1 --2- 172.21.15.37:0/1916909517 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35d40c5390 0x7f35d40b59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35d1d9b700 1 -- 172.21.15.37:0/1916909517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35d415d8d0 msgr2=0x7f35d4144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35d1d9b700 1 --2- 172.21.15.37:0/1916909517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35d415d8d0 0x7f35d4144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35d1d9b700 1 -- 172.21.15.37:0/1916909517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc0094f0 con 0x7f35d4159760 2023-10-06T02:27:48.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35d2d9d700 1 --2- 172.21.15.37:0/1916909517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35d415d8d0 0x7f35d4144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:27:48.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35d1d9b700 1 --2- 172.21.15.37:0/1916909517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d4159760 0x7f35d415aa00 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f35bc009290 tx=0x7f35bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:48.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35ca7fc700 1 -- 172.21.15.37:0/1916909517 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc011e60 con 0x7f35d4159760 2023-10-06T02:27:48.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35ca7fc700 1 -- 172.21.15.37:0/1916909517 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35bc01f070 con 0x7f35d4159760 2023-10-06T02:27:48.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.095+0000 7f35d8de0700 1 -- 172.21.15.37:0/1916909517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d40b3830 con 0x7f35d4159760 2023-10-06T02:27:48.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.096+0000 7f35ca7fc700 1 -- 172.21.15.37:0/1916909517 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc01a890 con 0x7f35d4159760 2023-10-06T02:27:48.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.096+0000 7f35d8de0700 1 -- 172.21.15.37:0/1916909517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d41565c0 con 0x7f35d4159760 2023-10-06T02:27:48.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.096+0000 7f35d8de0700 1 -- 172.21.15.37:0/1916909517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d40b3d20 con 0x7f35d4159760 2023-10-06T02:27:48.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.097+0000 7f35ca7fc700 1 -- 172.21.15.37:0/1916909517 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f35bc01ac00 con 0x7f35d4159760 2023-10-06T02:27:48.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.097+0000 7f35ca7fc700 1 --2- 172.21.15.37:0/1916909517 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f35b4066f30 0x7f35b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.097+0000 7f35ca7fc700 1 -- 172.21.15.37:0/1916909517 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f35bc021070 con 0x7f35d4159760 2023-10-06T02:27:48.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.098+0000 7f35d259c700 1 --2- 172.21.15.37:0/1916909517 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f35b4066f30 0x7f35b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.098+0000 7f35d259c700 1 --2- 172.21.15.37:0/1916909517 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f35b4066f30 0x7f35b40693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f35cc006fd0 tx=0x7f35cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:48.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.101+0000 7f35ca7fc700 1 -- 172.21.15.37:0/1916909517 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35bc0538b0 con 0x7f35d4159760 2023-10-06T02:27:48.111 INFO:tasks.ceph.mds.d.smithi191.stderr:2023-10-06T02:27:48.111+0000 7ff194ae9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:27:48.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.291+0000 7f35d8de0700 1 -- 172.21.15.37:0/1916909517 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35d406fbf0 con 0x7f35b4066f30 2023-10-06T02:27:48.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.300+0000 7f35ca7fc700 1 -- 172.21.15.37:0/1916909517 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309022 (secure 0 0 0) 0x7f35d406fbf0 con 0x7f35b4066f30 2023-10-06T02:27:48.304 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:48.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.303+0000 7f35d8de0700 1 -- 172.21.15.37:0/1916909517 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f35b4066f30 msgr2=0x7f35b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.303+0000 7f35d8de0700 1 --2- 172.21.15.37:0/1916909517 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f35b4066f30 0x7f35b40693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f35cc006fd0 tx=0x7f35cc008040 comp rx=0 tx=0).stop 2023-10-06T02:27:48.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.303+0000 7f35d8de0700 1 -- 172.21.15.37:0/1916909517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d4159760 msgr2=0x7f35d415aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.303+0000 7f35d8de0700 1 --2- 172.21.15.37:0/1916909517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d4159760 0x7f35d415aa00 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f35bc009290 tx=0x7f35bc017000 comp rx=0 tx=0).stop 2023-10-06T02:27:48.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.303+0000 7f35d8de0700 1 -- 172.21.15.37:0/1916909517 shutdown_connections 2023-10-06T02:27:48.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.303+0000 7f35d8de0700 1 --2- 172.21.15.37:0/1916909517 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f35b4066f30 0x7f35b40693e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.303+0000 7f35d8de0700 1 --2- 172.21.15.37:0/1916909517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35d415d8d0 0x7f35d4144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.303+0000 7f35d8de0700 1 --2- 172.21.15.37:0/1916909517 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35d40c5390 0x7f35d40b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.303+0000 7f35d8de0700 1 --2- 172.21.15.37:0/1916909517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d4159760 0x7f35d415aa00 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.303+0000 7f35d8de0700 1 -- 172.21.15.37:0/1916909517 >> 172.21.15.37:0/1916909517 conn(0x7f35d406c890 msgr2=0x7f35d406d930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:48.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.303+0000 7f35d8de0700 1 -- 172.21.15.37:0/1916909517 shutdown_connections 2023-10-06T02:27:48.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.303+0000 7f35d8de0700 1 -- 172.21.15.37:0/1916909517 wait complete. 2023-10-06T02:27:48.308 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:27:48.316 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2023-10-06T02:27:46.575715+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2386084,"kb_used_data":7780,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752588636,"statfs":{"total":773094113280,"available":770650763264,"internally_reserved":0,"allocated":7966720,"data_stored":4190453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.786925"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802518+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:53.218389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.807980+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:00.209850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.796866+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:36.224572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.798550+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:53.218389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802678+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:04.289183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801743+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:17.054182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801456+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:59.316808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802858+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:45:34.837248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801293+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:11.571663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.798313+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:33.606927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.807955+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:44.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797984+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:46.415629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802208+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:54.211724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801195+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:00.209850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.809053+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:17.377369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802426+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:33.606927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802907+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:28.926179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797755+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:46.464705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.803032+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:03.886385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800763+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:30.519208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.803836+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:36:48.718543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.805193+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:47.636151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802680+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:40.040632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.808461+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:28.225535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801398+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:01.723335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797772+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:54.179105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.807304+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:34.837998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800268+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:03.752060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800980+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:09.747047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.805049+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:09.747047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.796734+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:28:34.237238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801944+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:46.415629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797008+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:14.723560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813044+0000","last_change":"2023-10-06T02:27:42.813044+0000","last_active":"2023-10-06T02:27:42.813044+0000","last_peered":"2023-10-06T02:27:42.813044+0000","last_clean":"2023-10-06T02:27:42.813044+0000","last_became_active":"2023-10-06T02:27:42.812776+0000","last_became_peered":"2023-10-06T02:27:42.812776+0000","last_unstale":"2023-10-06T02:27:42.813044+0000","last_undegraded":"2023-10-06T02:27:42.813044+0000","last_fullsized":"2023-10-06T02:27:42.813044+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:47.491511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799411+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:33.606927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.812884+0000","last_change":"2023-10-06T02:27:42.812884+0000","last_active":"2023-10-06T02:27:42.812884+0000","last_peered":"2023-10-06T02:27:42.812884+0000","last_clean":"2023-10-06T02:27:42.812884+0000","last_became_active":"2023-10-06T02:27:42.812665+0000","last_became_peered":"2023-10-06T02:27:42.812665+0000","last_unstale":"2023-10-06T02:27:42.812884+0000","last_undegraded":"2023-10-06T02:27:42.812884+0000","last_fullsized":"2023-10-06T02:27:42.812884+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:29.170337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802146+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:15.684258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.815975+0000","last_change":"2023-10-06T02:27:42.815975+0000","last_active":"2023-10-06T02:27:42.815975+0000","last_peered":"2023-10-06T02:27:42.815975+0000","last_clean":"2023-10-06T02:27:42.815975+0000","last_became_active":"2023-10-06T02:27:42.815717+0000","last_became_peered":"2023-10-06T02:27:42.815717+0000","last_unstale":"2023-10-06T02:27:42.815975+0000","last_undegraded":"2023-10-06T02:27:42.815975+0000","last_fullsized":"2023-10-06T02:27:42.815975+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:43.563364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802182+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:09.677215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.814055+0000","last_change":"2023-10-06T02:27:42.814055+0000","last_active":"2023-10-06T02:27:42.814055+0000","last_peered":"2023-10-06T02:27:42.814055+0000","last_clean":"2023-10-06T02:27:42.814055+0000","last_became_active":"2023-10-06T02:27:42.813793+0000","last_became_peered":"2023-10-06T02:27:42.813793+0000","last_unstale":"2023-10-06T02:27:42.814055+0000","last_undegraded":"2023-10-06T02:27:42.814055+0000","last_fullsized":"2023-10-06T02:27:42.814055+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:30.927523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800029+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:53.218389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.811221+0000","last_change":"2023-10-06T02:27:42.811221+0000","last_active":"2023-10-06T02:27:42.811221+0000","last_peered":"2023-10-06T02:27:42.811221+0000","last_clean":"2023-10-06T02:27:42.811221+0000","last_became_active":"2023-10-06T02:27:42.810661+0000","last_became_peered":"2023-10-06T02:27:42.810661+0000","last_unstale":"2023-10-06T02:27:42.811221+0000","last_undegraded":"2023-10-06T02:27:42.811221+0000","last_fullsized":"2023-10-06T02:27:42.811221+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:25.281591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800116+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:20.572015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.811978+0000","last_change":"2023-10-06T02:27:42.811978+0000","last_active":"2023-10-06T02:27:42.811978+0000","last_peered":"2023-10-06T02:27:42.811978+0000","last_clean":"2023-10-06T02:27:42.811978+0000","last_became_active":"2023-10-06T02:27:42.811662+0000","last_became_peered":"2023-10-06T02:27:42.811662+0000","last_unstale":"2023-10-06T02:27:42.811978+0000","last_undegraded":"2023-10-06T02:27:42.811978+0000","last_fullsized":"2023-10-06T02:27:42.811978+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:31.613891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802265+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:37:46.334285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813508+0000","last_change":"2023-10-06T02:27:42.813508+0000","last_active":"2023-10-06T02:27:42.813508+0000","last_peered":"2023-10-06T02:27:42.813508+0000","last_clean":"2023-10-06T02:27:42.813508+0000","last_became_active":"2023-10-06T02:27:42.813249+0000","last_became_peered":"2023-10-06T02:27:42.813249+0000","last_unstale":"2023-10-06T02:27:42.813508+0000","last_undegraded":"2023-10-06T02:27:42.813508+0000","last_fullsized":"2023-10-06T02:27:42.813508+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:29.170337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801313+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:59.814849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.811677+0000","last_change":"2023-10-06T02:27:42.811677+0000","last_active":"2023-10-06T02:27:42.811677+0000","last_peered":"2023-10-06T02:27:42.811677+0000","last_clean":"2023-10-06T02:27:42.811677+0000","last_became_active":"2023-10-06T02:27:42.811370+0000","last_became_peered":"2023-10-06T02:27:42.811370+0000","last_unstale":"2023-10-06T02:27:42.811677+0000","last_undegraded":"2023-10-06T02:27:42.811677+0000","last_fullsized":"2023-10-06T02:27:42.811677+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:55:16.818646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800463+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:50.633626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813430+0000","last_change":"2023-10-06T02:27:42.813430+0000","last_active":"2023-10-06T02:27:42.813430+0000","last_peered":"2023-10-06T02:27:42.813430+0000","last_clean":"2023-10-06T02:27:42.813430+0000","last_became_active":"2023-10-06T02:27:42.813263+0000","last_became_peered":"2023-10-06T02:27:42.813263+0000","last_unstale":"2023-10-06T02:27:42.813430+0000","last_undegraded":"2023-10-06T02:27:42.813430+0000","last_fullsized":"2023-10-06T02:27:42.813430+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:28.180005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.798675+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:17.967348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.812967+0000","last_change":"2023-10-06T02:27:42.812967+0000","last_active":"2023-10-06T02:27:42.812967+0000","last_peered":"2023-10-06T02:27:42.812967+0000","last_clean":"2023-10-06T02:27:42.812967+0000","last_became_active":"2023-10-06T02:27:42.812686+0000","last_became_peered":"2023-10-06T02:27:42.812686+0000","last_unstale":"2023-10-06T02:27:42.812967+0000","last_undegraded":"2023-10-06T02:27:42.812967+0000","last_fullsized":"2023-10-06T02:27:42.812967+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:36:47.713799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800249+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:44.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.815152+0000","last_change":"2023-10-06T02:27:42.815152+0000","last_active":"2023-10-06T02:27:42.815152+0000","last_peered":"2023-10-06T02:27:42.815152+0000","last_clean":"2023-10-06T02:27:42.815152+0000","last_became_active":"2023-10-06T02:27:42.814822+0000","last_became_peered":"2023-10-06T02:27:42.814822+0000","last_unstale":"2023-10-06T02:27:42.815152+0000","last_undegraded":"2023-10-06T02:27:42.815152+0000","last_fullsized":"2023-10-06T02:27:42.815152+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:48.778361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.796949+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:56.326934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.806783+0000","last_change":"2023-10-06T02:27:42.806783+0000","last_active":"2023-10-06T02:27:42.806783+0000","last_peered":"2023-10-06T02:27:42.806783+0000","last_clean":"2023-10-06T02:27:42.806783+0000","last_became_active":"2023-10-06T02:27:42.806497+0000","last_became_peered":"2023-10-06T02:27:42.806497+0000","last_unstale":"2023-10-06T02:27:42.806783+0000","last_undegraded":"2023-10-06T02:27:42.806783+0000","last_fullsized":"2023-10-06T02:27:42.806783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:43:44.444253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797396+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:44.568108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.805768+0000","last_change":"2023-10-06T02:27:42.805768+0000","last_active":"2023-10-06T02:27:42.805768+0000","last_peered":"2023-10-06T02:27:42.805768+0000","last_clean":"2023-10-06T02:27:42.805768+0000","last_became_active":"2023-10-06T02:27:42.805483+0000","last_became_peered":"2023-10-06T02:27:42.805483+0000","last_unstale":"2023-10-06T02:27:42.805768+0000","last_undegraded":"2023-10-06T02:27:42.805768+0000","last_fullsized":"2023-10-06T02:27:42.805768+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:39.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800542+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:41.827434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.812082+0000","last_change":"2023-10-06T02:27:42.812082+0000","last_active":"2023-10-06T02:27:42.812082+0000","last_peered":"2023-10-06T02:27:42.812082+0000","last_clean":"2023-10-06T02:27:42.812082+0000","last_became_active":"2023-10-06T02:27:42.811811+0000","last_became_peered":"2023-10-06T02:27:42.811811+0000","last_unstale":"2023-10-06T02:27:42.812082+0000","last_undegraded":"2023-10-06T02:27:42.812082+0000","last_fullsized":"2023-10-06T02:27:42.812082+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:39.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799930+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:12:06.792194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813049+0000","last_change":"2023-10-06T02:27:42.813049+0000","last_active":"2023-10-06T02:27:42.813049+0000","last_peered":"2023-10-06T02:27:42.813049+0000","last_clean":"2023-10-06T02:27:42.813049+0000","last_became_active":"2023-10-06T02:27:42.812763+0000","last_became_peered":"2023-10-06T02:27:42.812763+0000","last_unstale":"2023-10-06T02:27:42.813049+0000","last_undegraded":"2023-10-06T02:27:42.813049+0000","last_fullsized":"2023-10-06T02:27:42.813049+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:09.771266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799859+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:58.171529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.812011+0000","last_change":"2023-10-06T02:27:42.812011+0000","last_active":"2023-10-06T02:27:42.812011+0000","last_peered":"2023-10-06T02:27:42.812011+0000","last_clean":"2023-10-06T02:27:42.812011+0000","last_became_active":"2023-10-06T02:27:42.810343+0000","last_became_peered":"2023-10-06T02:27:42.810343+0000","last_unstale":"2023-10-06T02:27:42.812011+0000","last_undegraded":"2023-10-06T02:27:42.812011+0000","last_fullsized":"2023-10-06T02:27:42.812011+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:31.613891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802247+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:46.057716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.809942+0000","last_change":"2023-10-06T02:27:42.809942+0000","last_active":"2023-10-06T02:27:42.809942+0000","last_peered":"2023-10-06T02:27:42.809942+0000","last_clean":"2023-10-06T02:27:42.809942+0000","last_became_active":"2023-10-06T02:27:42.809577+0000","last_became_peered":"2023-10-06T02:27:42.809577+0000","last_unstale":"2023-10-06T02:27:42.809942+0000","last_undegraded":"2023-10-06T02:27:42.809942+0000","last_fullsized":"2023-10-06T02:27:42.809942+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:28.180005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801000+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:55:31.826969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.810405+0000","last_change":"2023-10-06T02:27:42.810405+0000","last_active":"2023-10-06T02:27:42.810405+0000","last_peered":"2023-10-06T02:27:42.810405+0000","last_clean":"2023-10-06T02:27:42.810405+0000","last_became_active":"2023-10-06T02:27:42.810102+0000","last_became_peered":"2023-10-06T02:27:42.810102+0000","last_unstale":"2023-10-06T02:27:42.810405+0000","last_undegraded":"2023-10-06T02:27:42.810405+0000","last_fullsized":"2023-10-06T02:27:42.810405+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:28.180005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801182+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:31.134356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813189+0000","last_change":"2023-10-06T02:27:42.813189+0000","last_active":"2023-10-06T02:27:42.813189+0000","last_peered":"2023-10-06T02:27:42.813189+0000","last_clean":"2023-10-06T02:27:42.813189+0000","last_became_active":"2023-10-06T02:27:42.812916+0000","last_became_peered":"2023-10-06T02:27:42.812916+0000","last_unstale":"2023-10-06T02:27:42.813189+0000","last_undegraded":"2023-10-06T02:27:42.813189+0000","last_fullsized":"2023-10-06T02:27:42.813189+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:36:47.713799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799613+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:44.568108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.812184+0000","last_change":"2023-10-06T02:27:42.812184+0000","last_active":"2023-10-06T02:27:42.812184+0000","last_peered":"2023-10-06T02:27:42.812184+0000","last_clean":"2023-10-06T02:27:42.812184+0000","last_became_active":"2023-10-06T02:27:42.811906+0000","last_became_peered":"2023-10-06T02:27:42.811906+0000","last_unstale":"2023-10-06T02:27:42.812184+0000","last_undegraded":"2023-10-06T02:27:42.812184+0000","last_fullsized":"2023-10-06T02:27:42.812184+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:31.613891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799848+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:28.136884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.809545+0000","last_change":"2023-10-06T02:27:42.809545+0000","last_active":"2023-10-06T02:27:42.809545+0000","last_peered":"2023-10-06T02:27:42.809545+0000","last_clean":"2023-10-06T02:27:42.809545+0000","last_became_active":"2023-10-06T02:27:42.809216+0000","last_became_peered":"2023-10-06T02:27:42.809216+0000","last_unstale":"2023-10-06T02:27:42.809545+0000","last_undegraded":"2023-10-06T02:27:42.809545+0000","last_fullsized":"2023-10-06T02:27:42.809545+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:12.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800065+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:11.236431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813522+0000","last_change":"2023-10-06T02:27:42.813522+0000","last_active":"2023-10-06T02:27:42.813522+0000","last_peered":"2023-10-06T02:27:42.813522+0000","last_clean":"2023-10-06T02:27:42.813522+0000","last_became_active":"2023-10-06T02:27:42.813279+0000","last_became_peered":"2023-10-06T02:27:42.813279+0000","last_unstale":"2023-10-06T02:27:42.813522+0000","last_undegraded":"2023-10-06T02:27:42.813522+0000","last_fullsized":"2023-10-06T02:27:42.813522+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:59.272780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797159+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:42.464983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.811203+0000","last_change":"2023-10-06T02:27:42.811203+0000","last_active":"2023-10-06T02:27:42.811203+0000","last_peered":"2023-10-06T02:27:42.811203+0000","last_clean":"2023-10-06T02:27:42.811203+0000","last_became_active":"2023-10-06T02:27:42.810876+0000","last_became_peered":"2023-10-06T02:27:42.810876+0000","last_unstale":"2023-10-06T02:27:42.811203+0000","last_undegraded":"2023-10-06T02:27:42.811203+0000","last_fullsized":"2023-10-06T02:27:42.811203+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:28.067756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.796962+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:26.286335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.806843+0000","last_change":"2023-10-06T02:27:42.806843+0000","last_active":"2023-10-06T02:27:42.806843+0000","last_peered":"2023-10-06T02:27:42.806843+0000","last_clean":"2023-10-06T02:27:42.806843+0000","last_became_active":"2023-10-06T02:27:42.806561+0000","last_became_peered":"2023-10-06T02:27:42.806561+0000","last_unstale":"2023-10-06T02:27:42.806843+0000","last_undegraded":"2023-10-06T02:27:42.806843+0000","last_fullsized":"2023-10-06T02:27:42.806843+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:25.987778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800749+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:17.377369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.810765+0000","last_change":"2023-10-06T02:27:42.810765+0000","last_active":"2023-10-06T02:27:42.810765+0000","last_peered":"2023-10-06T02:27:42.810765+0000","last_clean":"2023-10-06T02:27:42.810765+0000","last_became_active":"2023-10-06T02:27:42.810012+0000","last_became_peered":"2023-10-06T02:27:42.810012+0000","last_unstale":"2023-10-06T02:27:42.810765+0000","last_undegraded":"2023-10-06T02:27:42.810765+0000","last_fullsized":"2023-10-06T02:27:42.810765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:16.962604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":56,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.791844+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:27:41.791844+0000","last_peered":"2023-10-06T02:27:41.791844+0000","last_clean":"2023-10-06T02:27:41.791844+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:27:41.791844+0000","last_undegraded":"2023-10-06T02:27:41.791844+0000","last_fullsized":"2023-10-06T02:27:41.791844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802069+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:55:50.706021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.806707+0000","last_change":"2023-10-06T02:27:42.806707+0000","last_active":"2023-10-06T02:27:42.806707+0000","last_peered":"2023-10-06T02:27:42.806707+0000","last_clean":"2023-10-06T02:27:42.806707+0000","last_became_active":"2023-10-06T02:27:42.806408+0000","last_became_peered":"2023-10-06T02:27:42.806408+0000","last_unstale":"2023-10-06T02:27:42.806707+0000","last_undegraded":"2023-10-06T02:27:42.806707+0000","last_fullsized":"2023-10-06T02:27:42.806707+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:41.460239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.795556+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:27:41.795556+0000","last_peered":"2023-10-06T02:27:41.795556+0000","last_clean":"2023-10-06T02:27:41.795556+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:27:41.795556+0000","last_undegraded":"2023-10-06T02:27:41.795556+0000","last_fullsized":"2023-10-06T02:27:41.795556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799401+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:46.415629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.809927+0000","last_change":"2023-10-06T02:27:42.809927+0000","last_active":"2023-10-06T02:27:42.809927+0000","last_peered":"2023-10-06T02:27:42.809927+0000","last_clean":"2023-10-06T02:27:42.809927+0000","last_became_active":"2023-10-06T02:27:42.809606+0000","last_became_peered":"2023-10-06T02:27:42.809606+0000","last_unstale":"2023-10-06T02:27:42.809927+0000","last_undegraded":"2023-10-06T02:27:42.809927+0000","last_fullsized":"2023-10-06T02:27:42.809927+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:08.742302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.796821+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:27:41.796821+0000","last_peered":"2023-10-06T02:27:41.796821+0000","last_clean":"2023-10-06T02:27:41.796821+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:27:41.796821+0000","last_undegraded":"2023-10-06T02:27:41.796821+0000","last_fullsized":"2023-10-06T02:27:41.796821+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":201,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.794607+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:27:41.794607+0000","last_peered":"2023-10-06T02:27:41.794607+0000","last_clean":"2023-10-06T02:27:41.794607+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:27:41.794607+0000","last_undegraded":"2023-10-06T02:27:41.794607+0000","last_fullsized":"2023-10-06T02:27:41.794607+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800805+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:16.944536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.810776+0000","last_change":"2023-10-06T02:27:42.810776+0000","last_active":"2023-10-06T02:27:42.810776+0000","last_peered":"2023-10-06T02:27:42.810776+0000","last_clean":"2023-10-06T02:27:42.810776+0000","last_became_active":"2023-10-06T02:27:42.810461+0000","last_became_peered":"2023-10-06T02:27:42.810461+0000","last_unstale":"2023-10-06T02:27:42.810776+0000","last_undegraded":"2023-10-06T02:27:42.810776+0000","last_fullsized":"2023-10-06T02:27:42.810776+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:00.718591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":51,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.794738+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:27:41.794738+0000","last_peered":"2023-10-06T02:27:41.794738+0000","last_clean":"2023-10-06T02:27:41.794738+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:27:41.794738+0000","last_undegraded":"2023-10-06T02:27:41.794738+0000","last_fullsized":"2023-10-06T02:27:41.794738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.804625+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:50.633626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.810898+0000","last_change":"2023-10-06T02:27:42.810898+0000","last_active":"2023-10-06T02:27:42.810898+0000","last_peered":"2023-10-06T02:27:42.810898+0000","last_clean":"2023-10-06T02:27:42.810898+0000","last_became_active":"2023-10-06T02:27:42.810582+0000","last_became_peered":"2023-10-06T02:27:42.810582+0000","last_unstale":"2023-10-06T02:27:42.810898+0000","last_undegraded":"2023-10-06T02:27:42.810898+0000","last_fullsized":"2023-10-06T02:27:42.810898+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:33.833254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":51,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.794696+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:27:41.794696+0000","last_peered":"2023-10-06T02:27:41.794696+0000","last_clean":"2023-10-06T02:27:41.794696+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:27:41.794696+0000","last_undegraded":"2023-10-06T02:27:41.794696+0000","last_fullsized":"2023-10-06T02:27:41.794696+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799338+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:54.179105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.810030+0000","last_change":"2023-10-06T02:27:42.810030+0000","last_active":"2023-10-06T02:27:42.810030+0000","last_peered":"2023-10-06T02:27:42.810030+0000","last_clean":"2023-10-06T02:27:42.810030+0000","last_became_active":"2023-10-06T02:27:42.809757+0000","last_became_peered":"2023-10-06T02:27:42.809757+0000","last_unstale":"2023-10-06T02:27:42.810030+0000","last_undegraded":"2023-10-06T02:27:42.810030+0000","last_fullsized":"2023-10-06T02:27:42.810030+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:49.628882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":62,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.792604+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:27:41.792604+0000","last_peered":"2023-10-06T02:27:41.792604+0000","last_clean":"2023-10-06T02:27:41.792604+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:27:41.792604+0000","last_undegraded":"2023-10-06T02:27:41.792604+0000","last_fullsized":"2023-10-06T02:27:41.792604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801580+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:28.225535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.806975+0000","last_change":"2023-10-06T02:27:42.806975+0000","last_active":"2023-10-06T02:27:42.806975+0000","last_peered":"2023-10-06T02:27:42.806975+0000","last_clean":"2023-10-06T02:27:42.806975+0000","last_became_active":"2023-10-06T02:27:42.806684+0000","last_became_peered":"2023-10-06T02:27:42.806684+0000","last_unstale":"2023-10-06T02:27:42.806975+0000","last_undegraded":"2023-10-06T02:27:42.806975+0000","last_fullsized":"2023-10-06T02:27:42.806975+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:25.314623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.796714+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:27:41.796714+0000","last_peered":"2023-10-06T02:27:41.796714+0000","last_clean":"2023-10-06T02:27:41.796714+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:27:41.796714+0000","last_undegraded":"2023-10-06T02:27:41.796714+0000","last_fullsized":"2023-10-06T02:27:41.796714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799894+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:12:09.790709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.811306+0000","last_change":"2023-10-06T02:27:42.811306+0000","last_active":"2023-10-06T02:27:42.811306+0000","last_peered":"2023-10-06T02:27:42.811306+0000","last_clean":"2023-10-06T02:27:42.811306+0000","last_became_active":"2023-10-06T02:27:42.811022+0000","last_became_peered":"2023-10-06T02:27:42.811022+0000","last_unstale":"2023-10-06T02:27:42.811306+0000","last_undegraded":"2023-10-06T02:27:42.811306+0000","last_fullsized":"2023-10-06T02:27:42.811306+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:08.022668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.796854+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:27:41.796854+0000","last_peered":"2023-10-06T02:27:41.796854+0000","last_clean":"2023-10-06T02:27:41.796854+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:27:41.796854+0000","last_undegraded":"2023-10-06T02:27:41.796854+0000","last_fullsized":"2023-10-06T02:27:41.796854+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298700,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073140,"statfs":{"total":96636764160,"available":96330895360,"internally_reserved":0,"allocated":1445888,"data_stored":968744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.311,"15min":0.311},"max":{"1min":0.69899999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.56899999999999995,"15min":0.55000000000000004},"min":{"1min":0.49199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.77400000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56100000000000005}]},{"osd":1,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54800000000000004,"15min":0.52200000000000002},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72299999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55800000000000005,"15min":0.54200000000000004},"min":{"1min":0.41999999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71499999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56799999999999995,"15min":0.55400000000000005},"min":{"1min":0.40999999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73099999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57599999999999996,"15min":0.55600000000000005},"min":{"1min":0.51900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76200000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59299999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72599999999999998,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57799999999999996,"15min":0.56399999999999995},"min":{"1min":0.372,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71699999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.34000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.68700000000000006,"5min":1.014,"15min":1.014},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64000000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.371,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66800000000000004,"5min":0.747,"15min":0.747},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55100000000000005,"15min":0.56399999999999995},"min":{"1min":0.39500000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69799999999999995,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.41399999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57499999999999996,"15min":0.58699999999999997},"min":{"1min":0.41499999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73599999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58399999999999996,"15min":0.59499999999999997},"min":{"1min":0.39300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.748,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.39800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298116,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073724,"statfs":{"total":96636764160,"available":96331493376,"internally_reserved":0,"allocated":847872,"data_stored":377023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64400000000000002,"15min":0.73599999999999999},"min":{"1min":0.41799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.77000000000000002,"5min":5.859,"15min":5.859},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.55800000000000005,"15min":0.54200000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79100000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.53900000000000003,"15min":0.52100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.754,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55200000000000005,"15min":0.53500000000000003},"min":{"1min":0.39000000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80700000000000005,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.499}]},{"osd":2,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77100000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85899999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.47699999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57599999999999996,"15min":0.55200000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83299999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82599999999999996,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.56299999999999994}]},{"osd":4,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67800000000000005,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.435},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.32500000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.73799999999999999,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.36299999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76600000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54800000000000004,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75600000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.58299999999999996},"min":{"1min":0.39200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.626},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298688,"kb_used_data":1400,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073152,"statfs":{"total":96636764160,"available":96330907648,"internally_reserved":0,"allocated":1433600,"data_stored":962128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36599999999999999,"15min":0.379},"min":{"1min":0.25800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.52500000000000002,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.53900000000000003,"15min":0.67300000000000004},"min":{"1min":0.32400000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58299999999999996,"5min":7.6900000000000004,"15min":7.6900000000000004},"last":0.27800000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.497,"15min":0.629},"min":{"1min":0.30099999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.50600000000000001,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.56200000000000006,"15min":0.70199999999999996},"min":{"1min":0.308,"5min":0.251,"15min":0.251},"max":{"1min":0.59499999999999997,"5min":7.758,"15min":7.758},"last":0.35799999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.59199999999999997,"15min":0.72899999999999998},"min":{"1min":0.35799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64700000000000002,"5min":7.7869999999999999,"15min":7.7869999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.42499999999999999},"min":{"1min":0.35499999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.625,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.29399999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.84599999999999997,"15min":1.0700000000000001},"min":{"1min":0.44,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76700000000000002,"5min":11.678000000000001,"15min":11.678000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.76400000000000001,"15min":0.90400000000000003},"min":{"1min":0.50900000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85399999999999998,"5min":7.6529999999999996,"15min":7.6529999999999996},"last":0.443}]},{"osd":5,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.42399999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81799999999999995,"5min":1.399,"15min":1.399},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.80600000000000005,"15min":0.93899999999999995},"min":{"1min":0.495,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84099999999999997,"5min":7.508,"15min":7.508},"last":0.48599999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.78000000000000003,"15min":0.91500000000000004},"min":{"1min":0.47399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83699999999999997,"5min":7.7270000000000003,"15min":7.7270000000000003},"last":0.501},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67300000000000004,"15min":0.68700000000000006},"min":{"1min":0.49399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.873,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.45700000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.497,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.92200000000000004,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.82999999999999996,"15min":0.96099999999999997},"min":{"1min":0.57199999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89200000000000002,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298104,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073736,"statfs":{"total":96636764160,"available":96331505664,"internally_reserved":0,"allocated":835584,"data_stored":370407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.35799999999999998,"15min":0.34699999999999998},"min":{"1min":0.23699999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.53400000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.38,"15min":0.36499999999999999},"min":{"1min":0.29399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51700000000000002,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.307}]},{"osd":2,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.39800000000000002,"15min":0.38900000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57299999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.57199999999999995,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.36799999999999999,"15min":0.35499999999999998},"min":{"1min":0.27500000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.52800000000000002,"5min":0.622,"15min":0.622},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.41199999999999998,"15min":0.39700000000000002},"min":{"1min":0.312,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60899999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95999999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64600000000000002,"15min":0.63900000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94599999999999995,"5min":1.008,"15min":1.008},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81899999999999995,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.621,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93100000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.505}]},{"osd":6,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.47899999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.98899999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.46500000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88700000000000001,"5min":1,"15min":1},"last":0.439}]},{"osd":7,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91600000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.97399999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.56499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":378376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.34799999999999998,"15min":0.33900000000000002},"min":{"1min":0.28899999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38,"15min":0.38200000000000001},"min":{"1min":0.29099999999999998,"5min":0.218,"15min":0.218},"max":{"1min":0.48499999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.29399999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.35999999999999999,"15min":0.34999999999999998},"min":{"1min":0.27200000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.311},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.40500000000000003,"15min":0.40000000000000002},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59199999999999997,"5min":0.621,"15min":0.621},"last":0.375}]},{"osd":3,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42499999999999999,"15min":0.41099999999999998},"min":{"1min":0.35099999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.373,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85199999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88700000000000001,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.58399999999999996,"5min":0.437,"15min":0.437},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.52500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.95399999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.56200000000000006}]},{"osd":6,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.498,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95699999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.52600000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.60999999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.498,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91700000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.503,"5min":0.439,"15min":0.439},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.57399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298116,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073724,"statfs":{"total":96636764160,"available":96331493376,"internally_reserved":0,"allocated":847872,"data_stored":377023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.52900000000000003,"15min":0.69099999999999995},"min":{"1min":0.216,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.61799999999999999,"5min":10.164999999999999,"15min":10.164999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40600000000000003,"15min":0.41099999999999998},"min":{"1min":0.26600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.57899999999999996,"5min":1.266,"15min":1.266},"last":0.318}]},{"osd":1,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42099999999999999,"15min":0.42899999999999999},"min":{"1min":0.27800000000000002,"5min":0.191,"15min":0.191},"max":{"1min":0.58399999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.42999999999999999,"15min":0.432},"min":{"1min":0.311,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66600000000000004,"5min":1.319,"15min":1.319},"last":0.376}]},{"osd":2,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.442,"15min":0.44},"min":{"1min":0.36099999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.627,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.47999999999999998,"15min":0.48899999999999999},"min":{"1min":0.33300000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.68700000000000006,"5min":1.5,"15min":1.5},"last":0.30599999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63700000000000001,"15min":0.63200000000000001},"min":{"1min":0.49299999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88800000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.503},{"interface":"front","average":{"1min":0.629,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.44600000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93100000000000005,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.501,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86299999999999999,"5min":1.538,"15min":1.538},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.64300000000000002},"min":{"1min":0.499,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84299999999999997,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.625,"15min":0.61399999999999999},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.88900000000000001,"5min":1.111,"15min":1.111},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90600000000000003,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.58299999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.47699999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.876,"5min":1.21,"15min":1.21},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.48599999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86199999999999999,"5min":1.135,"15min":1.135},"last":0.49199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":378376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.78800000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54100000000000004,"15min":0.51300000000000001},"min":{"1min":0.42099999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.51500000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.53300000000000003,"15min":0.501},"min":{"1min":0.40600000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.48199999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59099999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.40500000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.75800000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.46600000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77000000000000002,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.497,"15min":0.48999999999999999},"min":{"1min":0.43099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76800000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.443},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.79100000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.47399999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.36399999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75600000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.372,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76700000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.48799999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.34200000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80100000000000005,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.34599999999999997,"5min":0.308,"15min":0.308},"max":{"1min":0.83999999999999997,"5min":1.04,"15min":1.04},"last":0.45700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":378376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.51600000000000001,"15min":0.498},"min":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51300000000000001,"15min":0.49099999999999999},"min":{"1min":0.45600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.52300000000000002,"15min":0.49399999999999999},"min":{"1min":0.42899999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.51300000000000001,"15min":0.498},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.50800000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.58899999999999997,"15min":0.57399999999999995},"min":{"1min":0.46200000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.623}]},{"osd":3,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.53400000000000003,"15min":0.51600000000000001},"min":{"1min":0.40699999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.64600000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.47799999999999998,"15min":0.48899999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.60399999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51100000000000001,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69299999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.56699999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.32200000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.71099999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54700000000000004,"15min":0.56699999999999995},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68999999999999995,"5min":0.873,"15min":0.873},"last":0.41799999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54300000000000004,"15min":0.56299999999999994},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69699999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57299999999999995,"15min":0.60099999999999998},"min":{"1min":0.38,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67600000000000005,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:27:48.323 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:27:48.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.474+0000 7f6bef489700 1 Processor -- start 2023-10-06T02:27:48.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.475+0000 7f6bef489700 1 -- start start 2023-10-06T02:27:48.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.475+0000 7f6bef489700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6be81595a0 0x7f6be80b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.475+0000 7f6bef489700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6be806d890 0x7f6be806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.475+0000 7f6bef489700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be806e240 con 0x7f6be806c0b0 2023-10-06T02:27:48.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.475+0000 7f6bef489700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be815e180 con 0x7f6be81595a0 2023-10-06T02:27:48.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.475+0000 7f6bef489700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80b1000 con 0x7f6be806d890 2023-10-06T02:27:48.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.476+0000 7f6bed225700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6be81595a0 0x7f6be80b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.476+0000 7f6bed225700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6be81595a0 0x7f6be80b0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53060/0 (socket says 172.21.15.37:53060) 2023-10-06T02:27:48.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.476+0000 7f6bed225700 1 -- 172.21.15.37:0/195310652 learned_addr learned my addr 172.21.15.37:0/195310652 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:48.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.476+0000 7f6beca24700 1 --2- 172.21.15.37:0/195310652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6be806d890 0x7f6be806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.476+0000 7f6bed225700 1 -- 172.21.15.37:0/195310652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6be806d890 msgr2=0x7f6be806dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:48.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.476+0000 7f6bed225700 1 --2- 172.21.15.37:0/195310652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6be806d890 0x7f6be806dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.476+0000 7f6bed225700 1 -- 172.21.15.37:0/195310652 >> v1:172.21.15.191:6789/0 conn(0x7f6be806c0b0 legacy=0x7f6be806c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.476+0000 7f6bed225700 1 -- 172.21.15.37:0/195310652 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be815d570 con 0x7f6be81595a0 2023-10-06T02:27:48.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.476+0000 7f6beca24700 1 --2- 172.21.15.37:0/195310652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6be806d890 0x7f6be806dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:48.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.476+0000 7f6bed225700 1 --2- 172.21.15.37:0/195310652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be81595a0 0x7f6be80b0ac0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f6be00099b0 tx=0x7f6be0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9200bee09619b97 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:48.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.476+0000 7f6be7fff700 1 -- 172.21.15.37:0/195310652 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be000b860 con 0x7f6be81595a0 2023-10-06T02:27:48.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.476+0000 7f6be7fff700 1 -- 172.21.15.37:0/195310652 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be000b9c0 con 0x7f6be81595a0 2023-10-06T02:27:48.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.476+0000 7f6be7fff700 1 -- 172.21.15.37:0/195310652 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be000bd80 con 0x7f6be81595a0 2023-10-06T02:27:48.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.477+0000 7f6bef489700 1 -- 172.21.15.37:0/195310652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be81595a0 msgr2=0x7f6be80b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.477+0000 7f6bef489700 1 --2- 172.21.15.37:0/195310652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be81595a0 0x7f6be80b0ac0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f6be00099b0 tx=0x7f6be0009250 comp rx=0 tx=0).stop 2023-10-06T02:27:48.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.477+0000 7f6bef489700 1 -- 172.21.15.37:0/195310652 shutdown_connections 2023-10-06T02:27:48.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.477+0000 7f6bef489700 1 --2- 172.21.15.37:0/195310652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be81595a0 0x7f6be80b0ac0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.477+0000 7f6bef489700 1 --2- 172.21.15.37:0/195310652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6be806d890 0x7f6be806dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.477+0000 7f6bef489700 1 -- 172.21.15.37:0/195310652 >> 172.21.15.37:0/195310652 conn(0x7f6be80d04d0 msgr2=0x7f6be80d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:48.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.477+0000 7f6bef489700 1 -- 172.21.15.37:0/195310652 shutdown_connections 2023-10-06T02:27:48.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.477+0000 7f6bef489700 1 -- 172.21.15.37:0/195310652 wait complete. 2023-10-06T02:27:48.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.478+0000 7f6bef489700 1 Processor -- start 2023-10-06T02:27:48.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.478+0000 7f6bef489700 1 -- start start 2023-10-06T02:27:48.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.479+0000 7f6bef489700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6be806c0b0 0x7f6be80c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.479+0000 7f6bef489700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6be806d890 0x7f6be80c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.479+0000 7f6bef489700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be81595a0 0x7f6be80cea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.479+0000 7f6bef489700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80c8ee0 con 0x7f6be81595a0 2023-10-06T02:27:48.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.479+0000 7f6bef489700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80c9180 con 0x7f6be806d890 2023-10-06T02:27:48.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.479+0000 7f6bef489700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80c9460 con 0x7f6be806c0b0 2023-10-06T02:27:48.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.479+0000 7f6beda26700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be81595a0 0x7f6be80cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.479+0000 7f6beda26700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be81595a0 0x7f6be80cea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53062/0 (socket says 172.21.15.37:53062) 2023-10-06T02:27:48.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.479+0000 7f6beda26700 1 -- 172.21.15.37:0/1521072179 learned_addr learned my addr 172.21.15.37:0/1521072179 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:48.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.479+0000 7f6bed225700 1 --2- 172.21.15.37:0/1521072179 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6be806c0b0 0x7f6be80c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.479+0000 7f6beca24700 1 --2- 172.21.15.37:0/1521072179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6be806d890 0x7f6be80c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.479+0000 7f6beda26700 1 -- 172.21.15.37:0/1521072179 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6be806c0b0 msgr2=0x7f6be80c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.479+0000 7f6beda26700 1 --2- 172.21.15.37:0/1521072179 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6be806c0b0 0x7f6be80c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.479+0000 7f6beda26700 1 -- 172.21.15.37:0/1521072179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6be806d890 msgr2=0x7f6be80c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.479+0000 7f6beda26700 1 --2- 172.21.15.37:0/1521072179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6be806d890 0x7f6be80c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.479+0000 7f6beda26700 1 -- 172.21.15.37:0/1521072179 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be00094f0 con 0x7f6be81595a0 2023-10-06T02:27:48.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.479+0000 7f6beca24700 1 --2- 172.21.15.37:0/1521072179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6be806d890 0x7f6be80c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:48.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.479+0000 7f6beda26700 1 --2- 172.21.15.37:0/1521072179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be81595a0 0x7f6be80cea20 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6bd800c8e0 tx=0x7f6bd8001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:48.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.479+0000 7f6be57fa700 1 -- 172.21.15.37:0/1521072179 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8012630 con 0x7f6be81595a0 2023-10-06T02:27:48.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.480+0000 7f6be57fa700 1 -- 172.21.15.37:0/1521072179 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd8012790 con 0x7f6be81595a0 2023-10-06T02:27:48.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.480+0000 7f6bef489700 1 -- 172.21.15.37:0/1521072179 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be80c9740 con 0x7f6be81595a0 2023-10-06T02:27:48.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.480+0000 7f6be57fa700 1 -- 172.21.15.37:0/1521072179 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8012b50 con 0x7f6be81595a0 2023-10-06T02:27:48.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.480+0000 7f6bef489700 1 -- 172.21.15.37:0/1521072179 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be80c9d00 con 0x7f6be81595a0 2023-10-06T02:27:48.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.481+0000 7f6bef489700 1 -- 172.21.15.37:0/1521072179 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be8088b20 con 0x7f6be81595a0 2023-10-06T02:27:48.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.481+0000 7f6be57fa700 1 -- 172.21.15.37:0/1521072179 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6bd800a3b0 con 0x7f6be81595a0 2023-10-06T02:27:48.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.481+0000 7f6be57fa700 1 --2- 172.21.15.37:0/1521072179 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6bd4066f30 0x7f6bd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.481+0000 7f6be57fa700 1 -- 172.21.15.37:0/1521072179 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6bd8084990 con 0x7f6be81595a0 2023-10-06T02:27:48.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.482+0000 7f6bed225700 1 --2- 172.21.15.37:0/1521072179 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6bd4066f30 0x7f6bd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.482+0000 7f6bed225700 1 --2- 172.21.15.37:0/1521072179 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6bd4066f30 0x7f6bd40693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6be00099b0 tx=0x7f6be0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:48.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.486+0000 7f6be57fa700 1 -- 172.21.15.37:0/1521072179 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bd8051aa0 con 0x7f6be81595a0 2023-10-06T02:27:48.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.677+0000 7f6bef489700 1 -- 172.21.15.37:0/1521072179 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6be80c95d0 con 0x7f6bd4066f30 2023-10-06T02:27:48.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.686+0000 7f6be57fa700 1 -- 172.21.15.37:0/1521072179 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309022 (secure 0 0 0) 0x7f6be80c95d0 con 0x7f6bd4066f30 2023-10-06T02:27:48.690 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:48.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.689+0000 7f6bef489700 1 -- 172.21.15.37:0/1521072179 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6bd4066f30 msgr2=0x7f6bd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.689+0000 7f6bef489700 1 --2- 172.21.15.37:0/1521072179 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6bd4066f30 0x7f6bd40693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6be00099b0 tx=0x7f6be0017000 comp rx=0 tx=0).stop 2023-10-06T02:27:48.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.689+0000 7f6bef489700 1 -- 172.21.15.37:0/1521072179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be81595a0 msgr2=0x7f6be80cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.689+0000 7f6bef489700 1 --2- 172.21.15.37:0/1521072179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be81595a0 0x7f6be80cea20 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6bd800c8e0 tx=0x7f6bd8001710 comp rx=0 tx=0).stop 2023-10-06T02:27:48.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.689+0000 7f6bef489700 1 -- 172.21.15.37:0/1521072179 shutdown_connections 2023-10-06T02:27:48.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.689+0000 7f6bef489700 1 --2- 172.21.15.37:0/1521072179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be81595a0 0x7f6be80cea20 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.689+0000 7f6bef489700 1 --2- 172.21.15.37:0/1521072179 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6be806c0b0 0x7f6be80c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.689+0000 7f6bef489700 1 --2- 172.21.15.37:0/1521072179 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6bd4066f30 0x7f6bd40693e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.689+0000 7f6bef489700 1 --2- 172.21.15.37:0/1521072179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6be806d890 0x7f6be80c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.689+0000 7f6bef489700 1 -- 172.21.15.37:0/1521072179 >> 172.21.15.37:0/1521072179 conn(0x7f6be80d04d0 msgr2=0x7f6be806c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:48.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.689+0000 7f6bef489700 1 -- 172.21.15.37:0/1521072179 shutdown_connections 2023-10-06T02:27:48.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.689+0000 7f6bef489700 1 -- 172.21.15.37:0/1521072179 wait complete. 2023-10-06T02:27:48.694 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:27:48.703 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2023-10-06T02:27:48.576301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2386084,"kb_used_data":7780,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752588636,"statfs":{"total":773094113280,"available":770650763264,"internally_reserved":0,"allocated":7966720,"data_stored":4190453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001544"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802518+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:53.218389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.807980+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:00.209850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.796866+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:36.224572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.798550+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:53.218389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802678+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:04.289183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801743+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:17.054182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801456+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:59.316808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802858+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:45:34.837248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801293+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:11.571663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.798313+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:33.606927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.807955+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:44.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797984+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:46.415629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802208+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:54.211724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801195+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:00.209850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.809053+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:17.377369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802426+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:33.606927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802907+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:28.926179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797755+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:46.464705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.803032+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:03.886385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800763+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:30.519208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.803836+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:36:48.718543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.805193+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:47.636151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802680+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:40.040632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.808461+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:28.225535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801398+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:01.723335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797772+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:54.179105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.807304+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:34.837998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800268+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:03.752060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800980+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:09.747047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.805049+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:09.747047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.796734+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:28:34.237238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801944+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:46.415629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797008+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:14.723560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813044+0000","last_change":"2023-10-06T02:27:42.813044+0000","last_active":"2023-10-06T02:27:42.813044+0000","last_peered":"2023-10-06T02:27:42.813044+0000","last_clean":"2023-10-06T02:27:42.813044+0000","last_became_active":"2023-10-06T02:27:42.812776+0000","last_became_peered":"2023-10-06T02:27:42.812776+0000","last_unstale":"2023-10-06T02:27:42.813044+0000","last_undegraded":"2023-10-06T02:27:42.813044+0000","last_fullsized":"2023-10-06T02:27:42.813044+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:47.491511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799411+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:33.606927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.812884+0000","last_change":"2023-10-06T02:27:42.812884+0000","last_active":"2023-10-06T02:27:42.812884+0000","last_peered":"2023-10-06T02:27:42.812884+0000","last_clean":"2023-10-06T02:27:42.812884+0000","last_became_active":"2023-10-06T02:27:42.812665+0000","last_became_peered":"2023-10-06T02:27:42.812665+0000","last_unstale":"2023-10-06T02:27:42.812884+0000","last_undegraded":"2023-10-06T02:27:42.812884+0000","last_fullsized":"2023-10-06T02:27:42.812884+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:29.170337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802146+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:15.684258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.815975+0000","last_change":"2023-10-06T02:27:42.815975+0000","last_active":"2023-10-06T02:27:42.815975+0000","last_peered":"2023-10-06T02:27:42.815975+0000","last_clean":"2023-10-06T02:27:42.815975+0000","last_became_active":"2023-10-06T02:27:42.815717+0000","last_became_peered":"2023-10-06T02:27:42.815717+0000","last_unstale":"2023-10-06T02:27:42.815975+0000","last_undegraded":"2023-10-06T02:27:42.815975+0000","last_fullsized":"2023-10-06T02:27:42.815975+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:43.563364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802182+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:09.677215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.814055+0000","last_change":"2023-10-06T02:27:42.814055+0000","last_active":"2023-10-06T02:27:42.814055+0000","last_peered":"2023-10-06T02:27:42.814055+0000","last_clean":"2023-10-06T02:27:42.814055+0000","last_became_active":"2023-10-06T02:27:42.813793+0000","last_became_peered":"2023-10-06T02:27:42.813793+0000","last_unstale":"2023-10-06T02:27:42.814055+0000","last_undegraded":"2023-10-06T02:27:42.814055+0000","last_fullsized":"2023-10-06T02:27:42.814055+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:30.927523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800029+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:53.218389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.811221+0000","last_change":"2023-10-06T02:27:42.811221+0000","last_active":"2023-10-06T02:27:42.811221+0000","last_peered":"2023-10-06T02:27:42.811221+0000","last_clean":"2023-10-06T02:27:42.811221+0000","last_became_active":"2023-10-06T02:27:42.810661+0000","last_became_peered":"2023-10-06T02:27:42.810661+0000","last_unstale":"2023-10-06T02:27:42.811221+0000","last_undegraded":"2023-10-06T02:27:42.811221+0000","last_fullsized":"2023-10-06T02:27:42.811221+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:25.281591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800116+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:20.572015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.811978+0000","last_change":"2023-10-06T02:27:42.811978+0000","last_active":"2023-10-06T02:27:42.811978+0000","last_peered":"2023-10-06T02:27:42.811978+0000","last_clean":"2023-10-06T02:27:42.811978+0000","last_became_active":"2023-10-06T02:27:42.811662+0000","last_became_peered":"2023-10-06T02:27:42.811662+0000","last_unstale":"2023-10-06T02:27:42.811978+0000","last_undegraded":"2023-10-06T02:27:42.811978+0000","last_fullsized":"2023-10-06T02:27:42.811978+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:31.613891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802265+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:37:46.334285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813508+0000","last_change":"2023-10-06T02:27:42.813508+0000","last_active":"2023-10-06T02:27:42.813508+0000","last_peered":"2023-10-06T02:27:42.813508+0000","last_clean":"2023-10-06T02:27:42.813508+0000","last_became_active":"2023-10-06T02:27:42.813249+0000","last_became_peered":"2023-10-06T02:27:42.813249+0000","last_unstale":"2023-10-06T02:27:42.813508+0000","last_undegraded":"2023-10-06T02:27:42.813508+0000","last_fullsized":"2023-10-06T02:27:42.813508+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:29.170337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801313+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:59.814849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.811677+0000","last_change":"2023-10-06T02:27:42.811677+0000","last_active":"2023-10-06T02:27:42.811677+0000","last_peered":"2023-10-06T02:27:42.811677+0000","last_clean":"2023-10-06T02:27:42.811677+0000","last_became_active":"2023-10-06T02:27:42.811370+0000","last_became_peered":"2023-10-06T02:27:42.811370+0000","last_unstale":"2023-10-06T02:27:42.811677+0000","last_undegraded":"2023-10-06T02:27:42.811677+0000","last_fullsized":"2023-10-06T02:27:42.811677+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:55:16.818646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800463+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:50.633626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813430+0000","last_change":"2023-10-06T02:27:42.813430+0000","last_active":"2023-10-06T02:27:42.813430+0000","last_peered":"2023-10-06T02:27:42.813430+0000","last_clean":"2023-10-06T02:27:42.813430+0000","last_became_active":"2023-10-06T02:27:42.813263+0000","last_became_peered":"2023-10-06T02:27:42.813263+0000","last_unstale":"2023-10-06T02:27:42.813430+0000","last_undegraded":"2023-10-06T02:27:42.813430+0000","last_fullsized":"2023-10-06T02:27:42.813430+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:28.180005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.798675+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:17.967348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.812967+0000","last_change":"2023-10-06T02:27:42.812967+0000","last_active":"2023-10-06T02:27:42.812967+0000","last_peered":"2023-10-06T02:27:42.812967+0000","last_clean":"2023-10-06T02:27:42.812967+0000","last_became_active":"2023-10-06T02:27:42.812686+0000","last_became_peered":"2023-10-06T02:27:42.812686+0000","last_unstale":"2023-10-06T02:27:42.812967+0000","last_undegraded":"2023-10-06T02:27:42.812967+0000","last_fullsized":"2023-10-06T02:27:42.812967+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:36:47.713799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800249+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:44.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.815152+0000","last_change":"2023-10-06T02:27:42.815152+0000","last_active":"2023-10-06T02:27:42.815152+0000","last_peered":"2023-10-06T02:27:42.815152+0000","last_clean":"2023-10-06T02:27:42.815152+0000","last_became_active":"2023-10-06T02:27:42.814822+0000","last_became_peered":"2023-10-06T02:27:42.814822+0000","last_unstale":"2023-10-06T02:27:42.815152+0000","last_undegraded":"2023-10-06T02:27:42.815152+0000","last_fullsized":"2023-10-06T02:27:42.815152+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:48.778361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.796949+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:56.326934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.806783+0000","last_change":"2023-10-06T02:27:42.806783+0000","last_active":"2023-10-06T02:27:42.806783+0000","last_peered":"2023-10-06T02:27:42.806783+0000","last_clean":"2023-10-06T02:27:42.806783+0000","last_became_active":"2023-10-06T02:27:42.806497+0000","last_became_peered":"2023-10-06T02:27:42.806497+0000","last_unstale":"2023-10-06T02:27:42.806783+0000","last_undegraded":"2023-10-06T02:27:42.806783+0000","last_fullsized":"2023-10-06T02:27:42.806783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:43:44.444253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797396+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:44.568108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.805768+0000","last_change":"2023-10-06T02:27:42.805768+0000","last_active":"2023-10-06T02:27:42.805768+0000","last_peered":"2023-10-06T02:27:42.805768+0000","last_clean":"2023-10-06T02:27:42.805768+0000","last_became_active":"2023-10-06T02:27:42.805483+0000","last_became_peered":"2023-10-06T02:27:42.805483+0000","last_unstale":"2023-10-06T02:27:42.805768+0000","last_undegraded":"2023-10-06T02:27:42.805768+0000","last_fullsized":"2023-10-06T02:27:42.805768+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:39.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800542+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:41.827434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.812082+0000","last_change":"2023-10-06T02:27:42.812082+0000","last_active":"2023-10-06T02:27:42.812082+0000","last_peered":"2023-10-06T02:27:42.812082+0000","last_clean":"2023-10-06T02:27:42.812082+0000","last_became_active":"2023-10-06T02:27:42.811811+0000","last_became_peered":"2023-10-06T02:27:42.811811+0000","last_unstale":"2023-10-06T02:27:42.812082+0000","last_undegraded":"2023-10-06T02:27:42.812082+0000","last_fullsized":"2023-10-06T02:27:42.812082+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:39.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799930+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:12:06.792194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813049+0000","last_change":"2023-10-06T02:27:42.813049+0000","last_active":"2023-10-06T02:27:42.813049+0000","last_peered":"2023-10-06T02:27:42.813049+0000","last_clean":"2023-10-06T02:27:42.813049+0000","last_became_active":"2023-10-06T02:27:42.812763+0000","last_became_peered":"2023-10-06T02:27:42.812763+0000","last_unstale":"2023-10-06T02:27:42.813049+0000","last_undegraded":"2023-10-06T02:27:42.813049+0000","last_fullsized":"2023-10-06T02:27:42.813049+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:09.771266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799859+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:58.171529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.812011+0000","last_change":"2023-10-06T02:27:42.812011+0000","last_active":"2023-10-06T02:27:42.812011+0000","last_peered":"2023-10-06T02:27:42.812011+0000","last_clean":"2023-10-06T02:27:42.812011+0000","last_became_active":"2023-10-06T02:27:42.810343+0000","last_became_peered":"2023-10-06T02:27:42.810343+0000","last_unstale":"2023-10-06T02:27:42.812011+0000","last_undegraded":"2023-10-06T02:27:42.812011+0000","last_fullsized":"2023-10-06T02:27:42.812011+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:31.613891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802247+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:46.057716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.809942+0000","last_change":"2023-10-06T02:27:42.809942+0000","last_active":"2023-10-06T02:27:42.809942+0000","last_peered":"2023-10-06T02:27:42.809942+0000","last_clean":"2023-10-06T02:27:42.809942+0000","last_became_active":"2023-10-06T02:27:42.809577+0000","last_became_peered":"2023-10-06T02:27:42.809577+0000","last_unstale":"2023-10-06T02:27:42.809942+0000","last_undegraded":"2023-10-06T02:27:42.809942+0000","last_fullsized":"2023-10-06T02:27:42.809942+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:28.180005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801000+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:55:31.826969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.810405+0000","last_change":"2023-10-06T02:27:42.810405+0000","last_active":"2023-10-06T02:27:42.810405+0000","last_peered":"2023-10-06T02:27:42.810405+0000","last_clean":"2023-10-06T02:27:42.810405+0000","last_became_active":"2023-10-06T02:27:42.810102+0000","last_became_peered":"2023-10-06T02:27:42.810102+0000","last_unstale":"2023-10-06T02:27:42.810405+0000","last_undegraded":"2023-10-06T02:27:42.810405+0000","last_fullsized":"2023-10-06T02:27:42.810405+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:28.180005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801182+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:31.134356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813189+0000","last_change":"2023-10-06T02:27:42.813189+0000","last_active":"2023-10-06T02:27:42.813189+0000","last_peered":"2023-10-06T02:27:42.813189+0000","last_clean":"2023-10-06T02:27:42.813189+0000","last_became_active":"2023-10-06T02:27:42.812916+0000","last_became_peered":"2023-10-06T02:27:42.812916+0000","last_unstale":"2023-10-06T02:27:42.813189+0000","last_undegraded":"2023-10-06T02:27:42.813189+0000","last_fullsized":"2023-10-06T02:27:42.813189+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:36:47.713799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799613+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:44.568108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.812184+0000","last_change":"2023-10-06T02:27:42.812184+0000","last_active":"2023-10-06T02:27:42.812184+0000","last_peered":"2023-10-06T02:27:42.812184+0000","last_clean":"2023-10-06T02:27:42.812184+0000","last_became_active":"2023-10-06T02:27:42.811906+0000","last_became_peered":"2023-10-06T02:27:42.811906+0000","last_unstale":"2023-10-06T02:27:42.812184+0000","last_undegraded":"2023-10-06T02:27:42.812184+0000","last_fullsized":"2023-10-06T02:27:42.812184+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:31.613891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799848+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:28.136884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.809545+0000","last_change":"2023-10-06T02:27:42.809545+0000","last_active":"2023-10-06T02:27:42.809545+0000","last_peered":"2023-10-06T02:27:42.809545+0000","last_clean":"2023-10-06T02:27:42.809545+0000","last_became_active":"2023-10-06T02:27:42.809216+0000","last_became_peered":"2023-10-06T02:27:42.809216+0000","last_unstale":"2023-10-06T02:27:42.809545+0000","last_undegraded":"2023-10-06T02:27:42.809545+0000","last_fullsized":"2023-10-06T02:27:42.809545+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:12.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800065+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:11.236431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813522+0000","last_change":"2023-10-06T02:27:42.813522+0000","last_active":"2023-10-06T02:27:42.813522+0000","last_peered":"2023-10-06T02:27:42.813522+0000","last_clean":"2023-10-06T02:27:42.813522+0000","last_became_active":"2023-10-06T02:27:42.813279+0000","last_became_peered":"2023-10-06T02:27:42.813279+0000","last_unstale":"2023-10-06T02:27:42.813522+0000","last_undegraded":"2023-10-06T02:27:42.813522+0000","last_fullsized":"2023-10-06T02:27:42.813522+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:59.272780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797159+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:42.464983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.811203+0000","last_change":"2023-10-06T02:27:42.811203+0000","last_active":"2023-10-06T02:27:42.811203+0000","last_peered":"2023-10-06T02:27:42.811203+0000","last_clean":"2023-10-06T02:27:42.811203+0000","last_became_active":"2023-10-06T02:27:42.810876+0000","last_became_peered":"2023-10-06T02:27:42.810876+0000","last_unstale":"2023-10-06T02:27:42.811203+0000","last_undegraded":"2023-10-06T02:27:42.811203+0000","last_fullsized":"2023-10-06T02:27:42.811203+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:28.067756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.796962+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:26.286335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.806843+0000","last_change":"2023-10-06T02:27:42.806843+0000","last_active":"2023-10-06T02:27:42.806843+0000","last_peered":"2023-10-06T02:27:42.806843+0000","last_clean":"2023-10-06T02:27:42.806843+0000","last_became_active":"2023-10-06T02:27:42.806561+0000","last_became_peered":"2023-10-06T02:27:42.806561+0000","last_unstale":"2023-10-06T02:27:42.806843+0000","last_undegraded":"2023-10-06T02:27:42.806843+0000","last_fullsized":"2023-10-06T02:27:42.806843+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:25.987778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800749+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:17.377369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.810765+0000","last_change":"2023-10-06T02:27:42.810765+0000","last_active":"2023-10-06T02:27:42.810765+0000","last_peered":"2023-10-06T02:27:42.810765+0000","last_clean":"2023-10-06T02:27:42.810765+0000","last_became_active":"2023-10-06T02:27:42.810012+0000","last_became_peered":"2023-10-06T02:27:42.810012+0000","last_unstale":"2023-10-06T02:27:42.810765+0000","last_undegraded":"2023-10-06T02:27:42.810765+0000","last_fullsized":"2023-10-06T02:27:42.810765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:16.962604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":56,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.791844+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:27:41.791844+0000","last_peered":"2023-10-06T02:27:41.791844+0000","last_clean":"2023-10-06T02:27:41.791844+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:27:41.791844+0000","last_undegraded":"2023-10-06T02:27:41.791844+0000","last_fullsized":"2023-10-06T02:27:41.791844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802069+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:55:50.706021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.806707+0000","last_change":"2023-10-06T02:27:42.806707+0000","last_active":"2023-10-06T02:27:42.806707+0000","last_peered":"2023-10-06T02:27:42.806707+0000","last_clean":"2023-10-06T02:27:42.806707+0000","last_became_active":"2023-10-06T02:27:42.806408+0000","last_became_peered":"2023-10-06T02:27:42.806408+0000","last_unstale":"2023-10-06T02:27:42.806707+0000","last_undegraded":"2023-10-06T02:27:42.806707+0000","last_fullsized":"2023-10-06T02:27:42.806707+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:41.460239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.795556+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:27:41.795556+0000","last_peered":"2023-10-06T02:27:41.795556+0000","last_clean":"2023-10-06T02:27:41.795556+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:27:41.795556+0000","last_undegraded":"2023-10-06T02:27:41.795556+0000","last_fullsized":"2023-10-06T02:27:41.795556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799401+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:46.415629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.809927+0000","last_change":"2023-10-06T02:27:42.809927+0000","last_active":"2023-10-06T02:27:42.809927+0000","last_peered":"2023-10-06T02:27:42.809927+0000","last_clean":"2023-10-06T02:27:42.809927+0000","last_became_active":"2023-10-06T02:27:42.809606+0000","last_became_peered":"2023-10-06T02:27:42.809606+0000","last_unstale":"2023-10-06T02:27:42.809927+0000","last_undegraded":"2023-10-06T02:27:42.809927+0000","last_fullsized":"2023-10-06T02:27:42.809927+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:08.742302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.796821+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:27:41.796821+0000","last_peered":"2023-10-06T02:27:41.796821+0000","last_clean":"2023-10-06T02:27:41.796821+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:27:41.796821+0000","last_undegraded":"2023-10-06T02:27:41.796821+0000","last_fullsized":"2023-10-06T02:27:41.796821+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":201,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.794607+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:27:41.794607+0000","last_peered":"2023-10-06T02:27:41.794607+0000","last_clean":"2023-10-06T02:27:41.794607+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:27:41.794607+0000","last_undegraded":"2023-10-06T02:27:41.794607+0000","last_fullsized":"2023-10-06T02:27:41.794607+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800805+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:16.944536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.810776+0000","last_change":"2023-10-06T02:27:42.810776+0000","last_active":"2023-10-06T02:27:42.810776+0000","last_peered":"2023-10-06T02:27:42.810776+0000","last_clean":"2023-10-06T02:27:42.810776+0000","last_became_active":"2023-10-06T02:27:42.810461+0000","last_became_peered":"2023-10-06T02:27:42.810461+0000","last_unstale":"2023-10-06T02:27:42.810776+0000","last_undegraded":"2023-10-06T02:27:42.810776+0000","last_fullsized":"2023-10-06T02:27:42.810776+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:00.718591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":51,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.794738+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:27:41.794738+0000","last_peered":"2023-10-06T02:27:41.794738+0000","last_clean":"2023-10-06T02:27:41.794738+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:27:41.794738+0000","last_undegraded":"2023-10-06T02:27:41.794738+0000","last_fullsized":"2023-10-06T02:27:41.794738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.804625+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:50.633626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.810898+0000","last_change":"2023-10-06T02:27:42.810898+0000","last_active":"2023-10-06T02:27:42.810898+0000","last_peered":"2023-10-06T02:27:42.810898+0000","last_clean":"2023-10-06T02:27:42.810898+0000","last_became_active":"2023-10-06T02:27:42.810582+0000","last_became_peered":"2023-10-06T02:27:42.810582+0000","last_unstale":"2023-10-06T02:27:42.810898+0000","last_undegraded":"2023-10-06T02:27:42.810898+0000","last_fullsized":"2023-10-06T02:27:42.810898+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:33.833254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":51,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.794696+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:27:41.794696+0000","last_peered":"2023-10-06T02:27:41.794696+0000","last_clean":"2023-10-06T02:27:41.794696+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:27:41.794696+0000","last_undegraded":"2023-10-06T02:27:41.794696+0000","last_fullsized":"2023-10-06T02:27:41.794696+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799338+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:54.179105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.810030+0000","last_change":"2023-10-06T02:27:42.810030+0000","last_active":"2023-10-06T02:27:42.810030+0000","last_peered":"2023-10-06T02:27:42.810030+0000","last_clean":"2023-10-06T02:27:42.810030+0000","last_became_active":"2023-10-06T02:27:42.809757+0000","last_became_peered":"2023-10-06T02:27:42.809757+0000","last_unstale":"2023-10-06T02:27:42.810030+0000","last_undegraded":"2023-10-06T02:27:42.810030+0000","last_fullsized":"2023-10-06T02:27:42.810030+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:49.628882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":62,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.792604+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:27:41.792604+0000","last_peered":"2023-10-06T02:27:41.792604+0000","last_clean":"2023-10-06T02:27:41.792604+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:27:41.792604+0000","last_undegraded":"2023-10-06T02:27:41.792604+0000","last_fullsized":"2023-10-06T02:27:41.792604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801580+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:28.225535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.806975+0000","last_change":"2023-10-06T02:27:42.806975+0000","last_active":"2023-10-06T02:27:42.806975+0000","last_peered":"2023-10-06T02:27:42.806975+0000","last_clean":"2023-10-06T02:27:42.806975+0000","last_became_active":"2023-10-06T02:27:42.806684+0000","last_became_peered":"2023-10-06T02:27:42.806684+0000","last_unstale":"2023-10-06T02:27:42.806975+0000","last_undegraded":"2023-10-06T02:27:42.806975+0000","last_fullsized":"2023-10-06T02:27:42.806975+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:25.314623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.796714+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:27:41.796714+0000","last_peered":"2023-10-06T02:27:41.796714+0000","last_clean":"2023-10-06T02:27:41.796714+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:27:41.796714+0000","last_undegraded":"2023-10-06T02:27:41.796714+0000","last_fullsized":"2023-10-06T02:27:41.796714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799894+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:12:09.790709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.811306+0000","last_change":"2023-10-06T02:27:42.811306+0000","last_active":"2023-10-06T02:27:42.811306+0000","last_peered":"2023-10-06T02:27:42.811306+0000","last_clean":"2023-10-06T02:27:42.811306+0000","last_became_active":"2023-10-06T02:27:42.811022+0000","last_became_peered":"2023-10-06T02:27:42.811022+0000","last_unstale":"2023-10-06T02:27:42.811306+0000","last_undegraded":"2023-10-06T02:27:42.811306+0000","last_fullsized":"2023-10-06T02:27:42.811306+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:08.022668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.796854+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:27:41.796854+0000","last_peered":"2023-10-06T02:27:41.796854+0000","last_clean":"2023-10-06T02:27:41.796854+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:27:41.796854+0000","last_undegraded":"2023-10-06T02:27:41.796854+0000","last_fullsized":"2023-10-06T02:27:41.796854+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298700,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073140,"statfs":{"total":96636764160,"available":96330895360,"internally_reserved":0,"allocated":1445888,"data_stored":968744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.311,"15min":0.311},"max":{"1min":0.69899999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.56899999999999995,"15min":0.55000000000000004},"min":{"1min":0.49199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.77400000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56100000000000005}]},{"osd":1,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54800000000000004,"15min":0.52200000000000002},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72299999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55800000000000005,"15min":0.54200000000000004},"min":{"1min":0.41999999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71499999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56799999999999995,"15min":0.55400000000000005},"min":{"1min":0.40999999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73099999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57599999999999996,"15min":0.55600000000000005},"min":{"1min":0.51900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76200000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59299999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72599999999999998,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57799999999999996,"15min":0.56399999999999995},"min":{"1min":0.372,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71699999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.34000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.68700000000000006,"5min":1.014,"15min":1.014},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64000000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.371,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66800000000000004,"5min":0.747,"15min":0.747},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55100000000000005,"15min":0.56399999999999995},"min":{"1min":0.39500000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69799999999999995,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.41399999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57499999999999996,"15min":0.58699999999999997},"min":{"1min":0.41499999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73599999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58399999999999996,"15min":0.59499999999999997},"min":{"1min":0.39300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.748,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.39800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298116,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073724,"statfs":{"total":96636764160,"available":96331493376,"internally_reserved":0,"allocated":847872,"data_stored":377023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64400000000000002,"15min":0.73599999999999999},"min":{"1min":0.41799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.77000000000000002,"5min":5.859,"15min":5.859},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.55800000000000005,"15min":0.54200000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79100000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.53900000000000003,"15min":0.52100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.754,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55200000000000005,"15min":0.53500000000000003},"min":{"1min":0.39000000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80700000000000005,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.499}]},{"osd":2,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77100000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85899999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.47699999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57599999999999996,"15min":0.55200000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83299999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82599999999999996,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.56299999999999994}]},{"osd":4,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67800000000000005,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.435},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.32500000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.73799999999999999,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.36299999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76600000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54800000000000004,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75600000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.58299999999999996},"min":{"1min":0.39200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.626},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298688,"kb_used_data":1400,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073152,"statfs":{"total":96636764160,"available":96330907648,"internally_reserved":0,"allocated":1433600,"data_stored":962128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36599999999999999,"15min":0.379},"min":{"1min":0.25800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.52500000000000002,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.53900000000000003,"15min":0.67300000000000004},"min":{"1min":0.32400000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58299999999999996,"5min":7.6900000000000004,"15min":7.6900000000000004},"last":0.27800000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.497,"15min":0.629},"min":{"1min":0.30099999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.50600000000000001,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.56200000000000006,"15min":0.70199999999999996},"min":{"1min":0.308,"5min":0.251,"15min":0.251},"max":{"1min":0.59499999999999997,"5min":7.758,"15min":7.758},"last":0.35799999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.59199999999999997,"15min":0.72899999999999998},"min":{"1min":0.35799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64700000000000002,"5min":7.7869999999999999,"15min":7.7869999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.42499999999999999},"min":{"1min":0.35499999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.625,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.29399999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.84599999999999997,"15min":1.0700000000000001},"min":{"1min":0.44,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76700000000000002,"5min":11.678000000000001,"15min":11.678000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.76400000000000001,"15min":0.90400000000000003},"min":{"1min":0.50900000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85399999999999998,"5min":7.6529999999999996,"15min":7.6529999999999996},"last":0.443}]},{"osd":5,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.42399999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81799999999999995,"5min":1.399,"15min":1.399},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.80600000000000005,"15min":0.93899999999999995},"min":{"1min":0.495,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84099999999999997,"5min":7.508,"15min":7.508},"last":0.48599999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.78000000000000003,"15min":0.91500000000000004},"min":{"1min":0.47399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83699999999999997,"5min":7.7270000000000003,"15min":7.7270000000000003},"last":0.501},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67300000000000004,"15min":0.68700000000000006},"min":{"1min":0.49399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.873,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.45700000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.497,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.92200000000000004,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.82999999999999996,"15min":0.96099999999999997},"min":{"1min":0.57199999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89200000000000002,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298104,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073736,"statfs":{"total":96636764160,"available":96331505664,"internally_reserved":0,"allocated":835584,"data_stored":370407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.35799999999999998,"15min":0.34699999999999998},"min":{"1min":0.23699999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.53400000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.38,"15min":0.36499999999999999},"min":{"1min":0.29399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51700000000000002,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.307}]},{"osd":2,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.39800000000000002,"15min":0.38900000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57299999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.57199999999999995,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.36799999999999999,"15min":0.35499999999999998},"min":{"1min":0.27500000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.52800000000000002,"5min":0.622,"15min":0.622},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.41199999999999998,"15min":0.39700000000000002},"min":{"1min":0.312,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60899999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95999999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64600000000000002,"15min":0.63900000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94599999999999995,"5min":1.008,"15min":1.008},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81899999999999995,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.621,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93100000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.505}]},{"osd":6,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.47899999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.98899999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.46500000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88700000000000001,"5min":1,"15min":1},"last":0.439}]},{"osd":7,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91600000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.97399999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.56499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":378376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.34799999999999998,"15min":0.33900000000000002},"min":{"1min":0.28899999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38,"15min":0.38200000000000001},"min":{"1min":0.29099999999999998,"5min":0.218,"15min":0.218},"max":{"1min":0.48499999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.29399999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.35999999999999999,"15min":0.34999999999999998},"min":{"1min":0.27200000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.311},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.40500000000000003,"15min":0.40000000000000002},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59199999999999997,"5min":0.621,"15min":0.621},"last":0.375}]},{"osd":3,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42499999999999999,"15min":0.41099999999999998},"min":{"1min":0.35099999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.373,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85199999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88700000000000001,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.58399999999999996,"5min":0.437,"15min":0.437},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.52500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.95399999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.56200000000000006}]},{"osd":6,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.498,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95699999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.52600000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.60999999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.498,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91700000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.503,"5min":0.439,"15min":0.439},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.57399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298116,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073724,"statfs":{"total":96636764160,"available":96331493376,"internally_reserved":0,"allocated":847872,"data_stored":377023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.52900000000000003,"15min":0.69099999999999995},"min":{"1min":0.216,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.61799999999999999,"5min":10.164999999999999,"15min":10.164999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40600000000000003,"15min":0.41099999999999998},"min":{"1min":0.26600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.57899999999999996,"5min":1.266,"15min":1.266},"last":0.318}]},{"osd":1,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42099999999999999,"15min":0.42899999999999999},"min":{"1min":0.27800000000000002,"5min":0.191,"15min":0.191},"max":{"1min":0.58399999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.42999999999999999,"15min":0.432},"min":{"1min":0.311,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66600000000000004,"5min":1.319,"15min":1.319},"last":0.376}]},{"osd":2,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.442,"15min":0.44},"min":{"1min":0.36099999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.627,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.47999999999999998,"15min":0.48899999999999999},"min":{"1min":0.33300000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.68700000000000006,"5min":1.5,"15min":1.5},"last":0.30599999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63700000000000001,"15min":0.63200000000000001},"min":{"1min":0.49299999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88800000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.503},{"interface":"front","average":{"1min":0.629,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.44600000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93100000000000005,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.501,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86299999999999999,"5min":1.538,"15min":1.538},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.64300000000000002},"min":{"1min":0.499,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84299999999999997,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.625,"15min":0.61399999999999999},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.88900000000000001,"5min":1.111,"15min":1.111},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90600000000000003,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.58299999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.47699999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.876,"5min":1.21,"15min":1.21},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.48599999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86199999999999999,"5min":1.135,"15min":1.135},"last":0.49199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":378376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.78800000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54100000000000004,"15min":0.51300000000000001},"min":{"1min":0.42099999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.51500000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.53300000000000003,"15min":0.501},"min":{"1min":0.40600000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.48199999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59099999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.40500000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.75800000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.46600000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77000000000000002,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.497,"15min":0.48999999999999999},"min":{"1min":0.43099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76800000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.443},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.79100000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.47399999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.36399999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75600000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.372,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76700000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.48799999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.34200000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80100000000000005,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.34599999999999997,"5min":0.308,"15min":0.308},"max":{"1min":0.83999999999999997,"5min":1.04,"15min":1.04},"last":0.45700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":378376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.51600000000000001,"15min":0.498},"min":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51300000000000001,"15min":0.49099999999999999},"min":{"1min":0.45600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.52300000000000002,"15min":0.49399999999999999},"min":{"1min":0.42899999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.51300000000000001,"15min":0.498},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.50800000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.58899999999999997,"15min":0.57399999999999995},"min":{"1min":0.46200000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.623}]},{"osd":3,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.53400000000000003,"15min":0.51600000000000001},"min":{"1min":0.40699999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.64600000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.47799999999999998,"15min":0.48899999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.60399999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51100000000000001,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69299999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.56699999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.32200000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.71099999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54700000000000004,"15min":0.56699999999999995},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68999999999999995,"5min":0.873,"15min":0.873},"last":0.41799999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54300000000000004,"15min":0.56299999999999994},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69699999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57299999999999995,"15min":0.60099999999999998},"min":{"1min":0.38,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67600000000000005,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:27:48.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2023-10-06T02:27:48.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.802518+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:30:53.218389+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:27:48.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3e is not active+clean 2023-10-06T02:27:48.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.807980+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:05:00.209850+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:27:48.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3d is not active+clean 2023-10-06T02:27:48.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.796866+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:25:36.224572+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:27:48.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3c is not active+clean 2023-10-06T02:27:48.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.798550+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:30:53.218389+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:27:48.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3b is not active+clean 2023-10-06T02:27:48.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.802678+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:08:04.289183+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:27:48.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3a is not active+clean 2023-10-06T02:27:48.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.801743+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:18:17.054182+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:27:48.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.39 is not active+clean 2023-10-06T02:27:48.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.801456+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:15:59.316808+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:27:48.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.38 is not active+clean 2023-10-06T02:27:48.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.802858+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:45:34.837248+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:27:48.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.37 is not active+clean 2023-10-06T02:27:48.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.801293+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:37:11.571663+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:27:48.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.36 is not active+clean 2023-10-06T02:27:48.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.798313+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:45:33.606927+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:27:48.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.35 is not active+clean 2023-10-06T02:27:48.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.807955+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:52:44.727351+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:27:48.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.34 is not active+clean 2023-10-06T02:27:48.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.797984+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:32:46.415629+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:27:48.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.33 is not active+clean 2023-10-06T02:27:48.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.802208+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:59:54.211724+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:27:48.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.32 is not active+clean 2023-10-06T02:27:48.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.801195+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:05:00.209850+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:27:48.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.31 is not active+clean 2023-10-06T02:27:48.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.809053+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:13:17.377369+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:27:48.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2023-10-06T02:27:48.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.802426+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:45:33.606927+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:27:48.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2f is not active+clean 2023-10-06T02:27:48.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.802907+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:07:28.926179+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:27:48.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2e is not active+clean 2023-10-06T02:27:48.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.797755+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:16:46.464705+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:27:48.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2d is not active+clean 2023-10-06T02:27:48.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.803032+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:54:03.886385+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:27:48.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2c is not active+clean 2023-10-06T02:27:48.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.800763+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:19:30.519208+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:27:48.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2b is not active+clean 2023-10-06T02:27:48.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.803836+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T02:36:48.718543+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:27:48.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2a is not active+clean 2023-10-06T02:27:48.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.805193+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:42:47.636151+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:27:48.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.29 is not active+clean 2023-10-06T02:27:48.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.802680+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:46:40.040632+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:27:48.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.28 is not active+clean 2023-10-06T02:27:48.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.808461+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:11:28.225535+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:27:48.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.27 is not active+clean 2023-10-06T02:27:48.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.801398+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:55:01.723335+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:27:48.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.26 is not active+clean 2023-10-06T02:27:48.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.797772+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:18:54.179105+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:27:48.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2023-10-06T02:27:48.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.807304+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:49:34.837998+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:27:48.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.24 is not active+clean 2023-10-06T02:27:48.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.800268+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:09:03.752060+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:27:48.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.23 is not active+clean 2023-10-06T02:27:48.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.800980+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:19:09.747047+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:27:48.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2023-10-06T02:27:48.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.805049+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:19:09.747047+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:27:48.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.21 is not active+clean 2023-10-06T02:27:48.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.796734+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T02:28:34.237238+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:27:48.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2023-10-06T02:27:48.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.801944+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:32:46.415629+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:27:48.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2023-10-06T02:27:48.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.797008+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:45:14.723560+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:27:48.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-10-06T02:27:48.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.799411+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:45:33.606927+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:27:48.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-10-06T02:27:48.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.802146+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:59:15.684258+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:27:48.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-10-06T02:27:48.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.802182+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:13:09.677215+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:27:48.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-10-06T02:27:48.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.800029+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:30:53.218389+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:27:48.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-10-06T02:27:48.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.800116+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:43:20.572015+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:27:48.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-10-06T02:27:48.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.802265+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:37:46.334285+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:27:48.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-10-06T02:27:48.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.801313+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:05:59.814849+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:27:48.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-10-06T02:27:48.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.800463+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:23:50.633626+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:27:48.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-10-06T02:27:48.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.798675+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:27:17.967348+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:27:48.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-10-06T02:27:48.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.800249+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:52:44.727351+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:27:48.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2023-10-06T02:27:48.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.796949+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T02:52:56.326934+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:27:48.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-10-06T02:27:48.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.797396+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:17:44.568108+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T02:27:48.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-10-06T02:27:48.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.800542+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:39:41.827434+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:27:48.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-10-06T02:27:48.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.799930+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:12:06.792194+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:27:48.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-10-06T02:27:48.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.799859+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:27:58.171529+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:27:48.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-10-06T02:27:48.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.802247+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:20:46.057716+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:27:48.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-10-06T02:27:48.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.801000+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:55:31.826969+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:27:48.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-10-06T02:27:48.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.801182+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:01:31.134356+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T02:27:48.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-10-06T02:27:48.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.799613+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:17:44.568108+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:27:48.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-10-06T02:27:48.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.799848+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:44:28.136884+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:27:48.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-10-06T02:27:48.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.800065+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:33:11.236431+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:27:48.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2023-10-06T02:27:48.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.797159+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:32:42.464983+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:27:48.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2023-10-06T02:27:48.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.796962+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:46:26.286335+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:27:48.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-10-06T02:27:48.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.800749+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:13:17.377369+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:27:48.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2023-10-06T02:27:48.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.802069+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:55:50.706021+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:27:48.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-10-06T02:27:48.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.799401+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:32:46.415629+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:27:48.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-10-06T02:27:48.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.800805+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:38:16.944536+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T02:27:48.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-10-06T02:27:48.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.804625+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:23:50.633626+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T02:27:48.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-10-06T02:27:48.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.799338+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:18:54.179105+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T02:27:48.783 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2023-10-06T02:27:48.783 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.801580+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:11:28.225535+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T02:27:48.784 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-10-06T02:27:48.784 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:27:42.788150+0000', 'last_change': '2023-10-06T02:27:42.799894+0000', 'last_active': '2023-10-06T02:27:42.788150+0000', 'last_peered': '2023-10-06T02:27:42.788150+0000', 'last_clean': '2023-10-06T02:27:42.788150+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:27:42.788150+0000', 'last_undegraded': '2023-10-06T02:27:42.788150+0000', 'last_fullsized': '2023-10-06T02:27:42.788150+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'last_clean_scrub_stamp': '2023-10-06T02:27:42.788150+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:12:09.790709+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T02:27:48.785 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T02:27:48.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.903+0000 7f437d58f700 1 Processor -- start 2023-10-06T02:27:48.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.903+0000 7f437d58f700 1 -- start start 2023-10-06T02:27:48.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.904+0000 7f437d58f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4378156f50 0x7f437815a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.904+0000 7f437d58f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4378157320 0x7f43780ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.904+0000 7f437d58f700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f437815d170 0x7f43780cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.904+0000 7f437d58f700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43780cb320 con 0x7f4378157320 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.904+0000 7f437d58f700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f437815d710 con 0x7f437815d170 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.904+0000 7f437d58f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437815d9f0 con 0x7f4378156f50 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.904+0000 7f43767fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4378157320 0x7f43780ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.904+0000 7f43767fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4378157320 0x7f43780ce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53074/0 (socket says 172.21.15.37:53074) 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.904+0000 7f43767fc700 1 -- 172.21.15.37:0/1035116085 learned_addr learned my addr 172.21.15.37:0/1035116085 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.904+0000 7f43777fe700 1 --2- 172.21.15.37:0/1035116085 >> v2:172.21.15.191:3300/0 conn(0x7f437815d170 0x7f43780cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.904+0000 7f4376ffd700 1 --2- 172.21.15.37:0/1035116085 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4378156f50 0x7f437815a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.904+0000 7f43767fc700 1 -- 172.21.15.37:0/1035116085 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4378156f50 msgr2=0x7f437815a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.904+0000 7f43767fc700 1 --2- 172.21.15.37:0/1035116085 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4378156f50 0x7f437815a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.904+0000 7f43767fc700 1 -- 172.21.15.37:0/1035116085 >> v2:172.21.15.191:3300/0 conn(0x7f437815d170 msgr2=0x7f43780cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.904+0000 7f43767fc700 1 --2- 172.21.15.37:0/1035116085 >> v2:172.21.15.191:3300/0 conn(0x7f437815d170 0x7f43780cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.904+0000 7f43767fc700 1 -- 172.21.15.37:0/1035116085 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437815dcd0 con 0x7f4378157320 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.904+0000 7f43767fc700 1 --2- 172.21.15.37:0/1035116085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4378157320 0x7f43780ce8c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f43780cb290 tx=0x7f4360009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf300241d50b3e61 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.905+0000 7f4375ffb700 1 -- 172.21.15.37:0/1035116085 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436000b640 con 0x7f4378157320 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.905+0000 7f4375ffb700 1 -- 172.21.15.37:0/1035116085 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436000b7a0 con 0x7f4378157320 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.905+0000 7f4375ffb700 1 -- 172.21.15.37:0/1035116085 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436000bb60 con 0x7f4378157320 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.905+0000 7f437d58f700 1 -- 172.21.15.37:0/1035116085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4378157320 msgr2=0x7f43780ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.905+0000 7f437d58f700 1 --2- 172.21.15.37:0/1035116085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4378157320 0x7f43780ce8c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f43780cb290 tx=0x7f4360009250 comp rx=0 tx=0).stop 2023-10-06T02:27:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.905+0000 7f437d58f700 1 -- 172.21.15.37:0/1035116085 shutdown_connections 2023-10-06T02:27:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.905+0000 7f437d58f700 1 --2- 172.21.15.37:0/1035116085 >> v2:172.21.15.191:3300/0 conn(0x7f437815d170 0x7f43780cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.905+0000 7f437d58f700 1 --2- 172.21.15.37:0/1035116085 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4378156f50 0x7f437815a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.905+0000 7f437d58f700 1 --2- 172.21.15.37:0/1035116085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4378157320 0x7f43780ce8c0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.905+0000 7f437d58f700 1 -- 172.21.15.37:0/1035116085 >> 172.21.15.37:0/1035116085 conn(0x7f43780d04f0 msgr2=0x7f43780d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.905+0000 7f437d58f700 1 -- 172.21.15.37:0/1035116085 shutdown_connections 2023-10-06T02:27:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.905+0000 7f437d58f700 1 -- 172.21.15.37:0/1035116085 wait complete. 2023-10-06T02:27:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.906+0000 7f437d58f700 1 Processor -- start 2023-10-06T02:27:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.906+0000 7f437d58f700 1 -- start start 2023-10-06T02:27:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.907+0000 7f437d58f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4378156f50 0x7f43780c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.907+0000 7f437d58f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4378157320 0x7f43780cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.907+0000 7f437d58f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f437815d170 0x7f43780cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.907+0000 7f437d58f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437816b450 con 0x7f4378157320 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.907+0000 7f437d58f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43780b03a0 con 0x7f4378156f50 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.907+0000 7f437d58f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43780b0680 con 0x7f437815d170 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.907+0000 7f43767fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4378157320 0x7f43780cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.907+0000 7f43767fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4378157320 0x7f43780cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53078/0 (socket says 172.21.15.37:53078) 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.907+0000 7f43767fc700 1 -- 172.21.15.37:0/247472797 learned_addr learned my addr 172.21.15.37:0/247472797 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.907+0000 7f4376ffd700 1 --2- 172.21.15.37:0/247472797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4378156f50 0x7f43780c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.907+0000 7f43777fe700 1 --2- 172.21.15.37:0/247472797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f437815d170 0x7f43780cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.908+0000 7f43767fc700 1 -- 172.21.15.37:0/247472797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f437815d170 msgr2=0x7f43780cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.908+0000 7f43767fc700 1 --2- 172.21.15.37:0/247472797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f437815d170 0x7f43780cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.908+0000 7f43767fc700 1 -- 172.21.15.37:0/247472797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4378156f50 msgr2=0x7f43780c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.908+0000 7f43767fc700 1 --2- 172.21.15.37:0/247472797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4378156f50 0x7f43780c9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.908+0000 7f43767fc700 1 -- 172.21.15.37:0/247472797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43600094f0 con 0x7f4378157320 2023-10-06T02:27:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.908+0000 7f43777fe700 1 --2- 172.21.15.37:0/247472797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f437815d170 0x7f43780cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.908+0000 7f43767fc700 1 --2- 172.21.15.37:0/247472797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4378157320 0x7f43780cb5c0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f437806d190 tx=0x7f4360017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.908+0000 7f436effd700 1 -- 172.21.15.37:0/247472797 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360000d10 con 0x7f4378157320 2023-10-06T02:27:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.908+0000 7f436effd700 1 -- 172.21.15.37:0/247472797 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436000bb20 con 0x7f4378157320 2023-10-06T02:27:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.908+0000 7f437d58f700 1 -- 172.21.15.37:0/247472797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43780b0960 con 0x7f4378157320 2023-10-06T02:27:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.908+0000 7f436effd700 1 -- 172.21.15.37:0/247472797 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360011690 con 0x7f4378157320 2023-10-06T02:27:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.908+0000 7f437d58f700 1 -- 172.21.15.37:0/247472797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43780ca3b0 con 0x7f4378157320 2023-10-06T02:27:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.909+0000 7f437d58f700 1 -- 172.21.15.37:0/247472797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43780b0e60 con 0x7f4378157320 2023-10-06T02:27:49.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.909+0000 7f436effd700 1 -- 172.21.15.37:0/247472797 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4360011a00 con 0x7f4378157320 2023-10-06T02:27:49.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.910+0000 7f436effd700 1 --2- 172.21.15.37:0/247472797 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4358066f30 0x7f43580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:49.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.910+0000 7f436effd700 1 -- 172.21.15.37:0/247472797 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4360085ba0 con 0x7f4378157320 2023-10-06T02:27:49.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.910+0000 7f4376ffd700 1 --2- 172.21.15.37:0/247472797 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4358066f30 0x7f43580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:49.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.911+0000 7f4376ffd700 1 --2- 172.21.15.37:0/247472797 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4358066f30 0x7f43580693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f43780b0030 tx=0x7f43700091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:49.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:48.914+0000 7f436effd700 1 -- 172.21.15.37:0/247472797 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4360052d30 con 0x7f4378157320 2023-10-06T02:27:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.186+0000 7f437d58f700 1 -- 172.21.15.37:0/247472797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f437815dfb0 con 0x7f4378157320 2023-10-06T02:27:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.186+0000 7f436effd700 1 -- 172.21.15.37:0/247472797 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1037 (secure 0 0 0) 0x7f4360028420 con 0x7f4378157320 2023-10-06T02:27:49.188 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:49.188 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":292,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":72,"num_osds":8,"num_up_osds":8,"osd_up_since":1696558987,"num_in_osds":8,"osd_in_since":1696558979,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":2443350016,"bytes_avail":770650763264,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":47,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"d","status":"up:active","gid":6465}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-10-06T02:27:26.571408+0000","services":{}},"progress_events":{}} 2023-10-06T02:27:49.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.188+0000 7f437d58f700 1 -- 172.21.15.37:0/247472797 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4358066f30 msgr2=0x7f43580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:49.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.188+0000 7f437d58f700 1 --2- 172.21.15.37:0/247472797 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4358066f30 0x7f43580693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f43780b0030 tx=0x7f43700091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.188+0000 7f437d58f700 1 -- 172.21.15.37:0/247472797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4378157320 msgr2=0x7f43780cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:49.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.188+0000 7f437d58f700 1 --2- 172.21.15.37:0/247472797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4378157320 0x7f43780cb5c0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f437806d190 tx=0x7f4360017000 comp rx=0 tx=0).stop 2023-10-06T02:27:49.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.188+0000 7f437d58f700 1 -- 172.21.15.37:0/247472797 shutdown_connections 2023-10-06T02:27:49.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.188+0000 7f437d58f700 1 --2- 172.21.15.37:0/247472797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f437815d170 0x7f43780cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.188+0000 7f437d58f700 1 --2- 172.21.15.37:0/247472797 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4358066f30 0x7f43580693e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.188+0000 7f437d58f700 1 --2- 172.21.15.37:0/247472797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4378156f50 0x7f43780c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.188+0000 7f437d58f700 1 --2- 172.21.15.37:0/247472797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4378157320 0x7f43780cb5c0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.188+0000 7f437d58f700 1 -- 172.21.15.37:0/247472797 >> 172.21.15.37:0/247472797 conn(0x7f43780d04f0 msgr2=0x7f43780d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:49.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.188+0000 7f437d58f700 1 -- 172.21.15.37:0/247472797 shutdown_connections 2023-10-06T02:27:49.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.188+0000 7f437d58f700 1 -- 172.21.15.37:0/247472797 wait complete. 2023-10-06T02:27:49.202 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T02:27:49.227 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:27:49.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.344+0000 7fd8540c5700 1 Processor -- start 2023-10-06T02:27:49.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.344+0000 7fd8540c5700 1 -- start start 2023-10-06T02:27:49.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.345+0000 7fd8540c5700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd84c159760 0x7fd84c15d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:49.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.345+0000 7fd8540c5700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd84c15d8d0 0x7fd84c15dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:49.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.345+0000 7fd8540c5700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84c0cb650 con 0x7fd84c0c5390 2023-10-06T02:27:49.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.345+0000 7fd8540c5700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd84c0cc2d0 con 0x7fd84c15d8d0 2023-10-06T02:27:49.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.345+0000 7fd8540c5700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd84c0cb930 con 0x7fd84c159760 2023-10-06T02:27:49.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.345+0000 7fd851660700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd84c15d8d0 0x7fd84c15dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.345+0000 7fd852662700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd84c0c5390 0x7fd84c0c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47784/0 (socket says 172.21.15.37:47784) 2023-10-06T02:27:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.345+0000 7fd852662700 1 -- 172.21.15.37:0/196217519 learned_addr learned my addr 172.21.15.37:0/196217519 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.345+0000 7fd851e61700 1 --2- 172.21.15.37:0/196217519 >> v2:172.21.15.191:3300/0 conn(0x7fd84c159760 0x7fd84c15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.345+0000 7fd851660700 1 -- 172.21.15.37:0/196217519 >> v2:172.21.15.191:3300/0 conn(0x7fd84c159760 msgr2=0x7fd84c15d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.345+0000 7fd851660700 1 --2- 172.21.15.37:0/196217519 >> v2:172.21.15.191:3300/0 conn(0x7fd84c159760 0x7fd84c15d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.346+0000 7fd851660700 1 -- 172.21.15.37:0/196217519 >> v1:172.21.15.37:6789/0 conn(0x7fd84c0c5390 legacy=0x7fd84c0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.346+0000 7fd850e5f700 1 -- 172.21.15.37:0/196217519 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317920670 0 0) 0x7fd84c0cb650 con 0x7fd84c0c5390 2023-10-06T02:27:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.346+0000 7fd851660700 1 -- 172.21.15.37:0/196217519 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84c0cbc10 con 0x7fd84c15d8d0 2023-10-06T02:27:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.346+0000 7fd851660700 1 --2- 172.21.15.37:0/196217519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd84c15d8d0 0x7fd84c15dd50 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd84c0897f0 tx=0x7fd8400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e384252fe33dc9bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.346+0000 7fd850e5f700 1 -- 172.21.15.37:0/196217519 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84000b690 con 0x7fd84c15d8d0 2023-10-06T02:27:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.346+0000 7fd850e5f700 1 -- 172.21.15.37:0/196217519 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84000b7f0 con 0x7fd84c15d8d0 2023-10-06T02:27:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.346+0000 7fd850e5f700 1 -- 172.21.15.37:0/196217519 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84000bb90 con 0x7fd84c15d8d0 2023-10-06T02:27:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.346+0000 7fd8540c5700 1 -- 172.21.15.37:0/196217519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd84c15d8d0 msgr2=0x7fd84c15dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.346+0000 7fd8540c5700 1 --2- 172.21.15.37:0/196217519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd84c15d8d0 0x7fd84c15dd50 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd84c0897f0 tx=0x7fd8400091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.346+0000 7fd8540c5700 1 -- 172.21.15.37:0/196217519 shutdown_connections 2023-10-06T02:27:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.346+0000 7fd8540c5700 1 --2- 172.21.15.37:0/196217519 >> v2:172.21.15.191:3300/0 conn(0x7fd84c159760 0x7fd84c15d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.346+0000 7fd8540c5700 1 --2- 172.21.15.37:0/196217519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd84c15d8d0 0x7fd84c15dd50 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.346+0000 7fd8540c5700 1 -- 172.21.15.37:0/196217519 >> 172.21.15.37:0/196217519 conn(0x7fd84c06c890 msgr2=0x7fd84c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.347+0000 7fd8540c5700 1 -- 172.21.15.37:0/196217519 shutdown_connections 2023-10-06T02:27:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.347+0000 7fd8540c5700 1 -- 172.21.15.37:0/196217519 wait complete. 2023-10-06T02:27:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.348+0000 7fd8540c5700 1 Processor -- start 2023-10-06T02:27:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.348+0000 7fd8540c5700 1 -- start start 2023-10-06T02:27:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.348+0000 7fd8540c5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd84c0c5390 0x7fd84c169b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.348+0000 7fd8540c5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd84c159760 0x7fd84c16c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.348+0000 7fd8540c5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd84c15d8d0 0x7fd84c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.348+0000 7fd8540c5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c0b3300 con 0x7fd84c159760 2023-10-06T02:27:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.348+0000 7fd8540c5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c0b40f0 con 0x7fd84c0c5390 2023-10-06T02:27:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.348+0000 7fd8540c5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c16ce70 con 0x7fd84c15d8d0 2023-10-06T02:27:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.348+0000 7fd851660700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd84c159760 0x7fd84c16c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.348+0000 7fd851660700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd84c159760 0x7fd84c16c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53096/0 (socket says 172.21.15.37:53096) 2023-10-06T02:27:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.348+0000 7fd851660700 1 -- 172.21.15.37:0/2379952701 learned_addr learned my addr 172.21.15.37:0/2379952701 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.349+0000 7fd852662700 1 --2- 172.21.15.37:0/2379952701 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd84c15d8d0 0x7fd84c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.349+0000 7fd851e61700 1 --2- 172.21.15.37:0/2379952701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd84c0c5390 0x7fd84c169b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.349+0000 7fd851660700 1 -- 172.21.15.37:0/2379952701 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd84c15d8d0 msgr2=0x7fd84c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.349+0000 7fd851660700 1 --2- 172.21.15.37:0/2379952701 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd84c15d8d0 0x7fd84c15a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.349+0000 7fd851660700 1 -- 172.21.15.37:0/2379952701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd84c0c5390 msgr2=0x7fd84c169b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.349+0000 7fd851660700 1 --2- 172.21.15.37:0/2379952701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd84c0c5390 0x7fd84c169b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.349+0000 7fd851660700 1 -- 172.21.15.37:0/2379952701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd840009420 con 0x7fd84c159760 2023-10-06T02:27:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.349+0000 7fd851660700 1 --2- 172.21.15.37:0/2379952701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd84c159760 0x7fd84c16c930 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fd8400091e0 tx=0x7fd840017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.349+0000 7fd849ffb700 1 -- 172.21.15.37:0/2379952701 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840020070 con 0x7fd84c159760 2023-10-06T02:27:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.349+0000 7fd849ffb700 1 -- 172.21.15.37:0/2379952701 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84000bb70 con 0x7fd84c159760 2023-10-06T02:27:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.349+0000 7fd8540c5700 1 -- 172.21.15.37:0/2379952701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84c15ba00 con 0x7fd84c159760 2023-10-06T02:27:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.349+0000 7fd849ffb700 1 -- 172.21.15.37:0/2379952701 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840011650 con 0x7fd84c159760 2023-10-06T02:27:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.349+0000 7fd8540c5700 1 -- 172.21.15.37:0/2379952701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84c0b37c0 con 0x7fd84c159760 2023-10-06T02:27:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.350+0000 7fd8540c5700 1 -- 172.21.15.37:0/2379952701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd84c06fbf0 con 0x7fd84c159760 2023-10-06T02:27:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.351+0000 7fd849ffb700 1 -- 172.21.15.37:0/2379952701 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd840011a80 con 0x7fd84c159760 2023-10-06T02:27:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.351+0000 7fd849ffb700 1 --2- 172.21.15.37:0/2379952701 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd838066f30 0x7fd8380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.351+0000 7fd849ffb700 1 -- 172.21.15.37:0/2379952701 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd840085b10 con 0x7fd84c159760 2023-10-06T02:27:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.352+0000 7fd851e61700 1 --2- 172.21.15.37:0/2379952701 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd838066f30 0x7fd8380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.352+0000 7fd851e61700 1 --2- 172.21.15.37:0/2379952701 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd838066f30 0x7fd8380693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd844009d40 tx=0x7fd844008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.356+0000 7fd849ffb700 1 -- 172.21.15.37:0/2379952701 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd840052c20 con 0x7fd84c159760 2023-10-06T02:27:49.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.546+0000 7fd8540c5700 1 -- 172.21.15.37:0/2379952701 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd84c0b4230 con 0x7fd838066f30 2023-10-06T02:27:50.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.555+0000 7fd849ffb700 1 -- 172.21.15.37:0/2379952701 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309022 (secure 0 0 0) 0x7fd84c0b4230 con 0x7fd838066f30 2023-10-06T02:27:50.088 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:50.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.558+0000 7fd8540c5700 1 -- 172.21.15.37:0/2379952701 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd838066f30 msgr2=0x7fd8380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:50.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.558+0000 7fd8540c5700 1 --2- 172.21.15.37:0/2379952701 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd838066f30 0x7fd8380693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd844009d40 tx=0x7fd844008040 comp rx=0 tx=0).stop 2023-10-06T02:27:50.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.558+0000 7fd8540c5700 1 -- 172.21.15.37:0/2379952701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd84c159760 msgr2=0x7fd84c16c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:50.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.558+0000 7fd8540c5700 1 --2- 172.21.15.37:0/2379952701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd84c159760 0x7fd84c16c930 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fd8400091e0 tx=0x7fd840017000 comp rx=0 tx=0).stop 2023-10-06T02:27:50.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.558+0000 7fd8540c5700 1 -- 172.21.15.37:0/2379952701 shutdown_connections 2023-10-06T02:27:50.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.558+0000 7fd8540c5700 1 --2- 172.21.15.37:0/2379952701 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd84c15d8d0 0x7fd84c15a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:50.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.558+0000 7fd8540c5700 1 --2- 172.21.15.37:0/2379952701 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd838066f30 0x7fd8380693e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:50.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.558+0000 7fd8540c5700 1 --2- 172.21.15.37:0/2379952701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd84c0c5390 0x7fd84c169b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:50.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.558+0000 7fd8540c5700 1 --2- 172.21.15.37:0/2379952701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd84c159760 0x7fd84c16c930 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:50.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.558+0000 7fd8540c5700 1 -- 172.21.15.37:0/2379952701 >> 172.21.15.37:0/2379952701 conn(0x7fd84c06c890 msgr2=0x7fd84c06dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:50.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.558+0000 7fd8540c5700 1 -- 172.21.15.37:0/2379952701 shutdown_connections 2023-10-06T02:27:50.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:49.558+0000 7fd8540c5700 1 -- 172.21.15.37:0/2379952701 wait complete. 2023-10-06T02:27:50.091 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:27:50.091 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2023-10-06T02:27:48.576301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2386084,"kb_used_data":7780,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752588636,"statfs":{"total":773094113280,"available":770650763264,"internally_reserved":0,"allocated":7966720,"data_stored":4190453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001544"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802518+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:53.218389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.807980+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:00.209850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.796866+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:36.224572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.798550+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:53.218389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802678+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:04.289183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801743+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:17.054182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801456+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:15:59.316808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802858+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:45:34.837248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801293+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:11.571663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.798313+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:33.606927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.807955+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:44.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797984+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:46.415629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802208+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:54.211724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801195+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:00.209850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.809053+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:17.377369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802426+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:33.606927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802907+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:28.926179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797755+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:46.464705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.803032+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:03.886385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800763+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:30.519208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.803836+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:36:48.718543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.805193+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:47.636151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802680+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:40.040632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.808461+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:28.225535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801398+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:01.723335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797772+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:54.179105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.807304+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:34.837998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800268+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:03.752060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800980+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:09.747047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.805049+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:09.747047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.796734+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:28:34.237238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801944+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:46.415629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797008+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:14.723560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813044+0000","last_change":"2023-10-06T02:27:42.813044+0000","last_active":"2023-10-06T02:27:42.813044+0000","last_peered":"2023-10-06T02:27:42.813044+0000","last_clean":"2023-10-06T02:27:42.813044+0000","last_became_active":"2023-10-06T02:27:42.812776+0000","last_became_peered":"2023-10-06T02:27:42.812776+0000","last_unstale":"2023-10-06T02:27:42.813044+0000","last_undegraded":"2023-10-06T02:27:42.813044+0000","last_fullsized":"2023-10-06T02:27:42.813044+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:47.491511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799411+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:33.606927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.812884+0000","last_change":"2023-10-06T02:27:42.812884+0000","last_active":"2023-10-06T02:27:42.812884+0000","last_peered":"2023-10-06T02:27:42.812884+0000","last_clean":"2023-10-06T02:27:42.812884+0000","last_became_active":"2023-10-06T02:27:42.812665+0000","last_became_peered":"2023-10-06T02:27:42.812665+0000","last_unstale":"2023-10-06T02:27:42.812884+0000","last_undegraded":"2023-10-06T02:27:42.812884+0000","last_fullsized":"2023-10-06T02:27:42.812884+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:29.170337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802146+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:15.684258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.815975+0000","last_change":"2023-10-06T02:27:42.815975+0000","last_active":"2023-10-06T02:27:42.815975+0000","last_peered":"2023-10-06T02:27:42.815975+0000","last_clean":"2023-10-06T02:27:42.815975+0000","last_became_active":"2023-10-06T02:27:42.815717+0000","last_became_peered":"2023-10-06T02:27:42.815717+0000","last_unstale":"2023-10-06T02:27:42.815975+0000","last_undegraded":"2023-10-06T02:27:42.815975+0000","last_fullsized":"2023-10-06T02:27:42.815975+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:43.563364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802182+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:09.677215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.814055+0000","last_change":"2023-10-06T02:27:42.814055+0000","last_active":"2023-10-06T02:27:42.814055+0000","last_peered":"2023-10-06T02:27:42.814055+0000","last_clean":"2023-10-06T02:27:42.814055+0000","last_became_active":"2023-10-06T02:27:42.813793+0000","last_became_peered":"2023-10-06T02:27:42.813793+0000","last_unstale":"2023-10-06T02:27:42.814055+0000","last_undegraded":"2023-10-06T02:27:42.814055+0000","last_fullsized":"2023-10-06T02:27:42.814055+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:30.927523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800029+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:53.218389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.811221+0000","last_change":"2023-10-06T02:27:42.811221+0000","last_active":"2023-10-06T02:27:42.811221+0000","last_peered":"2023-10-06T02:27:42.811221+0000","last_clean":"2023-10-06T02:27:42.811221+0000","last_became_active":"2023-10-06T02:27:42.810661+0000","last_became_peered":"2023-10-06T02:27:42.810661+0000","last_unstale":"2023-10-06T02:27:42.811221+0000","last_undegraded":"2023-10-06T02:27:42.811221+0000","last_fullsized":"2023-10-06T02:27:42.811221+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:25.281591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800116+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:20.572015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.811978+0000","last_change":"2023-10-06T02:27:42.811978+0000","last_active":"2023-10-06T02:27:42.811978+0000","last_peered":"2023-10-06T02:27:42.811978+0000","last_clean":"2023-10-06T02:27:42.811978+0000","last_became_active":"2023-10-06T02:27:42.811662+0000","last_became_peered":"2023-10-06T02:27:42.811662+0000","last_unstale":"2023-10-06T02:27:42.811978+0000","last_undegraded":"2023-10-06T02:27:42.811978+0000","last_fullsized":"2023-10-06T02:27:42.811978+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:31.613891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802265+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:37:46.334285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813508+0000","last_change":"2023-10-06T02:27:42.813508+0000","last_active":"2023-10-06T02:27:42.813508+0000","last_peered":"2023-10-06T02:27:42.813508+0000","last_clean":"2023-10-06T02:27:42.813508+0000","last_became_active":"2023-10-06T02:27:42.813249+0000","last_became_peered":"2023-10-06T02:27:42.813249+0000","last_unstale":"2023-10-06T02:27:42.813508+0000","last_undegraded":"2023-10-06T02:27:42.813508+0000","last_fullsized":"2023-10-06T02:27:42.813508+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:29.170337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801313+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:59.814849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.811677+0000","last_change":"2023-10-06T02:27:42.811677+0000","last_active":"2023-10-06T02:27:42.811677+0000","last_peered":"2023-10-06T02:27:42.811677+0000","last_clean":"2023-10-06T02:27:42.811677+0000","last_became_active":"2023-10-06T02:27:42.811370+0000","last_became_peered":"2023-10-06T02:27:42.811370+0000","last_unstale":"2023-10-06T02:27:42.811677+0000","last_undegraded":"2023-10-06T02:27:42.811677+0000","last_fullsized":"2023-10-06T02:27:42.811677+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:55:16.818646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800463+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:50.633626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813430+0000","last_change":"2023-10-06T02:27:42.813430+0000","last_active":"2023-10-06T02:27:42.813430+0000","last_peered":"2023-10-06T02:27:42.813430+0000","last_clean":"2023-10-06T02:27:42.813430+0000","last_became_active":"2023-10-06T02:27:42.813263+0000","last_became_peered":"2023-10-06T02:27:42.813263+0000","last_unstale":"2023-10-06T02:27:42.813430+0000","last_undegraded":"2023-10-06T02:27:42.813430+0000","last_fullsized":"2023-10-06T02:27:42.813430+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:28.180005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.798675+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:17.967348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.812967+0000","last_change":"2023-10-06T02:27:42.812967+0000","last_active":"2023-10-06T02:27:42.812967+0000","last_peered":"2023-10-06T02:27:42.812967+0000","last_clean":"2023-10-06T02:27:42.812967+0000","last_became_active":"2023-10-06T02:27:42.812686+0000","last_became_peered":"2023-10-06T02:27:42.812686+0000","last_unstale":"2023-10-06T02:27:42.812967+0000","last_undegraded":"2023-10-06T02:27:42.812967+0000","last_fullsized":"2023-10-06T02:27:42.812967+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:36:47.713799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800249+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:44.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.815152+0000","last_change":"2023-10-06T02:27:42.815152+0000","last_active":"2023-10-06T02:27:42.815152+0000","last_peered":"2023-10-06T02:27:42.815152+0000","last_clean":"2023-10-06T02:27:42.815152+0000","last_became_active":"2023-10-06T02:27:42.814822+0000","last_became_peered":"2023-10-06T02:27:42.814822+0000","last_unstale":"2023-10-06T02:27:42.815152+0000","last_undegraded":"2023-10-06T02:27:42.815152+0000","last_fullsized":"2023-10-06T02:27:42.815152+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:48.778361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.796949+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:56.326934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.806783+0000","last_change":"2023-10-06T02:27:42.806783+0000","last_active":"2023-10-06T02:27:42.806783+0000","last_peered":"2023-10-06T02:27:42.806783+0000","last_clean":"2023-10-06T02:27:42.806783+0000","last_became_active":"2023-10-06T02:27:42.806497+0000","last_became_peered":"2023-10-06T02:27:42.806497+0000","last_unstale":"2023-10-06T02:27:42.806783+0000","last_undegraded":"2023-10-06T02:27:42.806783+0000","last_fullsized":"2023-10-06T02:27:42.806783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:43:44.444253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797396+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:44.568108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.805768+0000","last_change":"2023-10-06T02:27:42.805768+0000","last_active":"2023-10-06T02:27:42.805768+0000","last_peered":"2023-10-06T02:27:42.805768+0000","last_clean":"2023-10-06T02:27:42.805768+0000","last_became_active":"2023-10-06T02:27:42.805483+0000","last_became_peered":"2023-10-06T02:27:42.805483+0000","last_unstale":"2023-10-06T02:27:42.805768+0000","last_undegraded":"2023-10-06T02:27:42.805768+0000","last_fullsized":"2023-10-06T02:27:42.805768+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:39.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800542+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:41.827434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.812082+0000","last_change":"2023-10-06T02:27:42.812082+0000","last_active":"2023-10-06T02:27:42.812082+0000","last_peered":"2023-10-06T02:27:42.812082+0000","last_clean":"2023-10-06T02:27:42.812082+0000","last_became_active":"2023-10-06T02:27:42.811811+0000","last_became_peered":"2023-10-06T02:27:42.811811+0000","last_unstale":"2023-10-06T02:27:42.812082+0000","last_undegraded":"2023-10-06T02:27:42.812082+0000","last_fullsized":"2023-10-06T02:27:42.812082+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:39.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799930+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:12:06.792194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813049+0000","last_change":"2023-10-06T02:27:42.813049+0000","last_active":"2023-10-06T02:27:42.813049+0000","last_peered":"2023-10-06T02:27:42.813049+0000","last_clean":"2023-10-06T02:27:42.813049+0000","last_became_active":"2023-10-06T02:27:42.812763+0000","last_became_peered":"2023-10-06T02:27:42.812763+0000","last_unstale":"2023-10-06T02:27:42.813049+0000","last_undegraded":"2023-10-06T02:27:42.813049+0000","last_fullsized":"2023-10-06T02:27:42.813049+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:09.771266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799859+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:58.171529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.812011+0000","last_change":"2023-10-06T02:27:42.812011+0000","last_active":"2023-10-06T02:27:42.812011+0000","last_peered":"2023-10-06T02:27:42.812011+0000","last_clean":"2023-10-06T02:27:42.812011+0000","last_became_active":"2023-10-06T02:27:42.810343+0000","last_became_peered":"2023-10-06T02:27:42.810343+0000","last_unstale":"2023-10-06T02:27:42.812011+0000","last_undegraded":"2023-10-06T02:27:42.812011+0000","last_fullsized":"2023-10-06T02:27:42.812011+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:31.613891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802247+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:46.057716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.809942+0000","last_change":"2023-10-06T02:27:42.809942+0000","last_active":"2023-10-06T02:27:42.809942+0000","last_peered":"2023-10-06T02:27:42.809942+0000","last_clean":"2023-10-06T02:27:42.809942+0000","last_became_active":"2023-10-06T02:27:42.809577+0000","last_became_peered":"2023-10-06T02:27:42.809577+0000","last_unstale":"2023-10-06T02:27:42.809942+0000","last_undegraded":"2023-10-06T02:27:42.809942+0000","last_fullsized":"2023-10-06T02:27:42.809942+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:28.180005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801000+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:55:31.826969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.810405+0000","last_change":"2023-10-06T02:27:42.810405+0000","last_active":"2023-10-06T02:27:42.810405+0000","last_peered":"2023-10-06T02:27:42.810405+0000","last_clean":"2023-10-06T02:27:42.810405+0000","last_became_active":"2023-10-06T02:27:42.810102+0000","last_became_peered":"2023-10-06T02:27:42.810102+0000","last_unstale":"2023-10-06T02:27:42.810405+0000","last_undegraded":"2023-10-06T02:27:42.810405+0000","last_fullsized":"2023-10-06T02:27:42.810405+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:28.180005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801182+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:31.134356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813189+0000","last_change":"2023-10-06T02:27:42.813189+0000","last_active":"2023-10-06T02:27:42.813189+0000","last_peered":"2023-10-06T02:27:42.813189+0000","last_clean":"2023-10-06T02:27:42.813189+0000","last_became_active":"2023-10-06T02:27:42.812916+0000","last_became_peered":"2023-10-06T02:27:42.812916+0000","last_unstale":"2023-10-06T02:27:42.813189+0000","last_undegraded":"2023-10-06T02:27:42.813189+0000","last_fullsized":"2023-10-06T02:27:42.813189+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:36:47.713799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799613+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:44.568108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.812184+0000","last_change":"2023-10-06T02:27:42.812184+0000","last_active":"2023-10-06T02:27:42.812184+0000","last_peered":"2023-10-06T02:27:42.812184+0000","last_clean":"2023-10-06T02:27:42.812184+0000","last_became_active":"2023-10-06T02:27:42.811906+0000","last_became_peered":"2023-10-06T02:27:42.811906+0000","last_unstale":"2023-10-06T02:27:42.812184+0000","last_undegraded":"2023-10-06T02:27:42.812184+0000","last_fullsized":"2023-10-06T02:27:42.812184+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:31.613891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799848+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:28.136884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.809545+0000","last_change":"2023-10-06T02:27:42.809545+0000","last_active":"2023-10-06T02:27:42.809545+0000","last_peered":"2023-10-06T02:27:42.809545+0000","last_clean":"2023-10-06T02:27:42.809545+0000","last_became_active":"2023-10-06T02:27:42.809216+0000","last_became_peered":"2023-10-06T02:27:42.809216+0000","last_unstale":"2023-10-06T02:27:42.809545+0000","last_undegraded":"2023-10-06T02:27:42.809545+0000","last_fullsized":"2023-10-06T02:27:42.809545+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:12.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800065+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:11.236431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.813522+0000","last_change":"2023-10-06T02:27:42.813522+0000","last_active":"2023-10-06T02:27:42.813522+0000","last_peered":"2023-10-06T02:27:42.813522+0000","last_clean":"2023-10-06T02:27:42.813522+0000","last_became_active":"2023-10-06T02:27:42.813279+0000","last_became_peered":"2023-10-06T02:27:42.813279+0000","last_unstale":"2023-10-06T02:27:42.813522+0000","last_undegraded":"2023-10-06T02:27:42.813522+0000","last_fullsized":"2023-10-06T02:27:42.813522+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:59.272780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.797159+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:42.464983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.811203+0000","last_change":"2023-10-06T02:27:42.811203+0000","last_active":"2023-10-06T02:27:42.811203+0000","last_peered":"2023-10-06T02:27:42.811203+0000","last_clean":"2023-10-06T02:27:42.811203+0000","last_became_active":"2023-10-06T02:27:42.810876+0000","last_became_peered":"2023-10-06T02:27:42.810876+0000","last_unstale":"2023-10-06T02:27:42.811203+0000","last_undegraded":"2023-10-06T02:27:42.811203+0000","last_fullsized":"2023-10-06T02:27:42.811203+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:28.067756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.796962+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:26.286335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.806843+0000","last_change":"2023-10-06T02:27:42.806843+0000","last_active":"2023-10-06T02:27:42.806843+0000","last_peered":"2023-10-06T02:27:42.806843+0000","last_clean":"2023-10-06T02:27:42.806843+0000","last_became_active":"2023-10-06T02:27:42.806561+0000","last_became_peered":"2023-10-06T02:27:42.806561+0000","last_unstale":"2023-10-06T02:27:42.806843+0000","last_undegraded":"2023-10-06T02:27:42.806843+0000","last_fullsized":"2023-10-06T02:27:42.806843+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:25.987778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800749+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:17.377369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.810765+0000","last_change":"2023-10-06T02:27:42.810765+0000","last_active":"2023-10-06T02:27:42.810765+0000","last_peered":"2023-10-06T02:27:42.810765+0000","last_clean":"2023-10-06T02:27:42.810765+0000","last_became_active":"2023-10-06T02:27:42.810012+0000","last_became_peered":"2023-10-06T02:27:42.810012+0000","last_unstale":"2023-10-06T02:27:42.810765+0000","last_undegraded":"2023-10-06T02:27:42.810765+0000","last_fullsized":"2023-10-06T02:27:42.810765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:16.962604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":56,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.791844+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:27:41.791844+0000","last_peered":"2023-10-06T02:27:41.791844+0000","last_clean":"2023-10-06T02:27:41.791844+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:27:41.791844+0000","last_undegraded":"2023-10-06T02:27:41.791844+0000","last_fullsized":"2023-10-06T02:27:41.791844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.802069+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:55:50.706021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.806707+0000","last_change":"2023-10-06T02:27:42.806707+0000","last_active":"2023-10-06T02:27:42.806707+0000","last_peered":"2023-10-06T02:27:42.806707+0000","last_clean":"2023-10-06T02:27:42.806707+0000","last_became_active":"2023-10-06T02:27:42.806408+0000","last_became_peered":"2023-10-06T02:27:42.806408+0000","last_unstale":"2023-10-06T02:27:42.806707+0000","last_undegraded":"2023-10-06T02:27:42.806707+0000","last_fullsized":"2023-10-06T02:27:42.806707+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:41.460239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.795556+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:27:41.795556+0000","last_peered":"2023-10-06T02:27:41.795556+0000","last_clean":"2023-10-06T02:27:41.795556+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:27:41.795556+0000","last_undegraded":"2023-10-06T02:27:41.795556+0000","last_fullsized":"2023-10-06T02:27:41.795556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799401+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:46.415629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.809927+0000","last_change":"2023-10-06T02:27:42.809927+0000","last_active":"2023-10-06T02:27:42.809927+0000","last_peered":"2023-10-06T02:27:42.809927+0000","last_clean":"2023-10-06T02:27:42.809927+0000","last_became_active":"2023-10-06T02:27:42.809606+0000","last_became_peered":"2023-10-06T02:27:42.809606+0000","last_unstale":"2023-10-06T02:27:42.809927+0000","last_undegraded":"2023-10-06T02:27:42.809927+0000","last_fullsized":"2023-10-06T02:27:42.809927+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:08.742302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.796821+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:27:41.796821+0000","last_peered":"2023-10-06T02:27:41.796821+0000","last_clean":"2023-10-06T02:27:41.796821+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:27:41.796821+0000","last_undegraded":"2023-10-06T02:27:41.796821+0000","last_fullsized":"2023-10-06T02:27:41.796821+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":201,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.794607+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:27:41.794607+0000","last_peered":"2023-10-06T02:27:41.794607+0000","last_clean":"2023-10-06T02:27:41.794607+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:27:41.794607+0000","last_undegraded":"2023-10-06T02:27:41.794607+0000","last_fullsized":"2023-10-06T02:27:41.794607+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.800805+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:16.944536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.810776+0000","last_change":"2023-10-06T02:27:42.810776+0000","last_active":"2023-10-06T02:27:42.810776+0000","last_peered":"2023-10-06T02:27:42.810776+0000","last_clean":"2023-10-06T02:27:42.810776+0000","last_became_active":"2023-10-06T02:27:42.810461+0000","last_became_peered":"2023-10-06T02:27:42.810461+0000","last_unstale":"2023-10-06T02:27:42.810776+0000","last_undegraded":"2023-10-06T02:27:42.810776+0000","last_fullsized":"2023-10-06T02:27:42.810776+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:00.718591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":51,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.794738+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:27:41.794738+0000","last_peered":"2023-10-06T02:27:41.794738+0000","last_clean":"2023-10-06T02:27:41.794738+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:27:41.794738+0000","last_undegraded":"2023-10-06T02:27:41.794738+0000","last_fullsized":"2023-10-06T02:27:41.794738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.804625+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:50.633626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.810898+0000","last_change":"2023-10-06T02:27:42.810898+0000","last_active":"2023-10-06T02:27:42.810898+0000","last_peered":"2023-10-06T02:27:42.810898+0000","last_clean":"2023-10-06T02:27:42.810898+0000","last_became_active":"2023-10-06T02:27:42.810582+0000","last_became_peered":"2023-10-06T02:27:42.810582+0000","last_unstale":"2023-10-06T02:27:42.810898+0000","last_undegraded":"2023-10-06T02:27:42.810898+0000","last_fullsized":"2023-10-06T02:27:42.810898+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:33.833254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":51,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.794696+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:27:41.794696+0000","last_peered":"2023-10-06T02:27:41.794696+0000","last_clean":"2023-10-06T02:27:41.794696+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:27:41.794696+0000","last_undegraded":"2023-10-06T02:27:41.794696+0000","last_fullsized":"2023-10-06T02:27:41.794696+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799338+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:54.179105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.810030+0000","last_change":"2023-10-06T02:27:42.810030+0000","last_active":"2023-10-06T02:27:42.810030+0000","last_peered":"2023-10-06T02:27:42.810030+0000","last_clean":"2023-10-06T02:27:42.810030+0000","last_became_active":"2023-10-06T02:27:42.809757+0000","last_became_peered":"2023-10-06T02:27:42.809757+0000","last_unstale":"2023-10-06T02:27:42.810030+0000","last_undegraded":"2023-10-06T02:27:42.810030+0000","last_fullsized":"2023-10-06T02:27:42.810030+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:49.628882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":62,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.792604+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:27:41.792604+0000","last_peered":"2023-10-06T02:27:41.792604+0000","last_clean":"2023-10-06T02:27:41.792604+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:27:41.792604+0000","last_undegraded":"2023-10-06T02:27:41.792604+0000","last_fullsized":"2023-10-06T02:27:41.792604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.801580+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:11:28.225535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.806975+0000","last_change":"2023-10-06T02:27:42.806975+0000","last_active":"2023-10-06T02:27:42.806975+0000","last_peered":"2023-10-06T02:27:42.806975+0000","last_clean":"2023-10-06T02:27:42.806975+0000","last_became_active":"2023-10-06T02:27:42.806684+0000","last_became_peered":"2023-10-06T02:27:42.806684+0000","last_unstale":"2023-10-06T02:27:42.806975+0000","last_undegraded":"2023-10-06T02:27:42.806975+0000","last_fullsized":"2023-10-06T02:27:42.806975+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:25.314623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.796714+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:27:41.796714+0000","last_peered":"2023-10-06T02:27:41.796714+0000","last_clean":"2023-10-06T02:27:41.796714+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:27:41.796714+0000","last_undegraded":"2023-10-06T02:27:41.796714+0000","last_fullsized":"2023-10-06T02:27:41.796714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:27:42.788150+0000","last_change":"2023-10-06T02:27:42.799894+0000","last_active":"2023-10-06T02:27:42.788150+0000","last_peered":"2023-10-06T02:27:42.788150+0000","last_clean":"2023-10-06T02:27:42.788150+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:27:42.788150+0000","last_undegraded":"2023-10-06T02:27:42.788150+0000","last_fullsized":"2023-10-06T02:27:42.788150+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:12:09.790709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":8,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-10-06T02:27:42.811306+0000","last_change":"2023-10-06T02:27:42.811306+0000","last_active":"2023-10-06T02:27:42.811306+0000","last_peered":"2023-10-06T02:27:42.811306+0000","last_clean":"2023-10-06T02:27:42.811306+0000","last_became_active":"2023-10-06T02:27:42.811022+0000","last_became_peered":"2023-10-06T02:27:42.811022+0000","last_unstale":"2023-10-06T02:27:42.811306+0000","last_undegraded":"2023-10-06T02:27:42.811306+0000","last_fullsized":"2023-10-06T02:27:42.811306+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:08.022668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":55,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-10-06T02:27:41.796854+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:27:41.796854+0000","last_peered":"2023-10-06T02:27:41.796854+0000","last_clean":"2023-10-06T02:27:41.796854+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:27:41.796854+0000","last_undegraded":"2023-10-06T02:27:41.796854+0000","last_fullsized":"2023-10-06T02:27:41.796854+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298700,"kb_used_data":1412,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073140,"statfs":{"total":96636764160,"available":96330895360,"internally_reserved":0,"allocated":1445888,"data_stored":968744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.311,"15min":0.311},"max":{"1min":0.69899999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.56899999999999995,"15min":0.55000000000000004},"min":{"1min":0.49199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.77400000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56100000000000005}]},{"osd":1,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54800000000000004,"15min":0.52200000000000002},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72299999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55800000000000005,"15min":0.54200000000000004},"min":{"1min":0.41999999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71499999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56799999999999995,"15min":0.55400000000000005},"min":{"1min":0.40999999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73099999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57599999999999996,"15min":0.55600000000000005},"min":{"1min":0.51900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76200000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59299999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72599999999999998,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57799999999999996,"15min":0.56399999999999995},"min":{"1min":0.372,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71699999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.34000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.68700000000000006,"5min":1.014,"15min":1.014},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64000000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.371,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66800000000000004,"5min":0.747,"15min":0.747},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55100000000000005,"15min":0.56399999999999995},"min":{"1min":0.39500000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69799999999999995,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.41399999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57499999999999996,"15min":0.58699999999999997},"min":{"1min":0.41499999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73599999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58399999999999996,"15min":0.59499999999999997},"min":{"1min":0.39300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.748,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.39800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298116,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073724,"statfs":{"total":96636764160,"available":96331493376,"internally_reserved":0,"allocated":847872,"data_stored":377023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64400000000000002,"15min":0.73599999999999999},"min":{"1min":0.41799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.77000000000000002,"5min":5.859,"15min":5.859},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.55800000000000005,"15min":0.54200000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79100000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.53900000000000003,"15min":0.52100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.754,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55200000000000005,"15min":0.53500000000000003},"min":{"1min":0.39000000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80700000000000005,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.499}]},{"osd":2,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77100000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85899999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.47699999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57599999999999996,"15min":0.55200000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83299999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82599999999999996,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.56299999999999994}]},{"osd":4,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67800000000000005,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.435},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.32500000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.73799999999999999,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.36299999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76600000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54800000000000004,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75600000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.58299999999999996},"min":{"1min":0.39200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.626},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298688,"kb_used_data":1400,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073152,"statfs":{"total":96636764160,"available":96330907648,"internally_reserved":0,"allocated":1433600,"data_stored":962128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36599999999999999,"15min":0.379},"min":{"1min":0.25800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.52500000000000002,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.53900000000000003,"15min":0.67300000000000004},"min":{"1min":0.32400000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58299999999999996,"5min":7.6900000000000004,"15min":7.6900000000000004},"last":0.27800000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.497,"15min":0.629},"min":{"1min":0.30099999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.50600000000000001,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.56200000000000006,"15min":0.70199999999999996},"min":{"1min":0.308,"5min":0.251,"15min":0.251},"max":{"1min":0.59499999999999997,"5min":7.758,"15min":7.758},"last":0.35799999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.59199999999999997,"15min":0.72899999999999998},"min":{"1min":0.35799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64700000000000002,"5min":7.7869999999999999,"15min":7.7869999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.42499999999999999},"min":{"1min":0.35499999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.625,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.29399999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.84599999999999997,"15min":1.0700000000000001},"min":{"1min":0.44,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76700000000000002,"5min":11.678000000000001,"15min":11.678000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.76400000000000001,"15min":0.90400000000000003},"min":{"1min":0.50900000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85399999999999998,"5min":7.6529999999999996,"15min":7.6529999999999996},"last":0.443}]},{"osd":5,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.42399999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81799999999999995,"5min":1.399,"15min":1.399},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.80600000000000005,"15min":0.93899999999999995},"min":{"1min":0.495,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84099999999999997,"5min":7.508,"15min":7.508},"last":0.48599999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.78000000000000003,"15min":0.91500000000000004},"min":{"1min":0.47399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83699999999999997,"5min":7.7270000000000003,"15min":7.7270000000000003},"last":0.501},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67300000000000004,"15min":0.68700000000000006},"min":{"1min":0.49399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.873,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.45700000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.497,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.92200000000000004,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.82999999999999996,"15min":0.96099999999999997},"min":{"1min":0.57199999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89200000000000002,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298104,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073736,"statfs":{"total":96636764160,"available":96331505664,"internally_reserved":0,"allocated":835584,"data_stored":370407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.35799999999999998,"15min":0.34699999999999998},"min":{"1min":0.23699999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.53400000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.38,"15min":0.36499999999999999},"min":{"1min":0.29399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51700000000000002,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.307}]},{"osd":2,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.39800000000000002,"15min":0.38900000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57299999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.57199999999999995,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.36799999999999999,"15min":0.35499999999999998},"min":{"1min":0.27500000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.52800000000000002,"5min":0.622,"15min":0.622},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.41199999999999998,"15min":0.39700000000000002},"min":{"1min":0.312,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60899999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95999999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64600000000000002,"15min":0.63900000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94599999999999995,"5min":1.008,"15min":1.008},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81899999999999995,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.621,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93100000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.505}]},{"osd":6,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.47899999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.98899999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.46500000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88700000000000001,"5min":1,"15min":1},"last":0.439}]},{"osd":7,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91600000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.97399999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.56499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":378376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.34799999999999998,"15min":0.33900000000000002},"min":{"1min":0.28899999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38,"15min":0.38200000000000001},"min":{"1min":0.29099999999999998,"5min":0.218,"15min":0.218},"max":{"1min":0.48499999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.29399999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.35999999999999999,"15min":0.34999999999999998},"min":{"1min":0.27200000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.311},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.40500000000000003,"15min":0.40000000000000002},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59199999999999997,"5min":0.621,"15min":0.621},"last":0.375}]},{"osd":3,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42499999999999999,"15min":0.41099999999999998},"min":{"1min":0.35099999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.373,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85199999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88700000000000001,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.58399999999999996,"5min":0.437,"15min":0.437},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.52500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.95399999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.56200000000000006}]},{"osd":6,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.498,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95699999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.52600000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.60999999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.498,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91700000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.503,"5min":0.439,"15min":0.439},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.57399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298116,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073724,"statfs":{"total":96636764160,"available":96331493376,"internally_reserved":0,"allocated":847872,"data_stored":377023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.52900000000000003,"15min":0.69099999999999995},"min":{"1min":0.216,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.61799999999999999,"5min":10.164999999999999,"15min":10.164999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40600000000000003,"15min":0.41099999999999998},"min":{"1min":0.26600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.57899999999999996,"5min":1.266,"15min":1.266},"last":0.318}]},{"osd":1,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42099999999999999,"15min":0.42899999999999999},"min":{"1min":0.27800000000000002,"5min":0.191,"15min":0.191},"max":{"1min":0.58399999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.42999999999999999,"15min":0.432},"min":{"1min":0.311,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66600000000000004,"5min":1.319,"15min":1.319},"last":0.376}]},{"osd":2,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.442,"15min":0.44},"min":{"1min":0.36099999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.627,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.47999999999999998,"15min":0.48899999999999999},"min":{"1min":0.33300000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.68700000000000006,"5min":1.5,"15min":1.5},"last":0.30599999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63700000000000001,"15min":0.63200000000000001},"min":{"1min":0.49299999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88800000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.503},{"interface":"front","average":{"1min":0.629,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.44600000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93100000000000005,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.501,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86299999999999999,"5min":1.538,"15min":1.538},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.64300000000000002},"min":{"1min":0.499,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84299999999999997,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.625,"15min":0.61399999999999999},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.88900000000000001,"5min":1.111,"15min":1.111},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90600000000000003,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.58299999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.47699999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.876,"5min":1.21,"15min":1.21},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.48599999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86199999999999999,"5min":1.135,"15min":1.135},"last":0.49199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":378376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.78800000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54100000000000004,"15min":0.51300000000000001},"min":{"1min":0.42099999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.51500000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.53300000000000003,"15min":0.501},"min":{"1min":0.40600000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.48199999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59099999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.40500000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.75800000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.46600000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77000000000000002,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.497,"15min":0.48999999999999999},"min":{"1min":0.43099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76800000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.443},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.79100000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.47399999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.36399999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75600000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.372,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76700000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.48799999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.34200000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80100000000000005,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.34599999999999997,"5min":0.308,"15min":0.308},"max":{"1min":0.83999999999999997,"5min":1.04,"15min":1.04},"last":0.45700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":378376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.51600000000000001,"15min":0.498},"min":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51300000000000001,"15min":0.49099999999999999},"min":{"1min":0.45600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.52300000000000002,"15min":0.49399999999999999},"min":{"1min":0.42899999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.51300000000000001,"15min":0.498},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.50800000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.58899999999999997,"15min":0.57399999999999995},"min":{"1min":0.46200000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.623}]},{"osd":3,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.53400000000000003,"15min":0.51600000000000001},"min":{"1min":0.40699999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.64600000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.47799999999999998,"15min":0.48899999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.60399999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51100000000000001,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69299999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.56699999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.32200000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.71099999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54700000000000004,"15min":0.56699999999999995},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68999999999999995,"5min":0.873,"15min":0.873},"last":0.41799999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54300000000000004,"15min":0.56299999999999994},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69699999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57299999999999995,"15min":0.60099999999999998},"min":{"1min":0.38,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67600000000000005,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:27:51.944 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:27:52.188 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:27:53.249 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:27:53.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.377+0000 7f35bf6e1700 1 Processor -- start 2023-10-06T02:27:53.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.378+0000 7f35bf6e1700 1 -- start start 2023-10-06T02:27:53.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.378+0000 7f35bf6e1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f35b81595a0 0x7f35b80b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:53.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.378+0000 7f35bf6e1700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b815e180 con 0x7f35b806d890 2023-10-06T02:27:53.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.379+0000 7f35bf6e1700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b806ced0 con 0x7f35b80cc5a0 2023-10-06T02:27:53.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.379+0000 7f35bf6e1700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b80b1000 con 0x7f35b81595a0 2023-10-06T02:27:53.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.379+0000 7f35bd47d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f35b81595a0 0x7f35b80b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:53.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.379+0000 7f35bcc7c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f35b806d890 0x7f35b806c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47792/0 (socket says 172.21.15.37:47792) 2023-10-06T02:27:53.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.379+0000 7f35bcc7c700 1 -- 172.21.15.37:0/1479517516 learned_addr learned my addr 172.21.15.37:0/1479517516 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:53.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.379+0000 7f35bd47d700 1 -- 172.21.15.37:0/1479517516 >> v1:172.21.15.191:6789/0 conn(0x7f35b80cc5a0 legacy=0x7f35b806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:53.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.379+0000 7f35bd47d700 1 -- 172.21.15.37:0/1479517516 >> v1:172.21.15.37:6789/0 conn(0x7f35b806d890 legacy=0x7f35b806c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:53.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.379+0000 7f35affff700 1 -- 172.21.15.37:0/1479517516 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962074739 0 0) 0x7f35b815e180 con 0x7f35b806d890 2023-10-06T02:27:53.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.379+0000 7f35bd47d700 1 -- 172.21.15.37:0/1479517516 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b815d570 con 0x7f35b81595a0 2023-10-06T02:27:53.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.379+0000 7f35bd47d700 1 --2- 172.21.15.37:0/1479517516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b81595a0 0x7f35b80b0ac0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f35b40098e0 tx=0x7f35b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f21004f42d8876 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:53.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.379+0000 7f35affff700 1 -- 172.21.15.37:0/1479517516 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4009e80 con 0x7f35b81595a0 2023-10-06T02:27:53.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.379+0000 7f35affff700 1 -- 172.21.15.37:0/1479517516 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b400b860 con 0x7f35b81595a0 2023-10-06T02:27:53.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.379+0000 7f35affff700 1 -- 172.21.15.37:0/1479517516 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b400bbe0 con 0x7f35b81595a0 2023-10-06T02:27:53.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.380+0000 7f35bf6e1700 1 -- 172.21.15.37:0/1479517516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b81595a0 msgr2=0x7f35b80b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.380+0000 7f35bf6e1700 1 --2- 172.21.15.37:0/1479517516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b81595a0 0x7f35b80b0ac0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f35b40098e0 tx=0x7f35b40091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.380+0000 7f35bf6e1700 1 -- 172.21.15.37:0/1479517516 shutdown_connections 2023-10-06T02:27:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.380+0000 7f35bf6e1700 1 --2- 172.21.15.37:0/1479517516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b81595a0 0x7f35b80b0ac0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.380+0000 7f35bf6e1700 1 -- 172.21.15.37:0/1479517516 >> 172.21.15.37:0/1479517516 conn(0x7f35b80d04d0 msgr2=0x7f35b80d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.380+0000 7f35bf6e1700 1 -- 172.21.15.37:0/1479517516 shutdown_connections 2023-10-06T02:27:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.380+0000 7f35bf6e1700 1 -- 172.21.15.37:0/1479517516 wait complete. 2023-10-06T02:27:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.381+0000 7f35bf6e1700 1 Processor -- start 2023-10-06T02:27:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.381+0000 7f35bf6e1700 1 -- start start 2023-10-06T02:27:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.382+0000 7f35bf6e1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35b806d890 0x7f35b8155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.382+0000 7f35bf6e1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35b80cc5a0 0x7f35b80c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.382+0000 7f35bf6e1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b81595a0 0x7f35b815a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.382+0000 7f35bf6e1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b80c83a0 con 0x7f35b81595a0 2023-10-06T02:27:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.382+0000 7f35bf6e1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b80c7de0 con 0x7f35b806d890 2023-10-06T02:27:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.382+0000 7f35bf6e1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b80c80c0 con 0x7f35b80cc5a0 2023-10-06T02:27:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.382+0000 7f35bdc7e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b81595a0 0x7f35b815a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.382+0000 7f35bdc7e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b81595a0 0x7f35b815a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53110/0 (socket says 172.21.15.37:53110) 2023-10-06T02:27:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.382+0000 7f35bdc7e700 1 -- 172.21.15.37:0/3848077499 learned_addr learned my addr 172.21.15.37:0/3848077499 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.382+0000 7f35bd47d700 1 --2- 172.21.15.37:0/3848077499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35b806d890 0x7f35b8155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.382+0000 7f35bcc7c700 1 --2- 172.21.15.37:0/3848077499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35b80cc5a0 0x7f35b80c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.383+0000 7f35bdc7e700 1 -- 172.21.15.37:0/3848077499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35b80cc5a0 msgr2=0x7f35b80c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.383+0000 7f35bdc7e700 1 --2- 172.21.15.37:0/3848077499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35b80cc5a0 0x7f35b80c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.383+0000 7f35bdc7e700 1 -- 172.21.15.37:0/3848077499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35b806d890 msgr2=0x7f35b8155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.383+0000 7f35bdc7e700 1 --2- 172.21.15.37:0/3848077499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35b806d890 0x7f35b8155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.383+0000 7f35bdc7e700 1 -- 172.21.15.37:0/3848077499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b4009420 con 0x7f35b81595a0 2023-10-06T02:27:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.383+0000 7f35bdc7e700 1 --2- 172.21.15.37:0/3848077499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b81595a0 0x7f35b815a2c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f35b000c8e0 tx=0x7f35b0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.383+0000 7f35ad7fa700 1 -- 172.21.15.37:0/3848077499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b000ce80 con 0x7f35b81595a0 2023-10-06T02:27:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.383+0000 7f35ad7fa700 1 -- 172.21.15.37:0/3848077499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b000a7e0 con 0x7f35b81595a0 2023-10-06T02:27:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.383+0000 7f35bf6e1700 1 -- 172.21.15.37:0/3848077499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b80c86b0 con 0x7f35b81595a0 2023-10-06T02:27:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.383+0000 7f35ad7fa700 1 -- 172.21.15.37:0/3848077499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b000ab80 con 0x7f35b81595a0 2023-10-06T02:27:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.383+0000 7f35bf6e1700 1 -- 172.21.15.37:0/3848077499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b81563d0 con 0x7f35b81595a0 2023-10-06T02:27:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.384+0000 7f35bf6e1700 1 -- 172.21.15.37:0/3848077499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b8088b20 con 0x7f35b81595a0 2023-10-06T02:27:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.384+0000 7f35ad7fa700 1 -- 172.21.15.37:0/3848077499 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f35b0012420 con 0x7f35b81595a0 2023-10-06T02:27:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.385+0000 7f35ad7fa700 1 --2- 172.21.15.37:0/3848077499 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f359c066f30 0x7f359c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.385+0000 7f35ad7fa700 1 -- 172.21.15.37:0/3848077499 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f35b0084940 con 0x7f35b81595a0 2023-10-06T02:27:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.385+0000 7f35bd47d700 1 --2- 172.21.15.37:0/3848077499 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f359c066f30 0x7f359c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.385+0000 7f35bd47d700 1 --2- 172.21.15.37:0/3848077499 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f359c066f30 0x7f359c0693e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f35b40093f0 tx=0x7f35b4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:53.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.389+0000 7f35ad7fa700 1 -- 172.21.15.37:0/3848077499 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35b0051a50 con 0x7f35b81595a0 2023-10-06T02:27:53.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.580+0000 7f35bf6e1700 1 -- 172.21.15.37:0/3848077499 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35b815d850 con 0x7f359c066f30 2023-10-06T02:27:53.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.589+0000 7f35ad7fa700 1 -- 172.21.15.37:0/3848077499 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311948 (secure 0 0 0) 0x7f35b815d850 con 0x7f359c066f30 2023-10-06T02:27:53.598 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:53.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.593+0000 7f35bf6e1700 1 -- 172.21.15.37:0/3848077499 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f359c066f30 msgr2=0x7f359c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:53.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.593+0000 7f35bf6e1700 1 --2- 172.21.15.37:0/3848077499 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f359c066f30 0x7f359c0693e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f35b40093f0 tx=0x7f35b4017000 comp rx=0 tx=0).stop 2023-10-06T02:27:53.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.593+0000 7f35bf6e1700 1 -- 172.21.15.37:0/3848077499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b81595a0 msgr2=0x7f35b815a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.593+0000 7f35bf6e1700 1 --2- 172.21.15.37:0/3848077499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b81595a0 0x7f35b815a2c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f35b000c8e0 tx=0x7f35b0001710 comp rx=0 tx=0).stop 2023-10-06T02:27:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.593+0000 7f35bf6e1700 1 -- 172.21.15.37:0/3848077499 shutdown_connections 2023-10-06T02:27:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.593+0000 7f35bf6e1700 1 --2- 172.21.15.37:0/3848077499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b81595a0 0x7f35b815a2c0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.593+0000 7f35bf6e1700 1 --2- 172.21.15.37:0/3848077499 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f359c066f30 0x7f359c0693e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.593+0000 7f35bf6e1700 1 --2- 172.21.15.37:0/3848077499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35b806d890 0x7f35b8155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.593+0000 7f35bf6e1700 1 --2- 172.21.15.37:0/3848077499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35b80cc5a0 0x7f35b80c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.593+0000 7f35bf6e1700 1 -- 172.21.15.37:0/3848077499 >> 172.21.15.37:0/3848077499 conn(0x7f35b80d04d0 msgr2=0x7f35b81589e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.593+0000 7f35bf6e1700 1 -- 172.21.15.37:0/3848077499 shutdown_connections 2023-10-06T02:27:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.593+0000 7f35bf6e1700 1 -- 172.21.15.37:0/3848077499 wait complete. 2023-10-06T02:27:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:27:53.606 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2023-10-06T02:27:52.577182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2386364,"kb_used_data":8060,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752588356,"statfs":{"total":773094113280,"available":770650476544,"internally_reserved":0,"allocated":8253440,"data_stored":4318353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.778212"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.822325+0000","last_change":"2023-10-06T02:27:43.815576+0000","last_active":"2023-10-06T02:27:43.822325+0000","last_peered":"2023-10-06T02:27:43.822325+0000","last_clean":"2023-10-06T02:27:43.822325+0000","last_became_active":"2023-10-06T02:27:43.815305+0000","last_became_peered":"2023-10-06T02:27:43.815305+0000","last_unstale":"2023-10-06T02:27:43.822325+0000","last_undegraded":"2023-10-06T02:27:43.822325+0000","last_fullsized":"2023-10-06T02:27:43.822325+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:53.278263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.833240+0000","last_change":"2023-10-06T02:27:43.826508+0000","last_active":"2023-10-06T02:27:43.833240+0000","last_peered":"2023-10-06T02:27:43.833240+0000","last_clean":"2023-10-06T02:27:43.833240+0000","last_became_active":"2023-10-06T02:27:43.823676+0000","last_became_peered":"2023-10-06T02:27:43.823676+0000","last_unstale":"2023-10-06T02:27:43.833240+0000","last_undegraded":"2023-10-06T02:27:43.833240+0000","last_fullsized":"2023-10-06T02:27:43.833240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:40.328607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.828631+0000","last_change":"2023-10-06T02:27:43.825370+0000","last_active":"2023-10-06T02:27:43.828631+0000","last_peered":"2023-10-06T02:27:43.828631+0000","last_clean":"2023-10-06T02:27:43.828631+0000","last_became_active":"2023-10-06T02:27:43.825037+0000","last_became_peered":"2023-10-06T02:27:43.825037+0000","last_unstale":"2023-10-06T02:27:43.828631+0000","last_undegraded":"2023-10-06T02:27:43.828631+0000","last_fullsized":"2023-10-06T02:27:43.828631+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:15.684258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.817724+0000","last_change":"2023-10-06T02:27:43.814080+0000","last_active":"2023-10-06T02:27:43.817724+0000","last_peered":"2023-10-06T02:27:43.817724+0000","last_clean":"2023-10-06T02:27:43.817724+0000","last_became_active":"2023-10-06T02:27:43.813732+0000","last_became_peered":"2023-10-06T02:27:43.813732+0000","last_unstale":"2023-10-06T02:27:43.817724+0000","last_undegraded":"2023-10-06T02:27:43.817724+0000","last_fullsized":"2023-10-06T02:27:43.817724+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:50.633626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.818315+0000","last_change":"2023-10-06T02:27:43.816422+0000","last_active":"2023-10-06T02:27:43.818315+0000","last_peered":"2023-10-06T02:27:43.818315+0000","last_clean":"2023-10-06T02:27:43.818315+0000","last_became_active":"2023-10-06T02:27:43.816138+0000","last_became_peered":"2023-10-06T02:27:43.816138+0000","last_unstale":"2023-10-06T02:27:43.818315+0000","last_undegraded":"2023-10-06T02:27:43.818315+0000","last_fullsized":"2023-10-06T02:27:43.818315+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:43:45.448997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.825528+0000","last_change":"2023-10-06T02:27:43.820724+0000","last_active":"2023-10-06T02:27:43.825528+0000","last_peered":"2023-10-06T02:27:43.825528+0000","last_clean":"2023-10-06T02:27:43.825528+0000","last_became_active":"2023-10-06T02:27:43.819791+0000","last_became_peered":"2023-10-06T02:27:43.819791+0000","last_unstale":"2023-10-06T02:27:43.825528+0000","last_undegraded":"2023-10-06T02:27:43.825528+0000","last_fullsized":"2023-10-06T02:27:43.825528+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:45.837674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.822801+0000","last_change":"2023-10-06T02:27:43.818776+0000","last_active":"2023-10-06T02:27:43.822801+0000","last_peered":"2023-10-06T02:27:43.822801+0000","last_clean":"2023-10-06T02:27:43.822801+0000","last_became_active":"2023-10-06T02:27:43.818479+0000","last_became_peered":"2023-10-06T02:27:43.818479+0000","last_unstale":"2023-10-06T02:27:43.822801+0000","last_undegraded":"2023-10-06T02:27:43.822801+0000","last_fullsized":"2023-10-06T02:27:43.822801+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:26.286335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.832813+0000","last_change":"2023-10-06T02:27:43.820710+0000","last_active":"2023-10-06T02:27:43.832813+0000","last_peered":"2023-10-06T02:27:43.832813+0000","last_clean":"2023-10-06T02:27:43.832813+0000","last_became_active":"2023-10-06T02:27:43.818252+0000","last_became_peered":"2023-10-06T02:27:43.818252+0000","last_unstale":"2023-10-06T02:27:43.832813+0000","last_undegraded":"2023-10-06T02:27:43.832813+0000","last_fullsized":"2023-10-06T02:27:43.832813+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:29.072500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.814422+0000","last_change":"2023-10-06T02:27:43.809557+0000","last_active":"2023-10-06T02:27:43.814422+0000","last_peered":"2023-10-06T02:27:43.814422+0000","last_clean":"2023-10-06T02:27:43.814422+0000","last_became_active":"2023-10-06T02:27:43.809268+0000","last_became_peered":"2023-10-06T02:27:43.809268+0000","last_unstale":"2023-10-06T02:27:43.814422+0000","last_undegraded":"2023-10-06T02:27:43.814422+0000","last_fullsized":"2023-10-06T02:27:43.814422+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:32:46.415629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.823692+0000","last_change":"2023-10-06T02:27:43.817082+0000","last_active":"2023-10-06T02:27:43.823692+0000","last_peered":"2023-10-06T02:27:43.823692+0000","last_clean":"2023-10-06T02:27:43.823692+0000","last_became_active":"2023-10-06T02:27:43.816717+0000","last_became_peered":"2023-10-06T02:27:43.816717+0000","last_unstale":"2023-10-06T02:27:43.823692+0000","last_undegraded":"2023-10-06T02:27:43.823692+0000","last_fullsized":"2023-10-06T02:27:43.823692+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:20.572015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.833292+0000","last_change":"2023-10-06T02:27:43.823201+0000","last_active":"2023-10-06T02:27:43.833292+0000","last_peered":"2023-10-06T02:27:43.833292+0000","last_clean":"2023-10-06T02:27:43.833292+0000","last_became_active":"2023-10-06T02:27:43.822795+0000","last_became_peered":"2023-10-06T02:27:43.822795+0000","last_unstale":"2023-10-06T02:27:43.833292+0000","last_undegraded":"2023-10-06T02:27:43.833292+0000","last_fullsized":"2023-10-06T02:27:43.833292+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:40.713268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.827200+0000","last_change":"2023-10-06T02:27:43.824336+0000","last_active":"2023-10-06T02:27:43.827200+0000","last_peered":"2023-10-06T02:27:43.827200+0000","last_clean":"2023-10-06T02:27:43.827200+0000","last_became_active":"2023-10-06T02:27:43.823482+0000","last_became_peered":"2023-10-06T02:27:43.823482+0000","last_unstale":"2023-10-06T02:27:43.827200+0000","last_undegraded":"2023-10-06T02:27:43.827200+0000","last_fullsized":"2023-10-06T02:27:43.827200+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:53.278263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.832744+0000","last_change":"2023-10-06T02:27:43.815774+0000","last_active":"2023-10-06T02:27:43.832744+0000","last_peered":"2023-10-06T02:27:43.832744+0000","last_clean":"2023-10-06T02:27:43.832744+0000","last_became_active":"2023-10-06T02:27:43.815467+0000","last_became_peered":"2023-10-06T02:27:43.815467+0000","last_unstale":"2023-10-06T02:27:43.832744+0000","last_undegraded":"2023-10-06T02:27:43.832744+0000","last_fullsized":"2023-10-06T02:27:43.832744+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:12.007723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.825546+0000","last_change":"2023-10-06T02:27:43.820894+0000","last_active":"2023-10-06T02:27:43.825546+0000","last_peered":"2023-10-06T02:27:43.825546+0000","last_clean":"2023-10-06T02:27:43.825546+0000","last_became_active":"2023-10-06T02:27:43.820181+0000","last_became_peered":"2023-10-06T02:27:43.820181+0000","last_unstale":"2023-10-06T02:27:43.825546+0000","last_undegraded":"2023-10-06T02:27:43.825546+0000","last_fullsized":"2023-10-06T02:27:43.825546+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:16.571721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.820041+0000","last_change":"2023-10-06T02:27:43.816926+0000","last_active":"2023-10-06T02:27:43.820041+0000","last_peered":"2023-10-06T02:27:43.820041+0000","last_clean":"2023-10-06T02:27:43.820041+0000","last_became_active":"2023-10-06T02:27:43.816403+0000","last_became_peered":"2023-10-06T02:27:43.816403+0000","last_unstale":"2023-10-06T02:27:43.820041+0000","last_undegraded":"2023-10-06T02:27:43.820041+0000","last_fullsized":"2023-10-06T02:27:43.820041+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:03.886385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.824626+0000","last_change":"2023-10-06T02:27:43.816625+0000","last_active":"2023-10-06T02:27:43.824626+0000","last_peered":"2023-10-06T02:27:43.824626+0000","last_clean":"2023-10-06T02:27:43.824626+0000","last_became_active":"2023-10-06T02:27:43.815054+0000","last_became_peered":"2023-10-06T02:27:43.815054+0000","last_unstale":"2023-10-06T02:27:43.824626+0000","last_undegraded":"2023-10-06T02:27:43.824626+0000","last_fullsized":"2023-10-06T02:27:43.824626+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:01.723335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.832628+0000","last_change":"2023-10-06T02:27:43.817919+0000","last_active":"2023-10-06T02:27:43.832628+0000","last_peered":"2023-10-06T02:27:43.832628+0000","last_clean":"2023-10-06T02:27:43.832628+0000","last_became_active":"2023-10-06T02:27:43.817358+0000","last_became_peered":"2023-10-06T02:27:43.817358+0000","last_unstale":"2023-10-06T02:27:43.832628+0000","last_undegraded":"2023-10-06T02:27:43.832628+0000","last_fullsized":"2023-10-06T02:27:43.832628+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:17.274203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.833348+0000","last_change":"2023-10-06T02:27:43.825767+0000","last_active":"2023-10-06T02:27:43.833348+0000","last_peered":"2023-10-06T02:27:43.833348+0000","last_clean":"2023-10-06T02:27:43.833348+0000","last_became_active":"2023-10-06T02:27:43.825467+0000","last_became_peered":"2023-10-06T02:27:43.825467+0000","last_unstale":"2023-10-06T02:27:43.833348+0000","last_undegraded":"2023-10-06T02:27:43.833348+0000","last_fullsized":"2023-10-06T02:27:43.833348+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:37:46.334285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.822657+0000","last_change":"2023-10-06T02:27:43.817832+0000","last_active":"2023-10-06T02:27:43.822657+0000","last_peered":"2023-10-06T02:27:43.822657+0000","last_clean":"2023-10-06T02:27:43.822657+0000","last_became_active":"2023-10-06T02:27:43.817543+0000","last_became_peered":"2023-10-06T02:27:43.817543+0000","last_unstale":"2023-10-06T02:27:43.822657+0000","last_undegraded":"2023-10-06T02:27:43.822657+0000","last_fullsized":"2023-10-06T02:27:43.822657+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:40.713268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.832893+0000","last_change":"2023-10-06T02:27:43.821033+0000","last_active":"2023-10-06T02:27:43.832893+0000","last_peered":"2023-10-06T02:27:43.832893+0000","last_clean":"2023-10-06T02:27:43.832893+0000","last_became_active":"2023-10-06T02:27:43.820739+0000","last_became_peered":"2023-10-06T02:27:43.820739+0000","last_unstale":"2023-10-06T02:27:43.832893+0000","last_undegraded":"2023-10-06T02:27:43.832893+0000","last_fullsized":"2023-10-06T02:27:43.832893+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:53.028263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.824125+0000","last_change":"2023-10-06T02:27:43.820187+0000","last_active":"2023-10-06T02:27:43.824125+0000","last_peered":"2023-10-06T02:27:43.824125+0000","last_clean":"2023-10-06T02:27:43.824125+0000","last_became_active":"2023-10-06T02:27:43.819873+0000","last_became_peered":"2023-10-06T02:27:43.819873+0000","last_unstale":"2023-10-06T02:27:43.824125+0000","last_undegraded":"2023-10-06T02:27:43.824125+0000","last_fullsized":"2023-10-06T02:27:43.824125+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:30.175081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.818257+0000","last_change":"2023-10-06T02:27:43.815589+0000","last_active":"2023-10-06T02:27:43.818257+0000","last_peered":"2023-10-06T02:27:43.818257+0000","last_clean":"2023-10-06T02:27:43.818257+0000","last_became_active":"2023-10-06T02:27:43.815215+0000","last_became_peered":"2023-10-06T02:27:43.815215+0000","last_unstale":"2023-10-06T02:27:43.818257+0000","last_undegraded":"2023-10-06T02:27:43.818257+0000","last_fullsized":"2023-10-06T02:27:43.818257+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:39:21.331009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.821380+0000","last_change":"2023-10-06T02:27:43.811835+0000","last_active":"2023-10-06T02:27:43.821380+0000","last_peered":"2023-10-06T02:27:43.821380+0000","last_clean":"2023-10-06T02:27:43.821380+0000","last_became_active":"2023-10-06T02:27:43.811613+0000","last_became_peered":"2023-10-06T02:27:43.811613+0000","last_unstale":"2023-10-06T02:27:43.821380+0000","last_undegraded":"2023-10-06T02:27:43.821380+0000","last_fullsized":"2023-10-06T02:27:43.821380+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:32.618635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.833670+0000","last_change":"2023-10-06T02:27:43.828585+0000","last_active":"2023-10-06T02:27:43.833670+0000","last_peered":"2023-10-06T02:27:43.833670+0000","last_clean":"2023-10-06T02:27:43.833670+0000","last_became_active":"2023-10-06T02:27:43.828327+0000","last_became_peered":"2023-10-06T02:27:43.828327+0000","last_unstale":"2023-10-06T02:27:43.833670+0000","last_undegraded":"2023-10-06T02:27:43.833670+0000","last_fullsized":"2023-10-06T02:27:43.833670+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:17.054182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.833061+0000","last_change":"2023-10-06T02:27:43.823488+0000","last_active":"2023-10-06T02:27:43.833061+0000","last_peered":"2023-10-06T02:27:43.833061+0000","last_clean":"2023-10-06T02:27:43.833061+0000","last_became_active":"2023-10-06T02:27:43.823190+0000","last_became_peered":"2023-10-06T02:27:43.823190+0000","last_unstale":"2023-10-06T02:27:43.833061+0000","last_undegraded":"2023-10-06T02:27:43.833061+0000","last_fullsized":"2023-10-06T02:27:43.833061+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:53.278263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.825108+0000","last_change":"2023-10-06T02:27:43.823795+0000","last_active":"2023-10-06T02:27:43.825108+0000","last_peered":"2023-10-06T02:27:43.825108+0000","last_clean":"2023-10-06T02:27:43.825108+0000","last_became_active":"2023-10-06T02:27:43.823497+0000","last_became_peered":"2023-10-06T02:27:43.823497+0000","last_unstale":"2023-10-06T02:27:43.825108+0000","last_undegraded":"2023-10-06T02:27:43.825108+0000","last_fullsized":"2023-10-06T02:27:43.825108+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:34.837998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.822413+0000","last_change":"2023-10-06T02:27:43.815395+0000","last_active":"2023-10-06T02:27:43.822413+0000","last_peered":"2023-10-06T02:27:43.822413+0000","last_clean":"2023-10-06T02:27:43.822413+0000","last_became_active":"2023-10-06T02:27:43.815086+0000","last_became_peered":"2023-10-06T02:27:43.815086+0000","last_unstale":"2023-10-06T02:27:43.822413+0000","last_undegraded":"2023-10-06T02:27:43.822413+0000","last_fullsized":"2023-10-06T02:27:43.822413+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:06.773408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.818287+0000","last_change":"2023-10-06T02:27:43.815804+0000","last_active":"2023-10-06T02:27:43.818287+0000","last_peered":"2023-10-06T02:27:43.818287+0000","last_clean":"2023-10-06T02:27:43.818287+0000","last_became_active":"2023-10-06T02:27:43.815489+0000","last_became_peered":"2023-10-06T02:27:43.815489+0000","last_unstale":"2023-10-06T02:27:43.818287+0000","last_undegraded":"2023-10-06T02:27:43.818287+0000","last_fullsized":"2023-10-06T02:27:43.818287+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:13.438178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.833155+0000","last_change":"2023-10-06T02:27:43.823361+0000","last_active":"2023-10-06T02:27:43.833155+0000","last_peered":"2023-10-06T02:27:43.833155+0000","last_clean":"2023-10-06T02:27:43.833155+0000","last_became_active":"2023-10-06T02:27:43.822803+0000","last_became_peered":"2023-10-06T02:27:43.822803+0000","last_unstale":"2023-10-06T02:27:43.833155+0000","last_undegraded":"2023-10-06T02:27:43.833155+0000","last_fullsized":"2023-10-06T02:27:43.833155+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:43.460766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.824743+0000","last_change":"2023-10-06T02:27:43.820622+0000","last_active":"2023-10-06T02:27:43.824743+0000","last_peered":"2023-10-06T02:27:43.824743+0000","last_clean":"2023-10-06T02:27:43.824743+0000","last_became_active":"2023-10-06T02:27:43.820324+0000","last_became_peered":"2023-10-06T02:27:43.820324+0000","last_unstale":"2023-10-06T02:27:43.824743+0000","last_undegraded":"2023-10-06T02:27:43.824743+0000","last_fullsized":"2023-10-06T02:27:43.824743+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:48:03.838565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.824487+0000","last_change":"2023-10-06T02:27:43.816457+0000","last_active":"2023-10-06T02:27:43.824487+0000","last_peered":"2023-10-06T02:27:43.824487+0000","last_clean":"2023-10-06T02:27:43.824487+0000","last_became_active":"2023-10-06T02:27:43.816173+0000","last_became_peered":"2023-10-06T02:27:43.816173+0000","last_unstale":"2023-10-06T02:27:43.824487+0000","last_undegraded":"2023-10-06T02:27:43.824487+0000","last_fullsized":"2023-10-06T02:27:43.824487+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:11.571663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.824646+0000","last_change":"2023-10-06T02:27:43.816986+0000","last_active":"2023-10-06T02:27:43.824646+0000","last_peered":"2023-10-06T02:27:43.824646+0000","last_clean":"2023-10-06T02:27:43.824646+0000","last_became_active":"2023-10-06T02:27:43.816718+0000","last_became_peered":"2023-10-06T02:27:43.816718+0000","last_unstale":"2023-10-06T02:27:43.824646+0000","last_undegraded":"2023-10-06T02:27:43.824646+0000","last_fullsized":"2023-10-06T02:27:43.824646+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:20.572015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.828296+0000","last_change":"2023-10-06T02:27:43.823128+0000","last_active":"2023-10-06T02:27:43.828296+0000","last_peered":"2023-10-06T02:27:43.828296+0000","last_clean":"2023-10-06T02:27:43.828296+0000","last_became_active":"2023-10-06T02:27:43.822856+0000","last_became_peered":"2023-10-06T02:27:43.822856+0000","last_unstale":"2023-10-06T02:27:43.828296+0000","last_undegraded":"2023-10-06T02:27:43.828296+0000","last_fullsized":"2023-10-06T02:27:43.828296+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:20:46.057716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"71'4","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.825760+0000","last_change":"2023-10-06T02:27:42.813044+0000","last_active":"2023-10-06T02:27:43.825760+0000","last_peered":"2023-10-06T02:27:43.825760+0000","last_clean":"2023-10-06T02:27:43.825760+0000","last_became_active":"2023-10-06T02:27:42.812776+0000","last_became_peered":"2023-10-06T02:27:42.812776+0000","last_unstale":"2023-10-06T02:27:43.825760+0000","last_undegraded":"2023-10-06T02:27:43.825760+0000","last_fullsized":"2023-10-06T02:27:43.825760+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:47.491511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.823465+0000","last_change":"2023-10-06T02:27:43.819254+0000","last_active":"2023-10-06T02:27:43.823465+0000","last_peered":"2023-10-06T02:27:43.823465+0000","last_clean":"2023-10-06T02:27:43.823465+0000","last_became_active":"2023-10-06T02:27:43.818923+0000","last_became_peered":"2023-10-06T02:27:43.818923+0000","last_unstale":"2023-10-06T02:27:43.823465+0000","last_undegraded":"2023-10-06T02:27:43.823465+0000","last_fullsized":"2023-10-06T02:27:43.823465+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:45.837674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.814987+0000","last_change":"2023-10-06T02:27:42.812884+0000","last_active":"2023-10-06T02:27:43.814987+0000","last_peered":"2023-10-06T02:27:43.814987+0000","last_clean":"2023-10-06T02:27:43.814987+0000","last_became_active":"2023-10-06T02:27:42.812665+0000","last_became_peered":"2023-10-06T02:27:42.812665+0000","last_unstale":"2023-10-06T02:27:43.814987+0000","last_undegraded":"2023-10-06T02:27:43.814987+0000","last_fullsized":"2023-10-06T02:27:43.814987+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:29.170337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.824046+0000","last_change":"2023-10-06T02:27:43.818518+0000","last_active":"2023-10-06T02:27:43.824046+0000","last_peered":"2023-10-06T02:27:43.824046+0000","last_clean":"2023-10-06T02:27:43.824046+0000","last_became_active":"2023-10-06T02:27:43.818185+0000","last_became_peered":"2023-10-06T02:27:43.818185+0000","last_unstale":"2023-10-06T02:27:43.824046+0000","last_undegraded":"2023-10-06T02:27:43.824046+0000","last_fullsized":"2023-10-06T02:27:43.824046+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:33.606927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.820940+0000","last_change":"2023-10-06T02:27:42.815975+0000","last_active":"2023-10-06T02:27:43.820940+0000","last_peered":"2023-10-06T02:27:43.820940+0000","last_clean":"2023-10-06T02:27:43.820940+0000","last_became_active":"2023-10-06T02:27:42.815717+0000","last_became_peered":"2023-10-06T02:27:42.815717+0000","last_unstale":"2023-10-06T02:27:43.820940+0000","last_undegraded":"2023-10-06T02:27:43.820940+0000","last_fullsized":"2023-10-06T02:27:43.820940+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:43.563364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.827283+0000","last_change":"2023-10-06T02:27:43.823035+0000","last_active":"2023-10-06T02:27:43.827283+0000","last_peered":"2023-10-06T02:27:43.827283+0000","last_clean":"2023-10-06T02:27:43.827283+0000","last_became_active":"2023-10-06T02:27:43.822721+0000","last_became_peered":"2023-10-06T02:27:43.822721+0000","last_unstale":"2023-10-06T02:27:43.827283+0000","last_undegraded":"2023-10-06T02:27:43.827283+0000","last_fullsized":"2023-10-06T02:27:43.827283+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:29.184749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.823248+0000","last_change":"2023-10-06T02:27:42.814055+0000","last_active":"2023-10-06T02:27:43.823248+0000","last_peered":"2023-10-06T02:27:43.823248+0000","last_clean":"2023-10-06T02:27:43.823248+0000","last_became_active":"2023-10-06T02:27:42.813793+0000","last_became_peered":"2023-10-06T02:27:42.813793+0000","last_unstale":"2023-10-06T02:27:43.823248+0000","last_undegraded":"2023-10-06T02:27:43.823248+0000","last_fullsized":"2023-10-06T02:27:43.823248+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:30.927523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.831696+0000","last_change":"2023-10-06T02:27:43.823094+0000","last_active":"2023-10-06T02:27:43.831696+0000","last_peered":"2023-10-06T02:27:43.831696+0000","last_clean":"2023-10-06T02:27:43.831696+0000","last_became_active":"2023-10-06T02:27:43.822767+0000","last_became_peered":"2023-10-06T02:27:43.822767+0000","last_unstale":"2023-10-06T02:27:43.831696+0000","last_undegraded":"2023-10-06T02:27:43.831696+0000","last_fullsized":"2023-10-06T02:27:43.831696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:36.782492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.815166+0000","last_change":"2023-10-06T02:27:42.811221+0000","last_active":"2023-10-06T02:27:43.815166+0000","last_peered":"2023-10-06T02:27:43.815166+0000","last_clean":"2023-10-06T02:27:43.815166+0000","last_became_active":"2023-10-06T02:27:42.810661+0000","last_became_peered":"2023-10-06T02:27:42.810661+0000","last_unstale":"2023-10-06T02:27:43.815166+0000","last_undegraded":"2023-10-06T02:27:43.815166+0000","last_fullsized":"2023-10-06T02:27:43.815166+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:25.281591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.833458+0000","last_change":"2023-10-06T02:27:43.827216+0000","last_active":"2023-10-06T02:27:43.833458+0000","last_peered":"2023-10-06T02:27:43.833458+0000","last_clean":"2023-10-06T02:27:43.833458+0000","last_became_active":"2023-10-06T02:27:43.826840+0000","last_became_peered":"2023-10-06T02:27:43.826840+0000","last_unstale":"2023-10-06T02:27:43.833458+0000","last_undegraded":"2023-10-06T02:27:43.833458+0000","last_fullsized":"2023-10-06T02:27:43.833458+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:49.107220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.823461+0000","last_change":"2023-10-06T02:27:42.811978+0000","last_active":"2023-10-06T02:27:43.823461+0000","last_peered":"2023-10-06T02:27:43.823461+0000","last_clean":"2023-10-06T02:27:43.823461+0000","last_became_active":"2023-10-06T02:27:42.811662+0000","last_became_peered":"2023-10-06T02:27:42.811662+0000","last_unstale":"2023-10-06T02:27:43.823461+0000","last_undegraded":"2023-10-06T02:27:43.823461+0000","last_fullsized":"2023-10-06T02:27:43.823461+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:31.613891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.824229+0000","last_change":"2023-10-06T02:27:43.818387+0000","last_active":"2023-10-06T02:27:43.824229+0000","last_peered":"2023-10-06T02:27:43.824229+0000","last_clean":"2023-10-06T02:27:43.824229+0000","last_became_active":"2023-10-06T02:27:43.818095+0000","last_became_peered":"2023-10-06T02:27:43.818095+0000","last_unstale":"2023-10-06T02:27:43.824229+0000","last_undegraded":"2023-10-06T02:27:43.824229+0000","last_fullsized":"2023-10-06T02:27:43.824229+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:44.568108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.811207+0000","last_change":"2023-10-06T02:27:42.813508+0000","last_active":"2023-10-06T02:27:43.811207+0000","last_peered":"2023-10-06T02:27:43.811207+0000","last_clean":"2023-10-06T02:27:43.811207+0000","last_became_active":"2023-10-06T02:27:42.813249+0000","last_became_peered":"2023-10-06T02:27:42.813249+0000","last_unstale":"2023-10-06T02:27:43.811207+0000","last_undegraded":"2023-10-06T02:27:43.811207+0000","last_fullsized":"2023-10-06T02:27:43.811207+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:29.170337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.822609+0000","last_change":"2023-10-06T02:27:43.820060+0000","last_active":"2023-10-06T02:27:43.822609+0000","last_peered":"2023-10-06T02:27:43.822609+0000","last_clean":"2023-10-06T02:27:43.822609+0000","last_became_active":"2023-10-06T02:27:43.819763+0000","last_became_peered":"2023-10-06T02:27:43.819763+0000","last_unstale":"2023-10-06T02:27:43.822609+0000","last_undegraded":"2023-10-06T02:27:43.822609+0000","last_fullsized":"2023-10-06T02:27:43.822609+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:56.326934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.800016+0000","last_change":"2023-10-06T02:27:42.811677+0000","last_active":"2023-10-06T02:27:43.800016+0000","last_peered":"2023-10-06T02:27:43.800016+0000","last_clean":"2023-10-06T02:27:43.800016+0000","last_became_active":"2023-10-06T02:27:42.811370+0000","last_became_peered":"2023-10-06T02:27:42.811370+0000","last_unstale":"2023-10-06T02:27:43.800016+0000","last_undegraded":"2023-10-06T02:27:43.800016+0000","last_fullsized":"2023-10-06T02:27:43.800016+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:55:16.818646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.833652+0000","last_change":"2023-10-06T02:27:43.828061+0000","last_active":"2023-10-06T02:27:43.833652+0000","last_peered":"2023-10-06T02:27:43.833652+0000","last_clean":"2023-10-06T02:27:43.833652+0000","last_became_active":"2023-10-06T02:27:43.824036+0000","last_became_peered":"2023-10-06T02:27:43.824036+0000","last_unstale":"2023-10-06T02:27:43.833652+0000","last_undegraded":"2023-10-06T02:27:43.833652+0000","last_fullsized":"2023-10-06T02:27:43.833652+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:48:03.838565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.804671+0000","last_change":"2023-10-06T02:27:42.813430+0000","last_active":"2023-10-06T02:27:43.804671+0000","last_peered":"2023-10-06T02:27:43.804671+0000","last_clean":"2023-10-06T02:27:43.804671+0000","last_became_active":"2023-10-06T02:27:42.813263+0000","last_became_peered":"2023-10-06T02:27:42.813263+0000","last_unstale":"2023-10-06T02:27:43.804671+0000","last_undegraded":"2023-10-06T02:27:43.804671+0000","last_fullsized":"2023-10-06T02:27:43.804671+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:28.180005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.813547+0000","last_change":"2023-10-06T02:27:43.809403+0000","last_active":"2023-10-06T02:27:43.813547+0000","last_peered":"2023-10-06T02:27:43.813547+0000","last_clean":"2023-10-06T02:27:43.813547+0000","last_became_active":"2023-10-06T02:27:43.809118+0000","last_became_peered":"2023-10-06T02:27:43.809118+0000","last_unstale":"2023-10-06T02:27:43.813547+0000","last_undegraded":"2023-10-06T02:27:43.813547+0000","last_fullsized":"2023-10-06T02:27:43.813547+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:01.723335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.800534+0000","last_change":"2023-10-06T02:27:42.812967+0000","last_active":"2023-10-06T02:27:43.800534+0000","last_peered":"2023-10-06T02:27:43.800534+0000","last_clean":"2023-10-06T02:27:43.800534+0000","last_became_active":"2023-10-06T02:27:42.812686+0000","last_became_peered":"2023-10-06T02:27:42.812686+0000","last_unstale":"2023-10-06T02:27:43.800534+0000","last_undegraded":"2023-10-06T02:27:43.800534+0000","last_fullsized":"2023-10-06T02:27:43.800534+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:36:47.713799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.825507+0000","last_change":"2023-10-06T02:27:43.818770+0000","last_active":"2023-10-06T02:27:43.825507+0000","last_peered":"2023-10-06T02:27:43.825507+0000","last_clean":"2023-10-06T02:27:43.825507+0000","last_became_active":"2023-10-06T02:27:43.818483+0000","last_became_peered":"2023-10-06T02:27:43.818483+0000","last_unstale":"2023-10-06T02:27:43.825507+0000","last_undegraded":"2023-10-06T02:27:43.825507+0000","last_fullsized":"2023-10-06T02:27:43.825507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:36.782492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"71'3","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.826187+0000","last_change":"2023-10-06T02:27:42.815152+0000","last_active":"2023-10-06T02:27:43.826187+0000","last_peered":"2023-10-06T02:27:43.826187+0000","last_clean":"2023-10-06T02:27:43.826187+0000","last_became_active":"2023-10-06T02:27:42.814822+0000","last_became_peered":"2023-10-06T02:27:42.814822+0000","last_unstale":"2023-10-06T02:27:43.826187+0000","last_undegraded":"2023-10-06T02:27:43.826187+0000","last_fullsized":"2023-10-06T02:27:43.826187+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:48.778361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.829525+0000","last_change":"2023-10-06T02:27:43.824157+0000","last_active":"2023-10-06T02:27:43.829525+0000","last_peered":"2023-10-06T02:27:43.829525+0000","last_clean":"2023-10-06T02:27:43.829525+0000","last_became_active":"2023-10-06T02:27:43.823845+0000","last_became_peered":"2023-10-06T02:27:43.823845+0000","last_unstale":"2023-10-06T02:27:43.829525+0000","last_undegraded":"2023-10-06T02:27:43.829525+0000","last_fullsized":"2023-10-06T02:27:43.829525+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:09.677215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"71'6","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.833095+0000","last_change":"2023-10-06T02:27:42.806783+0000","last_active":"2023-10-06T02:27:43.833095+0000","last_peered":"2023-10-06T02:27:43.833095+0000","last_clean":"2023-10-06T02:27:43.833095+0000","last_became_active":"2023-10-06T02:27:42.806497+0000","last_became_peered":"2023-10-06T02:27:42.806497+0000","last_unstale":"2023-10-06T02:27:43.833095+0000","last_undegraded":"2023-10-06T02:27:43.833095+0000","last_fullsized":"2023-10-06T02:27:43.833095+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:43:44.444253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.817553+0000","last_change":"2023-10-06T02:27:43.814012+0000","last_active":"2023-10-06T02:27:43.817553+0000","last_peered":"2023-10-06T02:27:43.817553+0000","last_clean":"2023-10-06T02:27:43.817553+0000","last_became_active":"2023-10-06T02:27:43.813718+0000","last_became_peered":"2023-10-06T02:27:43.813718+0000","last_unstale":"2023-10-06T02:27:43.817553+0000","last_undegraded":"2023-10-06T02:27:43.817553+0000","last_fullsized":"2023-10-06T02:27:43.817553+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:09.747047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.821905+0000","last_change":"2023-10-06T02:27:42.805768+0000","last_active":"2023-10-06T02:27:43.821905+0000","last_peered":"2023-10-06T02:27:43.821905+0000","last_clean":"2023-10-06T02:27:43.821905+0000","last_became_active":"2023-10-06T02:27:42.805483+0000","last_became_peered":"2023-10-06T02:27:42.805483+0000","last_unstale":"2023-10-06T02:27:43.821905+0000","last_undegraded":"2023-10-06T02:27:43.821905+0000","last_fullsized":"2023-10-06T02:27:43.821905+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:39.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.827011+0000","last_change":"2023-10-06T02:27:43.821764+0000","last_active":"2023-10-06T02:27:43.827011+0000","last_peered":"2023-10-06T02:27:43.827011+0000","last_clean":"2023-10-06T02:27:43.827011+0000","last_became_active":"2023-10-06T02:27:43.821502+0000","last_became_peered":"2023-10-06T02:27:43.821502+0000","last_unstale":"2023-10-06T02:27:43.827011+0000","last_undegraded":"2023-10-06T02:27:43.827011+0000","last_fullsized":"2023-10-06T02:27:43.827011+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:39:23.939491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.804053+0000","last_change":"2023-10-06T02:27:42.812082+0000","last_active":"2023-10-06T02:27:43.804053+0000","last_peered":"2023-10-06T02:27:43.804053+0000","last_clean":"2023-10-06T02:27:43.804053+0000","last_became_active":"2023-10-06T02:27:42.811811+0000","last_became_peered":"2023-10-06T02:27:42.811811+0000","last_unstale":"2023-10-06T02:27:43.804053+0000","last_undegraded":"2023-10-06T02:27:43.804053+0000","last_fullsized":"2023-10-06T02:27:43.804053+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:39.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.830076+0000","last_change":"2023-10-06T02:27:43.822368+0000","last_active":"2023-10-06T02:27:43.830076+0000","last_peered":"2023-10-06T02:27:43.830076+0000","last_clean":"2023-10-06T02:27:43.830076+0000","last_became_active":"2023-10-06T02:27:43.822052+0000","last_became_peered":"2023-10-06T02:27:43.822052+0000","last_unstale":"2023-10-06T02:27:43.830076+0000","last_undegraded":"2023-10-06T02:27:43.830076+0000","last_fullsized":"2023-10-06T02:27:43.830076+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:44.903380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.800039+0000","last_change":"2023-10-06T02:27:42.813049+0000","last_active":"2023-10-06T02:27:43.800039+0000","last_peered":"2023-10-06T02:27:43.800039+0000","last_clean":"2023-10-06T02:27:43.800039+0000","last_became_active":"2023-10-06T02:27:42.812763+0000","last_became_peered":"2023-10-06T02:27:42.812763+0000","last_unstale":"2023-10-06T02:27:43.800039+0000","last_undegraded":"2023-10-06T02:27:43.800039+0000","last_fullsized":"2023-10-06T02:27:43.800039+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:09.771266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.830151+0000","last_change":"2023-10-06T02:27:43.823647+0000","last_active":"2023-10-06T02:27:43.830151+0000","last_peered":"2023-10-06T02:27:43.830151+0000","last_clean":"2023-10-06T02:27:43.830151+0000","last_became_active":"2023-10-06T02:27:43.823034+0000","last_became_peered":"2023-10-06T02:27:43.823034+0000","last_unstale":"2023-10-06T02:27:43.830151+0000","last_undegraded":"2023-10-06T02:27:43.830151+0000","last_fullsized":"2023-10-06T02:27:43.830151+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:26.992522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"71'8","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.836161+0000","last_change":"2023-10-06T02:27:42.812011+0000","last_active":"2023-10-06T02:27:43.836161+0000","last_peered":"2023-10-06T02:27:43.836161+0000","last_clean":"2023-10-06T02:27:43.836161+0000","last_became_active":"2023-10-06T02:27:42.810343+0000","last_became_peered":"2023-10-06T02:27:42.810343+0000","last_unstale":"2023-10-06T02:27:43.836161+0000","last_undegraded":"2023-10-06T02:27:43.836161+0000","last_fullsized":"2023-10-06T02:27:43.836161+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:31.613891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.824001+0000","last_change":"2023-10-06T02:27:43.818680+0000","last_active":"2023-10-06T02:27:43.824001+0000","last_peered":"2023-10-06T02:27:43.824001+0000","last_clean":"2023-10-06T02:27:43.824001+0000","last_became_active":"2023-10-06T02:27:43.817966+0000","last_became_peered":"2023-10-06T02:27:43.817966+0000","last_unstale":"2023-10-06T02:27:43.824001+0000","last_undegraded":"2023-10-06T02:27:43.824001+0000","last_fullsized":"2023-10-06T02:27:43.824001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:17.967348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.817913+0000","last_change":"2023-10-06T02:27:42.809942+0000","last_active":"2023-10-06T02:27:43.817913+0000","last_peered":"2023-10-06T02:27:43.817913+0000","last_clean":"2023-10-06T02:27:43.817913+0000","last_became_active":"2023-10-06T02:27:42.809577+0000","last_became_peered":"2023-10-06T02:27:42.809577+0000","last_unstale":"2023-10-06T02:27:43.817913+0000","last_undegraded":"2023-10-06T02:27:43.817913+0000","last_fullsized":"2023-10-06T02:27:43.817913+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:28.180005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.830238+0000","last_change":"2023-10-06T02:27:43.824068+0000","last_active":"2023-10-06T02:27:43.830238+0000","last_peered":"2023-10-06T02:27:43.830238+0000","last_clean":"2023-10-06T02:27:43.830238+0000","last_became_active":"2023-10-06T02:27:43.823827+0000","last_became_peered":"2023-10-06T02:27:43.823827+0000","last_unstale":"2023-10-06T02:27:43.830238+0000","last_undegraded":"2023-10-06T02:27:43.830238+0000","last_fullsized":"2023-10-06T02:27:43.830238+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:25:36.224572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"72'1","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T02:27:46.010924+0000","last_change":"2023-10-06T02:27:42.810405+0000","last_active":"2023-10-06T02:27:46.010924+0000","last_peered":"2023-10-06T02:27:46.010924+0000","last_clean":"2023-10-06T02:27:46.010924+0000","last_became_active":"2023-10-06T02:27:42.810102+0000","last_became_peered":"2023-10-06T02:27:42.810102+0000","last_unstale":"2023-10-06T02:27:46.010924+0000","last_undegraded":"2023-10-06T02:27:46.010924+0000","last_fullsized":"2023-10-06T02:27:46.010924+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:28.180005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.824029+0000","last_change":"2023-10-06T02:27:43.818409+0000","last_active":"2023-10-06T02:27:43.824029+0000","last_peered":"2023-10-06T02:27:43.824029+0000","last_clean":"2023-10-06T02:27:43.824029+0000","last_became_active":"2023-10-06T02:27:43.818133+0000","last_became_peered":"2023-10-06T02:27:43.818133+0000","last_unstale":"2023-10-06T02:27:43.824029+0000","last_undegraded":"2023-10-06T02:27:43.824029+0000","last_fullsized":"2023-10-06T02:27:43.824029+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:54.179105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.804829+0000","last_change":"2023-10-06T02:27:42.813189+0000","last_active":"2023-10-06T02:27:43.804829+0000","last_peered":"2023-10-06T02:27:43.804829+0000","last_clean":"2023-10-06T02:27:43.804829+0000","last_became_active":"2023-10-06T02:27:42.812916+0000","last_became_peered":"2023-10-06T02:27:42.812916+0000","last_unstale":"2023-10-06T02:27:43.804829+0000","last_undegraded":"2023-10-06T02:27:43.804829+0000","last_fullsized":"2023-10-06T02:27:43.804829+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:36:47.713799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.833176+0000","last_change":"2023-10-06T02:27:43.824069+0000","last_active":"2023-10-06T02:27:43.833176+0000","last_peered":"2023-10-06T02:27:43.833176+0000","last_clean":"2023-10-06T02:27:43.833176+0000","last_became_active":"2023-10-06T02:27:43.823759+0000","last_became_peered":"2023-10-06T02:27:43.823759+0000","last_unstale":"2023-10-06T02:27:43.833176+0000","last_undegraded":"2023-10-06T02:27:43.833176+0000","last_fullsized":"2023-10-06T02:27:43.833176+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:34.837998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.803491+0000","last_change":"2023-10-06T02:27:42.812184+0000","last_active":"2023-10-06T02:27:43.803491+0000","last_peered":"2023-10-06T02:27:43.803491+0000","last_clean":"2023-10-06T02:27:43.803491+0000","last_became_active":"2023-10-06T02:27:42.811906+0000","last_became_peered":"2023-10-06T02:27:42.811906+0000","last_unstale":"2023-10-06T02:27:43.803491+0000","last_undegraded":"2023-10-06T02:27:43.803491+0000","last_fullsized":"2023-10-06T02:27:43.803491+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:31.613891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.830416+0000","last_change":"2023-10-06T02:27:43.826724+0000","last_active":"2023-10-06T02:27:43.830416+0000","last_peered":"2023-10-06T02:27:43.830416+0000","last_clean":"2023-10-06T02:27:43.830416+0000","last_became_active":"2023-10-06T02:27:43.825047+0000","last_became_peered":"2023-10-06T02:27:43.825047+0000","last_unstale":"2023-10-06T02:27:43.830416+0000","last_undegraded":"2023-10-06T02:27:43.830416+0000","last_fullsized":"2023-10-06T02:27:43.830416+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:26.319367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.812241+0000","last_change":"2023-10-06T02:27:42.809545+0000","last_active":"2023-10-06T02:27:43.812241+0000","last_peered":"2023-10-06T02:27:43.812241+0000","last_clean":"2023-10-06T02:27:43.812241+0000","last_became_active":"2023-10-06T02:27:42.809216+0000","last_became_peered":"2023-10-06T02:27:42.809216+0000","last_unstale":"2023-10-06T02:27:43.812241+0000","last_undegraded":"2023-10-06T02:27:43.812241+0000","last_fullsized":"2023-10-06T02:27:43.812241+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:12.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.822464+0000","last_change":"2023-10-06T02:27:43.818930+0000","last_active":"2023-10-06T02:27:43.822464+0000","last_peered":"2023-10-06T02:27:43.822464+0000","last_clean":"2023-10-06T02:27:43.822464+0000","last_became_active":"2023-10-06T02:27:43.818647+0000","last_became_peered":"2023-10-06T02:27:43.818647+0000","last_unstale":"2023-10-06T02:27:43.822464+0000","last_undegraded":"2023-10-06T02:27:43.822464+0000","last_fullsized":"2023-10-06T02:27:43.822464+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:28:34.237238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.800862+0000","last_change":"2023-10-06T02:27:42.813522+0000","last_active":"2023-10-06T02:27:43.800862+0000","last_peered":"2023-10-06T02:27:43.800862+0000","last_clean":"2023-10-06T02:27:43.800862+0000","last_became_active":"2023-10-06T02:27:42.813279+0000","last_became_peered":"2023-10-06T02:27:42.813279+0000","last_unstale":"2023-10-06T02:27:43.800862+0000","last_undegraded":"2023-10-06T02:27:43.800862+0000","last_fullsized":"2023-10-06T02:27:43.800862+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:03:59.272780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.828490+0000","last_change":"2023-10-06T02:27:43.825187+0000","last_active":"2023-10-06T02:27:43.828490+0000","last_peered":"2023-10-06T02:27:43.828490+0000","last_clean":"2023-10-06T02:27:43.828490+0000","last_became_active":"2023-10-06T02:27:43.824792+0000","last_became_peered":"2023-10-06T02:27:43.824792+0000","last_unstale":"2023-10-06T02:27:43.828490+0000","last_undegraded":"2023-10-06T02:27:43.828490+0000","last_fullsized":"2023-10-06T02:27:43.828490+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:31.134356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.812381+0000","last_change":"2023-10-06T02:27:42.811203+0000","last_active":"2023-10-06T02:27:43.812381+0000","last_peered":"2023-10-06T02:27:43.812381+0000","last_clean":"2023-10-06T02:27:43.812381+0000","last_became_active":"2023-10-06T02:27:42.810876+0000","last_became_peered":"2023-10-06T02:27:42.810876+0000","last_unstale":"2023-10-06T02:27:43.812381+0000","last_undegraded":"2023-10-06T02:27:43.812381+0000","last_fullsized":"2023-10-06T02:27:43.812381+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:28.067756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.828590+0000","last_change":"2023-10-06T02:27:43.825066+0000","last_active":"2023-10-06T02:27:43.828590+0000","last_peered":"2023-10-06T02:27:43.828590+0000","last_clean":"2023-10-06T02:27:43.828590+0000","last_became_active":"2023-10-06T02:27:43.824586+0000","last_became_peered":"2023-10-06T02:27:43.824586+0000","last_unstale":"2023-10-06T02:27:43.828590+0000","last_undegraded":"2023-10-06T02:27:43.828590+0000","last_fullsized":"2023-10-06T02:27:43.828590+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:40.040632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.814561+0000","last_change":"2023-10-06T02:27:42.806843+0000","last_active":"2023-10-06T02:27:43.814561+0000","last_peered":"2023-10-06T02:27:43.814561+0000","last_clean":"2023-10-06T02:27:43.814561+0000","last_became_active":"2023-10-06T02:27:42.806561+0000","last_became_peered":"2023-10-06T02:27:42.806561+0000","last_unstale":"2023-10-06T02:27:43.814561+0000","last_undegraded":"2023-10-06T02:27:43.814561+0000","last_fullsized":"2023-10-06T02:27:43.814561+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:25.987778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.822590+0000","last_change":"2023-10-06T02:27:43.817486+0000","last_active":"2023-10-06T02:27:43.822590+0000","last_peered":"2023-10-06T02:27:43.822590+0000","last_clean":"2023-10-06T02:27:43.822590+0000","last_became_active":"2023-10-06T02:27:43.817194+0000","last_became_peered":"2023-10-06T02:27:43.817194+0000","last_unstale":"2023-10-06T02:27:43.822590+0000","last_undegraded":"2023-10-06T02:27:43.822590+0000","last_fullsized":"2023-10-06T02:27:43.822590+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:49.107220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.822259+0000","last_change":"2023-10-06T02:27:42.810765+0000","last_active":"2023-10-06T02:27:43.822259+0000","last_peered":"2023-10-06T02:27:43.822259+0000","last_clean":"2023-10-06T02:27:43.822259+0000","last_became_active":"2023-10-06T02:27:42.810012+0000","last_became_peered":"2023-10-06T02:27:42.810012+0000","last_unstale":"2023-10-06T02:27:43.822259+0000","last_undegraded":"2023-10-06T02:27:43.822259+0000","last_fullsized":"2023-10-06T02:27:43.822259+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:27:16.962604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":58,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.804560+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:27:43.804560+0000","last_peered":"2023-10-06T02:27:43.804560+0000","last_clean":"2023-10-06T02:27:43.804560+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:27:43.804560+0000","last_undegraded":"2023-10-06T02:27:43.804560+0000","last_fullsized":"2023-10-06T02:27:43.804560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.832584+0000","last_change":"2023-10-06T02:27:43.817383+0000","last_active":"2023-10-06T02:27:43.832584+0000","last_peered":"2023-10-06T02:27:43.832584+0000","last_clean":"2023-10-06T02:27:43.832584+0000","last_became_active":"2023-10-06T02:27:43.817092+0000","last_became_peered":"2023-10-06T02:27:43.817092+0000","last_unstale":"2023-10-06T02:27:43.832584+0000","last_undegraded":"2023-10-06T02:27:43.832584+0000","last_fullsized":"2023-10-06T02:27:43.832584+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:13.151588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.824374+0000","last_change":"2023-10-06T02:27:42.806707+0000","last_active":"2023-10-06T02:27:43.824374+0000","last_peered":"2023-10-06T02:27:43.824374+0000","last_clean":"2023-10-06T02:27:43.824374+0000","last_became_active":"2023-10-06T02:27:42.806408+0000","last_became_peered":"2023-10-06T02:27:42.806408+0000","last_unstale":"2023-10-06T02:27:43.824374+0000","last_undegraded":"2023-10-06T02:27:43.824374+0000","last_fullsized":"2023-10-06T02:27:43.824374+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:41.460239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":57,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.813527+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:27:43.813527+0000","last_peered":"2023-10-06T02:27:43.813527+0000","last_clean":"2023-10-06T02:27:43.813527+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:27:43.813527+0000","last_undegraded":"2023-10-06T02:27:43.813527+0000","last_fullsized":"2023-10-06T02:27:43.813527+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.833148+0000","last_change":"2023-10-06T02:27:43.823367+0000","last_active":"2023-10-06T02:27:43.833148+0000","last_peered":"2023-10-06T02:27:43.833148+0000","last_clean":"2023-10-06T02:27:43.833148+0000","last_became_active":"2023-10-06T02:27:43.819829+0000","last_became_peered":"2023-10-06T02:27:43.819829+0000","last_unstale":"2023-10-06T02:27:43.833148+0000","last_undegraded":"2023-10-06T02:27:43.833148+0000","last_fullsized":"2023-10-06T02:27:43.833148+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:06.773408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.807367+0000","last_change":"2023-10-06T02:27:42.809927+0000","last_active":"2023-10-06T02:27:43.807367+0000","last_peered":"2023-10-06T02:27:43.807367+0000","last_clean":"2023-10-06T02:27:43.807367+0000","last_became_active":"2023-10-06T02:27:42.809606+0000","last_became_peered":"2023-10-06T02:27:42.809606+0000","last_unstale":"2023-10-06T02:27:43.807367+0000","last_undegraded":"2023-10-06T02:27:43.807367+0000","last_fullsized":"2023-10-06T02:27:43.807367+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:08.742302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":57,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.814559+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:27:43.814559+0000","last_peered":"2023-10-06T02:27:43.814559+0000","last_clean":"2023-10-06T02:27:43.814559+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:27:43.814559+0000","last_undegraded":"2023-10-06T02:27:43.814559+0000","last_fullsized":"2023-10-06T02:27:43.814559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":203,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.804073+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:27:43.804073+0000","last_peered":"2023-10-06T02:27:43.804073+0000","last_clean":"2023-10-06T02:27:43.804073+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:27:43.804073+0000","last_undegraded":"2023-10-06T02:27:43.804073+0000","last_fullsized":"2023-10-06T02:27:43.804073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.818933+0000","last_change":"2023-10-06T02:27:43.815140+0000","last_active":"2023-10-06T02:27:43.818933+0000","last_peered":"2023-10-06T02:27:43.818933+0000","last_clean":"2023-10-06T02:27:43.818933+0000","last_became_active":"2023-10-06T02:27:43.814873+0000","last_became_peered":"2023-10-06T02:27:43.814873+0000","last_unstale":"2023-10-06T02:27:43.818933+0000","last_undegraded":"2023-10-06T02:27:43.818933+0000","last_fullsized":"2023-10-06T02:27:43.818933+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:14.723560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.807165+0000","last_change":"2023-10-06T02:27:42.810776+0000","last_active":"2023-10-06T02:27:43.807165+0000","last_peered":"2023-10-06T02:27:43.807165+0000","last_clean":"2023-10-06T02:27:43.807165+0000","last_became_active":"2023-10-06T02:27:42.810461+0000","last_became_peered":"2023-10-06T02:27:42.810461+0000","last_unstale":"2023-10-06T02:27:43.807165+0000","last_undegraded":"2023-10-06T02:27:43.807165+0000","last_fullsized":"2023-10-06T02:27:43.807165+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:00.718591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":53,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.804140+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:27:43.804140+0000","last_peered":"2023-10-06T02:27:43.804140+0000","last_clean":"2023-10-06T02:27:43.804140+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:27:43.804140+0000","last_undegraded":"2023-10-06T02:27:43.804140+0000","last_fullsized":"2023-10-06T02:27:43.804140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.822431+0000","last_change":"2023-10-06T02:27:43.815936+0000","last_active":"2023-10-06T02:27:43.822431+0000","last_peered":"2023-10-06T02:27:43.822431+0000","last_clean":"2023-10-06T02:27:43.822431+0000","last_became_active":"2023-10-06T02:27:43.815645+0000","last_became_peered":"2023-10-06T02:27:43.815645+0000","last_unstale":"2023-10-06T02:27:43.822431+0000","last_undegraded":"2023-10-06T02:27:43.822431+0000","last_fullsized":"2023-10-06T02:27:43.822431+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:44.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.808291+0000","last_change":"2023-10-06T02:27:42.810898+0000","last_active":"2023-10-06T02:27:43.808291+0000","last_peered":"2023-10-06T02:27:43.808291+0000","last_clean":"2023-10-06T02:27:43.808291+0000","last_became_active":"2023-10-06T02:27:42.810582+0000","last_became_peered":"2023-10-06T02:27:42.810582+0000","last_unstale":"2023-10-06T02:27:43.808291+0000","last_undegraded":"2023-10-06T02:27:43.808291+0000","last_fullsized":"2023-10-06T02:27:43.808291+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:33.833254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":53,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.804821+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:27:43.804821+0000","last_peered":"2023-10-06T02:27:43.804821+0000","last_clean":"2023-10-06T02:27:43.804821+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:27:43.804821+0000","last_undegraded":"2023-10-06T02:27:43.804821+0000","last_fullsized":"2023-10-06T02:27:43.804821+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.828476+0000","last_change":"2023-10-06T02:27:43.822058+0000","last_active":"2023-10-06T02:27:43.828476+0000","last_peered":"2023-10-06T02:27:43.828476+0000","last_clean":"2023-10-06T02:27:43.828476+0000","last_became_active":"2023-10-06T02:27:43.820240+0000","last_became_peered":"2023-10-06T02:27:43.820240+0000","last_unstale":"2023-10-06T02:27:43.828476+0000","last_undegraded":"2023-10-06T02:27:43.828476+0000","last_fullsized":"2023-10-06T02:27:43.828476+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:16.571721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.831618+0000","last_change":"2023-10-06T02:27:42.810030+0000","last_active":"2023-10-06T02:27:43.831618+0000","last_peered":"2023-10-06T02:27:43.831618+0000","last_clean":"2023-10-06T02:27:43.831618+0000","last_became_active":"2023-10-06T02:27:42.809757+0000","last_became_peered":"2023-10-06T02:27:42.809757+0000","last_unstale":"2023-10-06T02:27:43.831618+0000","last_undegraded":"2023-10-06T02:27:43.831618+0000","last_fullsized":"2023-10-06T02:27:43.831618+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:49.628882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":64,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.799857+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:27:43.799857+0000","last_peered":"2023-10-06T02:27:43.799857+0000","last_clean":"2023-10-06T02:27:43.799857+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:27:43.799857+0000","last_undegraded":"2023-10-06T02:27:43.799857+0000","last_fullsized":"2023-10-06T02:27:43.799857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.822565+0000","last_change":"2023-10-06T02:27:43.817641+0000","last_active":"2023-10-06T02:27:43.822565+0000","last_peered":"2023-10-06T02:27:43.822565+0000","last_clean":"2023-10-06T02:27:43.822565+0000","last_became_active":"2023-10-06T02:27:43.817129+0000","last_became_peered":"2023-10-06T02:27:43.817129+0000","last_unstale":"2023-10-06T02:27:43.822565+0000","last_undegraded":"2023-10-06T02:27:43.822565+0000","last_fullsized":"2023-10-06T02:27:43.822565+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:40.328607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.814409+0000","last_change":"2023-10-06T02:27:42.806975+0000","last_active":"2023-10-06T02:27:43.814409+0000","last_peered":"2023-10-06T02:27:43.814409+0000","last_clean":"2023-10-06T02:27:43.814409+0000","last_became_active":"2023-10-06T02:27:42.806684+0000","last_became_peered":"2023-10-06T02:27:42.806684+0000","last_unstale":"2023-10-06T02:27:43.814409+0000","last_undegraded":"2023-10-06T02:27:43.814409+0000","last_fullsized":"2023-10-06T02:27:43.814409+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:25.314623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":57,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.812383+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:27:43.812383+0000","last_peered":"2023-10-06T02:27:43.812383+0000","last_clean":"2023-10-06T02:27:43.812383+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:27:43.812383+0000","last_undegraded":"2023-10-06T02:27:43.812383+0000","last_fullsized":"2023-10-06T02:27:43.812383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.833103+0000","last_change":"2023-10-06T02:27:43.821600+0000","last_active":"2023-10-06T02:27:43.833103+0000","last_peered":"2023-10-06T02:27:43.833103+0000","last_clean":"2023-10-06T02:27:43.833103+0000","last_became_active":"2023-10-06T02:27:43.821352+0000","last_became_peered":"2023-10-06T02:27:43.821352+0000","last_unstale":"2023-10-06T02:27:43.833103+0000","last_undegraded":"2023-10-06T02:27:43.833103+0000","last_fullsized":"2023-10-06T02:27:43.833103+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:42.788150+0000","last_clean_scrub_stamp":"2023-10-06T02:27:42.788150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:11.894850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.826309+0000","last_change":"2023-10-06T02:27:42.811306+0000","last_active":"2023-10-06T02:27:43.826309+0000","last_peered":"2023-10-06T02:27:43.826309+0000","last_clean":"2023-10-06T02:27:43.826309+0000","last_became_active":"2023-10-06T02:27:42.811022+0000","last_became_peered":"2023-10-06T02:27:42.811022+0000","last_unstale":"2023-10-06T02:27:43.826309+0000","last_undegraded":"2023-10-06T02:27:43.826309+0000","last_fullsized":"2023-10-06T02:27:43.826309+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:27:41.783406+0000","last_clean_scrub_stamp":"2023-10-06T02:27:41.783406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:08.022668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":57,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-10-06T02:27:43.812600+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:27:43.812600+0000","last_peered":"2023-10-06T02:27:43.812600+0000","last_clean":"2023-10-06T02:27:43.812600+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:27:43.812600+0000","last_undegraded":"2023-10-06T02:27:43.812600+0000","last_fullsized":"2023-10-06T02:27:43.812600+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574909,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298728,"kb_used_data":1440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073112,"statfs":{"total":96636764160,"available":96330866688,"internally_reserved":0,"allocated":1474560,"data_stored":982523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.311,"15min":0.311},"max":{"1min":0.69899999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.628},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.56899999999999995,"15min":0.55000000000000004},"min":{"1min":0.49199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.77400000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.73299999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54800000000000004,"15min":0.52200000000000002},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72299999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55800000000000005,"15min":0.54200000000000004},"min":{"1min":0.41999999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71499999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.68300000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56799999999999995,"15min":0.55400000000000005},"min":{"1min":0.40999999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73099999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57599999999999996,"15min":0.55600000000000005},"min":{"1min":0.51900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76200000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72599999999999998,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57799999999999996,"15min":0.56399999999999995},"min":{"1min":0.372,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71699999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.745}]},{"osd":4,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.34000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.68700000000000006,"5min":1.014,"15min":1.014},"last":0.505},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64000000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54500000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.371,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66800000000000004,"5min":0.747,"15min":0.747},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55100000000000005,"15min":0.56399999999999995},"min":{"1min":0.39500000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69799999999999995,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57499999999999996,"15min":0.58699999999999997},"min":{"1min":0.41499999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73599999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58399999999999996,"15min":0.59499999999999997},"min":{"1min":0.39300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.748,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":392316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64400000000000002,"15min":0.73599999999999999},"min":{"1min":0.41799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.77000000000000002,"5min":5.859,"15min":5.859},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.55800000000000005,"15min":0.54200000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79100000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.434}]},{"osd":1,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.53900000000000003,"15min":0.52100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.754,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55200000000000005,"15min":0.53500000000000003},"min":{"1min":0.39000000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80700000000000005,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.55500000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77100000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85899999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.41499999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57599999999999996,"15min":0.55200000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83299999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82599999999999996,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67800000000000005,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.32500000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.73799999999999999,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.57499999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.36299999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76600000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54800000000000004,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75600000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.63400000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.58299999999999996},"min":{"1min":0.39200000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.61799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298732,"kb_used_data":1444,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073108,"statfs":{"total":96636764160,"available":96330862592,"internally_reserved":0,"allocated":1478656,"data_stored":982613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36599999999999999,"15min":0.379},"min":{"1min":0.25800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.52500000000000002,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.53900000000000003,"15min":0.67300000000000004},"min":{"1min":0.32400000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58299999999999996,"5min":7.6900000000000004,"15min":7.6900000000000004},"last":0.41299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.497,"15min":0.629},"min":{"1min":0.30099999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.50600000000000001,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.56200000000000006,"15min":0.70199999999999996},"min":{"1min":0.308,"5min":0.251,"15min":0.251},"max":{"1min":0.59499999999999997,"5min":7.758,"15min":7.758},"last":0.34699999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.59199999999999997,"15min":0.72899999999999998},"min":{"1min":0.35799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64700000000000002,"5min":7.7869999999999999,"15min":7.7869999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.42499999999999999},"min":{"1min":0.35499999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.625,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.376}]},{"osd":4,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.84599999999999997,"15min":1.0700000000000001},"min":{"1min":0.44,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76700000000000002,"5min":11.678000000000001,"15min":11.678000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.76400000000000001,"15min":0.90400000000000003},"min":{"1min":0.50900000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85399999999999998,"5min":7.6529999999999996,"15min":7.6529999999999996},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.42399999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81799999999999995,"5min":1.399,"15min":1.399},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.80600000000000005,"15min":0.93899999999999995},"min":{"1min":0.495,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84099999999999997,"5min":7.508,"15min":7.508},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.78000000000000003,"15min":0.91500000000000004},"min":{"1min":0.47399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83699999999999997,"5min":7.7270000000000003,"15min":7.7270000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67300000000000004,"15min":0.68700000000000006},"min":{"1min":0.49399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.873,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.75600000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.497,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.92200000000000004,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.82999999999999996,"15min":0.96099999999999997},"min":{"1min":0.57199999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89200000000000002,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.82999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298140,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073700,"statfs":{"total":96636764160,"available":96331468800,"internally_reserved":0,"allocated":872448,"data_stored":390780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.35799999999999998,"15min":0.34699999999999998},"min":{"1min":0.23699999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.53400000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.38,"15min":0.36499999999999999},"min":{"1min":0.29399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51700000000000002,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.39800000000000002,"15min":0.38900000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57299999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.308},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.57199999999999995,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.373}]},{"osd":3,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.36799999999999999,"15min":0.35499999999999998},"min":{"1min":0.27500000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.52800000000000002,"5min":0.622,"15min":0.622},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.41199999999999998,"15min":0.39700000000000002},"min":{"1min":0.312,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60899999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.35899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95999999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64600000000000002,"15min":0.63900000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94599999999999995,"5min":1.008,"15min":1.008},"last":0.56499999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81899999999999995,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.621,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93100000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.47899999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.98899999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.46500000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88700000000000001,"5min":1,"15min":1},"last":0.55400000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91600000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.97399999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.64700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298156,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073684,"statfs":{"total":96636764160,"available":96331452416,"internally_reserved":0,"allocated":888832,"data_stored":392847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.34799999999999998,"15min":0.33900000000000002},"min":{"1min":0.28899999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38,"15min":0.38200000000000001},"min":{"1min":0.29099999999999998,"5min":0.218,"15min":0.218},"max":{"1min":0.48499999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.33400000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.35999999999999999,"15min":0.34999999999999998},"min":{"1min":0.27200000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.317},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.40500000000000003,"15min":0.40000000000000002},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59199999999999997,"5min":0.621,"15min":0.621},"last":0.23599999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42499999999999999,"15min":0.41099999999999998},"min":{"1min":0.35099999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.373,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.34899999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85199999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.504},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88700000000000001,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.58399999999999996,"5min":0.437,"15min":0.437},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.52500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.95399999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.53900000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.498,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95699999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.52600000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.52600000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.498,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91700000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.503,"5min":0.439,"15min":0.439},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.54700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574909,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":876544,"data_stored":391334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.52900000000000003,"15min":0.69099999999999995},"min":{"1min":0.216,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.61799999999999999,"5min":10.164999999999999,"15min":10.164999999999999},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40600000000000003,"15min":0.41099999999999998},"min":{"1min":0.26600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.57899999999999996,"5min":1.266,"15min":1.266},"last":0.29399999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42099999999999999,"15min":0.42899999999999999},"min":{"1min":0.27800000000000002,"5min":0.191,"15min":0.191},"max":{"1min":0.58399999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.42999999999999999,"15min":0.432},"min":{"1min":0.311,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66600000000000004,"5min":1.319,"15min":1.319},"last":0.38500000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.442,"15min":0.44},"min":{"1min":0.36099999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.627,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.47999999999999998,"15min":0.48899999999999999},"min":{"1min":0.33300000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.68700000000000006,"5min":1.5,"15min":1.5},"last":0.34999999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63700000000000001,"15min":0.63200000000000001},"min":{"1min":0.49299999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88800000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.498},{"interface":"front","average":{"1min":0.629,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.44600000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93100000000000005,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.53500000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.501,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86299999999999999,"5min":1.538,"15min":1.538},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.64300000000000002},"min":{"1min":0.499,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84299999999999997,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.44800000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.625,"15min":0.61399999999999999},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.88900000000000001,"5min":1.111,"15min":1.111},"last":0.44},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90600000000000003,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.54500000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.47699999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.876,"5min":1.21,"15min":1.21},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.48599999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86199999999999999,"5min":1.135,"15min":1.135},"last":0.46500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298164,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073676,"statfs":{"total":96636764160,"available":96331444224,"internally_reserved":0,"allocated":897024,"data_stored":393773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.78800000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54100000000000004,"15min":0.51300000000000001},"min":{"1min":0.42099999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.53300000000000003,"15min":0.501},"min":{"1min":0.40600000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.48199999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.67200000000000004}]},{"osd":3,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.40500000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.75800000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.46600000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77000000000000002,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.73199999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.497,"15min":0.48999999999999999},"min":{"1min":0.43099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76800000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.79100000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.47999999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.36399999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75600000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.372,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76700000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.41699999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.34200000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80100000000000005,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.34599999999999997,"5min":0.308,"15min":0.308},"max":{"1min":0.83999999999999997,"5min":1.04,"15min":1.04},"last":0.46100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":880640,"data_stored":392167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.51600000000000001,"15min":0.498},"min":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51300000000000001,"15min":0.49099999999999999},"min":{"1min":0.45600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.41599999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.52300000000000002,"15min":0.49399999999999999},"min":{"1min":0.42899999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.51300000000000001,"15min":0.498},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.50800000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.58899999999999997,"15min":0.57399999999999995},"min":{"1min":0.46200000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.53400000000000003,"15min":0.51600000000000001},"min":{"1min":0.40699999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.433}]},{"osd":4,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.47799999999999998,"15min":0.48899999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.60399999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51100000000000001,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69299999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.48199999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.32200000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.71099999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54700000000000004,"15min":0.56699999999999995},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68999999999999995,"5min":0.873,"15min":0.873},"last":0.61499999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:27:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54300000000000004,"15min":0.56299999999999994},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69699999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57299999999999995,"15min":0.60099999999999998},"min":{"1min":0.38,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67600000000000005,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:27:53.612 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:27:53.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:27:53.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.771+0000 7fa9e6691700 1 Processor -- start 2023-10-06T02:27:53.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.771+0000 7fa9e6691700 1 -- start start 2023-10-06T02:27:53.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.772+0000 7fa9e6691700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa9e00b29d0 0x7fa9e00ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:53.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.772+0000 7fa9e6691700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa9e00cb170 0x7fa9e00cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:53.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.772+0000 7fa9e6691700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9e00cf340 0x7fa9e00c5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:53.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.772+0000 7fa9e6691700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e00b2da0 con 0x7fa9e00b29d0 2023-10-06T02:27:53.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.772+0000 7fa9e6691700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e0099bd0 con 0x7fa9e00cb170 2023-10-06T02:27:53.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.772+0000 7fa9e6691700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e0159a70 con 0x7fa9e00cf340 2023-10-06T02:27:53.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.772+0000 7fa9e568f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa9e00b29d0 0x7fa9e00ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:53.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.772+0000 7fa9e568f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa9e00b29d0 0x7fa9e00ce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53120/0 (socket says 172.21.15.37:53120) 2023-10-06T02:27:53.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.772+0000 7fa9e568f700 1 -- 172.21.15.37:0/2491715117 learned_addr learned my addr 172.21.15.37:0/2491715117 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:53.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.772+0000 7fa9e4e8e700 1 --2- 172.21.15.37:0/2491715117 >> v2:172.21.15.191:3300/0 conn(0x7fa9e00cb170 0x7fa9e00cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:53.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.772+0000 7fa9e5e90700 1 --2- 172.21.15.37:0/2491715117 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9e00cf340 0x7fa9e00c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:53.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.772+0000 7fa9e568f700 1 -- 172.21.15.37:0/2491715117 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9e00cf340 msgr2=0x7fa9e00c5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:53.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.772+0000 7fa9e568f700 1 --2- 172.21.15.37:0/2491715117 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9e00cf340 0x7fa9e00c5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.772+0000 7fa9e568f700 1 -- 172.21.15.37:0/2491715117 >> v2:172.21.15.191:3300/0 conn(0x7fa9e00cb170 msgr2=0x7fa9e00cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:53.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.772+0000 7fa9e568f700 1 --2- 172.21.15.37:0/2491715117 >> v2:172.21.15.191:3300/0 conn(0x7fa9e00cb170 0x7fa9e00cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.772+0000 7fa9e568f700 1 -- 172.21.15.37:0/2491715117 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e00cb5e0 con 0x7fa9e00b29d0 2023-10-06T02:27:53.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.772+0000 7fa9e4e8e700 1 --2- 172.21.15.37:0/2491715117 >> v2:172.21.15.191:3300/0 conn(0x7fa9e00cb170 0x7fa9e00cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:53.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.773+0000 7fa9e568f700 1 --2- 172.21.15.37:0/2491715117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9e00b29d0 0x7fa9e00ce8c0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa9e008ab30 tx=0x7fa9d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4c2d2cf5252dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:53.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.773+0000 7fa9dffff700 1 -- 172.21.15.37:0/2491715117 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d800b860 con 0x7fa9e00b29d0 2023-10-06T02:27:53.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.773+0000 7fa9dffff700 1 -- 172.21.15.37:0/2491715117 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d800b9c0 con 0x7fa9e00b29d0 2023-10-06T02:27:53.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.773+0000 7fa9dffff700 1 -- 172.21.15.37:0/2491715117 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d800bd60 con 0x7fa9e00b29d0 2023-10-06T02:27:53.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.773+0000 7fa9e6691700 1 -- 172.21.15.37:0/2491715117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9e00b29d0 msgr2=0x7fa9e00ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:53.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.773+0000 7fa9e6691700 1 --2- 172.21.15.37:0/2491715117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9e00b29d0 0x7fa9e00ce8c0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa9e008ab30 tx=0x7fa9d8009250 comp rx=0 tx=0).stop 2023-10-06T02:27:53.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.773+0000 7fa9e6691700 1 -- 172.21.15.37:0/2491715117 shutdown_connections 2023-10-06T02:27:53.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.773+0000 7fa9e6691700 1 --2- 172.21.15.37:0/2491715117 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9e00cf340 0x7fa9e00c5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.773+0000 7fa9e6691700 1 --2- 172.21.15.37:0/2491715117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9e00b29d0 0x7fa9e00ce8c0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.773+0000 7fa9e6691700 1 --2- 172.21.15.37:0/2491715117 >> v2:172.21.15.191:3300/0 conn(0x7fa9e00cb170 0x7fa9e00cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.773+0000 7fa9e6691700 1 -- 172.21.15.37:0/2491715117 >> 172.21.15.37:0/2491715117 conn(0x7fa9e0099610 msgr2=0x7fa9e006c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:53.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.773+0000 7fa9e6691700 1 -- 172.21.15.37:0/2491715117 shutdown_connections 2023-10-06T02:27:53.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.773+0000 7fa9e6691700 1 -- 172.21.15.37:0/2491715117 wait complete. 2023-10-06T02:27:53.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.775+0000 7fa9e6691700 1 Processor -- start 2023-10-06T02:27:53.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.775+0000 7fa9e6691700 1 -- start start 2023-10-06T02:27:53.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.775+0000 7fa9e6691700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9e00b29d0 0x7fa9e00b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:53.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.775+0000 7fa9e6691700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9e00cb170 0x7fa9e0150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:53.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.775+0000 7fa9e6691700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9e00cf340 0x7fa9e016a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:53.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.775+0000 7fa9e6691700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e00b5380 con 0x7fa9e00cf340 2023-10-06T02:27:53.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.775+0000 7fa9e6691700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e0169780 con 0x7fa9e00cb170 2023-10-06T02:27:53.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.775+0000 7fa9e6691700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e0169d40 con 0x7fa9e00b29d0 2023-10-06T02:27:53.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.776+0000 7fa9e5e90700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9e00cf340 0x7fa9e016a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:53.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.776+0000 7fa9e5e90700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9e00cf340 0x7fa9e016a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53126/0 (socket says 172.21.15.37:53126) 2023-10-06T02:27:53.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.776+0000 7fa9e5e90700 1 -- 172.21.15.37:0/3145934879 learned_addr learned my addr 172.21.15.37:0/3145934879 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:53.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.776+0000 7fa9e568f700 1 --2- 172.21.15.37:0/3145934879 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9e00b29d0 0x7fa9e00b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:53.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.776+0000 7fa9e4e8e700 1 --2- 172.21.15.37:0/3145934879 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9e00cb170 0x7fa9e0150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:53.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.776+0000 7fa9e5e90700 1 -- 172.21.15.37:0/3145934879 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9e00b29d0 msgr2=0x7fa9e00b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:53.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.776+0000 7fa9e5e90700 1 --2- 172.21.15.37:0/3145934879 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9e00b29d0 0x7fa9e00b47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.776+0000 7fa9e5e90700 1 -- 172.21.15.37:0/3145934879 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9e00cb170 msgr2=0x7fa9e0150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:53.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.776+0000 7fa9e5e90700 1 --2- 172.21.15.37:0/3145934879 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9e00cb170 0x7fa9e0150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.776+0000 7fa9e5e90700 1 -- 172.21.15.37:0/3145934879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d80094f0 con 0x7fa9e00cf340 2023-10-06T02:27:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.776+0000 7fa9e4e8e700 1 --2- 172.21.15.37:0/3145934879 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9e00cb170 0x7fa9e0150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.776+0000 7fa9e568f700 1 --2- 172.21.15.37:0/3145934879 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9e00b29d0 0x7fa9e00b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.776+0000 7fa9e5e90700 1 --2- 172.21.15.37:0/3145934879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9e00cf340 0x7fa9e016a1d0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0007f50 tx=0x7fa9d0009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.776+0000 7fa9dd7fa700 1 -- 172.21.15.37:0/3145934879 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d000ecd0 con 0x7fa9e00cf340 2023-10-06T02:27:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.776+0000 7fa9dd7fa700 1 -- 172.21.15.37:0/3145934879 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d000ee50 con 0x7fa9e00cf340 2023-10-06T02:27:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.776+0000 7fa9e6691700 1 -- 172.21.15.37:0/3145934879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e016a710 con 0x7fa9e00cf340 2023-10-06T02:27:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.776+0000 7fa9dd7fa700 1 -- 172.21.15.37:0/3145934879 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d0014670 con 0x7fa9e00cf340 2023-10-06T02:27:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.776+0000 7fa9e6691700 1 -- 172.21.15.37:0/3145934879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e00b5120 con 0x7fa9e00cf340 2023-10-06T02:27:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.777+0000 7fa9e6691700 1 -- 172.21.15.37:0/3145934879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e00884f0 con 0x7fa9e00cf340 2023-10-06T02:27:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.778+0000 7fa9dd7fa700 1 -- 172.21.15.37:0/3145934879 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9d00149e0 con 0x7fa9e00cf340 2023-10-06T02:27:53.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.778+0000 7fa9dd7fa700 1 --2- 172.21.15.37:0/3145934879 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa9cc066f30 0x7fa9cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:53.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.778+0000 7fa9dd7fa700 1 -- 172.21.15.37:0/3145934879 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa9d0084d80 con 0x7fa9e00cf340 2023-10-06T02:27:53.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.778+0000 7fa9e568f700 1 --2- 172.21.15.37:0/3145934879 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa9cc066f30 0x7fa9cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:53.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.779+0000 7fa9e568f700 1 --2- 172.21.15.37:0/3145934879 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa9cc066f30 0x7fa9cc0693e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa9e008ab30 tx=0x7fa9d8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:53.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:53.782+0000 7fa9dd7fa700 1 -- 172.21.15.37:0/3145934879 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9d0051e90 con 0x7fa9e00cf340 2023-10-06T02:27:54.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.053+0000 7fa9e6691700 1 -- 172.21.15.37:0/3145934879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa9e0064b00 con 0x7fa9e00cf340 2023-10-06T02:27:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.057+0000 7fa9dd7fa700 1 -- 172.21.15.37:0/3145934879 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7fa9d00554b0 con 0x7fa9e00cf340 2023-10-06T02:27:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.059+0000 7fa9e6691700 1 -- 172.21.15.37:0/3145934879 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa9cc066f30 msgr2=0x7fa9cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.059+0000 7fa9e6691700 1 --2- 172.21.15.37:0/3145934879 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa9cc066f30 0x7fa9cc0693e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa9e008ab30 tx=0x7fa9d8017000 comp rx=0 tx=0).stop 2023-10-06T02:27:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.059+0000 7fa9e6691700 1 -- 172.21.15.37:0/3145934879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9e00cf340 msgr2=0x7fa9e016a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.059+0000 7fa9e6691700 1 --2- 172.21.15.37:0/3145934879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9e00cf340 0x7fa9e016a1d0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0007f50 tx=0x7fa9d0009860 comp rx=0 tx=0).stop 2023-10-06T02:27:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.059+0000 7fa9e6691700 1 -- 172.21.15.37:0/3145934879 shutdown_connections 2023-10-06T02:27:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.059+0000 7fa9e6691700 1 --2- 172.21.15.37:0/3145934879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9e00cf340 0x7fa9e016a1d0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.059+0000 7fa9e6691700 1 --2- 172.21.15.37:0/3145934879 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9e00b29d0 0x7fa9e00b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.059+0000 7fa9e6691700 1 --2- 172.21.15.37:0/3145934879 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa9cc066f30 0x7fa9cc0693e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.059+0000 7fa9e6691700 1 --2- 172.21.15.37:0/3145934879 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9e00cb170 0x7fa9e0150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.059+0000 7fa9e6691700 1 -- 172.21.15.37:0/3145934879 >> 172.21.15.37:0/3145934879 conn(0x7fa9e0099610 msgr2=0x7fa9e00cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.059+0000 7fa9e6691700 1 -- 172.21.15.37:0/3145934879 shutdown_connections 2023-10-06T02:27:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.059+0000 7fa9e6691700 1 -- 172.21.15.37:0/3145934879 wait complete. 2023-10-06T02:27:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-10-06T02:27:54.073 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:27:54.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.191+0000 7f149aa91700 1 Processor -- start 2023-10-06T02:27:54.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.191+0000 7f149aa91700 1 -- start start 2023-10-06T02:27:54.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.192+0000 7f149aa91700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f14940b1040 0x7f1494157430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:54.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.192+0000 7f149aa91700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14940b1d80 0x7f14940b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:54.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.192+0000 7f149aa91700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14940b1610 con 0x7f1494157060 2023-10-06T02:27:54.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.192+0000 7f149aa91700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14940b18f0 con 0x7f14940b1040 2023-10-06T02:27:54.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.192+0000 7f149aa91700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149415b710 con 0x7f14940b1d80 2023-10-06T02:27:54.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.192+0000 7f149a290700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14940b1d80 0x7f14940b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:54.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.192+0000 7f149928e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f14940b1040 0x7f1494157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:54.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.192+0000 7f1499a8f700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f1494157060 0x7f149415aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:56668/0 (socket says 172.21.15.37:56668) 2023-10-06T02:27:54.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.192+0000 7f149a290700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14940b1d80 0x7f14940b2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:53302/0 (socket says 172.21.15.37:53302) 2023-10-06T02:27:54.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.192+0000 7f1499a8f700 1 -- 172.21.15.37:0/2778033700 learned_addr learned my addr 172.21.15.37:0/2778033700 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:54.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.192+0000 7f149a290700 1 -- 172.21.15.37:0/2778033700 >> v2:172.21.15.191:3300/0 conn(0x7f14940b1040 msgr2=0x7f1494157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:54.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.192+0000 7f149a290700 1 --2- 172.21.15.37:0/2778033700 >> v2:172.21.15.191:3300/0 conn(0x7f14940b1040 0x7f1494157430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.192+0000 7f149a290700 1 -- 172.21.15.37:0/2778033700 >> v1:172.21.15.191:6789/0 conn(0x7f1494157060 legacy=0x7f149415aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.192+0000 7f149a290700 1 -- 172.21.15.37:0/2778033700 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149415b9f0 con 0x7f14940b1d80 2023-10-06T02:27:54.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.192+0000 7f149928e700 1 --2- 172.21.15.37:0/2778033700 >> v2:172.21.15.191:3300/0 conn(0x7f14940b1040 0x7f1494157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:27:54.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.193+0000 7f149a290700 1 --2- 172.21.15.37:0/2778033700 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14940b1d80 0x7f14940b2200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f148c0098e0 tx=0x7f148c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=835e9c9fe38136e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:54.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.193+0000 7f1498a8d700 1 -- 172.21.15.37:0/2778033700 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c00b640 con 0x7f14940b1d80 2023-10-06T02:27:54.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.193+0000 7f1498a8d700 1 -- 172.21.15.37:0/2778033700 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c00b7a0 con 0x7f14940b1d80 2023-10-06T02:27:54.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.193+0000 7f1498a8d700 1 -- 172.21.15.37:0/2778033700 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c00bb40 con 0x7f14940b1d80 2023-10-06T02:27:54.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.193+0000 7f149aa91700 1 -- 172.21.15.37:0/2778033700 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14940b1d80 msgr2=0x7f14940b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.193+0000 7f149aa91700 1 --2- 172.21.15.37:0/2778033700 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14940b1d80 0x7f14940b2200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f148c0098e0 tx=0x7f148c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.193+0000 7f149aa91700 1 -- 172.21.15.37:0/2778033700 shutdown_connections 2023-10-06T02:27:54.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.193+0000 7f149aa91700 1 --2- 172.21.15.37:0/2778033700 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14940b1d80 0x7f14940b2200 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.193+0000 7f149aa91700 1 --2- 172.21.15.37:0/2778033700 >> v2:172.21.15.191:3300/0 conn(0x7f14940b1040 0x7f1494157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.193+0000 7f149aa91700 1 -- 172.21.15.37:0/2778033700 >> 172.21.15.37:0/2778033700 conn(0x7f14940ce280 msgr2=0x7f14940ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:54.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.193+0000 7f149aa91700 1 -- 172.21.15.37:0/2778033700 shutdown_connections 2023-10-06T02:27:54.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.193+0000 7f149aa91700 1 -- 172.21.15.37:0/2778033700 wait complete. 2023-10-06T02:27:54.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.194+0000 7f149aa91700 1 Processor -- start 2023-10-06T02:27:54.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.195+0000 7f149aa91700 1 -- start start 2023-10-06T02:27:54.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.195+0000 7f149aa91700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14940b1040 0x7f14940ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:54.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.195+0000 7f149aa91700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14940b1d80 0x7f149414f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:54.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.195+0000 7f149aa91700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1494157060 0x7f1494154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:54.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.195+0000 7f149aa91700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149416bf80 con 0x7f1494157060 2023-10-06T02:27:54.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.195+0000 7f149aa91700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14940aea40 con 0x7f14940b1d80 2023-10-06T02:27:54.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.195+0000 7f149aa91700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149416b370 con 0x7f14940b1040 2023-10-06T02:27:54.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.195+0000 7f149a290700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1494157060 0x7f1494154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:54.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.195+0000 7f149a290700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1494157060 0x7f1494154990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53132/0 (socket says 172.21.15.37:53132) 2023-10-06T02:27:54.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.195+0000 7f149a290700 1 -- 172.21.15.37:0/3105153207 learned_addr learned my addr 172.21.15.37:0/3105153207 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:54.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.196+0000 7f149928e700 1 --2- 172.21.15.37:0/3105153207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14940b1d80 0x7f149414f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:54.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.196+0000 7f1499a8f700 1 --2- 172.21.15.37:0/3105153207 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14940b1040 0x7f14940ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:54.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.196+0000 7f149a290700 1 -- 172.21.15.37:0/3105153207 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14940b1040 msgr2=0x7f14940ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.196+0000 7f149a290700 1 --2- 172.21.15.37:0/3105153207 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14940b1040 0x7f14940ae500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.196+0000 7f149a290700 1 -- 172.21.15.37:0/3105153207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14940b1d80 msgr2=0x7f149414f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.196+0000 7f149a290700 1 --2- 172.21.15.37:0/3105153207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14940b1d80 0x7f149414f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.196+0000 7f149a290700 1 -- 172.21.15.37:0/3105153207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1488009420 con 0x7f1494157060 2023-10-06T02:27:54.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.196+0000 7f149a290700 1 --2- 172.21.15.37:0/3105153207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1494157060 0x7f1494154990 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f149415b850 tx=0x7f148c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:54.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.196+0000 7f1491ffb700 1 -- 172.21.15.37:0/3105153207 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c01be40 con 0x7f1494157060 2023-10-06T02:27:54.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.196+0000 7f1491ffb700 1 -- 172.21.15.37:0/3105153207 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c011630 con 0x7f1494157060 2023-10-06T02:27:54.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.196+0000 7f149aa91700 1 -- 172.21.15.37:0/3105153207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148c009420 con 0x7f1494157060 2023-10-06T02:27:54.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.196+0000 7f1491ffb700 1 -- 172.21.15.37:0/3105153207 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0119f0 con 0x7f1494157060 2023-10-06T02:27:54.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.196+0000 7f149aa91700 1 -- 172.21.15.37:0/3105153207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149416b930 con 0x7f1494157060 2023-10-06T02:27:54.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.197+0000 7f149aa91700 1 -- 172.21.15.37:0/3105153207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14940af530 con 0x7f1494157060 2023-10-06T02:27:54.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.198+0000 7f1491ffb700 1 -- 172.21.15.37:0/3105153207 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f148c02e440 con 0x7f1494157060 2023-10-06T02:27:54.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.198+0000 7f1491ffb700 1 --2- 172.21.15.37:0/3105153207 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1480066f30 0x7f14800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:54.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.198+0000 7f1491ffb700 1 -- 172.21.15.37:0/3105153207 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f148c086320 con 0x7f1494157060 2023-10-06T02:27:54.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.198+0000 7f1499a8f700 1 --2- 172.21.15.37:0/3105153207 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1480066f30 0x7f14800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:54.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.199+0000 7f1499a8f700 1 --2- 172.21.15.37:0/3105153207 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1480066f30 0x7f14800693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f14840021c0 tx=0x7f1484009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:54.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.203+0000 7f1491ffb700 1 -- 172.21.15.37:0/3105153207 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f148c053430 con 0x7f1494157060 2023-10-06T02:27:54.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.439+0000 7f149aa91700 1 -- 172.21.15.37:0/3105153207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f149415bcd0 con 0x7f1494157060 2023-10-06T02:27:54.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.440+0000 7f1491ffb700 1 -- 172.21.15.37:0/3105153207 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f148c056a50 con 0x7f1494157060 2023-10-06T02:27:54.441 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:27:54.441 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3055524642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3055524642},{"type":"v1","addr":"172.21.15.37:6835","nonce":3055524642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2821947660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2821947660},{"type":"v1","addr":"172.21.15.191:6836","nonce":2821947660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6453,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4246185831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4246185831},{"type":"v1","addr":"172.21.15.37:6834","nonce":4246185831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:27:43.200836+0000","modified":"2023-10-06T02:27:46.838015+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6465},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6465":{"gid":6465,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6837/2764715102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2764715102},{"type":"v1","addr":"172.21.15.191:6837","nonce":2764715102}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:27:54.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.442+0000 7f149aa91700 1 -- 172.21.15.37:0/3105153207 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1480066f30 msgr2=0x7f14800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.442+0000 7f149aa91700 1 --2- 172.21.15.37:0/3105153207 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1480066f30 0x7f14800693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f14840021c0 tx=0x7f1484009040 comp rx=0 tx=0).stop 2023-10-06T02:27:54.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.442+0000 7f149aa91700 1 -- 172.21.15.37:0/3105153207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1494157060 msgr2=0x7f1494154990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.442+0000 7f149aa91700 1 --2- 172.21.15.37:0/3105153207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1494157060 0x7f1494154990 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f149415b850 tx=0x7f148c017000 comp rx=0 tx=0).stop 2023-10-06T02:27:54.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.442+0000 7f149aa91700 1 -- 172.21.15.37:0/3105153207 shutdown_connections 2023-10-06T02:27:54.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.442+0000 7f149aa91700 1 --2- 172.21.15.37:0/3105153207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1494157060 0x7f1494154990 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.442+0000 7f149aa91700 1 --2- 172.21.15.37:0/3105153207 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14940b1040 0x7f14940ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.442+0000 7f149aa91700 1 --2- 172.21.15.37:0/3105153207 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1480066f30 0x7f14800693e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.442+0000 7f149aa91700 1 --2- 172.21.15.37:0/3105153207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14940b1d80 0x7f149414f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.442+0000 7f149aa91700 1 -- 172.21.15.37:0/3105153207 >> 172.21.15.37:0/3105153207 conn(0x7f14940ce280 msgr2=0x7f1494152d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:54.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.442+0000 7f149aa91700 1 -- 172.21.15.37:0/3105153207 shutdown_connections 2023-10-06T02:27:54.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.442+0000 7f149aa91700 1 -- 172.21.15.37:0/3105153207 wait complete. 2023-10-06T02:27:54.445 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 47 2023-10-06T02:27:54.857 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:27:43.200836+0000', 'modified': '2023-10-06T02:27:46.838015+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6465}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6465': {'gid': 6465, 'name': 'd', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.191:6837/2764715102', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6834', 'nonce': 2764715102}, {'type': 'v1', 'addr': '172.21.15.191:6837', 'nonce': 2764715102}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:27:54.858 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:27:54.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T02:27:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.981+0000 7f06ddb17700 1 Processor -- start 2023-10-06T02:27:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.981+0000 7f06ddb17700 1 -- start start 2023-10-06T02:27:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.982+0000 7f06ddb17700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06d80af630 0x7f06d806a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.982+0000 7f06ddb17700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d815d460 con 0x7f06d815deb0 2023-10-06T02:27:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.982+0000 7f06ddb17700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d815e350 con 0x7f06d806c5d0 2023-10-06T02:27:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.982+0000 7f06ddb17700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d815a990 con 0x7f06d80af630 2023-10-06T02:27:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.982+0000 7f06d6ffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f06d815deb0 0x7f06d80aef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47798/0 (socket says 172.21.15.37:47798) 2023-10-06T02:27:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.982+0000 7f06d6ffd700 1 -- 172.21.15.37:0/291328004 learned_addr learned my addr 172.21.15.37:0/291328004 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:27:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.982+0000 7f06d7fff700 1 --2- 172.21.15.37:0/291328004 >> v2:172.21.15.37:3300/0 conn(0x7f06d80af630 0x7f06d806a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.982+0000 7f06d67fc700 1 -- 172.21.15.37:0/291328004 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386177136 0 0) 0x7f06d815d460 con 0x7f06d815deb0 2023-10-06T02:27:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.982+0000 7f06d67fc700 1 -- 172.21.15.37:0/291328004 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06c0003570 con 0x7f06d815deb0 2023-10-06T02:27:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.982+0000 7f06d7fff700 1 -- 172.21.15.37:0/291328004 >> v1:172.21.15.191:6789/0 conn(0x7f06d806c5d0 legacy=0x7f06d8159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.982+0000 7f06d7fff700 1 -- 172.21.15.37:0/291328004 >> v1:172.21.15.37:6789/0 conn(0x7f06d815deb0 legacy=0x7f06d80aef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.982+0000 7f06d7fff700 1 -- 172.21.15.37:0/291328004 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d815ac70 con 0x7f06d80af630 2023-10-06T02:27:54.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.982+0000 7f06d7fff700 1 --2- 172.21.15.37:0/291328004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d80af630 0x7f06d806a5e0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009e60 tx=0x7f06d0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7650c39f8774ec36 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:54.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.982+0000 7f06d67fc700 1 -- 172.21.15.37:0/291328004 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d000e070 con 0x7f06d80af630 2023-10-06T02:27:54.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.982+0000 7f06d67fc700 1 -- 172.21.15.37:0/291328004 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d000bb60 con 0x7f06d80af630 2023-10-06T02:27:54.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.982+0000 7f06d67fc700 1 -- 172.21.15.37:0/291328004 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0012430 con 0x7f06d80af630 2023-10-06T02:27:54.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.983+0000 7f06ddb17700 1 -- 172.21.15.37:0/291328004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d80af630 msgr2=0x7f06d806a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.983+0000 7f06ddb17700 1 --2- 172.21.15.37:0/291328004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d80af630 0x7f06d806a5e0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009e60 tx=0x7f06d0009780 comp rx=0 tx=0).stop 2023-10-06T02:27:54.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.983+0000 7f06ddb17700 1 -- 172.21.15.37:0/291328004 shutdown_connections 2023-10-06T02:27:54.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.983+0000 7f06ddb17700 1 --2- 172.21.15.37:0/291328004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d80af630 0x7f06d806a5e0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.983+0000 7f06ddb17700 1 -- 172.21.15.37:0/291328004 >> 172.21.15.37:0/291328004 conn(0x7f06d806dc40 msgr2=0x7f06d8067660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:54.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.983+0000 7f06ddb17700 1 -- 172.21.15.37:0/291328004 shutdown_connections 2023-10-06T02:27:54.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.983+0000 7f06ddb17700 1 -- 172.21.15.37:0/291328004 wait complete. 2023-10-06T02:27:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.984+0000 7f06ddb17700 1 Processor -- start 2023-10-06T02:27:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.984+0000 7f06ddb17700 1 -- start start 2023-10-06T02:27:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.985+0000 7f06ddb17700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d806c5d0 0x7f06d816a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.985+0000 7f06ddb17700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06d80af630 0x7f06d8146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.985+0000 7f06ddb17700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06d815deb0 0x7f06d80acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.985+0000 7f06ddb17700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d816aa70 con 0x7f06d806c5d0 2023-10-06T02:27:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.985+0000 7f06ddb17700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d8148090 con 0x7f06d80af630 2023-10-06T02:27:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.985+0000 7f06ddb17700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d816d1c0 con 0x7f06d815deb0 2023-10-06T02:27:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.985+0000 7f06d77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d806c5d0 0x7f06d816a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.985+0000 7f06d77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d806c5d0 0x7f06d816a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53142/0 (socket says 172.21.15.37:53142) 2023-10-06T02:27:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.985+0000 7f06d77fe700 1 -- 172.21.15.37:0/1178601995 learned_addr learned my addr 172.21.15.37:0/1178601995 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.985+0000 7f06d77fe700 1 -- 172.21.15.37:0/1178601995 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06d815deb0 msgr2=0x7f06d80acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.985+0000 7f06d77fe700 1 --2- 172.21.15.37:0/1178601995 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06d815deb0 0x7f06d80acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.985+0000 7f06d77fe700 1 -- 172.21.15.37:0/1178601995 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06d80af630 msgr2=0x7f06d8146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.985+0000 7f06d77fe700 1 --2- 172.21.15.37:0/1178601995 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06d80af630 0x7f06d8146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.985+0000 7f06d77fe700 1 -- 172.21.15.37:0/1178601995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d0009a20 con 0x7f06d806c5d0 2023-10-06T02:27:54.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.986+0000 7f06d77fe700 1 --2- 172.21.15.37:0/1178601995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d806c5d0 0x7f06d816a530 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00c5c0 tx=0x7f06cc00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:54.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.986+0000 7f06bf7fe700 1 -- 172.21.15.37:0/1178601995 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc011590 con 0x7f06d806c5d0 2023-10-06T02:27:54.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.986+0000 7f06bf7fe700 1 -- 172.21.15.37:0/1178601995 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06cc011710 con 0x7f06d806c5d0 2023-10-06T02:27:54.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.986+0000 7f06ddb17700 1 -- 172.21.15.37:0/1178601995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d816d4a0 con 0x7f06d806c5d0 2023-10-06T02:27:54.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.986+0000 7f06bf7fe700 1 -- 172.21.15.37:0/1178601995 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc011ad0 con 0x7f06d806c5d0 2023-10-06T02:27:54.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.986+0000 7f06ddb17700 1 -- 172.21.15.37:0/1178601995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d816da60 con 0x7f06d806c5d0 2023-10-06T02:27:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.988+0000 7f06bf7fe700 1 -- 172.21.15.37:0/1178601995 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f06cc012420 con 0x7f06d806c5d0 2023-10-06T02:27:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.988+0000 7f06bf7fe700 1 --2- 172.21.15.37:0/1178601995 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f06c4066f30 0x7f06c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.988+0000 7f06bf7fe700 1 -- 172.21.15.37:0/1178601995 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f06cc083a30 con 0x7f06d806c5d0 2023-10-06T02:27:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.988+0000 7f06d6ffd700 1 --2- 172.21.15.37:0/1178601995 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f06c4066f30 0x7f06c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.989+0000 7f06d6ffd700 1 --2- 172.21.15.37:0/1178601995 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f06c4066f30 0x7f06c40693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f06c80058d0 tx=0x7f06c80079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.990+0000 7f06e6e0fb80 1 Processor -- start 2023-10-06T02:27:54.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.990+0000 7f06e6e0fb80 1 -- start start 2023-10-06T02:27:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06e6e0fb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fb91a1e840 0x55fb91a1ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06e6e0fb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb91a1fcc0 0x55fb91a6e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06e6e0fb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a6ec00 0x55fb91a6f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06e6e0fb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb91975a70 con 0x55fb91a6ec00 2023-10-06T02:27:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06e6e0fb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb91973270 con 0x55fb91a1fcc0 2023-10-06T02:27:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06e6e0fb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb9196f060 con 0x55fb91a1e840 2023-10-06T02:27:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06d7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a6ec00 0x55fb91a6f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06d77fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fb91a1e840 0x55fb91a1ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06d6ffd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb91a1fcc0 0x55fb91a6e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06d7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a6ec00 0x55fb91a6f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53156/0 (socket says 172.21.15.37:53156) 2023-10-06T02:27:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06d7fff700 1 -- 172.21.15.37:0/1562246311 learned_addr learned my addr 172.21.15.37:0/1562246311 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06d77fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fb91a1e840 0x55fb91a1ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:53336/0 (socket says 172.21.15.37:53336) 2023-10-06T02:27:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06d7fff700 1 -- 172.21.15.37:0/1562246311 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fb91a1e840 msgr2=0x55fb91a1ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06d7fff700 1 --2- 172.21.15.37:0/1562246311 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fb91a1e840 0x55fb91a1ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06d7fff700 1 -- 172.21.15.37:0/1562246311 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb91a1fcc0 msgr2=0x55fb91a6e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06d7fff700 1 --2- 172.21.15.37:0/1562246311 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb91a1fcc0 0x55fb91a6e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06d7fff700 1 -- 172.21.15.37:0/1562246311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb91809270 con 0x55fb91a6ec00 2023-10-06T02:27:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06d7fff700 1 --2- 172.21.15.37:0/1562246311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a6ec00 0x55fb91a6f050 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f06d000b6c0 tx=0x7f06d0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d64cb5e1334849f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06bcff9700 1 -- 172.21.15.37:0/1562246311 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0009880 con 0x55fb91a6ec00 2023-10-06T02:27:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06bcff9700 1 -- 172.21.15.37:0/1562246311 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d000bcd0 con 0x55fb91a6ec00 2023-10-06T02:27:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.991+0000 7f06bcff9700 1 -- 172.21.15.37:0/1562246311 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0012a40 con 0x55fb91a6ec00 2023-10-06T02:27:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.992+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/1562246311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a6ec00 msgr2=0x55fb91a6f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.992+0000 7f06e6e0fb80 1 --2- 172.21.15.37:0/1562246311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a6ec00 0x55fb91a6f050 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f06d000b6c0 tx=0x7f06d0019000 comp rx=0 tx=0).stop 2023-10-06T02:27:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.992+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/1562246311 shutdown_connections 2023-10-06T02:27:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.992+0000 7f06e6e0fb80 1 --2- 172.21.15.37:0/1562246311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a6ec00 0x55fb91a6f050 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.992+0000 7f06e6e0fb80 1 --2- 172.21.15.37:0/1562246311 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fb91a1e840 0x55fb91a1ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.992+0000 7f06e6e0fb80 1 --2- 172.21.15.37:0/1562246311 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb91a1fcc0 0x55fb91a6e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.992+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/1562246311 >> 172.21.15.37:0/1562246311 conn(0x55fb91a20160 msgr2=0x55fb91a20530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.992+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/1562246311 shutdown_connections 2023-10-06T02:27:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.992+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/1562246311 wait complete. 2023-10-06T02:27:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.993+0000 7f06e6e0fb80 1 -- start start 2023-10-06T02:27:55.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.993+0000 7f06e6e0fb80 1 Processor -- start 2023-10-06T02:27:55.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06e6e0fb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fb91a1e840 0x55fb91a4b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06e6e0fb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a1fcc0 0x55fb91a4d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06e6e0fb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb91a6ec00 0x55fb91a4dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06e6e0fb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9191a890 con 0x55fb91a1fcc0 2023-10-06T02:27:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06e6e0fb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb91935ea0 con 0x55fb91a6ec00 2023-10-06T02:27:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06e6e0fb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb917f1e30 con 0x55fb91a1e840 2023-10-06T02:27:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06e6e0fb80 10 client.0 _ll_register_callbacks cb 0x55fb919e1e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:27:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06d6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a1fcc0 0x55fb91a4d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06d6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a1fcc0 0x55fb91a4d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53162/0 (socket says 172.21.15.37:53162) 2023-10-06T02:27:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06d6ffd700 1 -- 172.21.15.37:0/1369074846 learned_addr learned my addr 172.21.15.37:0/1369074846 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06d77fe700 1 --2- 172.21.15.37:0/1369074846 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fb91a1e840 0x55fb91a4b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06d7fff700 1 --2- 172.21.15.37:0/1369074846 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb91a6ec00 0x55fb91a4dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06d6ffd700 1 -- 172.21.15.37:0/1369074846 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fb91a1e840 msgr2=0x55fb91a4b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06d6ffd700 1 --2- 172.21.15.37:0/1369074846 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fb91a1e840 0x55fb91a4b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06d6ffd700 1 -- 172.21.15.37:0/1369074846 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb91a6ec00 msgr2=0x55fb91a4dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06d6ffd700 1 --2- 172.21.15.37:0/1369074846 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb91a6ec00 0x55fb91a4dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06d6ffd700 1 -- 172.21.15.37:0/1369074846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d815ac70 con 0x55fb91a1fcc0 2023-10-06T02:27:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06d7fff700 1 --2- 172.21.15.37:0/1369074846 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb91a6ec00 0x55fb91a4dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06d6ffd700 1 --2- 172.21.15.37:0/1369074846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a1fcc0 0x55fb91a4d780 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f06d80b2230 tx=0x7f06c8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c9388e421dbd5e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06b5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:27:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06b5ffb700 1 -- 172.21.15.37:0/1369074846 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c801b050 con 0x55fb91a1fcc0 2023-10-06T02:27:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06b5ffb700 1 -- 172.21.15.37:0/1369074846 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f06c8021460 con 0x55fb91a1fcc0 2023-10-06T02:27:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.994+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/1369074846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb91a13940 con 0x55fb91a1fcc0 2023-10-06T02:27:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.995+0000 7f06b5ffb700 1 -- 172.21.15.37:0/1369074846 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06c8015e70 con 0x55fb91a1fcc0 2023-10-06T02:27:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.995+0000 7f06e6e0fb80 10 client.6636 fetch_fsmap learned FSMap version 47 2023-10-06T02:27:55.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.995+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/1369074846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x55fb917abfe0 con 0x55fb91a1fcc0 2023-10-06T02:27:55.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.995+0000 7f06b5ffb700 1 -- 172.21.15.37:0/1369074846 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fb91a13940 con 0x55fb91a1fcc0 2023-10-06T02:27:55.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.995+0000 7f06b5ffb700 1 -- 172.21.15.37:0/1369074846 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 47) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f06c8021830 con 0x55fb91a1fcc0 2023-10-06T02:27:55.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.995+0000 7f06e6e0fb80 10 client.6636 fetch_fsmap finished waiting for FSMap version 47 2023-10-06T02:27:55.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.995+0000 7f06e6e0fb80 10 client.6636 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T02:27:55.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.995+0000 7f06e6e0fb80 20 client.6636 populate_metadata read hostname 'smithi037' 2023-10-06T02:27:55.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.995+0000 7f06e6e0fb80 1 --2- 172.21.15.37:0/1369074846 >> [v2:172.21.15.191:6834/2764715102,v1:172.21.15.191:6837/2764715102] conn(0x55fb91a49cd0 0x55fb91a788f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.995+0000 7f06e6e0fb80 4 client.6636 mds_command: new command op to 6465 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:27:55.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.995+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/1369074846 --> [v2:172.21.15.191:6834/2764715102,v1:172.21.15.191:6837/2764715102] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fb919f0870 con 0x55fb91a49cd0 2023-10-06T02:27:55.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.995+0000 7f06d77fe700 1 --2- 172.21.15.37:0/1369074846 >> [v2:172.21.15.191:6834/2764715102,v1:172.21.15.191:6837/2764715102] conn(0x55fb91a49cd0 0x55fb91a788f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.996+0000 7f06b5ffb700 10 client.6636 ms_handle_connect on v2:172.21.15.191:6834/2764715102 2023-10-06T02:27:55.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.996+0000 7f06d77fe700 1 --2- 172.21.15.37:0/1369074846 >> [v2:172.21.15.191:6834/2764715102,v1:172.21.15.191:6837/2764715102] conn(0x55fb91a49cd0 0x55fb91a788f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7344ced987bed5da server_cookie=a77b9579a7391a9b in_seq=0 out_seq=0 2023-10-06T02:27:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.996+0000 7f06b5ffb700 1 -- 172.21.15.37:0/1369074846 <== mds.0 v2:172.21.15.191:6834/2764715102 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55fb919f0870 con 0x55fb91a49cd0 2023-10-06T02:27:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.996+0000 7f06b5ffb700 10 client.6636 handle_command_reply: tid=0 2023-10-06T02:27:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.996+0000 7f06e6e0fb80 1 client.6636 shutdown 2023-10-06T02:27:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.997+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/1369074846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a1fcc0 msgr2=0x55fb91a4d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.997+0000 7f06e6e0fb80 1 --2- 172.21.15.37:0/1369074846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a1fcc0 0x55fb91a4d780 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f06d80b2230 tx=0x7f06c8011000 comp rx=0 tx=0).stop 2023-10-06T02:27:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.997+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/1369074846 shutdown_connections 2023-10-06T02:27:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.997+0000 7f06e6e0fb80 1 --2- 172.21.15.37:0/1369074846 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb91a6ec00 0x55fb91a4dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.997+0000 7f06e6e0fb80 1 --2- 172.21.15.37:0/1369074846 >> [v2:172.21.15.191:6834/2764715102,v1:172.21.15.191:6837/2764715102] conn(0x55fb91a49cd0 0x55fb91a788f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.997+0000 7f06e6e0fb80 1 --2- 172.21.15.37:0/1369074846 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fb91a1e840 0x55fb91a4b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.997+0000 7f06e6e0fb80 1 --2- 172.21.15.37:0/1369074846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a1fcc0 0x55fb91a4d780 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.997+0000 7f06b5ffb700 0 client.6636 ms_handle_reset on v2:172.21.15.191:6834/2764715102 2023-10-06T02:27:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.997+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/1369074846 >> 172.21.15.37:0/1369074846 conn(0x55fb91a20160 msgr2=0x55fb91a1f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:55.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.997+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/1369074846 shutdown_connections 2023-10-06T02:27:55.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.997+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/1369074846 wait complete. 2023-10-06T02:27:55.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:54.997+0000 7f06e6e0fb80 20 client.6636 trim_cache size 0 max 16384 2023-10-06T02:27:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.014+0000 7f06e6e0fb80 1 Processor -- start 2023-10-06T02:27:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.014+0000 7f06e6e0fb80 1 -- start start 2023-10-06T02:27:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.014+0000 7f06e6e0fb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a1e840 0x55fb91a1bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.014+0000 7f06e6e0fb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fb91a1fcc0 0x55fb91a4bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.014+0000 7f06e6e0fb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb91a6ec00 0x55fb91a4d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.014+0000 7f06e6e0fb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb91a4a220 con 0x55fb91a1e840 2023-10-06T02:27:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.014+0000 7f06e6e0fb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb919fe2e0 con 0x55fb91a6ec00 2023-10-06T02:27:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.014+0000 7f06e6e0fb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb91a4afe0 con 0x55fb91a1fcc0 2023-10-06T02:27:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.014+0000 7f06d77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a1e840 0x55fb91a1bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.014+0000 7f06d77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a1e840 0x55fb91a1bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53176/0 (socket says 172.21.15.37:53176) 2023-10-06T02:27:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.014+0000 7f06d77fe700 1 -- 172.21.15.37:0/3837264809 learned_addr learned my addr 172.21.15.37:0/3837264809 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.015+0000 7f06d77fe700 1 -- 172.21.15.37:0/3837264809 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fb91a1fcc0 msgr2=0x55fb91a4bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.015+0000 7f06d77fe700 1 --2- 172.21.15.37:0/3837264809 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fb91a1fcc0 0x55fb91a4bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.015+0000 7f06d77fe700 1 -- 172.21.15.37:0/3837264809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb91a6ec00 msgr2=0x55fb91a4d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.015+0000 7f06d77fe700 1 --2- 172.21.15.37:0/3837264809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb91a6ec00 0x55fb91a4d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.015+0000 7f06d77fe700 1 -- 172.21.15.37:0/3837264809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb91a1eee0 con 0x55fb91a1e840 2023-10-06T02:27:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.015+0000 7f06d77fe700 1 --2- 172.21.15.37:0/3837264809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a1e840 0x55fb91a1bcf0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f06cc054840 tx=0x7f06cc06c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a97775991dda613 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.015+0000 7f06bd7fa700 1 -- 172.21.15.37:0/3837264809 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc06a040 con 0x55fb91a1e840 2023-10-06T02:27:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.015+0000 7f06bd7fa700 1 -- 172.21.15.37:0/3837264809 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06cc011ee0 con 0x55fb91a1e840 2023-10-06T02:27:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.015+0000 7f06bd7fa700 1 -- 172.21.15.37:0/3837264809 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc052a50 con 0x55fb91a1e840 2023-10-06T02:27:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.015+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/3837264809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a1e840 msgr2=0x55fb91a1bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.015+0000 7f06e6e0fb80 1 --2- 172.21.15.37:0/3837264809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a1e840 0x55fb91a1bcf0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f06cc054840 tx=0x7f06cc06c040 comp rx=0 tx=0).stop 2023-10-06T02:27:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.015+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/3837264809 shutdown_connections 2023-10-06T02:27:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.015+0000 7f06e6e0fb80 1 --2- 172.21.15.37:0/3837264809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb91a6ec00 0x55fb91a4d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.015+0000 7f06e6e0fb80 1 --2- 172.21.15.37:0/3837264809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a1e840 0x55fb91a1bcf0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.015+0000 7f06e6e0fb80 1 --2- 172.21.15.37:0/3837264809 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fb91a1fcc0 0x55fb91a4bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.015+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/3837264809 >> 172.21.15.37:0/3837264809 conn(0x55fb91a20160 msgr2=0x55fb91a17280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.015+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/3837264809 shutdown_connections 2023-10-06T02:27:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.015+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/3837264809 wait complete. 2023-10-06T02:27:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.016+0000 7f06e6e0fb80 1 -- start start 2023-10-06T02:27:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.016+0000 7f06e6e0fb80 1 Processor -- start 2023-10-06T02:27:55.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06e6e0fb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fb91a1e840 0x55fb91ac7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06e6e0fb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb91a1fcc0 0x55fb91a7e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06e6e0fb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a6ec00 0x55fb91a7ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06e6e0fb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb91a646c0 con 0x55fb91a6ec00 2023-10-06T02:27:55.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06e6e0fb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb91acb7b0 con 0x55fb91a1fcc0 2023-10-06T02:27:55.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06e6e0fb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb91ac8420 con 0x55fb91a1e840 2023-10-06T02:27:55.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06e6e0fb80 10 client.0 _ll_register_callbacks cb 0x55fb919e1e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:27:55.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06d7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a6ec00 0x55fb91a7ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06d7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a6ec00 0x55fb91a7ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53190/0 (socket says 172.21.15.37:53190) 2023-10-06T02:27:55.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06d7fff700 1 -- 172.21.15.37:0/38714428 learned_addr learned my addr 172.21.15.37:0/38714428 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:55.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06d77fe700 1 --2- 172.21.15.37:0/38714428 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fb91a1e840 0x55fb91ac7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06d6ffd700 1 --2- 172.21.15.37:0/38714428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb91a1fcc0 0x55fb91a7e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06d7fff700 1 -- 172.21.15.37:0/38714428 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fb91a1e840 msgr2=0x55fb91ac7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:55.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06d7fff700 1 --2- 172.21.15.37:0/38714428 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fb91a1e840 0x55fb91ac7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06d7fff700 1 -- 172.21.15.37:0/38714428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb91a1fcc0 msgr2=0x55fb91a7e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:55.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06d7fff700 1 --2- 172.21.15.37:0/38714428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb91a1fcc0 0x55fb91a7e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06d7fff700 1 -- 172.21.15.37:0/38714428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d816da60 con 0x55fb91a6ec00 2023-10-06T02:27:55.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06d7fff700 1 --2- 172.21.15.37:0/38714428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a6ec00 0x55fb91a7ee60 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f06d0000f80 tx=0x7f06d0020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df17707e7b5ab564 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06b5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:27:55.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06b5ffb700 1 -- 172.21.15.37:0/38714428 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d002c070 con 0x55fb91a6ec00 2023-10-06T02:27:55.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06b5ffb700 1 -- 172.21.15.37:0/38714428 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f06d000be40 con 0x55fb91a6ec00 2023-10-06T02:27:55.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.017+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/38714428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f06d000bcd0 con 0x55fb91a6ec00 2023-10-06T02:27:55.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.018+0000 7f06b5ffb700 1 -- 172.21.15.37:0/38714428 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06d0009420 con 0x55fb91a6ec00 2023-10-06T02:27:55.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.018+0000 7f06e6e0fb80 10 client.6642 fetch_fsmap learned FSMap version 47 2023-10-06T02:27:55.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.018+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/38714428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x55fb9193d780 con 0x55fb91a6ec00 2023-10-06T02:27:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.018+0000 7f06b5ffb700 1 -- 172.21.15.37:0/38714428 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d000bcd0 con 0x55fb91a6ec00 2023-10-06T02:27:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.018+0000 7f06b5ffb700 1 -- 172.21.15.37:0/38714428 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 47) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f06d001e630 con 0x55fb91a6ec00 2023-10-06T02:27:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.018+0000 7f06e6e0fb80 10 client.6642 fetch_fsmap finished waiting for FSMap version 47 2023-10-06T02:27:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.018+0000 7f06e6e0fb80 10 client.6642 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T02:27:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.018+0000 7f06e6e0fb80 20 client.6642 populate_metadata read hostname 'smithi037' 2023-10-06T02:27:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.018+0000 7f06e6e0fb80 1 --2- 172.21.15.37:0/38714428 >> [v2:172.21.15.191:6834/2764715102,v1:172.21.15.191:6837/2764715102] conn(0x55fb91a6cb30 0x55fb91a6cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.018+0000 7f06e6e0fb80 4 client.6642 mds_command: new command op to 6465 tid=0[{"prefix": "status"}] 2023-10-06T02:27:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.018+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/38714428 --> [v2:172.21.15.191:6834/2764715102,v1:172.21.15.191:6837/2764715102] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fb91911e00 con 0x55fb91a6cb30 2023-10-06T02:27:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.018+0000 7f06d77fe700 1 --2- 172.21.15.37:0/38714428 >> [v2:172.21.15.191:6834/2764715102,v1:172.21.15.191:6837/2764715102] conn(0x55fb91a6cb30 0x55fb91a6cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.018+0000 7f06b5ffb700 10 client.6642 ms_handle_connect on v2:172.21.15.191:6834/2764715102 2023-10-06T02:27:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.018+0000 7f06d77fe700 1 --2- 172.21.15.37:0/38714428 >> [v2:172.21.15.191:6834/2764715102,v1:172.21.15.191:6837/2764715102] conn(0x55fb91a6cb30 0x55fb91a6cf00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da88b5132065d9 server_cookie=6b758e5737d3609e in_seq=0 out_seq=0 2023-10-06T02:27:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.019+0000 7f06b5ffb700 1 -- 172.21.15.37:0/38714428 <== mds.0 v2:172.21.15.191:6834/2764715102 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55fb91911e00 con 0x55fb91a6cb30 2023-10-06T02:27:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.019+0000 7f06b5ffb700 10 client.6642 handle_command_reply: tid=0 2023-10-06T02:27:55.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.019+0000 7f06e6e0fb80 1 client.6642 shutdown 2023-10-06T02:27:55.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.019+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/38714428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a6ec00 msgr2=0x55fb91a7ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.019+0000 7f06e6e0fb80 1 --2- 172.21.15.37:0/38714428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a6ec00 0x55fb91a7ee60 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f06d0000f80 tx=0x7f06d0020070 comp rx=0 tx=0).stop 2023-10-06T02:27:55.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.019+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/38714428 shutdown_connections 2023-10-06T02:27:55.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.019+0000 7f06e6e0fb80 1 --2- 172.21.15.37:0/38714428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb91a6ec00 0x55fb91a7ee60 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.019+0000 7f06e6e0fb80 1 --2- 172.21.15.37:0/38714428 >> [v2:172.21.15.191:6834/2764715102,v1:172.21.15.191:6837/2764715102] conn(0x55fb91a6cb30 0x55fb91a6cf00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.019+0000 7f06e6e0fb80 1 --2- 172.21.15.37:0/38714428 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fb91a1e840 0x55fb91ac7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.019+0000 7f06e6e0fb80 1 --2- 172.21.15.37:0/38714428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fb91a1fcc0 0x55fb91a7e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.019+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/38714428 >> 172.21.15.37:0/38714428 conn(0x55fb91a20160 msgr2=0x55fb91a1bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:55.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.019+0000 7f06b5ffb700 0 client.6642 ms_handle_reset on v2:172.21.15.191:6834/2764715102 2023-10-06T02:27:55.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.019+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/38714428 shutdown_connections 2023-10-06T02:27:55.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.019+0000 7f06e6e0fb80 1 -- 172.21.15.37:0/38714428 wait complete. 2023-10-06T02:27:55.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.019+0000 7f06e6e0fb80 20 client.6642 trim_cache size 0 max 16384 2023-10-06T02:27:55.027 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:27:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "d1f292a2-fd8c-430a-be88-f44de408e77c", 2023-10-06T02:27:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-10-06T02:27:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6465, 2023-10-06T02:27:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-10-06T02:27:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-10-06T02:27:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-10-06T02:27:55.028 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 11.22452899, 2023-10-06T02:27:55.028 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 47, 2023-10-06T02:27:55.028 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 72, 2023-10-06T02:27:55.028 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 72, 2023-10-06T02:27:55.028 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 17.289487331 2023-10-06T02:27:55.028 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:27:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.019+0000 7f06ddb17700 1 -- 172.21.15.37:0/1178601995 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f06c4066f30 msgr2=0x7f06c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.019+0000 7f06ddb17700 1 --2- 172.21.15.37:0/1178601995 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f06c4066f30 0x7f06c40693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f06c80058d0 tx=0x7f06c80079d0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.019+0000 7f06ddb17700 1 -- 172.21.15.37:0/1178601995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d806c5d0 msgr2=0x7f06d816a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.019+0000 7f06ddb17700 1 --2- 172.21.15.37:0/1178601995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d806c5d0 0x7f06d816a530 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00c5c0 tx=0x7f06cc00c980 comp rx=0 tx=0).stop 2023-10-06T02:27:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.020+0000 7f06ddb17700 1 -- 172.21.15.37:0/1178601995 shutdown_connections 2023-10-06T02:27:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.020+0000 7f06ddb17700 1 --2- 172.21.15.37:0/1178601995 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06d815deb0 0x7f06d80acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.020+0000 7f06ddb17700 1 --2- 172.21.15.37:0/1178601995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d806c5d0 0x7f06d816a530 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.020+0000 7f06ddb17700 1 --2- 172.21.15.37:0/1178601995 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f06c4066f30 0x7f06c40693e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.020+0000 7f06ddb17700 1 --2- 172.21.15.37:0/1178601995 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06d80af630 0x7f06d8146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.020+0000 7f06ddb17700 1 -- 172.21.15.37:0/1178601995 >> 172.21.15.37:0/1178601995 conn(0x7f06d806dc40 msgr2=0x7f06d80cbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.020+0000 7f06ddb17700 1 -- 172.21.15.37:0/1178601995 shutdown_connections 2023-10-06T02:27:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.020+0000 7f06ddb17700 1 -- 172.21.15.37:0/1178601995 wait complete. 2023-10-06T02:27:55.034 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:27:55.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.151+0000 7ff614e22700 1 Processor -- start 2023-10-06T02:27:55.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.151+0000 7ff614e22700 1 -- start start 2023-10-06T02:27:55.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.152+0000 7ff614e22700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff61006c300 0x7ff6100cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.152+0000 7ff614e22700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff61006c6d0 0x7ff6100cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.152+0000 7ff614e22700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff61015e040 con 0x7ff610159180 2023-10-06T02:27:55.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.152+0000 7ff614e22700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6100cbbd0 con 0x7ff61006c6d0 2023-10-06T02:27:55.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.152+0000 7ff614e22700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61015d430 con 0x7ff61006c300 2023-10-06T02:27:55.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.152+0000 7ff60dd9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff61006c6d0 0x7ff6100cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.153+0000 7ff60dd9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff61006c6d0 0x7ff6100cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53206/0 (socket says 172.21.15.37:53206) 2023-10-06T02:27:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.153+0000 7ff60dd9b700 1 -- 172.21.15.37:0/2934642895 learned_addr learned my addr 172.21.15.37:0/2934642895 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.153+0000 7ff60e59c700 1 --2- 172.21.15.37:0/2934642895 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff61006c300 0x7ff6100cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.153+0000 7ff60dd9b700 1 -- 172.21.15.37:0/2934642895 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff61006c300 msgr2=0x7ff6100cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:27:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.153+0000 7ff60dd9b700 1 --2- 172.21.15.37:0/2934642895 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff61006c300 0x7ff6100cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.153+0000 7ff60dd9b700 1 -- 172.21.15.37:0/2934642895 >> v1:172.21.15.191:6789/0 conn(0x7ff610159180 legacy=0x7ff610159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.153+0000 7ff60dd9b700 1 -- 172.21.15.37:0/2934642895 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61015d710 con 0x7ff61006c6d0 2023-10-06T02:27:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.153+0000 7ff60e59c700 1 --2- 172.21.15.37:0/2934642895 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff61006c300 0x7ff6100cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.153+0000 7ff60dd9b700 1 --2- 172.21.15.37:0/2934642895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61006c6d0 0x7ff6100cb690 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80099b0 tx=0x7ff5f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3cd836a23e26af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.153+0000 7ff60d59a700 1 -- 172.21.15.37:0/2934642895 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f800b860 con 0x7ff61006c6d0 2023-10-06T02:27:55.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.153+0000 7ff60d59a700 1 -- 172.21.15.37:0/2934642895 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f800b9c0 con 0x7ff61006c6d0 2023-10-06T02:27:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.153+0000 7ff60d59a700 1 -- 172.21.15.37:0/2934642895 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f800bd60 con 0x7ff61006c6d0 2023-10-06T02:27:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.154+0000 7ff614e22700 1 -- 172.21.15.37:0/2934642895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61006c6d0 msgr2=0x7ff6100cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.154+0000 7ff614e22700 1 --2- 172.21.15.37:0/2934642895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61006c6d0 0x7ff6100cb690 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80099b0 tx=0x7ff5f8009250 comp rx=0 tx=0).stop 2023-10-06T02:27:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.154+0000 7ff614e22700 1 -- 172.21.15.37:0/2934642895 shutdown_connections 2023-10-06T02:27:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.154+0000 7ff614e22700 1 --2- 172.21.15.37:0/2934642895 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff61006c300 0x7ff6100cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.154+0000 7ff614e22700 1 --2- 172.21.15.37:0/2934642895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61006c6d0 0x7ff6100cb690 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.154+0000 7ff614e22700 1 -- 172.21.15.37:0/2934642895 >> 172.21.15.37:0/2934642895 conn(0x7ff6100cd290 msgr2=0x7ff6100cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.154+0000 7ff614e22700 1 -- 172.21.15.37:0/2934642895 shutdown_connections 2023-10-06T02:27:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.154+0000 7ff614e22700 1 -- 172.21.15.37:0/2934642895 wait complete. 2023-10-06T02:27:55.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.155+0000 7ff614e22700 1 Processor -- start 2023-10-06T02:27:55.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.155+0000 7ff614e22700 1 -- start start 2023-10-06T02:27:55.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff614e22700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61006c300 0x7ff610151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff614e22700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff61006c6d0 0x7ff61016a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff614e22700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff610159180 0x7ff61015aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff614e22700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6100c46b0 con 0x7ff61006c300 2023-10-06T02:27:55.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff614e22700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61016a9d0 con 0x7ff61006c6d0 2023-10-06T02:27:55.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff614e22700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61016acb0 con 0x7ff610159180 2023-10-06T02:27:55.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff60e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61006c300 0x7ff610151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff60e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61006c300 0x7ff610151020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53212/0 (socket says 172.21.15.37:53212) 2023-10-06T02:27:55.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff60e59c700 1 -- 172.21.15.37:0/2488928157 learned_addr learned my addr 172.21.15.37:0/2488928157 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:27:55.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff60dd9b700 1 --2- 172.21.15.37:0/2488928157 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff61006c6d0 0x7ff61016a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff60ed9d700 1 --2- 172.21.15.37:0/2488928157 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff610159180 0x7ff61015aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff60e59c700 1 -- 172.21.15.37:0/2488928157 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff610159180 msgr2=0x7ff61015aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff60e59c700 1 --2- 172.21.15.37:0/2488928157 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff610159180 0x7ff61015aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff60e59c700 1 -- 172.21.15.37:0/2488928157 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff61006c6d0 msgr2=0x7ff61016a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff60e59c700 1 --2- 172.21.15.37:0/2488928157 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff61006c6d0 0x7ff61016a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff60e59c700 1 -- 172.21.15.37:0/2488928157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f80094f0 con 0x7ff61006c300 2023-10-06T02:27:55.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff60ed9d700 1 --2- 172.21.15.37:0/2488928157 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff610159180 0x7ff61015aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:27:55.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff60e59c700 1 --2- 172.21.15.37:0/2488928157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61006c300 0x7ff610151020 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff60800e8d0 tx=0x7ff608008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff6067fc700 1 -- 172.21.15.37:0/2488928157 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff608013410 con 0x7ff61006c300 2023-10-06T02:27:55.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff6067fc700 1 -- 172.21.15.37:0/2488928157 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff608013570 con 0x7ff61006c300 2023-10-06T02:27:55.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff6067fc700 1 -- 172.21.15.37:0/2488928157 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff608013910 con 0x7ff61006c300 2023-10-06T02:27:55.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff614e22700 1 -- 172.21.15.37:0/2488928157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61016af90 con 0x7ff61006c300 2023-10-06T02:27:55.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.156+0000 7ff614e22700 1 -- 172.21.15.37:0/2488928157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff610151560 con 0x7ff61006c300 2023-10-06T02:27:55.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.157+0000 7ff614e22700 1 -- 172.21.15.37:0/2488928157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff610069820 con 0x7ff61006c300 2023-10-06T02:27:55.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.158+0000 7ff6067fc700 1 -- 172.21.15.37:0/2488928157 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff608013d00 con 0x7ff61006c300 2023-10-06T02:27:55.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.158+0000 7ff6067fc700 1 --2- 172.21.15.37:0/2488928157 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff5f0066f30 0x7ff5f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:27:55.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.158+0000 7ff6067fc700 1 -- 172.21.15.37:0/2488928157 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff608084400 con 0x7ff61006c300 2023-10-06T02:27:55.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.158+0000 7ff60dd9b700 1 --2- 172.21.15.37:0/2488928157 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff5f0066f30 0x7ff5f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:27:55.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.159+0000 7ff60dd9b700 1 --2- 172.21.15.37:0/2488928157 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff5f0066f30 0x7ff5f00693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80099b0 tx=0x7ff5f8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:27:55.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.162+0000 7ff6067fc700 1 -- 172.21.15.37:0/2488928157 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff608051510 con 0x7ff61006c300 2023-10-06T02:27:55.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.401+0000 7ff614e22700 1 -- 172.21.15.37:0/2488928157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff61015d9f0 con 0x7ff61006c300 2023-10-06T02:27:55.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.401+0000 7ff6067fc700 1 -- 172.21.15.37:0/2488928157 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff608054b30 con 0x7ff61006c300 2023-10-06T02:27:55.403 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:27:55.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.403+0000 7ff614e22700 1 -- 172.21.15.37:0/2488928157 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff5f0066f30 msgr2=0x7ff5f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.403+0000 7ff614e22700 1 --2- 172.21.15.37:0/2488928157 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff5f0066f30 0x7ff5f00693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80099b0 tx=0x7ff5f8017000 comp rx=0 tx=0).stop 2023-10-06T02:27:55.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.403+0000 7ff614e22700 1 -- 172.21.15.37:0/2488928157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61006c300 msgr2=0x7ff610151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:27:55.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.403+0000 7ff614e22700 1 --2- 172.21.15.37:0/2488928157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61006c300 0x7ff610151020 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff60800e8d0 tx=0x7ff608008040 comp rx=0 tx=0).stop 2023-10-06T02:27:55.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.403+0000 7ff614e22700 1 -- 172.21.15.37:0/2488928157 shutdown_connections 2023-10-06T02:27:55.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.403+0000 7ff614e22700 1 --2- 172.21.15.37:0/2488928157 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff610159180 0x7ff61015aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.403+0000 7ff614e22700 1 --2- 172.21.15.37:0/2488928157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61006c300 0x7ff610151020 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.403+0000 7ff614e22700 1 --2- 172.21.15.37:0/2488928157 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7ff5f0066f30 0x7ff5f00693e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.403+0000 7ff614e22700 1 --2- 172.21.15.37:0/2488928157 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff61006c6d0 0x7ff61016a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:27:55.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.403+0000 7ff614e22700 1 -- 172.21.15.37:0/2488928157 >> 172.21.15.37:0/2488928157 conn(0x7ff6100cd290 msgr2=0x7ff6100c9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:27:55.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.403+0000 7ff614e22700 1 -- 172.21.15.37:0/2488928157 shutdown_connections 2023-10-06T02:27:55.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:27:55.403+0000 7ff614e22700 1 -- 172.21.15.37:0/2488928157 wait complete. 2023-10-06T02:27:55.417 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:27:55.417 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:27:55.417 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-10-06T02:27:55.417 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:27:55.417 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:55.417 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:27:55.417 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:27:55.417 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:27:55.417 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:27:55.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:55.418 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-10-06T02:27:55.433 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:27:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:27:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:27:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T02:27:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:55.434 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:27:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:27:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-10-06T02:27:55.434 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:27:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:27:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-10-06T02:27:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:27:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42206sec preferred_lft 42206sec 2023-10-06T02:27:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-10-06T02:27:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:55.435 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:27:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:27:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-10-06T02:27:55.435 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:27:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:27:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-10-06T02:27:55.435 INFO:teuthology.orchestra.run.smithi037.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:27:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 26:84:4a:aa:8b:b5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:27:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:27:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::a0fb:38ff:fe90:57e1/64 scope link 2023-10-06T02:27:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:55.436 INFO:teuthology.orchestra.run.smithi037.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:27:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 36:fb:a9:50:59:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:27:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::34fb:a9ff:fe50:5976/64 scope link 2023-10-06T02:27:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:55.436 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:27:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 26:84:4a:aa:8b:b5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:27:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::2484:4aff:feaa:8bb5/64 scope link 2023-10-06T02:27:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:27:55.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:55.437 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:27:55.497 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T02:27:55.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:55.499 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-10-06T02:27:55.555 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-10-06T02:27:55.555 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:27:55.555 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:27:55.555 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:27:55.556 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:27:55.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:55.556 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T02:27:55.556 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T02:27:55.556 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:27:55.556 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:27:55.556 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:27:55.557 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T02:27:55.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:55.657 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T02:27:55.672 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:27:55.672 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:27:55.673 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:27:55.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:27:55.673 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-10-06T02:27:55.737 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:27:55.737 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:27:55.737 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:55.792 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:27:55.792 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:27:55.793 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:55.847 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T02:27:55.912 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:27:55.913 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:27:55.978 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:27:55.978 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:27:55.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:27:55.979 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T02:27:56.034 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:27:56.034 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:27:56.076 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T02:27:56.101 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:27:56.101 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:27:56.158 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-10-06T02:27:56.157+0000 7fb1365b4540 -1 init, newargv = 0x5631deebcab0 newargc=15 2023-10-06T02:27:56.158 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[114004]: starting ceph client 2023-10-06T02:27:56.163 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[114004]: starting fuse 2023-10-06T02:27:56.167 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:27:56.168 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:27:56.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:27:56.168 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T02:27:56.224 INFO:teuthology.orchestra.run.smithi037.stdout:46 2023-10-06T02:27:56.225 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T02:27:56.225 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:27:56.225 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-10-06T02:27:56.225 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-10-06T02:27:56.225 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:27:56.225 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-10-06T02:27:56.225 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:27:56.225 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-10-06T02:27:56.225 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:27:56.226 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-10-06T02:27:56.226 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:27:56.226 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:27:56.226 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-10-06T02:27:56.226 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-10-06T02:27:56.226 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-10-06T02:27:56.226 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-10-06T02:27:56.226 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:27:56.226 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-10-06T02:27:56.226 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:27:56.226 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:27:56.226 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:27:56.226 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-10-06T02:27:56.227 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-10-06T02:27:56.227 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-10-06T02:27:56.227 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:27:56.227 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:27:56.227 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-10-06T02:27:56.227 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:27:56.348 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.114004.asok 2023-10-06T02:27:56.530 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.114004.asok 2023-10-06T02:27:56.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:27:56.530 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.114004.asok status 2023-10-06T02:27:56.685 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:27:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-10-06T02:27:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:27:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:27:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-10-06T02:27:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-10-06T02:27:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:27:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "114004", 2023-10-06T02:27:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-10-06T02:27:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-10-06T02:27:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-10-06T02:27:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6654, 2023-10-06T02:27:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-10-06T02:27:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-10-06T02:27:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-10-06T02:27:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 6654 2023-10-06T02:27:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T02:27:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T02:27:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:27:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1991353085 2023-10-06T02:27:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:27:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T02:27:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T02:27:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:27:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1991353085 2023-10-06T02:27:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:27:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.6654 192.168.0.1:0/1991353085", 2023-10-06T02:27:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/1991353085", 2023-10-06T02:27:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-10-06T02:27:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 47, 2023-10-06T02:27:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 72, 2023-10-06T02:27:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:27:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-10-06T02:27:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-10-06T02:27:56.688 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:27:56.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:27:56.695 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-10-06T02:27:56.695 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:56.710 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-10-06T02:27:56.711 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:56.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:27:56.711 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:56.777 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:27:56.777 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:27:56.777 DEBUG:teuthology.orchestra.run.smithi037:> mount_point = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:27:56.778 DEBUG:teuthology.orchestra.run.smithi037:> parent = os.path.join(mount_point, "parent") 2023-10-06T02:27:56.778 DEBUG:teuthology.orchestra.run.smithi037:> os.mkdir(parent) 2023-10-06T02:27:56.778 DEBUG:teuthology.orchestra.run.smithi037:> flushed = os.path.join(parent, "flushed") 2023-10-06T02:27:56.778 DEBUG:teuthology.orchestra.run.smithi037:> os.mkdir(flushed) 2023-10-06T02:27:56.778 DEBUG:teuthology.orchestra.run.smithi037:> for f in ["alpha", "bravo", "charlie"]: 2023-10-06T02:27:56.778 DEBUG:teuthology.orchestra.run.smithi037:> open(os.path.join(flushed, f), '"'"'w'"'"').write(f) 2023-10-06T02:27:56.778 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:27:57.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:27:57.072 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2023-10-06T02:27:57.138 INFO:teuthology.orchestra.run.smithi037.stdout:./ 2023-10-06T02:27:57.139 INFO:teuthology.orchestra.run.smithi037.stdout:./parent 2023-10-06T02:27:57.139 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed 2023-10-06T02:27:57.139 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed/charlie 2023-10-06T02:27:57.139 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed/alpha 2023-10-06T02:27:57.139 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed/bravo 2023-10-06T02:27:57.139 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:27:57.139 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:27:57.139 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:27:57.140 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:27:57.140 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2023-10-06T02:27:57.140 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:27:57.244 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T02:27:57.433 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:27:57.434 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:27:57.434 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:27:57.434 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:27:57.434 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2023-10-06T02:27:57.434 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:27:57.539 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627776 2023-10-06T02:27:57.728 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:27:57.728 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:27:57.728 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:27:57.728 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:27:57.728 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2023-10-06T02:27:57.728 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:27:57.834 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627777 2023-10-06T02:27:58.023 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:27:58.023 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:27:58.024 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:27:58.024 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:27:58.024 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2023-10-06T02:27:58.024 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:27:58.130 INFO:teuthology.orchestra.run.smithi037.stdout:1099511628280 2023-10-06T02:27:58.319 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:27:58.319 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:27:58.319 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:27:58.319 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:27:58.320 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2023-10-06T02:27:58.320 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:27:58.425 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627778 2023-10-06T02:27:58.614 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:27:58.614 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:27:58.614 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:27:58.614 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:27:58.614 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2023-10-06T02:27:58.614 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:27:58.722 INFO:teuthology.orchestra.run.smithi037.stdout:1099511628279 2023-10-06T02:27:58.909 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-10-06T02:27:58.910 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:27:58.910 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:27:58.986 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[114004]: fuse finished with error 0 and tester_r 0 2023-10-06T02:27:58.987 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:28:05.089 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:28:05.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:05.089 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:28:05.109 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 flush journal 2023-10-06T02:28:05.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.282+0000 7f46e359e700 1 Processor -- start 2023-10-06T02:28:05.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.282+0000 7f46e359e700 1 -- start start 2023-10-06T02:28:05.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.283+0000 7f46e359e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f46e40b29d0 0x7f46e40ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.283+0000 7f46e359e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e40b2da0 con 0x7f46e40cb170 2023-10-06T02:28:05.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.283+0000 7f46e359e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e4099bd0 con 0x7f46e40ccdd0 2023-10-06T02:28:05.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.283+0000 7f46e359e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e4159a70 con 0x7f46e40b29d0 2023-10-06T02:28:05.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.283+0000 7f46e1d9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f46e40cb170 0x7f46e40cee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48584/0 (socket says 172.21.15.37:48584) 2023-10-06T02:28:05.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.283+0000 7f46e1d9b700 1 -- 172.21.15.37:0/1766246140 learned_addr learned my addr 172.21.15.37:0/1766246140 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:05.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e259c700 1 --2- 172.21.15.37:0/1766246140 >> v2:172.21.15.191:3300/0 conn(0x7f46e40b29d0 0x7f46e40ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e159a700 1 -- 172.21.15.37:0/1766246140 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732973445 0 0) 0x7f46cc001110 con 0x7f46e40cb170 2023-10-06T02:28:05.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e159a700 1 -- 172.21.15.37:0/1766246140 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46d0003570 con 0x7f46e40cb170 2023-10-06T02:28:05.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e159a700 1 -- 172.21.15.37:0/1766246140 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 147037753 0 0) 0x7f46d0003570 con 0x7f46e40cb170 2023-10-06T02:28:05.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e159a700 1 -- 172.21.15.37:0/1766246140 >> v2:172.21.15.191:3300/0 conn(0x7f46e40b29d0 msgr2=0x7f46e40ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:05.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e159a700 1 --2- 172.21.15.37:0/1766246140 >> v2:172.21.15.191:3300/0 conn(0x7f46e40b29d0 0x7f46e40ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e159a700 1 -- 172.21.15.37:0/1766246140 >> v1:172.21.15.191:6789/0 conn(0x7f46e40ccdd0 legacy=0x7f46e4163250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e159a700 1 -- 172.21.15.37:0/1766246140 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e40cb5e0 con 0x7f46e40cb170 2023-10-06T02:28:05.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e159a700 1 -- 172.21.15.37:0/1766246140 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f46cc001600 con 0x7f46e40cb170 2023-10-06T02:28:05.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e159a700 1 -- 172.21.15.37:0/1766246140 >> v1:172.21.15.37:6789/0 conn(0x7f46e40cb170 legacy=0x7f46e40cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e159a700 1 --2- 172.21.15.37:0/1766246140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46d0003a60 0x7f46d0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e159a700 1 --2- 172.21.15.37:0/1766246140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46d0004810 0x7f46d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e159a700 1 --2- 172.21.15.37:0/1766246140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46d00051c0 0x7f46d000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e159a700 1 -- 172.21.15.37:0/1766246140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e4159a70 con 0x7f46d0004810 2023-10-06T02:28:05.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e159a700 1 -- 172.21.15.37:0/1766246140 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d000c160 con 0x7f46d00051c0 2023-10-06T02:28:05.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e159a700 1 -- 172.21.15.37:0/1766246140 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d000c320 con 0x7f46d0003a60 2023-10-06T02:28:05.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e1d9b700 1 --2- 172.21.15.37:0/1766246140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46d0004810 0x7f46d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e2d9d700 1 --2- 172.21.15.37:0/1766246140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46d00051c0 0x7f46d000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e259c700 1 --2- 172.21.15.37:0/1766246140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46d0003a60 0x7f46d0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e1d9b700 1 -- 172.21.15.37:0/1766246140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46d0003a60 msgr2=0x7f46d0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:05.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e1d9b700 1 --2- 172.21.15.37:0/1766246140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46d0003a60 0x7f46d0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e1d9b700 1 -- 172.21.15.37:0/1766246140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46d00051c0 msgr2=0x7f46d000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:05.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e1d9b700 1 --2- 172.21.15.37:0/1766246140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46d00051c0 0x7f46d000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e1d9b700 1 -- 172.21.15.37:0/1766246140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d0003570 con 0x7f46d0004810 2023-10-06T02:28:05.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e2d9d700 1 --2- 172.21.15.37:0/1766246140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46d00051c0 0x7f46d000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:05.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.284+0000 7f46e2d9d700 1 -- 172.21.15.37:0/1766246140 reap_dead start 2023-10-06T02:28:05.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.285+0000 7f46e1d9b700 1 --2- 172.21.15.37:0/1766246140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46d0004810 0x7f46d0004c80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f46e4089580 tx=0x7f46cc007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3a8543511e7ac8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:05.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.285+0000 7f46e159a700 1 -- 172.21.15.37:0/1766246140 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc00cd60 con 0x7f46d0004810 2023-10-06T02:28:05.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.285+0000 7f46e159a700 1 -- 172.21.15.37:0/1766246140 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46cc005920 con 0x7f46d0004810 2023-10-06T02:28:05.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.285+0000 7f46e159a700 1 -- 172.21.15.37:0/1766246140 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc005ce0 con 0x7f46d0004810 2023-10-06T02:28:05.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.285+0000 7f46e359e700 1 -- 172.21.15.37:0/1766246140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46d0004810 msgr2=0x7f46d0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.285+0000 7f46e359e700 1 --2- 172.21.15.37:0/1766246140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46d0004810 0x7f46d0004c80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f46e4089580 tx=0x7f46cc007a50 comp rx=0 tx=0).stop 2023-10-06T02:28:05.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.285+0000 7f46e359e700 1 -- 172.21.15.37:0/1766246140 shutdown_connections 2023-10-06T02:28:05.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.285+0000 7f46e359e700 1 --2- 172.21.15.37:0/1766246140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46d0004810 0x7f46d0004c80 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.285+0000 7f46e359e700 1 -- 172.21.15.37:0/1766246140 >> 172.21.15.37:0/1766246140 conn(0x7f46e4099610 msgr2=0x7f46e406c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:05.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.285+0000 7f46e359e700 1 -- 172.21.15.37:0/1766246140 shutdown_connections 2023-10-06T02:28:05.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.285+0000 7f46e359e700 1 -- 172.21.15.37:0/1766246140 wait complete. 2023-10-06T02:28:05.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.286+0000 7f46e359e700 1 Processor -- start 2023-10-06T02:28:05.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.286+0000 7f46e359e700 1 -- start start 2023-10-06T02:28:05.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.287+0000 7f46e359e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46d0004810 0x7f46e40b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.287+0000 7f46e359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46e40c8af0 0x7f46e40c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.287+0000 7f46e359e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46e40c94a0 0x7f46e40c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.287+0000 7f46e359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e4157610 con 0x7f46e40c8af0 2023-10-06T02:28:05.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.287+0000 7f46e359e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e40c8660 con 0x7f46d0004810 2023-10-06T02:28:05.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.287+0000 7f46e359e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e4157100 con 0x7f46e40c94a0 2023-10-06T02:28:05.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.287+0000 7f46e1d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46e40c8af0 0x7f46e40c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.287+0000 7f46e1d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46e40c8af0 0x7f46e40c8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44206/0 (socket says 172.21.15.37:44206) 2023-10-06T02:28:05.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.287+0000 7f46e1d9b700 1 -- 172.21.15.37:0/4155012443 learned_addr learned my addr 172.21.15.37:0/4155012443 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:05.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.287+0000 7f46e259c700 1 --2- 172.21.15.37:0/4155012443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46d0004810 0x7f46e40b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.287+0000 7f46e2d9d700 1 --2- 172.21.15.37:0/4155012443 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46e40c94a0 0x7f46e40c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.288+0000 7f46e1d9b700 1 -- 172.21.15.37:0/4155012443 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46e40c94a0 msgr2=0x7f46e40c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.288+0000 7f46e1d9b700 1 --2- 172.21.15.37:0/4155012443 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46e40c94a0 0x7f46e40c9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.288+0000 7f46e1d9b700 1 -- 172.21.15.37:0/4155012443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46d0004810 msgr2=0x7f46e40b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.288+0000 7f46e1d9b700 1 --2- 172.21.15.37:0/4155012443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46d0004810 0x7f46e40b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.288+0000 7f46e1d9b700 1 -- 172.21.15.37:0/4155012443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e40b41a0 con 0x7f46e40c8af0 2023-10-06T02:28:05.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.288+0000 7f46e1d9b700 1 --2- 172.21.15.37:0/4155012443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46e40c8af0 0x7f46e40c8f60 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f46d000c130 tx=0x7f46cc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:05.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.288+0000 7f46da7fc700 1 -- 172.21.15.37:0/4155012443 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc00cd60 con 0x7f46e40c8af0 2023-10-06T02:28:05.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.288+0000 7f46da7fc700 1 -- 172.21.15.37:0/4155012443 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46cc0072e0 con 0x7f46e40c8af0 2023-10-06T02:28:05.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.288+0000 7f46e359e700 1 -- 172.21.15.37:0/4155012443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e415a9a0 con 0x7f46e40c8af0 2023-10-06T02:28:05.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.288+0000 7f46da7fc700 1 -- 172.21.15.37:0/4155012443 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc0076a0 con 0x7f46e40c8af0 2023-10-06T02:28:05.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.288+0000 7f46e359e700 1 -- 172.21.15.37:0/4155012443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e415b190 con 0x7f46e40c8af0 2023-10-06T02:28:05.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.289+0000 7f46da7fc700 1 -- 172.21.15.37:0/4155012443 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46cc01e640 con 0x7f46e40c8af0 2023-10-06T02:28:05.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.290+0000 7f46da7fc700 1 --2- 172.21.15.37:0/4155012443 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f46c4066f30 0x7f46c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.290+0000 7f46da7fc700 1 -- 172.21.15.37:0/4155012443 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f46cc085020 con 0x7f46e40c8af0 2023-10-06T02:28:05.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.290+0000 7f46e259c700 1 --2- 172.21.15.37:0/4155012443 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f46c4066f30 0x7f46c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.291+0000 7f46e259c700 1 --2- 172.21.15.37:0/4155012443 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f46c4066f30 0x7f46c40693e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f46e406dcc0 tx=0x7f46dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:05.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.292+0000 7f46f1f3eb80 1 Processor -- start 2023-10-06T02:28:05.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.292+0000 7f46f1f3eb80 1 -- start start 2023-10-06T02:28:05.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.293+0000 7f46f1f3eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8526ea0 0x5559d8501d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.293+0000 7f46f1f3eb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559d8507310 0x5559d8502250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.293+0000 7f46f1f3eb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8508a60 0x5559d8502790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.293+0000 7f46f1f3eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559d845cac0 con 0x5559d8526ea0 2023-10-06T02:28:05.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.293+0000 7f46f1f3eb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559d845a2c0 con 0x5559d8508a60 2023-10-06T02:28:05.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.293+0000 7f46f1f3eb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5559d84560b0 con 0x5559d8507310 2023-10-06T02:28:05.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.293+0000 7f46e259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8526ea0 0x5559d8501d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.293+0000 7f46e259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8526ea0 0x5559d8501d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44222/0 (socket says 172.21.15.37:44222) 2023-10-06T02:28:05.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.293+0000 7f46e259c700 1 -- 172.21.15.37:0/3987092911 learned_addr learned my addr 172.21.15.37:0/3987092911 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:05.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.293+0000 7f46e1d9b700 1 --2- 172.21.15.37:0/3987092911 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559d8507310 0x5559d8502250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.293+0000 7f46e2d9d700 1 --2- 172.21.15.37:0/3987092911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8508a60 0x5559d8502790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.293+0000 7f46e259c700 1 -- 172.21.15.37:0/3987092911 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559d8507310 msgr2=0x5559d8502250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:05.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.293+0000 7f46e259c700 1 --2- 172.21.15.37:0/3987092911 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559d8507310 0x5559d8502250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.293+0000 7f46e259c700 1 -- 172.21.15.37:0/3987092911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8508a60 msgr2=0x5559d8502790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:05.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.293+0000 7f46e259c700 1 --2- 172.21.15.37:0/3987092911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8508a60 0x5559d8502790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.293+0000 7f46e259c700 1 -- 172.21.15.37:0/3987092911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559d82f02c0 con 0x5559d8526ea0 2023-10-06T02:28:05.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.293+0000 7f46e2d9d700 1 --2- 172.21.15.37:0/3987092911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8508a60 0x5559d8502790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:05.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.293+0000 7f46e259c700 1 --2- 172.21.15.37:0/3987092911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8526ea0 0x5559d8501d10 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f46dc014f00 tx=0x7f46dc01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c389b1e1ff42e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:05.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.294+0000 7f46c37fe700 1 -- 172.21.15.37:0/3987092911 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc016d20 con 0x5559d8526ea0 2023-10-06T02:28:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.294+0000 7f46c37fe700 1 -- 172.21.15.37:0/3987092911 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc016e80 con 0x5559d8526ea0 2023-10-06T02:28:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.294+0000 7f46c37fe700 1 -- 172.21.15.37:0/3987092911 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc023660 con 0x5559d8526ea0 2023-10-06T02:28:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.294+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3987092911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8526ea0 msgr2=0x5559d8501d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.294+0000 7f46f1f3eb80 1 --2- 172.21.15.37:0/3987092911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8526ea0 0x5559d8501d10 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f46dc014f00 tx=0x7f46dc01b000 comp rx=0 tx=0).stop 2023-10-06T02:28:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.294+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3987092911 shutdown_connections 2023-10-06T02:28:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.294+0000 7f46f1f3eb80 1 --2- 172.21.15.37:0/3987092911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8508a60 0x5559d8502790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.294+0000 7f46f1f3eb80 1 --2- 172.21.15.37:0/3987092911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8526ea0 0x5559d8501d10 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.294+0000 7f46f1f3eb80 1 --2- 172.21.15.37:0/3987092911 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559d8507310 0x5559d8502250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.294+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3987092911 >> 172.21.15.37:0/3987092911 conn(0x5559d8506ed0 msgr2=0x5559d8507700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.294+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3987092911 shutdown_connections 2023-10-06T02:28:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.294+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3987092911 wait complete. 2023-10-06T02:28:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.295+0000 7f46f1f3eb80 1 -- start start 2023-10-06T02:28:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.295+0000 7f46f1f3eb80 1 Processor -- start 2023-10-06T02:28:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.296+0000 7f46f1f3eb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559d8507310 0x5559d8527270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.296+0000 7f46f1f3eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8508a60 0x5559d854c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.296+0000 7f46f1f3eb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8526ea0 0x5559d8550090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.296+0000 7f46f1f3eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559d84018e0 con 0x5559d8508a60 2023-10-06T02:28:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.296+0000 7f46f1f3eb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559d841cef0 con 0x5559d8526ea0 2023-10-06T02:28:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.296+0000 7f46f1f3eb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5559d82d8e80 con 0x5559d8507310 2023-10-06T02:28:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.296+0000 7f46f1f3eb80 10 client.0 _ll_register_callbacks cb 0x5559d84c9070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:28:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.296+0000 7f46e1d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8508a60 0x5559d854c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.296+0000 7f46e1d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8508a60 0x5559d854c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44232/0 (socket says 172.21.15.37:44232) 2023-10-06T02:28:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.296+0000 7f46e1d9b700 1 -- 172.21.15.37:0/3468758721 learned_addr learned my addr 172.21.15.37:0/3468758721 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.296+0000 7f46e259c700 1 --2- 172.21.15.37:0/3468758721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559d8507310 0x5559d8527270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.296+0000 7f46e1d9b700 1 -- 172.21.15.37:0/3468758721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559d8507310 msgr2=0x5559d8527270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:05.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.296+0000 7f46e2d9d700 1 --2- 172.21.15.37:0/3468758721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8526ea0 0x5559d8550090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.296+0000 7f46e1d9b700 1 --2- 172.21.15.37:0/3468758721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559d8507310 0x5559d8527270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.296+0000 7f46e1d9b700 1 -- 172.21.15.37:0/3468758721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8526ea0 msgr2=0x5559d8550090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:05.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.296+0000 7f46e1d9b700 1 --2- 172.21.15.37:0/3468758721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8526ea0 0x5559d8550090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.296+0000 7f46e1d9b700 1 -- 172.21.15.37:0/3468758721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46dc014be0 con 0x5559d8508a60 2023-10-06T02:28:05.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.297+0000 7f46e1d9b700 1 --2- 172.21.15.37:0/3468758721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8508a60 0x5559d854c0c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f46cc083490 tx=0x7f46cc05b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a026880a046ac6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:05.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.297+0000 7f46c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:28:05.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.297+0000 7f46c0ff9700 1 -- 172.21.15.37:0/3468758721 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc0564f0 con 0x5559d8508a60 2023-10-06T02:28:05.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.297+0000 7f46c0ff9700 1 -- 172.21.15.37:0/3468758721 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f46cc055df0 con 0x5559d8508a60 2023-10-06T02:28:05.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.297+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3468758721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5559d84d78c0 con 0x5559d8508a60 2023-10-06T02:28:05.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.297+0000 7f46c0ff9700 1 -- 172.21.15.37:0/3468758721 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46cc059040 con 0x5559d8508a60 2023-10-06T02:28:05.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.297+0000 7f46f1f3eb80 10 client.6666 fetch_fsmap learned FSMap version 47 2023-10-06T02:28:05.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.297+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3468758721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x5559d8293030 con 0x5559d8508a60 2023-10-06T02:28:05.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.297+0000 7f46c0ff9700 1 -- 172.21.15.37:0/3468758721 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46cc070020 con 0x5559d8508a60 2023-10-06T02:28:05.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.297+0000 7f46c0ff9700 1 -- 172.21.15.37:0/3468758721 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 47) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f46cc0552e0 con 0x5559d8508a60 2023-10-06T02:28:05.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.297+0000 7f46f1f3eb80 10 client.6666 fetch_fsmap finished waiting for FSMap version 47 2023-10-06T02:28:05.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.297+0000 7f46f1f3eb80 10 client.6666 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.d 2023-10-06T02:28:05.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.297+0000 7f46f1f3eb80 20 client.6666 populate_metadata read hostname 'smithi037' 2023-10-06T02:28:05.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.297+0000 7f46f1f3eb80 1 --2- 172.21.15.37:0/3468758721 >> [v2:172.21.15.191:6834/2764715102,v1:172.21.15.191:6837/2764715102] conn(0x5559d85259b0 0x5559d854e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.297+0000 7f46f1f3eb80 4 client.6666 mds_command: new command op to 6465 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:28:05.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.297+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3468758721 --> [v2:172.21.15.191:6834/2764715102,v1:172.21.15.191:6837/2764715102] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5559d83f8e50 con 0x5559d85259b0 2023-10-06T02:28:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.297+0000 7f46e259c700 1 --2- 172.21.15.37:0/3468758721 >> [v2:172.21.15.191:6834/2764715102,v1:172.21.15.191:6837/2764715102] conn(0x5559d85259b0 0x5559d854e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.298+0000 7f46c0ff9700 10 client.6666 ms_handle_connect on v2:172.21.15.191:6834/2764715102 2023-10-06T02:28:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.298+0000 7f46e259c700 1 --2- 172.21.15.37:0/3468758721 >> [v2:172.21.15.191:6834/2764715102,v1:172.21.15.191:6837/2764715102] conn(0x5559d85259b0 0x5559d854e2a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d18bdd66a4bcda8f server_cookie=46afe53bf1274673 in_seq=0 out_seq=0 2023-10-06T02:28:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.299+0000 7f46c0ff9700 1 -- 172.21.15.37:0/3468758721 <== mds.0 v2:172.21.15.191:6834/2764715102 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5559d83f8e50 con 0x5559d85259b0 2023-10-06T02:28:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.299+0000 7f46c0ff9700 10 client.6666 handle_command_reply: tid=0 2023-10-06T02:28:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.299+0000 7f46f1f3eb80 1 client.6666 shutdown 2023-10-06T02:28:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.299+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3468758721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8508a60 msgr2=0x5559d854c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.299+0000 7f46f1f3eb80 1 --2- 172.21.15.37:0/3468758721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8508a60 0x5559d854c0c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f46cc083490 tx=0x7f46cc05b040 comp rx=0 tx=0).stop 2023-10-06T02:28:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.299+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3468758721 shutdown_connections 2023-10-06T02:28:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.299+0000 7f46f1f3eb80 1 --2- 172.21.15.37:0/3468758721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8526ea0 0x5559d8550090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.299+0000 7f46f1f3eb80 1 --2- 172.21.15.37:0/3468758721 >> [v2:172.21.15.191:6834/2764715102,v1:172.21.15.191:6837/2764715102] conn(0x5559d85259b0 0x5559d854e2a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.299+0000 7f46f1f3eb80 1 --2- 172.21.15.37:0/3468758721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559d8507310 0x5559d8527270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.299+0000 7f46f1f3eb80 1 --2- 172.21.15.37:0/3468758721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8508a60 0x5559d854c0c0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.299+0000 7f46c0ff9700 0 client.6666 ms_handle_reset on v2:172.21.15.191:6834/2764715102 2023-10-06T02:28:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.299+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3468758721 >> 172.21.15.37:0/3468758721 conn(0x5559d8506ed0 msgr2=0x5559d85264d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.299+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3468758721 shutdown_connections 2023-10-06T02:28:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.299+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3468758721 wait complete. 2023-10-06T02:28:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.299+0000 7f46f1f3eb80 20 client.6666 trim_cache size 0 max 16384 2023-10-06T02:28:05.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.313+0000 7f46f1f3eb80 1 Processor -- start 2023-10-06T02:28:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.313+0000 7f46f1f3eb80 1 -- start start 2023-10-06T02:28:05.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.314+0000 7f46f1f3eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8506ed0 0x5559d84fc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.314+0000 7f46f1f3eb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559d8507310 0x5559d85ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.314+0000 7f46f1f3eb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8508a60 0x5559d85ac720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.314+0000 7f46f1f3eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559d84fe3e0 con 0x5559d8506ed0 2023-10-06T02:28:05.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.314+0000 7f46f1f3eb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559d84de2d0 con 0x5559d8508a60 2023-10-06T02:28:05.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.314+0000 7f46f1f3eb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5559d8525d80 con 0x5559d8507310 2023-10-06T02:28:05.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.314+0000 7f46e259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8506ed0 0x5559d84fc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.314+0000 7f46e259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8506ed0 0x5559d84fc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44246/0 (socket says 172.21.15.37:44246) 2023-10-06T02:28:05.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.314+0000 7f46e259c700 1 -- 172.21.15.37:0/1570283868 learned_addr learned my addr 172.21.15.37:0/1570283868 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:05.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.314+0000 7f46e2d9d700 1 --2- 172.21.15.37:0/1570283868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8508a60 0x5559d85ac720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.314+0000 7f46e1d9b700 1 --2- 172.21.15.37:0/1570283868 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559d8507310 0x5559d85ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.314+0000 7f46e259c700 1 -- 172.21.15.37:0/1570283868 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559d8507310 msgr2=0x5559d85ac1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:05.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.314+0000 7f46e259c700 1 --2- 172.21.15.37:0/1570283868 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559d8507310 0x5559d85ac1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.314+0000 7f46e259c700 1 -- 172.21.15.37:0/1570283868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8508a60 msgr2=0x5559d85ac720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:05.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.314+0000 7f46e259c700 1 --2- 172.21.15.37:0/1570283868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8508a60 0x5559d85ac720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.314+0000 7f46e259c700 1 -- 172.21.15.37:0/1570283868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559d84247d0 con 0x5559d8506ed0 2023-10-06T02:28:05.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.315+0000 7f46e259c700 1 --2- 172.21.15.37:0/1570283868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8506ed0 0x5559d84fc620 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f46dc002f10 tx=0x7f46dc023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3039582248add63d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:05.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.315+0000 7f46c3fff700 1 -- 172.21.15.37:0/1570283868 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc023450 con 0x5559d8506ed0 2023-10-06T02:28:05.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.315+0000 7f46c3fff700 1 -- 172.21.15.37:0/1570283868 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc032040 con 0x5559d8506ed0 2023-10-06T02:28:05.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.315+0000 7f46c3fff700 1 -- 172.21.15.37:0/1570283868 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc0235f0 con 0x5559d8506ed0 2023-10-06T02:28:05.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.315+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/1570283868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8506ed0 msgr2=0x5559d84fc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.315+0000 7f46f1f3eb80 1 --2- 172.21.15.37:0/1570283868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8506ed0 0x5559d84fc620 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f46dc002f10 tx=0x7f46dc023000 comp rx=0 tx=0).stop 2023-10-06T02:28:05.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.315+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/1570283868 shutdown_connections 2023-10-06T02:28:05.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.315+0000 7f46f1f3eb80 1 --2- 172.21.15.37:0/1570283868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8508a60 0x5559d85ac720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.315+0000 7f46f1f3eb80 1 --2- 172.21.15.37:0/1570283868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8506ed0 0x5559d84fc620 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.315+0000 7f46f1f3eb80 1 --2- 172.21.15.37:0/1570283868 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559d8507310 0x5559d85ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.315+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/1570283868 >> 172.21.15.37:0/1570283868 conn(0x5559d8535d50 msgr2=0x5559d8505be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:05.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.315+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/1570283868 shutdown_connections 2023-10-06T02:28:05.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.315+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/1570283868 wait complete. 2023-10-06T02:28:05.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.316+0000 7f46f1f3eb80 1 -- start start 2023-10-06T02:28:05.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.316+0000 7f46f1f3eb80 1 Processor -- start 2023-10-06T02:28:05.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.317+0000 7f46f1f3eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8506ed0 0x5559d8507b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.317+0000 7f46f1f3eb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559d8507310 0x5559d8532480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.317+0000 7f46f1f3eb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8508a60 0x5559d85329c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.317+0000 7f46f1f3eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559d856d060 con 0x5559d8506ed0 2023-10-06T02:28:05.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.317+0000 7f46f1f3eb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559d8569e10 con 0x5559d8508a60 2023-10-06T02:28:05.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.317+0000 7f46f1f3eb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5559d8508080 con 0x5559d8507310 2023-10-06T02:28:05.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.317+0000 7f46f1f3eb80 10 client.0 _ll_register_callbacks cb 0x5559d84c9070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:28:05.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.317+0000 7f46e259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8506ed0 0x5559d8507b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.317+0000 7f46e259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8506ed0 0x5559d8507b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44252/0 (socket says 172.21.15.37:44252) 2023-10-06T02:28:05.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.317+0000 7f46e259c700 1 -- 172.21.15.37:0/3139083804 learned_addr learned my addr 172.21.15.37:0/3139083804 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:05.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.317+0000 7f46e2d9d700 1 --2- 172.21.15.37:0/3139083804 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8508a60 0x5559d85329c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.317+0000 7f46e1d9b700 1 --2- 172.21.15.37:0/3139083804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559d8507310 0x5559d8532480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.317+0000 7f46e259c700 1 -- 172.21.15.37:0/3139083804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559d8507310 msgr2=0x5559d8532480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:05.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.317+0000 7f46e259c700 1 --2- 172.21.15.37:0/3139083804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559d8507310 0x5559d8532480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.317+0000 7f46e259c700 1 -- 172.21.15.37:0/3139083804 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8508a60 msgr2=0x5559d85329c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:05.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.317+0000 7f46e259c700 1 --2- 172.21.15.37:0/3139083804 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8508a60 0x5559d85329c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.317+0000 7f46e259c700 1 -- 172.21.15.37:0/3139083804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559d82f02c0 con 0x5559d8506ed0 2023-10-06T02:28:05.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.317+0000 7f46e2d9d700 1 --2- 172.21.15.37:0/3139083804 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8508a60 0x5559d85329c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:05.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.317+0000 7f46e259c700 1 --2- 172.21.15.37:0/3139083804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8506ed0 0x5559d8507b40 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f46dc014f00 tx=0x7f46dc033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3f371b217bd1d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:05.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.317+0000 7f46c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:28:05.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.318+0000 7f46c0ff9700 1 -- 172.21.15.37:0/3139083804 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc040730 con 0x5559d8506ed0 2023-10-06T02:28:05.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.318+0000 7f46c0ff9700 1 -- 172.21.15.37:0/3139083804 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f46dc040890 con 0x5559d8506ed0 2023-10-06T02:28:05.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.318+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3139083804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5559d8526340 con 0x5559d8506ed0 2023-10-06T02:28:05.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.318+0000 7f46c0ff9700 1 -- 172.21.15.37:0/3139083804 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46dc040c60 con 0x5559d8506ed0 2023-10-06T02:28:05.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.318+0000 7f46f1f3eb80 10 client.6672 fetch_fsmap learned FSMap version 47 2023-10-06T02:28:05.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.318+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3139083804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x5559d840b4c0 con 0x5559d8506ed0 2023-10-06T02:28:05.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.318+0000 7f46c0ff9700 1 -- 172.21.15.37:0/3139083804 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc04f080 con 0x5559d8506ed0 2023-10-06T02:28:05.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.318+0000 7f46c0ff9700 1 -- 172.21.15.37:0/3139083804 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 47) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f46dc02c450 con 0x5559d8506ed0 2023-10-06T02:28:05.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.318+0000 7f46f1f3eb80 10 client.6672 fetch_fsmap finished waiting for FSMap version 47 2023-10-06T02:28:05.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.318+0000 7f46f1f3eb80 10 client.6672 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.d 2023-10-06T02:28:05.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.318+0000 7f46f1f3eb80 20 client.6672 populate_metadata read hostname 'smithi037' 2023-10-06T02:28:05.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.318+0000 7f46f1f3eb80 1 --2- 172.21.15.37:0/3139083804 >> [v2:172.21.15.191:6834/2764715102,v1:172.21.15.191:6837/2764715102] conn(0x5559d8526ea0 0x5559d85ab040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.318+0000 7f46f1f3eb80 4 client.6672 mds_command: new command op to 6465 tid=0[{"prefix": "flush journal"}] 2023-10-06T02:28:05.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.318+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3139083804 --> [v2:172.21.15.191:6834/2764715102,v1:172.21.15.191:6837/2764715102] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5559d84fa990 con 0x5559d8526ea0 2023-10-06T02:28:05.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.318+0000 7f46e1d9b700 1 --2- 172.21.15.37:0/3139083804 >> [v2:172.21.15.191:6834/2764715102,v1:172.21.15.191:6837/2764715102] conn(0x5559d8526ea0 0x5559d85ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.319+0000 7f46c0ff9700 10 client.6672 ms_handle_connect on v2:172.21.15.191:6834/2764715102 2023-10-06T02:28:05.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.319+0000 7f46e1d9b700 1 --2- 172.21.15.37:0/3139083804 >> [v2:172.21.15.191:6834/2764715102,v1:172.21.15.191:6837/2764715102] conn(0x5559d8526ea0 0x5559d85ab040 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d75442ec5ca84ed server_cookie=edda54637a4f1560 in_seq=0 out_seq=0 2023-10-06T02:28:05.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.329+0000 7f46c0ff9700 1 -- 172.21.15.37:0/3139083804 <== mds.0 v2:172.21.15.191:6834/2764715102 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5559d84fa990 con 0x5559d8526ea0 2023-10-06T02:28:05.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.329+0000 7f46c0ff9700 10 client.6672 handle_command_reply: tid=0 2023-10-06T02:28:05.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.329+0000 7f46f1f3eb80 1 client.6672 shutdown 2023-10-06T02:28:05.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.329+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3139083804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8506ed0 msgr2=0x5559d8507b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.329+0000 7f46f1f3eb80 1 --2- 172.21.15.37:0/3139083804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8506ed0 0x5559d8507b40 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f46dc014f00 tx=0x7f46dc033000 comp rx=0 tx=0).stop 2023-10-06T02:28:05.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3139083804 shutdown_connections 2023-10-06T02:28:05.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46f1f3eb80 1 --2- 172.21.15.37:0/3139083804 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5559d8508a60 0x5559d85329c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46f1f3eb80 1 --2- 172.21.15.37:0/3139083804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559d8506ed0 0x5559d8507b40 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46f1f3eb80 1 --2- 172.21.15.37:0/3139083804 >> [v2:172.21.15.191:6834/2764715102,v1:172.21.15.191:6837/2764715102] conn(0x5559d8526ea0 0x5559d85ab040 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46f1f3eb80 1 --2- 172.21.15.37:0/3139083804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5559d8507310 0x5559d8532480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46c0ff9700 0 client.6672 ms_handle_reset on v2:172.21.15.191:6834/2764715102 2023-10-06T02:28:05.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3139083804 >> 172.21.15.37:0/3139083804 conn(0x5559d8535d50 msgr2=0x5559d8505be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:05.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3139083804 shutdown_connections 2023-10-06T02:28:05.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46f1f3eb80 1 -- 172.21.15.37:0/3139083804 wait complete. 2023-10-06T02:28:05.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46f1f3eb80 20 client.6672 trim_cache size 0 max 16384 2023-10-06T02:28:05.333 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:28:05.333 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "", 2023-10-06T02:28:05.333 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0 2023-10-06T02:28:05.333 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:28:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46e359e700 1 -- 172.21.15.37:0/4155012443 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f46c4066f30 msgr2=0x7f46c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46e359e700 1 --2- 172.21.15.37:0/4155012443 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f46c4066f30 0x7f46c40693e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f46e406dcc0 tx=0x7f46dc008040 comp rx=0 tx=0).stop 2023-10-06T02:28:05.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46e359e700 1 -- 172.21.15.37:0/4155012443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46e40c8af0 msgr2=0x7f46e40c8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46e359e700 1 --2- 172.21.15.37:0/4155012443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46e40c8af0 0x7f46e40c8f60 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f46d000c130 tx=0x7f46cc015000 comp rx=0 tx=0).stop 2023-10-06T02:28:05.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46e359e700 1 -- 172.21.15.37:0/4155012443 shutdown_connections 2023-10-06T02:28:05.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46e359e700 1 --2- 172.21.15.37:0/4155012443 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46e40c94a0 0x7f46e40c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46e359e700 1 --2- 172.21.15.37:0/4155012443 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f46c4066f30 0x7f46c40693e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46e359e700 1 --2- 172.21.15.37:0/4155012443 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46d0004810 0x7f46e40b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46e359e700 1 --2- 172.21.15.37:0/4155012443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46e40c8af0 0x7f46e40c8f60 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46e359e700 1 -- 172.21.15.37:0/4155012443 >> 172.21.15.37:0/4155012443 conn(0x7f46e4099610 msgr2=0x7f46e406ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:05.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46e359e700 1 -- 172.21.15.37:0/4155012443 shutdown_connections 2023-10-06T02:28:05.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.330+0000 7f46e359e700 1 -- 172.21.15.37:0/4155012443 wait complete. 2023-10-06T02:28:05.343 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:28:05.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.460+0000 7f5763c41700 1 Processor -- start 2023-10-06T02:28:05.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.461+0000 7f5763c41700 1 -- start start 2023-10-06T02:28:05.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.461+0000 7f5763c41700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f575c0b3be0 0x7f575c157be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.461+0000 7f5763c41700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575c158db0 con 0x7f575c068140 2023-10-06T02:28:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.461+0000 7f5763c41700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575c0cc2f0 con 0x7f575c0b3fb0 2023-10-06T02:28:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.461+0000 7f5763c41700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f575c158510 con 0x7f575c0b3be0 2023-10-06T02:28:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57621de700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f575c068140 0x7f575c0cc780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48596/0 (socket says 172.21.15.37:48596) 2023-10-06T02:28:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57621de700 1 -- 172.21.15.37:0/727416446 learned_addr learned my addr 172.21.15.37:0/727416446 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57619dd700 1 --2- 172.21.15.37:0/727416446 >> v2:172.21.15.191:3300/0 conn(0x7f575c0b3be0 0x7f575c157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57609db700 1 -- 172.21.15.37:0/727416446 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274148054 0 0) 0x7f575c158db0 con 0x7f575c068140 2023-10-06T02:28:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57609db700 1 -- 172.21.15.37:0/727416446 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5744003570 con 0x7f575c068140 2023-10-06T02:28:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57609db700 1 -- 172.21.15.37:0/727416446 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4198178123 0 0) 0x7f5744003570 con 0x7f575c068140 2023-10-06T02:28:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57609db700 1 -- 172.21.15.37:0/727416446 >> v2:172.21.15.191:3300/0 conn(0x7f575c0b3be0 msgr2=0x7f575c157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57609db700 1 --2- 172.21.15.37:0/727416446 >> v2:172.21.15.191:3300/0 conn(0x7f575c0b3be0 0x7f575c157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57609db700 1 -- 172.21.15.37:0/727416446 >> v1:172.21.15.191:6789/0 conn(0x7f575c0b3fb0 legacy=0x7f575c067a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57609db700 1 -- 172.21.15.37:0/727416446 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575c1587f0 con 0x7f575c068140 2023-10-06T02:28:05.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57609db700 1 -- 172.21.15.37:0/727416446 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f574c0017f0 con 0x7f575c068140 2023-10-06T02:28:05.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57609db700 1 -- 172.21.15.37:0/727416446 >> v1:172.21.15.37:6789/0 conn(0x7f575c068140 legacy=0x7f575c0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57609db700 1 --2- 172.21.15.37:0/727416446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5744003a60 0x7f5744003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57609db700 1 --2- 172.21.15.37:0/727416446 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5744004810 0x7f5744004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57609db700 1 --2- 172.21.15.37:0/727416446 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57440051c0 0x7f574400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57609db700 1 -- 172.21.15.37:0/727416446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c158510 con 0x7f5744003a60 2023-10-06T02:28:05.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57609db700 1 -- 172.21.15.37:0/727416446 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57440104e0 con 0x7f57440051c0 2023-10-06T02:28:05.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57609db700 1 -- 172.21.15.37:0/727416446 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57440106a0 con 0x7f5744004810 2023-10-06T02:28:05.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57619dd700 1 --2- 172.21.15.37:0/727416446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5744003a60 0x7f5744003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57611dc700 1 --2- 172.21.15.37:0/727416446 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5744004810 0x7f5744004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.462+0000 7f57621de700 1 --2- 172.21.15.37:0/727416446 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57440051c0 0x7f574400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.463+0000 7f57619dd700 1 -- 172.21.15.37:0/727416446 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5744004810 msgr2=0x7f5744004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:05.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.463+0000 7f57619dd700 1 --2- 172.21.15.37:0/727416446 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5744004810 0x7f5744004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.463+0000 7f57619dd700 1 -- 172.21.15.37:0/727416446 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57440051c0 msgr2=0x7f574400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:05.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.463+0000 7f57619dd700 1 --2- 172.21.15.37:0/727416446 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57440051c0 0x7f574400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.463+0000 7f57619dd700 1 -- 172.21.15.37:0/727416446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5744003570 con 0x7f5744003a60 2023-10-06T02:28:05.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.463+0000 7f57621de700 1 -- 172.21.15.37:0/727416446 reap_dead start 2023-10-06T02:28:05.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.463+0000 7f57619dd700 1 --2- 172.21.15.37:0/727416446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5744003a60 0x7f5744003e70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f5754009bf0 tx=0x7f5754009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f18d984347e0f5a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:05.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.463+0000 7f57609db700 1 -- 172.21.15.37:0/727416446 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5754005a00 con 0x7f5744003a60 2023-10-06T02:28:05.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.463+0000 7f57609db700 1 -- 172.21.15.37:0/727416446 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5754005b60 con 0x7f5744003a60 2023-10-06T02:28:05.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.463+0000 7f57609db700 1 -- 172.21.15.37:0/727416446 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575400e710 con 0x7f5744003a60 2023-10-06T02:28:05.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.464+0000 7f5763c41700 1 -- 172.21.15.37:0/727416446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5744003a60 msgr2=0x7f5744003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.464+0000 7f5763c41700 1 --2- 172.21.15.37:0/727416446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5744003a60 0x7f5744003e70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f5754009bf0 tx=0x7f5754009120 comp rx=0 tx=0).stop 2023-10-06T02:28:05.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.464+0000 7f5763c41700 1 -- 172.21.15.37:0/727416446 shutdown_connections 2023-10-06T02:28:05.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.464+0000 7f5763c41700 1 --2- 172.21.15.37:0/727416446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5744003a60 0x7f5744003e70 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.464+0000 7f5763c41700 1 -- 172.21.15.37:0/727416446 >> 172.21.15.37:0/727416446 conn(0x7f575c0ce330 msgr2=0x7f575c0ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:05.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.464+0000 7f5763c41700 1 -- 172.21.15.37:0/727416446 shutdown_connections 2023-10-06T02:28:05.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.464+0000 7f5763c41700 1 -- 172.21.15.37:0/727416446 wait complete. 2023-10-06T02:28:05.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.465+0000 7f5763c41700 1 Processor -- start 2023-10-06T02:28:05.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.465+0000 7f5763c41700 1 -- start start 2023-10-06T02:28:05.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.465+0000 7f5763c41700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5744003a60 0x7f575c169240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.465+0000 7f5763c41700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f575c0c8060 0x7f575c0c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.465+0000 7f5763c41700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f575c06e190 0x7f575c06e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.465+0000 7f5763c41700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c06d1c0 con 0x7f575c0c8060 2023-10-06T02:28:05.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.465+0000 7f5763c41700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c06eb40 con 0x7f5744003a60 2023-10-06T02:28:05.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.465+0000 7f5763c41700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575c06dd00 con 0x7f575c06e190 2023-10-06T02:28:05.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.466+0000 7f57611dc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f575c0c8060 0x7f575c0c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.466+0000 7f57611dc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f575c0c8060 0x7f575c0c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44270/0 (socket says 172.21.15.37:44270) 2023-10-06T02:28:05.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.466+0000 7f57611dc700 1 -- 172.21.15.37:0/1012155182 learned_addr learned my addr 172.21.15.37:0/1012155182 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:05.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.466+0000 7f57619dd700 1 --2- 172.21.15.37:0/1012155182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5744003a60 0x7f575c169240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.466+0000 7f57621de700 1 --2- 172.21.15.37:0/1012155182 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f575c06e190 0x7f575c06e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.466+0000 7f57611dc700 1 -- 172.21.15.37:0/1012155182 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f575c06e190 msgr2=0x7f575c06e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.466+0000 7f57611dc700 1 --2- 172.21.15.37:0/1012155182 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f575c06e190 0x7f575c06e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.466+0000 7f57611dc700 1 -- 172.21.15.37:0/1012155182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5744003a60 msgr2=0x7f575c169240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.466+0000 7f57611dc700 1 --2- 172.21.15.37:0/1012155182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5744003a60 0x7f575c169240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.466+0000 7f57611dc700 1 -- 172.21.15.37:0/1012155182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575c06d3d0 con 0x7f575c0c8060 2023-10-06T02:28:05.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.466+0000 7f57621de700 1 --2- 172.21.15.37:0/1012155182 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f575c06e190 0x7f575c06e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:05.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.466+0000 7f57611dc700 1 --2- 172.21.15.37:0/1012155182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f575c0c8060 0x7f575c0c84d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f5750002980 tx=0x7f5750007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:05.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.466+0000 7f5759ffb700 1 -- 172.21.15.37:0/1012155182 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5750002e10 con 0x7f575c0c8060 2023-10-06T02:28:05.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.466+0000 7f5759ffb700 1 -- 172.21.15.37:0/1012155182 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575000f8d0 con 0x7f575c0c8060 2023-10-06T02:28:05.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.466+0000 7f5763c41700 1 -- 172.21.15.37:0/1012155182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575c06d6b0 con 0x7f575c0c8060 2023-10-06T02:28:05.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.466+0000 7f5759ffb700 1 -- 172.21.15.37:0/1012155182 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575000fc70 con 0x7f575c0c8060 2023-10-06T02:28:05.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.466+0000 7f5763c41700 1 -- 172.21.15.37:0/1012155182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575c169780 con 0x7f575c0c8060 2023-10-06T02:28:05.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.467+0000 7f5763c41700 1 -- 172.21.15.37:0/1012155182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575c06a9d0 con 0x7f575c0c8060 2023-10-06T02:28:05.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.468+0000 7f5759ffb700 1 -- 172.21.15.37:0/1012155182 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5750013600 con 0x7f575c0c8060 2023-10-06T02:28:05.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.468+0000 7f5759ffb700 1 --2- 172.21.15.37:0/1012155182 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5748066f60 0x7f5748069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:05.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.468+0000 7f5759ffb700 1 -- 172.21.15.37:0/1012155182 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5750084ad0 con 0x7f575c0c8060 2023-10-06T02:28:05.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.468+0000 7f57619dd700 1 --2- 172.21.15.37:0/1012155182 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5748066f60 0x7f5748069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:05.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.469+0000 7f57619dd700 1 --2- 172.21.15.37:0/1012155182 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5748066f60 0x7f5748069410 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5754009160 tx=0x7f5754019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:05.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.473+0000 7f5759ffb700 1 -- 172.21.15.37:0/1012155182 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5750051b40 con 0x7f575c0c8060 2023-10-06T02:28:05.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.711+0000 7f5763c41700 1 -- 172.21.15.37:0/1012155182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f575c06de40 con 0x7f575c0c8060 2023-10-06T02:28:05.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.711+0000 7f5759ffb700 1 -- 172.21.15.37:0/1012155182 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5750055160 con 0x7f575c0c8060 2023-10-06T02:28:05.713 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:28:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.713+0000 7f5763c41700 1 -- 172.21.15.37:0/1012155182 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5748066f60 msgr2=0x7f5748069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.713+0000 7f5763c41700 1 --2- 172.21.15.37:0/1012155182 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5748066f60 0x7f5748069410 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5754009160 tx=0x7f5754019000 comp rx=0 tx=0).stop 2023-10-06T02:28:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.713+0000 7f5763c41700 1 -- 172.21.15.37:0/1012155182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f575c0c8060 msgr2=0x7f575c0c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.713+0000 7f5763c41700 1 --2- 172.21.15.37:0/1012155182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f575c0c8060 0x7f575c0c84d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f5750002980 tx=0x7f5750007d30 comp rx=0 tx=0).stop 2023-10-06T02:28:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.713+0000 7f5763c41700 1 -- 172.21.15.37:0/1012155182 shutdown_connections 2023-10-06T02:28:05.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.713+0000 7f5763c41700 1 --2- 172.21.15.37:0/1012155182 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f575c06e190 0x7f575c06e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.713+0000 7f5763c41700 1 --2- 172.21.15.37:0/1012155182 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5748066f60 0x7f5748069410 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.713+0000 7f5763c41700 1 --2- 172.21.15.37:0/1012155182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5744003a60 0x7f575c169240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.713+0000 7f5763c41700 1 --2- 172.21.15.37:0/1012155182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f575c0c8060 0x7f575c0c84d0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:05.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.714+0000 7f5763c41700 1 -- 172.21.15.37:0/1012155182 >> 172.21.15.37:0/1012155182 conn(0x7f575c0ce330 msgr2=0x7f575c0cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:05.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.714+0000 7f5763c41700 1 -- 172.21.15.37:0/1012155182 shutdown_connections 2023-10-06T02:28:05.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:05.714+0000 7f5763c41700 1 -- 172.21.15.37:0/1012155182 wait complete. 2023-10-06T02:28:05.727 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:28:05.727 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:28:05.727 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-10-06T02:28:05.727 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:28:05.727 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:05.727 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:28:05.727 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:28:05.727 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:28:05.727 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:28:05.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:05.728 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-10-06T02:28:05.743 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:28:05.743 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:28:05.744 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:28:05.744 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:05.744 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T02:28:05.744 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:05.744 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:28:05.744 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:05.744 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-10-06T02:28:05.744 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:28:05.744 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:05.744 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-10-06T02:28:05.744 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:28:05.745 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42196sec preferred_lft 42196sec 2023-10-06T02:28:05.745 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-10-06T02:28:05.745 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:05.745 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:28:05.745 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:05.745 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-10-06T02:28:05.745 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:28:05.745 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:05.745 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-10-06T02:28:05.745 INFO:teuthology.orchestra.run.smithi037.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:28:05.745 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 26:84:4a:aa:8b:b5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:05.746 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:28:05.746 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:05.746 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::a0fb:38ff:fe90:57e1/64 scope link 2023-10-06T02:28:05.746 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:05.746 INFO:teuthology.orchestra.run.smithi037.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:28:05.746 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 36:fb:a9:50:59:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:28:05.746 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::34fb:a9ff:fe50:5976/64 scope link 2023-10-06T02:28:05.746 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:05.746 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:28:05.746 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 26:84:4a:aa:8b:b5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:28:05.746 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::2484:4aff:feaa:8bb5/64 scope link 2023-10-06T02:28:05.746 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:05.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:05.747 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:28:05.807 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T02:28:05.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:05.809 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-10-06T02:28:05.865 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-10-06T02:28:05.865 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:28:05.865 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:28:05.865 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:28:05.865 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:28:05.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:05.866 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T02:28:05.866 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T02:28:05.866 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:28:05.866 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:28:05.866 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:28:05.866 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T02:28:05.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:05.967 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T02:28:05.982 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:28:05.982 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:28:05.982 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:28:05.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:05.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-10-06T02:28:06.047 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:28:06.047 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:28:06.048 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:06.104 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:28:06.104 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:28:06.104 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:06.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T02:28:06.224 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:28:06.224 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:28:06.290 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:28:06.290 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:28:06.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:06.291 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T02:28:06.346 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:28:06.346 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:28:06.388 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T02:28:06.412 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:28:06.412 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:28:06.471 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-10-06T02:28:06.470+0000 7fd1e8af7540 -1 init, newargv = 0x559d24a60c70 newargc=15 2023-10-06T02:28:06.471 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[114653]: starting ceph client 2023-10-06T02:28:06.476 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[114653]: starting fuse 2023-10-06T02:28:06.479 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:28:06.480 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:28:06.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:06.481 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T02:28:06.536 INFO:teuthology.orchestra.run.smithi037.stdout:46 2023-10-06T02:28:06.537 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T02:28:06.537 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:06.537 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-10-06T02:28:06.537 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-10-06T02:28:06.537 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:28:06.537 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-10-06T02:28:06.537 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:06.537 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-10-06T02:28:06.537 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:28:06.537 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-10-06T02:28:06.538 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:28:06.538 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:06.538 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-10-06T02:28:06.538 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-10-06T02:28:06.538 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-10-06T02:28:06.538 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-10-06T02:28:06.538 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:06.538 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-10-06T02:28:06.538 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:28:06.538 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:28:06.538 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:28:06.538 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-10-06T02:28:06.539 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-10-06T02:28:06.539 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-10-06T02:28:06.539 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:28:06.539 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:06.539 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-10-06T02:28:06.539 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:28:06.658 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.114653.asok 2023-10-06T02:28:06.840 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.114653.asok 2023-10-06T02:28:06.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:06.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.114653.asok status 2023-10-06T02:28:06.994 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:28:06.995 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-10-06T02:28:06.995 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:28:06.995 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:28:06.995 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-10-06T02:28:06.995 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-10-06T02:28:06.995 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:28:06.995 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "114653", 2023-10-06T02:28:06.995 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-10-06T02:28:06.995 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:28:06.996 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-10-06T02:28:06.996 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-10-06T02:28:06.996 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6684, 2023-10-06T02:28:06.996 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-10-06T02:28:06.996 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-10-06T02:28:06.996 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-10-06T02:28:06.996 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 6684 2023-10-06T02:28:06.996 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:28:06.996 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T02:28:06.996 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T02:28:06.996 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:28:06.996 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 4071082312 2023-10-06T02:28:06.997 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:28:06.997 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:28:06.997 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T02:28:06.997 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T02:28:06.997 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:28:06.997 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 4071082312 2023-10-06T02:28:06.997 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:28:06.997 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.6684 192.168.0.1:0/4071082312", 2023-10-06T02:28:06.997 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/4071082312", 2023-10-06T02:28:06.997 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-10-06T02:28:06.997 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 47, 2023-10-06T02:28:06.997 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 72, 2023-10-06T02:28:06.998 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:28:06.998 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-10-06T02:28:06.998 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-10-06T02:28:06.998 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:28:07.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:07.005 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-10-06T02:28:07.005 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:07.020 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-10-06T02:28:07.020 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:07.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:07.021 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:07.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:07.085 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/unflushed) 2023-10-06T02:28:07.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:07.146 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=./parent/unflushed/jfile bs=1M count=8) 2023-10-06T02:28:07.250 INFO:teuthology.orchestra.run.smithi037.stderr:8+0 records in 2023-10-06T02:28:07.251 INFO:teuthology.orchestra.run.smithi037.stderr:8+0 records out 2023-10-06T02:28:07.251 INFO:teuthology.orchestra.run.smithi037.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.0483346 s, 174 MB/s 2023-10-06T02:28:07.252 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:07.252 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:28:07.252 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:28:07.252 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:07.252 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2023-10-06T02:28:07.252 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:28:07.320 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627779 2023-10-06T02:28:07.508 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:07.508 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:28:07.509 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:28:07.509 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:07.509 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2023-10-06T02:28:07.509 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:28:07.614 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627780 2023-10-06T02:28:07.803 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-10-06T02:28:07.803 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:28:07.803 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:07.877 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[114653]: fuse finished with error 0 and tester_r 0 2023-10-06T02:28:07.879 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:28:13.981 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:28:13.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:13.981 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:28:14.000 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi037.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:14.001 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:28:14.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:14.001 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:28:14.059 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:28:14.059 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T02:28:14.060 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:28:14.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.228+0000 7f5d04d04700 1 Processor -- start 2023-10-06T02:28:14.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.228+0000 7f5d04d04700 1 -- start start 2023-10-06T02:28:14.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.229+0000 7f5d04d04700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5d0006de80 0x7f5d000b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.229+0000 7f5d04d04700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d000cc250 con 0x7f5d0006dab0 2023-10-06T02:28:14.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.229+0000 7f5d04d04700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d000cb640 con 0x7f5d000cb080 2023-10-06T02:28:14.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.229+0000 7f5d04d04700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d000b0e00 con 0x7f5d0006de80 2023-10-06T02:28:14.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.229+0000 7f5cfe59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5d0006dab0 0x7f5d000cc6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48600/0 (socket says 172.21.15.37:48600) 2023-10-06T02:28:14.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.229+0000 7f5cfe59c700 1 -- 172.21.15.37:0/2749439107 learned_addr learned my addr 172.21.15.37:0/2749439107 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:14.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.230+0000 7f5cfed9d700 1 --2- 172.21.15.37:0/2749439107 >> v2:172.21.15.191:3300/0 conn(0x7f5d0006de80 0x7f5d000b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.230+0000 7f5cfd59a700 1 -- 172.21.15.37:0/2749439107 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700944575 0 0) 0x7f5d000cc250 con 0x7f5d0006dab0 2023-10-06T02:28:14.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.230+0000 7f5cfd59a700 1 -- 172.21.15.37:0/2749439107 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cec003570 con 0x7f5d0006dab0 2023-10-06T02:28:14.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.230+0000 7f5cfd59a700 1 -- 172.21.15.37:0/2749439107 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3325495948 0 0) 0x7f5cec003570 con 0x7f5d0006dab0 2023-10-06T02:28:14.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.230+0000 7f5cfd59a700 1 -- 172.21.15.37:0/2749439107 >> v2:172.21.15.191:3300/0 conn(0x7f5d0006de80 msgr2=0x7f5d000b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:14.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.230+0000 7f5cfd59a700 1 --2- 172.21.15.37:0/2749439107 >> v2:172.21.15.191:3300/0 conn(0x7f5d0006de80 0x7f5d000b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.230+0000 7f5cfd59a700 1 -- 172.21.15.37:0/2749439107 >> v1:172.21.15.191:6789/0 conn(0x7f5d000cb080 legacy=0x7f5d000b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:14.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.230+0000 7f5cfd59a700 1 -- 172.21.15.37:0/2749439107 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d000cb920 con 0x7f5d0006dab0 2023-10-06T02:28:14.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.230+0000 7f5cfd59a700 1 -- 172.21.15.37:0/2749439107 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f5cf0001470 con 0x7f5d0006dab0 2023-10-06T02:28:14.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.230+0000 7f5cfd59a700 1 -- 172.21.15.37:0/2749439107 >> v1:172.21.15.37:6789/0 conn(0x7f5d0006dab0 legacy=0x7f5d000cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:14.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.230+0000 7f5cfd59a700 1 --2- 172.21.15.37:0/2749439107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cec003a60 0x7f5cec003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.230+0000 7f5cfd59a700 1 --2- 172.21.15.37:0/2749439107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cec004810 0x7f5cec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.230+0000 7f5cfd59a700 1 --2- 172.21.15.37:0/2749439107 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cec0051c0 0x7f5cec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.230+0000 7f5cfd59a700 1 -- 172.21.15.37:0/2749439107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000b0e00 con 0x7f5cec004810 2023-10-06T02:28:14.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.230+0000 7f5cfd59a700 1 -- 172.21.15.37:0/2749439107 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec00c050 con 0x7f5cec003a60 2023-10-06T02:28:14.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.230+0000 7f5cfd59a700 1 -- 172.21.15.37:0/2749439107 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec00c210 con 0x7f5cec0051c0 2023-10-06T02:28:14.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.230+0000 7f5cfdd9b700 1 --2- 172.21.15.37:0/2749439107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cec004810 0x7f5cec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.230+0000 7f5cfe59c700 1 --2- 172.21.15.37:0/2749439107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cec003a60 0x7f5cec003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.230+0000 7f5cfed9d700 1 --2- 172.21.15.37:0/2749439107 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cec0051c0 0x7f5cec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.231+0000 7f5cfdd9b700 1 -- 172.21.15.37:0/2749439107 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cec0051c0 msgr2=0x7f5cec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.231+0000 7f5cfdd9b700 1 --2- 172.21.15.37:0/2749439107 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cec0051c0 0x7f5cec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.231+0000 7f5cfdd9b700 1 -- 172.21.15.37:0/2749439107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cec003a60 msgr2=0x7f5cec003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.231+0000 7f5cfdd9b700 1 --2- 172.21.15.37:0/2749439107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cec003a60 0x7f5cec003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.231+0000 7f5cfdd9b700 1 -- 172.21.15.37:0/2749439107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cec003570 con 0x7f5cec004810 2023-10-06T02:28:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.231+0000 7f5cfed9d700 1 -- 172.21.15.37:0/2749439107 reap_dead start 2023-10-06T02:28:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.231+0000 7f5cfdd9b700 1 --2- 172.21.15.37:0/2749439107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cec004810 0x7f5cec004c80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8001a60 tx=0x7f5ce8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77074f85a5d05113 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.231+0000 7f5cfd59a700 1 -- 172.21.15.37:0/2749439107 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8001ea0 con 0x7f5cec004810 2023-10-06T02:28:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.231+0000 7f5cfd59a700 1 -- 172.21.15.37:0/2749439107 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce800c590 con 0x7f5cec004810 2023-10-06T02:28:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.231+0000 7f5cfd59a700 1 -- 172.21.15.37:0/2749439107 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce800c930 con 0x7f5cec004810 2023-10-06T02:28:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.231+0000 7f5d04d04700 1 -- 172.21.15.37:0/2749439107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cec004810 msgr2=0x7f5cec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.231+0000 7f5d04d04700 1 --2- 172.21.15.37:0/2749439107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cec004810 0x7f5cec004c80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8001a60 tx=0x7f5ce8007d30 comp rx=0 tx=0).stop 2023-10-06T02:28:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.232+0000 7f5d04d04700 1 -- 172.21.15.37:0/2749439107 shutdown_connections 2023-10-06T02:28:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.232+0000 7f5d04d04700 1 --2- 172.21.15.37:0/2749439107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cec004810 0x7f5cec004c80 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.232+0000 7f5d04d04700 1 -- 172.21.15.37:0/2749439107 >> 172.21.15.37:0/2749439107 conn(0x7f5d000d0510 msgr2=0x7f5d000d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.232+0000 7f5d04d04700 1 -- 172.21.15.37:0/2749439107 shutdown_connections 2023-10-06T02:28:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.232+0000 7f5d04d04700 1 -- 172.21.15.37:0/2749439107 wait complete. 2023-10-06T02:28:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.233+0000 7f5d04d04700 1 Processor -- start 2023-10-06T02:28:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.233+0000 7f5d04d04700 1 -- start start 2023-10-06T02:28:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.233+0000 7f5d04d04700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cec004810 0x7f5d00146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.233+0000 7f5d04d04700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d000c5a10 0x7f5d000c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.233+0000 7f5d04d04700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d00169b40 0x7f5d00169fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.233+0000 7f5d04d04700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000a7140 con 0x7f5d00169b40 2023-10-06T02:28:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.233+0000 7f5d04d04700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000c63c0 con 0x7f5cec004810 2023-10-06T02:28:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.233+0000 7f5d04d04700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0016aac0 con 0x7f5d000c5a10 2023-10-06T02:28:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.234+0000 7f5cfed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d00169b40 0x7f5d00169fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.234+0000 7f5cfed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d00169b40 0x7f5d00169fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44286/0 (socket says 172.21.15.37:44286) 2023-10-06T02:28:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.234+0000 7f5cfed9d700 1 -- 172.21.15.37:0/1598385425 learned_addr learned my addr 172.21.15.37:0/1598385425 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.234+0000 7f5cfe59c700 1 --2- 172.21.15.37:0/1598385425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cec004810 0x7f5d00146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.234+0000 7f5cfdd9b700 1 --2- 172.21.15.37:0/1598385425 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d000c5a10 0x7f5d000c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.234+0000 7f5cfed9d700 1 -- 172.21.15.37:0/1598385425 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d000c5a10 msgr2=0x7f5d000c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.234+0000 7f5cfed9d700 1 --2- 172.21.15.37:0/1598385425 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d000c5a10 0x7f5d000c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.234+0000 7f5cfed9d700 1 -- 172.21.15.37:0/1598385425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cec004810 msgr2=0x7f5d00146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.234+0000 7f5cfed9d700 1 --2- 172.21.15.37:0/1598385425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cec004810 0x7f5d00146f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.234+0000 7f5cfed9d700 1 -- 172.21.15.37:0/1598385425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0016b440 con 0x7f5d00169b40 2023-10-06T02:28:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.234+0000 7f5cfed9d700 1 --2- 172.21.15.37:0/1598385425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d00169b40 0x7f5d00169fe0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f5d000c7540 tx=0x7f5cf800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.234+0000 7f5cf67fc700 1 -- 172.21.15.37:0/1598385425 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf800e070 con 0x7f5d00169b40 2023-10-06T02:28:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.234+0000 7f5cf67fc700 1 -- 172.21.15.37:0/1598385425 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf8011bd0 con 0x7f5d00169b40 2023-10-06T02:28:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.234+0000 7f5d04d04700 1 -- 172.21.15.37:0/1598385425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0016a520 con 0x7f5d00169b40 2023-10-06T02:28:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.234+0000 7f5cf67fc700 1 -- 172.21.15.37:0/1598385425 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8016470 con 0x7f5d00169b40 2023-10-06T02:28:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.234+0000 7f5d04d04700 1 -- 172.21.15.37:0/1598385425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0016adf0 con 0x7f5d00169b40 2023-10-06T02:28:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.235+0000 7f5d04d04700 1 -- 172.21.15.37:0/1598385425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d00088ba0 con 0x7f5d00169b40 2023-10-06T02:28:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.236+0000 7f5cf67fc700 1 -- 172.21.15.37:0/1598385425 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5cf8016820 con 0x7f5d00169b40 2023-10-06T02:28:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.236+0000 7f5cf67fc700 1 --2- 172.21.15.37:0/1598385425 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ce0066f30 0x7f5ce00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.236+0000 7f5cf67fc700 1 -- 172.21.15.37:0/1598385425 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5cf80852a0 con 0x7f5d00169b40 2023-10-06T02:28:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.236+0000 7f5cfe59c700 1 --2- 172.21.15.37:0/1598385425 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ce0066f30 0x7f5ce00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.237+0000 7f5cfe59c700 1 --2- 172.21.15.37:0/1598385425 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ce0066f30 0x7f5ce00693e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0001c80 tx=0x7f5cf0001df0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:14.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.240+0000 7f5cf67fc700 1 -- 172.21.15.37:0/1598385425 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5cf8055f00 con 0x7f5d00169b40 2023-10-06T02:28:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.481+0000 7f5d04d04700 1 -- 172.21.15.37:0/1598385425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5d000cbc00 con 0x7f5d00169b40 2023-10-06T02:28:14.483 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-10-06T02:28:14.482+0000 7f292cc58700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:28:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.488+0000 7f5cf67fc700 1 -- 172.21.15.37:0/1598385425 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5cf8055a90 con 0x7f5d00169b40 2023-10-06T02:28:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.490+0000 7f5d04d04700 1 -- 172.21.15.37:0/1598385425 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ce0066f30 msgr2=0x7f5ce00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.490+0000 7f5d04d04700 1 --2- 172.21.15.37:0/1598385425 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ce0066f30 0x7f5ce00693e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0001c80 tx=0x7f5cf0001df0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.490+0000 7f5d04d04700 1 -- 172.21.15.37:0/1598385425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d00169b40 msgr2=0x7f5d00169fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.490+0000 7f5d04d04700 1 --2- 172.21.15.37:0/1598385425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d00169b40 0x7f5d00169fe0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f5d000c7540 tx=0x7f5cf800b040 comp rx=0 tx=0).stop 2023-10-06T02:28:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.490+0000 7f5d04d04700 1 -- 172.21.15.37:0/1598385425 shutdown_connections 2023-10-06T02:28:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.490+0000 7f5d04d04700 1 --2- 172.21.15.37:0/1598385425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d00169b40 0x7f5d00169fe0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.490+0000 7f5d04d04700 1 --2- 172.21.15.37:0/1598385425 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ce0066f30 0x7f5ce00693e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.490+0000 7f5d04d04700 1 --2- 172.21.15.37:0/1598385425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cec004810 0x7f5d00146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.490+0000 7f5d04d04700 1 --2- 172.21.15.37:0/1598385425 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d000c5a10 0x7f5d000c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.490+0000 7f5d04d04700 1 -- 172.21.15.37:0/1598385425 >> 172.21.15.37:0/1598385425 conn(0x7f5d000d0510 msgr2=0x7f5d000cd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:14.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.490+0000 7f5d04d04700 1 -- 172.21.15.37:0/1598385425 shutdown_connections 2023-10-06T02:28:14.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.490+0000 7f5d04d04700 1 -- 172.21.15.37:0/1598385425 wait complete. 2023-10-06T02:28:14.493 INFO:tasks.ceph.mds.d.smithi191.stderr: -7443> 2023-10-06T02:27:48.111+0000 7ff194ae9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:28:14.494 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:28:14.505 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:28:14.507 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:28:14.523 INFO:tasks.ceph.mds.d.smithi191.stdout:starting mds.d at 2023-10-06T02:28:14.550 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2023-10-06T02:28:14.551 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2023-10-06T02:28:14.551 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:28:14.551 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2023-10-06T02:28:14.551 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.551 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2023-10-06T02:28:14.551 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.551 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2023-10-06T02:28:14.551 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.551 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2023-10-06T02:28:14.552 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2023-10-06T02:28:14.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.552 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2023-10-06T02:28:14.552 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2023-10-06T02:28:14.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.552 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:28:14.552 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2023-10-06T02:28:14.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.552 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:28:14.552 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:28:14.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.552 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2023-10-06T02:28:14.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.553 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2023-10-06T02:28:14.553 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2023-10-06T02:28:14.553 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:28:14.553 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:28:14.553 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2023-10-06T02:28:14.553 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:28:14.553 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2023-10-06T02:28:14.553 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:28:14.553 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:28:14.553 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2023-10-06T02:28:14.553 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.553 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:28:14.554 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.554 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2023-10-06T02:28:14.554 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.554 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2023-10-06T02:28:14.554 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.554 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2023-10-06T02:28:14.554 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2023-10-06T02:28:14.554 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2023-10-06T02:28:14.554 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]" 2023-10-06T02:28:14.554 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = d1f292a2-fd8c-430a-be88-f44de408e77c 2023-10-06T02:28:14.554 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.554 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2023-10-06T02:28:14.555 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2023-10-06T02:28:14.555 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.555 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2023-10-06T02:28:14.555 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2023-10-06T02:28:14.555 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:28:14.555 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.555 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2023-10-06T02:28:14.555 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2023-10-06T02:28:14.555 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.555 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2023-10-06T02:28:14.555 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2023-10-06T02:28:14.555 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2023-10-06T02:28:14.556 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.556 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2023-10-06T02:28:14.556 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2023-10-06T02:28:14.556 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.556 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:28:14.556 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.556 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2023-10-06T02:28:14.556 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.556 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2023-10-06T02:28:14.556 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.556 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:28:14.556 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2023-10-06T02:28:14.557 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.557 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2023-10-06T02:28:14.557 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2023-10-06T02:28:14.557 INFO:teuthology.orchestra.run.smithi037.stdout: bdev async discard = True 2023-10-06T02:28:14.557 INFO:teuthology.orchestra.run.smithi037.stdout: bdev enable discard = True 2023-10-06T02:28:14.557 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore allocator = bitmap 2023-10-06T02:28:14.557 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2023-10-06T02:28:14.557 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2023-10-06T02:28:14.557 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 1/20 2023-10-06T02:28:14.557 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 1/20 2023-10-06T02:28:14.557 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:28:14.557 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2023-10-06T02:28:14.557 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 4/10 2023-10-06T02:28:14.558 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:28:14.558 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2023-10-06T02:28:14.558 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:28:14.558 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:28:14.558 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2023-10-06T02:28:14.558 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-10-06T02:28:14.558 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.558 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2023-10-06T02:28:14.558 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:28:14.558 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2023-10-06T02:28:14.558 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-10-06T02:28:14.559 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-10-06T02:28:14.559 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:28:14.559 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:28:14.559 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2023-10-06T02:28:14.559 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.559 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2023-10-06T02:28:14.559 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:28:14.559 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-10-06T02:28:14.560 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2023-10-06T02:28:14.560 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-10-06T02:28:14.560 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2023-10-06T02:28:14.560 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2023-10-06T02:28:14.560 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:28:14.560 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2023-10-06T02:28:14.560 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2023-10-06T02:28:14.560 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:28:14.560 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.560 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:28:14.560 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:28:14.560 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:28:14.561 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.561 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:28:14.561 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:28:14.561 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:28:14.561 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.561 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2023-10-06T02:28:14.561 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:28:14.561 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.561 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:28:14.561 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2023-10-06T02:28:14.561 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.561 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2023-10-06T02:28:14.561 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2023-10-06T02:28:14.562 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2023-10-06T02:28:14.562 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2023-10-06T02:28:14.562 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:28:14.562 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:28:14.562 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2023-10-06T02:28:14.562 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2023-10-06T02:28:14.562 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:28:14.562 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = "" 2023-10-06T02:28:14.562 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-10-06T02:28:14.562 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-10-06T02:28:14.562 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2023-10-06T02:28:14.562 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2023-10-06T02:28:14.563 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2023-10-06T02:28:14.563 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-10-06T02:28:14.563 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-10-06T02:28:14.563 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-10-06T02:28:14.563 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-10-06T02:28:14.563 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2023-10-06T02:28:14.563 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2023-10-06T02:28:14.563 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:28:14.563 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2023-10-06T02:28:14.563 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = True 2023-10-06T02:28:14.563 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2023-10-06T02:28:14.563 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = False 2023-10-06T02:28:14.563 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-10-06T02:28:14.564 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-10-06T02:28:14.564 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-10-06T02:28:14.564 INFO:teuthology.orchestra.run.smithi191.stdout:[global] 2023-10-06T02:28:14.564 INFO:teuthology.orchestra.run.smithi191.stdout: chdir = "" 2023-10-06T02:28:14.564 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:28:14.564 INFO:teuthology.orchestra.run.smithi191.stdout: auth supported = cephx 2023-10-06T02:28:14.565 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.565 INFO:teuthology.orchestra.run.smithi191.stdout: filestore xattr use omap = true 2023-10-06T02:28:14.565 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.565 INFO:teuthology.orchestra.run.smithi191.stdout: mon clock drift allowed = 1.000 2023-10-06T02:28:14.565 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.565 INFO:teuthology.orchestra.run.smithi191.stdout: osd crush chooseleaf type = 0 2023-10-06T02:28:14.565 INFO:teuthology.orchestra.run.smithi191.stdout: auth debug = true 2023-10-06T02:28:14.565 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.565 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on old message = true 2023-10-06T02:28:14.565 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on bug = true 2023-10-06T02:28:14.566 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.566 INFO:teuthology.orchestra.run.smithi191.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:28:14.566 INFO:teuthology.orchestra.run.smithi191.stdout: mon pg warn max object skew = 0 2023-10-06T02:28:14.566 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.566 INFO:teuthology.orchestra.run.smithi191.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:28:14.566 INFO:teuthology.orchestra.run.smithi191.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:28:14.566 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.566 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default size = 2 2023-10-06T02:28:14.566 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.566 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow primary affinity = true 2023-10-06T02:28:14.566 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow pg remap = true 2023-10-06T02:28:14.566 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:28:14.567 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:28:14.567 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on no sortbitwise = false 2023-10-06T02:28:14.567 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:28:14.567 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on too few osds = false 2023-10-06T02:28:14.567 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:28:14.567 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:28:14.567 INFO:teuthology.orchestra.run.smithi191.stdout: mon_allow_pool_size_one = true 2023-10-06T02:28:14.567 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.567 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:28:14.567 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.567 INFO:teuthology.orchestra.run.smithi191.stdout: osd default data pool replay window = 5 2023-10-06T02:28:14.567 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.568 INFO:teuthology.orchestra.run.smithi191.stdout: mon allow pool delete = true 2023-10-06T02:28:14.568 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.568 INFO:teuthology.orchestra.run.smithi191.stdout: mon cluster log file level = debug 2023-10-06T02:28:14.568 INFO:teuthology.orchestra.run.smithi191.stdout: debug asserts on shutdown = true 2023-10-06T02:28:14.568 INFO:teuthology.orchestra.run.smithi191.stdout: mon health detail to clog = false 2023-10-06T02:28:14.568 INFO:teuthology.orchestra.run.smithi191.stdout: mon host = "172.21.15.37,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]" 2023-10-06T02:28:14.568 INFO:teuthology.orchestra.run.smithi191.stdout: fsid = d1f292a2-fd8c-430a-be88-f44de408e77c 2023-10-06T02:28:14.568 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.568 INFO:teuthology.orchestra.run.smithi191.stdout:[osd] 2023-10-06T02:28:14.568 INFO:teuthology.orchestra.run.smithi191.stdout: osd journal size = 100 2023-10-06T02:28:14.568 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.568 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub load threshold = 5.0 2023-10-06T02:28:14.569 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub max interval = 600 2023-10-06T02:28:14.569 INFO:teuthology.orchestra.run.smithi191.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:28:14.569 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.569 INFO:teuthology.orchestra.run.smithi191.stdout: osd recover clone overlap = true 2023-10-06T02:28:14.569 INFO:teuthology.orchestra.run.smithi191.stdout: osd recovery max chunk = 1048576 2023-10-06T02:28:14.569 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.569 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug shutdown = true 2023-10-06T02:28:14.569 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug op order = true 2023-10-06T02:28:14.569 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug verify stray on activate = true 2023-10-06T02:28:14.570 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.570 INFO:teuthology.orchestra.run.smithi191.stdout: osd open classes on start = true 2023-10-06T02:28:14.570 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug pg log writeout = true 2023-10-06T02:28:14.570 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.570 INFO:teuthology.orchestra.run.smithi191.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:28:14.570 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.570 INFO:teuthology.orchestra.run.smithi191.stdout: osd map max advance = 10 2023-10-06T02:28:14.570 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.570 INFO:teuthology.orchestra.run.smithi191.stdout: journal zero on create = true 2023-10-06T02:28:14.570 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.570 INFO:teuthology.orchestra.run.smithi191.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:28:14.570 INFO:teuthology.orchestra.run.smithi191.stdout: filestore apply finisher threads = 3 2023-10-06T02:28:14.571 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.571 INFO:teuthology.orchestra.run.smithi191.stdout: bdev debug aio = true 2023-10-06T02:28:14.571 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug misdirected ops = true 2023-10-06T02:28:14.571 INFO:teuthology.orchestra.run.smithi191.stdout: bdev async discard = True 2023-10-06T02:28:14.571 INFO:teuthology.orchestra.run.smithi191.stdout: bdev enable discard = True 2023-10-06T02:28:14.571 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore allocator = bitmap 2023-10-06T02:28:14.571 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore block size = 96636764160 2023-10-06T02:28:14.571 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore fsck on mount = True 2023-10-06T02:28:14.571 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluefs = 1/20 2023-10-06T02:28:14.571 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluestore = 1/20 2023-10-06T02:28:14.571 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:28:14.571 INFO:teuthology.orchestra.run.smithi191.stdout: debug osd = 20 2023-10-06T02:28:14.572 INFO:teuthology.orchestra.run.smithi191.stdout: debug rocksdb = 4/10 2023-10-06T02:28:14.572 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:28:14.572 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd full ratio = 0.9 2023-10-06T02:28:14.572 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:28:14.572 INFO:teuthology.orchestra.run.smithi191.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:28:14.572 INFO:teuthology.orchestra.run.smithi191.stdout: osd objectstore = bluestore 2023-10-06T02:28:14.572 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2023-10-06T02:28:14.572 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.572 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr] 2023-10-06T02:28:14.572 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:28:14.572 INFO:teuthology.orchestra.run.smithi191.stdout: debug mgr = 20 2023-10-06T02:28:14.572 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2023-10-06T02:28:14.573 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2023-10-06T02:28:14.573 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:28:14.573 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:28:14.573 INFO:teuthology.orchestra.run.smithi191.stdout: mgr/telemetry/nag = false 2023-10-06T02:28:14.573 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.573 INFO:teuthology.orchestra.run.smithi191.stdout:[mon] 2023-10-06T02:28:14.573 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:28:14.573 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2023-10-06T02:28:14.573 INFO:teuthology.orchestra.run.smithi191.stdout: debug paxos = 20 2023-10-06T02:28:14.573 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2023-10-06T02:28:14.573 INFO:teuthology.orchestra.run.smithi191.stdout: mon data avail warn = 5 2023-10-06T02:28:14.573 INFO:teuthology.orchestra.run.smithi191.stdout: mon mgr mkfs grace = 240 2023-10-06T02:28:14.573 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:28:14.574 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd reporter subtree level = osd 2023-10-06T02:28:14.574 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd prime pg temp = true 2023-10-06T02:28:14.574 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:28:14.574 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.574 INFO:teuthology.orchestra.run.smithi191.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:28:14.574 INFO:teuthology.orchestra.run.smithi191.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:28:14.574 INFO:teuthology.orchestra.run.smithi191.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:28:14.574 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.574 INFO:teuthology.orchestra.run.smithi191.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:28:14.574 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:28:14.574 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:28:14.574 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.575 INFO:teuthology.orchestra.run.smithi191.stdout: # 1m isn't quite enough 2023-10-06T02:28:14.575 INFO:teuthology.orchestra.run.smithi191.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:28:14.575 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.575 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:28:14.575 INFO:teuthology.orchestra.run.smithi191.stdout: mon op complaint time = 120 2023-10-06T02:28:14.575 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.575 INFO:teuthology.orchestra.run.smithi191.stdout:[client] 2023-10-06T02:28:14.575 INFO:teuthology.orchestra.run.smithi191.stdout: rgw cache enabled = true 2023-10-06T02:28:14.575 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable ops log = true 2023-10-06T02:28:14.575 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable usage log = true 2023-10-06T02:28:14.575 INFO:teuthology.orchestra.run.smithi191.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:28:14.575 INFO:teuthology.orchestra.run.smithi191.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:28:14.575 INFO:teuthology.orchestra.run.smithi191.stdout: client mount timeout = 600 2023-10-06T02:28:14.576 INFO:teuthology.orchestra.run.smithi191.stdout: debug client = 20 2023-10-06T02:28:14.576 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:28:14.576 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = "" 2023-10-06T02:28:14.576 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2023-10-06T02:28:14.576 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2023-10-06T02:28:14.576 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.a] 2023-10-06T02:28:14.576 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.b] 2023-10-06T02:28:14.576 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.c] 2023-10-06T02:28:14.576 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.a] 2023-10-06T02:28:14.576 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.c] 2023-10-06T02:28:14.576 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.b] 2023-10-06T02:28:14.576 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.d] 2023-10-06T02:28:14.577 INFO:teuthology.orchestra.run.smithi191.stdout:[mds] 2023-10-06T02:28:14.577 INFO:teuthology.orchestra.run.smithi191.stdout: debug mds = 20 2023-10-06T02:28:14.577 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:28:14.577 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug frag = True 2023-10-06T02:28:14.577 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug scatterstat = True 2023-10-06T02:28:14.577 INFO:teuthology.orchestra.run.smithi191.stdout: mds op complaint time = 180 2023-10-06T02:28:14.577 INFO:teuthology.orchestra.run.smithi191.stdout: mds verify scatter = False 2023-10-06T02:28:14.577 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2023-10-06T02:28:14.577 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2023-10-06T02:28:14.577 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2023-10-06T02:28:14.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:28:14.620 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:28:14.662 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2023-10-06T02:28:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2023-10-06T02:28:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:28:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2023-10-06T02:28:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2023-10-06T02:28:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2023-10-06T02:28:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2023-10-06T02:28:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2023-10-06T02:28:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2023-10-06T02:28:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2023-10-06T02:28:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:28:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2023-10-06T02:28:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:28:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:28:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2023-10-06T02:28:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2023-10-06T02:28:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2023-10-06T02:28:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:28:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:28:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2023-10-06T02:28:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:28:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2023-10-06T02:28:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:28:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:28:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2023-10-06T02:28:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:28:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2023-10-06T02:28:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2023-10-06T02:28:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2023-10-06T02:28:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2023-10-06T02:28:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2023-10-06T02:28:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]" 2023-10-06T02:28:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = d1f292a2-fd8c-430a-be88-f44de408e77c 2023-10-06T02:28:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.667 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2023-10-06T02:28:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2023-10-06T02:28:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2023-10-06T02:28:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2023-10-06T02:28:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:28:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2023-10-06T02:28:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2023-10-06T02:28:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2023-10-06T02:28:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2023-10-06T02:28:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2023-10-06T02:28:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2023-10-06T02:28:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2023-10-06T02:28:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:28:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2023-10-06T02:28:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2023-10-06T02:28:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:28:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2023-10-06T02:28:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2023-10-06T02:28:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2023-10-06T02:28:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: bdev async discard = True 2023-10-06T02:28:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: bdev enable discard = True 2023-10-06T02:28:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore allocator = bitmap 2023-10-06T02:28:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2023-10-06T02:28:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2023-10-06T02:28:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 1/20 2023-10-06T02:28:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 1/20 2023-10-06T02:28:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:28:14.670 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2023-10-06T02:28:14.670 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 4/10 2023-10-06T02:28:14.670 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:28:14.670 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2023-10-06T02:28:14.670 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:28:14.670 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:28:14.670 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2023-10-06T02:28:14.670 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-10-06T02:28:14.670 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.670 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2023-10-06T02:28:14.670 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:28:14.670 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2023-10-06T02:28:14.671 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-10-06T02:28:14.671 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-10-06T02:28:14.671 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:28:14.671 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:28:14.671 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2023-10-06T02:28:14.671 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.671 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2023-10-06T02:28:14.671 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:28:14.671 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-10-06T02:28:14.671 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2023-10-06T02:28:14.671 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-10-06T02:28:14.671 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2023-10-06T02:28:14.671 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2023-10-06T02:28:14.672 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:28:14.672 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2023-10-06T02:28:14.672 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2023-10-06T02:28:14.672 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:28:14.672 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.672 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:28:14.672 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:28:14.672 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:28:14.672 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.672 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:28:14.672 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:28:14.672 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:28:14.673 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.673 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2023-10-06T02:28:14.673 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:28:14.673 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.673 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:28:14.673 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2023-10-06T02:28:14.673 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:14.673 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2023-10-06T02:28:14.673 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2023-10-06T02:28:14.673 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2023-10-06T02:28:14.673 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2023-10-06T02:28:14.673 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:28:14.673 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:28:14.674 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2023-10-06T02:28:14.674 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2023-10-06T02:28:14.674 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:28:14.674 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = "" 2023-10-06T02:28:14.674 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-10-06T02:28:14.674 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-10-06T02:28:14.674 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2023-10-06T02:28:14.674 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2023-10-06T02:28:14.674 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2023-10-06T02:28:14.674 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-10-06T02:28:14.674 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-10-06T02:28:14.675 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-10-06T02:28:14.675 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-10-06T02:28:14.675 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2023-10-06T02:28:14.675 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2023-10-06T02:28:14.675 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:28:14.675 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2023-10-06T02:28:14.675 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = False 2023-10-06T02:28:14.675 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2023-10-06T02:28:14.675 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = False 2023-10-06T02:28:14.675 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-10-06T02:28:14.676 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-10-06T02:28:14.676 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-10-06T02:28:14.677 INFO:teuthology.orchestra.run.smithi191.stdout:[global] 2023-10-06T02:28:14.677 INFO:teuthology.orchestra.run.smithi191.stdout: chdir = "" 2023-10-06T02:28:14.677 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:28:14.677 INFO:teuthology.orchestra.run.smithi191.stdout: auth supported = cephx 2023-10-06T02:28:14.677 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.678 INFO:teuthology.orchestra.run.smithi191.stdout: filestore xattr use omap = true 2023-10-06T02:28:14.678 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.678 INFO:teuthology.orchestra.run.smithi191.stdout: mon clock drift allowed = 1.000 2023-10-06T02:28:14.678 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.678 INFO:teuthology.orchestra.run.smithi191.stdout: osd crush chooseleaf type = 0 2023-10-06T02:28:14.678 INFO:teuthology.orchestra.run.smithi191.stdout: auth debug = true 2023-10-06T02:28:14.678 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.678 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on old message = true 2023-10-06T02:28:14.678 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on bug = true 2023-10-06T02:28:14.678 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.678 INFO:teuthology.orchestra.run.smithi191.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:28:14.679 INFO:teuthology.orchestra.run.smithi191.stdout: mon pg warn max object skew = 0 2023-10-06T02:28:14.679 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.679 INFO:teuthology.orchestra.run.smithi191.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:28:14.679 INFO:teuthology.orchestra.run.smithi191.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:28:14.679 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.679 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default size = 2 2023-10-06T02:28:14.679 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.679 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow primary affinity = true 2023-10-06T02:28:14.679 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow pg remap = true 2023-10-06T02:28:14.679 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:28:14.679 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:28:14.679 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on no sortbitwise = false 2023-10-06T02:28:14.680 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:28:14.680 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on too few osds = false 2023-10-06T02:28:14.680 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:28:14.680 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:28:14.680 INFO:teuthology.orchestra.run.smithi191.stdout: mon_allow_pool_size_one = true 2023-10-06T02:28:14.680 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.680 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:28:14.680 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.680 INFO:teuthology.orchestra.run.smithi191.stdout: osd default data pool replay window = 5 2023-10-06T02:28:14.680 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.680 INFO:teuthology.orchestra.run.smithi191.stdout: mon allow pool delete = true 2023-10-06T02:28:14.680 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.681 INFO:teuthology.orchestra.run.smithi191.stdout: mon cluster log file level = debug 2023-10-06T02:28:14.681 INFO:teuthology.orchestra.run.smithi191.stdout: debug asserts on shutdown = true 2023-10-06T02:28:14.681 INFO:teuthology.orchestra.run.smithi191.stdout: mon health detail to clog = false 2023-10-06T02:28:14.681 INFO:teuthology.orchestra.run.smithi191.stdout: mon host = "172.21.15.37,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]" 2023-10-06T02:28:14.681 INFO:teuthology.orchestra.run.smithi191.stdout: fsid = d1f292a2-fd8c-430a-be88-f44de408e77c 2023-10-06T02:28:14.681 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.681 INFO:teuthology.orchestra.run.smithi191.stdout:[osd] 2023-10-06T02:28:14.681 INFO:teuthology.orchestra.run.smithi191.stdout: osd journal size = 100 2023-10-06T02:28:14.681 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.681 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub load threshold = 5.0 2023-10-06T02:28:14.681 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub max interval = 600 2023-10-06T02:28:14.681 INFO:teuthology.orchestra.run.smithi191.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:28:14.681 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.682 INFO:teuthology.orchestra.run.smithi191.stdout: osd recover clone overlap = true 2023-10-06T02:28:14.682 INFO:teuthology.orchestra.run.smithi191.stdout: osd recovery max chunk = 1048576 2023-10-06T02:28:14.682 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.682 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug shutdown = true 2023-10-06T02:28:14.682 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug op order = true 2023-10-06T02:28:14.682 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug verify stray on activate = true 2023-10-06T02:28:14.682 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.682 INFO:teuthology.orchestra.run.smithi191.stdout: osd open classes on start = true 2023-10-06T02:28:14.682 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug pg log writeout = true 2023-10-06T02:28:14.682 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.682 INFO:teuthology.orchestra.run.smithi191.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:28:14.683 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.683 INFO:teuthology.orchestra.run.smithi191.stdout: osd map max advance = 10 2023-10-06T02:28:14.683 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.683 INFO:teuthology.orchestra.run.smithi191.stdout: journal zero on create = true 2023-10-06T02:28:14.683 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.683 INFO:teuthology.orchestra.run.smithi191.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:28:14.683 INFO:teuthology.orchestra.run.smithi191.stdout: filestore apply finisher threads = 3 2023-10-06T02:28:14.683 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.683 INFO:teuthology.orchestra.run.smithi191.stdout: bdev debug aio = true 2023-10-06T02:28:14.683 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug misdirected ops = true 2023-10-06T02:28:14.683 INFO:teuthology.orchestra.run.smithi191.stdout: bdev async discard = True 2023-10-06T02:28:14.683 INFO:teuthology.orchestra.run.smithi191.stdout: bdev enable discard = True 2023-10-06T02:28:14.684 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore allocator = bitmap 2023-10-06T02:28:14.684 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore block size = 96636764160 2023-10-06T02:28:14.684 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore fsck on mount = True 2023-10-06T02:28:14.684 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluefs = 1/20 2023-10-06T02:28:14.684 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluestore = 1/20 2023-10-06T02:28:14.684 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:28:14.684 INFO:teuthology.orchestra.run.smithi191.stdout: debug osd = 20 2023-10-06T02:28:14.684 INFO:teuthology.orchestra.run.smithi191.stdout: debug rocksdb = 4/10 2023-10-06T02:28:14.684 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:28:14.684 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd full ratio = 0.9 2023-10-06T02:28:14.684 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:28:14.684 INFO:teuthology.orchestra.run.smithi191.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:28:14.685 INFO:teuthology.orchestra.run.smithi191.stdout: osd objectstore = bluestore 2023-10-06T02:28:14.685 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2023-10-06T02:28:14.685 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.685 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr] 2023-10-06T02:28:14.685 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:28:14.685 INFO:teuthology.orchestra.run.smithi191.stdout: debug mgr = 20 2023-10-06T02:28:14.685 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2023-10-06T02:28:14.685 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2023-10-06T02:28:14.685 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:28:14.685 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:28:14.685 INFO:teuthology.orchestra.run.smithi191.stdout: mgr/telemetry/nag = false 2023-10-06T02:28:14.685 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.685 INFO:teuthology.orchestra.run.smithi191.stdout:[mon] 2023-10-06T02:28:14.686 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:28:14.686 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2023-10-06T02:28:14.686 INFO:teuthology.orchestra.run.smithi191.stdout: debug paxos = 20 2023-10-06T02:28:14.686 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2023-10-06T02:28:14.686 INFO:teuthology.orchestra.run.smithi191.stdout: mon data avail warn = 5 2023-10-06T02:28:14.686 INFO:teuthology.orchestra.run.smithi191.stdout: mon mgr mkfs grace = 240 2023-10-06T02:28:14.686 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:28:14.686 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd reporter subtree level = osd 2023-10-06T02:28:14.686 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd prime pg temp = true 2023-10-06T02:28:14.686 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:28:14.686 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.686 INFO:teuthology.orchestra.run.smithi191.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:28:14.687 INFO:teuthology.orchestra.run.smithi191.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:28:14.687 INFO:teuthology.orchestra.run.smithi191.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:28:14.687 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.687 INFO:teuthology.orchestra.run.smithi191.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:28:14.687 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:28:14.687 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:28:14.687 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.687 INFO:teuthology.orchestra.run.smithi191.stdout: # 1m isn't quite enough 2023-10-06T02:28:14.687 INFO:teuthology.orchestra.run.smithi191.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:28:14.687 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.687 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:28:14.688 INFO:teuthology.orchestra.run.smithi191.stdout: mon op complaint time = 120 2023-10-06T02:28:14.688 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:14.688 INFO:teuthology.orchestra.run.smithi191.stdout:[client] 2023-10-06T02:28:14.688 INFO:teuthology.orchestra.run.smithi191.stdout: rgw cache enabled = true 2023-10-06T02:28:14.688 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable ops log = true 2023-10-06T02:28:14.688 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable usage log = true 2023-10-06T02:28:14.688 INFO:teuthology.orchestra.run.smithi191.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:28:14.688 INFO:teuthology.orchestra.run.smithi191.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:28:14.688 INFO:teuthology.orchestra.run.smithi191.stdout: client mount timeout = 600 2023-10-06T02:28:14.688 INFO:teuthology.orchestra.run.smithi191.stdout: debug client = 20 2023-10-06T02:28:14.688 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:28:14.688 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = "" 2023-10-06T02:28:14.688 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2023-10-06T02:28:14.689 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2023-10-06T02:28:14.689 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.a] 2023-10-06T02:28:14.689 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.b] 2023-10-06T02:28:14.689 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.c] 2023-10-06T02:28:14.689 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.a] 2023-10-06T02:28:14.689 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.c] 2023-10-06T02:28:14.689 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.b] 2023-10-06T02:28:14.689 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.d] 2023-10-06T02:28:14.689 INFO:teuthology.orchestra.run.smithi191.stdout:[mds] 2023-10-06T02:28:14.689 INFO:teuthology.orchestra.run.smithi191.stdout: debug mds = 20 2023-10-06T02:28:14.689 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:28:14.689 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug frag = True 2023-10-06T02:28:14.689 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug scatterstat = False 2023-10-06T02:28:14.690 INFO:teuthology.orchestra.run.smithi191.stdout: mds op complaint time = 180 2023-10-06T02:28:14.690 INFO:teuthology.orchestra.run.smithi191.stdout: mds verify scatter = False 2023-10-06T02:28:14.690 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2023-10-06T02:28:14.690 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2023-10-06T02:28:14.690 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2023-10-06T02:28:14.690 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000001.00000000 bravo_head 2023-10-06T02:28:14.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.754+0000 7fafd2e4e000 1 Processor -- start 2023-10-06T02:28:14.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.754+0000 7fafd2e4e000 1 -- start start 2023-10-06T02:28:14.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.755+0000 7fafd2e4e000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564b4c6fc9d0 0x564b4c73c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.755+0000 7fafd2e4e000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564b4c6fe8f0 0x564b4c7d5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.755+0000 7fafd2e4e000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564b4c729300 0x564b4c7d6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.755+0000 7fafd2e4e000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b4c646980 con 0x564b4c6fc9d0 2023-10-06T02:28:14.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.755+0000 7fafd2e4e000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b4c646620 con 0x564b4c729300 2023-10-06T02:28:14.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.755+0000 7fafd2e4e000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b4c63d400 con 0x564b4c6fe8f0 2023-10-06T02:28:14.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.755+0000 7fafcc089700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564b4c6fc9d0 0x564b4c73c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.755+0000 7fafcc089700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564b4c6fc9d0 0x564b4c73c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44314/0 (socket says 172.21.15.37:44314) 2023-10-06T02:28:14.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.755+0000 7fafcc089700 1 -- 172.21.15.37:0/3762314584 learned_addr learned my addr 172.21.15.37:0/3762314584 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:14.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.755+0000 7fafcc88a700 1 --2- 172.21.15.37:0/3762314584 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564b4c729300 0x564b4c7d6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.755+0000 7fafcb888700 1 --2- 172.21.15.37:0/3762314584 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564b4c6fe8f0 0x564b4c7d5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.755+0000 7fafcc089700 1 -- 172.21.15.37:0/3762314584 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564b4c6fe8f0 msgr2=0x564b4c7d5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:14.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.755+0000 7fafcc089700 1 --2- 172.21.15.37:0/3762314584 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564b4c6fe8f0 0x564b4c7d5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.755+0000 7fafcc089700 1 -- 172.21.15.37:0/3762314584 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564b4c729300 msgr2=0x564b4c7d6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:14.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.755+0000 7fafcc089700 1 --2- 172.21.15.37:0/3762314584 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564b4c729300 0x564b4c7d6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.755+0000 7fafcc089700 1 -- 172.21.15.37:0/3762314584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc400a180 con 0x564b4c6fc9d0 2023-10-06T02:28:14.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.755+0000 7fafcc88a700 1 --2- 172.21.15.37:0/3762314584 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564b4c729300 0x564b4c7d6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:14.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.755+0000 7fafcc089700 1 --2- 172.21.15.37:0/3762314584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564b4c6fc9d0 0x564b4c73c240 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fafc400e590 tx=0x7fafc4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab4751c9017ccc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:14.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.755+0000 7fafca886700 1 -- 172.21.15.37:0/3762314584 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc400eda0 con 0x564b4c6fc9d0 2023-10-06T02:28:14.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.755+0000 7fafca886700 1 -- 172.21.15.37:0/3762314584 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc4000f40 con 0x564b4c6fc9d0 2023-10-06T02:28:14.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.756+0000 7fafca886700 1 -- 172.21.15.37:0/3762314584 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc400ea30 con 0x564b4c6fc9d0 2023-10-06T02:28:14.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.756+0000 7fafd2e4e000 1 -- 172.21.15.37:0/3762314584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564b4c6fc9d0 msgr2=0x564b4c73c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:14.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.756+0000 7fafd2e4e000 1 --2- 172.21.15.37:0/3762314584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564b4c6fc9d0 0x564b4c73c240 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fafc400e590 tx=0x7fafc4013000 comp rx=0 tx=0).stop 2023-10-06T02:28:14.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.756+0000 7fafd2e4e000 1 -- 172.21.15.37:0/3762314584 shutdown_connections 2023-10-06T02:28:14.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.756+0000 7fafd2e4e000 1 --2- 172.21.15.37:0/3762314584 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564b4c729300 0x564b4c7d6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.756+0000 7fafd2e4e000 1 --2- 172.21.15.37:0/3762314584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564b4c6fc9d0 0x564b4c73c240 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.756+0000 7fafd2e4e000 1 --2- 172.21.15.37:0/3762314584 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564b4c6fe8f0 0x564b4c7d5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.756+0000 7fafd2e4e000 1 -- 172.21.15.37:0/3762314584 >> 172.21.15.37:0/3762314584 conn(0x564b4c744af0 msgr2=0x564b4c7d1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:14.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.756+0000 7fafd2e4e000 1 -- 172.21.15.37:0/3762314584 shutdown_connections 2023-10-06T02:28:14.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.756+0000 7fafd2e4e000 1 -- 172.21.15.37:0/3762314584 wait complete. 2023-10-06T02:28:14.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.757+0000 7fafd2e4e000 1 Processor -- start 2023-10-06T02:28:14.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.757+0000 7fafd2e4e000 1 -- start start 2023-10-06T02:28:14.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.757+0000 7fafd2e4e000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564b4c6fc9d0 0x564b4c7d9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.757+0000 7fafd2e4e000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564b4c6fe8f0 0x564b4c7cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.757+0000 7fafd2e4e000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564b4c729300 0x564b4c7d75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.757+0000 7fafd2e4e000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b4c727c40 con 0x564b4c6fe8f0 2023-10-06T02:28:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.757+0000 7fafd2e4e000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b4c727ee0 con 0x564b4c729300 2023-10-06T02:28:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.757+0000 7fafd2e4e000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b4c728180 con 0x564b4c6fc9d0 2023-10-06T02:28:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.757+0000 7fafcb888700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564b4c6fe8f0 0x564b4c7cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.758+0000 7fafcb888700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564b4c6fe8f0 0x564b4c7cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44322/0 (socket says 172.21.15.37:44322) 2023-10-06T02:28:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.758+0000 7fafcb888700 1 -- 172.21.15.37:0/2904916698 learned_addr learned my addr 172.21.15.37:0/2904916698 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.758+0000 7fafcc88a700 1 --2- 172.21.15.37:0/2904916698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564b4c729300 0x564b4c7d75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.758+0000 7fafcc089700 1 --2- 172.21.15.37:0/2904916698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564b4c6fc9d0 0x564b4c7d9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.758+0000 7fafcb888700 1 -- 172.21.15.37:0/2904916698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564b4c6fc9d0 msgr2=0x564b4c7d9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.758+0000 7fafcb888700 1 --2- 172.21.15.37:0/2904916698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564b4c6fc9d0 0x564b4c7d9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.758+0000 7fafcb888700 1 -- 172.21.15.37:0/2904916698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564b4c729300 msgr2=0x564b4c7d75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:14.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.758+0000 7fafcb888700 1 --2- 172.21.15.37:0/2904916698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564b4c729300 0x564b4c7d75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.758+0000 7fafcb888700 1 -- 172.21.15.37:0/2904916698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b4c66f1c0 con 0x564b4c6fe8f0 2023-10-06T02:28:14.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.758+0000 7fafcb888700 1 --2- 172.21.15.37:0/2904916698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564b4c6fe8f0 0x564b4c7cd7b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fafb400a6d0 tx=0x7fafb4005b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:14.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.758+0000 7fafc9083700 1 -- 172.21.15.37:0/2904916698 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb400d620 con 0x564b4c6fe8f0 2023-10-06T02:28:14.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.758+0000 7fafc9083700 1 -- 172.21.15.37:0/2904916698 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb400d780 con 0x564b4c6fe8f0 2023-10-06T02:28:14.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.758+0000 7fafd2e4e000 1 -- 172.21.15.37:0/2904916698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564b4c6553d0 con 0x564b4c6fe8f0 2023-10-06T02:28:14.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.758+0000 7fafc9083700 1 -- 172.21.15.37:0/2904916698 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb400db40 con 0x564b4c6fe8f0 2023-10-06T02:28:14.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.758+0000 7fafd2e4e000 1 -- 172.21.15.37:0/2904916698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b4c648ae0 con 0x564b4c6fe8f0 2023-10-06T02:28:14.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.760+0000 7fafc9083700 1 -- 172.21.15.37:0/2904916698 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fafb4013070 con 0x564b4c6fe8f0 2023-10-06T02:28:14.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.760+0000 7fafc9083700 1 --2- 172.21.15.37:0/2904916698 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fafac065890 0x7fafac067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.760+0000 7fafc9083700 1 -- 172.21.15.37:0/2904916698 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fafb40834f0 con 0x564b4c6fe8f0 2023-10-06T02:28:14.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.760+0000 7fafd2e4e000 1 --2- 172.21.15.37:0/2904916698 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x564b4c7cdcf0 0x564b4c741500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.760+0000 7fafd2e4e000 1 -- 172.21.15.37:0/2904916698 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:1 11.7 11:e2e07930:::10000000001.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) v8 -- 0x564b4c7dcbd0 con 0x564b4c7cdcf0 2023-10-06T02:28:14.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.760+0000 7fafcc089700 1 --2- 172.21.15.37:0/2904916698 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fafac065890 0x7fafac067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.760+0000 7fafcc88a700 1 --2- 172.21.15.37:0/2904916698 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x564b4c7cdcf0 0x564b4c741500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.761+0000 7fafcc089700 1 --2- 172.21.15.37:0/2904916698 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fafac065890 0x7fafac067d40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fafc400e590 tx=0x7fafc401c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:14.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.761+0000 7fafcc88a700 1 --2- 172.21.15.37:0/2904916698 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x564b4c7cdcf0 0x564b4c741500 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:14.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.762+0000 7fafcc88a700 1 -- 172.21.15.37:0/2904916698 <== osd.5 v2:172.21.15.191:6808/90853 1 ==== osd_op_reply(1 10000000001.00000000 [omap-rm-keys] v73'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fafbc0099d0 con 0x564b4c7cdcf0 2023-10-06T02:28:14.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.762+0000 7fafd2e4e000 1 -- 172.21.15.37:0/2904916698 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x564b4c7cdcf0 msgr2=0x564b4c741500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:14.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.762+0000 7fafd2e4e000 1 --2- 172.21.15.37:0/2904916698 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x564b4c7cdcf0 0x564b4c741500 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.762+0000 7fafd2e4e000 1 -- 172.21.15.37:0/2904916698 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fafac065890 msgr2=0x7fafac067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:14.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.762+0000 7fafd2e4e000 1 --2- 172.21.15.37:0/2904916698 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fafac065890 0x7fafac067d40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fafc400e590 tx=0x7fafc401c000 comp rx=0 tx=0).stop 2023-10-06T02:28:14.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.762+0000 7fafd2e4e000 1 -- 172.21.15.37:0/2904916698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564b4c6fe8f0 msgr2=0x564b4c7cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:14.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.762+0000 7fafd2e4e000 1 --2- 172.21.15.37:0/2904916698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564b4c6fe8f0 0x564b4c7cd7b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fafb400a6d0 tx=0x7fafb4005b20 comp rx=0 tx=0).stop 2023-10-06T02:28:14.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.762+0000 7fafcc88a700 1 -- 172.21.15.37:0/2904916698 reap_dead start 2023-10-06T02:28:14.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.762+0000 7fafd2e4e000 1 -- 172.21.15.37:0/2904916698 shutdown_connections 2023-10-06T02:28:14.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.762+0000 7fafd2e4e000 1 -- 172.21.15.37:0/2904916698 >> 172.21.15.37:0/2904916698 conn(0x564b4c744af0 msgr2=0x564b4c73b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:14.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.762+0000 7fafd2e4e000 1 -- 172.21.15.37:0/2904916698 shutdown_connections 2023-10-06T02:28:14.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.762+0000 7fafd2e4e000 1 -- 172.21.15.37:0/2904916698 wait complete. 2023-10-06T02:28:14.769 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:28:14.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.929+0000 7fab54d5c700 1 Processor -- start 2023-10-06T02:28:14.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.929+0000 7fab54d5c700 1 -- start start 2023-10-06T02:28:14.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.930+0000 7fab54d5c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fab501593c0 0x7fab50159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.930+0000 7fab54d5c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab500ccb30 0x7fab500ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.930+0000 7fab54d5c700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab500b07a0 con 0x7fab500b2380 2023-10-06T02:28:14.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.930+0000 7fab54d5c700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab500cd8a0 con 0x7fab501593c0 2023-10-06T02:28:14.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.930+0000 7fab54d5c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab500afe70 con 0x7fab500ccb30 2023-10-06T02:28:14.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.931+0000 7fab4ed9d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab500ccb30 0x7fab500ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.931+0000 7fab4e59c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fab501593c0 0x7fab50159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.931+0000 7fab4dd9b700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fab500b2380 0x7fab500b2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:50998/0 (socket says 172.21.15.37:50998) 2023-10-06T02:28:14.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.931+0000 7fab4dd9b700 1 -- 172.21.15.37:0/327456986 learned_addr learned my addr 172.21.15.37:0/327456986 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:14.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.931+0000 7fab4d59a700 1 -- 172.21.15.37:0/327456986 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147267190 0 0) 0x7fab500b07a0 con 0x7fab500b2380 2023-10-06T02:28:14.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.931+0000 7fab4d59a700 1 -- 172.21.15.37:0/327456986 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab3c003570 con 0x7fab500b2380 2023-10-06T02:28:14.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.931+0000 7fab4ed9d700 1 -- 172.21.15.37:0/327456986 >> v2:172.21.15.191:3300/0 conn(0x7fab501593c0 msgr2=0x7fab50159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:14.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.931+0000 7fab4ed9d700 1 --2- 172.21.15.37:0/327456986 >> v2:172.21.15.191:3300/0 conn(0x7fab501593c0 0x7fab50159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.931+0000 7fab4ed9d700 1 -- 172.21.15.37:0/327456986 >> v1:172.21.15.191:6789/0 conn(0x7fab500b2380 legacy=0x7fab500b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:14.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.931+0000 7fab4ed9d700 1 -- 172.21.15.37:0/327456986 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab500b0150 con 0x7fab500ccb30 2023-10-06T02:28:14.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.931+0000 7fab4e59c700 1 --2- 172.21.15.37:0/327456986 >> v2:172.21.15.191:3300/0 conn(0x7fab501593c0 0x7fab50159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:14.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.931+0000 7fab4ed9d700 1 --2- 172.21.15.37:0/327456986 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab500ccb30 0x7fab500ccfb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fab40009e60 tx=0x7fab40009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4d5a9f79bbf8eb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:14.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.931+0000 7fab4d59a700 1 -- 172.21.15.37:0/327456986 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4000e070 con 0x7fab500ccb30 2023-10-06T02:28:14.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.931+0000 7fab4d59a700 1 -- 172.21.15.37:0/327456986 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4000bab0 con 0x7fab500ccb30 2023-10-06T02:28:14.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.931+0000 7fab4d59a700 1 -- 172.21.15.37:0/327456986 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4000be70 con 0x7fab500ccb30 2023-10-06T02:28:14.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.932+0000 7fab54d5c700 1 -- 172.21.15.37:0/327456986 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab500ccb30 msgr2=0x7fab500ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:14.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.932+0000 7fab54d5c700 1 --2- 172.21.15.37:0/327456986 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab500ccb30 0x7fab500ccfb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fab40009e60 tx=0x7fab40009780 comp rx=0 tx=0).stop 2023-10-06T02:28:14.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.932+0000 7fab54d5c700 1 -- 172.21.15.37:0/327456986 shutdown_connections 2023-10-06T02:28:14.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.932+0000 7fab54d5c700 1 --2- 172.21.15.37:0/327456986 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab500ccb30 0x7fab500ccfb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.932+0000 7fab54d5c700 1 --2- 172.21.15.37:0/327456986 >> v2:172.21.15.191:3300/0 conn(0x7fab501593c0 0x7fab50159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.932+0000 7fab54d5c700 1 -- 172.21.15.37:0/327456986 >> 172.21.15.37:0/327456986 conn(0x7fab5006c0b0 msgr2=0x7fab5006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:14.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.932+0000 7fab54d5c700 1 -- 172.21.15.37:0/327456986 shutdown_connections 2023-10-06T02:28:14.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.932+0000 7fab54d5c700 1 -- 172.21.15.37:0/327456986 wait complete. 2023-10-06T02:28:14.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.933+0000 7fab54d5c700 1 Processor -- start 2023-10-06T02:28:14.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.933+0000 7fab54d5c700 1 -- start start 2023-10-06T02:28:14.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.934+0000 7fab54d5c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab500b2380 0x7fab5014a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.934+0000 7fab54d5c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fab500ccb30 0x7fab500c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.934+0000 7fab54d5c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab501593c0 0x7fab500c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.934+0000 7fab54d5c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab500c5110 con 0x7fab501593c0 2023-10-06T02:28:14.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.934+0000 7fab54d5c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab500c7660 con 0x7fab500ccb30 2023-10-06T02:28:14.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.934+0000 7fab54d5c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab500c4890 con 0x7fab500b2380 2023-10-06T02:28:14.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.934+0000 7fab4ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab501593c0 0x7fab500c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.934+0000 7fab4ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab501593c0 0x7fab500c58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44332/0 (socket says 172.21.15.37:44332) 2023-10-06T02:28:14.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.934+0000 7fab4ed9d700 1 -- 172.21.15.37:0/2885775748 learned_addr learned my addr 172.21.15.37:0/2885775748 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:14.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.934+0000 7fab4e59c700 1 --2- 172.21.15.37:0/2885775748 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab500b2380 0x7fab5014a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.934+0000 7fab4dd9b700 1 --2- 172.21.15.37:0/2885775748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fab500ccb30 0x7fab500c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.934+0000 7fab4e59c700 1 -- 172.21.15.37:0/2885775748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fab500ccb30 msgr2=0x7fab500c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:14.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.934+0000 7fab4e59c700 1 --2- 172.21.15.37:0/2885775748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fab500ccb30 0x7fab500c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.934+0000 7fab4e59c700 1 -- 172.21.15.37:0/2885775748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab501593c0 msgr2=0x7fab500c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:14.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.934+0000 7fab4e59c700 1 --2- 172.21.15.37:0/2885775748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab501593c0 0x7fab500c58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:14.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.934+0000 7fab4e59c700 1 -- 172.21.15.37:0/2885775748 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab48009420 con 0x7fab500b2380 2023-10-06T02:28:14.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.934+0000 7fab4dd9b700 1 --2- 172.21.15.37:0/2885775748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fab500ccb30 0x7fab500c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:14.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.934+0000 7fab4ed9d700 1 --2- 172.21.15.37:0/2885775748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab501593c0 0x7fab500c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:14.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.935+0000 7fab4e59c700 1 --2- 172.21.15.37:0/2885775748 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab500b2380 0x7fab5014a940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fab4800ea00 tx=0x7fab480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:14.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.935+0000 7fab467fc700 1 -- 172.21.15.37:0/2885775748 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab48009660 con 0x7fab500b2380 2023-10-06T02:28:14.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.935+0000 7fab467fc700 1 -- 172.21.15.37:0/2885775748 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4800c6a0 con 0x7fab500b2380 2023-10-06T02:28:14.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.935+0000 7fab54d5c700 1 -- 172.21.15.37:0/2885775748 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab40009a20 con 0x7fab500b2380 2023-10-06T02:28:14.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.935+0000 7fab467fc700 1 -- 172.21.15.37:0/2885775748 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4800ca40 con 0x7fab500b2380 2023-10-06T02:28:14.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.935+0000 7fab54d5c700 1 -- 172.21.15.37:0/2885775748 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab500c4e30 con 0x7fab500b2380 2023-10-06T02:28:14.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.936+0000 7fab54d5c700 1 -- 172.21.15.37:0/2885775748 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab500c7990 con 0x7fab500b2380 2023-10-06T02:28:14.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.936+0000 7fab467fc700 1 -- 172.21.15.37:0/2885775748 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab48013470 con 0x7fab500b2380 2023-10-06T02:28:14.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.937+0000 7fab467fc700 1 --2- 172.21.15.37:0/2885775748 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fab30066f30 0x7fab300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:14.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.937+0000 7fab467fc700 1 -- 172.21.15.37:0/2885775748 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fab48084560 con 0x7fab500b2380 2023-10-06T02:28:14.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.937+0000 7fab4dd9b700 1 --2- 172.21.15.37:0/2885775748 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fab30066f30 0x7fab300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:14.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.937+0000 7fab4dd9b700 1 --2- 172.21.15.37:0/2885775748 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fab30066f30 0x7fab300693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fab5015dd00 tx=0x7fab38009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:14.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:14.942+0000 7fab467fc700 1 -- 172.21.15.37:0/2885775748 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab480550b0 con 0x7fab500b2380 2023-10-06T02:28:15.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.178+0000 7fab54d5c700 1 -- 172.21.15.37:0/2885775748 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fab500b0430 con 0x7fab500b2380 2023-10-06T02:28:15.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.489+0000 7fab467fc700 1 -- 172.21.15.37:0/2885775748 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v49) v1 ==== 162+0+0 (secure 0 0 0) 0x7fab48054c40 con 0x7fab500b2380 2023-10-06T02:28:15.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.491+0000 7fab54d5c700 1 -- 172.21.15.37:0/2885775748 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fab30066f30 msgr2=0x7fab300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:15.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.491+0000 7fab54d5c700 1 --2- 172.21.15.37:0/2885775748 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fab30066f30 0x7fab300693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fab5015dd00 tx=0x7fab38009040 comp rx=0 tx=0).stop 2023-10-06T02:28:15.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.491+0000 7fab54d5c700 1 -- 172.21.15.37:0/2885775748 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab500b2380 msgr2=0x7fab5014a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:15.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.491+0000 7fab54d5c700 1 --2- 172.21.15.37:0/2885775748 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab500b2380 0x7fab5014a940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fab4800ea00 tx=0x7fab480091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:15.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.491+0000 7fab54d5c700 1 -- 172.21.15.37:0/2885775748 shutdown_connections 2023-10-06T02:28:15.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.491+0000 7fab54d5c700 1 --2- 172.21.15.37:0/2885775748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab501593c0 0x7fab500c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:15.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.491+0000 7fab54d5c700 1 --2- 172.21.15.37:0/2885775748 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab500b2380 0x7fab5014a940 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:15.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.491+0000 7fab54d5c700 1 --2- 172.21.15.37:0/2885775748 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fab30066f30 0x7fab300693e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:15.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.491+0000 7fab54d5c700 1 --2- 172.21.15.37:0/2885775748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fab500ccb30 0x7fab500c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:15.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.491+0000 7fab54d5c700 1 -- 172.21.15.37:0/2885775748 >> 172.21.15.37:0/2885775748 conn(0x7fab5006c0b0 msgr2=0x7fab500cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:15.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.492+0000 7fab54d5c700 1 -- 172.21.15.37:0/2885775748 shutdown_connections 2023-10-06T02:28:15.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.492+0000 7fab54d5c700 1 -- 172.21.15.37:0/2885775748 wait complete. 2023-10-06T02:28:15.494 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:28:15.507 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:15.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.626+0000 7f1de6b19700 1 Processor -- start 2023-10-06T02:28:15.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.626+0000 7f1de6b19700 1 -- start start 2023-10-06T02:28:15.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.627+0000 7f1de6b19700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1de00a8920 0x7f1de00b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:15.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.627+0000 7f1de6b19700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1de00a8cf0 0x7f1de00b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:15.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.627+0000 7f1de6b19700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de015d1f0 con 0x7f1de0159040 2023-10-06T02:28:15.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.627+0000 7f1de6b19700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de0159ba0 con 0x7f1de00a8cf0 2023-10-06T02:28:15.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.627+0000 7f1de6b19700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de00b4150 con 0x7f1de00a8920 2023-10-06T02:28:15.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.627+0000 7f1ddffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1de00a8cf0 0x7f1de00b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:15.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.627+0000 7f1ddffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1de00a8cf0 0x7f1de00b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39382/0 (socket says 172.21.15.37:39382) 2023-10-06T02:28:15.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.627+0000 7f1ddffff700 1 -- 172.21.15.37:0/10193821 learned_addr learned my addr 172.21.15.37:0/10193821 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:15.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.627+0000 7f1de48b5700 1 --2- 172.21.15.37:0/10193821 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1de00a8920 0x7f1de00b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:15.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.627+0000 7f1ddffff700 1 -- 172.21.15.37:0/10193821 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1de00a8920 msgr2=0x7f1de00b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:15.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.628+0000 7f1ddffff700 1 --2- 172.21.15.37:0/10193821 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1de00a8920 0x7f1de00b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:15.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.628+0000 7f1ddffff700 1 -- 172.21.15.37:0/10193821 >> v1:172.21.15.191:6789/0 conn(0x7f1de0159040 legacy=0x7f1de0159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:15.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.628+0000 7f1ddffff700 1 -- 172.21.15.37:0/10193821 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de015dd70 con 0x7f1de00a8cf0 2023-10-06T02:28:15.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.628+0000 7f1ddffff700 1 --2- 172.21.15.37:0/10193821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de00a8cf0 0x7f1de00b15d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00099b0 tx=0x7f1dd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f7fd66ce5e5b9d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:15.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.628+0000 7f1ddf7fe700 1 -- 172.21.15.37:0/10193821 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd000b820 con 0x7f1de00a8cf0 2023-10-06T02:28:15.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.628+0000 7f1ddf7fe700 1 -- 172.21.15.37:0/10193821 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd000b980 con 0x7f1de00a8cf0 2023-10-06T02:28:15.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.628+0000 7f1ddf7fe700 1 -- 172.21.15.37:0/10193821 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd000bd20 con 0x7f1de00a8cf0 2023-10-06T02:28:15.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.628+0000 7f1de6b19700 1 -- 172.21.15.37:0/10193821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de00a8cf0 msgr2=0x7f1de00b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:15.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.628+0000 7f1de6b19700 1 --2- 172.21.15.37:0/10193821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de00a8cf0 0x7f1de00b15d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00099b0 tx=0x7f1dd0009250 comp rx=0 tx=0).stop 2023-10-06T02:28:15.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.628+0000 7f1de6b19700 1 -- 172.21.15.37:0/10193821 shutdown_connections 2023-10-06T02:28:15.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.628+0000 7f1de6b19700 1 --2- 172.21.15.37:0/10193821 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1de00a8920 0x7f1de00b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.628+0000 7f1de6b19700 1 --2- 172.21.15.37:0/10193821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de00a8cf0 0x7f1de00b15d0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.628+0000 7f1de6b19700 1 -- 172.21.15.37:0/10193821 >> 172.21.15.37:0/10193821 conn(0x7f1de0067b30 msgr2=0x7f1de0067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.628+0000 7f1de6b19700 1 -- 172.21.15.37:0/10193821 shutdown_connections 2023-10-06T02:28:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.628+0000 7f1de6b19700 1 -- 172.21.15.37:0/10193821 wait complete. 2023-10-06T02:28:15.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.630+0000 7f1de6b19700 1 Processor -- start 2023-10-06T02:28:15.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.630+0000 7f1de6b19700 1 -- start start 2023-10-06T02:28:15.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.630+0000 7f1de6b19700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1de00a8920 0x7f1de014b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:15.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.630+0000 7f1de6b19700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1de00a8cf0 0x7f1de00a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:15.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.630+0000 7f1de6b19700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de0159040 0x7f1de00ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:15.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.630+0000 7f1de6b19700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de014d860 con 0x7f1de0159040 2023-10-06T02:28:15.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.630+0000 7f1de6b19700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de014e6c0 con 0x7f1de00a8cf0 2023-10-06T02:28:15.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.630+0000 7f1de6b19700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de00a7900 con 0x7f1de00a8920 2023-10-06T02:28:15.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.631+0000 7f1de50b6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de0159040 0x7f1de00ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:15.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.631+0000 7f1de50b6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de0159040 0x7f1de00ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39386/0 (socket says 172.21.15.37:39386) 2023-10-06T02:28:15.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.631+0000 7f1de50b6700 1 -- 172.21.15.37:0/3914065955 learned_addr learned my addr 172.21.15.37:0/3914065955 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:15.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.631+0000 7f1ddffff700 1 --2- 172.21.15.37:0/3914065955 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1de00a8cf0 0x7f1de00a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:15.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.631+0000 7f1de48b5700 1 --2- 172.21.15.37:0/3914065955 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1de00a8920 0x7f1de014b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:15.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.631+0000 7f1de50b6700 1 -- 172.21.15.37:0/3914065955 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1de00a8920 msgr2=0x7f1de014b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:15.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.631+0000 7f1de50b6700 1 --2- 172.21.15.37:0/3914065955 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1de00a8920 0x7f1de014b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:15.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.631+0000 7f1de50b6700 1 -- 172.21.15.37:0/3914065955 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1de00a8cf0 msgr2=0x7f1de00a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:15.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.631+0000 7f1de50b6700 1 --2- 172.21.15.37:0/3914065955 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1de00a8cf0 0x7f1de00a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:15.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.631+0000 7f1de50b6700 1 -- 172.21.15.37:0/3914065955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd00094f0 con 0x7f1de0159040 2023-10-06T02:28:15.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.631+0000 7f1de50b6700 1 --2- 172.21.15.37:0/3914065955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de0159040 0x7f1de00ae8b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800b4e0 tx=0x7f1dc8006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.631+0000 7f1ddcff9700 1 -- 172.21.15.37:0/3914065955 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc800be90 con 0x7f1de0159040 2023-10-06T02:28:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.631+0000 7f1ddcff9700 1 -- 172.21.15.37:0/3914065955 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc800f510 con 0x7f1de0159040 2023-10-06T02:28:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.631+0000 7f1ddcff9700 1 -- 172.21.15.37:0/3914065955 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc800f8d0 con 0x7f1de0159040 2023-10-06T02:28:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.631+0000 7f1de6b19700 1 -- 172.21.15.37:0/3914065955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de014dab0 con 0x7f1de0159040 2023-10-06T02:28:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.631+0000 7f1de6b19700 1 -- 172.21.15.37:0/3914065955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de014e070 con 0x7f1de0159040 2023-10-06T02:28:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.632+0000 7f1de6b19700 1 -- 172.21.15.37:0/3914065955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de00ad980 con 0x7f1de0159040 2023-10-06T02:28:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.633+0000 7f1ddcff9700 1 -- 172.21.15.37:0/3914065955 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1dc800fd00 con 0x7f1de0159040 2023-10-06T02:28:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.633+0000 7f1ddcff9700 1 --2- 172.21.15.37:0/3914065955 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1dc0066f30 0x7f1dc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.633+0000 7f1ddcff9700 1 -- 172.21.15.37:0/3914065955 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f1dc8084070 con 0x7f1de0159040 2023-10-06T02:28:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.633+0000 7f1de48b5700 1 --2- 172.21.15.37:0/3914065955 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1dc0066f30 0x7f1dc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:15.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.634+0000 7f1de48b5700 1 --2- 172.21.15.37:0/3914065955 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1dc0066f30 0x7f1dc00693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800f6c0 tx=0x7f1dd8007820 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:15.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.637+0000 7f1ddcff9700 1 -- 172.21.15.37:0/3914065955 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1dc80511b0 con 0x7f1de0159040 2023-10-06T02:28:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.878+0000 7f1de6b19700 1 -- 172.21.15.37:0/3914065955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1de00ae690 con 0x7f1de0159040 2023-10-06T02:28:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.879+0000 7f1ddcff9700 1 -- 172.21.15.37:0/3914065955 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f1dc80547d0 con 0x7f1de0159040 2023-10-06T02:28:15.880 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:15.880 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":50,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3055524642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3055524642},{"type":"v1","addr":"172.21.15.37:6835","nonce":3055524642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2821947660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2821947660},{"type":"v1","addr":"172.21.15.191:6836","nonce":2821947660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6310,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3752119173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3752119173},{"type":"v1","addr":"172.21.15.191:6837","nonce":3752119173}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:27:43.200836+0000","modified":"2023-10-06T02:28:15.490562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6453":{"gid":6453,"name":"c","rank":0,"incarnation":50,"state":"up:replay","state_seq":1,"addr":"172.21.15.37:6834/4246185831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4246185831},{"type":"v1","addr":"172.21.15.37:6834","nonce":4246185831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:28:15.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.882+0000 7f1de6b19700 1 -- 172.21.15.37:0/3914065955 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1dc0066f30 msgr2=0x7f1dc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:15.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.882+0000 7f1de6b19700 1 --2- 172.21.15.37:0/3914065955 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1dc0066f30 0x7f1dc00693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800f6c0 tx=0x7f1dd8007820 comp rx=0 tx=0).stop 2023-10-06T02:28:15.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.882+0000 7f1de6b19700 1 -- 172.21.15.37:0/3914065955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de0159040 msgr2=0x7f1de00ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:15.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.882+0000 7f1de6b19700 1 --2- 172.21.15.37:0/3914065955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de0159040 0x7f1de00ae8b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800b4e0 tx=0x7f1dc8006f90 comp rx=0 tx=0).stop 2023-10-06T02:28:15.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.882+0000 7f1de6b19700 1 -- 172.21.15.37:0/3914065955 shutdown_connections 2023-10-06T02:28:15.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.882+0000 7f1de6b19700 1 --2- 172.21.15.37:0/3914065955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de0159040 0x7f1de00ae8b0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:15.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.882+0000 7f1de6b19700 1 --2- 172.21.15.37:0/3914065955 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1de00a8920 0x7f1de014b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:15.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.882+0000 7f1de6b19700 1 --2- 172.21.15.37:0/3914065955 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f1dc0066f30 0x7f1dc00693e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:15.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.882+0000 7f1de6b19700 1 --2- 172.21.15.37:0/3914065955 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1de00a8cf0 0x7f1de00a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:15.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.882+0000 7f1de6b19700 1 -- 172.21.15.37:0/3914065955 >> 172.21.15.37:0/3914065955 conn(0x7f1de0067b30 msgr2=0x7f1de014d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:15.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.882+0000 7f1de6b19700 1 -- 172.21.15.37:0/3914065955 shutdown_connections 2023-10-06T02:28:15.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:15.882+0000 7f1de6b19700 1 -- 172.21.15.37:0/3914065955 wait complete. 2023-10-06T02:28:15.884 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 50 2023-10-06T02:28:16.297 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:27:43.200836+0000', 'modified': '2023-10-06T02:28:15.490562+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 73, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6453}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6453': {'gid': 6453, 'name': 'c', 'rank': 0, 'incarnation': 50, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.37:6834/4246185831', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 4246185831}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 4246185831}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:28:16.297 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6453:up:replay 2023-10-06T02:28:17.298 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:17.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.432+0000 7f4b8aee5700 1 Processor -- start 2023-10-06T02:28:17.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.432+0000 7f4b8aee5700 1 -- start start 2023-10-06T02:28:17.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.432+0000 7f4b8aee5700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4b8406dd30 0x7f4b840cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:17.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.432+0000 7f4b8aee5700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b8415e180 con 0x7f4b841595a0 2023-10-06T02:28:17.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.432+0000 7f4b8aee5700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b8415d570 con 0x7f4b8406d890 2023-10-06T02:28:17.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.432+0000 7f4b8aee5700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b8415d850 con 0x7f4b8406dd30 2023-10-06T02:28:17.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b88c81700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4b841595a0 0x7f4b840b0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39452/0 (socket says 172.21.15.37:39452) 2023-10-06T02:28:17.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b88c81700 1 -- 172.21.15.37:0/3423468008 learned_addr learned my addr 172.21.15.37:0/3423468008 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:17.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b89482700 1 --2- 172.21.15.37:0/3423468008 >> v2:172.21.15.191:3300/0 conn(0x7f4b8406dd30 0x7f4b840cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:17.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b837fe700 1 -- 172.21.15.37:0/3423468008 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426398431 0 0) 0x7f4b8415e180 con 0x7f4b841595a0 2023-10-06T02:28:17.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b837fe700 1 -- 172.21.15.37:0/3423468008 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b70003570 con 0x7f4b841595a0 2023-10-06T02:28:17.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b837fe700 1 -- 172.21.15.37:0/3423468008 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2524406376 0 0) 0x7f4b70003570 con 0x7f4b841595a0 2023-10-06T02:28:17.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b837fe700 1 -- 172.21.15.37:0/3423468008 >> v2:172.21.15.191:3300/0 conn(0x7f4b8406dd30 msgr2=0x7f4b840cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:17.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b837fe700 1 --2- 172.21.15.37:0/3423468008 >> v2:172.21.15.191:3300/0 conn(0x7f4b8406dd30 0x7f4b840cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:17.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b837fe700 1 -- 172.21.15.37:0/3423468008 >> v1:172.21.15.191:6789/0 conn(0x7f4b8406d890 legacy=0x7f4b840cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:17.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b837fe700 1 -- 172.21.15.37:0/3423468008 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8415db30 con 0x7f4b841595a0 2023-10-06T02:28:17.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b837fe700 1 -- 172.21.15.37:0/3423468008 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f4b6c001470 con 0x7f4b841595a0 2023-10-06T02:28:17.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b837fe700 1 -- 172.21.15.37:0/3423468008 >> v1:172.21.15.37:6789/0 conn(0x7f4b841595a0 legacy=0x7f4b840b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:17.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b837fe700 1 --2- 172.21.15.37:0/3423468008 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b70003a60 0x7f4b70003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:17.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b837fe700 1 --2- 172.21.15.37:0/3423468008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b70004810 0x7f4b70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:17.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b837fe700 1 --2- 172.21.15.37:0/3423468008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b700052e0 0x7f4b7000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:17.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b837fe700 1 -- 172.21.15.37:0/3423468008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8415d850 con 0x7f4b700052e0 2023-10-06T02:28:17.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b837fe700 1 -- 172.21.15.37:0/3423468008 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7000c2a0 con 0x7f4b70004810 2023-10-06T02:28:17.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b837fe700 1 -- 172.21.15.37:0/3423468008 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7000c460 con 0x7f4b70003a60 2023-10-06T02:28:17.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b89482700 1 --2- 172.21.15.37:0/3423468008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b700052e0 0x7f4b7000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:17.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b83fff700 1 --2- 172.21.15.37:0/3423468008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b70004810 0x7f4b70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:17.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.433+0000 7f4b88c81700 1 --2- 172.21.15.37:0/3423468008 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b70003a60 0x7f4b70003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:17.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.434+0000 7f4b89482700 1 -- 172.21.15.37:0/3423468008 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b70003a60 msgr2=0x7f4b70003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:17.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.434+0000 7f4b89482700 1 --2- 172.21.15.37:0/3423468008 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b70003a60 0x7f4b70003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:17.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.434+0000 7f4b89482700 1 -- 172.21.15.37:0/3423468008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b70004810 msgr2=0x7f4b70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:17.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.434+0000 7f4b89482700 1 --2- 172.21.15.37:0/3423468008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b70004810 0x7f4b70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:17.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.434+0000 7f4b89482700 1 -- 172.21.15.37:0/3423468008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b70003570 con 0x7f4b700052e0 2023-10-06T02:28:17.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.434+0000 7f4b89482700 1 -- 172.21.15.37:0/3423468008 reap_dead start 2023-10-06T02:28:17.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.434+0000 7f4b89482700 1 --2- 172.21.15.37:0/3423468008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b700052e0 0x7f4b7000ba60 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009c00 tx=0x7f4b7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b742e57034da09d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:17.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.434+0000 7f4b837fe700 1 -- 172.21.15.37:0/3423468008 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c00e710 con 0x7f4b700052e0 2023-10-06T02:28:17.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.434+0000 7f4b837fe700 1 -- 172.21.15.37:0/3423468008 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c00e890 con 0x7f4b700052e0 2023-10-06T02:28:17.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.434+0000 7f4b837fe700 1 -- 172.21.15.37:0/3423468008 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c00ec50 con 0x7f4b700052e0 2023-10-06T02:28:17.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.435+0000 7f4b8aee5700 1 -- 172.21.15.37:0/3423468008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b700052e0 msgr2=0x7f4b7000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:17.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.435+0000 7f4b8aee5700 1 --2- 172.21.15.37:0/3423468008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b700052e0 0x7f4b7000ba60 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009c00 tx=0x7f4b7c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:17.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.435+0000 7f4b8aee5700 1 -- 172.21.15.37:0/3423468008 shutdown_connections 2023-10-06T02:28:17.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.435+0000 7f4b8aee5700 1 --2- 172.21.15.37:0/3423468008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b700052e0 0x7f4b7000ba60 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:17.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.435+0000 7f4b8aee5700 1 -- 172.21.15.37:0/3423468008 >> 172.21.15.37:0/3423468008 conn(0x7f4b840d04d0 msgr2=0x7f4b840d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:17.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.435+0000 7f4b8aee5700 1 -- 172.21.15.37:0/3423468008 shutdown_connections 2023-10-06T02:28:17.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.435+0000 7f4b8aee5700 1 -- 172.21.15.37:0/3423468008 wait complete. 2023-10-06T02:28:17.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.436+0000 7f4b8aee5700 1 Processor -- start 2023-10-06T02:28:17.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.436+0000 7f4b8aee5700 1 -- start start 2023-10-06T02:28:17.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b8aee5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b700052e0 0x7f4b84150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:17.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b8aee5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b8415ae80 0x7f4b84156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:17.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b8aee5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b8415b2f0 0x7f4b84157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:17.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b8aee5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b84151710 con 0x7f4b700052e0 2023-10-06T02:28:17.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b8aee5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8415b8b0 con 0x7f4b8415b2f0 2023-10-06T02:28:17.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b8aee5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b84169e30 con 0x7f4b8415ae80 2023-10-06T02:28:17.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b88c81700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b700052e0 0x7f4b84150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:17.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b88c81700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b700052e0 0x7f4b84150b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39406/0 (socket says 172.21.15.37:39406) 2023-10-06T02:28:17.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b88c81700 1 -- 172.21.15.37:0/3431453797 learned_addr learned my addr 172.21.15.37:0/3431453797 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:17.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b83fff700 1 --2- 172.21.15.37:0/3431453797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b8415ae80 0x7f4b84156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:17.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b89482700 1 --2- 172.21.15.37:0/3431453797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b8415b2f0 0x7f4b84157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:17.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b88c81700 1 -- 172.21.15.37:0/3431453797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b8415ae80 msgr2=0x7f4b84156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:17.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b88c81700 1 --2- 172.21.15.37:0/3431453797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b8415ae80 0x7f4b84156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:17.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b88c81700 1 -- 172.21.15.37:0/3431453797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b8415b2f0 msgr2=0x7f4b84157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:17.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b88c81700 1 --2- 172.21.15.37:0/3431453797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b8415b2f0 0x7f4b84157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:17.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b88c81700 1 -- 172.21.15.37:0/3431453797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8416a110 con 0x7f4b700052e0 2023-10-06T02:28:17.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b89482700 1 --2- 172.21.15.37:0/3431453797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b8415b2f0 0x7f4b84157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:17.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b83fff700 1 --2- 172.21.15.37:0/3431453797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b8415ae80 0x7f4b84156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:17.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b88c81700 1 --2- 172.21.15.37:0/3431453797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b700052e0 0x7f4b84150b10 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c007390 tx=0x7f4b6c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:17.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b80ff9700 1 -- 172.21.15.37:0/3431453797 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c018030 con 0x7f4b700052e0 2023-10-06T02:28:17.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b80ff9700 1 -- 172.21.15.37:0/3431453797 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6c00f8d0 con 0x7f4b700052e0 2023-10-06T02:28:17.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b8aee5700 1 -- 172.21.15.37:0/3431453797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b8416a3f0 con 0x7f4b700052e0 2023-10-06T02:28:17.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.437+0000 7f4b80ff9700 1 -- 172.21.15.37:0/3431453797 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c00fc90 con 0x7f4b700052e0 2023-10-06T02:28:17.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.438+0000 7f4b8aee5700 1 -- 172.21.15.37:0/3431453797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8416abf0 con 0x7f4b700052e0 2023-10-06T02:28:17.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.438+0000 7f4b8aee5700 1 -- 172.21.15.37:0/3431453797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b8416a910 con 0x7f4b700052e0 2023-10-06T02:28:17.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.439+0000 7f4b80ff9700 1 -- 172.21.15.37:0/3431453797 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b6c01b070 con 0x7f4b700052e0 2023-10-06T02:28:17.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.439+0000 7f4b80ff9700 1 --2- 172.21.15.37:0/3431453797 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4b64066f30 0x7f4b640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:17.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.439+0000 7f4b80ff9700 1 -- 172.21.15.37:0/3431453797 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f4b6c019070 con 0x7f4b700052e0 2023-10-06T02:28:17.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.439+0000 7f4b83fff700 1 --2- 172.21.15.37:0/3431453797 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4b64066f30 0x7f4b640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:17.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.440+0000 7f4b83fff700 1 --2- 172.21.15.37:0/3431453797 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4b64066f30 0x7f4b640693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4b74004290 tx=0x7f4b74001640 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:17.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.444+0000 7f4b80ff9700 1 -- 172.21.15.37:0/3431453797 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b8416a910 con 0x7f4b700052e0 2023-10-06T02:28:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.683+0000 7f4b8aee5700 1 -- 172.21.15.37:0/3431453797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b8416a910 con 0x7f4b700052e0 2023-10-06T02:28:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.683+0000 7f4b80ff9700 1 -- 172.21.15.37:0/3431453797 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f4b8416a910 con 0x7f4b700052e0 2023-10-06T02:28:17.684 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:17.684 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":52,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3055524642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3055524642},{"type":"v1","addr":"172.21.15.37:6835","nonce":3055524642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2821947660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2821947660},{"type":"v1","addr":"172.21.15.191:6836","nonce":2821947660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6310,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3752119173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3752119173},{"type":"v1","addr":"172.21.15.191:6837","nonce":3752119173}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:27:43.200836+0000","modified":"2023-10-06T02:28:17.493164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6453":{"gid":6453,"name":"c","rank":0,"incarnation":50,"state":"up:rejoin","state_seq":12,"addr":"172.21.15.37:6834/4246185831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4246185831},{"type":"v1","addr":"172.21.15.37:6834","nonce":4246185831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:28:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.685+0000 7f4b8aee5700 1 -- 172.21.15.37:0/3431453797 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4b64066f30 msgr2=0x7f4b640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.685+0000 7f4b8aee5700 1 --2- 172.21.15.37:0/3431453797 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4b64066f30 0x7f4b640693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4b74004290 tx=0x7f4b74001640 comp rx=0 tx=0).stop 2023-10-06T02:28:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.685+0000 7f4b8aee5700 1 -- 172.21.15.37:0/3431453797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b700052e0 msgr2=0x7f4b84150b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.685+0000 7f4b8aee5700 1 --2- 172.21.15.37:0/3431453797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b700052e0 0x7f4b84150b10 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c007390 tx=0x7f4b6c001e50 comp rx=0 tx=0).stop 2023-10-06T02:28:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.685+0000 7f4b8aee5700 1 -- 172.21.15.37:0/3431453797 shutdown_connections 2023-10-06T02:28:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.685+0000 7f4b8aee5700 1 --2- 172.21.15.37:0/3431453797 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4b64066f30 0x7f4b640693e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.685+0000 7f4b8aee5700 1 --2- 172.21.15.37:0/3431453797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b8415b2f0 0x7f4b84157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.685+0000 7f4b8aee5700 1 --2- 172.21.15.37:0/3431453797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b700052e0 0x7f4b84150b10 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.685+0000 7f4b8aee5700 1 --2- 172.21.15.37:0/3431453797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b8415ae80 0x7f4b84156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.685+0000 7f4b8aee5700 1 -- 172.21.15.37:0/3431453797 >> 172.21.15.37:0/3431453797 conn(0x7f4b840d04d0 msgr2=0x7f4b840d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.685+0000 7f4b8aee5700 1 -- 172.21.15.37:0/3431453797 shutdown_connections 2023-10-06T02:28:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:17.685+0000 7f4b8aee5700 1 -- 172.21.15.37:0/3431453797 wait complete. 2023-10-06T02:28:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 52 2023-10-06T02:28:18.099 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:27:43.200836+0000', 'modified': '2023-10-06T02:28:17.493164+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 73, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6453}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6453': {'gid': 6453, 'name': 'c', 'rank': 0, 'incarnation': 50, 'state': 'up:rejoin', 'state_seq': 12, 'addr': '172.21.15.37:6834/4246185831', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 4246185831}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 4246185831}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:28:18.100 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6453:up:rejoin 2023-10-06T02:28:19.101 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:19.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.234+0000 7f9cd80f4700 1 Processor -- start 2023-10-06T02:28:19.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.234+0000 7f9cd80f4700 1 -- start start 2023-10-06T02:28:19.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.235+0000 7f9cd80f4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd00cb860 0x7f9cd0159180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:19.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.235+0000 7f9cd80f4700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9cd006c6d0 0x7f9cd01596c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:19.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.235+0000 7f9cd80f4700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd015e040 con 0x7f9cd006c300 2023-10-06T02:28:19.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.235+0000 7f9cd80f4700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd0159c00 con 0x7f9cd006c6d0 2023-10-06T02:28:19.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.235+0000 7f9cd80f4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd015d430 con 0x7f9cd00cb860 2023-10-06T02:28:19.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.235+0000 7f9cd6691700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9cd006c6d0 0x7f9cd01596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:19.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.235+0000 7f9cd5e90700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9cd006c300 0x7f9cd00cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39456/0 (socket says 172.21.15.37:39456) 2023-10-06T02:28:19.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.235+0000 7f9cd5e90700 1 -- 172.21.15.37:0/1958483556 learned_addr learned my addr 172.21.15.37:0/1958483556 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:19.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.235+0000 7f9cd568f700 1 --2- 172.21.15.37:0/1958483556 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd00cb860 0x7f9cd0159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:19.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.236+0000 7f9cd6691700 1 -- 172.21.15.37:0/1958483556 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd00cb860 msgr2=0x7f9cd0159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:19.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.236+0000 7f9cd6691700 1 --2- 172.21.15.37:0/1958483556 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd00cb860 0x7f9cd0159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.236+0000 7f9cd6691700 1 -- 172.21.15.37:0/1958483556 >> v1:172.21.15.37:6789/0 conn(0x7f9cd006c300 legacy=0x7f9cd00cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:19.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.236+0000 7f9cd6691700 1 -- 172.21.15.37:0/1958483556 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd015d710 con 0x7f9cd006c6d0 2023-10-06T02:28:19.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.236+0000 7f9cd4e8e700 1 -- 172.21.15.37:0/1958483556 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939547299 0 0) 0x7f9cd015e040 con 0x7f9cd006c300 2023-10-06T02:28:19.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.236+0000 7f9cd6691700 1 --2- 172.21.15.37:0/1958483556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd006c6d0 0x7f9cd01596c0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80098e0 tx=0x7f9cc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bf0f8d5c31a34c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:19.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.236+0000 7f9cd4e8e700 1 -- 172.21.15.37:0/1958483556 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc800b640 con 0x7f9cd006c6d0 2023-10-06T02:28:19.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.236+0000 7f9cd4e8e700 1 -- 172.21.15.37:0/1958483556 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc800b7a0 con 0x7f9cd006c6d0 2023-10-06T02:28:19.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.236+0000 7f9cd4e8e700 1 -- 172.21.15.37:0/1958483556 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc800bb40 con 0x7f9cd006c6d0 2023-10-06T02:28:19.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.237+0000 7f9cd80f4700 1 -- 172.21.15.37:0/1958483556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd006c6d0 msgr2=0x7f9cd01596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:19.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.237+0000 7f9cd80f4700 1 --2- 172.21.15.37:0/1958483556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd006c6d0 0x7f9cd01596c0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80098e0 tx=0x7f9cc80091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.237+0000 7f9cd80f4700 1 -- 172.21.15.37:0/1958483556 shutdown_connections 2023-10-06T02:28:19.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.237+0000 7f9cd80f4700 1 --2- 172.21.15.37:0/1958483556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd006c6d0 0x7f9cd01596c0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.237+0000 7f9cd80f4700 1 --2- 172.21.15.37:0/1958483556 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd00cb860 0x7f9cd0159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.237+0000 7f9cd80f4700 1 -- 172.21.15.37:0/1958483556 >> 172.21.15.37:0/1958483556 conn(0x7f9cd00cd290 msgr2=0x7f9cd00cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:19.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.237+0000 7f9cd80f4700 1 -- 172.21.15.37:0/1958483556 shutdown_connections 2023-10-06T02:28:19.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.237+0000 7f9cd80f4700 1 -- 172.21.15.37:0/1958483556 wait complete. 2023-10-06T02:28:19.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.238+0000 7f9cd80f4700 1 Processor -- start 2023-10-06T02:28:19.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.238+0000 7f9cd80f4700 1 -- start start 2023-10-06T02:28:19.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9cd80f4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cd006c300 0x7f9cd015b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:19.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9cd80f4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd006c6d0 0x7f9cd0151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:19.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9cd80f4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd00cb860 0x7f9cd014c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:19.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9cd80f4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd016a170 con 0x7f9cd00cb860 2023-10-06T02:28:19.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9cd80f4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd015c2c0 con 0x7f9cd006c300 2023-10-06T02:28:19.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9cd80f4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd015c750 con 0x7f9cd006c6d0 2023-10-06T02:28:19.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9cd6691700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd00cb860 0x7f9cd014c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:19.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9cd6691700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd00cb860 0x7f9cd014c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39428/0 (socket says 172.21.15.37:39428) 2023-10-06T02:28:19.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9cd6691700 1 -- 172.21.15.37:0/1479022154 learned_addr learned my addr 172.21.15.37:0/1479022154 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:19.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9cd568f700 1 --2- 172.21.15.37:0/1479022154 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd006c6d0 0x7f9cd0151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:19.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9cd5e90700 1 --2- 172.21.15.37:0/1479022154 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cd006c300 0x7f9cd015b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:19.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9cd6691700 1 -- 172.21.15.37:0/1479022154 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd006c6d0 msgr2=0x7f9cd0151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:19.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9cd6691700 1 --2- 172.21.15.37:0/1479022154 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd006c6d0 0x7f9cd0151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9cd6691700 1 -- 172.21.15.37:0/1479022154 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cd006c300 msgr2=0x7f9cd015b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:19.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9cd6691700 1 --2- 172.21.15.37:0/1479022154 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cd006c300 0x7f9cd015b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9cd6691700 1 -- 172.21.15.37:0/1479022154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc8009420 con 0x7f9cd00cb860 2023-10-06T02:28:19.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9cd6691700 1 --2- 172.21.15.37:0/1479022154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd00cb860 0x7f9cd014c720 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9cd006a2a0 tx=0x7f9cc8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:19.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9ccdffb700 1 -- 172.21.15.37:0/1479022154 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc800b910 con 0x7f9cd00cb860 2023-10-06T02:28:19.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9ccdffb700 1 -- 172.21.15.37:0/1479022154 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc800bab0 con 0x7f9cd00cb860 2023-10-06T02:28:19.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9ccdffb700 1 -- 172.21.15.37:0/1479022154 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8025670 con 0x7f9cd00cb860 2023-10-06T02:28:19.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.239+0000 7f9cd80f4700 1 -- 172.21.15.37:0/1479022154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd015b6b0 con 0x7f9cd00cb860 2023-10-06T02:28:19.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.240+0000 7f9cd80f4700 1 -- 172.21.15.37:0/1479022154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd015bc70 con 0x7f9cd00cb860 2023-10-06T02:28:19.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.241+0000 7f9cd80f4700 1 -- 172.21.15.37:0/1479022154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd0069820 con 0x7f9cd00cb860 2023-10-06T02:28:19.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.241+0000 7f9ccdffb700 1 -- 172.21.15.37:0/1479022154 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9cc8023070 con 0x7f9cd00cb860 2023-10-06T02:28:19.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.241+0000 7f9ccdffb700 1 --2- 172.21.15.37:0/1479022154 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9cbc066f30 0x7f9cbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:19.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.242+0000 7f9ccdffb700 1 -- 172.21.15.37:0/1479022154 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f9cc8085c50 con 0x7f9cd00cb860 2023-10-06T02:28:19.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.242+0000 7f9cd5e90700 1 --2- 172.21.15.37:0/1479022154 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9cbc066f30 0x7f9cbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:19.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.242+0000 7f9cd5e90700 1 --2- 172.21.15.37:0/1479022154 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9cbc066f30 0x7f9cbc0693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0002250 tx=0x7f9cc0001a20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:19.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.246+0000 7f9ccdffb700 1 -- 172.21.15.37:0/1479022154 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9cc808b020 con 0x7f9cd00cb860 2023-10-06T02:28:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.485+0000 7f9cd80f4700 1 -- 172.21.15.37:0/1479022154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9cd015c400 con 0x7f9cd00cb860 2023-10-06T02:28:19.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.486+0000 7f9ccdffb700 1 -- 172.21.15.37:0/1479022154 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f9cc8015090 con 0x7f9cd00cb860 2023-10-06T02:28:19.649 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:19.649 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":53,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3055524642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3055524642},{"type":"v1","addr":"172.21.15.37:6835","nonce":3055524642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2821947660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2821947660},{"type":"v1","addr":"172.21.15.191:6836","nonce":2821947660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6310,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3752119173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3752119173},{"type":"v1","addr":"172.21.15.191:6837","nonce":3752119173}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:27:43.200836+0000","modified":"2023-10-06T02:28:18.497522+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6453":{"gid":6453,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":13,"addr":"172.21.15.37:6834/4246185831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4246185831},{"type":"v1","addr":"172.21.15.37:6834","nonce":4246185831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:28:19.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.488+0000 7f9cd80f4700 1 -- 172.21.15.37:0/1479022154 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9cbc066f30 msgr2=0x7f9cbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:19.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.488+0000 7f9cd80f4700 1 --2- 172.21.15.37:0/1479022154 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9cbc066f30 0x7f9cbc0693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0002250 tx=0x7f9cc0001a20 comp rx=0 tx=0).stop 2023-10-06T02:28:19.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.488+0000 7f9cd80f4700 1 -- 172.21.15.37:0/1479022154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd00cb860 msgr2=0x7f9cd014c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:19.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.488+0000 7f9cd80f4700 1 --2- 172.21.15.37:0/1479022154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd00cb860 0x7f9cd014c720 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9cd006a2a0 tx=0x7f9cc8017000 comp rx=0 tx=0).stop 2023-10-06T02:28:19.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.488+0000 7f9cd80f4700 1 -- 172.21.15.37:0/1479022154 shutdown_connections 2023-10-06T02:28:19.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.488+0000 7f9cd80f4700 1 --2- 172.21.15.37:0/1479022154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd00cb860 0x7f9cd014c720 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.488+0000 7f9cd80f4700 1 --2- 172.21.15.37:0/1479022154 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9cbc066f30 0x7f9cbc0693e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.488+0000 7f9cd80f4700 1 --2- 172.21.15.37:0/1479022154 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cd006c300 0x7f9cd015b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.488+0000 7f9cd80f4700 1 --2- 172.21.15.37:0/1479022154 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cd006c6d0 0x7f9cd0151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:19.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.488+0000 7f9cd80f4700 1 -- 172.21.15.37:0/1479022154 >> 172.21.15.37:0/1479022154 conn(0x7f9cd00cd290 msgr2=0x7f9cd0153860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:19.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.488+0000 7f9cd80f4700 1 -- 172.21.15.37:0/1479022154 shutdown_connections 2023-10-06T02:28:19.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:19.488+0000 7f9cd80f4700 1 -- 172.21.15.37:0/1479022154 wait complete. 2023-10-06T02:28:19.654 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 53 2023-10-06T02:28:20.057 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:27:43.200836+0000', 'modified': '2023-10-06T02:28:18.497522+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 73, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6453}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6453': {'gid': 6453, 'name': 'c', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.37:6834/4246185831', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 4246185831}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 4246185831}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:28:20.057 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:28:20.058 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T02:28:20.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.182+0000 7f90e6094700 1 Processor -- start 2023-10-06T02:28:20.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.182+0000 7f90e6094700 1 -- start start 2023-10-06T02:28:20.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.183+0000 7f90e6094700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90e0157260 0x7f90e00cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.183+0000 7f90e6094700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e00b1980 con 0x7f90e00cc300 2023-10-06T02:28:20.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.183+0000 7f90e6094700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e0158190 con 0x7f90e00b1040 2023-10-06T02:28:20.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.183+0000 7f90e6094700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e00b3fb0 con 0x7f90e0157260 2023-10-06T02:28:20.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.183+0000 7f90e5092700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90e0157260 0x7f90e00cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.183+0000 7f90e5893700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f90e00cc300 0x7f90e0067990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39468/0 (socket says 172.21.15.37:39468) 2023-10-06T02:28:20.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.183+0000 7f90e5893700 1 -- 172.21.15.37:0/1303279414 learned_addr learned my addr 172.21.15.37:0/1303279414 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:20.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.183+0000 7f90e5092700 1 -- 172.21.15.37:0/1303279414 >> v1:172.21.15.191:6789/0 conn(0x7f90e00b1040 legacy=0x7f90e0157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:20.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.184+0000 7f90e5092700 1 -- 172.21.15.37:0/1303279414 >> v1:172.21.15.37:6789/0 conn(0x7f90e00cc300 legacy=0x7f90e0067990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:20.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.184+0000 7f90dffff700 1 -- 172.21.15.37:0/1303279414 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832391609 0 0) 0x7f90e00b1980 con 0x7f90e00cc300 2023-10-06T02:28:20.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.184+0000 7f90e5092700 1 -- 172.21.15.37:0/1303279414 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e0158470 con 0x7f90e0157260 2023-10-06T02:28:20.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.184+0000 7f90e5092700 1 --2- 172.21.15.37:0/1303279414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90e0157260 0x7f90e00cbdc0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f90d0009e60 tx=0x7f90d0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deae1de8f7a65541 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:20.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.184+0000 7f90dffff700 1 -- 172.21.15.37:0/1303279414 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d000e070 con 0x7f90e0157260 2023-10-06T02:28:20.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.184+0000 7f90dffff700 1 -- 172.21.15.37:0/1303279414 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d000bbf0 con 0x7f90e0157260 2023-10-06T02:28:20.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.184+0000 7f90dffff700 1 -- 172.21.15.37:0/1303279414 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d0012430 con 0x7f90e0157260 2023-10-06T02:28:20.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.184+0000 7f90e6094700 1 -- 172.21.15.37:0/1303279414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90e0157260 msgr2=0x7f90e00cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:20.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.184+0000 7f90e6094700 1 --2- 172.21.15.37:0/1303279414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90e0157260 0x7f90e00cbdc0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f90d0009e60 tx=0x7f90d0009780 comp rx=0 tx=0).stop 2023-10-06T02:28:20.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.184+0000 7f90e6094700 1 -- 172.21.15.37:0/1303279414 shutdown_connections 2023-10-06T02:28:20.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.184+0000 7f90e6094700 1 --2- 172.21.15.37:0/1303279414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90e0157260 0x7f90e00cbdc0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.184+0000 7f90e6094700 1 -- 172.21.15.37:0/1303279414 >> 172.21.15.37:0/1303279414 conn(0x7f90e00ce280 msgr2=0x7f90e00ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:20.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.184+0000 7f90e6094700 1 -- 172.21.15.37:0/1303279414 shutdown_connections 2023-10-06T02:28:20.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.185+0000 7f90e6094700 1 -- 172.21.15.37:0/1303279414 wait complete. 2023-10-06T02:28:20.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.186+0000 7f90e6094700 1 Processor -- start 2023-10-06T02:28:20.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.186+0000 7f90e6094700 1 -- start start 2023-10-06T02:28:20.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.186+0000 7f90e6094700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90e00b1040 0x7f90e00c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.186+0000 7f90e6094700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90e00cc300 0x7f90e00c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.186+0000 7f90e6094700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90e0157260 0x7f90e01670c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.186+0000 7f90e6094700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e00ca7e0 con 0x7f90e00cc300 2023-10-06T02:28:20.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.186+0000 7f90e6094700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e00c9bd0 con 0x7f90e00b1040 2023-10-06T02:28:20.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.186+0000 7f90e6094700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e00c9eb0 con 0x7f90e0157260 2023-10-06T02:28:20.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.187+0000 7f90e4891700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90e00cc300 0x7f90e00c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.187+0000 7f90e4891700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90e00cc300 0x7f90e00c9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39446/0 (socket says 172.21.15.37:39446) 2023-10-06T02:28:20.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.187+0000 7f90e4891700 1 -- 172.21.15.37:0/2655120529 learned_addr learned my addr 172.21.15.37:0/2655120529 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:20.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.187+0000 7f90e4891700 1 -- 172.21.15.37:0/2655120529 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90e0157260 msgr2=0x7f90e01670c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:20.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.187+0000 7f90e4891700 1 --2- 172.21.15.37:0/2655120529 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90e0157260 0x7f90e01670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.187+0000 7f90e4891700 1 -- 172.21.15.37:0/2655120529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90e00b1040 msgr2=0x7f90e00c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:20.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.187+0000 7f90e5092700 1 --2- 172.21.15.37:0/2655120529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90e00b1040 0x7f90e00c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.187+0000 7f90e4891700 1 --2- 172.21.15.37:0/2655120529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90e00b1040 0x7f90e00c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.187+0000 7f90e4891700 1 -- 172.21.15.37:0/2655120529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d0009a20 con 0x7f90e00cc300 2023-10-06T02:28:20.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.187+0000 7f90e5092700 1 --2- 172.21.15.37:0/2655120529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90e00b1040 0x7f90e00c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:20.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.187+0000 7f90e4891700 1 --2- 172.21.15.37:0/2655120529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90e00cc300 0x7f90e00c9370 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f90d400c5d0 tx=0x7f90d4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:20.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.187+0000 7f90dd7fa700 1 -- 172.21.15.37:0/2655120529 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d4011590 con 0x7f90e00cc300 2023-10-06T02:28:20.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.187+0000 7f90dd7fa700 1 -- 172.21.15.37:0/2655120529 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d4011710 con 0x7f90e00cc300 2023-10-06T02:28:20.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.187+0000 7f90dd7fa700 1 -- 172.21.15.37:0/2655120529 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d4011ad0 con 0x7f90e00cc300 2023-10-06T02:28:20.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.187+0000 7f90e6094700 1 -- 172.21.15.37:0/2655120529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e00ca190 con 0x7f90e00cc300 2023-10-06T02:28:20.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.187+0000 7f90e6094700 1 -- 172.21.15.37:0/2655120529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e00c98b0 con 0x7f90e00cc300 2023-10-06T02:28:20.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.189+0000 7f90dd7fa700 1 -- 172.21.15.37:0/2655120529 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90d401c460 con 0x7f90e00cc300 2023-10-06T02:28:20.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.189+0000 7f90dd7fa700 1 --2- 172.21.15.37:0/2655120529 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f90cc066f30 0x7f90cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.189+0000 7f90dd7fa700 1 -- 172.21.15.37:0/2655120529 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f90d40844e0 con 0x7f90e00cc300 2023-10-06T02:28:20.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.189+0000 7f90e5092700 1 --2- 172.21.15.37:0/2655120529 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f90cc066f30 0x7f90cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.190+0000 7f90e5092700 1 --2- 172.21.15.37:0/2655120529 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f90cc066f30 0x7f90cc0693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f90d00097c0 tx=0x7f90d0018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.191+0000 7f90f05eeb80 1 Processor -- start 2023-10-06T02:28:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.191+0000 7f90f05eeb80 1 -- start start 2023-10-06T02:28:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.191+0000 7f90f05eeb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721532e90 0x55d721565e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.191+0000 7f90f05eeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 0x55d721533260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.192+0000 7f90f05eeb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721566350 0x55d7215824f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.192+0000 7f90f05eeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d72148da70 con 0x55d721538250 2023-10-06T02:28:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.192+0000 7f90f05eeb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d72148b270 con 0x55d721566350 2023-10-06T02:28:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.192+0000 7f90f05eeb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d721487060 con 0x55d721532e90 2023-10-06T02:28:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.192+0000 7f90e4891700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 0x55d721533260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.192+0000 7f90e4891700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 0x55d721533260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39456/0 (socket says 172.21.15.37:39456) 2023-10-06T02:28:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.192+0000 7f90e4891700 1 -- 172.21.15.37:0/2283293467 learned_addr learned my addr 172.21.15.37:0/2283293467 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.192+0000 7f90e5092700 1 --2- 172.21.15.37:0/2283293467 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721532e90 0x55d721565e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.192+0000 7f90e5893700 1 --2- 172.21.15.37:0/2283293467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721566350 0x55d7215824f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.192+0000 7f90e4891700 1 -- 172.21.15.37:0/2283293467 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721532e90 msgr2=0x55d721565e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.192+0000 7f90e4891700 1 --2- 172.21.15.37:0/2283293467 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721532e90 0x55d721565e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.192+0000 7f90e4891700 1 -- 172.21.15.37:0/2283293467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721566350 msgr2=0x55d7215824f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.192+0000 7f90e4891700 1 --2- 172.21.15.37:0/2283293467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721566350 0x55d7215824f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.192+0000 7f90e4891700 1 -- 172.21.15.37:0/2283293467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d721321270 con 0x55d721538250 2023-10-06T02:28:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.192+0000 7f90e5092700 1 --2- 172.21.15.37:0/2283293467 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721532e90 0x55d721565e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.192+0000 7f90e4891700 1 --2- 172.21.15.37:0/2283293467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 0x55d721533260 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f90d400a040 tx=0x7f90d40827b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f1a2043bc3392b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.192+0000 7f90c67fc700 1 -- 172.21.15.37:0/2283293467 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d4055260 con 0x55d721538250 2023-10-06T02:28:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.192+0000 7f90c67fc700 1 -- 172.21.15.37:0/2283293467 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d40584b0 con 0x55d721538250 2023-10-06T02:28:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.192+0000 7f90c67fc700 1 -- 172.21.15.37:0/2283293467 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d405c200 con 0x55d721538250 2023-10-06T02:28:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.193+0000 7f90f05eeb80 1 -- 172.21.15.37:0/2283293467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 msgr2=0x55d721533260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:20.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.193+0000 7f90f05eeb80 1 --2- 172.21.15.37:0/2283293467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 0x55d721533260 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f90d400a040 tx=0x7f90d40827b0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.193+0000 7f90f05eeb80 1 -- 172.21.15.37:0/2283293467 shutdown_connections 2023-10-06T02:28:20.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.193+0000 7f90f05eeb80 1 --2- 172.21.15.37:0/2283293467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721566350 0x55d7215824f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.193+0000 7f90f05eeb80 1 --2- 172.21.15.37:0/2283293467 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721532e90 0x55d721565e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.193+0000 7f90f05eeb80 1 --2- 172.21.15.37:0/2283293467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 0x55d721533260 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.193+0000 7f90f05eeb80 1 -- 172.21.15.37:0/2283293467 >> 172.21.15.37:0/2283293467 conn(0x55d721537e80 msgr2=0x55d7215386b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:20.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.193+0000 7f90f05eeb80 1 -- 172.21.15.37:0/2283293467 shutdown_connections 2023-10-06T02:28:20.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.193+0000 7f90f05eeb80 1 -- 172.21.15.37:0/2283293467 wait complete. 2023-10-06T02:28:20.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.193+0000 7f90f05eeb80 1 -- start start 2023-10-06T02:28:20.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.194+0000 7f90f05eeb80 1 Processor -- start 2023-10-06T02:28:20.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.194+0000 7f90f05eeb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721532e90 0x55d721552710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.194+0000 7f90f05eeb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721538250 0x55d7215631f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.194+0000 7f90f05eeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721566350 0x55d72156c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.194+0000 7f90f05eeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d721432890 con 0x55d721566350 2023-10-06T02:28:20.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.194+0000 7f90f05eeb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d72144dea0 con 0x55d721538250 2023-10-06T02:28:20.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.194+0000 7f90f05eeb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d721309e30 con 0x55d721532e90 2023-10-06T02:28:20.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.195+0000 7f90f05eeb80 10 client.0 _ll_register_callbacks cb 0x55d7214fa020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:28:20.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.195+0000 7f90e5893700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721566350 0x55d72156c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.195+0000 7f90e5893700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721566350 0x55d72156c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39472/0 (socket says 172.21.15.37:39472) 2023-10-06T02:28:20.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.195+0000 7f90e5893700 1 -- 172.21.15.37:0/3240793800 learned_addr learned my addr 172.21.15.37:0/3240793800 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:20.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.195+0000 7f90e5092700 1 --2- 172.21.15.37:0/3240793800 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721532e90 0x55d721552710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.195+0000 7f90e4891700 1 --2- 172.21.15.37:0/3240793800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721538250 0x55d7215631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.195+0000 7f90e5893700 1 -- 172.21.15.37:0/3240793800 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721532e90 msgr2=0x55d721552710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:20.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.195+0000 7f90e5893700 1 --2- 172.21.15.37:0/3240793800 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721532e90 0x55d721552710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.195+0000 7f90e5893700 1 -- 172.21.15.37:0/3240793800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721538250 msgr2=0x55d7215631f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:20.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.195+0000 7f90e5893700 1 --2- 172.21.15.37:0/3240793800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721538250 0x55d7215631f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.195+0000 7f90e5893700 1 -- 172.21.15.37:0/3240793800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e00c98b0 con 0x55d721566350 2023-10-06T02:28:20.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.195+0000 7f90e4891700 1 --2- 172.21.15.37:0/3240793800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721538250 0x55d7215631f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:20.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.195+0000 7f90e5893700 1 --2- 172.21.15.37:0/3240793800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721566350 0x55d72156c790 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f90d800e210 tx=0x7f90d8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2c36193878cb9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:20.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.195+0000 7f90bf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:28:20.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.195+0000 7f90bf7fe700 1 -- 172.21.15.37:0/3240793800 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80058c0 con 0x55d721566350 2023-10-06T02:28:20.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.195+0000 7f90bf7fe700 1 -- 172.21.15.37:0/3240793800 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(73..73 src has 1..73) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f90d8005a20 con 0x55d721566350 2023-10-06T02:28:20.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.195+0000 7f90f05eeb80 1 -- 172.21.15.37:0/3240793800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d72152b940 con 0x55d721566350 2023-10-06T02:28:20.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.195+0000 7f90bf7fe700 1 -- 172.21.15.37:0/3240793800 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90d8007e80 con 0x55d721566350 2023-10-06T02:28:20.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.195+0000 7f90f05eeb80 10 client.6741 fetch_fsmap learned FSMap version 53 2023-10-06T02:28:20.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.195+0000 7f90f05eeb80 1 -- 172.21.15.37:0/3240793800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) v3 -- 0x55d7212c3fe0 con 0x55d721566350 2023-10-06T02:28:20.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.196+0000 7f90bf7fe700 1 -- 172.21.15.37:0/3240793800 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d72152b940 con 0x55d721566350 2023-10-06T02:28:20.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.196+0000 7f90bf7fe700 1 -- 172.21.15.37:0/3240793800 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 53) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f90d80070d0 con 0x55d721566350 2023-10-06T02:28:20.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.196+0000 7f90f05eeb80 10 client.6741 fetch_fsmap finished waiting for FSMap version 53 2023-10-06T02:28:20.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.196+0000 7f90f05eeb80 10 client.6741 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:28:20.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.196+0000 7f90f05eeb80 20 client.6741 populate_metadata read hostname 'smithi037' 2023-10-06T02:28:20.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.196+0000 7f90f05eeb80 1 --2- 172.21.15.37:0/3240793800 >> [v2:172.21.15.37:6832/4246185831,v1:172.21.15.37:6834/4246185831] conn(0x55d721594fa0 0x55d721595370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.196+0000 7f90f05eeb80 4 client.6741 mds_command: new command op to 6453 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:28:20.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.196+0000 7f90f05eeb80 1 -- 172.21.15.37:0/3240793800 --> [v2:172.21.15.37:6832/4246185831,v1:172.21.15.37:6834/4246185831] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d721508870 con 0x55d721594fa0 2023-10-06T02:28:20.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.196+0000 7f90e5092700 1 --2- 172.21.15.37:0/3240793800 >> [v2:172.21.15.37:6832/4246185831,v1:172.21.15.37:6834/4246185831] conn(0x55d721594fa0 0x55d721595370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.196+0000 7f90bf7fe700 10 client.6741 ms_handle_connect on v2:172.21.15.37:6832/4246185831 2023-10-06T02:28:20.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.196+0000 7f90e5092700 1 --2- 172.21.15.37:0/3240793800 >> [v2:172.21.15.37:6832/4246185831,v1:172.21.15.37:6834/4246185831] conn(0x55d721594fa0 0x55d721595370 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b1766d1ae6240ae server_cookie=ffd1946eb18d8da1 in_seq=0 out_seq=0 2023-10-06T02:28:20.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.197+0000 7f90bf7fe700 1 -- 172.21.15.37:0/3240793800 <== mds.0 v2:172.21.15.37:6832/4246185831 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d721508870 con 0x55d721594fa0 2023-10-06T02:28:20.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.197+0000 7f90bf7fe700 10 client.6741 handle_command_reply: tid=0 2023-10-06T02:28:20.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.197+0000 7f90f05eeb80 1 client.6741 shutdown 2023-10-06T02:28:20.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.197+0000 7f90f05eeb80 1 -- 172.21.15.37:0/3240793800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721566350 msgr2=0x55d72156c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:20.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.197+0000 7f90f05eeb80 1 --2- 172.21.15.37:0/3240793800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721566350 0x55d72156c790 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f90d800e210 tx=0x7f90d8009040 comp rx=0 tx=0).stop 2023-10-06T02:28:20.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.197+0000 7f90f05eeb80 1 -- 172.21.15.37:0/3240793800 shutdown_connections 2023-10-06T02:28:20.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.197+0000 7f90f05eeb80 1 --2- 172.21.15.37:0/3240793800 >> [v2:172.21.15.37:6832/4246185831,v1:172.21.15.37:6834/4246185831] conn(0x55d721594fa0 0x55d721595370 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.197+0000 7f90f05eeb80 1 --2- 172.21.15.37:0/3240793800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721566350 0x55d72156c790 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.197+0000 7f90bf7fe700 0 client.6741 ms_handle_reset on v2:172.21.15.37:6832/4246185831 2023-10-06T02:28:20.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.197+0000 7f90f05eeb80 1 --2- 172.21.15.37:0/3240793800 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721532e90 0x55d721552710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.197+0000 7f90f05eeb80 1 --2- 172.21.15.37:0/3240793800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721538250 0x55d7215631f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.197+0000 7f90f05eeb80 1 -- 172.21.15.37:0/3240793800 >> 172.21.15.37:0/3240793800 conn(0x55d721537e80 msgr2=0x55d721533960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:20.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.197+0000 7f90f05eeb80 1 -- 172.21.15.37:0/3240793800 shutdown_connections 2023-10-06T02:28:20.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.197+0000 7f90f05eeb80 1 -- 172.21.15.37:0/3240793800 wait complete. 2023-10-06T02:28:20.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.197+0000 7f90f05eeb80 20 client.6741 trim_cache size 0 max 16384 2023-10-06T02:28:20.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.214+0000 7f90f05eeb80 1 Processor -- start 2023-10-06T02:28:20.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.214+0000 7f90f05eeb80 1 -- start start 2023-10-06T02:28:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90f05eeb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721537e80 0x55d721593e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90f05eeb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721532e90 0x55d721580860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90f05eeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 0x55d721580da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90f05eeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d721566c60 con 0x55d721538250 2023-10-06T02:28:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90f05eeb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d72152e120 con 0x55d721537e80 2023-10-06T02:28:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90f05eeb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7215162e0 con 0x55d721532e90 2023-10-06T02:28:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90e5893700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 0x55d721580da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90e5893700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 0x55d721580da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39478/0 (socket says 172.21.15.37:39478) 2023-10-06T02:28:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90e5893700 1 -- 172.21.15.37:0/2469284312 learned_addr learned my addr 172.21.15.37:0/2469284312 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90e4891700 1 --2- 172.21.15.37:0/2469284312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721532e90 0x55d721580860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90e5893700 1 -- 172.21.15.37:0/2469284312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721532e90 msgr2=0x55d721580860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90e5893700 1 --2- 172.21.15.37:0/2469284312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721532e90 0x55d721580860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90e5092700 1 --2- 172.21.15.37:0/2469284312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721537e80 0x55d721593e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90e5893700 1 -- 172.21.15.37:0/2469284312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721537e80 msgr2=0x55d721593e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90e5893700 1 --2- 172.21.15.37:0/2469284312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721537e80 0x55d721593e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90e5893700 1 -- 172.21.15.37:0/2469284312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d721455780 con 0x55d721538250 2023-10-06T02:28:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90e4891700 1 --2- 172.21.15.37:0/2469284312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721532e90 0x55d721580860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90e5893700 1 --2- 172.21.15.37:0/2469284312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 0x55d721580da0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x55d72153a950 tx=0x7f90d801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6ad42d0d751b3a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90c6ffd700 1 -- 172.21.15.37:0/2469284312 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d800e960 con 0x55d721538250 2023-10-06T02:28:20.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90c6ffd700 1 -- 172.21.15.37:0/2469284312 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d80075e0 con 0x55d721538250 2023-10-06T02:28:20.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.215+0000 7f90c6ffd700 1 -- 172.21.15.37:0/2469284312 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d8005880 con 0x55d721538250 2023-10-06T02:28:20.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.216+0000 7f90f05eeb80 1 -- 172.21.15.37:0/2469284312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 msgr2=0x55d721580da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:20.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.216+0000 7f90f05eeb80 1 --2- 172.21.15.37:0/2469284312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 0x55d721580da0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x55d72153a950 tx=0x7f90d801d000 comp rx=0 tx=0).stop 2023-10-06T02:28:20.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.216+0000 7f90f05eeb80 1 -- 172.21.15.37:0/2469284312 shutdown_connections 2023-10-06T02:28:20.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.216+0000 7f90f05eeb80 1 --2- 172.21.15.37:0/2469284312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 0x55d721580da0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.216+0000 7f90f05eeb80 1 --2- 172.21.15.37:0/2469284312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721537e80 0x55d721593e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.216+0000 7f90f05eeb80 1 --2- 172.21.15.37:0/2469284312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721532e90 0x55d721580860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.216+0000 7f90f05eeb80 1 -- 172.21.15.37:0/2469284312 >> 172.21.15.37:0/2469284312 conn(0x55d721564ab0 msgr2=0x55d72155f490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:20.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.216+0000 7f90f05eeb80 1 -- 172.21.15.37:0/2469284312 shutdown_connections 2023-10-06T02:28:20.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.216+0000 7f90f05eeb80 1 -- 172.21.15.37:0/2469284312 wait complete. 2023-10-06T02:28:20.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.217+0000 7f90f05eeb80 1 -- start start 2023-10-06T02:28:20.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.217+0000 7f90f05eeb80 1 Processor -- start 2023-10-06T02:28:20.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90f05eeb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721532e90 0x55d72156bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90f05eeb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721537e80 0x55d72156c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90f05eeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 0x55d721533260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90f05eeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7215597b0 con 0x55d721538250 2023-10-06T02:28:20.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90f05eeb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d721536e90 con 0x55d721532e90 2023-10-06T02:28:20.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90f05eeb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7215eaf80 con 0x55d721537e80 2023-10-06T02:28:20.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90f05eeb80 10 client.0 _ll_register_callbacks cb 0x55d7215669f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:28:20.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90e5893700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 0x55d721533260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90e5893700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 0x55d721533260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39486/0 (socket says 172.21.15.37:39486) 2023-10-06T02:28:20.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90e5893700 1 -- 172.21.15.37:0/3969070358 learned_addr learned my addr 172.21.15.37:0/3969070358 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:20.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90e4891700 1 --2- 172.21.15.37:0/3969070358 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721537e80 0x55d72156c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90e5092700 1 --2- 172.21.15.37:0/3969070358 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721532e90 0x55d72156bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90e5893700 1 -- 172.21.15.37:0/3969070358 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721537e80 msgr2=0x55d72156c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:20.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90e5893700 1 --2- 172.21.15.37:0/3969070358 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721537e80 0x55d72156c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90e5893700 1 -- 172.21.15.37:0/3969070358 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721532e90 msgr2=0x55d72156bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:20.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90e5893700 1 --2- 172.21.15.37:0/3969070358 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721532e90 0x55d72156bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90e5893700 1 -- 172.21.15.37:0/3969070358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7212c3fe0 con 0x55d721538250 2023-10-06T02:28:20.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90e5893700 1 --2- 172.21.15.37:0/3969070358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 0x55d721533260 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f90d80011e0 tx=0x7f90d8025070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204271e1537bb26d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:20.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90bf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:28:20.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90bf7fe700 1 -- 172.21.15.37:0/3969070358 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d8033070 con 0x55d721538250 2023-10-06T02:28:20.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90bf7fe700 1 -- 172.21.15.37:0/3969070358 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(73..73 src has 1..73) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f90d8014ce0 con 0x55d721538250 2023-10-06T02:28:20.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90f05eeb80 1 -- 172.21.15.37:0/3969070358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f90d40584b0 con 0x55d721538250 2023-10-06T02:28:20.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90bf7fe700 1 -- 172.21.15.37:0/3969070358 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90d8014ea0 con 0x55d721538250 2023-10-06T02:28:20.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90f05eeb80 10 client.6747 fetch_fsmap learned FSMap version 53 2023-10-06T02:28:20.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.218+0000 7f90f05eeb80 1 -- 172.21.15.37:0/3969070358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) v3 -- 0x55d72143c470 con 0x55d721538250 2023-10-06T02:28:20.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.219+0000 7f90bf7fe700 1 -- 172.21.15.37:0/3969070358 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d40584b0 con 0x55d721538250 2023-10-06T02:28:20.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.219+0000 7f90bf7fe700 1 -- 172.21.15.37:0/3969070358 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 53) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f90d8036020 con 0x55d721538250 2023-10-06T02:28:20.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.219+0000 7f90f05eeb80 10 client.6747 fetch_fsmap finished waiting for FSMap version 53 2023-10-06T02:28:20.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.219+0000 7f90f05eeb80 10 client.6747 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:28:20.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.219+0000 7f90f05eeb80 20 client.6747 populate_metadata read hostname 'smithi037' 2023-10-06T02:28:20.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.219+0000 7f90f05eeb80 1 --2- 172.21.15.37:0/3969070358 >> [v2:172.21.15.37:6832/4246185831,v1:172.21.15.37:6834/4246185831] conn(0x55d721566350 0x55d7215337a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.219+0000 7f90f05eeb80 4 client.6747 mds_command: new command op to 6453 tid=0[{"prefix": "status"}] 2023-10-06T02:28:20.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.219+0000 7f90f05eeb80 1 -- 172.21.15.37:0/3969070358 --> [v2:172.21.15.37:6832/4246185831,v1:172.21.15.37:6834/4246185831] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d721429e00 con 0x55d721566350 2023-10-06T02:28:20.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.219+0000 7f90e5092700 1 --2- 172.21.15.37:0/3969070358 >> [v2:172.21.15.37:6832/4246185831,v1:172.21.15.37:6834/4246185831] conn(0x55d721566350 0x55d7215337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.219+0000 7f90bf7fe700 10 client.6747 ms_handle_connect on v2:172.21.15.37:6832/4246185831 2023-10-06T02:28:20.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.219+0000 7f90e5092700 1 --2- 172.21.15.37:0/3969070358 >> [v2:172.21.15.37:6832/4246185831,v1:172.21.15.37:6834/4246185831] conn(0x55d721566350 0x55d7215337a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f010c275f87118e server_cookie=78f8e32b5432b168 in_seq=0 out_seq=0 2023-10-06T02:28:20.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.219+0000 7f90bf7fe700 1 -- 172.21.15.37:0/3969070358 <== mds.0 v2:172.21.15.37:6832/4246185831 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55d721429e00 con 0x55d721566350 2023-10-06T02:28:20.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.219+0000 7f90bf7fe700 10 client.6747 handle_command_reply: tid=0 2023-10-06T02:28:20.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.219+0000 7f90f05eeb80 1 client.6747 shutdown 2023-10-06T02:28:20.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90f05eeb80 1 -- 172.21.15.37:0/3969070358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 msgr2=0x55d721533260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:20.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90f05eeb80 1 --2- 172.21.15.37:0/3969070358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 0x55d721533260 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f90d80011e0 tx=0x7f90d8025070 comp rx=0 tx=0).stop 2023-10-06T02:28:20.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90f05eeb80 1 -- 172.21.15.37:0/3969070358 shutdown_connections 2023-10-06T02:28:20.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90f05eeb80 1 --2- 172.21.15.37:0/3969070358 >> [v2:172.21.15.37:6832/4246185831,v1:172.21.15.37:6834/4246185831] conn(0x55d721566350 0x55d7215337a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90f05eeb80 1 --2- 172.21.15.37:0/3969070358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d721538250 0x55d721533260 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90bf7fe700 0 client.6747 ms_handle_reset on v2:172.21.15.37:6832/4246185831 2023-10-06T02:28:20.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90f05eeb80 1 --2- 172.21.15.37:0/3969070358 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d721532e90 0x55d72156bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90f05eeb80 1 --2- 172.21.15.37:0/3969070358 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d721537e80 0x55d72156c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90f05eeb80 1 -- 172.21.15.37:0/3969070358 >> 172.21.15.37:0/3969070358 conn(0x55d721564ab0 msgr2=0x55d7215600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:20.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90f05eeb80 1 -- 172.21.15.37:0/3969070358 shutdown_connections 2023-10-06T02:28:20.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90f05eeb80 1 -- 172.21.15.37:0/3969070358 wait complete. 2023-10-06T02:28:20.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90f05eeb80 20 client.6747 trim_cache size 0 max 16384 2023-10-06T02:28:20.231 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:28:20.231 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "d1f292a2-fd8c-430a-be88-f44de408e77c", 2023-10-06T02:28:20.231 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-10-06T02:28:20.232 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6453, 2023-10-06T02:28:20.232 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-10-06T02:28:20.232 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-10-06T02:28:20.232 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-10-06T02:28:20.232 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 4.7284185680000004, 2023-10-06T02:28:20.232 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 53, 2023-10-06T02:28:20.232 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 73, 2023-10-06T02:28:20.232 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 73, 2023-10-06T02:28:20.232 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 42.499127813999998 2023-10-06T02:28:20.232 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:28:20.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90e6094700 1 -- 172.21.15.37:0/2655120529 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f90cc066f30 msgr2=0x7f90cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:20.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90e6094700 1 --2- 172.21.15.37:0/2655120529 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f90cc066f30 0x7f90cc0693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f90d00097c0 tx=0x7f90d0018000 comp rx=0 tx=0).stop 2023-10-06T02:28:20.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90e6094700 1 -- 172.21.15.37:0/2655120529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90e00cc300 msgr2=0x7f90e00c9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:20.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90e6094700 1 --2- 172.21.15.37:0/2655120529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90e00cc300 0x7f90e00c9370 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f90d400c5d0 tx=0x7f90d4007f60 comp rx=0 tx=0).stop 2023-10-06T02:28:20.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90e6094700 1 -- 172.21.15.37:0/2655120529 shutdown_connections 2023-10-06T02:28:20.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90e6094700 1 --2- 172.21.15.37:0/2655120529 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90e0157260 0x7f90e01670c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90e6094700 1 --2- 172.21.15.37:0/2655120529 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f90cc066f30 0x7f90cc0693e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90e6094700 1 --2- 172.21.15.37:0/2655120529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90e00b1040 0x7f90e00c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90e6094700 1 --2- 172.21.15.37:0/2655120529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90e00cc300 0x7f90e00c9370 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90e6094700 1 -- 172.21.15.37:0/2655120529 >> 172.21.15.37:0/2655120529 conn(0x7f90e00ce280 msgr2=0x7f90e0068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:20.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90e6094700 1 -- 172.21.15.37:0/2655120529 shutdown_connections 2023-10-06T02:28:20.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.220+0000 7f90e6094700 1 -- 172.21.15.37:0/2655120529 wait complete. 2023-10-06T02:28:20.235 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:28:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.353+0000 7f5902453700 1 Processor -- start 2023-10-06T02:28:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.353+0000 7f5902453700 1 -- start start 2023-10-06T02:28:20.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.354+0000 7f5902453700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f58fc159760 0x7f58fc15d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.354+0000 7f5902453700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58fc15d8d0 0x7f58fc15dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.354+0000 7f5902453700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f58fc0c5390 0x7f58fc0c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.354+0000 7f5902453700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58fc0cc2d0 con 0x7f58fc0c5390 2023-10-06T02:28:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.354+0000 7f5902453700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58fc15e260 con 0x7f58fc159760 2023-10-06T02:28:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.354+0000 7f5902453700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0cb650 con 0x7f58fc15d8d0 2023-10-06T02:28:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.354+0000 7f59009f0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f58fc0c5390 0x7f58fc0c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.354+0000 7f59009f0700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f58fc0c5390 0x7f58fc0c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39500/0 (socket says 172.21.15.37:39500) 2023-10-06T02:28:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.354+0000 7f59009f0700 1 -- 172.21.15.37:0/605737100 learned_addr learned my addr 172.21.15.37:0/605737100 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.354+0000 7f58fbfff700 1 --2- 172.21.15.37:0/605737100 >> v2:172.21.15.191:3300/0 conn(0x7f58fc159760 0x7f58fc15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.354+0000 7f58fb7fe700 1 --2- 172.21.15.37:0/605737100 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58fc15d8d0 0x7f58fc15dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.355+0000 7f59009f0700 1 -- 172.21.15.37:0/605737100 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58fc15d8d0 msgr2=0x7f58fc15dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.355+0000 7f59009f0700 1 --2- 172.21.15.37:0/605737100 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58fc15d8d0 0x7f58fc15dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.355+0000 7f59009f0700 1 -- 172.21.15.37:0/605737100 >> v2:172.21.15.191:3300/0 conn(0x7f58fc159760 msgr2=0x7f58fc15d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.355+0000 7f59009f0700 1 --2- 172.21.15.37:0/605737100 >> v2:172.21.15.191:3300/0 conn(0x7f58fc159760 0x7f58fc15d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.355+0000 7f59009f0700 1 -- 172.21.15.37:0/605737100 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc0cb930 con 0x7f58fc0c5390 2023-10-06T02:28:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.355+0000 7f59009f0700 1 --2- 172.21.15.37:0/605737100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58fc0c5390 0x7f58fc0c5810 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0897f0 tx=0x7f58f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ed4b581c272a12 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.355+0000 7f58faffd700 1 -- 172.21.15.37:0/605737100 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f400e070 con 0x7f58fc0c5390 2023-10-06T02:28:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.355+0000 7f58faffd700 1 -- 172.21.15.37:0/605737100 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f400ba00 con 0x7f58fc0c5390 2023-10-06T02:28:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.355+0000 7f58faffd700 1 -- 172.21.15.37:0/605737100 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f40092e0 con 0x7f58fc0c5390 2023-10-06T02:28:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.355+0000 7f5902453700 1 -- 172.21.15.37:0/605737100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58fc0c5390 msgr2=0x7f58fc0c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.355+0000 7f5902453700 1 --2- 172.21.15.37:0/605737100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58fc0c5390 0x7f58fc0c5810 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0897f0 tx=0x7f58f4009840 comp rx=0 tx=0).stop 2023-10-06T02:28:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.356+0000 7f5902453700 1 -- 172.21.15.37:0/605737100 shutdown_connections 2023-10-06T02:28:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.356+0000 7f5902453700 1 --2- 172.21.15.37:0/605737100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58fc0c5390 0x7f58fc0c5810 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.356+0000 7f5902453700 1 --2- 172.21.15.37:0/605737100 >> v2:172.21.15.191:3300/0 conn(0x7f58fc159760 0x7f58fc15d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.356+0000 7f5902453700 1 --2- 172.21.15.37:0/605737100 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58fc15d8d0 0x7f58fc15dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.356+0000 7f5902453700 1 -- 172.21.15.37:0/605737100 >> 172.21.15.37:0/605737100 conn(0x7f58fc06c890 msgr2=0x7f58fc0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.356+0000 7f5902453700 1 -- 172.21.15.37:0/605737100 shutdown_connections 2023-10-06T02:28:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.356+0000 7f5902453700 1 -- 172.21.15.37:0/605737100 wait complete. 2023-10-06T02:28:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.357+0000 7f5902453700 1 Processor -- start 2023-10-06T02:28:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.357+0000 7f5902453700 1 -- start start 2023-10-06T02:28:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f5902453700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58fc0c5390 0x7f58fc15a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f5902453700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58fc159760 0x7f58fc0b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f5902453700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58fc15d8d0 0x7f58fc0b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f5902453700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc155770 con 0x7f58fc0c5390 2023-10-06T02:28:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f5902453700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0b4eb0 con 0x7f58fc15d8d0 2023-10-06T02:28:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f5902453700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0b5190 con 0x7f58fc159760 2023-10-06T02:28:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f58fbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58fc0c5390 0x7f58fc15a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f58fbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58fc0c5390 0x7f58fc15a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39514/0 (socket says 172.21.15.37:39514) 2023-10-06T02:28:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f58fbfff700 1 -- 172.21.15.37:0/3936248309 learned_addr learned my addr 172.21.15.37:0/3936248309 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f59009f0700 1 --2- 172.21.15.37:0/3936248309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58fc15d8d0 0x7f58fc0b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f58fb7fe700 1 --2- 172.21.15.37:0/3936248309 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58fc159760 0x7f58fc0b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f58fbfff700 1 -- 172.21.15.37:0/3936248309 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58fc159760 msgr2=0x7f58fc0b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f58fbfff700 1 --2- 172.21.15.37:0/3936248309 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58fc159760 0x7f58fc0b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f58fbfff700 1 -- 172.21.15.37:0/3936248309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58fc15d8d0 msgr2=0x7f58fc0b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:20.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f58fbfff700 1 --2- 172.21.15.37:0/3936248309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58fc15d8d0 0x7f58fc0b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f58fbfff700 1 -- 172.21.15.37:0/3936248309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f4009ae0 con 0x7f58fc0c5390 2023-10-06T02:28:20.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f58fbfff700 1 --2- 172.21.15.37:0/3936248309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58fc0c5390 0x7f58fc15a6b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f58f000ec80 tx=0x7f58f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:20.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f58e3fff700 1 -- 172.21.15.37:0/3936248309 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f000c850 con 0x7f58fc0c5390 2023-10-06T02:28:20.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f58e3fff700 1 -- 172.21.15.37:0/3936248309 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f000c9b0 con 0x7f58fc0c5390 2023-10-06T02:28:20.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f5902453700 1 -- 172.21.15.37:0/3936248309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc155120 con 0x7f58fc0c5390 2023-10-06T02:28:20.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f58e3fff700 1 -- 172.21.15.37:0/3936248309 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f000cd50 con 0x7f58fc0c5390 2023-10-06T02:28:20.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.358+0000 7f5902453700 1 -- 172.21.15.37:0/3936248309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc15abf0 con 0x7f58fc0c5390 2023-10-06T02:28:20.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.359+0000 7f5902453700 1 -- 172.21.15.37:0/3936248309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58fc155a50 con 0x7f58fc0c5390 2023-10-06T02:28:20.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.360+0000 7f58e3fff700 1 -- 172.21.15.37:0/3936248309 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f58f0013680 con 0x7f58fc0c5390 2023-10-06T02:28:20.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.360+0000 7f58e3fff700 1 --2- 172.21.15.37:0/3936248309 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f58e8066f30 0x7f58e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:20.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.360+0000 7f58e3fff700 1 -- 172.21.15.37:0/3936248309 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f58f0084910 con 0x7f58fc0c5390 2023-10-06T02:28:20.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.360+0000 7f58fb7fe700 1 --2- 172.21.15.37:0/3936248309 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f58e8066f30 0x7f58e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:20.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.361+0000 7f58fb7fe700 1 --2- 172.21.15.37:0/3936248309 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f58e8066f30 0x7f58e80693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0b30c0 tx=0x7f58ec0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:20.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.364+0000 7f58e3fff700 1 -- 172.21.15.37:0/3936248309 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58f00519d0 con 0x7f58fc0c5390 2023-10-06T02:28:20.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.605+0000 7f5902453700 1 -- 172.21.15.37:0/3936248309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f58fc0b60d0 con 0x7f58fc0c5390 2023-10-06T02:28:20.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.605+0000 7f58e3fff700 1 -- 172.21.15.37:0/3936248309 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+73 (secure 0 0 0) 0x7f58f0054ff0 con 0x7f58fc0c5390 2023-10-06T02:28:20.606 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:28:20.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.607+0000 7f5902453700 1 -- 172.21.15.37:0/3936248309 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f58e8066f30 msgr2=0x7f58e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:20.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.607+0000 7f5902453700 1 --2- 172.21.15.37:0/3936248309 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f58e8066f30 0x7f58e80693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0b30c0 tx=0x7f58ec0091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.607+0000 7f5902453700 1 -- 172.21.15.37:0/3936248309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58fc0c5390 msgr2=0x7f58fc15a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:20.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.607+0000 7f5902453700 1 --2- 172.21.15.37:0/3936248309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58fc0c5390 0x7f58fc15a6b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f58f000ec80 tx=0x7f58f00091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.607+0000 7f5902453700 1 -- 172.21.15.37:0/3936248309 shutdown_connections 2023-10-06T02:28:20.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.607+0000 7f5902453700 1 --2- 172.21.15.37:0/3936248309 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f58e8066f30 0x7f58e80693e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.607+0000 7f5902453700 1 --2- 172.21.15.37:0/3936248309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58fc15d8d0 0x7f58fc0b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.607+0000 7f5902453700 1 --2- 172.21.15.37:0/3936248309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58fc0c5390 0x7f58fc15a6b0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.607+0000 7f5902453700 1 --2- 172.21.15.37:0/3936248309 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58fc159760 0x7f58fc0b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:20.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.607+0000 7f5902453700 1 -- 172.21.15.37:0/3936248309 >> 172.21.15.37:0/3936248309 conn(0x7f58fc06c890 msgr2=0x7f58fc1585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:20.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.607+0000 7f5902453700 1 -- 172.21.15.37:0/3936248309 shutdown_connections 2023-10-06T02:28:20.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:20.607+0000 7f5902453700 1 -- 172.21.15.37:0/3936248309 wait complete. 2023-10-06T02:28:20.620 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:28:20.620 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:28:20.620 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-10-06T02:28:20.620 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:28:20.620 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:20.620 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:28:20.620 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:28:20.620 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:28:20.620 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:28:20.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:20.621 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-10-06T02:28:20.640 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:28:20.641 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:28:20.641 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:28:20.641 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:20.641 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T02:28:20.641 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:20.641 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:28:20.642 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:20.642 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-10-06T02:28:20.642 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:28:20.642 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:20.642 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-10-06T02:28:20.642 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:28:20.642 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42181sec preferred_lft 42181sec 2023-10-06T02:28:20.643 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-10-06T02:28:20.643 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:20.643 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:28:20.643 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:20.643 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-10-06T02:28:20.643 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:28:20.643 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:20.643 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-10-06T02:28:20.644 INFO:teuthology.orchestra.run.smithi037.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:28:20.644 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 26:84:4a:aa:8b:b5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:20.644 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:28:20.644 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:20.644 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::a0fb:38ff:fe90:57e1/64 scope link 2023-10-06T02:28:20.644 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:20.644 INFO:teuthology.orchestra.run.smithi037.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:28:20.645 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 36:fb:a9:50:59:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:28:20.645 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::34fb:a9ff:fe50:5976/64 scope link 2023-10-06T02:28:20.645 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:20.645 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:28:20.645 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 26:84:4a:aa:8b:b5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:28:20.645 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::2484:4aff:feaa:8bb5/64 scope link 2023-10-06T02:28:20.645 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:20.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:20.647 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:28:20.705 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T02:28:20.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:20.707 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-10-06T02:28:20.762 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-10-06T02:28:20.763 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:28:20.763 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:28:20.763 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:28:20.763 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:28:20.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:20.763 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T02:28:20.763 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T02:28:20.763 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:28:20.764 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:28:20.764 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:28:20.764 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T02:28:20.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:20.865 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T02:28:20.880 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:28:20.880 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:28:20.880 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:28:20.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:20.881 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-10-06T02:28:20.946 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:28:20.946 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:28:20.946 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:21.001 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:28:21.002 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:28:21.002 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:21.057 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T02:28:21.123 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:28:21.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:28:21.187 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:28:21.188 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:28:21.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:21.189 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T02:28:21.244 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:28:21.244 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:28:21.286 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T02:28:21.311 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:28:21.311 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:28:21.368 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-10-06T02:28:21.368+0000 7f83bf6b6540 -1 init, newargv = 0x55a76cf36690 newargc=15 2023-10-06T02:28:21.368 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[115567]: starting ceph client 2023-10-06T02:28:21.373 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[115567]: starting fuse 2023-10-06T02:28:21.377 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:28:21.378 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:28:21.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:21.379 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T02:28:21.434 INFO:teuthology.orchestra.run.smithi037.stdout:46 2023-10-06T02:28:21.435 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T02:28:21.435 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:21.435 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-10-06T02:28:21.435 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-10-06T02:28:21.435 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:28:21.435 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-10-06T02:28:21.435 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:21.436 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-10-06T02:28:21.436 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:28:21.436 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-10-06T02:28:21.436 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:28:21.436 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:21.436 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-10-06T02:28:21.436 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-10-06T02:28:21.436 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-10-06T02:28:21.436 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-10-06T02:28:21.436 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:21.436 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-10-06T02:28:21.436 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:28:21.436 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:28:21.437 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:28:21.437 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-10-06T02:28:21.437 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-10-06T02:28:21.437 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-10-06T02:28:21.437 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:28:21.437 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:21.437 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-10-06T02:28:21.437 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:28:21.558 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.115567.asok 2023-10-06T02:28:21.741 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.115567.asok 2023-10-06T02:28:22.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:22.266 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.115567.asok status 2023-10-06T02:28:22.267 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:28:22.270 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:28:22.390 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:28:22.390 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-10-06T02:28:22.391 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:28:22.391 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:28:22.391 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-10-06T02:28:22.391 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-10-06T02:28:22.391 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:28:22.391 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "115567", 2023-10-06T02:28:22.391 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-10-06T02:28:22.391 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:28:22.391 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-10-06T02:28:22.391 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-10-06T02:28:22.391 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6762, 2023-10-06T02:28:22.391 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-10-06T02:28:22.392 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-10-06T02:28:22.392 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-10-06T02:28:22.392 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 6762 2023-10-06T02:28:22.392 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:28:22.392 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T02:28:22.392 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T02:28:22.392 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:28:22.392 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3433273132 2023-10-06T02:28:22.392 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:28:22.392 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:28:22.392 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T02:28:22.392 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T02:28:22.393 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:28:22.393 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3433273132 2023-10-06T02:28:22.393 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:28:22.393 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.6762 192.168.0.1:0/3433273132", 2023-10-06T02:28:22.393 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/3433273132", 2023-10-06T02:28:22.393 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-10-06T02:28:22.393 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 53, 2023-10-06T02:28:22.393 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 73, 2023-10-06T02:28:22.393 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:28:22.393 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-10-06T02:28:22.393 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-10-06T02:28:22.393 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:28:22.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:22.425 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-10-06T02:28:22.425 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:22.442 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-10-06T02:28:22.743 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:22.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:22.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:22.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:22.771 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2023-10-06T02:28:22.837 INFO:teuthology.orchestra.run.smithi037.stdout:./ 2023-10-06T02:28:22.837 INFO:teuthology.orchestra.run.smithi037.stdout:./parent 2023-10-06T02:28:22.837 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed 2023-10-06T02:28:22.838 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed/charlie 2023-10-06T02:28:22.838 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed/alpha 2023-10-06T02:28:22.838 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/unflushed 2023-10-06T02:28:22.839 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/unflushed/jfile 2023-10-06T02:28:22.839 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:22.839 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:28:22.839 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:28:22.840 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:22.840 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2023-10-06T02:28:22.840 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:28:22.944 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T02:28:23.112 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-10-06T02:28:23.111+0000 7f2f54fdc700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:28:23.133 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:23.133 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:28:23.133 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:28:23.133 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:23.133 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2023-10-06T02:28:23.134 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:28:23.240 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627776 2023-10-06T02:28:23.428 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:23.428 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:28:23.428 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:28:23.428 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:23.429 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2023-10-06T02:28:23.429 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:28:23.535 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627777 2023-10-06T02:28:23.723 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:23.723 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:28:23.723 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:28:23.723 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:23.724 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2023-10-06T02:28:23.724 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:28:23.831 INFO:teuthology.orchestra.run.smithi037.stdout:1099511628280 2023-10-06T02:28:24.018 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:24.019 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:28:24.019 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:28:24.019 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:24.019 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2023-10-06T02:28:24.019 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:28:24.125 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627778 2023-10-06T02:28:24.314 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:24.314 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:28:24.314 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:28:24.314 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:24.315 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2023-10-06T02:28:24.315 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:28:24.421 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627779 2023-10-06T02:28:24.610 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:24.610 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:28:24.610 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:28:24.610 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:24.610 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2023-10-06T02:28:24.611 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:28:24.718 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627780 2023-10-06T02:28:24.906 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-10-06T02:28:24.907 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:28:24.907 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:24.983 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[115567]: fuse finished with error 0 and tester_r 0 2023-10-06T02:28:24.984 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:28:31.086 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:28:31.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:31.086 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:28:31.105 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:31.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.276+0000 7fa280b41700 1 Processor -- start 2023-10-06T02:28:31.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.276+0000 7fa280b41700 1 -- start start 2023-10-06T02:28:31.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.277+0000 7fa280b41700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa27c0a8920 0x7fa27c0b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.277+0000 7fa280b41700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa27c159750 0x7fa27c0b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.277+0000 7fa280b41700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa27c15d1f0 con 0x7fa27c0a8cf0 2023-10-06T02:28:31.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.277+0000 7fa280b41700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa27c0b4150 con 0x7fa27c159750 2023-10-06T02:28:31.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.277+0000 7fa280b41700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa27c0b1ce0 con 0x7fa27c0a8920 2023-10-06T02:28:31.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.277+0000 7fa27ad9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa27c159750 0x7fa27c0b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.277+0000 7fa27ad9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa27c159750 0x7fa27c0b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60994/0 (socket says 172.21.15.37:60994) 2023-10-06T02:28:31.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.277+0000 7fa27ad9d700 1 -- 172.21.15.37:0/1307863455 learned_addr learned my addr 172.21.15.37:0/1307863455 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:31.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.277+0000 7fa27a59c700 1 --2- 172.21.15.37:0/1307863455 >> v2:172.21.15.191:3300/0 conn(0x7fa27c0a8920 0x7fa27c0b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.278+0000 7fa27ad9d700 1 -- 172.21.15.37:0/1307863455 >> v2:172.21.15.191:3300/0 conn(0x7fa27c0a8920 msgr2=0x7fa27c0b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:31.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.278+0000 7fa27ad9d700 1 --2- 172.21.15.37:0/1307863455 >> v2:172.21.15.191:3300/0 conn(0x7fa27c0a8920 0x7fa27c0b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.278+0000 7fa27ad9d700 1 -- 172.21.15.37:0/1307863455 >> v1:172.21.15.191:6789/0 conn(0x7fa27c0a8cf0 legacy=0x7fa27c159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.278+0000 7fa27ad9d700 1 -- 172.21.15.37:0/1307863455 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27c15dd70 con 0x7fa27c159750 2023-10-06T02:28:31.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.278+0000 7fa27ad9d700 1 --2- 172.21.15.37:0/1307863455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa27c159750 0x7fa27c0b15d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa27c064240 tx=0x7fa274009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9317d220356bc152 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:31.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.278+0000 7fa27959a700 1 -- 172.21.15.37:0/1307863455 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27400b820 con 0x7fa27c159750 2023-10-06T02:28:31.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.278+0000 7fa27959a700 1 -- 172.21.15.37:0/1307863455 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27400b980 con 0x7fa27c159750 2023-10-06T02:28:31.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.278+0000 7fa27959a700 1 -- 172.21.15.37:0/1307863455 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27400bd20 con 0x7fa27c159750 2023-10-06T02:28:31.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.278+0000 7fa280b41700 1 -- 172.21.15.37:0/1307863455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa27c159750 msgr2=0x7fa27c0b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.278+0000 7fa280b41700 1 --2- 172.21.15.37:0/1307863455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa27c159750 0x7fa27c0b15d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa27c064240 tx=0x7fa274009250 comp rx=0 tx=0).stop 2023-10-06T02:28:31.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.278+0000 7fa280b41700 1 -- 172.21.15.37:0/1307863455 shutdown_connections 2023-10-06T02:28:31.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.278+0000 7fa280b41700 1 --2- 172.21.15.37:0/1307863455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa27c159750 0x7fa27c0b15d0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.278+0000 7fa280b41700 1 --2- 172.21.15.37:0/1307863455 >> v2:172.21.15.191:3300/0 conn(0x7fa27c0a8920 0x7fa27c0b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.278+0000 7fa280b41700 1 -- 172.21.15.37:0/1307863455 >> 172.21.15.37:0/1307863455 conn(0x7fa27c067b30 msgr2=0x7fa27c067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:31.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.279+0000 7fa280b41700 1 -- 172.21.15.37:0/1307863455 shutdown_connections 2023-10-06T02:28:31.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.279+0000 7fa280b41700 1 -- 172.21.15.37:0/1307863455 wait complete. 2023-10-06T02:28:31.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.280+0000 7fa280b41700 1 Processor -- start 2023-10-06T02:28:31.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.280+0000 7fa280b41700 1 -- start start 2023-10-06T02:28:31.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.280+0000 7fa280b41700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa27c0a8920 0x7fa27c143c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.280+0000 7fa280b41700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa27c0a8cf0 0x7fa27c16cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.280+0000 7fa280b41700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa27c159750 0x7fa27c1560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.280+0000 7fa280b41700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c16dc80 con 0x7fa27c159750 2023-10-06T02:28:31.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.280+0000 7fa280b41700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c15a180 con 0x7fa27c0a8920 2023-10-06T02:28:31.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.280+0000 7fa280b41700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c16d6c0 con 0x7fa27c0a8cf0 2023-10-06T02:28:31.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.280+0000 7fa27ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa27c159750 0x7fa27c1560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.281+0000 7fa27ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa27c159750 0x7fa27c1560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32778/0 (socket says 172.21.15.37:32778) 2023-10-06T02:28:31.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.281+0000 7fa27ad9d700 1 -- 172.21.15.37:0/1650883225 learned_addr learned my addr 172.21.15.37:0/1650883225 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:31.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.281+0000 7fa27a59c700 1 --2- 172.21.15.37:0/1650883225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa27c0a8920 0x7fa27c143c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.281+0000 7fa279d9b700 1 --2- 172.21.15.37:0/1650883225 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa27c0a8cf0 0x7fa27c16cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.281+0000 7fa27ad9d700 1 -- 172.21.15.37:0/1650883225 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa27c0a8cf0 msgr2=0x7fa27c16cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.281+0000 7fa27ad9d700 1 --2- 172.21.15.37:0/1650883225 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa27c0a8cf0 0x7fa27c16cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.281+0000 7fa27ad9d700 1 -- 172.21.15.37:0/1650883225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa27c0a8920 msgr2=0x7fa27c143c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.281+0000 7fa27ad9d700 1 --2- 172.21.15.37:0/1650883225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa27c0a8920 0x7fa27c143c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.281+0000 7fa27ad9d700 1 -- 172.21.15.37:0/1650883225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2740094f0 con 0x7fa27c159750 2023-10-06T02:28:31.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.281+0000 7fa27ad9d700 1 --2- 172.21.15.37:0/1650883225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa27c159750 0x7fa27c1560d0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fa274009930 tx=0x7fa274017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:31.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.281+0000 7fa2727fc700 1 -- 172.21.15.37:0/1650883225 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa274011e30 con 0x7fa27c159750 2023-10-06T02:28:31.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.281+0000 7fa2727fc700 1 -- 172.21.15.37:0/1650883225 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27401a630 con 0x7fa27c159750 2023-10-06T02:28:31.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.281+0000 7fa280b41700 1 -- 172.21.15.37:0/1650883225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa27c16d9a0 con 0x7fa27c159750 2023-10-06T02:28:31.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.281+0000 7fa2727fc700 1 -- 172.21.15.37:0/1650883225 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27401a9f0 con 0x7fa27c159750 2023-10-06T02:28:31.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.281+0000 7fa280b41700 1 -- 172.21.15.37:0/1650883225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27c1441c0 con 0x7fa27c159750 2023-10-06T02:28:31.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.282+0000 7fa280b41700 1 -- 172.21.15.37:0/1650883225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa27c067970 con 0x7fa27c159750 2023-10-06T02:28:31.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.283+0000 7fa2727fc700 1 -- 172.21.15.37:0/1650883225 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa27402d440 con 0x7fa27c159750 2023-10-06T02:28:31.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.283+0000 7fa2727fc700 1 --2- 172.21.15.37:0/1650883225 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa25c066f30 0x7fa25c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.283+0000 7fa2727fc700 1 -- 172.21.15.37:0/1650883225 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fa274086060 con 0x7fa27c159750 2023-10-06T02:28:31.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.283+0000 7fa27a59c700 1 --2- 172.21.15.37:0/1650883225 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa25c066f30 0x7fa25c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.284+0000 7fa27a59c700 1 --2- 172.21.15.37:0/1650883225 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa25c066f30 0x7fa25c0693e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa26c007680 tx=0x7fa26c0098d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:31.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.287+0000 7fa2727fc700 1 -- 172.21.15.37:0/1650883225 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2740531a0 con 0x7fa27c159750 2023-10-06T02:28:31.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.524+0000 7fa280b41700 1 -- 172.21.15.37:0/1650883225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa27c0aeb00 con 0x7fa27c159750 2023-10-06T02:28:31.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.524+0000 7fa2727fc700 1 -- 172.21.15.37:0/1650883225 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4607 (secure 0 0 0) 0x7fa2740567c0 con 0x7fa27c159750 2023-10-06T02:28:31.525 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:31.525 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":53,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3055524642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3055524642},{"type":"v1","addr":"172.21.15.37:6835","nonce":3055524642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2821947660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2821947660},{"type":"v1","addr":"172.21.15.191:6836","nonce":2821947660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6310,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3752119173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3752119173},{"type":"v1","addr":"172.21.15.191:6837","nonce":3752119173}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:27:43.200836+0000","modified":"2023-10-06T02:28:18.497522+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6453":{"gid":6453,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":13,"addr":"172.21.15.37:6834/4246185831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4246185831},{"type":"v1","addr":"172.21.15.37:6834","nonce":4246185831}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:28:31.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.526+0000 7fa280b41700 1 -- 172.21.15.37:0/1650883225 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa25c066f30 msgr2=0x7fa25c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.526+0000 7fa280b41700 1 --2- 172.21.15.37:0/1650883225 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa25c066f30 0x7fa25c0693e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa26c007680 tx=0x7fa26c0098d0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.526+0000 7fa280b41700 1 -- 172.21.15.37:0/1650883225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa27c159750 msgr2=0x7fa27c1560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.526+0000 7fa280b41700 1 --2- 172.21.15.37:0/1650883225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa27c159750 0x7fa27c1560d0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fa274009930 tx=0x7fa274017000 comp rx=0 tx=0).stop 2023-10-06T02:28:31.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.526+0000 7fa280b41700 1 -- 172.21.15.37:0/1650883225 shutdown_connections 2023-10-06T02:28:31.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.526+0000 7fa280b41700 1 --2- 172.21.15.37:0/1650883225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa27c159750 0x7fa27c1560d0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.526+0000 7fa280b41700 1 --2- 172.21.15.37:0/1650883225 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa25c066f30 0x7fa25c0693e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.526+0000 7fa280b41700 1 --2- 172.21.15.37:0/1650883225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa27c0a8920 0x7fa27c143c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.526+0000 7fa280b41700 1 --2- 172.21.15.37:0/1650883225 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa27c0a8cf0 0x7fa27c16cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.526+0000 7fa280b41700 1 -- 172.21.15.37:0/1650883225 >> 172.21.15.37:0/1650883225 conn(0x7fa27c067b30 msgr2=0x7fa27c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:31.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.526+0000 7fa280b41700 1 -- 172.21.15.37:0/1650883225 shutdown_connections 2023-10-06T02:28:31.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.526+0000 7fa280b41700 1 -- 172.21.15.37:0/1650883225 wait complete. 2023-10-06T02:28:31.528 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 53 2023-10-06T02:28:31.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json tag path /parent mytag123 2023-10-06T02:28:31.679 INFO:teuthology.orchestra.run.smithi037.stdout:{"return_code":0,"scrub_tag":"mytag123","mode":"asynchronous"} 2023-10-06T02:28:31.680 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag123" } 2023-10-06T02:28:31.680 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2023-10-06T02:28:31.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.718+0000 7f50f210a000 1 Processor -- start 2023-10-06T02:28:31.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.718+0000 7f50f210a000 1 -- start start 2023-10-06T02:28:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50f210a000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d1d23d950 0x558d1d30d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50f210a000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558d1d268090 0x558d1d2fbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50f210a000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d1d312480 0x558d1d27f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50f210a000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1d186620 con 0x558d1d312480 2023-10-06T02:28:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50f210a000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1d17d400 con 0x558d1d23d950 2023-10-06T02:28:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50f210a000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x558d1d22a890 con 0x558d1d268090 2023-10-06T02:28:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50ebb46700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d1d312480 0x558d1d27f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50ebb46700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d1d312480 0x558d1d27f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32796/0 (socket says 172.21.15.37:32796) 2023-10-06T02:28:31.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50ebb46700 1 -- 172.21.15.37:0/555073090 learned_addr learned my addr 172.21.15.37:0/555073090 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:31.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50eab44700 1 --2- 172.21.15.37:0/555073090 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558d1d268090 0x558d1d2fbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50eb345700 1 --2- 172.21.15.37:0/555073090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d1d23d950 0x558d1d30d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50ebb46700 1 -- 172.21.15.37:0/555073090 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558d1d268090 msgr2=0x558d1d2fbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:31.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50ebb46700 1 --2- 172.21.15.37:0/555073090 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558d1d268090 0x558d1d2fbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50ebb46700 1 -- 172.21.15.37:0/555073090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d1d23d950 msgr2=0x558d1d30d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:31.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50ebb46700 1 --2- 172.21.15.37:0/555073090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d1d23d950 0x558d1d30d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50ebb46700 1 -- 172.21.15.37:0/555073090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc00a180 con 0x558d1d312480 2023-10-06T02:28:31.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50eb345700 1 --2- 172.21.15.37:0/555073090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d1d23d950 0x558d1d30d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:31.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50eab44700 1 --2- 172.21.15.37:0/555073090 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558d1d268090 0x558d1d2fbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:31.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50ebb46700 1 --2- 172.21.15.37:0/555073090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d1d312480 0x558d1d27f0d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00ad60 tx=0x7f50dc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e65f334d50f19b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:31.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50e9b42700 1 -- 172.21.15.37:0/555073090 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc00ed60 con 0x558d1d312480 2023-10-06T02:28:31.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50e9b42700 1 -- 172.21.15.37:0/555073090 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50dc00e7e0 con 0x558d1d312480 2023-10-06T02:28:31.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.719+0000 7f50e9b42700 1 -- 172.21.15.37:0/555073090 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc01c640 con 0x558d1d312480 2023-10-06T02:28:31.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.720+0000 7f50f210a000 1 -- 172.21.15.37:0/555073090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d1d312480 msgr2=0x558d1d27f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.720+0000 7f50f210a000 1 --2- 172.21.15.37:0/555073090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d1d312480 0x558d1d27f0d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00ad60 tx=0x7f50dc011000 comp rx=0 tx=0).stop 2023-10-06T02:28:31.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.720+0000 7f50f210a000 1 -- 172.21.15.37:0/555073090 shutdown_connections 2023-10-06T02:28:31.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.720+0000 7f50f210a000 1 --2- 172.21.15.37:0/555073090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d1d312480 0x558d1d27f0d0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.720+0000 7f50f210a000 1 --2- 172.21.15.37:0/555073090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d1d23d950 0x558d1d30d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.720+0000 7f50f210a000 1 --2- 172.21.15.37:0/555073090 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558d1d268090 0x558d1d2fbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.720+0000 7f50f210a000 1 -- 172.21.15.37:0/555073090 >> 172.21.15.37:0/555073090 conn(0x558d1d23b3e0 msgr2=0x558d1d23ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:31.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.720+0000 7f50f210a000 1 -- 172.21.15.37:0/555073090 shutdown_connections 2023-10-06T02:28:31.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.720+0000 7f50f210a000 1 -- 172.21.15.37:0/555073090 wait complete. 2023-10-06T02:28:31.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.720+0000 7f50f210a000 1 Processor -- start 2023-10-06T02:28:31.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.721+0000 7f50f210a000 1 -- start start 2023-10-06T02:28:31.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.721+0000 7f50f210a000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d1d23d950 0x558d1d3100f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.721+0000 7f50f210a000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558d1d268090 0x558d1d31e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.721+0000 7f50f210a000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d1d312480 0x558d1d2fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.721+0000 7f50f210a000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1d31d200 con 0x558d1d23d950 2023-10-06T02:28:31.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.721+0000 7f50f210a000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1d31d4a0 con 0x558d1d312480 2023-10-06T02:28:31.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.721+0000 7f50f210a000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x558d1d31d740 con 0x558d1d268090 2023-10-06T02:28:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.721+0000 7f50eb345700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d1d23d950 0x558d1d3100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.721+0000 7f50eb345700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d1d23d950 0x558d1d3100f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32810/0 (socket says 172.21.15.37:32810) 2023-10-06T02:28:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.721+0000 7f50eb345700 1 -- 172.21.15.37:0/3124995559 learned_addr learned my addr 172.21.15.37:0/3124995559 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.722+0000 7f50ebb46700 1 --2- 172.21.15.37:0/3124995559 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d1d312480 0x558d1d2fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.722+0000 7f50eab44700 1 --2- 172.21.15.37:0/3124995559 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558d1d268090 0x558d1d31e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.722+0000 7f50eb345700 1 -- 172.21.15.37:0/3124995559 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558d1d268090 msgr2=0x558d1d31e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.722+0000 7f50eb345700 1 --2- 172.21.15.37:0/3124995559 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558d1d268090 0x558d1d31e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.722+0000 7f50eb345700 1 -- 172.21.15.37:0/3124995559 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d1d312480 msgr2=0x558d1d2fbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.722+0000 7f50eb345700 1 --2- 172.21.15.37:0/3124995559 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558d1d312480 0x558d1d2fbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.722+0000 7f50eb345700 1 -- 172.21.15.37:0/3124995559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d1d188750 con 0x558d1d23d950 2023-10-06T02:28:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.722+0000 7f50eb345700 1 --2- 172.21.15.37:0/3124995559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d1d23d950 0x558d1d3100f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f50e400a760 tx=0x7f50e4005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.722+0000 7f50e3fff700 1 -- 172.21.15.37:0/3124995559 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e40087b0 con 0x558d1d23d950 2023-10-06T02:28:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.722+0000 7f50e3fff700 1 -- 172.21.15.37:0/3124995559 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e4008910 con 0x558d1d23d950 2023-10-06T02:28:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.722+0000 7f50f210a000 1 -- 172.21.15.37:0/3124995559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558d1d1af1c0 con 0x558d1d23d950 2023-10-06T02:28:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.722+0000 7f50e3fff700 1 -- 172.21.15.37:0/3124995559 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4008cb0 con 0x558d1d23d950 2023-10-06T02:28:31.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.722+0000 7f50f210a000 1 -- 172.21.15.37:0/3124995559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d1d1953d0 con 0x558d1d23d950 2023-10-06T02:28:31.731 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:28:31.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.723+0000 7f50e3fff700 1 -- 172.21.15.37:0/3124995559 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f50e4014620 con 0x558d1d23d950 2023-10-06T02:28:31.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.724+0000 7f50e3fff700 1 --2- 172.21.15.37:0/3124995559 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f50cc0658c0 0x7f50cc067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.724+0000 7f50e3fff700 1 -- 172.21.15.37:0/3124995559 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f50e4083130 con 0x558d1d23d950 2023-10-06T02:28:31.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.724+0000 7f50eab44700 1 --2- 172.21.15.37:0/3124995559 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f50cc0658c0 0x7f50cc067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.724+0000 7f50f210a000 1 --2- 172.21.15.37:0/3124995559 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x558d1d31f2d0 0x558d1d31f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.724+0000 7f50f210a000 1 -- 172.21.15.37:0/3124995559 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:1 12.36 12:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) v8 -- 0x558d1d31fc10 con 0x558d1d31f2d0 2023-10-06T02:28:31.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.724+0000 7f50ebb46700 1 --2- 172.21.15.37:0/3124995559 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x558d1d31f2d0 0x558d1d31f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.724+0000 7f50eab44700 1 --2- 172.21.15.37:0/3124995559 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f50cc0658c0 0x7f50cc067d70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f50d4007950 tx=0x7f50d400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:31.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.725+0000 7f50ebb46700 1 --2- 172.21.15.37:0/3124995559 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x558d1d31f2d0 0x558d1d31f6d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:31.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.725+0000 7f50ebb46700 1 -- 172.21.15.37:0/3124995559 <== osd.5 v2:172.21.15.191:6808/90853 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f50dc00ed60 con 0x558d1d31f2d0 2023-10-06T02:28:31.732 INFO:teuthology.orchestra.run.smithi037.stderr:error getting xattr cephfs_data/100000001f7.00000000/scrub_tag: (61) No data available 2023-10-06T02:28:31.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.725+0000 7f50f210a000 1 -- 172.21.15.37:0/3124995559 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x558d1d31f2d0 msgr2=0x558d1d31f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.725+0000 7f50f210a000 1 --2- 172.21.15.37:0/3124995559 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x558d1d31f2d0 0x558d1d31f6d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.725+0000 7f50f210a000 1 -- 172.21.15.37:0/3124995559 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f50cc0658c0 msgr2=0x7f50cc067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.725+0000 7f50f210a000 1 --2- 172.21.15.37:0/3124995559 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f50cc0658c0 0x7f50cc067d70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f50d4007950 tx=0x7f50d400b040 comp rx=0 tx=0).stop 2023-10-06T02:28:31.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.725+0000 7f50f210a000 1 -- 172.21.15.37:0/3124995559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d1d23d950 msgr2=0x558d1d3100f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.725+0000 7f50f210a000 1 --2- 172.21.15.37:0/3124995559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d1d23d950 0x558d1d3100f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f50e400a760 tx=0x7f50e4005bd0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.725+0000 7f50ebb46700 1 -- 172.21.15.37:0/3124995559 reap_dead start 2023-10-06T02:28:31.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.725+0000 7f50f210a000 1 -- 172.21.15.37:0/3124995559 shutdown_connections 2023-10-06T02:28:31.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.725+0000 7f50f210a000 1 -- 172.21.15.37:0/3124995559 >> 172.21.15.37:0/3124995559 conn(0x558d1d23b3e0 msgr2=0x558d1d23cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:31.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.725+0000 7f50f210a000 1 -- 172.21.15.37:0/3124995559 shutdown_connections 2023-10-06T02:28:31.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.725+0000 7f50f210a000 1 -- 172.21.15.37:0/3124995559 wait complete. 2023-10-06T02:28:31.734 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2023-10-06T02:28:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.812+0000 7fc6df9d9000 1 Processor -- start 2023-10-06T02:28:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.812+0000 7fc6df9d9000 1 -- start start 2023-10-06T02:28:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.812+0000 7fc6df9d9000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1ad1e8e50 0x55a1ad2ba830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.813+0000 7fc6df9d9000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1ad2123f0 0x55a1ad1e4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.813+0000 7fc6df9d9000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55a1ad2a3ab0 0x55a1ad1e4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.813+0000 7fc6df9d9000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1ad131980 con 0x55a1ad2123f0 2023-10-06T02:28:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.813+0000 7fc6df9d9000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1ad131620 con 0x55a1ad1e8e50 2023-10-06T02:28:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.813+0000 7fc6df9d9000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a1ad128400 con 0x55a1ad2a3ab0 2023-10-06T02:28:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.813+0000 7fc6d8413700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1ad2123f0 0x55a1ad1e4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.813+0000 7fc6d8413700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1ad2123f0 0x55a1ad1e4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32818/0 (socket says 172.21.15.37:32818) 2023-10-06T02:28:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.813+0000 7fc6d8413700 1 -- 172.21.15.37:0/4212176176 learned_addr learned my addr 172.21.15.37:0/4212176176 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.813+0000 7fc6d8c14700 1 --2- 172.21.15.37:0/4212176176 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1ad1e8e50 0x55a1ad2ba830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.813+0000 7fc6d9415700 1 --2- 172.21.15.37:0/4212176176 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55a1ad2a3ab0 0x55a1ad1e4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.813+0000 7fc6d8413700 1 -- 172.21.15.37:0/4212176176 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55a1ad2a3ab0 msgr2=0x55a1ad1e4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.813+0000 7fc6d8413700 1 --2- 172.21.15.37:0/4212176176 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55a1ad2a3ab0 0x55a1ad1e4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.813+0000 7fc6d8413700 1 -- 172.21.15.37:0/4212176176 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1ad1e8e50 msgr2=0x55a1ad2ba830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.813+0000 7fc6d8413700 1 --2- 172.21.15.37:0/4212176176 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1ad1e8e50 0x55a1ad2ba830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.813+0000 7fc6d8413700 1 -- 172.21.15.37:0/4212176176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c800a180 con 0x55a1ad2123f0 2023-10-06T02:28:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.813+0000 7fc6d8413700 1 --2- 172.21.15.37:0/4212176176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1ad2123f0 0x55a1ad1e4620 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000b360 tx=0x7fc6c00018d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64f594b0da49cff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.813+0000 7fc6d7411700 1 -- 172.21.15.37:0/4212176176 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0014070 con 0x55a1ad2123f0 2023-10-06T02:28:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.813+0000 7fc6d7411700 1 -- 172.21.15.37:0/4212176176 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c000be80 con 0x55a1ad2123f0 2023-10-06T02:28:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.813+0000 7fc6d7411700 1 -- 172.21.15.37:0/4212176176 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c000f680 con 0x55a1ad2123f0 2023-10-06T02:28:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.814+0000 7fc6df9d9000 1 -- 172.21.15.37:0/4212176176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1ad2123f0 msgr2=0x55a1ad1e4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.814+0000 7fc6df9d9000 1 --2- 172.21.15.37:0/4212176176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1ad2123f0 0x55a1ad1e4620 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000b360 tx=0x7fc6c00018d0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.814+0000 7fc6df9d9000 1 -- 172.21.15.37:0/4212176176 shutdown_connections 2023-10-06T02:28:31.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.814+0000 7fc6df9d9000 1 --2- 172.21.15.37:0/4212176176 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55a1ad2a3ab0 0x55a1ad1e4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.814+0000 7fc6df9d9000 1 --2- 172.21.15.37:0/4212176176 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1ad1e8e50 0x55a1ad2ba830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.814+0000 7fc6df9d9000 1 --2- 172.21.15.37:0/4212176176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1ad2123f0 0x55a1ad1e4620 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.814+0000 7fc6df9d9000 1 -- 172.21.15.37:0/4212176176 >> 172.21.15.37:0/4212176176 conn(0x55a1ad1e7500 msgr2=0x55a1ad216390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:31.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.814+0000 7fc6df9d9000 1 -- 172.21.15.37:0/4212176176 shutdown_connections 2023-10-06T02:28:31.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.814+0000 7fc6df9d9000 1 -- 172.21.15.37:0/4212176176 wait complete. 2023-10-06T02:28:31.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.814+0000 7fc6df9d9000 1 Processor -- start 2023-10-06T02:28:31.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.815+0000 7fc6df9d9000 1 -- start start 2023-10-06T02:28:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.815+0000 7fc6df9d9000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1ad1e8e50 0x55a1ad2bad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.815+0000 7fc6df9d9000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1ad2123f0 0x55a1ad2bca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.815+0000 7fc6df9d9000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55a1ad2a3ab0 0x55a1ad29d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.815+0000 7fc6df9d9000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1ad2b95c0 con 0x55a1ad2123f0 2023-10-06T02:28:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.815+0000 7fc6df9d9000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1ad29f240 con 0x55a1ad1e8e50 2023-10-06T02:28:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.815+0000 7fc6df9d9000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a1ad29ed00 con 0x55a1ad2a3ab0 2023-10-06T02:28:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.815+0000 7fc6d8413700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1ad2123f0 0x55a1ad2bca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.815+0000 7fc6d8413700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1ad2123f0 0x55a1ad2bca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32826/0 (socket says 172.21.15.37:32826) 2023-10-06T02:28:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.815+0000 7fc6d8413700 1 -- 172.21.15.37:0/161256808 learned_addr learned my addr 172.21.15.37:0/161256808 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.815+0000 7fc6d8c14700 1 --2- 172.21.15.37:0/161256808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1ad1e8e50 0x55a1ad2bad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.816+0000 7fc6d8413700 1 -- 172.21.15.37:0/161256808 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55a1ad2a3ab0 msgr2=0x55a1ad29d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.816+0000 7fc6d8413700 1 --2- 172.21.15.37:0/161256808 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55a1ad2a3ab0 0x55a1ad29d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.816+0000 7fc6d8413700 1 -- 172.21.15.37:0/161256808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1ad1e8e50 msgr2=0x55a1ad2bad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.816+0000 7fc6d8413700 1 --2- 172.21.15.37:0/161256808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1ad1e8e50 0x55a1ad2bad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.816+0000 7fc6d8413700 1 -- 172.21.15.37:0/161256808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c0001bb0 con 0x55a1ad2123f0 2023-10-06T02:28:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.816+0000 7fc6d8413700 1 --2- 172.21.15.37:0/161256808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1ad2123f0 0x55a1ad2bca30 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000fda0 tx=0x7fc6c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.816+0000 7fc6d5c0e700 1 -- 172.21.15.37:0/161256808 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c001a690 con 0x55a1ad2123f0 2023-10-06T02:28:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.816+0000 7fc6df9d9000 1 -- 172.21.15.37:0/161256808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a1ad1403d0 con 0x55a1ad2123f0 2023-10-06T02:28:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.816+0000 7fc6d5c0e700 1 -- 172.21.15.37:0/161256808 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c0021070 con 0x55a1ad2123f0 2023-10-06T02:28:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.816+0000 7fc6d5c0e700 1 -- 172.21.15.37:0/161256808 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c001a7f0 con 0x55a1ad2123f0 2023-10-06T02:28:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.816+0000 7fc6df9d9000 1 -- 172.21.15.37:0/161256808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a1ad133ae0 con 0x55a1ad2123f0 2023-10-06T02:28:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.818+0000 7fc6d5c0e700 1 -- 172.21.15.37:0/161256808 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6c001ac20 con 0x55a1ad2123f0 2023-10-06T02:28:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.818+0000 7fc6d5c0e700 1 --2- 172.21.15.37:0/161256808 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc6b80658c0 0x7fc6b8067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.818+0000 7fc6d5c0e700 1 -- 172.21.15.37:0/161256808 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fc6c0008030 con 0x55a1ad2123f0 2023-10-06T02:28:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.818+0000 7fc6d8c14700 1 --2- 172.21.15.37:0/161256808 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc6b80658c0 0x7fc6b8067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.818+0000 7fc6df9d9000 1 --2- 172.21.15.37:0/161256808 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x55a1ad2bcf70 0x55a1ad2a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.818+0000 7fc6df9d9000 1 -- 172.21.15.37:0/161256808 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:1 12.12 12:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) v8 -- 0x55a1ad2a22a0 con 0x55a1ad2bcf70 2023-10-06T02:28:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.819+0000 7fc6d9415700 1 --2- 172.21.15.37:0/161256808 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x55a1ad2bcf70 0x55a1ad2a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.819+0000 7fc6d9415700 1 --2- 172.21.15.37:0/161256808 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x55a1ad2bcf70 0x55a1ad2a1d60 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.819+0000 7fc6d8c14700 1 --2- 172.21.15.37:0/161256808 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc6b80658c0 0x7fc6b8067d70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0005fd0 tx=0x7fc6d000c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.819+0000 7fc6d9415700 1 -- 172.21.15.37:0/161256808 <== osd.3 v2:172.21.15.37:6817/90628 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr (12) out=12b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7fc6c800ed80 con 0x55a1ad2bcf70 2023-10-06T02:28:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.819+0000 7fc6df9d9000 1 -- 172.21.15.37:0/161256808 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x55a1ad2bcf70 msgr2=0x55a1ad2a1d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.819+0000 7fc6df9d9000 1 --2- 172.21.15.37:0/161256808 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x55a1ad2bcf70 0x55a1ad2a1d60 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.819+0000 7fc6df9d9000 1 -- 172.21.15.37:0/161256808 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc6b80658c0 msgr2=0x7fc6b8067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.819+0000 7fc6df9d9000 1 --2- 172.21.15.37:0/161256808 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc6b80658c0 0x7fc6b8067d70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0005fd0 tx=0x7fc6d000c040 comp rx=0 tx=0).stop 2023-10-06T02:28:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.819+0000 7fc6df9d9000 1 -- 172.21.15.37:0/161256808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1ad2123f0 msgr2=0x55a1ad2bca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.819+0000 7fc6df9d9000 1 --2- 172.21.15.37:0/161256808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1ad2123f0 0x55a1ad2bca30 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000fda0 tx=0x7fc6c0016000 comp rx=0 tx=0).stop 2023-10-06T02:28:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.819+0000 7fc6d9415700 1 -- 172.21.15.37:0/161256808 reap_dead start 2023-10-06T02:28:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.819+0000 7fc6df9d9000 1 -- 172.21.15.37:0/161256808 shutdown_connections 2023-10-06T02:28:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.819+0000 7fc6df9d9000 1 -- 172.21.15.37:0/161256808 >> 172.21.15.37:0/161256808 conn(0x55a1ad1e7500 msgr2=0x55a1ad216390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.820+0000 7fc6df9d9000 1 -- 172.21.15.37:0/161256808 shutdown_connections 2023-10-06T02:28:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.820+0000 7fc6df9d9000 1 -- 172.21.15.37:0/161256808 wait complete. 2023-10-06T02:28:31.826 INFO:teuthology.orchestra.run.smithi037.stdout:mytag123 2023-10-06T02:28:31.826 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2023-10-06T02:28:31.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.905+0000 7f60ba65d000 1 Processor -- start 2023-10-06T02:28:31.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.905+0000 7f60ba65d000 1 -- start start 2023-10-06T02:28:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.905+0000 7f60ba65d000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e123018f0 0x564e122fea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.905+0000 7f60ba65d000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564e12301cc0 0x564e123d36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.905+0000 7f60ba65d000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564e1232c300 0x564e123d3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.905+0000 7f60ba65d000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e12249980 con 0x564e123018f0 2023-10-06T02:28:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.905+0000 7f60ba65d000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e12249620 con 0x564e1232c300 2023-10-06T02:28:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.905+0000 7f60ba65d000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e12240400 con 0x564e12301cc0 2023-10-06T02:28:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.905+0000 7f60b3898700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e123018f0 0x564e122fea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.905+0000 7f60b3898700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e123018f0 0x564e122fea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32838/0 (socket says 172.21.15.37:32838) 2023-10-06T02:28:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.905+0000 7f60b3898700 1 -- 172.21.15.37:0/2358011335 learned_addr learned my addr 172.21.15.37:0/2358011335 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.906+0000 7f60abfff700 1 --2- 172.21.15.37:0/2358011335 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564e12301cc0 0x564e123d36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.906+0000 7f60b4099700 1 --2- 172.21.15.37:0/2358011335 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564e1232c300 0x564e123d3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.906+0000 7f60b3898700 1 -- 172.21.15.37:0/2358011335 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564e12301cc0 msgr2=0x564e123d36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.906+0000 7f60b3898700 1 --2- 172.21.15.37:0/2358011335 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564e12301cc0 0x564e123d36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.906+0000 7f60b3898700 1 -- 172.21.15.37:0/2358011335 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564e1232c300 msgr2=0x564e123d3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.906+0000 7f60b3898700 1 --2- 172.21.15.37:0/2358011335 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564e1232c300 0x564e123d3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.906+0000 7f60b3898700 1 -- 172.21.15.37:0/2358011335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c005cf0 con 0x564e123018f0 2023-10-06T02:28:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.906+0000 7f60b3898700 1 --2- 172.21.15.37:0/2358011335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e123018f0 0x564e122fea00 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f60a400a7b0 tx=0x7f60a4005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74668c2d1f614ba6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.906+0000 7f60b2896700 1 -- 172.21.15.37:0/2358011335 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a400f070 con 0x564e123018f0 2023-10-06T02:28:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.906+0000 7f60b2896700 1 -- 172.21.15.37:0/2358011335 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a4008950 con 0x564e123018f0 2023-10-06T02:28:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.906+0000 7f60b2896700 1 -- 172.21.15.37:0/2358011335 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a4008cf0 con 0x564e123018f0 2023-10-06T02:28:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.906+0000 7f60ba65d000 1 -- 172.21.15.37:0/2358011335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e123018f0 msgr2=0x564e122fea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.906+0000 7f60ba65d000 1 --2- 172.21.15.37:0/2358011335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e123018f0 0x564e122fea00 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f60a400a7b0 tx=0x7f60a4005c80 comp rx=0 tx=0).stop 2023-10-06T02:28:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.907+0000 7f60ba65d000 1 -- 172.21.15.37:0/2358011335 shutdown_connections 2023-10-06T02:28:31.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.907+0000 7f60ba65d000 1 --2- 172.21.15.37:0/2358011335 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564e1232c300 0x564e123d3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.907+0000 7f60ba65d000 1 --2- 172.21.15.37:0/2358011335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e123018f0 0x564e122fea00 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.907+0000 7f60ba65d000 1 --2- 172.21.15.37:0/2358011335 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564e12301cc0 0x564e123d36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.907+0000 7f60ba65d000 1 -- 172.21.15.37:0/2358011335 >> 172.21.15.37:0/2358011335 conn(0x564e12347af0 msgr2=0x564e1232ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:31.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.907+0000 7f60ba65d000 1 -- 172.21.15.37:0/2358011335 shutdown_connections 2023-10-06T02:28:31.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.907+0000 7f60ba65d000 1 -- 172.21.15.37:0/2358011335 wait complete. 2023-10-06T02:28:31.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.907+0000 7f60ba65d000 1 Processor -- start 2023-10-06T02:28:31.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.907+0000 7f60ba65d000 1 -- start start 2023-10-06T02:28:31.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.908+0000 7f60ba65d000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564e123018f0 0x564e123c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.908+0000 7f60ba65d000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e12301cc0 0x564e123d0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.908+0000 7f60ba65d000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564e1232c300 0x564e123416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.908+0000 7f60ba65d000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e123454f0 con 0x564e12301cc0 2023-10-06T02:28:31.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.908+0000 7f60ba65d000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e12342930 con 0x564e1232c300 2023-10-06T02:28:31.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.908+0000 7f60ba65d000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e12342bd0 con 0x564e123018f0 2023-10-06T02:28:31.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.908+0000 7f60abfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e12301cc0 0x564e123d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.908+0000 7f60abfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e12301cc0 0x564e123d0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32846/0 (socket says 172.21.15.37:32846) 2023-10-06T02:28:31.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.908+0000 7f60abfff700 1 -- 172.21.15.37:0/2122966900 learned_addr learned my addr 172.21.15.37:0/2122966900 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:31.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.908+0000 7f60b3898700 1 --2- 172.21.15.37:0/2122966900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564e123018f0 0x564e123c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.908+0000 7f60b4099700 1 --2- 172.21.15.37:0/2122966900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564e1232c300 0x564e123416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.908+0000 7f60abfff700 1 -- 172.21.15.37:0/2122966900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564e123018f0 msgr2=0x564e123c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.908+0000 7f60abfff700 1 --2- 172.21.15.37:0/2122966900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x564e123018f0 0x564e123c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.908+0000 7f60abfff700 1 -- 172.21.15.37:0/2122966900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564e1232c300 msgr2=0x564e123416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.908+0000 7f60abfff700 1 --2- 172.21.15.37:0/2122966900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564e1232c300 0x564e123416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.908+0000 7f60abfff700 1 -- 172.21.15.37:0/2122966900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a400a440 con 0x564e12301cc0 2023-10-06T02:28:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.909+0000 7f60abfff700 1 --2- 172.21.15.37:0/2122966900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e12301cc0 0x564e123d0290 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f609c005a90 tx=0x7f609c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.909+0000 7f60b1093700 1 -- 172.21.15.37:0/2122966900 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c008b70 con 0x564e12301cc0 2023-10-06T02:28:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.909+0000 7f60b1093700 1 -- 172.21.15.37:0/2122966900 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c023070 con 0x564e12301cc0 2023-10-06T02:28:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.909+0000 7f60ba65d000 1 -- 172.21.15.37:0/2122966900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564e122583d0 con 0x564e12301cc0 2023-10-06T02:28:31.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.909+0000 7f60b1093700 1 -- 172.21.15.37:0/2122966900 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c028480 con 0x564e12301cc0 2023-10-06T02:28:31.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.909+0000 7f60ba65d000 1 -- 172.21.15.37:0/2122966900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564e1224bae0 con 0x564e12301cc0 2023-10-06T02:28:31.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.910+0000 7f60b1093700 1 -- 172.21.15.37:0/2122966900 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f609c025030 con 0x564e12301cc0 2023-10-06T02:28:31.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.910+0000 7f60b1093700 1 --2- 172.21.15.37:0/2122966900 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f60940658c0 0x7f6094067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.910+0000 7f60b1093700 1 -- 172.21.15.37:0/2122966900 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f609c086a80 con 0x564e12301cc0 2023-10-06T02:28:31.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.911+0000 7f60b3898700 1 --2- 172.21.15.37:0/2122966900 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f60940658c0 0x7f6094067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.911+0000 7f60ba65d000 1 --2- 172.21.15.37:0/2122966900 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x564e12344d40 0x564e123ecde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:31.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.911+0000 7f60ba65d000 1 -- 172.21.15.37:0/2122966900 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:1 12.19 12:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) v8 -- 0x564e12344080 con 0x564e12344d40 2023-10-06T02:28:31.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.911+0000 7f60b4099700 1 --2- 172.21.15.37:0/2122966900 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x564e12344d40 0x564e123ecde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:31.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.911+0000 7f60b3898700 1 --2- 172.21.15.37:0/2122966900 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f60940658c0 0x7f6094067d70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f60a400a6a0 tx=0x7f60a4019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:31.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.911+0000 7f60b4099700 1 --2- 172.21.15.37:0/2122966900 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x564e12344d40 0x564e123ecde0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:31.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.911+0000 7f60b4099700 1 -- 172.21.15.37:0/2122966900 <== osd.0 v2:172.21.15.37:6816/90621 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (12) out=12b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7f60ac001630 con 0x564e12344d40 2023-10-06T02:28:31.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.911+0000 7f60ba65d000 1 -- 172.21.15.37:0/2122966900 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x564e12344d40 msgr2=0x564e123ecde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.911+0000 7f60ba65d000 1 --2- 172.21.15.37:0/2122966900 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x564e12344d40 0x564e123ecde0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:31.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.911+0000 7f60ba65d000 1 -- 172.21.15.37:0/2122966900 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f60940658c0 msgr2=0x7f6094067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.911+0000 7f60ba65d000 1 --2- 172.21.15.37:0/2122966900 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f60940658c0 0x7f6094067d70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f60a400a6a0 tx=0x7f60a4019000 comp rx=0 tx=0).stop 2023-10-06T02:28:31.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.911+0000 7f60ba65d000 1 -- 172.21.15.37:0/2122966900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e12301cc0 msgr2=0x564e123d0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:31.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.911+0000 7f60ba65d000 1 --2- 172.21.15.37:0/2122966900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e12301cc0 0x564e123d0290 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f609c005a90 tx=0x7f609c017000 comp rx=0 tx=0).stop 2023-10-06T02:28:31.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.911+0000 7f60b4099700 1 -- 172.21.15.37:0/2122966900 reap_dead start 2023-10-06T02:28:31.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.912+0000 7f60ba65d000 1 -- 172.21.15.37:0/2122966900 shutdown_connections 2023-10-06T02:28:31.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.912+0000 7f60ba65d000 1 -- 172.21.15.37:0/2122966900 >> 172.21.15.37:0/2122966900 conn(0x564e12347af0 msgr2=0x564e12348610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:31.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.912+0000 7f60ba65d000 1 -- 172.21.15.37:0/2122966900 shutdown_connections 2023-10-06T02:28:31.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.912+0000 7f60ba65d000 1 -- 172.21.15.37:0/2122966900 wait complete. 2023-10-06T02:28:31.919 INFO:teuthology.orchestra.run.smithi037.stdout:mytag123 2023-10-06T02:28:31.919 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000004.00000000 scrub_tag 2023-10-06T02:28:31.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.998+0000 7fc5b7efc000 1 Processor -- start 2023-10-06T02:28:31.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.998+0000 7fc5b7efc000 1 -- start start 2023-10-06T02:28:32.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.999+0000 7fc5b7efc000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a4ba75640 0x558a4baf8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.999+0000 7fc5b7efc000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a4ba6c000 0x558a4ba74850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.999+0000 7fc5b7efc000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558a4ba5b0b0 0x558a4ba5b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.999+0000 7fc5b7efc000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a4b977980 con 0x558a4ba6c000 2023-10-06T02:28:32.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.999+0000 7fc5b7efc000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a4b977620 con 0x558a4ba75640 2023-10-06T02:28:32.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.999+0000 7fc5b7efc000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a4b96e400 con 0x558a4ba5b0b0 2023-10-06T02:28:32.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.999+0000 7fc5abfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a4ba6c000 0x558a4ba74850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.999+0000 7fc5abfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a4ba6c000 0x558a4ba74850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32862/0 (socket says 172.21.15.37:32862) 2023-10-06T02:28:32.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.999+0000 7fc5abfff700 1 -- 172.21.15.37:0/393275391 learned_addr learned my addr 172.21.15.37:0/393275391 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:32.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.999+0000 7fc5b1938700 1 --2- 172.21.15.37:0/393275391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558a4ba5b0b0 0x558a4ba5b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.999+0000 7fc5b1137700 1 --2- 172.21.15.37:0/393275391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a4ba75640 0x558a4baf8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.999+0000 7fc5abfff700 1 -- 172.21.15.37:0/393275391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558a4ba5b0b0 msgr2=0x558a4ba5b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.999+0000 7fc5abfff700 1 --2- 172.21.15.37:0/393275391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558a4ba5b0b0 0x558a4ba5b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.999+0000 7fc5abfff700 1 -- 172.21.15.37:0/393275391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a4ba75640 msgr2=0x558a4baf8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.999+0000 7fc5abfff700 1 --2- 172.21.15.37:0/393275391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a4ba75640 0x558a4baf8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.999+0000 7fc5abfff700 1 -- 172.21.15.37:0/393275391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a4b9863d0 con 0x558a4ba6c000 2023-10-06T02:28:32.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.999+0000 7fc5b1938700 1 --2- 172.21.15.37:0/393275391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558a4ba5b0b0 0x558a4ba5b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:32.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:31.999+0000 7fc5b1137700 1 --2- 172.21.15.37:0/393275391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a4ba75640 0x558a4baf8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:32.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.000+0000 7fc5abfff700 1 --2- 172.21.15.37:0/393275391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a4ba6c000 0x558a4ba74850 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fc59c005cc0 tx=0x7fc59c00c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83717d0b11cd188d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.000+0000 7fc5ab7fe700 1 -- 172.21.15.37:0/393275391 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c00f040 con 0x558a4ba6c000 2023-10-06T02:28:32.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.000+0000 7fc5ab7fe700 1 -- 172.21.15.37:0/393275391 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59c008900 con 0x558a4ba6c000 2023-10-06T02:28:32.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.000+0000 7fc5ab7fe700 1 -- 172.21.15.37:0/393275391 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c008c80 con 0x558a4ba6c000 2023-10-06T02:28:32.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.000+0000 7fc5b7efc000 1 -- 172.21.15.37:0/393275391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a4ba6c000 msgr2=0x558a4ba74850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.000+0000 7fc5b7efc000 1 --2- 172.21.15.37:0/393275391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a4ba6c000 0x558a4ba74850 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fc59c005cc0 tx=0x7fc59c00c040 comp rx=0 tx=0).stop 2023-10-06T02:28:32.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.000+0000 7fc5b7efc000 1 -- 172.21.15.37:0/393275391 shutdown_connections 2023-10-06T02:28:32.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.000+0000 7fc5b7efc000 1 --2- 172.21.15.37:0/393275391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558a4ba5b0b0 0x558a4ba5b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.000+0000 7fc5b7efc000 1 --2- 172.21.15.37:0/393275391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a4ba75640 0x558a4baf8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.000+0000 7fc5b7efc000 1 --2- 172.21.15.37:0/393275391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a4ba6c000 0x558a4ba74850 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.000+0000 7fc5b7efc000 1 -- 172.21.15.37:0/393275391 >> 172.21.15.37:0/393275391 conn(0x558a4ba2c3e0 msgr2=0x558a4bafeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:32.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.000+0000 7fc5b7efc000 1 -- 172.21.15.37:0/393275391 shutdown_connections 2023-10-06T02:28:32.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.000+0000 7fc5b7efc000 1 -- 172.21.15.37:0/393275391 wait complete. 2023-10-06T02:28:32.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.001+0000 7fc5b7efc000 1 Processor -- start 2023-10-06T02:28:32.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.001+0000 7fc5b7efc000 1 -- start start 2023-10-06T02:28:32.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5b7efc000 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558a4ba5b0b0 0x558a4baef810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5b7efc000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a4ba6c000 0x558a4ba74850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5b7efc000 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a4ba75640 0x558a4ba74d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5b7efc000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a4ba6d520 con 0x558a4ba6c000 2023-10-06T02:28:32.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5b7efc000 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a4baf7df0 con 0x558a4ba75640 2023-10-06T02:28:32.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5b7efc000 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a4baf8090 con 0x558a4ba5b0b0 2023-10-06T02:28:32.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5abfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a4ba6c000 0x558a4ba74850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5abfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a4ba6c000 0x558a4ba74850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32864/0 (socket says 172.21.15.37:32864) 2023-10-06T02:28:32.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5abfff700 1 -- 172.21.15.37:0/2303162132 learned_addr learned my addr 172.21.15.37:0/2303162132 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:32.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5b1137700 1 --2- 172.21.15.37:0/2303162132 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558a4ba5b0b0 0x558a4baef810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5b1938700 1 --2- 172.21.15.37:0/2303162132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a4ba75640 0x558a4ba74d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5abfff700 1 -- 172.21.15.37:0/2303162132 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558a4ba5b0b0 msgr2=0x558a4baef810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5abfff700 1 --2- 172.21.15.37:0/2303162132 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x558a4ba5b0b0 0x558a4baef810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5abfff700 1 -- 172.21.15.37:0/2303162132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a4ba75640 msgr2=0x558a4ba74d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5abfff700 1 --2- 172.21.15.37:0/2303162132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558a4ba75640 0x558a4ba74d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5abfff700 1 -- 172.21.15.37:0/2303162132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c0094b0 con 0x558a4ba6c000 2023-10-06T02:28:32.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5abfff700 1 --2- 172.21.15.37:0/2303162132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a4ba6c000 0x558a4ba74850 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0057a0 tx=0x7fc59c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5a9ffb700 1 -- 172.21.15.37:0/2303162132 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c00f040 con 0x558a4ba6c000 2023-10-06T02:28:32.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5a9ffb700 1 -- 172.21.15.37:0/2303162132 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59c015ac0 con 0x558a4ba6c000 2023-10-06T02:28:32.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5b7efc000 1 -- 172.21.15.37:0/2303162132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558a4b979ae0 con 0x558a4ba6c000 2023-10-06T02:28:32.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5a9ffb700 1 -- 172.21.15.37:0/2303162132 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c015e80 con 0x558a4ba6c000 2023-10-06T02:28:32.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.002+0000 7fc5b7efc000 1 -- 172.21.15.37:0/2303162132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a4b979540 con 0x558a4ba6c000 2023-10-06T02:28:32.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.004+0000 7fc5a9ffb700 1 -- 172.21.15.37:0/2303162132 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc59c025070 con 0x558a4ba6c000 2023-10-06T02:28:32.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.004+0000 7fc5a9ffb700 1 --2- 172.21.15.37:0/2303162132 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc594065890 0x7fc594067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.004+0000 7fc5a9ffb700 1 -- 172.21.15.37:0/2303162132 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fc59c085570 con 0x558a4ba6c000 2023-10-06T02:28:32.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.004+0000 7fc5b1137700 1 --2- 172.21.15.37:0/2303162132 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc594065890 0x7fc594067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.004+0000 7fc5b7efc000 1 --2- 172.21.15.37:0/2303162132 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x558a4ba5aaa0 0x558a4baf6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.004+0000 7fc5b7efc000 1 -- 172.21.15.37:0/2303162132 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:1 12.5 12:a367a3e8:::10000000004.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e73) v8 -- 0x558a4baf7320 con 0x558a4ba5aaa0 2023-10-06T02:28:32.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.005+0000 7fc5b1938700 1 --2- 172.21.15.37:0/2303162132 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x558a4ba5aaa0 0x558a4baf6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.005+0000 7fc5b1137700 1 --2- 172.21.15.37:0/2303162132 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc594065890 0x7fc594067d40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4005fa0 tx=0x7fc5a400c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.005+0000 7fc5b1938700 1 --2- 172.21.15.37:0/2303162132 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x558a4ba5aaa0 0x558a4baf6de0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.005+0000 7fc5b1938700 1 -- 172.21.15.37:0/2303162132 <== osd.6 v2:172.21.15.191:6824/90897 1 ==== osd_op_reply(1 10000000004.00000000 [getxattr (12) out=12b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7fc5ac018040 con 0x558a4ba5aaa0 2023-10-06T02:28:32.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.005+0000 7fc5b7efc000 1 -- 172.21.15.37:0/2303162132 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x558a4ba5aaa0 msgr2=0x558a4baf6de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.005+0000 7fc5b7efc000 1 --2- 172.21.15.37:0/2303162132 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x558a4ba5aaa0 0x558a4baf6de0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.005+0000 7fc5b7efc000 1 -- 172.21.15.37:0/2303162132 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc594065890 msgr2=0x7fc594067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.005+0000 7fc5b7efc000 1 --2- 172.21.15.37:0/2303162132 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc594065890 0x7fc594067d40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4005fa0 tx=0x7fc5a400c040 comp rx=0 tx=0).stop 2023-10-06T02:28:32.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.005+0000 7fc5b7efc000 1 -- 172.21.15.37:0/2303162132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a4ba6c000 msgr2=0x558a4ba74850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.005+0000 7fc5b7efc000 1 --2- 172.21.15.37:0/2303162132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a4ba6c000 0x558a4ba74850 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0057a0 tx=0x7fc59c01a000 comp rx=0 tx=0).stop 2023-10-06T02:28:32.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.005+0000 7fc5b1938700 1 -- 172.21.15.37:0/2303162132 reap_dead start 2023-10-06T02:28:32.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.005+0000 7fc5b7efc000 1 -- 172.21.15.37:0/2303162132 shutdown_connections 2023-10-06T02:28:32.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.005+0000 7fc5b7efc000 1 -- 172.21.15.37:0/2303162132 >> 172.21.15.37:0/2303162132 conn(0x558a4ba2c3e0 msgr2=0x558a4bafeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:32.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.006+0000 7fc5b7efc000 1 -- 172.21.15.37:0/2303162132 shutdown_connections 2023-10-06T02:28:32.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.006+0000 7fc5b7efc000 1 -- 172.21.15.37:0/2303162132 wait complete. 2023-10-06T02:28:32.012 INFO:teuthology.orchestra.run.smithi037.stdout:mytag123 2023-10-06T02:28:32.012 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 flush journal 2023-10-06T02:28:32.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.172+0000 7f6d44194700 1 Processor -- start 2023-10-06T02:28:32.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.172+0000 7f6d44194700 1 -- start start 2023-10-06T02:28:32.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.173+0000 7f6d44194700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6d3c1599e0 0x7f6d3c0b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.173+0000 7f6d44194700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d3c0b3310 0x7f6d3c0b4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.173+0000 7f6d44194700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d3c0b43b0 con 0x7f6d3c159610 2023-10-06T02:28:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.173+0000 7f6d44194700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d3c0cde50 con 0x7f6d3c1599e0 2023-10-06T02:28:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.173+0000 7f6d44194700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c0b1020 con 0x7f6d3c0b3310 2023-10-06T02:28:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.173+0000 7f6d41f30700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6d3c159610 0x7f6d3c0d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36576/0 (socket says 172.21.15.37:36576) 2023-10-06T02:28:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.173+0000 7f6d4172f700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6d3c1599e0 0x7f6d3c0b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.173+0000 7f6d41f30700 1 -- 172.21.15.37:0/4169798024 learned_addr learned my addr 172.21.15.37:0/4169798024 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.174+0000 7f6d42731700 1 --2- 172.21.15.37:0/4169798024 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d3c0b3310 0x7f6d3c0b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.174+0000 7f6d4172f700 1 -- 172.21.15.37:0/4169798024 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d3c0b3310 msgr2=0x7f6d3c0b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.174+0000 7f6d4172f700 1 --2- 172.21.15.37:0/4169798024 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d3c0b3310 0x7f6d3c0b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.174+0000 7f6d4172f700 1 -- 172.21.15.37:0/4169798024 >> v1:172.21.15.37:6789/0 conn(0x7f6d3c159610 legacy=0x7f6d3c0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.174+0000 7f6d40f2e700 1 -- 172.21.15.37:0/4169798024 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496407761 0 0) 0x7f6d3c0b43b0 con 0x7f6d3c159610 2023-10-06T02:28:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.174+0000 7f6d4172f700 1 -- 172.21.15.37:0/4169798024 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c0b37a0 con 0x7f6d3c1599e0 2023-10-06T02:28:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.174+0000 7f6d4172f700 1 --2- 172.21.15.37:0/4169798024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d3c1599e0 0x7f6d3c0b0ae0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f6d300098e0 tx=0x7f6d300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61c98c4a6747479 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.174+0000 7f6d40f2e700 1 -- 172.21.15.37:0/4169798024 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d30009e80 con 0x7f6d3c1599e0 2023-10-06T02:28:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.174+0000 7f6d40f2e700 1 -- 172.21.15.37:0/4169798024 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3000b860 con 0x7f6d3c1599e0 2023-10-06T02:28:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.174+0000 7f6d40f2e700 1 -- 172.21.15.37:0/4169798024 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3000bbe0 con 0x7f6d3c1599e0 2023-10-06T02:28:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.175+0000 7f6d44194700 1 -- 172.21.15.37:0/4169798024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d3c1599e0 msgr2=0x7f6d3c0b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.175+0000 7f6d44194700 1 --2- 172.21.15.37:0/4169798024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d3c1599e0 0x7f6d3c0b0ae0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f6d300098e0 tx=0x7f6d300091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.175+0000 7f6d44194700 1 -- 172.21.15.37:0/4169798024 shutdown_connections 2023-10-06T02:28:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.175+0000 7f6d44194700 1 --2- 172.21.15.37:0/4169798024 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d3c0b3310 0x7f6d3c0b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.175+0000 7f6d44194700 1 --2- 172.21.15.37:0/4169798024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d3c1599e0 0x7f6d3c0b0ae0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.175+0000 7f6d44194700 1 -- 172.21.15.37:0/4169798024 >> 172.21.15.37:0/4169798024 conn(0x7f6d3c06c0b0 msgr2=0x7f6d3c06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.175+0000 7f6d44194700 1 -- 172.21.15.37:0/4169798024 shutdown_connections 2023-10-06T02:28:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.175+0000 7f6d44194700 1 -- 172.21.15.37:0/4169798024 wait complete. 2023-10-06T02:28:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.176+0000 7f6d44194700 1 Processor -- start 2023-10-06T02:28:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.176+0000 7f6d44194700 1 -- start start 2023-10-06T02:28:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.176+0000 7f6d44194700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d3c0b3310 0x7f6d3c14d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.176+0000 7f6d44194700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d3c159610 0x7f6d3c15c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.176+0000 7f6d44194700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d3c1599e0 0x7f6d3c15c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.176+0000 7f6d44194700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c0c5340 con 0x7f6d3c0b3310 2023-10-06T02:28:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.176+0000 7f6d44194700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c0c5ec0 con 0x7f6d3c1599e0 2023-10-06T02:28:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.176+0000 7f6d44194700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c14de60 con 0x7f6d3c159610 2023-10-06T02:28:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.177+0000 7f6d41f30700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d3c0b3310 0x7f6d3c14d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.177+0000 7f6d41f30700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d3c0b3310 0x7f6d3c14d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32882/0 (socket says 172.21.15.37:32882) 2023-10-06T02:28:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.177+0000 7f6d41f30700 1 -- 172.21.15.37:0/693739746 learned_addr learned my addr 172.21.15.37:0/693739746 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.177+0000 7f6d4172f700 1 --2- 172.21.15.37:0/693739746 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d3c159610 0x7f6d3c15c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.177+0000 7f6d42731700 1 --2- 172.21.15.37:0/693739746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d3c1599e0 0x7f6d3c15c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.177+0000 7f6d41f30700 1 -- 172.21.15.37:0/693739746 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d3c159610 msgr2=0x7f6d3c15c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.177+0000 7f6d41f30700 1 --2- 172.21.15.37:0/693739746 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d3c159610 0x7f6d3c15c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.177+0000 7f6d41f30700 1 -- 172.21.15.37:0/693739746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d3c1599e0 msgr2=0x7f6d3c15c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.177+0000 7f6d41f30700 1 --2- 172.21.15.37:0/693739746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d3c1599e0 0x7f6d3c15c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.177+0000 7f6d41f30700 1 -- 172.21.15.37:0/693739746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d30009420 con 0x7f6d3c0b3310 2023-10-06T02:28:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.177+0000 7f6d41f30700 1 --2- 172.21.15.37:0/693739746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d3c0b3310 0x7f6d3c14d920 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00cdb0 tx=0x7f6d2c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.177+0000 7f6d39ffb700 1 -- 172.21.15.37:0/693739746 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c00aa20 con 0x7f6d3c0b3310 2023-10-06T02:28:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.177+0000 7f6d39ffb700 1 -- 172.21.15.37:0/693739746 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c00ab80 con 0x7f6d3c0b3310 2023-10-06T02:28:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.177+0000 7f6d44194700 1 -- 172.21.15.37:0/693739746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d3c0c5590 con 0x7f6d3c0b3310 2023-10-06T02:28:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.177+0000 7f6d39ffb700 1 -- 172.21.15.37:0/693739746 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c0070f0 con 0x7f6d3c0b3310 2023-10-06T02:28:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.178+0000 7f6d44194700 1 -- 172.21.15.37:0/693739746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3c0c5b50 con 0x7f6d3c0b3310 2023-10-06T02:28:32.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.179+0000 7f6d39ffb700 1 -- 172.21.15.37:0/693739746 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d2c0074e0 con 0x7f6d3c0b3310 2023-10-06T02:28:32.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.179+0000 7f6d39ffb700 1 --2- 172.21.15.37:0/693739746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6d28066f30 0x7f6d280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.180+0000 7f6d39ffb700 1 -- 172.21.15.37:0/693739746 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f6d2c084ac0 con 0x7f6d3c0b3310 2023-10-06T02:28:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.180+0000 7f6d4172f700 1 --2- 172.21.15.37:0/693739746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6d28066f30 0x7f6d280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.180+0000 7f6d4172f700 1 --2- 172.21.15.37:0/693739746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6d28066f30 0x7f6d280693e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6d300091e0 tx=0x7f6d30017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.181+0000 7f6d4d48cb80 1 Processor -- start 2023-10-06T02:28:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.181+0000 7f6d4d48cb80 1 -- start start 2023-10-06T02:28:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.182+0000 7f6d4d48cb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x565019d4a890 0x565019d4ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.182+0000 7f6d4d48cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d4bd10 0x565019d9a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.182+0000 7f6d4d48cb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565019d9ac50 0x565019d9b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.182+0000 7f6d4d48cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x565019ca1ac0 con 0x565019d4bd10 2023-10-06T02:28:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.182+0000 7f6d4d48cb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x565019c9f2c0 con 0x565019d9ac50 2023-10-06T02:28:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.182+0000 7f6d4d48cb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x565019c9b0b0 con 0x565019d4a890 2023-10-06T02:28:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.182+0000 7f6d4172f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d4bd10 0x565019d9a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.182+0000 7f6d4172f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d4bd10 0x565019d9a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32890/0 (socket says 172.21.15.37:32890) 2023-10-06T02:28:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.182+0000 7f6d4172f700 1 -- 172.21.15.37:0/2090344073 learned_addr learned my addr 172.21.15.37:0/2090344073 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.182+0000 7f6d41f30700 1 --2- 172.21.15.37:0/2090344073 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x565019d4a890 0x565019d4ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.182+0000 7f6d42731700 1 --2- 172.21.15.37:0/2090344073 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565019d9ac50 0x565019d9b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.182+0000 7f6d4172f700 1 -- 172.21.15.37:0/2090344073 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x565019d4a890 msgr2=0x565019d4ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.182+0000 7f6d4172f700 1 --2- 172.21.15.37:0/2090344073 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x565019d4a890 0x565019d4ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.182+0000 7f6d4172f700 1 -- 172.21.15.37:0/2090344073 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565019d9ac50 msgr2=0x565019d9b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.182+0000 7f6d4172f700 1 --2- 172.21.15.37:0/2090344073 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565019d9ac50 0x565019d9b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.182+0000 7f6d4172f700 1 -- 172.21.15.37:0/2090344073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565019b352c0 con 0x565019d4bd10 2023-10-06T02:28:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.183+0000 7f6d4172f700 1 --2- 172.21.15.37:0/2090344073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d4bd10 0x565019d9a710 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000bc60 tx=0x7f6d30021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4e39a9d41f6d60 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.183+0000 7f6d22ffd700 1 -- 172.21.15.37:0/2090344073 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d30021070 con 0x565019d4bd10 2023-10-06T02:28:32.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.183+0000 7f6d22ffd700 1 -- 172.21.15.37:0/2090344073 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3002aba0 con 0x565019d4bd10 2023-10-06T02:28:32.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.183+0000 7f6d22ffd700 1 -- 172.21.15.37:0/2090344073 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3002ad10 con 0x565019d4bd10 2023-10-06T02:28:32.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.183+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/2090344073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d4bd10 msgr2=0x565019d9a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.183+0000 7f6d4d48cb80 1 --2- 172.21.15.37:0/2090344073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d4bd10 0x565019d9a710 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000bc60 tx=0x7f6d30021000 comp rx=0 tx=0).stop 2023-10-06T02:28:32.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.183+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/2090344073 shutdown_connections 2023-10-06T02:28:32.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.183+0000 7f6d4d48cb80 1 --2- 172.21.15.37:0/2090344073 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565019d9ac50 0x565019d9b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.183+0000 7f6d4d48cb80 1 --2- 172.21.15.37:0/2090344073 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x565019d4a890 0x565019d4ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.183+0000 7f6d4d48cb80 1 --2- 172.21.15.37:0/2090344073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d4bd10 0x565019d9a710 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.183+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/2090344073 >> 172.21.15.37:0/2090344073 conn(0x565019d4c1b0 msgr2=0x565019d4c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:32.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.183+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/2090344073 shutdown_connections 2023-10-06T02:28:32.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.183+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/2090344073 wait complete. 2023-10-06T02:28:32.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.184+0000 7f6d4d48cb80 1 -- start start 2023-10-06T02:28:32.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.184+0000 7f6d4d48cb80 1 Processor -- start 2023-10-06T02:28:32.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.185+0000 7f6d4d48cb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565019d4a890 0x565019d8a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.185+0000 7f6d4d48cb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x565019d4bd10 0x565019da3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.185+0000 7f6d4d48cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 0x565019d7aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.185+0000 7f6d4d48cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x565019c468e0 con 0x565019d9ac50 2023-10-06T02:28:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.185+0000 7f6d4d48cb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x565019c61ef0 con 0x565019d4a890 2023-10-06T02:28:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.185+0000 7f6d4d48cb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x565019b1de80 con 0x565019d4bd10 2023-10-06T02:28:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.185+0000 7f6d4d48cb80 10 client.0 _ll_register_callbacks cb 0x565019d0dec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:28:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.185+0000 7f6d42731700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 0x565019d7aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.185+0000 7f6d42731700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 0x565019d7aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32896/0 (socket says 172.21.15.37:32896) 2023-10-06T02:28:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.185+0000 7f6d42731700 1 -- 172.21.15.37:0/2575194856 learned_addr learned my addr 172.21.15.37:0/2575194856 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.185+0000 7f6d4172f700 1 --2- 172.21.15.37:0/2575194856 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x565019d4bd10 0x565019da3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.185+0000 7f6d41f30700 1 --2- 172.21.15.37:0/2575194856 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565019d4a890 0x565019d8a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.185+0000 7f6d42731700 1 -- 172.21.15.37:0/2575194856 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x565019d4bd10 msgr2=0x565019da3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.185+0000 7f6d42731700 1 --2- 172.21.15.37:0/2575194856 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x565019d4bd10 0x565019da3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.185+0000 7f6d42731700 1 -- 172.21.15.37:0/2575194856 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565019d4a890 msgr2=0x565019d8a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.185+0000 7f6d42731700 1 --2- 172.21.15.37:0/2575194856 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565019d4a890 0x565019d8a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.185+0000 7f6d42731700 1 -- 172.21.15.37:0/2575194856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3c0b37a0 con 0x565019d9ac50 2023-10-06T02:28:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.186+0000 7f6d42731700 1 --2- 172.21.15.37:0/2575194856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 0x565019d7aa90 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f6d340139a0 tx=0x7f6d34008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1020770d464ea499 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.186+0000 7f6d1bfff700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:28:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.186+0000 7f6d1bfff700 1 -- 172.21.15.37:0/2575194856 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d34015700 con 0x565019d9ac50 2023-10-06T02:28:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.186+0000 7f6d1bfff700 1 -- 172.21.15.37:0/2575194856 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(73..73 src has 1..73) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f6d34015860 con 0x565019d9ac50 2023-10-06T02:28:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.186+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/2575194856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565019d3f990 con 0x565019d9ac50 2023-10-06T02:28:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.186+0000 7f6d1bfff700 1 -- 172.21.15.37:0/2575194856 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d34015c30 con 0x565019d9ac50 2023-10-06T02:28:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.186+0000 7f6d4d48cb80 10 client.6819 fetch_fsmap learned FSMap version 53 2023-10-06T02:28:32.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.186+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/2575194856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) v3 -- 0x565019ad8030 con 0x565019d9ac50 2023-10-06T02:28:32.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.186+0000 7f6d1bfff700 1 -- 172.21.15.37:0/2575194856 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565019d3f990 con 0x565019d9ac50 2023-10-06T02:28:32.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.186+0000 7f6d1bfff700 1 -- 172.21.15.37:0/2575194856 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 53) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6d3401d3c0 con 0x565019d9ac50 2023-10-06T02:28:32.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.186+0000 7f6d4d48cb80 10 client.6819 fetch_fsmap finished waiting for FSMap version 53 2023-10-06T02:28:32.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.186+0000 7f6d4d48cb80 10 client.6819 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-10-06T02:28:32.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.186+0000 7f6d4d48cb80 20 client.6819 populate_metadata read hostname 'smithi037' 2023-10-06T02:28:32.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.186+0000 7f6d4d48cb80 1 --2- 172.21.15.37:0/2575194856 >> [v2:172.21.15.37:6832/4246185831,v1:172.21.15.37:6834/4246185831] conn(0x565019da1300 0x565019da41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.186+0000 7f6d4d48cb80 4 client.6819 mds_command: new command op to 6453 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:28:32.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.186+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/2575194856 --> [v2:172.21.15.37:6832/4246185831,v1:172.21.15.37:6834/4246185831] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565019d1c8c0 con 0x565019da1300 2023-10-06T02:28:32.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.186+0000 7f6d41f30700 1 --2- 172.21.15.37:0/2575194856 >> [v2:172.21.15.37:6832/4246185831,v1:172.21.15.37:6834/4246185831] conn(0x565019da1300 0x565019da41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.187+0000 7f6d1bfff700 10 client.6819 ms_handle_connect on v2:172.21.15.37:6832/4246185831 2023-10-06T02:28:32.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.187+0000 7f6d41f30700 1 --2- 172.21.15.37:0/2575194856 >> [v2:172.21.15.37:6832/4246185831,v1:172.21.15.37:6834/4246185831] conn(0x565019da1300 0x565019da41e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2efe12d29913dbd9 server_cookie=6977940ead55ec1e in_seq=0 out_seq=0 2023-10-06T02:28:32.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.187+0000 7f6d1bfff700 1 -- 172.21.15.37:0/2575194856 <== mds.0 v2:172.21.15.37:6832/4246185831 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x565019d1c8c0 con 0x565019da1300 2023-10-06T02:28:32.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.187+0000 7f6d1bfff700 10 client.6819 handle_command_reply: tid=0 2023-10-06T02:28:32.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.187+0000 7f6d4d48cb80 1 client.6819 shutdown 2023-10-06T02:28:32.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.187+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/2575194856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 msgr2=0x565019d7aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.187+0000 7f6d4d48cb80 1 --2- 172.21.15.37:0/2575194856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 0x565019d7aa90 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f6d340139a0 tx=0x7f6d34008040 comp rx=0 tx=0).stop 2023-10-06T02:28:32.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.187+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/2575194856 shutdown_connections 2023-10-06T02:28:32.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.187+0000 7f6d4d48cb80 1 --2- 172.21.15.37:0/2575194856 >> [v2:172.21.15.37:6832/4246185831,v1:172.21.15.37:6834/4246185831] conn(0x565019da1300 0x565019da41e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.187+0000 7f6d4d48cb80 1 --2- 172.21.15.37:0/2575194856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 0x565019d7aa90 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.187+0000 7f6d4d48cb80 1 --2- 172.21.15.37:0/2575194856 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565019d4a890 0x565019d8a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.187+0000 7f6d4d48cb80 1 --2- 172.21.15.37:0/2575194856 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x565019d4bd10 0x565019da3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.187+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/2575194856 >> 172.21.15.37:0/2575194856 conn(0x565019d4c1b0 msgr2=0x565019d45a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:32.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.187+0000 7f6d1bfff700 0 client.6819 ms_handle_reset on v2:172.21.15.37:6832/4246185831 2023-10-06T02:28:32.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.187+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/2575194856 shutdown_connections 2023-10-06T02:28:32.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.188+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/2575194856 wait complete. 2023-10-06T02:28:32.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.188+0000 7f6d4d48cb80 20 client.6819 trim_cache size 0 max 16384 2023-10-06T02:28:32.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.201+0000 7f6d4d48cb80 1 Processor -- start 2023-10-06T02:28:32.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.201+0000 7f6d4d48cb80 1 -- start start 2023-10-06T02:28:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.202+0000 7f6d4d48cb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565019d4a890 0x565019d90420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.202+0000 7f6d4d48cb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x565019d4bd10 0x565019d90960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.202+0000 7f6d4d48cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 0x565019d4b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.202+0000 7f6d4d48cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x565019d4e100 con 0x565019d9ac50 2023-10-06T02:28:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.202+0000 7f6d4d48cb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x565019d8fc40 con 0x565019d4a890 2023-10-06T02:28:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.202+0000 7f6d4d48cb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x565019d8bab0 con 0x565019d4bd10 2023-10-06T02:28:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.202+0000 7f6d42731700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 0x565019d4b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.202+0000 7f6d42731700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 0x565019d4b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32906/0 (socket says 172.21.15.37:32906) 2023-10-06T02:28:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.202+0000 7f6d42731700 1 -- 172.21.15.37:0/1654437739 learned_addr learned my addr 172.21.15.37:0/1654437739 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.202+0000 7f6d42731700 1 -- 172.21.15.37:0/1654437739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x565019d4bd10 msgr2=0x565019d90960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.202+0000 7f6d42731700 1 --2- 172.21.15.37:0/1654437739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x565019d4bd10 0x565019d90960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.202+0000 7f6d42731700 1 -- 172.21.15.37:0/1654437739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565019d4a890 msgr2=0x565019d90420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.202+0000 7f6d42731700 1 --2- 172.21.15.37:0/1654437739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565019d4a890 0x565019d90420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.203+0000 7f6d42731700 1 -- 172.21.15.37:0/1654437739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565019c697d0 con 0x565019d9ac50 2023-10-06T02:28:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.203+0000 7f6d42731700 1 --2- 172.21.15.37:0/1654437739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 0x565019d4b200 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f6d3401dfd0 tx=0x7f6d3401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49ae60a3881491b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.203+0000 7f6d237fe700 1 -- 172.21.15.37:0/1654437739 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3401d8d0 con 0x565019d9ac50 2023-10-06T02:28:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.203+0000 7f6d237fe700 1 -- 172.21.15.37:0/1654437739 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3401d3c0 con 0x565019d9ac50 2023-10-06T02:28:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.203+0000 7f6d237fe700 1 -- 172.21.15.37:0/1654437739 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3401d530 con 0x565019d9ac50 2023-10-06T02:28:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.203+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/1654437739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 msgr2=0x565019d4b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.203+0000 7f6d4d48cb80 1 --2- 172.21.15.37:0/1654437739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 0x565019d4b200 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f6d3401dfd0 tx=0x7f6d3401e000 comp rx=0 tx=0).stop 2023-10-06T02:28:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.203+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/1654437739 shutdown_connections 2023-10-06T02:28:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.203+0000 7f6d4d48cb80 1 --2- 172.21.15.37:0/1654437739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 0x565019d4b200 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.203+0000 7f6d4d48cb80 1 --2- 172.21.15.37:0/1654437739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565019d4a890 0x565019d90420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.203+0000 7f6d4d48cb80 1 --2- 172.21.15.37:0/1654437739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x565019d4bd10 0x565019d90960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.203+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/1654437739 >> 172.21.15.37:0/1654437739 conn(0x565019d4c1b0 msgr2=0x565019da4170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.203+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/1654437739 shutdown_connections 2023-10-06T02:28:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.203+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/1654437739 wait complete. 2023-10-06T02:28:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.204+0000 7f6d4d48cb80 1 -- start start 2023-10-06T02:28:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.204+0000 7f6d4d48cb80 1 Processor -- start 2023-10-06T02:28:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.205+0000 7f6d4d48cb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565019d4a890 0x565019d94f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.205+0000 7f6d4d48cb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x565019d4bd10 0x565019d954a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.205+0000 7f6d4d48cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 0x565019df5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.205+0000 7f6d4d48cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x565019d4b640 con 0x565019d9ac50 2023-10-06T02:28:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.205+0000 7f6d4d48cb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x565019d4b920 con 0x565019d4a890 2023-10-06T02:28:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.205+0000 7f6d4d48cb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x565019d47b50 con 0x565019d4bd10 2023-10-06T02:28:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.205+0000 7f6d4d48cb80 10 client.0 _ll_register_callbacks cb 0x565019d0dec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:28:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.205+0000 7f6d42731700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 0x565019df5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.205+0000 7f6d42731700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 0x565019df5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32920/0 (socket says 172.21.15.37:32920) 2023-10-06T02:28:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.205+0000 7f6d42731700 1 -- 172.21.15.37:0/633690991 learned_addr learned my addr 172.21.15.37:0/633690991 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.205+0000 7f6d4172f700 1 --2- 172.21.15.37:0/633690991 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x565019d4bd10 0x565019d954a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.205+0000 7f6d41f30700 1 --2- 172.21.15.37:0/633690991 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565019d4a890 0x565019d94f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.205+0000 7f6d42731700 1 -- 172.21.15.37:0/633690991 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x565019d4bd10 msgr2=0x565019d954a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.205+0000 7f6d42731700 1 --2- 172.21.15.37:0/633690991 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x565019d4bd10 0x565019d954a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.205+0000 7f6d42731700 1 -- 172.21.15.37:0/633690991 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565019d4a890 msgr2=0x565019d94f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.205+0000 7f6d42731700 1 --2- 172.21.15.37:0/633690991 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565019d4a890 0x565019d94f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.205+0000 7f6d42731700 1 -- 172.21.15.37:0/633690991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565019ad8030 con 0x565019d9ac50 2023-10-06T02:28:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.205+0000 7f6d42731700 1 --2- 172.21.15.37:0/633690991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 0x565019df5cd0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f6d34000fb0 tx=0x7f6d3402b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d734164fdc9800 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.205+0000 7f6d1bfff700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:28:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.206+0000 7f6d1bfff700 1 -- 172.21.15.37:0/633690991 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d34015700 con 0x565019d9ac50 2023-10-06T02:28:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.206+0000 7f6d1bfff700 1 -- 172.21.15.37:0/633690991 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(73..73 src has 1..73) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f6d34015860 con 0x565019d9ac50 2023-10-06T02:28:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.206+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/633690991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6d3002aba0 con 0x565019d9ac50 2023-10-06T02:28:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.206+0000 7f6d1bfff700 1 -- 172.21.15.37:0/633690991 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d3401dae0 con 0x565019d9ac50 2023-10-06T02:28:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.206+0000 7f6d4d48cb80 10 client.6825 fetch_fsmap learned FSMap version 53 2023-10-06T02:28:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.206+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/633690991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) v3 -- 0x565019c504c0 con 0x565019d9ac50 2023-10-06T02:28:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.206+0000 7f6d1bfff700 1 -- 172.21.15.37:0/633690991 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3002aba0 con 0x565019d9ac50 2023-10-06T02:28:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.206+0000 7f6d1bfff700 1 -- 172.21.15.37:0/633690991 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 53) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6d34031070 con 0x565019d9ac50 2023-10-06T02:28:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.206+0000 7f6d4d48cb80 10 client.6825 fetch_fsmap finished waiting for FSMap version 53 2023-10-06T02:28:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.206+0000 7f6d4d48cb80 10 client.6825 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-10-06T02:28:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.206+0000 7f6d4d48cb80 20 client.6825 populate_metadata read hostname 'smithi037' 2023-10-06T02:28:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.206+0000 7f6d4d48cb80 1 --2- 172.21.15.37:0/633690991 >> [v2:172.21.15.37:6832/4246185831,v1:172.21.15.37:6834/4246185831] conn(0x565019d9a0d0 0x565019df6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.206+0000 7f6d4d48cb80 4 client.6825 mds_command: new command op to 6453 tid=0[{"prefix": "flush journal"}] 2023-10-06T02:28:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.206+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/633690991 --> [v2:172.21.15.37:6832/4246185831,v1:172.21.15.37:6834/4246185831] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x565019c3de50 con 0x565019d9a0d0 2023-10-06T02:28:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.206+0000 7f6d41f30700 1 --2- 172.21.15.37:0/633690991 >> [v2:172.21.15.37:6832/4246185831,v1:172.21.15.37:6834/4246185831] conn(0x565019d9a0d0 0x565019df6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.206+0000 7f6d1bfff700 10 client.6825 ms_handle_connect on v2:172.21.15.37:6832/4246185831 2023-10-06T02:28:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.206+0000 7f6d41f30700 1 --2- 172.21.15.37:0/633690991 >> [v2:172.21.15.37:6832/4246185831,v1:172.21.15.37:6834/4246185831] conn(0x565019d9a0d0 0x565019df6210 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32b68c191276018b server_cookie=5aff4d72f2712a2 in_seq=0 out_seq=0 2023-10-06T02:28:32.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.221+0000 7f6d1bfff700 1 -- 172.21.15.37:0/633690991 <== mds.0 v2:172.21.15.37:6832/4246185831 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x565019c3de50 con 0x565019d9a0d0 2023-10-06T02:28:32.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.221+0000 7f6d1bfff700 10 client.6825 handle_command_reply: tid=0 2023-10-06T02:28:32.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.221+0000 7f6d4d48cb80 1 client.6825 shutdown 2023-10-06T02:28:32.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.221+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/633690991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 msgr2=0x565019df5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.221+0000 7f6d4d48cb80 1 --2- 172.21.15.37:0/633690991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 0x565019df5cd0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f6d34000fb0 tx=0x7f6d3402b000 comp rx=0 tx=0).stop 2023-10-06T02:28:32.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.222+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/633690991 shutdown_connections 2023-10-06T02:28:32.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.222+0000 7f6d4d48cb80 1 --2- 172.21.15.37:0/633690991 >> [v2:172.21.15.37:6832/4246185831,v1:172.21.15.37:6834/4246185831] conn(0x565019d9a0d0 0x565019df6210 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.222+0000 7f6d4d48cb80 1 --2- 172.21.15.37:0/633690991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565019d9ac50 0x565019df5cd0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.222+0000 7f6d4d48cb80 1 --2- 172.21.15.37:0/633690991 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565019d4a890 0x565019d94f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.222+0000 7f6d1bfff700 0 client.6825 ms_handle_reset on v2:172.21.15.37:6832/4246185831 2023-10-06T02:28:32.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.222+0000 7f6d4d48cb80 1 --2- 172.21.15.37:0/633690991 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x565019d4bd10 0x565019d954a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.222+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/633690991 >> 172.21.15.37:0/633690991 conn(0x565019d4c1b0 msgr2=0x565019da4070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:32.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.222+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/633690991 shutdown_connections 2023-10-06T02:28:32.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.222+0000 7f6d4d48cb80 1 -- 172.21.15.37:0/633690991 wait complete. 2023-10-06T02:28:32.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.222+0000 7f6d4d48cb80 20 client.6825 trim_cache size 0 max 16384 2023-10-06T02:28:32.224 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:28:32.224 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "", 2023-10-06T02:28:32.224 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0 2023-10-06T02:28:32.224 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:28:32.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.222+0000 7f6d44194700 1 -- 172.21.15.37:0/693739746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6d28066f30 msgr2=0x7f6d280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.222+0000 7f6d44194700 1 --2- 172.21.15.37:0/693739746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6d28066f30 0x7f6d280693e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6d300091e0 tx=0x7f6d30017000 comp rx=0 tx=0).stop 2023-10-06T02:28:32.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.222+0000 7f6d44194700 1 -- 172.21.15.37:0/693739746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d3c0b3310 msgr2=0x7f6d3c14d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.222+0000 7f6d44194700 1 --2- 172.21.15.37:0/693739746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d3c0b3310 0x7f6d3c14d920 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00cdb0 tx=0x7f6d2c001ae0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.222+0000 7f6d44194700 1 -- 172.21.15.37:0/693739746 shutdown_connections 2023-10-06T02:28:32.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.222+0000 7f6d44194700 1 --2- 172.21.15.37:0/693739746 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6d28066f30 0x7f6d280693e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.222+0000 7f6d44194700 1 --2- 172.21.15.37:0/693739746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d3c1599e0 0x7f6d3c15c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.222+0000 7f6d44194700 1 --2- 172.21.15.37:0/693739746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d3c0b3310 0x7f6d3c14d920 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.222+0000 7f6d44194700 1 --2- 172.21.15.37:0/693739746 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d3c159610 0x7f6d3c15c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.222+0000 7f6d44194700 1 -- 172.21.15.37:0/693739746 >> 172.21.15.37:0/693739746 conn(0x7f6d3c06c0b0 msgr2=0x7f6d3c1568f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:32.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.223+0000 7f6d44194700 1 -- 172.21.15.37:0/693739746 shutdown_connections 2023-10-06T02:28:32.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.223+0000 7f6d44194700 1 -- 172.21.15.37:0/693739746 wait complete. 2023-10-06T02:28:32.235 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:28:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.354+0000 7fa98759e700 1 Processor -- start 2023-10-06T02:28:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.354+0000 7fa98759e700 1 -- start start 2023-10-06T02:28:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.355+0000 7fa98759e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa9880c5150 0x7fa9880ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.355+0000 7fa98759e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa9880cf020 0x7fa9880cba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.355+0000 7fa98759e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9880cb600 con 0x7fa9880b28f0 2023-10-06T02:28:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.355+0000 7fa98759e700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9880cf450 con 0x7fa9880c5150 2023-10-06T02:28:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.355+0000 7fa98759e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa988159a50 con 0x7fa9880cf020 2023-10-06T02:28:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.355+0000 7fa98659c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa9880b28f0 0x7fa9880c6040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36580/0 (socket says 172.21.15.37:36580) 2023-10-06T02:28:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.355+0000 7fa985d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa9880c5150 0x7fa9880ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.355+0000 7fa98659c700 1 -- 172.21.15.37:0/2500301622 learned_addr learned my addr 172.21.15.37:0/2500301622 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.355+0000 7fa986d9d700 1 --2- 172.21.15.37:0/2500301622 >> v2:172.21.15.191:3300/0 conn(0x7fa9880cf020 0x7fa9880cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.356+0000 7fa985d9b700 1 -- 172.21.15.37:0/2500301622 >> v2:172.21.15.191:3300/0 conn(0x7fa9880cf020 msgr2=0x7fa9880cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.356+0000 7fa985d9b700 1 --2- 172.21.15.37:0/2500301622 >> v2:172.21.15.191:3300/0 conn(0x7fa9880cf020 0x7fa9880cba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.356+0000 7fa985d9b700 1 -- 172.21.15.37:0/2500301622 >> v1:172.21.15.37:6789/0 conn(0x7fa9880b28f0 legacy=0x7fa9880c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.356+0000 7fa985d9b700 1 -- 172.21.15.37:0/2500301622 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9880c68a0 con 0x7fa9880c5150 2023-10-06T02:28:32.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.356+0000 7fa985d9b700 1 --2- 172.21.15.37:0/2500301622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9880c5150 0x7fa9880ceae0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa98806be80 tx=0x7fa9700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d34f17be91ee1a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.356+0000 7fa98559a700 1 -- 172.21.15.37:0/2500301622 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000b6b0 con 0x7fa9880c5150 2023-10-06T02:28:32.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.356+0000 7fa98559a700 1 -- 172.21.15.37:0/2500301622 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97000b810 con 0x7fa9880c5150 2023-10-06T02:28:32.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.356+0000 7fa98559a700 1 -- 172.21.15.37:0/2500301622 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000bbb0 con 0x7fa9880c5150 2023-10-06T02:28:32.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.356+0000 7fa98759e700 1 -- 172.21.15.37:0/2500301622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9880c5150 msgr2=0x7fa9880ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.356+0000 7fa98759e700 1 --2- 172.21.15.37:0/2500301622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9880c5150 0x7fa9880ceae0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa98806be80 tx=0x7fa9700091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.357+0000 7fa98759e700 1 -- 172.21.15.37:0/2500301622 shutdown_connections 2023-10-06T02:28:32.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.357+0000 7fa98759e700 1 --2- 172.21.15.37:0/2500301622 >> v2:172.21.15.191:3300/0 conn(0x7fa9880cf020 0x7fa9880cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.357+0000 7fa98759e700 1 --2- 172.21.15.37:0/2500301622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9880c5150 0x7fa9880ceae0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.357+0000 7fa98759e700 1 -- 172.21.15.37:0/2500301622 >> 172.21.15.37:0/2500301622 conn(0x7fa9880995f0 msgr2=0x7fa98806c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:32.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.357+0000 7fa98759e700 1 -- 172.21.15.37:0/2500301622 shutdown_connections 2023-10-06T02:28:32.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.357+0000 7fa98759e700 1 -- 172.21.15.37:0/2500301622 wait complete. 2023-10-06T02:28:32.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.358+0000 7fa98759e700 1 Processor -- start 2023-10-06T02:28:32.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.358+0000 7fa98759e700 1 -- start start 2023-10-06T02:28:32.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.358+0000 7fa98759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9880b28f0 0x7fa98809da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.358+0000 7fa98759e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9880c5150 0x7fa988169bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.358+0000 7fa98759e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9880cf020 0x7fa9880b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.358+0000 7fa98759e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa988157a30 con 0x7fa9880b28f0 2023-10-06T02:28:32.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.358+0000 7fa98759e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98816b250 con 0x7fa9880c5150 2023-10-06T02:28:32.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.358+0000 7fa98759e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98816ac20 con 0x7fa9880cf020 2023-10-06T02:28:32.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.359+0000 7fa98659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9880b28f0 0x7fa98809da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.359+0000 7fa98659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9880b28f0 0x7fa98809da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32926/0 (socket says 172.21.15.37:32926) 2023-10-06T02:28:32.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.359+0000 7fa98659c700 1 -- 172.21.15.37:0/2881910919 learned_addr learned my addr 172.21.15.37:0/2881910919 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:32.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.359+0000 7fa985d9b700 1 --2- 172.21.15.37:0/2881910919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9880c5150 0x7fa988169bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.359+0000 7fa986d9d700 1 --2- 172.21.15.37:0/2881910919 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9880cf020 0x7fa9880b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.359+0000 7fa98659c700 1 -- 172.21.15.37:0/2881910919 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9880cf020 msgr2=0x7fa9880b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.359+0000 7fa98659c700 1 --2- 172.21.15.37:0/2881910919 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9880cf020 0x7fa9880b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.359+0000 7fa98659c700 1 -- 172.21.15.37:0/2881910919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9880c5150 msgr2=0x7fa988169bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.359+0000 7fa98659c700 1 --2- 172.21.15.37:0/2881910919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9880c5150 0x7fa988169bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.359+0000 7fa98659c700 1 -- 172.21.15.37:0/2881910919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa970009420 con 0x7fa9880b28f0 2023-10-06T02:28:32.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.359+0000 7fa98659c700 1 --2- 172.21.15.37:0/2881910919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9880b28f0 0x7fa98809da30 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa97800c7c0 tx=0x7fa978007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.359+0000 7fa97e7fc700 1 -- 172.21.15.37:0/2881910919 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa978005b30 con 0x7fa9880b28f0 2023-10-06T02:28:32.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.359+0000 7fa97e7fc700 1 -- 172.21.15.37:0/2881910919 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa978005c90 con 0x7fa9880b28f0 2023-10-06T02:28:32.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.359+0000 7fa98759e700 1 -- 172.21.15.37:0/2881910919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98816a660 con 0x7fa9880b28f0 2023-10-06T02:28:32.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.359+0000 7fa97e7fc700 1 -- 172.21.15.37:0/2881910919 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa978004a80 con 0x7fa9880b28f0 2023-10-06T02:28:32.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.359+0000 7fa98759e700 1 -- 172.21.15.37:0/2881910919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98816aee0 con 0x7fa9880b28f0 2023-10-06T02:28:32.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.360+0000 7fa98759e700 1 -- 172.21.15.37:0/2881910919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9880884f0 con 0x7fa9880b28f0 2023-10-06T02:28:32.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.361+0000 7fa97e7fc700 1 -- 172.21.15.37:0/2881910919 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9780070d0 con 0x7fa9880b28f0 2023-10-06T02:28:32.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.361+0000 7fa97e7fc700 1 --2- 172.21.15.37:0/2881910919 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa968066f30 0x7fa9680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.361+0000 7fa97e7fc700 1 -- 172.21.15.37:0/2881910919 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fa978083ab0 con 0x7fa9880b28f0 2023-10-06T02:28:32.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.361+0000 7fa985d9b700 1 --2- 172.21.15.37:0/2881910919 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa968066f30 0x7fa9680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.362+0000 7fa985d9b700 1 --2- 172.21.15.37:0/2881910919 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa968066f30 0x7fa9680693e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa9700093f0 tx=0x7fa970017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.365+0000 7fa97e7fc700 1 -- 172.21.15.37:0/2881910919 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa97804b5a0 con 0x7fa9880b28f0 2023-10-06T02:28:32.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.606+0000 7fa98759e700 1 -- 172.21.15.37:0/2881910919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa988064b00 con 0x7fa9880b28f0 2023-10-06T02:28:32.607 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-10-06T02:28:32.606+0000 7f292cc58700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:28:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.610+0000 7fa97e7fc700 1 -- 172.21.15.37:0/2881910919 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa978050b70 con 0x7fa9880b28f0 2023-10-06T02:28:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.612+0000 7fa98759e700 1 -- 172.21.15.37:0/2881910919 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa968066f30 msgr2=0x7fa9680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.612+0000 7fa98759e700 1 --2- 172.21.15.37:0/2881910919 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa968066f30 0x7fa9680693e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa9700093f0 tx=0x7fa970017000 comp rx=0 tx=0).stop 2023-10-06T02:28:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.612+0000 7fa98759e700 1 -- 172.21.15.37:0/2881910919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9880b28f0 msgr2=0x7fa98809da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.612+0000 7fa98759e700 1 --2- 172.21.15.37:0/2881910919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9880b28f0 0x7fa98809da30 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa97800c7c0 tx=0x7fa978007f70 comp rx=0 tx=0).stop 2023-10-06T02:28:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.612+0000 7fa98759e700 1 -- 172.21.15.37:0/2881910919 shutdown_connections 2023-10-06T02:28:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.612+0000 7fa98759e700 1 --2- 172.21.15.37:0/2881910919 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9880cf020 0x7fa9880b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.612+0000 7fa98759e700 1 --2- 172.21.15.37:0/2881910919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9880b28f0 0x7fa98809da30 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.612+0000 7fa98759e700 1 --2- 172.21.15.37:0/2881910919 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fa968066f30 0x7fa9680693e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.612+0000 7fa98759e700 1 --2- 172.21.15.37:0/2881910919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9880c5150 0x7fa988169bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.612+0000 7fa98759e700 1 -- 172.21.15.37:0/2881910919 >> 172.21.15.37:0/2881910919 conn(0x7fa9880995f0 msgr2=0x7fa9880c5630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.612+0000 7fa98759e700 1 -- 172.21.15.37:0/2881910919 shutdown_connections 2023-10-06T02:28:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.612+0000 7fa98759e700 1 -- 172.21.15.37:0/2881910919 wait complete. 2023-10-06T02:28:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:28:32.615 INFO:tasks.ceph.mds.c.smithi037.stderr: -1077> 2023-10-06T02:28:23.111+0000 7f2f54fdc700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:28:32.625 DEBUG:teuthology.orchestra.run.smithi037:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --force 2023-10-06T02:28:32.637 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-10-06T02:28:32.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.663+0000 7fd0d8882240 1 -- start start 2023-10-06T02:28:32.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.663+0000 7fd0d8882240 1 Processor -- start 2023-10-06T02:28:32.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.664+0000 7fd0d8882240 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325234400 0x55e325e76580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.664+0000 7fd0d8882240 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e325234800 0x55e325e76b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.664+0000 7fd0d8882240 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e325234c00 0x55e325e77080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.664+0000 7fd0d8882240 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3250ffcc0 con 0x55e325234400 2023-10-06T02:28:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.664+0000 7fd0d8882240 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3250ff540 con 0x55e325234800 2023-10-06T02:28:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.664+0000 7fd0d8882240 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3250ffb80 con 0x55e325234c00 2023-10-06T02:28:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.664+0000 7fd0d1d50700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325234400 0x55e325e76580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.664+0000 7fd0d1d50700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325234400 0x55e325e76580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32968/0 (socket says 172.21.15.37:32968) 2023-10-06T02:28:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.664+0000 7fd0d1d50700 1 -- 172.21.15.37:0/2301604538 learned_addr learned my addr 172.21.15.37:0/2301604538 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.664+0000 7fd0d154f700 1 --2- 172.21.15.37:0/2301604538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e325234800 0x55e325e76b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.664+0000 7fd0d2551700 1 --2- 172.21.15.37:0/2301604538 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e325234c00 0x55e325e77080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.664+0000 7fd0d1d50700 1 -- 172.21.15.37:0/2301604538 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e325234c00 msgr2=0x55e325e77080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.664+0000 7fd0d1d50700 1 --2- 172.21.15.37:0/2301604538 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e325234c00 0x55e325e77080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.664+0000 7fd0d1d50700 1 -- 172.21.15.37:0/2301604538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e325234800 msgr2=0x55e325e76b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.664+0000 7fd0d1d50700 1 --2- 172.21.15.37:0/2301604538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e325234800 0x55e325e76b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.664+0000 7fd0d1d50700 1 -- 172.21.15.37:0/2301604538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3250e2340 con 0x55e325234400 2023-10-06T02:28:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.664+0000 7fd0d1d50700 1 --2- 172.21.15.37:0/2301604538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325234400 0x55e325e76580 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x55e325e3c0c0 tx=0x55e325e42780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0495d59e019744 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.664+0000 7fd0cf54b700 1 -- 172.21.15.37:0/2301604538 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e3250f7600 con 0x55e325234400 2023-10-06T02:28:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.665+0000 7fd0cf54b700 1 -- 172.21.15.37:0/2301604538 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e325114480 con 0x55e325234400 2023-10-06T02:28:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.665+0000 7fd0cf54b700 1 -- 172.21.15.37:0/2301604538 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e3250f71e0 con 0x55e325234400 2023-10-06T02:28:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.665+0000 7fd0d8882240 1 -- 172.21.15.37:0/2301604538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3250e2000 con 0x55e325234400 2023-10-06T02:28:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.665+0000 7fd0d8882240 1 -- 172.21.15.37:0/2301604538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55e3250e2ea0 con 0x55e325234400 2023-10-06T02:28:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.665+0000 7fd0d8882240 4 waiting for MDS map... 2023-10-06T02:28:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.665+0000 7fd0cf54b700 1 -- 172.21.15.37:0/2301604538 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x55e325102c40 con 0x55e325234400 2023-10-06T02:28:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.665+0000 7fd0cf54b700 1 -- 172.21.15.37:0/2301604538 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 54) v1 ==== 2559+0+0 (secure 0 0 0) 0x55e325eae600 con 0x55e325234400 2023-10-06T02:28:32.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.665+0000 7fd0d8882240 4 Got MDS map 54 2023-10-06T02:28:32.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.665+0000 7fd0d8882240 10 main: JournalTool::main 2023-10-06T02:28:32.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.665+0000 7fd0d8882240 4 main: JournalTool: connecting to RADOS... 2023-10-06T02:28:32.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.665+0000 7fd0d8882240 1 Processor -- start 2023-10-06T02:28:32.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.665+0000 7fd0d8882240 1 -- start start 2023-10-06T02:28:32.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.666+0000 7fd0d8882240 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325235800 0x55e325e77600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.666+0000 7fd0d8882240 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e325235c00 0x55e325e77b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.666+0000 7fd0d8882240 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e325f1a000 0x55e325e78100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.666+0000 7fd0d8882240 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3250fedc0 con 0x55e325235800 2023-10-06T02:28:32.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.666+0000 7fd0d8882240 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3250ff540 con 0x55e325235c00 2023-10-06T02:28:32.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.666+0000 7fd0d8882240 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3250fe3c0 con 0x55e325f1a000 2023-10-06T02:28:32.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.666+0000 7fd0d2551700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325235800 0x55e325e77600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.666+0000 7fd0d2551700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325235800 0x55e325e77600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32974/0 (socket says 172.21.15.37:32974) 2023-10-06T02:28:32.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.666+0000 7fd0d2551700 1 -- 172.21.15.37:0/1561801170 learned_addr learned my addr 172.21.15.37:0/1561801170 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:32.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.666+0000 7fd0d1d50700 1 --2- 172.21.15.37:0/1561801170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e325235c00 0x55e325e77b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.666+0000 7fd0d154f700 1 --2- 172.21.15.37:0/1561801170 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e325f1a000 0x55e325e78100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.666+0000 7fd0d2551700 1 -- 172.21.15.37:0/1561801170 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e325f1a000 msgr2=0x55e325e78100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.666+0000 7fd0d2551700 1 --2- 172.21.15.37:0/1561801170 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e325f1a000 0x55e325e78100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.666+0000 7fd0d2551700 1 -- 172.21.15.37:0/1561801170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e325235c00 msgr2=0x55e325e77b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.666+0000 7fd0d2551700 1 --2- 172.21.15.37:0/1561801170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e325235c00 0x55e325e77b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.666+0000 7fd0d2551700 1 -- 172.21.15.37:0/1561801170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3250e3860 con 0x55e325235800 2023-10-06T02:28:32.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.667+0000 7fd0d2551700 1 --2- 172.21.15.37:0/1561801170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325235800 0x55e325e77600 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x55e325e3d650 tx=0x55e325e83e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bca1c861506878b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.667+0000 7fd0cd547700 1 -- 172.21.15.37:0/1561801170 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e3250f7600 con 0x55e325235800 2023-10-06T02:28:32.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.667+0000 7fd0cd547700 1 -- 172.21.15.37:0/1561801170 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e325eda300 con 0x55e325235800 2023-10-06T02:28:32.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.667+0000 7fd0cd547700 1 -- 172.21.15.37:0/1561801170 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e3250f71e0 con 0x55e325235800 2023-10-06T02:28:32.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.667+0000 7fd0d8882240 1 -- 172.21.15.37:0/1561801170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325235800 msgr2=0x55e325e77600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.667+0000 7fd0d8882240 1 --2- 172.21.15.37:0/1561801170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325235800 0x55e325e77600 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x55e325e3d650 tx=0x55e325e83e60 comp rx=0 tx=0).stop 2023-10-06T02:28:32.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.667+0000 7fd0d8882240 1 -- 172.21.15.37:0/1561801170 shutdown_connections 2023-10-06T02:28:32.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.667+0000 7fd0d8882240 1 --2- 172.21.15.37:0/1561801170 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e325f1a000 0x55e325e78100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.667+0000 7fd0d8882240 1 --2- 172.21.15.37:0/1561801170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325235800 0x55e325e77600 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.667+0000 7fd0d8882240 1 --2- 172.21.15.37:0/1561801170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e325235c00 0x55e325e77b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.667+0000 7fd0d8882240 1 -- 172.21.15.37:0/1561801170 >> 172.21.15.37:0/1561801170 conn(0x55e325235000 msgr2=0x55e325e39800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:32.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.667+0000 7fd0d8882240 1 -- 172.21.15.37:0/1561801170 shutdown_connections 2023-10-06T02:28:32.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.667+0000 7fd0d8882240 1 -- 172.21.15.37:0/1561801170 wait complete. 2023-10-06T02:28:32.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.668+0000 7fd0d8882240 1 Processor -- start 2023-10-06T02:28:32.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.668+0000 7fd0d8882240 1 -- start start 2023-10-06T02:28:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.668+0000 7fd0d8882240 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e325235c00 0x55e325e78c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.668+0000 7fd0d8882240 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e325235800 0x55e325e78680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.668+0000 7fd0d8882240 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325f3a000 0x55e325e78100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.668+0000 7fd0d8882240 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3250fe000 con 0x55e325f3a000 2023-10-06T02:28:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.668+0000 7fd0d8882240 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3250ff180 con 0x55e325235800 2023-10-06T02:28:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.668+0000 7fd0d8882240 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3250ff040 con 0x55e325235c00 2023-10-06T02:28:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.668+0000 7fd0d154f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325f3a000 0x55e325e78100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.669+0000 7fd0d154f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325f3a000 0x55e325e78100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32978/0 (socket says 172.21.15.37:32978) 2023-10-06T02:28:32.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.669+0000 7fd0d154f700 1 -- 172.21.15.37:0/4285548222 learned_addr learned my addr 172.21.15.37:0/4285548222 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:32.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.669+0000 7fd0d1d50700 1 --2- 172.21.15.37:0/4285548222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e325235800 0x55e325e78680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.669+0000 7fd0d2551700 1 --2- 172.21.15.37:0/4285548222 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e325235c00 0x55e325e78c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.669+0000 7fd0d154f700 1 -- 172.21.15.37:0/4285548222 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e325235c00 msgr2=0x55e325e78c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.669+0000 7fd0d154f700 1 --2- 172.21.15.37:0/4285548222 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e325235c00 0x55e325e78c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.669+0000 7fd0d154f700 1 -- 172.21.15.37:0/4285548222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e325235800 msgr2=0x55e325e78680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.669+0000 7fd0d154f700 1 --2- 172.21.15.37:0/4285548222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e325235800 0x55e325e78680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.669+0000 7fd0d154f700 1 -- 172.21.15.37:0/4285548222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3250e2340 con 0x55e325f3a000 2023-10-06T02:28:32.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.669+0000 7fd0d154f700 1 --2- 172.21.15.37:0/4285548222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325f3a000 0x55e325e78100 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x55e325ee0630 tx=0x55e325e82420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.669+0000 7fd0cbd44700 1 -- 172.21.15.37:0/4285548222 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e3250f7080 con 0x55e325f3a000 2023-10-06T02:28:32.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.669+0000 7fd0cbd44700 1 -- 172.21.15.37:0/4285548222 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e325eda480 con 0x55e325f3a000 2023-10-06T02:28:32.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.669+0000 7fd0cbd44700 1 -- 172.21.15.37:0/4285548222 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e3250f7600 con 0x55e325f3a000 2023-10-06T02:28:32.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.669+0000 7fd0d8882240 1 -- 172.21.15.37:0/4285548222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e3250e3a00 con 0x55e325f3a000 2023-10-06T02:28:32.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.669+0000 7fd0d8882240 1 -- 172.21.15.37:0/4285548222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3250e29c0 con 0x55e325f3a000 2023-10-06T02:28:32.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.669+0000 7fd0d8882240 4 main: JournalTool: resolving pool 11 2023-10-06T02:28:32.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.670+0000 7fd0cbd44700 1 -- 172.21.15.37:0/4285548222 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x55e325e35080 con 0x55e325f3a000 2023-10-06T02:28:32.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.671+0000 7fd0cbd44700 1 --2- 172.21.15.37:0/4285548222 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x55e325f3c400 0x55e325e79700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.671+0000 7fd0cbd44700 1 -- 172.21.15.37:0/4285548222 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x55e325102a80 con 0x55e325f3a000 2023-10-06T02:28:32.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.671+0000 7fd0d8882240 4 main: JournalTool: creating IoCtx.. 2023-10-06T02:28:32.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.671+0000 7fd0d8882240 4 main: Executing for rank 0 2023-10-06T02:28:32.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.671+0000 7fd0d2551700 1 --2- 172.21.15.37:0/4285548222 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x55e325f3c400 0x55e325e79700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.671+0000 7fd0d2551700 1 --2- 172.21.15.37:0/4285548222 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x55e325f3c400 0x55e325e79700 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x55e325e3d650 tx=0x55e325e83f20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.671+0000 7fd0d8882240 1 -- start start 2023-10-06T02:28:32.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.671+0000 7fd0d8882240 1 Processor -- start 2023-10-06T02:28:32.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.672+0000 7fd0d8882240 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e325f3a800 0x55e325e77600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.672+0000 7fd0d8882240 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e325f3ac00 0x55e32607a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.672+0000 7fd0d8882240 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325f3b000 0x55e32607a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.672+0000 7fd0d8882240 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e325186dc0 con 0x55e325f3b000 2023-10-06T02:28:32.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.672+0000 7fd0d8882240 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3250ff040 con 0x55e325f3a800 2023-10-06T02:28:32.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.672+0000 7fd0d8882240 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3250ff180 con 0x55e325f3ac00 2023-10-06T02:28:32.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.672+0000 7fd0d154f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325f3b000 0x55e32607a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.672+0000 7fd0d154f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325f3b000 0x55e32607a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32988/0 (socket says 172.21.15.37:32988) 2023-10-06T02:28:32.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.672+0000 7fd0d154f700 1 -- 172.21.15.37:0/3720691417 learned_addr learned my addr 172.21.15.37:0/3720691417 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:32.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.672+0000 7fd0d1d50700 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e325f3ac00 0x55e32607a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.672+0000 7fd0d2551700 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e325f3a800 0x55e325e77600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.672+0000 7fd0d154f700 1 -- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e325f3ac00 msgr2=0x55e32607a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.672+0000 7fd0d154f700 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e325f3ac00 0x55e32607a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.672+0000 7fd0d154f700 1 -- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e325f3a800 msgr2=0x55e325e77600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.672+0000 7fd0d154f700 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e325f3a800 0x55e325e77600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.672+0000 7fd0d154f700 1 -- 172.21.15.37:0/3720691417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3250e3a00 con 0x55e325f3b000 2023-10-06T02:28:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.672+0000 7fd0d1d50700 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e325f3ac00 0x55e32607a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.672+0000 7fd0d2551700 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e325f3a800 0x55e325e77600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.673+0000 7fd0d154f700 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325f3b000 0x55e32607a580 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x55e326086000 tx=0x55e325f1b380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b9a123932187d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.673+0000 7fd0c8d3e700 1 -- 172.21.15.37:0/3720691417 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e3250f71e0 con 0x55e325f3b000 2023-10-06T02:28:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.673+0000 7fd0c8d3e700 1 -- 172.21.15.37:0/3720691417 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e325eda600 con 0x55e325f3b000 2023-10-06T02:28:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.673+0000 7fd0c8d3e700 1 -- 172.21.15.37:0/3720691417 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e3250f6420 con 0x55e325f3b000 2023-10-06T02:28:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.673+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3250e2000 con 0x55e325f3b000 2023-10-06T02:28:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.673+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55e325f73040 con 0x55e325f3b000 2023-10-06T02:28:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.673+0000 7fd0d8882240 4 waiting for MDS map... 2023-10-06T02:28:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.673+0000 7fd0c8d3e700 1 -- 172.21.15.37:0/3720691417 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x55e3251028c0 con 0x55e325f3b000 2023-10-06T02:28:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.673+0000 7fd0c8d3e700 1 -- 172.21.15.37:0/3720691417 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 54) v1 ==== 2559+0+0 (secure 0 0 0) 0x55e326088600 con 0x55e325f3b000 2023-10-06T02:28:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.673+0000 7fd0d8882240 4 Got MDS map 54 2023-10-06T02:28:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.673+0000 7fd0d8882240 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x55e325f3b400 0x55e32607ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.673+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:1 11.f 11:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74) v8 -- 0x55e325f3b800 con 0x55e325f3b400 2023-10-06T02:28:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.673+0000 7fd0d2551700 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x55e325f3b400 0x55e32607ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.674+0000 7fd0d2551700 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x55e325f3b400 0x55e32607ab00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=33eebc28ad4bd5c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.678+0000 7fd0d2551700 1 -- 172.21.15.37:0/3720691417 <== osd.7 v2:172.21.15.191:6813/90854 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v74'2 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55e325ea9200 con 0x55e325f3b400 2023-10-06T02:28:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.678+0000 7fd0d8882240 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x55e325f3bc00 0x55e32607b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.678+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:2 11.14 11:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74) v8 -- 0x55e325f3d000 con 0x55e325f3bc00 2023-10-06T02:28:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.678+0000 7fd0d1d50700 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x55e325f3bc00 0x55e32607b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.678+0000 7fd0d1d50700 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x55e325f3bc00 0x55e32607b080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=c6f9f7aa6e013360 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.682+0000 7fd0d1d50700 1 -- 172.21.15.37:0/3720691417 <== osd.6 v2:172.21.15.191:6824/90897 1 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v74'41 uv41 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55e325ea9440 con 0x55e325f3bc00 2023-10-06T02:28:32.685 INFO:teuthology.orchestra.run.smithi037.stdout:writing EResetJournal entry 2023-10-06T02:28:32.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.682+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:3 11.14 11:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74) v8 -- 0x55e325f3d400 con 0x55e325f3bc00 2023-10-06T02:28:32.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.682+0000 7fd0d8882240 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x55e325f3d800 0x55e32607b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.682+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:4 11.1b 11:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74) v8 -- 0x55e325f3dc00 con 0x55e325f3d800 2023-10-06T02:28:32.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.682+0000 7fd0d8882240 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x55e3260a4000 0x55e32607bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.682+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:5 11.b 11:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74) v8 -- 0x55e3260a4400 con 0x55e3260a4000 2023-10-06T02:28:32.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.682+0000 7fd0d8882240 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x55e3260a4800 0x55e32607c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.682+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:6 11.1f 11:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74) v8 -- 0x55e3260a4c00 con 0x55e3260a4800 2023-10-06T02:28:32.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.682+0000 7fd0d8882240 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x55e3260a5000 0x55e32607c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.682+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:7 11.1a 11:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74) v8 -- 0x55e3260a5400 con 0x55e3260a5000 2023-10-06T02:28:32.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.682+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:8 11.1e 11:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74) v8 -- 0x55e3260a5800 con 0x55e325f3b400 2023-10-06T02:28:32.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.683+0000 7fd0d1d50700 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x55e3260a4000 0x55e32607bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.683+0000 7fd0d154f700 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x55e3260a4800 0x55e32607c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.683+0000 7fd0d2551700 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x55e325f3d800 0x55e32607b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.683+0000 7fd0d2551700 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x55e3260a5000 0x55e32607c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.683+0000 7fd0d154f700 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x55e3260a4800 0x55e32607c100 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=4fd4cf14797cb1e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.683+0000 7fd0d1d50700 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x55e3260a4000 0x55e32607bb80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=511a5d96ef84ac70 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.683+0000 7fd0d2551700 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x55e325f3d800 0x55e32607b600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=a4b173b9e986163e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.683+0000 7fd0d2551700 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x55e3260a5000 0x55e32607c680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=dd165882d7c41223 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.685+0000 7fd0d2551700 1 -- 172.21.15.37:0/3720691417 <== osd.5 v2:172.21.15.191:6808/90853 1 ==== osd_op_reply(7 200.00000005 [delete] v74'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55e325ea9200 con 0x55e3260a5000 2023-10-06T02:28:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.686+0000 7fd0d1d50700 1 -- 172.21.15.37:0/3720691417 <== osd.6 v2:172.21.15.191:6824/90897 2 ==== osd_op_reply(3 200.00000001 [delete] v74'42 uv42 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55e325ea9440 con 0x55e325f3bc00 2023-10-06T02:28:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.686+0000 7fd0d2551700 1 -- 172.21.15.37:0/3720691417 <== osd.7 v2:172.21.15.191:6813/90854 2 ==== osd_op_reply(8 200.00000006 [delete] v74'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55e325ea9200 con 0x55e325f3b400 2023-10-06T02:28:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.686+0000 7fd0d2551700 1 -- 172.21.15.37:0/3720691417 <== osd.4 v2:172.21.15.191:6800/90852 1 ==== osd_op_reply(4 200.00000002 [delete] v74'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55e325ea9200 con 0x55e325f3d800 2023-10-06T02:28:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.686+0000 7fd0c753b700 1 -- 172.21.15.37:0/3720691417 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:9 11.14 11:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74) v8 -- 0x55e325f3d000 con 0x55e325f3bc00 2023-10-06T02:28:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.687+0000 7fd0d1d50700 1 -- 172.21.15.37:0/3720691417 <== osd.3 v2:172.21.15.37:6817/90628 1 ==== osd_op_reply(5 200.00000003 [delete] v74'6 uv5 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55e325ea9440 con 0x55e3260a4000 2023-10-06T02:28:32.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.688+0000 7fd0d154f700 1 -- 172.21.15.37:0/3720691417 <== osd.2 v2:172.21.15.37:6800/90611 1 ==== osd_op_reply(6 200.00000004 [delete] v74'9 uv8 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55e3260b6000 con 0x55e3260a4800 2023-10-06T02:28:32.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d1d50700 1 -- 172.21.15.37:0/3720691417 <== osd.6 v2:172.21.15.191:6824/90897 3 ==== osd_op_reply(9 200.00000001 [write 0~48] v74'43 uv43 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55e325ea9440 con 0x55e325f3bc00 2023-10-06T02:28:32.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 4 Successfully wrote new journal pointer and header for rank 5:0 2023-10-06T02:28:32.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x55e3260a4800 msgr2=0x55e32607c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x55e3260a4800 0x55e32607c100 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x55e3260a4000 msgr2=0x55e32607bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x55e3260a4000 0x55e32607bb80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x55e325f3d800 msgr2=0x55e32607b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x55e325f3d800 0x55e32607b600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x55e3260a5000 msgr2=0x55e32607c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x55e3260a5000 0x55e32607c680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x55e325f3bc00 msgr2=0x55e32607b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x55e325f3bc00 0x55e32607b080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x55e325f3b400 msgr2=0x55e32607ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x55e325f3b400 0x55e32607ab00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d1d50700 1 -- 172.21.15.37:0/3720691417 reap_dead start 2023-10-06T02:28:32.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d1d50700 1 -- 172.21.15.37:0/3720691417 reap_dead start 2023-10-06T02:28:32.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325f3b000 msgr2=0x55e32607a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 --2- 172.21.15.37:0/3720691417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325f3b000 0x55e32607a580 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x55e326086000 tx=0x55e325f1b380 comp rx=0 tx=0).stop 2023-10-06T02:28:32.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d1d50700 1 -- 172.21.15.37:0/3720691417 reap_dead start 2023-10-06T02:28:32.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 shutdown_connections 2023-10-06T02:28:32.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 >> 172.21.15.37:0/3720691417 conn(0x55e325f3a400 msgr2=0x55e325e3a000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:32.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 shutdown_connections 2023-10-06T02:28:32.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 -- 172.21.15.37:0/3720691417 wait complete. 2023-10-06T02:28:32.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 -- 172.21.15.37:0/4285548222 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x55e325f3c400 msgr2=0x55e325e79700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 --2- 172.21.15.37:0/4285548222 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x55e325f3c400 0x55e325e79700 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x55e325e3d650 tx=0x55e325e83f20 comp rx=0 tx=0).stop 2023-10-06T02:28:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 -- 172.21.15.37:0/4285548222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325f3a000 msgr2=0x55e325e78100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 --2- 172.21.15.37:0/4285548222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325f3a000 0x55e325e78100 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x55e325ee0630 tx=0x55e325e82420 comp rx=0 tx=0).stop 2023-10-06T02:28:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 -- 172.21.15.37:0/4285548222 shutdown_connections 2023-10-06T02:28:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 --2- 172.21.15.37:0/4285548222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325f3a000 0x55e325e78100 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 --2- 172.21.15.37:0/4285548222 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e325235c00 0x55e325e78c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.689+0000 7fd0d8882240 1 --2- 172.21.15.37:0/4285548222 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x55e325f3c400 0x55e325e79700 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.690+0000 7fd0d8882240 1 --2- 172.21.15.37:0/4285548222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e325235800 0x55e325e78680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.690+0000 7fd0d8882240 1 -- 172.21.15.37:0/4285548222 >> 172.21.15.37:0/4285548222 conn(0x55e325235000 msgr2=0x55e325e39800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.690+0000 7fd0d8882240 1 -- 172.21.15.37:0/4285548222 shutdown_connections 2023-10-06T02:28:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.690+0000 7fd0d8882240 1 -- 172.21.15.37:0/4285548222 wait complete. 2023-10-06T02:28:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.690+0000 7fd0d8882240 1 -- 172.21.15.37:0/2301604538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325234400 msgr2=0x55e325e76580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.690+0000 7fd0d8882240 1 --2- 172.21.15.37:0/2301604538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325234400 0x55e325e76580 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x55e325e3c0c0 tx=0x55e325e42780 comp rx=0 tx=0).stop 2023-10-06T02:28:32.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.690+0000 7fd0d8882240 1 -- 172.21.15.37:0/2301604538 shutdown_connections 2023-10-06T02:28:32.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.690+0000 7fd0d8882240 1 --2- 172.21.15.37:0/2301604538 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e325234c00 0x55e325e77080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.690+0000 7fd0d8882240 1 --2- 172.21.15.37:0/2301604538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e325234400 0x55e325e76580 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.690+0000 7fd0d8882240 1 --2- 172.21.15.37:0/2301604538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e325234800 0x55e325e76b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.690+0000 7fd0d8882240 1 -- 172.21.15.37:0/2301604538 >> 172.21.15.37:0/2301604538 conn(0x55e325234000 msgr2=0x55e325e39000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:32.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.690+0000 7fd0d8882240 1 -- 172.21.15.37:0/2301604538 shutdown_connections 2023-10-06T02:28:32.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.690+0000 7fd0d8882240 1 -- 172.21.15.37:0/2301604538 wait complete. 2023-10-06T02:28:32.697 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--force'] in time 0:00:00.072089, result: writing EResetJournal entry 2023-10-06T02:28:32.698 DEBUG:teuthology.orchestra.run.smithi037:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2023-10-06T02:28:32.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.769+0000 7f68c87bf740 1 -- start start 2023-10-06T02:28:32.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.769+0000 7f68c87bf740 1 Processor -- start 2023-10-06T02:28:32.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.770+0000 7f68c87bf740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5621fc5a0400 0x5621fd1e6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.770+0000 7f68c87bf740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5621fc5a0800 0x5621fd1e6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.770+0000 7f68c87bf740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621fc5a0c00 0x5621fd1e7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.770+0000 7f68c87bf740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fc46bcc0 con 0x5621fc5a0c00 2023-10-06T02:28:32.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.770+0000 7f68c87bf740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fc46b540 con 0x5621fc5a0800 2023-10-06T02:28:32.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.770+0000 7f68c87bf740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621fc46bb80 con 0x5621fc5a0400 2023-10-06T02:28:32.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.770+0000 7f68c222e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621fc5a0c00 0x5621fd1e7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.770+0000 7f68c222e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621fc5a0c00 0x5621fd1e7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33002/0 (socket says 172.21.15.37:33002) 2023-10-06T02:28:32.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.770+0000 7f68c222e700 1 -- 172.21.15.37:0/418378980 learned_addr learned my addr 172.21.15.37:0/418378980 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:32.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.770+0000 7f68c122c700 1 --2- 172.21.15.37:0/418378980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5621fc5a0800 0x5621fd1e6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.770+0000 7f68c1a2d700 1 --2- 172.21.15.37:0/418378980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5621fc5a0400 0x5621fd1e6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.771+0000 7f68c222e700 1 -- 172.21.15.37:0/418378980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5621fc5a0400 msgr2=0x5621fd1e6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.771+0000 7f68c222e700 1 --2- 172.21.15.37:0/418378980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5621fc5a0400 0x5621fd1e6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.771+0000 7f68c222e700 1 -- 172.21.15.37:0/418378980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5621fc5a0800 msgr2=0x5621fd1e6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.771+0000 7f68c222e700 1 --2- 172.21.15.37:0/418378980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5621fc5a0800 0x5621fd1e6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.771+0000 7f68c222e700 1 -- 172.21.15.37:0/418378980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621fc44e340 con 0x5621fc5a0c00 2023-10-06T02:28:32.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.771+0000 7f68c222e700 1 --2- 172.21.15.37:0/418378980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621fc5a0c00 0x5621fd1e7080 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x5621fd2080f0 tx=0x5621fd1bd920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df208ac426890cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.771+0000 7f68bf228700 1 -- 172.21.15.37:0/418378980 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5621fc463080 con 0x5621fc5a0c00 2023-10-06T02:28:32.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.771+0000 7f68bf228700 1 -- 172.21.15.37:0/418378980 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5621fc480f00 con 0x5621fc5a0c00 2023-10-06T02:28:32.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.771+0000 7f68bf228700 1 -- 172.21.15.37:0/418378980 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5621fc463600 con 0x5621fc5a0c00 2023-10-06T02:28:32.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.771+0000 7f68c87bf740 1 -- 172.21.15.37:0/418378980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621fc44e000 con 0x5621fc5a0c00 2023-10-06T02:28:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.771+0000 7f68c87bf740 1 -- 172.21.15.37:0/418378980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5621fc44eea0 con 0x5621fc5a0c00 2023-10-06T02:28:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.771+0000 7f68c87bf740 4 waiting for MDS map... 2023-10-06T02:28:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.771+0000 7f68bf228700 1 -- 172.21.15.37:0/418378980 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x5621fc46ec40 con 0x5621fc5a0c00 2023-10-06T02:28:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.771+0000 7f68bf228700 1 -- 172.21.15.37:0/418378980 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 54) v1 ==== 2559+0+0 (secure 0 0 0) 0x5621fd207200 con 0x5621fc5a0c00 2023-10-06T02:28:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.771+0000 7f68c87bf740 4 Got MDS map 54 2023-10-06T02:28:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.771+0000 7f68c87bf740 4 datascan.main: Using metadata pool output 2023-10-06T02:28:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.771+0000 7f68c87bf740 4 datascan.main: connecting to RADOS... 2023-10-06T02:28:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.772+0000 7f68c87bf740 1 Processor -- start 2023-10-06T02:28:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.772+0000 7f68c87bf740 1 -- start start 2023-10-06T02:28:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.772+0000 7f68c87bf740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621fc5a1800 0x5621fd1e7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.772+0000 7f68c87bf740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5621fc5a1c00 0x5621fd1e7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.772+0000 7f68c87bf740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5621fd286000 0x5621fd1e8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.772+0000 7f68c87bf740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fc46adc0 con 0x5621fc5a1800 2023-10-06T02:28:32.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.772+0000 7f68c87bf740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fc46a3c0 con 0x5621fd286000 2023-10-06T02:28:32.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.772+0000 7f68c87bf740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621fc46bb80 con 0x5621fc5a1c00 2023-10-06T02:28:32.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.772+0000 7f68c122c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621fc5a1800 0x5621fd1e7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.773+0000 7f68c122c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621fc5a1800 0x5621fd1e7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33008/0 (socket says 172.21.15.37:33008) 2023-10-06T02:28:32.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.773+0000 7f68c122c700 1 -- 172.21.15.37:0/3684466476 learned_addr learned my addr 172.21.15.37:0/3684466476 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:32.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.773+0000 7f68c1a2d700 1 --2- 172.21.15.37:0/3684466476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5621fc5a1c00 0x5621fd1e7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.773+0000 7f68c122c700 1 --2- 172.21.15.37:0/3684466476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5621fd286000 0x5621fd1e8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.773+0000 7f68c122c700 1 -- 172.21.15.37:0/3684466476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5621fc5a1c00 msgr2=0x5621fd1e7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.773+0000 7f68c122c700 1 --2- 172.21.15.37:0/3684466476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5621fc5a1c00 0x5621fd1e7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.773+0000 7f68c122c700 1 -- 172.21.15.37:0/3684466476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5621fd286000 msgr2=0x5621fd1e8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.773+0000 7f68c122c700 1 --2- 172.21.15.37:0/3684466476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5621fd286000 0x5621fd1e8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.773+0000 7f68c122c700 1 -- 172.21.15.37:0/3684466476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621fc44f860 con 0x5621fc5a1800 2023-10-06T02:28:32.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.773+0000 7f68c1a2d700 1 --2- 172.21.15.37:0/3684466476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5621fc5a1c00 0x5621fd1e7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:32.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.773+0000 7f68c122c700 1 --2- 172.21.15.37:0/3684466476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621fc5a1800 0x5621fd1e7600 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x5621fd2095c0 tx=0x5621fd20a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84ec3e475064dfa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.773+0000 7f68bd224700 1 -- 172.21.15.37:0/3684466476 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5621fc463080 con 0x5621fc5a1800 2023-10-06T02:28:32.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.773+0000 7f68bd224700 1 -- 172.21.15.37:0/3684466476 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5621fc480480 con 0x5621fc5a1800 2023-10-06T02:28:32.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.773+0000 7f68bd224700 1 -- 172.21.15.37:0/3684466476 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5621fc463600 con 0x5621fc5a1800 2023-10-06T02:28:32.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.774+0000 7f68c87bf740 1 -- 172.21.15.37:0/3684466476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621fc5a1800 msgr2=0x5621fd1e7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.774+0000 7f68c87bf740 1 --2- 172.21.15.37:0/3684466476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621fc5a1800 0x5621fd1e7600 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x5621fd2095c0 tx=0x5621fd20a000 comp rx=0 tx=0).stop 2023-10-06T02:28:32.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.774+0000 7f68c87bf740 1 -- 172.21.15.37:0/3684466476 shutdown_connections 2023-10-06T02:28:32.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.774+0000 7f68c87bf740 1 --2- 172.21.15.37:0/3684466476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5621fd286000 0x5621fd1e8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.774+0000 7f68c87bf740 1 --2- 172.21.15.37:0/3684466476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621fc5a1800 0x5621fd1e7600 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.774+0000 7f68c87bf740 1 --2- 172.21.15.37:0/3684466476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5621fc5a1c00 0x5621fd1e7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.774+0000 7f68c87bf740 1 -- 172.21.15.37:0/3684466476 >> 172.21.15.37:0/3684466476 conn(0x5621fc5a1000 msgr2=0x5621fc4ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.774+0000 7f68c87bf740 1 -- 172.21.15.37:0/3684466476 shutdown_connections 2023-10-06T02:28:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.774+0000 7f68c87bf740 1 -- 172.21.15.37:0/3684466476 wait complete. 2023-10-06T02:28:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.774+0000 7f68c87bf740 1 Processor -- start 2023-10-06T02:28:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.774+0000 7f68c87bf740 1 -- start start 2023-10-06T02:28:32.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68c87bf740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5621fc5a1c00 0x5621fd1e8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68c87bf740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621fc5a1800 0x5621fd1e8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68c87bf740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5621fd2aa000 0x5621fd1e8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68c87bf740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fc46a000 con 0x5621fc5a1800 2023-10-06T02:28:32.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68c87bf740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fc46b180 con 0x5621fd2aa000 2023-10-06T02:28:32.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68c87bf740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621fc46b040 con 0x5621fc5a1c00 2023-10-06T02:28:32.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68c1a2d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621fc5a1800 0x5621fd1e8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68c1a2d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621fc5a1800 0x5621fd1e8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33024/0 (socket says 172.21.15.37:33024) 2023-10-06T02:28:32.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 learned_addr learned my addr 172.21.15.37:0/2965028157 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:32.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68c122c700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5621fc5a1c00 0x5621fd1e8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68c122c700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5621fd2aa000 0x5621fd1e8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5621fc5a1c00 msgr2=0x5621fd1e8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68c1a2d700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5621fc5a1c00 0x5621fd1e8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5621fd2aa000 msgr2=0x5621fd1e8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68c1a2d700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5621fd2aa000 0x5621fd1e8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621fc44e340 con 0x5621fc5a1800 2023-10-06T02:28:32.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68c1a2d700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621fc5a1800 0x5621fd1e8680 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x5621fd23c6f0 tx=0x5621fd20a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68bba21700 1 -- 172.21.15.37:0/2965028157 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5621fc463080 con 0x5621fc5a1800 2023-10-06T02:28:32.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68bba21700 1 -- 172.21.15.37:0/2965028157 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5621fc480600 con 0x5621fc5a1800 2023-10-06T02:28:32.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5621fc44e9c0 con 0x5621fc5a1800 2023-10-06T02:28:32.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.775+0000 7f68bba21700 1 -- 172.21.15.37:0/2965028157 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5621fc463600 con 0x5621fc5a1800 2023-10-06T02:28:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.776+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621fc44fa00 con 0x5621fc5a1800 2023-10-06T02:28:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.776+0000 7f68c87bf740 4 datascan.init: resolving metadata pool 11 2023-10-06T02:28:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.777+0000 7f68bba21700 1 -- 172.21.15.37:0/2965028157 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x5621fd1a1080 con 0x5621fc5a1800 2023-10-06T02:28:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.777+0000 7f68bba21700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x5621fd2ac400 0x5621fd1e9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.777+0000 7f68bba21700 1 -- 172.21.15.37:0/2965028157 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x5621fc46ea80 con 0x5621fc5a1800 2023-10-06T02:28:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.777+0000 7f68c87bf740 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-10-06T02:28:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.777+0000 7f68c87bf740 4 datascan.main: data pool 'cephfs_data' has ID 12 2023-10-06T02:28:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.777+0000 7f68c87bf740 4 datascan.main: opening data pool 'cephfs_data' 2023-10-06T02:28:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.777+0000 7f68c87bf740 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x5621fd2aa400 0x5621fd1e7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.777+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:1 12.0 12:00000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2aa800 con 0x5621fd2aa400 2023-10-06T02:28:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.777+0000 7f68c122c700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x5621fd2ac400 0x5621fd1e9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.777+0000 7f68c122c700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x5621fd2aa400 0x5621fd1e7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.778+0000 7f68c122c700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x5621fd2ac400 0x5621fd1e9700 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x5621fd209710 tx=0x5621fd297080 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.778+0000 7f68c122c700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x5621fd2aa400 0x5621fd1e7b80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.778+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.4 v2:172.21.15.191:6800/90852 1 ==== osd_op_reply(1 [pgnls start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2aa400 2023-10-06T02:28:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.778+0000 7f68bca23700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x5621fd2ac800 0x5621fd39e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.778+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:2 12.20 12:04000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2acc00 con 0x5621fd2ac800 2023-10-06T02:28:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.778+0000 7f68c222e700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x5621fd2ac800 0x5621fd39e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.779+0000 7f68c222e700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x5621fd2ac800 0x5621fd39e000 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.779+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.7 v2:172.21.15.191:6813/90854 1 ==== osd_op_reply(2 [pgnls start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd2ac800 2023-10-06T02:28:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.779+0000 7f68bd224700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x5621fd2ad400 0x5621fd39e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.779+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:3 12.10 12:08000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2ad800 con 0x5621fd2ad400 2023-10-06T02:28:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.779+0000 7f68c1a2d700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x5621fd2ad400 0x5621fd39e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.780+0000 7f68c1a2d700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x5621fd2ad400 0x5621fd39e580 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.780+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.0 v2:172.21.15.37:6816/90621 1 ==== osd_op_reply(3 [pgnls start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd2ad400 2023-10-06T02:28:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.780+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:4 12.30 12:0c000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2ad000 con 0x5621fd2ac800 2023-10-06T02:28:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.780+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.7 v2:172.21.15.191:6813/90854 2 ==== osd_op_reply(4 [pgnls start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd2ac800 2023-10-06T02:28:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.780+0000 7f68bd224700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x5621fd2adc00 0x5621fd39eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.780+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:5 12.8 12:10000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a6000 con 0x5621fd2adc00 2023-10-06T02:28:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.780+0000 7f68c122c700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x5621fd2adc00 0x5621fd39eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.780+0000 7f68c122c700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x5621fd2adc00 0x5621fd39eb00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.781+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.3 v2:172.21.15.37:6817/90628 1 ==== osd_op_reply(5 [pgnls start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2adc00 2023-10-06T02:28:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.781+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:6 12.28 12:14000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a6000 con 0x5621fd2ad400 2023-10-06T02:28:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.781+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.0 v2:172.21.15.37:6816/90621 2 ==== osd_op_reply(6 [pgnls start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd2ad400 2023-10-06T02:28:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.781+0000 7f68bd224700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5621fd3a6400 0x5621fd39f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.781+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:7 12.18 12:18000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a6800 con 0x5621fd3a6400 2023-10-06T02:28:32.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.781+0000 7f68c222e700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5621fd3a6400 0x5621fd39f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.781+0000 7f68c222e700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5621fd3a6400 0x5621fd39f080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.782+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.1 v2:172.21.15.37:6808/90617 1 ==== osd_op_reply(7 [pgnls start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd3a6400 2023-10-06T02:28:32.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.782+0000 7f68bca23700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x5621fd3a6c00 0x5621fd39f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.782+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:8 12.38 12:1c000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2aa800 con 0x5621fd3a6c00 2023-10-06T02:28:32.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.782+0000 7f68c1a2d700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x5621fd3a6c00 0x5621fd39f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.782+0000 7f68c1a2d700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x5621fd3a6c00 0x5621fd39f600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.782+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.2 v2:172.21.15.37:6800/90611 1 ==== osd_op_reply(8 [pgnls start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd3a6c00 2023-10-06T02:28:32.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.782+0000 7f68bd224700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x5621fd2ad800 0x5621fd3a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.782+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:9 12.4 12:20000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2acc00 con 0x5621fd2ad800 2023-10-06T02:28:32.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.783+0000 7f68c122c700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x5621fd2ad800 0x5621fd3a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.783+0000 7f68c122c700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x5621fd2ad800 0x5621fd3a0100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.783+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.6 v2:172.21.15.191:6824/90897 1 ==== osd_op_reply(9 [pgnls start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2ad800 2023-10-06T02:28:32.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.783+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:10 12.24 12:24000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a6000 con 0x5621fd3a6c00 2023-10-06T02:28:32.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.784+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.2 v2:172.21.15.37:6800/90611 2 ==== osd_op_reply(10 [pgnls start_epoch 74 out=49b] v72'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd3a6c00 2023-10-06T02:28:32.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.784+0000 7f68bd224700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x5621fd2ad000 0x5621fd3a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.784+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:11 12.14 12:28000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2aa800 con 0x5621fd2ad000 2023-10-06T02:28:32.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.784+0000 7f68c222e700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x5621fd2ad000 0x5621fd3a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.784+0000 7f68c222e700 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x5621fd2ad000 0x5621fd3a0680 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.785+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.5 v2:172.21.15.191:6808/90853 1 ==== osd_op_reply(11 [pgnls start_epoch 74 out=49b] v72'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd2ad000 2023-10-06T02:28:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.785+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:12 12.34 12:2c000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a6800 con 0x5621fd2ad000 2023-10-06T02:28:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.785+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.5 v2:172.21.15.191:6808/90853 2 ==== osd_op_reply(12 [pgnls start_epoch 74 out=49b] v72'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd2ad000 2023-10-06T02:28:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.785+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:13 12.c 12:30000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a7800 con 0x5621fd2ad400 2023-10-06T02:28:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.785+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.0 v2:172.21.15.37:6816/90621 3 ==== osd_op_reply(13 [pgnls start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd2ad400 2023-10-06T02:28:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.785+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:14 12.2c 12:34000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a7000 con 0x5621fd3a6c00 2023-10-06T02:28:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.785+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.2 v2:172.21.15.37:6800/90611 3 ==== osd_op_reply(14 [pgnls start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd3a6c00 2023-10-06T02:28:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.785+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:15 12.1c 12:38000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a7c00 con 0x5621fd2ad400 2023-10-06T02:28:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.786+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.0 v2:172.21.15.37:6816/90621 4 ==== osd_op_reply(15 [pgnls start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd2ad400 2023-10-06T02:28:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.786+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:16 12.3c 12:3c000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a7400 con 0x5621fd2ad000 2023-10-06T02:28:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.786+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.5 v2:172.21.15.191:6808/90853 3 ==== osd_op_reply(16 [pgnls start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd2ad000 2023-10-06T02:28:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.786+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:17 12.2 12:40000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a6000 con 0x5621fd2aa400 2023-10-06T02:28:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.786+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.4 v2:172.21.15.191:6800/90852 2 ==== osd_op_reply(17 [pgnls start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2aa400 2023-10-06T02:28:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.787+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:18 12.22 12:44000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3be000 con 0x5621fd2ac800 2023-10-06T02:28:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.787+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.7 v2:172.21.15.191:6813/90854 3 ==== osd_op_reply(18 [pgnls start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd2ac800 2023-10-06T02:28:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.787+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:19 12.12 12:48000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a7800 con 0x5621fd2adc00 2023-10-06T02:28:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.787+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.3 v2:172.21.15.37:6817/90628 2 ==== osd_op_reply(19 [pgnls start_epoch 74 out=81b] v73'22 uv22 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2adc00 2023-10-06T02:28:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.787+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:20 12.12 12:4bec3886:::10000000002.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2aac00 con 0x5621fd2adc00 2023-10-06T02:28:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.787+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.3 v2:172.21.15.37:6817/90628 3 ==== osd_op_reply(20 10000000002.00000000 [stat out=16b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2adc00 2023-10-06T02:28:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.787+0000 7f68c87bf740 10 datascan.operator(): handling object 1099511627778.0 2023-10-06T02:28:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.787+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:21 12.12 12:4bec3886:::10000000002.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2ab000 con 0x5621fd2adc00 2023-10-06T02:28:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.789+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.3 v2:172.21.15.37:6817/90628 4 ==== osd_op_reply(21 10000000002.00000000 [call] v74'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2adc00 2023-10-06T02:28:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.789+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:22 12.32 12:4c000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2ab400 con 0x5621fd2adc00 2023-10-06T02:28:32.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.789+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.3 v2:172.21.15.37:6817/90628 5 ==== osd_op_reply(22 [pgnls start_epoch 74 out=49b] v72'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2adc00 2023-10-06T02:28:32.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.789+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:23 12.a 12:50000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a7000 con 0x5621fd3a6c00 2023-10-06T02:28:32.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.789+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.2 v2:172.21.15.37:6800/90611 4 ==== osd_op_reply(23 [pgnls start_epoch 74 out=49b] v72'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd3a6c00 2023-10-06T02:28:32.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.789+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:24 12.2a 12:54000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3be400 con 0x5621fd3a6c00 2023-10-06T02:28:32.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.789+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.2 v2:172.21.15.37:6800/90611 5 ==== osd_op_reply(24 [pgnls start_epoch 74 out=49b] v72'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd3a6c00 2023-10-06T02:28:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.789+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:25 12.1a 12:58000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a7c00 con 0x5621fd2aa400 2023-10-06T02:28:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.790+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.4 v2:172.21.15.191:6800/90852 3 ==== osd_op_reply(25 [pgnls start_epoch 74 out=49b] v72'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2aa400 2023-10-06T02:28:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.790+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:26 12.3a 12:5c000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3be800 con 0x5621fd2adc00 2023-10-06T02:28:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.790+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.3 v2:172.21.15.37:6817/90628 6 ==== osd_op_reply(26 [pgnls start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2adc00 2023-10-06T02:28:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.790+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:27 12.6 12:60000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a7c00 con 0x5621fd3a6400 2023-10-06T02:28:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.790+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.1 v2:172.21.15.37:6808/90617 2 ==== osd_op_reply(27 [pgnls start_epoch 74 out=49b] v72'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd3a6400 2023-10-06T02:28:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.790+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:28 12.26 12:64000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3bec00 con 0x5621fd2ad000 2023-10-06T02:28:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.790+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.5 v2:172.21.15.191:6808/90853 4 ==== osd_op_reply(28 [pgnls start_epoch 74 out=49b] v72'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd2ad000 2023-10-06T02:28:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.790+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:29 12.16 12:68000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a6000 con 0x5621fd2ad800 2023-10-06T02:28:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.791+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.6 v2:172.21.15.191:6824/90897 2 ==== osd_op_reply(29 [pgnls start_epoch 74 out=49b] v72'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2ad800 2023-10-06T02:28:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.791+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:30 12.36 12:6c000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3bf000 con 0x5621fd2ad000 2023-10-06T02:28:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.791+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.5 v2:172.21.15.191:6808/90853 5 ==== osd_op_reply(30 [pgnls start_epoch 74 out=81b] v72'33 uv17 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd2ad000 2023-10-06T02:28:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.791+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:31 12.36 12:6fe38dc2:::100000001f7.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2ab800 con 0x5621fd2ad000 2023-10-06T02:28:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.791+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.5 v2:172.21.15.191:6808/90853 6 ==== osd_op_reply(31 100000001f7.00000000 [stat out=16b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd2ad000 2023-10-06T02:28:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.791+0000 7f68c87bf740 10 datascan.operator(): handling object 1099511628279.0 2023-10-06T02:28:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.791+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:32 12.36 12:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2abc00 con 0x5621fd2ad000 2023-10-06T02:28:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.793+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.5 v2:172.21.15.191:6808/90853 7 ==== osd_op_reply(32 100000001f7.00000000 [call] v74'34 uv34 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd2ad000 2023-10-06T02:28:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.793+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:33 12.e 12:70000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3bec00 con 0x5621fd2ad400 2023-10-06T02:28:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.793+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.0 v2:172.21.15.37:6816/90621 5 ==== osd_op_reply(33 [pgnls start_epoch 74 out=49b] v72'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd2ad400 2023-10-06T02:28:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.793+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:34 12.2e 12:74000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3bfc00 con 0x5621fd3a6400 2023-10-06T02:28:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.794+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.1 v2:172.21.15.37:6808/90617 3 ==== osd_op_reply(34 [pgnls start_epoch 74 out=49b] v72'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd3a6400 2023-10-06T02:28:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.794+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:35 12.1e 12:78000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2aac00 con 0x5621fd2aa400 2023-10-06T02:28:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.794+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.4 v2:172.21.15.191:6800/90852 4 ==== osd_op_reply(35 [pgnls start_epoch 74 out=49b] v72'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2aa400 2023-10-06T02:28:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.794+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:36 12.3e 12:7c000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3c8000 con 0x5621fd2ad400 2023-10-06T02:28:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.794+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.0 v2:172.21.15.37:6816/90621 6 ==== osd_op_reply(36 [pgnls start_epoch 74 out=49b] v72'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd2ad400 2023-10-06T02:28:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.794+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:37 12.1 12:80000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2ab000 con 0x5621fd2ad800 2023-10-06T02:28:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.795+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.6 v2:172.21.15.191:6824/90897 3 ==== osd_op_reply(37 [pgnls start_epoch 74 out=49b] v72'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2ad800 2023-10-06T02:28:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.795+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:38 12.21 12:84000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3c8400 con 0x5621fd3a6400 2023-10-06T02:28:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.795+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.1 v2:172.21.15.37:6808/90617 4 ==== osd_op_reply(38 [pgnls start_epoch 74 out=49b] v72'24 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd3a6400 2023-10-06T02:28:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.795+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:39 12.11 12:88000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2ab400 con 0x5621fd2ad000 2023-10-06T02:28:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.795+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.5 v2:172.21.15.191:6808/90853 8 ==== osd_op_reply(39 [pgnls start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd2ad000 2023-10-06T02:28:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.795+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:40 12.31 12:8c000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3c8800 con 0x5621fd2ad400 2023-10-06T02:28:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.795+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.0 v2:172.21.15.37:6816/90621 7 ==== osd_op_reply(40 [pgnls start_epoch 74 out=81b] v72'15 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd2ad400 2023-10-06T02:28:32.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.796+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:41 12.31 12:8de29a03:::10000000004.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3bf000 con 0x5621fd2ad400 2023-10-06T02:28:32.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.796+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.0 v2:172.21.15.37:6816/90621 8 ==== osd_op_reply(41 10000000004.00000001 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd2ad400 2023-10-06T02:28:32.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.796+0000 7f68c87bf740 10 datascan.operator(): handling object 1099511627780.1 2023-10-06T02:28:32.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.796+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:42 12.5 12:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3be000 con 0x5621fd2ad800 2023-10-06T02:28:32.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.797+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.6 v2:172.21.15.191:6824/90897 4 ==== osd_op_reply(42 10000000004.00000000 [call] v74'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2ad800 2023-10-06T02:28:32.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.797+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:43 12.9 12:90000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3bf400 con 0x5621fd3a6c00 2023-10-06T02:28:32.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.797+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.2 v2:172.21.15.37:6800/90611 6 ==== osd_op_reply(43 [pgnls start_epoch 74 out=49b] v72'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd3a6c00 2023-10-06T02:28:32.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.797+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:44 12.29 12:94000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3c8c00 con 0x5621fd2aa400 2023-10-06T02:28:32.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.798+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.4 v2:172.21.15.191:6800/90852 5 ==== osd_op_reply(44 [pgnls start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2aa400 2023-10-06T02:28:32.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.798+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:45 12.19 12:98000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2aa800 con 0x5621fd2ad400 2023-10-06T02:28:32.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.798+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.0 v2:172.21.15.37:6816/90621 9 ==== osd_op_reply(45 [pgnls start_epoch 74 out=81b] v73'23 uv23 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd2ad400 2023-10-06T02:28:32.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.798+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:46 12.19 12:997b7129:::100000001f8.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3bf800 con 0x5621fd2ad400 2023-10-06T02:28:32.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.798+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.0 v2:172.21.15.37:6816/90621 10 ==== osd_op_reply(46 100000001f8.00000000 [stat out=16b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd2ad400 2023-10-06T02:28:32.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.798+0000 7f68c87bf740 10 datascan.operator(): handling object 1099511628280.0 2023-10-06T02:28:32.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.798+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:47 12.19 12:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a7c00 con 0x5621fd2ad400 2023-10-06T02:28:32.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.799+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.0 v2:172.21.15.37:6816/90621 11 ==== osd_op_reply(47 100000001f8.00000000 [call] v74'24 uv24 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd2ad400 2023-10-06T02:28:32.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.800+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:48 12.39 12:9c000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a7800 con 0x5621fd2ad800 2023-10-06T02:28:32.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.800+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.6 v2:172.21.15.191:6824/90897 5 ==== osd_op_reply(48 [pgnls start_epoch 74 out=49b] v72'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2ad800 2023-10-06T02:28:32.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.800+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:49 12.5 12:a0000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2acc00 con 0x5621fd2ad800 2023-10-06T02:28:32.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.800+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.6 v2:172.21.15.191:6824/90897 6 ==== osd_op_reply(49 [pgnls start_epoch 74 out=81b] v74'14 uv14 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2ad800 2023-10-06T02:28:32.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.800+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:50 12.5 12:a367a3e8:::10000000004.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a6800 con 0x5621fd2ad800 2023-10-06T02:28:32.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.800+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.6 v2:172.21.15.191:6824/90897 7 ==== osd_op_reply(50 10000000004.00000000 [stat out=16b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2ad800 2023-10-06T02:28:32.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.800+0000 7f68c87bf740 10 datascan.operator(): handling object 1099511627780.0 2023-10-06T02:28:32.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.800+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:51 12.5 12:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a7400 con 0x5621fd2ad800 2023-10-06T02:28:32.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.804+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.6 v2:172.21.15.191:6824/90897 8 ==== osd_op_reply(51 10000000004.00000000 [call] v74'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2ad800 2023-10-06T02:28:32.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.804+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:52 12.25 12:a4000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2ab800 con 0x5621fd2ac800 2023-10-06T02:28:32.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.804+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.7 v2:172.21.15.191:6813/90854 4 ==== osd_op_reply(52 [pgnls start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd2ac800 2023-10-06T02:28:32.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.804+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:53 12.15 12:a8000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3be800 con 0x5621fd2ad800 2023-10-06T02:28:32.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.804+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.6 v2:172.21.15.191:6824/90897 9 ==== osd_op_reply(53 [pgnls start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2ad800 2023-10-06T02:28:32.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.804+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:54 12.35 12:ac000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3c9000 con 0x5621fd2ad400 2023-10-06T02:28:32.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.805+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.0 v2:172.21.15.37:6816/90621 12 ==== osd_op_reply(54 [pgnls start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd2ad400 2023-10-06T02:28:32.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.805+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:55 12.d 12:b0000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3be000 con 0x5621fd2ac800 2023-10-06T02:28:32.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.805+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.7 v2:172.21.15.191:6813/90854 5 ==== osd_op_reply(55 [pgnls start_epoch 74 out=49b] v72'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd2ac800 2023-10-06T02:28:32.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.805+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:56 12.2d 12:b4000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3c9400 con 0x5621fd2adc00 2023-10-06T02:28:32.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.805+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.3 v2:172.21.15.37:6817/90628 7 ==== osd_op_reply(56 [pgnls start_epoch 74 out=49b] v72'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2adc00 2023-10-06T02:28:32.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.805+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:57 12.1d 12:b8000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3be400 con 0x5621fd2ad400 2023-10-06T02:28:32.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.806+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.0 v2:172.21.15.37:6816/90621 13 ==== osd_op_reply(57 [pgnls start_epoch 74 out=49b] v72'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd2ad400 2023-10-06T02:28:32.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.806+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:58 12.3d 12:bc000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3c9800 con 0x5621fd3a6400 2023-10-06T02:28:32.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.806+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.1 v2:172.21.15.37:6808/90617 5 ==== osd_op_reply(58 [pgnls start_epoch 74 out=49b] v72'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd3a6400 2023-10-06T02:28:32.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.806+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:59 12.3 12:c0000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3bec00 con 0x5621fd2ad400 2023-10-06T02:28:32.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.806+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.0 v2:172.21.15.37:6816/90621 14 ==== osd_op_reply(59 [pgnls start_epoch 74 out=49b] v72'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd2ad400 2023-10-06T02:28:32.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.806+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:60 12.23 12:c4000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a7c00 con 0x5621fd2ad400 2023-10-06T02:28:32.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.806+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.0 v2:172.21.15.37:6816/90621 15 ==== osd_op_reply(60 [pgnls start_epoch 74 out=49b] v72'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd2ad400 2023-10-06T02:28:32.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.806+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:61 12.13 12:c8000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a6000 con 0x5621fd3a6400 2023-10-06T02:28:32.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.807+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.1 v2:172.21.15.37:6808/90617 6 ==== osd_op_reply(61 [pgnls start_epoch 74 out=49b] v72'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd3a6400 2023-10-06T02:28:32.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.807+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:62 12.33 12:cc000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a7800 con 0x5621fd3a6c00 2023-10-06T02:28:32.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.807+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.2 v2:172.21.15.37:6800/90611 7 ==== osd_op_reply(62 [pgnls start_epoch 74 out=49b] v72'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd3a6c00 2023-10-06T02:28:32.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.807+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:63 12.b 12:d0000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a7000 con 0x5621fd2adc00 2023-10-06T02:28:32.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.807+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.3 v2:172.21.15.37:6817/90628 8 ==== osd_op_reply(63 [pgnls start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2adc00 2023-10-06T02:28:32.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.807+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:64 12.2b 12:d4000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a6800 con 0x5621fd2aa400 2023-10-06T02:28:32.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.808+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.4 v2:172.21.15.191:6800/90852 6 ==== osd_op_reply(64 [pgnls start_epoch 74 out=49b] v72'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2aa400 2023-10-06T02:28:32.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.808+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:65 12.1b 12:d8000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2aac00 con 0x5621fd2aa400 2023-10-06T02:28:32.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.808+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.4 v2:172.21.15.191:6800/90852 7 ==== osd_op_reply(65 [pgnls start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2aa400 2023-10-06T02:28:32.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.808+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:66 12.3b 12:dc000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3a7400 con 0x5621fd3a6c00 2023-10-06T02:28:32.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.808+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.2 v2:172.21.15.37:6800/90611 8 ==== osd_op_reply(66 [pgnls start_epoch 74 out=49b] v72'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd3a6c00 2023-10-06T02:28:32.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.808+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:67 12.7 12:e0000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2ab000 con 0x5621fd3a6400 2023-10-06T02:28:32.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.808+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.1 v2:172.21.15.37:6808/90617 7 ==== osd_op_reply(67 [pgnls start_epoch 74 out=49b] v72'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd3a6400 2023-10-06T02:28:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.808+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:68 12.27 12:e4000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2acc00 con 0x5621fd2ad400 2023-10-06T02:28:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.809+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.0 v2:172.21.15.37:6816/90621 16 ==== osd_op_reply(68 [pgnls start_epoch 74 out=49b] v72'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd2ad400 2023-10-06T02:28:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.809+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:69 12.17 12:e8000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3c8400 con 0x5621fd2ad800 2023-10-06T02:28:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.809+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.6 v2:172.21.15.191:6824/90897 10 ==== osd_op_reply(69 [pgnls start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2ad800 2023-10-06T02:28:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.809+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:70 12.37 12:ec000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2ab400 con 0x5621fd2aa400 2023-10-06T02:28:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.809+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.4 v2:172.21.15.191:6800/90852 8 ==== osd_op_reply(70 [pgnls start_epoch 74 out=49b] v72'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2aa400 2023-10-06T02:28:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.809+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:71 12.f 12:f0000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3c9800 con 0x5621fd2ad800 2023-10-06T02:28:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.809+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.6 v2:172.21.15.191:6824/90897 11 ==== osd_op_reply(71 [pgnls start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2ad800 2023-10-06T02:28:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.810+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:72 12.2f 12:f4000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2ab800 con 0x5621fd3a6c00 2023-10-06T02:28:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.810+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 <== osd.2 v2:172.21.15.37:6800/90611 9 ==== osd_op_reply(72 [pgnls start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9440 con 0x5621fd3a6c00 2023-10-06T02:28:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.810+0000 7f68bd224700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:73 12.1f 12:f8000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd3c9000 con 0x5621fd2ad800 2023-10-06T02:28:32.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.810+0000 7f68c122c700 1 -- 172.21.15.37:0/2965028157 <== osd.6 v2:172.21.15.191:6824/90897 12 ==== osd_op_reply(73 [pgnls start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f8fc0 con 0x5621fd2ad800 2023-10-06T02:28:32.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.810+0000 7f68bca23700 1 -- 172.21.15.37:0/2965028157 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:74 12.3f 12:fc000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5621fd2aa800 con 0x5621fd2ac800 2023-10-06T02:28:32.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c222e700 1 -- 172.21.15.37:0/2965028157 <== osd.7 v2:172.21.15.191:6813/90854 6 ==== osd_op_reply(74 [pgnls start_epoch 74 out=49b] v72'17 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fd1f9200 con 0x5621fd2ac800 2023-10-06T02:28:32.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x5621fd2ad400 msgr2=0x5621fd39e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x5621fd2ad400 0x5621fd39e580 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5621fd3a6400 msgr2=0x5621fd39f080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5621fd3a6400 0x5621fd39f080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x5621fd3a6c00 msgr2=0x5621fd39f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x5621fd3a6c00 0x5621fd39f600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x5621fd2adc00 msgr2=0x5621fd39eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x5621fd2adc00 0x5621fd39eb00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 reap_dead start 2023-10-06T02:28:32.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x5621fd2aa400 msgr2=0x5621fd1e7b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x5621fd2aa400 0x5621fd1e7b80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x5621fd2ad000 msgr2=0x5621fd3a0680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x5621fd2ad000 0x5621fd3a0680 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 reap_dead start 2023-10-06T02:28:32.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x5621fd2ad800 msgr2=0x5621fd3a0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x5621fd2ad800 0x5621fd3a0100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x5621fd2ac800 msgr2=0x5621fd39e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x5621fd2ac800 0x5621fd39e000 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x5621fd2ac400 msgr2=0x5621fd1e9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x5621fd2ac400 0x5621fd1e9700 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x5621fd209710 tx=0x5621fd297080 comp rx=0 tx=0).stop 2023-10-06T02:28:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621fc5a1800 msgr2=0x5621fd1e8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 --2- 172.21.15.37:0/2965028157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621fc5a1800 0x5621fd1e8680 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x5621fd23c6f0 tx=0x5621fd20a1e0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c1a2d700 1 -- 172.21.15.37:0/2965028157 reap_dead start 2023-10-06T02:28:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 shutdown_connections 2023-10-06T02:28:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 >> 172.21.15.37:0/2965028157 conn(0x5621fc5a1000 msgr2=0x5621fc4ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 shutdown_connections 2023-10-06T02:28:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 -- 172.21.15.37:0/2965028157 wait complete. 2023-10-06T02:28:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 -- 172.21.15.37:0/418378980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621fc5a0c00 msgr2=0x5621fd1e7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 --2- 172.21.15.37:0/418378980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621fc5a0c00 0x5621fd1e7080 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x5621fd2080f0 tx=0x5621fd1bd920 comp rx=0 tx=0).stop 2023-10-06T02:28:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 -- 172.21.15.37:0/418378980 shutdown_connections 2023-10-06T02:28:32.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 --2- 172.21.15.37:0/418378980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621fc5a0c00 0x5621fd1e7080 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 --2- 172.21.15.37:0/418378980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5621fc5a0400 0x5621fd1e6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 --2- 172.21.15.37:0/418378980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5621fc5a0800 0x5621fd1e6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 -- 172.21.15.37:0/418378980 >> 172.21.15.37:0/418378980 conn(0x5621fc5a0000 msgr2=0x5621fc4ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:32.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 -- 172.21.15.37:0/418378980 shutdown_connections 2023-10-06T02:28:32.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.811+0000 7f68c87bf740 1 -- 172.21.15.37:0/418378980 wait complete. 2023-10-06T02:28:32.823 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.125454, result: 2023-10-06T02:28:32.823 DEBUG:teuthology.orchestra.run.smithi037:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --filter-tag mytag123 cephfs_data 2023-10-06T02:28:32.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.894+0000 7fbed3e57740 1 -- start start 2023-10-06T02:28:32.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.894+0000 7fbed3e57740 1 Processor -- start 2023-10-06T02:28:32.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.895+0000 7fbed3e57740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561d47dd0400 0x561d48a12580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.895+0000 7fbed3e57740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d47dd0800 0x561d48a12b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.895+0000 7fbed3e57740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561d47dd0c00 0x561d48a13080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.895+0000 7fbed3e57740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d47c9bcc0 con 0x561d47dd0800 2023-10-06T02:28:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.895+0000 7fbed3e57740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d47c9be00 con 0x561d47dd0c00 2023-10-06T02:28:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.895+0000 7fbed3e57740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d47c9b540 con 0x561d47dd0400 2023-10-06T02:28:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.895+0000 7fbecc8c4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d47dd0800 0x561d48a12b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.895+0000 7fbecc8c4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d47dd0800 0x561d48a12b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33034/0 (socket says 172.21.15.37:33034) 2023-10-06T02:28:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.895+0000 7fbecc8c4700 1 -- 172.21.15.37:0/3561865644 learned_addr learned my addr 172.21.15.37:0/3561865644 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.895+0000 7fbecd0c5700 1 --2- 172.21.15.37:0/3561865644 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561d47dd0400 0x561d48a12580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.895+0000 7fbecd8c6700 1 --2- 172.21.15.37:0/3561865644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561d47dd0c00 0x561d48a13080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.895+0000 7fbecc8c4700 1 -- 172.21.15.37:0/3561865644 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561d47dd0400 msgr2=0x561d48a12580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.895+0000 7fbecc8c4700 1 --2- 172.21.15.37:0/3561865644 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561d47dd0400 0x561d48a12580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.895+0000 7fbecc8c4700 1 -- 172.21.15.37:0/3561865644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561d47dd0c00 msgr2=0x561d48a13080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.895+0000 7fbecc8c4700 1 --2- 172.21.15.37:0/3561865644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561d47dd0c00 0x561d48a13080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.895+0000 7fbecc8c4700 1 -- 172.21.15.37:0/3561865644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d47c7eb60 con 0x561d47dd0800 2023-10-06T02:28:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.895+0000 7fbecd0c5700 1 --2- 172.21.15.37:0/3561865644 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561d47dd0400 0x561d48a12580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.896+0000 7fbecc8c4700 1 --2- 172.21.15.37:0/3561865644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d47dd0800 0x561d48a12b00 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x561d48a3c6f0 tx=0x561d48a48120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c83e0143a01cb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.896+0000 7fbeca8c0700 1 -- 172.21.15.37:0/3561865644 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561d47c93600 con 0x561d47dd0800 2023-10-06T02:28:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.896+0000 7fbeca8c0700 1 -- 172.21.15.37:0/3561865644 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561d47cb0600 con 0x561d47dd0800 2023-10-06T02:28:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.896+0000 7fbeca8c0700 1 -- 172.21.15.37:0/3561865644 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561d47c931e0 con 0x561d47dd0800 2023-10-06T02:28:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.896+0000 7fbed3e57740 1 -- 172.21.15.37:0/3561865644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561d47c7e000 con 0x561d47dd0800 2023-10-06T02:28:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.896+0000 7fbed3e57740 1 -- 172.21.15.37:0/3561865644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x561d47c7eea0 con 0x561d47dd0800 2023-10-06T02:28:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.896+0000 7fbed3e57740 4 waiting for MDS map... 2023-10-06T02:28:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.896+0000 7fbeca8c0700 1 -- 172.21.15.37:0/3561865644 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x561d47c9ec40 con 0x561d47dd0800 2023-10-06T02:28:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.896+0000 7fbeca8c0700 1 -- 172.21.15.37:0/3561865644 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 54) v1 ==== 2559+0+0 (secure 0 0 0) 0x561d48a60600 con 0x561d47dd0800 2023-10-06T02:28:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.896+0000 7fbed3e57740 4 Got MDS map 54 2023-10-06T02:28:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.896+0000 7fbed3e57740 10 datascan.parse_kwarg: Applying tag filter: 'mytag123' 2023-10-06T02:28:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.896+0000 7fbed3e57740 4 datascan.main: Using metadata pool output 2023-10-06T02:28:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.896+0000 7fbed3e57740 4 datascan.main: connecting to RADOS... 2023-10-06T02:28:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.897+0000 7fbed3e57740 1 Processor -- start 2023-10-06T02:28:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.897+0000 7fbed3e57740 1 -- start start 2023-10-06T02:28:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.897+0000 7fbed3e57740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561d47dd1c00 0x561d48a13600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.897+0000 7fbed3e57740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561d48ac6000 0x561d48a13b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.897+0000 7fbed3e57740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d48ac6400 0x561d48a14100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.897+0000 7fbed3e57740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d47c9bb80 con 0x561d48ac6400 2023-10-06T02:28:32.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.897+0000 7fbed3e57740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d47c9be00 con 0x561d47dd1c00 2023-10-06T02:28:32.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.897+0000 7fbed3e57740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d47c9adc0 con 0x561d48ac6000 2023-10-06T02:28:32.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.897+0000 7fbecc8c4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d48ac6400 0x561d48a14100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.897+0000 7fbecc8c4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d48ac6400 0x561d48a14100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33042/0 (socket says 172.21.15.37:33042) 2023-10-06T02:28:32.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.897+0000 7fbecc8c4700 1 -- 172.21.15.37:0/2755701605 learned_addr learned my addr 172.21.15.37:0/2755701605 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:32.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.897+0000 7fbecd8c6700 1 --2- 172.21.15.37:0/2755701605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561d47dd1c00 0x561d48a13600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.897+0000 7fbecd0c5700 1 --2- 172.21.15.37:0/2755701605 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561d48ac6000 0x561d48a13b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.898+0000 7fbecc8c4700 1 -- 172.21.15.37:0/2755701605 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561d48ac6000 msgr2=0x561d48a13b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.898+0000 7fbecc8c4700 1 --2- 172.21.15.37:0/2755701605 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561d48ac6000 0x561d48a13b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.898+0000 7fbecc8c4700 1 -- 172.21.15.37:0/2755701605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561d47dd1c00 msgr2=0x561d48a13600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:32.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.898+0000 7fbecc8c4700 1 --2- 172.21.15.37:0/2755701605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561d47dd1c00 0x561d48a13600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.898+0000 7fbecc8c4700 1 -- 172.21.15.37:0/2755701605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d47c7eb60 con 0x561d48ac6400 2023-10-06T02:28:32.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.898+0000 7fbecd8c6700 1 --2- 172.21.15.37:0/2755701605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561d47dd1c00 0x561d48a13600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:32.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.898+0000 7fbecc8c4700 1 --2- 172.21.15.37:0/2755701605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d48ac6400 0x561d48a14100 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x561d48a3cfc0 tx=0x561d48a48060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2cd578aa329e1b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.898+0000 7fbec88bc700 1 -- 172.21.15.37:0/2755701605 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561d47c92f20 con 0x561d48ac6400 2023-10-06T02:28:32.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.898+0000 7fbec88bc700 1 -- 172.21.15.37:0/2755701605 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561d47cb0c00 con 0x561d48ac6400 2023-10-06T02:28:32.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.898+0000 7fbec88bc700 1 -- 172.21.15.37:0/2755701605 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561d47c93600 con 0x561d48ac6400 2023-10-06T02:28:32.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.898+0000 7fbed3e57740 1 -- 172.21.15.37:0/2755701605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d48ac6400 msgr2=0x561d48a14100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.898+0000 7fbed3e57740 1 --2- 172.21.15.37:0/2755701605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d48ac6400 0x561d48a14100 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x561d48a3cfc0 tx=0x561d48a48060 comp rx=0 tx=0).stop 2023-10-06T02:28:32.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.898+0000 7fbed3e57740 1 -- 172.21.15.37:0/2755701605 shutdown_connections 2023-10-06T02:28:32.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.898+0000 7fbed3e57740 1 --2- 172.21.15.37:0/2755701605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d48ac6400 0x561d48a14100 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.898+0000 7fbed3e57740 1 --2- 172.21.15.37:0/2755701605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561d47dd1c00 0x561d48a13600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.898+0000 7fbed3e57740 1 --2- 172.21.15.37:0/2755701605 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561d48ac6000 0x561d48a13b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.898+0000 7fbed3e57740 1 -- 172.21.15.37:0/2755701605 >> 172.21.15.37:0/2755701605 conn(0x561d47dd1000 msgr2=0x561d47d3b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:32.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.898+0000 7fbed3e57740 1 -- 172.21.15.37:0/2755701605 shutdown_connections 2023-10-06T02:28:32.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.898+0000 7fbed3e57740 1 -- 172.21.15.37:0/2755701605 wait complete. 2023-10-06T02:28:32.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.899+0000 7fbed3e57740 1 Processor -- start 2023-10-06T02:28:32.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.899+0000 7fbed3e57740 1 -- start start 2023-10-06T02:28:32.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbed3e57740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d47dd1000 0x561d48a14c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbed3e57740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561d48ada000 0x561d48a14680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbed3e57740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561d48ada400 0x561d48a14100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbed3e57740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d47c9a3c0 con 0x561d47dd1000 2023-10-06T02:28:32.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbed3e57740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d47c9a000 con 0x561d48ada000 2023-10-06T02:28:32.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbed3e57740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d47c9b180 con 0x561d48ada400 2023-10-06T02:28:32.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbecd8c6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d47dd1000 0x561d48a14c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbecd8c6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d47dd1000 0x561d48a14c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33046/0 (socket says 172.21.15.37:33046) 2023-10-06T02:28:32.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 learned_addr learned my addr 172.21.15.37:0/1209767671 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:32.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbecd0c5700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561d48ada000 0x561d48a14680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbecc8c4700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561d48ada400 0x561d48a14100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561d48ada400 msgr2=0x561d48a14100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbecd8c6700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561d48ada400 0x561d48a14100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561d48ada000 msgr2=0x561d48a14680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbecd8c6700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561d48ada000 0x561d48a14680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d47c7f860 con 0x561d47dd1000 2023-10-06T02:28:32.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbecd8c6700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d47dd1000 0x561d48a14c00 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x561d48a746c0 tx=0x561d48ae2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbec70b9700 1 -- 172.21.15.37:0/1209767671 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561d47c92f20 con 0x561d47dd1000 2023-10-06T02:28:32.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbec70b9700 1 -- 172.21.15.37:0/1209767671 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561d48a72300 con 0x561d47dd1000 2023-10-06T02:28:32.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561d47c7e000 con 0x561d47dd1000 2023-10-06T02:28:32.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbec70b9700 1 -- 172.21.15.37:0/1209767671 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561d47c93600 con 0x561d47dd1000 2023-10-06T02:28:32.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561d47c7eea0 con 0x561d47dd1000 2023-10-06T02:28:32.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.900+0000 7fbed3e57740 4 datascan.init: resolving metadata pool 11 2023-10-06T02:28:32.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.902+0000 7fbec70b9700 1 -- 172.21.15.37:0/1209767671 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x561d489d1080 con 0x561d47dd1000 2023-10-06T02:28:32.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.902+0000 7fbec70b9700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x561d48adc400 0x561d48a15700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.902+0000 7fbec70b9700 1 -- 172.21.15.37:0/1209767671 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x561d47c9ea80 con 0x561d47dd1000 2023-10-06T02:28:32.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.902+0000 7fbed3e57740 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-10-06T02:28:32.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.902+0000 7fbed3e57740 4 datascan.main: data pool 'cephfs_data' has ID 12 2023-10-06T02:28:32.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.902+0000 7fbed3e57740 4 datascan.main: opening data pool 'cephfs_data' 2023-10-06T02:28:32.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.902+0000 7fbed3e57740 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x561d48ada800 0x561d48a13b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.902+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:1 11.14 11:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48adac00 con 0x561d48ada800 2023-10-06T02:28:32.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.902+0000 7fbecd0c5700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x561d48adc400 0x561d48a15700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.902+0000 7fbecc8c4700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x561d48ada800 0x561d48a13b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.903+0000 7fbecd0c5700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x561d48adc400 0x561d48a15700 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x561d489d4900 tx=0x561d489eda40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.903+0000 7fbecc8c4700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x561d48ada800 0x561d48a13b80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.903+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.6 v2:172.21.15.191:6824/90897 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv36 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48ada800 2023-10-06T02:28:32.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.903+0000 7fbed3e57740 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x561d48adb000 0x561d48a13600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.903+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:2 11.1f 11:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48adb400 con 0x561d48adb000 2023-10-06T02:28:32.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.903+0000 7fbecd8c6700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x561d48adb000 0x561d48a13600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.903+0000 7fbecd8c6700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x561d48adb000 0x561d48a13600 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.903+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.2 v2:172.21.15.37:6800/90611 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x561d48a2f200 con 0x561d48adb000 2023-10-06T02:28:32.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.904+0000 7fbed3e57740 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x561d48adb800 0x561d48bda000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.904+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:3 12.0 12:00000000::::head [pgnls-filter start_epoch 74 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48adbc00 con 0x561d48adb800 2023-10-06T02:28:32.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.904+0000 7fbecd0c5700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x561d48adb800 0x561d48bda000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.904+0000 7fbecd0c5700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x561d48adb800 0x561d48bda000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.904+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 <== osd.4 v2:172.21.15.191:6800/90852 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f440 con 0x561d48adb800 2023-10-06T02:28:32.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.904+0000 7fbec80bb700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x561d48adc800 0x561d48bdc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.904+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:4 12.20 12:04000000::::head [pgnls-filter start_epoch 74 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48adcc00 con 0x561d48adc800 2023-10-06T02:28:32.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.905+0000 7fbecc8c4700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x561d48adc800 0x561d48bdc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.905+0000 7fbecc8c4700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x561d48adc800 0x561d48bdc680 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.905+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.7 v2:172.21.15.191:6813/90854 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48adc800 2023-10-06T02:28:32.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.905+0000 7fbec88bc700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x561d48add400 0x561d48bdcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.905+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:5 12.10 12:08000000::::head [pgnls-filter start_epoch 74 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48add800 con 0x561d48add400 2023-10-06T02:28:32.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.905+0000 7fbecd8c6700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x561d48add400 0x561d48bdcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.906+0000 7fbecd8c6700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x561d48add400 0x561d48bdcc00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.906+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.0 v2:172.21.15.37:6816/90621 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48add400 2023-10-06T02:28:32.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.906+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:6 12.30 12:0c000000::::head [pgnls-filter start_epoch 74 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48add000 con 0x561d48adc800 2023-10-06T02:28:32.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.906+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.7 v2:172.21.15.191:6813/90854 2 ==== osd_op_reply(6 [pgnls-filter start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48adc800 2023-10-06T02:28:32.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.906+0000 7fbec88bc700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x561d48addc00 0x561d48bdd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.906+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:7 12.8 12:10000000::::head [pgnls-filter start_epoch 74 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48adcc00 con 0x561d48addc00 2023-10-06T02:28:32.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.906+0000 7fbecd0c5700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x561d48addc00 0x561d48bdd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.907+0000 7fbecd0c5700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x561d48addc00 0x561d48bdd180 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.907+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 <== osd.3 v2:172.21.15.37:6817/90628 1 ==== osd_op_reply(7 [pgnls-filter start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f440 con 0x561d48addc00 2023-10-06T02:28:32.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.907+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:8 12.28 12:14000000::::head [pgnls-filter start_epoch 74 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bea000 con 0x561d48add400 2023-10-06T02:28:32.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.907+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.0 v2:172.21.15.37:6816/90621 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48add400 2023-10-06T02:28:32.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.907+0000 7fbec88bc700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x561d48add000 0x561d48bdd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.907+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:9 12.18 12:18000000::::head [pgnls-filter start_epoch 74 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48adac00 con 0x561d48add000 2023-10-06T02:28:32.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.907+0000 7fbecc8c4700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x561d48add000 0x561d48bdd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.907+0000 7fbecc8c4700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x561d48add000 0x561d48bdd700 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.908+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.1 v2:172.21.15.37:6808/90617 1 ==== osd_op_reply(9 [pgnls-filter start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48add000 2023-10-06T02:28:32.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.908+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:10 12.38 12:1c000000::::head [pgnls-filter start_epoch 74 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bea400 con 0x561d48adb000 2023-10-06T02:28:32.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.908+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.2 v2:172.21.15.37:6800/90611 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48adb000 2023-10-06T02:28:32.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.908+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:11 12.4 12:20000000::::head [pgnls-filter start_epoch 74 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bea000 con 0x561d48ada800 2023-10-06T02:28:32.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.908+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.6 v2:172.21.15.191:6824/90897 2 ==== osd_op_reply(11 [pgnls-filter start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48ada800 2023-10-06T02:28:32.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.908+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:12 12.24 12:24000000::::head [pgnls-filter start_epoch 74 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bea800 con 0x561d48adb000 2023-10-06T02:28:32.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.909+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.2 v2:172.21.15.37:6800/90611 3 ==== osd_op_reply(12 [pgnls-filter start_epoch 74 out=49b] v72'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48adb000 2023-10-06T02:28:32.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.909+0000 7fbec88bc700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x561d48beac00 0x561d48bf0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:32.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.909+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:13 12.14 12:28000000::::head [pgnls-filter start_epoch 74 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48add800 con 0x561d48beac00 2023-10-06T02:28:32.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.909+0000 7fbecd8c6700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x561d48beac00 0x561d48bf0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:32.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.909+0000 7fbecd8c6700 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x561d48beac00 0x561d48bf0000 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:32.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.910+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.5 v2:172.21.15.191:6808/90853 1 ==== osd_op_reply(13 [pgnls-filter start_epoch 74 out=49b] v72'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48beac00 2023-10-06T02:28:32.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.910+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:14 12.34 12:2c000000::::head [pgnls-filter start_epoch 74 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48beb000 con 0x561d48beac00 2023-10-06T02:28:32.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.910+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.5 v2:172.21.15.191:6808/90853 2 ==== osd_op_reply(14 [pgnls-filter start_epoch 74 out=49b] v72'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48beac00 2023-10-06T02:28:32.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.910+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:15 12.c 12:30000000::::head [pgnls-filter start_epoch 74 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48adb400 con 0x561d48add400 2023-10-06T02:28:32.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.910+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.0 v2:172.21.15.37:6816/90621 3 ==== osd_op_reply(15 [pgnls-filter start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48add400 2023-10-06T02:28:32.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.910+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:16 12.2c 12:34000000::::head [pgnls-filter start_epoch 74 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48beb400 con 0x561d48adb000 2023-10-06T02:28:32.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.910+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.2 v2:172.21.15.37:6800/90611 4 ==== osd_op_reply(16 [pgnls-filter start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48adb000 2023-10-06T02:28:32.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.910+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:17 12.1c 12:38000000::::head [pgnls-filter start_epoch 74 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bea400 con 0x561d48add400 2023-10-06T02:28:32.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.911+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.0 v2:172.21.15.37:6816/90621 4 ==== osd_op_reply(17 [pgnls-filter start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48add400 2023-10-06T02:28:32.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.911+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:18 12.3c 12:3c000000::::head [pgnls-filter start_epoch 74 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48beb800 con 0x561d48beac00 2023-10-06T02:28:32.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.911+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.5 v2:172.21.15.191:6808/90853 3 ==== osd_op_reply(18 [pgnls-filter start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48beac00 2023-10-06T02:28:32.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.911+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:19 12.2 12:40000000::::head [pgnls-filter start_epoch 74 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bea800 con 0x561d48adb800 2023-10-06T02:28:32.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.911+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 <== osd.4 v2:172.21.15.191:6800/90852 2 ==== osd_op_reply(19 [pgnls-filter start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f440 con 0x561d48adb800 2023-10-06T02:28:32.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.911+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:20 12.22 12:44000000::::head [pgnls-filter start_epoch 74 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bebc00 con 0x561d48adc800 2023-10-06T02:28:32.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.911+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.7 v2:172.21.15.191:6813/90854 3 ==== osd_op_reply(20 [pgnls-filter start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48adc800 2023-10-06T02:28:32.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.912+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:21 12.12 12:48000000::::head [pgnls-filter start_epoch 74 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48beb000 con 0x561d48addc00 2023-10-06T02:28:32.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.912+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 <== osd.3 v2:172.21.15.37:6817/90628 2 ==== osd_op_reply(21 [pgnls-filter start_epoch 74 out=81b] v74'23 uv23 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x561d48a2f440 con 0x561d48addc00 2023-10-06T02:28:32.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.912+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:22 12.0 12:00000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bea800 con 0x561d48adb800 2023-10-06T02:28:32.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.912+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 <== osd.4 v2:172.21.15.191:6800/90852 3 ==== osd_op_reply(22 [pgnls-filter start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f440 con 0x561d48adb800 2023-10-06T02:28:32.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.912+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:23 12.20 12:04000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48add800 con 0x561d48adc800 2023-10-06T02:28:32.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.913+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.7 v2:172.21.15.191:6813/90854 4 ==== osd_op_reply(23 [pgnls-filter start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48adc800 2023-10-06T02:28:32.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.913+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:24 12.10 12:08000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48add800 con 0x561d48add400 2023-10-06T02:28:32.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.913+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.0 v2:172.21.15.37:6816/90621 5 ==== osd_op_reply(24 [pgnls-filter start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48add400 2023-10-06T02:28:32.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.913+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:25 12.30 12:0c000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48add800 con 0x561d48adc800 2023-10-06T02:28:32.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.913+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.7 v2:172.21.15.191:6813/90854 5 ==== osd_op_reply(25 [pgnls-filter start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48adc800 2023-10-06T02:28:32.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.913+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:26 12.8 12:10000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bea000 con 0x561d48addc00 2023-10-06T02:28:32.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.913+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 <== osd.3 v2:172.21.15.37:6817/90628 3 ==== osd_op_reply(26 [pgnls-filter start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f440 con 0x561d48addc00 2023-10-06T02:28:32.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.913+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:27 12.28 12:14000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48beb400 con 0x561d48add400 2023-10-06T02:28:32.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.914+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.0 v2:172.21.15.37:6816/90621 6 ==== osd_op_reply(27 [pgnls-filter start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48add400 2023-10-06T02:28:32.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.914+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:28 12.18 12:18000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bebc00 con 0x561d48add000 2023-10-06T02:28:32.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.914+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.1 v2:172.21.15.37:6808/90617 2 ==== osd_op_reply(28 [pgnls-filter start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48add000 2023-10-06T02:28:32.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.914+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:29 12.38 12:1c000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bea400 con 0x561d48adb000 2023-10-06T02:28:32.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.914+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.2 v2:172.21.15.37:6800/90611 5 ==== osd_op_reply(29 [pgnls-filter start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48adb000 2023-10-06T02:28:32.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.914+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:30 12.4 12:20000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48adac00 con 0x561d48ada800 2023-10-06T02:28:32.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.914+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.6 v2:172.21.15.191:6824/90897 3 ==== osd_op_reply(30 [pgnls-filter start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48ada800 2023-10-06T02:28:32.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.914+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:31 12.24 12:24000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48beb800 con 0x561d48adb000 2023-10-06T02:28:32.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.915+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.2 v2:172.21.15.37:6800/90611 6 ==== osd_op_reply(31 [pgnls-filter start_epoch 74 out=49b] v72'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48adb000 2023-10-06T02:28:32.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.915+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:32 12.14 12:28000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bfe000 con 0x561d48beac00 2023-10-06T02:28:32.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.915+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.5 v2:172.21.15.191:6808/90853 4 ==== osd_op_reply(32 [pgnls-filter start_epoch 74 out=49b] v72'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48beac00 2023-10-06T02:28:32.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.915+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:33 12.34 12:2c000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48adb400 con 0x561d48beac00 2023-10-06T02:28:32.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.915+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.5 v2:172.21.15.191:6808/90853 5 ==== osd_op_reply(33 [pgnls-filter start_epoch 74 out=49b] v72'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48beac00 2023-10-06T02:28:32.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.915+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:34 12.c 12:30000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bfe400 con 0x561d48add400 2023-10-06T02:28:32.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.915+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.0 v2:172.21.15.37:6816/90621 7 ==== osd_op_reply(34 [pgnls-filter start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48add400 2023-10-06T02:28:32.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.916+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:35 12.2c 12:34000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bfe000 con 0x561d48adb000 2023-10-06T02:28:32.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.916+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.2 v2:172.21.15.37:6800/90611 7 ==== osd_op_reply(35 [pgnls-filter start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48adb000 2023-10-06T02:28:32.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.916+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:36 12.1c 12:38000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bfe800 con 0x561d48add400 2023-10-06T02:28:32.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.916+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.0 v2:172.21.15.37:6816/90621 8 ==== osd_op_reply(36 [pgnls-filter start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48add400 2023-10-06T02:28:32.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.916+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:37 12.3c 12:3c000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bfe400 con 0x561d48beac00 2023-10-06T02:28:32.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.916+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.5 v2:172.21.15.191:6808/90853 6 ==== osd_op_reply(37 [pgnls-filter start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48beac00 2023-10-06T02:28:32.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.916+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:38 12.2 12:40000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bfec00 con 0x561d48adb800 2023-10-06T02:28:32.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.917+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 <== osd.4 v2:172.21.15.191:6800/90852 4 ==== osd_op_reply(38 [pgnls-filter start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f440 con 0x561d48adb800 2023-10-06T02:28:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.917+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:39 12.22 12:44000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bff800 con 0x561d48adc800 2023-10-06T02:28:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.917+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.7 v2:172.21.15.191:6813/90854 6 ==== osd_op_reply(39 [pgnls-filter start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48adc800 2023-10-06T02:28:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.917+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:40 12.12 12:48000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bff000 con 0x561d48addc00 2023-10-06T02:28:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.917+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 <== osd.3 v2:172.21.15.37:6817/90628 4 ==== osd_op_reply(40 [pgnls-filter start_epoch 74 out=49b] v74'23 uv23 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f440 con 0x561d48addc00 2023-10-06T02:28:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.917+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:41 12.32 12:4c000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48adb400 con 0x561d48addc00 2023-10-06T02:28:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.917+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 <== osd.3 v2:172.21.15.37:6817/90628 5 ==== osd_op_reply(41 [pgnls-filter start_epoch 74 out=49b] v72'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f440 con 0x561d48addc00 2023-10-06T02:28:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.917+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:42 12.a 12:50000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bff400 con 0x561d48adb000 2023-10-06T02:28:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.918+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.2 v2:172.21.15.37:6800/90611 8 ==== osd_op_reply(42 [pgnls-filter start_epoch 74 out=49b] v72'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48adb000 2023-10-06T02:28:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.918+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:43 12.2a 12:54000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48beb400 con 0x561d48adb000 2023-10-06T02:28:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.918+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.2 v2:172.21.15.37:6800/90611 9 ==== osd_op_reply(43 [pgnls-filter start_epoch 74 out=49b] v72'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48adb000 2023-10-06T02:28:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.918+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:44 12.1a 12:58000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bfec00 con 0x561d48adb800 2023-10-06T02:28:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.918+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 <== osd.4 v2:172.21.15.191:6800/90852 5 ==== osd_op_reply(44 [pgnls-filter start_epoch 74 out=49b] v72'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f440 con 0x561d48adb800 2023-10-06T02:28:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.918+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:45 12.3a 12:5c000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bea400 con 0x561d48addc00 2023-10-06T02:28:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.919+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 <== osd.3 v2:172.21.15.37:6817/90628 6 ==== osd_op_reply(45 [pgnls-filter start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f440 con 0x561d48addc00 2023-10-06T02:28:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.919+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:46 12.6 12:60000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bffc00 con 0x561d48add000 2023-10-06T02:28:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.919+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.1 v2:172.21.15.37:6808/90617 3 ==== osd_op_reply(46 [pgnls-filter start_epoch 74 out=49b] v72'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48add000 2023-10-06T02:28:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.919+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:47 12.26 12:64000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48beb800 con 0x561d48beac00 2023-10-06T02:28:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.919+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.5 v2:172.21.15.191:6808/90853 7 ==== osd_op_reply(47 [pgnls-filter start_epoch 74 out=49b] v72'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48beac00 2023-10-06T02:28:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.919+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:48 12.16 12:68000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48beb000 con 0x561d48ada800 2023-10-06T02:28:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.920+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.6 v2:172.21.15.191:6824/90897 4 ==== osd_op_reply(48 [pgnls-filter start_epoch 74 out=49b] v72'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48ada800 2023-10-06T02:28:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.920+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:49 12.36 12:6c000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bff800 con 0x561d48beac00 2023-10-06T02:28:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.920+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.5 v2:172.21.15.191:6808/90853 8 ==== osd_op_reply(49 [pgnls-filter start_epoch 74 out=81b] v74'34 uv34 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x561d48a2f200 con 0x561d48beac00 2023-10-06T02:28:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.920+0000 7fbed3e57740 20 datascan.forall_objects: OSD matched oid 100000001f7.00000000 2023-10-06T02:28:32.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.920+0000 7fbed3e57740 10 datascan.operator(): handling object 100000001f7.0 2023-10-06T02:28:32.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.920+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:50 12.36 12:6fe38dc2:::100000001f7.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48adcc00 con 0x561d48beac00 2023-10-06T02:28:32.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.920+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.5 v2:172.21.15.191:6808/90853 9 ==== osd_op_reply(50 100000001f7.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (126) out=126b,getxattr (30) out=30b,getxattr] v0'0 uv34 ondisk = 0) v8 ==== 416+0+194 (crc 0 0 0) 0x561d48a2f200 con 0x561d48beac00 2023-10-06T02:28:32.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.920+0000 7fbed3e57740 10 datascan.inject_with_backtrace: inode: 0x0x100000001f7 2023-10-06T02:28:32.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.920+0000 7fbed3e57740 10 datascan.inject_with_backtrace: backptr: 0x0x10000000001/bravo 2023-10-06T02:28:32.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.920+0000 7fbed3e57740 20 datascan.get_frag_of: dirino=0x10000000001 target_dname=bravo 2023-10-06T02:28:32.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.920+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:51 11.7 11:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48adbc00 con 0x561d48beac00 2023-10-06T02:28:32.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.921+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.5 v2:172.21.15.191:6808/90853 10 ==== osd_op_reply(51 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x561d48a2f200 con 0x561d48beac00 2023-10-06T02:28:32.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.921+0000 7fbed3e57740 20 datascan.get_frag_of: got backtrace parent 0x10000000000/flushed 2023-10-06T02:28:32.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.921+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:52 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bfe000 con 0x561d48add400 2023-10-06T02:28:32.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.921+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.0 v2:172.21.15.37:6816/90621 9 ==== osd_op_reply(52 10000000000.00000000 [omap-get-vals-by-keys out=512b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+512 (crc 0 0 0) 0x561d48a2f200 con 0x561d48add400 2023-10-06T02:28:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.921+0000 7fbed3e57740 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed frag=*, r=0 2023-10-06T02:28:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.921+0000 7fbed3e57740 20 datascan.get_frag_of: fast path, fragtree is fragtree_t() 2023-10-06T02:28:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.921+0000 7fbed3e57740 20 datascan.get_frag_of: frag is * 2023-10-06T02:28:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.921+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:53 11.7 11:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bfe800 con 0x561d48beac00 2023-10-06T02:28:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.921+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.5 v2:172.21.15.191:6808/90853 11 ==== osd_op_reply(53 10000000001.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x561d48a2f200 con 0x561d48beac00 2023-10-06T02:28:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.921+0000 7fbed3e57740 10 datascan.find_or_create_dirfrag: read_version = 7 2023-10-06T02:28:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.921+0000 7fbed3e57740 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000001 * 2023-10-06T02:28:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.921+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:54 11.7 11:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bfe400 con 0x561d48beac00 2023-10-06T02:28:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.922+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.5 v2:172.21.15.191:6808/90853 12 ==== osd_op_reply(54 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x561d48a2f200 con 0x561d48beac00 2023-10-06T02:28:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.922+0000 7fbed3e57740 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2023-10-06T02:28:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.922+0000 7fbed3e57740 20 datascan.read_dentry: bravo_head not found in result 2023-10-06T02:28:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.922+0000 7fbed3e57740 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f7 at 0x0x10000000001/bravo with size=5 bytes 2023-10-06T02:28:32.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.922+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:55 11.7 11:e2e07930:::10000000001.00000000:head [omap-set-vals in=494b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bff400 con 0x561d48beac00 2023-10-06T02:28:32.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.923+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.5 v2:172.21.15.191:6808/90853 13 ==== osd_op_reply(55 10000000001.00000000 [omap-set-vals] v74'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561d48a2f200 con 0x561d48beac00 2023-10-06T02:28:32.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.923+0000 7fbed3e57740 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x100000001f7 2023-10-06T02:28:32.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.923+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:56 12.e 12:70000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bff800 con 0x561d48add400 2023-10-06T02:28:32.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.923+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.0 v2:172.21.15.37:6816/90621 10 ==== osd_op_reply(56 [pgnls-filter start_epoch 74 out=49b] v72'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48add400 2023-10-06T02:28:32.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.923+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:57 12.2e 12:74000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bffc00 con 0x561d48add000 2023-10-06T02:28:32.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.923+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.1 v2:172.21.15.37:6808/90617 4 ==== osd_op_reply(57 [pgnls-filter start_epoch 74 out=49b] v72'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48add000 2023-10-06T02:28:32.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.923+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:58 12.1e 12:78000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bea800 con 0x561d48adb800 2023-10-06T02:28:32.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.924+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 <== osd.4 v2:172.21.15.191:6800/90852 6 ==== osd_op_reply(58 [pgnls-filter start_epoch 74 out=49b] v72'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f440 con 0x561d48adb800 2023-10-06T02:28:32.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.924+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:59 12.3e 12:7c000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48adac00 con 0x561d48add400 2023-10-06T02:28:32.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.924+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.0 v2:172.21.15.37:6816/90621 11 ==== osd_op_reply(59 [pgnls-filter start_epoch 74 out=49b] v72'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48add400 2023-10-06T02:28:32.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.924+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:60 12.1 12:80000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bea000 con 0x561d48ada800 2023-10-06T02:28:32.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.924+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.6 v2:172.21.15.191:6824/90897 5 ==== osd_op_reply(60 [pgnls-filter start_epoch 74 out=49b] v72'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48ada800 2023-10-06T02:28:32.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.924+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:61 12.21 12:84000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bebc00 con 0x561d48add000 2023-10-06T02:28:32.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.925+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.1 v2:172.21.15.37:6808/90617 5 ==== osd_op_reply(61 [pgnls-filter start_epoch 74 out=49b] v72'24 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48add000 2023-10-06T02:28:32.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.925+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:62 12.11 12:88000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bfe000 con 0x561d48beac00 2023-10-06T02:28:32.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.925+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.5 v2:172.21.15.191:6808/90853 14 ==== osd_op_reply(62 [pgnls-filter start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48beac00 2023-10-06T02:28:32.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.925+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:63 12.31 12:8c000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48add800 con 0x561d48add400 2023-10-06T02:28:32.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.925+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.0 v2:172.21.15.37:6816/90621 12 ==== osd_op_reply(63 [pgnls-filter start_epoch 74 out=49b] v72'15 uv8 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48add400 2023-10-06T02:28:32.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.925+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:64 12.9 12:90000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bfe800 con 0x561d48adb000 2023-10-06T02:28:32.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.926+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.2 v2:172.21.15.37:6800/90611 10 ==== osd_op_reply(64 [pgnls-filter start_epoch 74 out=49b] v72'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48adb000 2023-10-06T02:28:32.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.926+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:65 12.29 12:94000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bea400 con 0x561d48adb800 2023-10-06T02:28:32.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.926+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 <== osd.4 v2:172.21.15.191:6800/90852 7 ==== osd_op_reply(65 [pgnls-filter start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f440 con 0x561d48adb800 2023-10-06T02:28:32.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.926+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:66 12.19 12:98000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bfe400 con 0x561d48add400 2023-10-06T02:28:32.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.926+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.0 v2:172.21.15.37:6816/90621 13 ==== osd_op_reply(66 [pgnls-filter start_epoch 74 out=49b] v74'24 uv24 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48add400 2023-10-06T02:28:32.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.926+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:67 12.39 12:9c000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bea800 con 0x561d48ada800 2023-10-06T02:28:32.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.927+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.6 v2:172.21.15.191:6824/90897 6 ==== osd_op_reply(67 [pgnls-filter start_epoch 74 out=49b] v72'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48ada800 2023-10-06T02:28:32.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.927+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:68 12.5 12:a0000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bff400 con 0x561d48ada800 2023-10-06T02:28:32.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.927+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.6 v2:172.21.15.191:6824/90897 7 ==== osd_op_reply(68 [pgnls-filter start_epoch 74 out=49b] v74'15 uv15 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48ada800 2023-10-06T02:28:32.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.927+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:69 12.25 12:a4000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bff800 con 0x561d48adc800 2023-10-06T02:28:32.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.927+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.7 v2:172.21.15.191:6813/90854 7 ==== osd_op_reply(69 [pgnls-filter start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48adc800 2023-10-06T02:28:32.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.927+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:70 12.15 12:a8000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48adbc00 con 0x561d48ada800 2023-10-06T02:28:32.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.928+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.6 v2:172.21.15.191:6824/90897 8 ==== osd_op_reply(70 [pgnls-filter start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48ada800 2023-10-06T02:28:32.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.928+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:71 12.35 12:ac000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bff000 con 0x561d48add400 2023-10-06T02:28:32.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.928+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.0 v2:172.21.15.37:6816/90621 14 ==== osd_op_reply(71 [pgnls-filter start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48add400 2023-10-06T02:28:32.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.928+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:72 12.d 12:b0000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48adac00 con 0x561d48adc800 2023-10-06T02:28:32.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.928+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.7 v2:172.21.15.191:6813/90854 8 ==== osd_op_reply(72 [pgnls-filter start_epoch 74 out=49b] v72'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48adc800 2023-10-06T02:28:32.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.928+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:73 12.2d 12:b4000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bfec00 con 0x561d48addc00 2023-10-06T02:28:32.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.929+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 <== osd.3 v2:172.21.15.37:6817/90628 7 ==== osd_op_reply(73 [pgnls-filter start_epoch 74 out=49b] v72'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f440 con 0x561d48addc00 2023-10-06T02:28:32.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.929+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:74 12.1d 12:b8000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48adb400 con 0x561d48add400 2023-10-06T02:28:32.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.929+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.0 v2:172.21.15.37:6816/90621 15 ==== osd_op_reply(74 [pgnls-filter start_epoch 74 out=49b] v72'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48add400 2023-10-06T02:28:32.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.929+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:75 12.3d 12:bc000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bffc00 con 0x561d48add000 2023-10-06T02:28:32.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.929+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.1 v2:172.21.15.37:6808/90617 6 ==== osd_op_reply(75 [pgnls-filter start_epoch 74 out=49b] v72'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48add000 2023-10-06T02:28:32.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.929+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:76 12.3 12:c0000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48adcc00 con 0x561d48add400 2023-10-06T02:28:32.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.929+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.0 v2:172.21.15.37:6816/90621 16 ==== osd_op_reply(76 [pgnls-filter start_epoch 74 out=49b] v72'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48add400 2023-10-06T02:28:32.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.929+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:77 12.23 12:c4000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bff400 con 0x561d48add400 2023-10-06T02:28:32.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.930+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.0 v2:172.21.15.37:6816/90621 17 ==== osd_op_reply(77 [pgnls-filter start_epoch 74 out=49b] v72'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48add400 2023-10-06T02:28:32.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.930+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:78 12.13 12:c8000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48c06000 con 0x561d48add000 2023-10-06T02:28:32.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.930+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.1 v2:172.21.15.37:6808/90617 7 ==== osd_op_reply(78 [pgnls-filter start_epoch 74 out=49b] v72'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48add000 2023-10-06T02:28:32.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.930+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:79 12.33 12:cc000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48beb000 con 0x561d48adb000 2023-10-06T02:28:32.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.930+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.2 v2:172.21.15.37:6800/90611 11 ==== osd_op_reply(79 [pgnls-filter start_epoch 74 out=49b] v72'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48adb000 2023-10-06T02:28:32.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.930+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:80 12.b 12:d0000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48c06400 con 0x561d48addc00 2023-10-06T02:28:32.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.930+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 <== osd.3 v2:172.21.15.37:6817/90628 8 ==== osd_op_reply(80 [pgnls-filter start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f440 con 0x561d48addc00 2023-10-06T02:28:32.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.930+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:81 12.2b 12:d4000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bea000 con 0x561d48adb800 2023-10-06T02:28:32.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.931+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 <== osd.4 v2:172.21.15.191:6800/90852 8 ==== osd_op_reply(81 [pgnls-filter start_epoch 74 out=49b] v72'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f440 con 0x561d48adb800 2023-10-06T02:28:32.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.931+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:82 12.1b 12:d8000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48c06800 con 0x561d48adb800 2023-10-06T02:28:32.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.931+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 <== osd.4 v2:172.21.15.191:6800/90852 9 ==== osd_op_reply(82 [pgnls-filter start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f440 con 0x561d48adb800 2023-10-06T02:28:32.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.931+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:83 12.3b 12:dc000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bebc00 con 0x561d48adb000 2023-10-06T02:28:32.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.931+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.2 v2:172.21.15.37:6800/90611 12 ==== osd_op_reply(83 [pgnls-filter start_epoch 74 out=49b] v72'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48adb000 2023-10-06T02:28:32.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.931+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:84 12.7 12:e0000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48c06c00 con 0x561d48add000 2023-10-06T02:28:32.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.931+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.1 v2:172.21.15.37:6808/90617 8 ==== osd_op_reply(84 [pgnls-filter start_epoch 74 out=49b] v72'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48add000 2023-10-06T02:28:32.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.932+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:85 12.27 12:e4000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bea800 con 0x561d48add400 2023-10-06T02:28:32.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.932+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.0 v2:172.21.15.37:6816/90621 18 ==== osd_op_reply(85 [pgnls-filter start_epoch 74 out=49b] v72'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48add400 2023-10-06T02:28:32.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.932+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:86 12.17 12:e8000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48c07000 con 0x561d48ada800 2023-10-06T02:28:32.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.932+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.6 v2:172.21.15.191:6824/90897 9 ==== osd_op_reply(86 [pgnls-filter start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48ada800 2023-10-06T02:28:32.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.932+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:87 12.37 12:ec000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bff800 con 0x561d48adb800 2023-10-06T02:28:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.933+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 <== osd.4 v2:172.21.15.191:6800/90852 10 ==== osd_op_reply(87 [pgnls-filter start_epoch 74 out=49b] v72'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f440 con 0x561d48adb800 2023-10-06T02:28:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.933+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:88 12.f 12:f0000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48c07400 con 0x561d48ada800 2023-10-06T02:28:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.933+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.6 v2:172.21.15.191:6824/90897 10 ==== osd_op_reply(88 [pgnls-filter start_epoch 74 out=49b] v72'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48ada800 2023-10-06T02:28:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.933+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:89 12.2f 12:f4000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bffc00 con 0x561d48adb000 2023-10-06T02:28:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.934+0000 7fbecd8c6700 1 -- 172.21.15.37:0/1209767671 <== osd.2 v2:172.21.15.37:6800/90611 13 ==== osd_op_reply(89 [pgnls-filter start_epoch 74 out=49b] v72'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2f200 con 0x561d48adb000 2023-10-06T02:28:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.934+0000 7fbec80bb700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:90 12.1f 12:f8000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48c07800 con 0x561d48ada800 2023-10-06T02:28:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.934+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.6 v2:172.21.15.191:6824/90897 11 ==== osd_op_reply(90 [pgnls-filter start_epoch 74 out=49b] v72'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48ada800 2023-10-06T02:28:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.934+0000 7fbec88bc700 1 -- 172.21.15.37:0/1209767671 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:91 12.3f 12:fc000000::::head [pgnls-filter start_epoch 74 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x561d48bfe000 con 0x561d48adc800 2023-10-06T02:28:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.934+0000 7fbecc8c4700 1 -- 172.21.15.37:0/1209767671 <== osd.7 v2:172.21.15.191:6813/90854 9 ==== osd_op_reply(91 [pgnls-filter start_epoch 74 out=49b] v72'17 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561d48a2efc0 con 0x561d48adc800 2023-10-06T02:28:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.934+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x561d48add400 msgr2=0x561d48bdcc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.934+0000 7fbed3e57740 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x561d48add400 0x561d48bdcc00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.934+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x561d48add000 msgr2=0x561d48bdd700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.934+0000 7fbed3e57740 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x561d48add000 0x561d48bdd700 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.934+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x561d48adb000 msgr2=0x561d48a13600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.934+0000 7fbed3e57740 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x561d48adb000 0x561d48a13600 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.934+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x561d48addc00 msgr2=0x561d48bdd180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.934+0000 7fbed3e57740 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x561d48addc00 0x561d48bdd180 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.934+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 reap_dead start 2023-10-06T02:28:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.934+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x561d48adb800 msgr2=0x561d48bda000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.934+0000 7fbed3e57740 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x561d48adb800 0x561d48bda000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.934+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 reap_dead start 2023-10-06T02:28:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.934+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x561d48beac00 msgr2=0x561d48bf0000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.934+0000 7fbed3e57740 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x561d48beac00 0x561d48bf0000 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x561d48ada800 msgr2=0x561d48a13b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x561d48ada800 0x561d48a13b80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x561d48adc800 msgr2=0x561d48bdc680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x561d48adc800 0x561d48bdc680 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x561d48adc400 msgr2=0x561d48a15700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x561d48adc400 0x561d48a15700 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x561d489d4900 tx=0x561d489eda40 comp rx=0 tx=0).stop 2023-10-06T02:28:32.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d47dd1000 msgr2=0x561d48a14c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 --2- 172.21.15.37:0/1209767671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d47dd1000 0x561d48a14c00 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x561d48a746c0 tx=0x561d48ae2000 comp rx=0 tx=0).stop 2023-10-06T02:28:32.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbecd0c5700 1 -- 172.21.15.37:0/1209767671 reap_dead start 2023-10-06T02:28:32.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 shutdown_connections 2023-10-06T02:28:32.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 >> 172.21.15.37:0/1209767671 conn(0x561d47dd1c00 msgr2=0x561d47d3b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 shutdown_connections 2023-10-06T02:28:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 -- 172.21.15.37:0/1209767671 wait complete. 2023-10-06T02:28:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 -- 172.21.15.37:0/3561865644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d47dd0800 msgr2=0x561d48a12b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 --2- 172.21.15.37:0/3561865644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d47dd0800 0x561d48a12b00 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x561d48a3c6f0 tx=0x561d48a48120 comp rx=0 tx=0).stop 2023-10-06T02:28:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 -- 172.21.15.37:0/3561865644 shutdown_connections 2023-10-06T02:28:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 --2- 172.21.15.37:0/3561865644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561d47dd0c00 0x561d48a13080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 --2- 172.21.15.37:0/3561865644 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561d47dd0400 0x561d48a12580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 --2- 172.21.15.37:0/3561865644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d47dd0800 0x561d48a12b00 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 -- 172.21.15.37:0/3561865644 >> 172.21.15.37:0/3561865644 conn(0x561d47dd0000 msgr2=0x561d47d3b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 -- 172.21.15.37:0/3561865644 shutdown_connections 2023-10-06T02:28:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:32.935+0000 7fbed3e57740 1 -- 172.21.15.37:0/3561865644 wait complete. 2023-10-06T02:28:32.957 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--filter-tag', 'mytag123', 'cephfs_data'] in time 0:00:00.133309, result: 2023-10-06T02:28:32.957 DEBUG:teuthology.orchestra.run.smithi037:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2023-10-06T02:28:33.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.021+0000 7f54bfe8a740 1 -- start start 2023-10-06T02:28:33.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.021+0000 7f54bfe8a740 1 Processor -- start 2023-10-06T02:28:33.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54bfe8a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fca1e400 0x5593fd65a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54bfe8a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593fca1e800 0x5593fd65ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54bfe8a740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5593fca1ec00 0x5593fd65b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54bfe8a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fc8e9cc0 con 0x5593fca1e400 2023-10-06T02:28:33.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54bfe8a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fc8e9540 con 0x5593fca1e800 2023-10-06T02:28:33.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54bfe8a740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593fc8e9b80 con 0x5593fca1ec00 2023-10-06T02:28:33.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54b90f8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fca1e400 0x5593fd65a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54b90f8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fca1e400 0x5593fd65a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33066/0 (socket says 172.21.15.37:33066) 2023-10-06T02:28:33.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54b90f8700 1 -- 172.21.15.37:0/151872959 learned_addr learned my addr 172.21.15.37:0/151872959 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:33.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54b88f7700 1 --2- 172.21.15.37:0/151872959 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593fca1e800 0x5593fd65ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54b98f9700 1 --2- 172.21.15.37:0/151872959 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5593fca1ec00 0x5593fd65b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54b90f8700 1 -- 172.21.15.37:0/151872959 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5593fca1ec00 msgr2=0x5593fd65b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:33.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54b90f8700 1 --2- 172.21.15.37:0/151872959 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5593fca1ec00 0x5593fd65b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54b90f8700 1 -- 172.21.15.37:0/151872959 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593fca1e800 msgr2=0x5593fd65ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:33.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54b90f8700 1 --2- 172.21.15.37:0/151872959 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593fca1e800 0x5593fd65ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54b90f8700 1 -- 172.21.15.37:0/151872959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593fc8ccb60 con 0x5593fca1e400 2023-10-06T02:28:33.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54b98f9700 1 --2- 172.21.15.37:0/151872959 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5593fca1ec00 0x5593fd65b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:33.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54b88f7700 1 --2- 172.21.15.37:0/151872959 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593fca1e800 0x5593fd65ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:33.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54b90f8700 1 --2- 172.21.15.37:0/151872959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fca1e400 0x5593fd65a580 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x5593fd68a0f0 tx=0x5593fd688180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40dfb9633c8a88c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:33.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54b68f3700 1 -- 172.21.15.37:0/151872959 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5593fc8e1600 con 0x5593fca1e400 2023-10-06T02:28:33.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.022+0000 7f54b68f3700 1 -- 172.21.15.37:0/151872959 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5593fc8fe600 con 0x5593fca1e400 2023-10-06T02:28:33.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.023+0000 7f54b68f3700 1 -- 172.21.15.37:0/151872959 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5593fc8e11e0 con 0x5593fca1e400 2023-10-06T02:28:33.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.023+0000 7f54bfe8a740 1 -- 172.21.15.37:0/151872959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5593fc8cc000 con 0x5593fca1e400 2023-10-06T02:28:33.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.023+0000 7f54bfe8a740 1 -- 172.21.15.37:0/151872959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5593fc8ccea0 con 0x5593fca1e400 2023-10-06T02:28:33.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.023+0000 7f54bfe8a740 4 waiting for MDS map... 2023-10-06T02:28:33.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.023+0000 7f54b68f3700 1 -- 172.21.15.37:0/151872959 <== mon.0 v2:172.21.15.37:3300/0 4 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x5593fc8ecc40 con 0x5593fca1e400 2023-10-06T02:28:33.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.023+0000 7f54b68f3700 1 -- 172.21.15.37:0/151872959 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 54) v1 ==== 2559+0+0 (secure 0 0 0) 0x5593fd69e600 con 0x5593fca1e400 2023-10-06T02:28:33.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.023+0000 7f54bfe8a740 4 Got MDS map 54 2023-10-06T02:28:33.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.023+0000 7f54bfe8a740 4 datascan.main: Using metadata pool output 2023-10-06T02:28:33.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.023+0000 7f54bfe8a740 4 datascan.main: connecting to RADOS... 2023-10-06T02:28:33.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.023+0000 7f54bfe8a740 1 Processor -- start 2023-10-06T02:28:33.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.023+0000 7f54bfe8a740 1 -- start start 2023-10-06T02:28:33.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.024+0000 7f54bfe8a740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5593fca1f800 0x5593fd65b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.024+0000 7f54bfe8a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fca1fc00 0x5593fd65bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.024+0000 7f54bfe8a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593fd6fe000 0x5593fd65c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.024+0000 7f54bfe8a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fc8e8dc0 con 0x5593fca1fc00 2023-10-06T02:28:33.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.024+0000 7f54bfe8a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fc8e83c0 con 0x5593fd6fe000 2023-10-06T02:28:33.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.024+0000 7f54bfe8a740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593fc8e9540 con 0x5593fca1f800 2023-10-06T02:28:33.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.024+0000 7f54b90f8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fca1fc00 0x5593fd65bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.024+0000 7f54b90f8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fca1fc00 0x5593fd65bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33068/0 (socket says 172.21.15.37:33068) 2023-10-06T02:28:33.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.024+0000 7f54b90f8700 1 -- 172.21.15.37:0/1683258338 learned_addr learned my addr 172.21.15.37:0/1683258338 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:33.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.024+0000 7f54b88f7700 1 --2- 172.21.15.37:0/1683258338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593fd6fe000 0x5593fd65c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.024+0000 7f54b98f9700 1 --2- 172.21.15.37:0/1683258338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5593fca1f800 0x5593fd65b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.024+0000 7f54b90f8700 1 -- 172.21.15.37:0/1683258338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5593fca1f800 msgr2=0x5593fd65b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:33.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.024+0000 7f54b90f8700 1 --2- 172.21.15.37:0/1683258338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5593fca1f800 0x5593fd65b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.024+0000 7f54b90f8700 1 -- 172.21.15.37:0/1683258338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593fd6fe000 msgr2=0x5593fd65c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:33.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.024+0000 7f54b90f8700 1 --2- 172.21.15.37:0/1683258338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593fd6fe000 0x5593fd65c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.024+0000 7f54b90f8700 1 -- 172.21.15.37:0/1683258338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593fc8cd860 con 0x5593fca1fc00 2023-10-06T02:28:33.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.024+0000 7f54b98f9700 1 --2- 172.21.15.37:0/1683258338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5593fca1f800 0x5593fd65b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:33.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.024+0000 7f54b90f8700 1 --2- 172.21.15.37:0/1683258338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fca1fc00 0x5593fd65bb80 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x5593fd68b560 tx=0x5593fd688060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653b42d2165476c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:33.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.025+0000 7f54b48ef700 1 -- 172.21.15.37:0/1683258338 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5593fc8e0f20 con 0x5593fca1fc00 2023-10-06T02:28:33.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.025+0000 7f54b48ef700 1 -- 172.21.15.37:0/1683258338 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5593fc8fec00 con 0x5593fca1fc00 2023-10-06T02:28:33.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.025+0000 7f54b48ef700 1 -- 172.21.15.37:0/1683258338 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5593fc8e1600 con 0x5593fca1fc00 2023-10-06T02:28:33.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.025+0000 7f54bfe8a740 1 -- 172.21.15.37:0/1683258338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fca1fc00 msgr2=0x5593fd65bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.025+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/1683258338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fca1fc00 0x5593fd65bb80 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x5593fd68b560 tx=0x5593fd688060 comp rx=0 tx=0).stop 2023-10-06T02:28:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.025+0000 7f54bfe8a740 1 -- 172.21.15.37:0/1683258338 shutdown_connections 2023-10-06T02:28:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.025+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/1683258338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593fd6fe000 0x5593fd65c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.025+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/1683258338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5593fca1f800 0x5593fd65b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.025+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/1683258338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fca1fc00 0x5593fd65bb80 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.025+0000 7f54bfe8a740 1 -- 172.21.15.37:0/1683258338 >> 172.21.15.37:0/1683258338 conn(0x5593fca1f000 msgr2=0x5593fc97d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.025+0000 7f54bfe8a740 1 -- 172.21.15.37:0/1683258338 shutdown_connections 2023-10-06T02:28:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.025+0000 7f54bfe8a740 1 -- 172.21.15.37:0/1683258338 wait complete. 2023-10-06T02:28:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.026+0000 7f54bfe8a740 1 Processor -- start 2023-10-06T02:28:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.026+0000 7f54bfe8a740 1 -- start start 2023-10-06T02:28:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.026+0000 7f54bfe8a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593fca1fc00 0x5593fd65cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.026+0000 7f54bfe8a740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5593fca1f800 0x5593fd65c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.026+0000 7f54bfe8a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fd6fe000 0x5593fd65c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.026+0000 7f54bfe8a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fc8e8000 con 0x5593fd6fe000 2023-10-06T02:28:33.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.026+0000 7f54bfe8a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593fc8e9180 con 0x5593fca1fc00 2023-10-06T02:28:33.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.026+0000 7f54bfe8a740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593fc8e9040 con 0x5593fca1f800 2023-10-06T02:28:33.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.026+0000 7f54b88f7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fd6fe000 0x5593fd65c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.026+0000 7f54b88f7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fd6fe000 0x5593fd65c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33084/0 (socket says 172.21.15.37:33084) 2023-10-06T02:28:33.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.026+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 learned_addr learned my addr 172.21.15.37:0/522894301 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:33.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.026+0000 7f54b98f9700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593fca1fc00 0x5593fd65cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.026+0000 7f54b90f8700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5593fca1f800 0x5593fd65c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.027+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5593fca1f800 msgr2=0x5593fd65c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:33.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.027+0000 7f54b88f7700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5593fca1f800 0x5593fd65c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.027+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593fca1fc00 msgr2=0x5593fd65cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:33.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.027+0000 7f54b88f7700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593fca1fc00 0x5593fd65cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.027+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593fc8ccb60 con 0x5593fd6fe000 2023-10-06T02:28:33.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.027+0000 7f54b88f7700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fd6fe000 0x5593fd65c100 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x5593fd68c9c0 tx=0x5593fd63b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:33.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.027+0000 7f54b30ec700 1 -- 172.21.15.37:0/522894301 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5593fc8e1080 con 0x5593fd6fe000 2023-10-06T02:28:33.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.027+0000 7f54b30ec700 1 -- 172.21.15.37:0/522894301 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5593fc8fed80 con 0x5593fd6fe000 2023-10-06T02:28:33.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.027+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5593fc8cda00 con 0x5593fd6fe000 2023-10-06T02:28:33.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.027+0000 7f54b30ec700 1 -- 172.21.15.37:0/522894301 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5593fc8e0f20 con 0x5593fd6fe000 2023-10-06T02:28:33.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.027+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5593fc8cc9c0 con 0x5593fd6fe000 2023-10-06T02:28:33.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.027+0000 7f54bfe8a740 4 datascan.init: resolving metadata pool 11 2023-10-06T02:28:33.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.028+0000 7f54b30ec700 1 -- 172.21.15.37:0/522894301 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x5593fd61f080 con 0x5593fd6fe000 2023-10-06T02:28:33.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.028+0000 7f54b30ec700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x5593fd724400 0x5593fd65d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.029+0000 7f54b30ec700 1 -- 172.21.15.37:0/522894301 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x5593fc8eca80 con 0x5593fd6fe000 2023-10-06T02:28:33.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.029+0000 7f54bfe8a740 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-10-06T02:28:33.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.029+0000 7f54bfe8a740 4 datascan.main: resolving metadata pool 11 2023-10-06T02:28:33.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.029+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5593fd6fe400 0x5593fd65bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.029+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:1 11.0 11:00000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6fe800 con 0x5593fd6fe400 2023-10-06T02:28:33.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.029+0000 7f54b98f9700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x5593fd724400 0x5593fd65d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.029+0000 7f54b90f8700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5593fd6fe400 0x5593fd65bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.029+0000 7f54b90f8700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5593fd6fe400 0x5593fd65bb80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:33.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.029+0000 7f54b98f9700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x5593fd724400 0x5593fd65d700 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x5593fd68c000 tx=0x5593fd68ee40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:33.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.029+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.1 v2:172.21.15.37:6808/90617 1 ==== osd_op_reply(1 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd6fe400 2023-10-06T02:28:33.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.029+0000 7f54b90f8700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x5593fd6fe800 0x5593fd818000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.030+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:2 11.10 11:08000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd724800 con 0x5593fd6fe800 2023-10-06T02:28:33.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.030+0000 7f54b98f9700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x5593fd6fe800 0x5593fd818000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.030+0000 7f54b98f9700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x5593fd6fe800 0x5593fd818000 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:33.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.030+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.0 v2:172.21.15.37:6816/90621 1 ==== osd_op_reply(2 [pgnls start_epoch 74 out=177b] v73'16 uv16 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x5593fd683200 con 0x5593fd6fe800 2023-10-06T02:28:33.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.030+0000 7f54b98f9700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x5593fd724800 0x5593fd818580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.030+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:3 11.8 11:10000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725000 con 0x5593fd724800 2023-10-06T02:28:33.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.030+0000 7f54b90f8700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x5593fd724800 0x5593fd818580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.031+0000 7f54b90f8700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x5593fd724800 0x5593fd818580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:33.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.031+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.3 v2:172.21.15.37:6817/90628 1 ==== osd_op_reply(3 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd724800 2023-10-06T02:28:33.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.031+0000 7f54b90f8700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x5593fd725000 0x5593fd818b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.031+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:4 11.18 11:18000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd724c00 con 0x5593fd725000 2023-10-06T02:28:33.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.031+0000 7f54b88f7700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x5593fd725000 0x5593fd818b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.031+0000 7f54b88f7700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x5593fd725000 0x5593fd818b00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:33.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.031+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.2 v2:172.21.15.37:6800/90611 1 ==== osd_op_reply(4 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725000 2023-10-06T02:28:33.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.031+0000 7f54b88f7700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x5593fd724c00 0x5593fd819600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.031+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:5 11.4 11:20000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725400 con 0x5593fd724c00 2023-10-06T02:28:33.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.032+0000 7f54b98f9700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x5593fd724c00 0x5593fd819600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.032+0000 7f54b98f9700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x5593fd724c00 0x5593fd819600 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:33.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.032+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.7 v2:172.21.15.191:6813/90854 1 ==== osd_op_reply(5 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683200 con 0x5593fd724c00 2023-10-06T02:28:33.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.032+0000 7f54b98f9700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x5593fd725400 0x5593fd819b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.032+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:6 11.14 11:28000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725c00 con 0x5593fd725400 2023-10-06T02:28:33.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.033+0000 7f54b90f8700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x5593fd725400 0x5593fd819b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.033+0000 7f54b90f8700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x5593fd725400 0x5593fd819b80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:33.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.033+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.6 v2:172.21.15.191:6824/90897 1 ==== osd_op_reply(6 [pgnls start_epoch 74 out=149b] v74'43 uv43 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd725400 2023-10-06T02:28:33.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.033+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:7 11.c 11:30000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725c00 con 0x5593fd6fe400 2023-10-06T02:28:33.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.033+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.1 v2:172.21.15.37:6808/90617 2 ==== osd_op_reply(7 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd6fe400 2023-10-06T02:28:33.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.033+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:8 11.1c 11:38000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725c00 con 0x5593fd725400 2023-10-06T02:28:33.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.034+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.6 v2:172.21.15.191:6824/90897 2 ==== osd_op_reply(8 [pgnls start_epoch 74 out=73b] v73'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd725400 2023-10-06T02:28:33.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.034+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:9 11.2 11:40000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725c00 con 0x5593fd725000 2023-10-06T02:28:33.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.034+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.2 v2:172.21.15.37:6800/90611 2 ==== osd_op_reply(9 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725000 2023-10-06T02:28:33.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.034+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:10 11.12 11:48000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725c00 con 0x5593fd724c00 2023-10-06T02:28:33.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.034+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.7 v2:172.21.15.191:6813/90854 2 ==== osd_op_reply(10 [pgnls start_epoch 74 out=81b] v73'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5593fd683200 con 0x5593fd724c00 2023-10-06T02:28:33.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.034+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:11 11.a 11:50000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725c00 con 0x5593fd724800 2023-10-06T02:28:33.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.035+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.3 v2:172.21.15.37:6817/90628 2 ==== osd_op_reply(11 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd724800 2023-10-06T02:28:33.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.035+0000 7f54b90f8700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x5593fd725c00 0x5593fd819080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.035+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:12 11.1a 11:58000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd830000 con 0x5593fd725c00 2023-10-06T02:28:33.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.035+0000 7f54b88f7700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x5593fd725c00 0x5593fd819080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.035+0000 7f54b88f7700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x5593fd725c00 0x5593fd819080 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:33.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.036+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.5 v2:172.21.15.191:6808/90853 1 ==== osd_op_reply(12 [pgnls start_epoch 74 out=49b] v74'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725c00 2023-10-06T02:28:33.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.036+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:13 11.6 11:60000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd830000 con 0x5593fd6fe800 2023-10-06T02:28:33.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.036+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.0 v2:172.21.15.37:6816/90621 2 ==== osd_op_reply(13 [pgnls start_epoch 74 out=77b] v73'8 uv8 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x5593fd683200 con 0x5593fd6fe800 2023-10-06T02:28:33.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.036+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:14 11.16 11:68000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd830000 con 0x5593fd725c00 2023-10-06T02:28:33.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.036+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.5 v2:172.21.15.191:6808/90853 2 ==== osd_op_reply(14 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725c00 2023-10-06T02:28:33.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.036+0000 7f54b88f7700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x5593fd830000 0x5593fd81a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.036+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:15 11.e 11:70000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd830000 2023-10-06T02:28:33.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.036+0000 7f54b98f9700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x5593fd830000 0x5593fd81a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.037+0000 7f54b98f9700 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x5593fd830000 0x5593fd81a680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:33.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.037+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.4 v2:172.21.15.191:6800/90852 1 ==== osd_op_reply(15 [pgnls start_epoch 74 out=73b] v73'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5593fd683200 con 0x5593fd830000 2023-10-06T02:28:33.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.037+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:16 11.1e 11:78000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd724c00 2023-10-06T02:28:33.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.037+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.7 v2:172.21.15.191:6813/90854 3 ==== osd_op_reply(16 [pgnls start_epoch 74 out=49b] v74'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683200 con 0x5593fd724c00 2023-10-06T02:28:33.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.037+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:17 11.1 11:80000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd725400 2023-10-06T02:28:33.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.038+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.6 v2:172.21.15.191:6824/90897 3 ==== osd_op_reply(17 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd725400 2023-10-06T02:28:33.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.038+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:18 11.11 11:88000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd725000 2023-10-06T02:28:33.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.038+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.2 v2:172.21.15.37:6800/90611 3 ==== osd_op_reply(18 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725000 2023-10-06T02:28:33.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.038+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:19 11.9 11:90000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd724800 2023-10-06T02:28:33.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.038+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.3 v2:172.21.15.37:6817/90628 3 ==== osd_op_reply(19 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd724800 2023-10-06T02:28:33.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.038+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:20 11.19 11:98000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd6fe800 2023-10-06T02:28:33.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.038+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.0 v2:172.21.15.37:6816/90621 3 ==== osd_op_reply(20 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683200 con 0x5593fd6fe800 2023-10-06T02:28:33.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.038+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:21 11.5 11:a0000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd724c00 2023-10-06T02:28:33.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.039+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.7 v2:172.21.15.191:6813/90854 4 ==== osd_op_reply(21 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683200 con 0x5593fd724c00 2023-10-06T02:28:33.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.039+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:22 11.15 11:a8000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd725000 2023-10-06T02:28:33.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.039+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.2 v2:172.21.15.37:6800/90611 4 ==== osd_op_reply(22 [pgnls start_epoch 74 out=97b] v73'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725000 2023-10-06T02:28:33.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.039+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:23 11.d 11:b0000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd725000 2023-10-06T02:28:33.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.039+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.2 v2:172.21.15.37:6800/90611 5 ==== osd_op_reply(23 [pgnls start_epoch 74 out=74b] v71'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725000 2023-10-06T02:28:33.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.039+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:24 11.1d 11:b8000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd724c00 2023-10-06T02:28:33.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.040+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.7 v2:172.21.15.191:6813/90854 5 ==== osd_op_reply(24 [pgnls start_epoch 74 out=73b] v73'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5593fd683200 con 0x5593fd724c00 2023-10-06T02:28:33.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.040+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:25 11.3 11:c0000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd725400 2023-10-06T02:28:33.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.040+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.6 v2:172.21.15.191:6824/90897 4 ==== osd_op_reply(25 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd725400 2023-10-06T02:28:33.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.040+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:26 11.13 11:c8000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd725c00 2023-10-06T02:28:33.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.040+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.5 v2:172.21.15.191:6808/90853 3 ==== osd_op_reply(26 [pgnls start_epoch 74 out=98b] v73'5 uv5 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725c00 2023-10-06T02:28:33.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.040+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:27 11.b 11:d0000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd724800 2023-10-06T02:28:33.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.041+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.3 v2:172.21.15.37:6817/90628 4 ==== osd_op_reply(27 [pgnls start_epoch 74 out=76b] v74'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd724800 2023-10-06T02:28:33.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.041+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:28 11.1b 11:d8000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd830000 2023-10-06T02:28:33.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.041+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.4 v2:172.21.15.191:6800/90852 2 ==== osd_op_reply(28 [pgnls start_epoch 74 out=49b] v74'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683200 con 0x5593fd830000 2023-10-06T02:28:33.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.041+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:29 11.7 11:e0000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd725c00 2023-10-06T02:28:33.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.041+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.5 v2:172.21.15.191:6808/90853 4 ==== osd_op_reply(29 [pgnls start_epoch 74 out=105b] v74'9 uv9 ondisk = 1) v8 ==== 144+0+105 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725c00 2023-10-06T02:28:33.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.041+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:30 11.17 11:e8000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd724c00 2023-10-06T02:28:33.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.042+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.7 v2:172.21.15.191:6813/90854 6 ==== osd_op_reply(30 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683200 con 0x5593fd724c00 2023-10-06T02:28:33.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.042+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:31 11.f 11:f0000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd724c00 2023-10-06T02:28:33.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.042+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.7 v2:172.21.15.191:6813/90854 7 ==== osd_op_reply(31 [pgnls start_epoch 74 out=73b] v74'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5593fd683200 con 0x5593fd724c00 2023-10-06T02:28:33.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.042+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:32 11.1f 11:f8000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd725000 2023-10-06T02:28:33.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.042+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.2 v2:172.21.15.37:6800/90611 6 ==== osd_op_reply(32 [pgnls start_epoch 74 out=101b] v74'9 uv8 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725000 2023-10-06T02:28:33.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.042+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 601.00000000 2023-10-06T02:28:33.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.042+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:33 11.10 11:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6fec00 con 0x5593fd6fe800 2023-10-06T02:28:33.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.043+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.0 v2:172.21.15.37:6816/90621 4 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5593fd683200 con 0x5593fd6fe800 2023-10-06T02:28:33.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.043+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 602.00000000 2023-10-06T02:28:33.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.043+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:34 11.10 11:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ff000 con 0x5593fd6fe800 2023-10-06T02:28:33.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.043+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.0 v2:172.21.15.37:6816/90621 5 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5593fd683200 con 0x5593fd6fe800 2023-10-06T02:28:33.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.043+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2023-10-06T02:28:33.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.043+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:35 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ff400 con 0x5593fd6fe800 2023-10-06T02:28:33.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.043+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.0 v2:172.21.15.37:6816/90621 6 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=1023b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+1023 (crc 0 0 0) 0x5593fd683200 con 0x5593fd6fe800 2023-10-06T02:28:33.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.043+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 600.00000000 2023-10-06T02:28:33.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.043+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:36 11.10 11:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ff800 con 0x5593fd6fe800 2023-10-06T02:28:33.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.043+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.0 v2:172.21.15.37:6816/90621 7 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5593fd683200 con 0x5593fd6fe800 2023-10-06T02:28:33.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.044+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 603.00000000 2023-10-06T02:28:33.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.044+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:37 11.10 11:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd6fe800 2023-10-06T02:28:33.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.044+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.0 v2:172.21.15.37:6816/90621 8 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5593fd683200 con 0x5593fd6fe800 2023-10-06T02:28:33.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.044+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2023-10-06T02:28:33.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.044+0000 7f54bfe8a740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-10-06T02:28:33.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.044+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 200.00000000 2023-10-06T02:28:33.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.044+0000 7f54bfe8a740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2023-10-06T02:28:33.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.044+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 200.00000001 2023-10-06T02:28:33.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.044+0000 7f54bfe8a740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2023-10-06T02:28:33.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.044+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 606.00000000 2023-10-06T02:28:33.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.044+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:38 11.14 11:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd830c00 con 0x5593fd725400 2023-10-06T02:28:33.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.044+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.6 v2:172.21.15.191:6824/90897 5 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv37 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd725400 2023-10-06T02:28:33.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.044+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 607.00000000 2023-10-06T02:28:33.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.044+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:39 11.1c 11:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd831000 con 0x5593fd725400 2023-10-06T02:28:33.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.044+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.6 v2:172.21.15.191:6824/90897 6 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd725400 2023-10-06T02:28:33.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.044+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 10000000003.00000000 2023-10-06T02:28:33.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.044+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:40 11.12 11:4def72d4:::10000000003.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd831400 con 0x5593fd724c00 2023-10-06T02:28:33.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.045+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.7 v2:172.21.15.191:6813/90854 8 ==== osd_op_reply(40 10000000003.00000000 [omap-get-vals out=511b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+511 (crc 0 0 0) 0x5593fd683200 con 0x5593fd724c00 2023-10-06T02:28:33.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.045+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2023-10-06T02:28:33.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.045+0000 7f54bfe8a740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2023-10-06T02:28:33.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.045+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 608.00000000 2023-10-06T02:28:33.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.045+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:41 11.e 11:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd831800 con 0x5593fd830000 2023-10-06T02:28:33.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.045+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.4 v2:172.21.15.191:6800/90852 3 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5593fd683200 con 0x5593fd830000 2023-10-06T02:28:33.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.045+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 604.00000000 2023-10-06T02:28:33.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.045+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:42 11.15 11:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd831c00 con 0x5593fd725000 2023-10-06T02:28:33.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.046+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.2 v2:172.21.15.37:6800/90611 7 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725000 2023-10-06T02:28:33.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.046+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 500.00000000 2023-10-06T02:28:33.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.046+0000 7f54bfe8a740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2023-10-06T02:28:33.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.046+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object mds_snaptable 2023-10-06T02:28:33.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.046+0000 7f54bfe8a740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-10-06T02:28:33.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.046+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 605.00000000 2023-10-06T02:28:33.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.046+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:43 11.1d 11:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6fec00 con 0x5593fd724c00 2023-10-06T02:28:33.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.046+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.7 v2:172.21.15.191:6813/90854 9 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5593fd683200 con 0x5593fd724c00 2023-10-06T02:28:33.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.046+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object mds0_inotable 2023-10-06T02:28:33.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.046+0000 7f54bfe8a740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-10-06T02:28:33.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.046+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 100.00000000 2023-10-06T02:28:33.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.046+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:44 11.13 11:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ff000 con 0x5593fd725c00 2023-10-06T02:28:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.046+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.5 v2:172.21.15.191:6808/90853 5 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5075b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5075 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725c00 2023-10-06T02:28:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.047+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2023-10-06T02:28:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.047+0000 7f54bfe8a740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-10-06T02:28:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.047+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 609.00000000 2023-10-06T02:28:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.047+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:45 11.7 11:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ff400 con 0x5593fd725c00 2023-10-06T02:28:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.047+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.5 v2:172.21.15.191:6808/90853 6 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv8 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725c00 2023-10-06T02:28:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.047+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 10000000001.00000000 2023-10-06T02:28:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.047+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:46 11.7 11:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ff800 con 0x5593fd725c00 2023-10-06T02:28:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.047+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.5 v2:172.21.15.191:6808/90853 7 ==== osd_op_reply(46 10000000001.00000000 [omap-get-vals out=1509b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+1509 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725c00 2023-10-06T02:28:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.047+0000 7f54bfe8a740 20 datascan.scan_links: injected ino detected 2023-10-06T02:28:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.047+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 400.00000000 2023-10-06T02:28:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.047+0000 7f54bfe8a740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2023-10-06T02:28:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.047+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2023-10-06T02:28:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.047+0000 7f54bfe8a740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-10-06T02:28:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.047+0000 7f54bfe8a740 10 datascan.scan_links: step 1: handling object 1.00000000 2023-10-06T02:28:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.047+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:47 11.1f 11:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ff000 con 0x5593fd725000 2023-10-06T02:28:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.048+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.2 v2:172.21.15.37:6800/90611 8 ==== osd_op_reply(47 1.00000000 [omap-get-vals out=512b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+512 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725000 2023-10-06T02:28:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.048+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:48 11.0 11:00000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ff400 con 0x5593fd6fe400 2023-10-06T02:28:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.048+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.1 v2:172.21.15.37:6808/90617 3 ==== osd_op_reply(48 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd6fe400 2023-10-06T02:28:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.048+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:49 11.10 11:08000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ff400 con 0x5593fd6fe800 2023-10-06T02:28:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.048+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.0 v2:172.21.15.37:6816/90621 9 ==== osd_op_reply(49 [pgnls start_epoch 74 out=177b] v73'16 uv16 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x5593fd683200 con 0x5593fd6fe800 2023-10-06T02:28:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.048+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:50 11.8 11:10000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd724800 2023-10-06T02:28:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.048+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.3 v2:172.21.15.37:6817/90628 5 ==== osd_op_reply(50 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd724800 2023-10-06T02:28:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.048+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:51 11.18 11:18000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd725000 2023-10-06T02:28:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.049+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.2 v2:172.21.15.37:6800/90611 9 ==== osd_op_reply(51 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725000 2023-10-06T02:28:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.049+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:52 11.4 11:20000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd724c00 2023-10-06T02:28:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.049+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.7 v2:172.21.15.191:6813/90854 10 ==== osd_op_reply(52 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683200 con 0x5593fd724c00 2023-10-06T02:28:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.049+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:53 11.14 11:28000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd725400 2023-10-06T02:28:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.049+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.6 v2:172.21.15.191:6824/90897 7 ==== osd_op_reply(53 [pgnls start_epoch 74 out=149b] v74'43 uv43 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd725400 2023-10-06T02:28:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.049+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- osd_op(unknown.0.0:54 11.c 11:30000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd6fe400 2023-10-06T02:28:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.050+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.1 v2:172.21.15.37:6808/90617 4 ==== osd_op_reply(54 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd6fe400 2023-10-06T02:28:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.050+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:55 11.1c 11:38000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd725400 2023-10-06T02:28:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.050+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.6 v2:172.21.15.191:6824/90897 8 ==== osd_op_reply(55 [pgnls start_epoch 74 out=73b] v73'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd725400 2023-10-06T02:28:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.050+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:56 11.2 11:40000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd725000 2023-10-06T02:28:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.050+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.2 v2:172.21.15.37:6800/90611 10 ==== osd_op_reply(56 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725000 2023-10-06T02:28:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.050+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:57 11.12 11:48000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd724c00 2023-10-06T02:28:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.050+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.7 v2:172.21.15.191:6813/90854 11 ==== osd_op_reply(57 [pgnls start_epoch 74 out=81b] v73'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5593fd683200 con 0x5593fd724c00 2023-10-06T02:28:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.051+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:58 11.a 11:50000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd724800 2023-10-06T02:28:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.051+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.3 v2:172.21.15.37:6817/90628 6 ==== osd_op_reply(58 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd724800 2023-10-06T02:28:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.051+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:59 11.1a 11:58000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd725c00 2023-10-06T02:28:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.051+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.5 v2:172.21.15.191:6808/90853 8 ==== osd_op_reply(59 [pgnls start_epoch 74 out=49b] v74'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725c00 2023-10-06T02:28:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.051+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:60 11.6 11:60000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd6fe800 2023-10-06T02:28:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.051+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.0 v2:172.21.15.37:6816/90621 10 ==== osd_op_reply(60 [pgnls start_epoch 74 out=77b] v73'8 uv8 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x5593fd683200 con 0x5593fd6fe800 2023-10-06T02:28:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.051+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:61 11.16 11:68000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd725c00 2023-10-06T02:28:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.051+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.5 v2:172.21.15.191:6808/90853 9 ==== osd_op_reply(61 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725c00 2023-10-06T02:28:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.052+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:62 11.e 11:70000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd830000 2023-10-06T02:28:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.052+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.4 v2:172.21.15.191:6800/90852 4 ==== osd_op_reply(62 [pgnls start_epoch 74 out=73b] v73'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5593fd683200 con 0x5593fd830000 2023-10-06T02:28:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.052+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:63 11.1e 11:78000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd724c00 2023-10-06T02:28:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.052+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.7 v2:172.21.15.191:6813/90854 12 ==== osd_op_reply(63 [pgnls start_epoch 74 out=49b] v74'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683200 con 0x5593fd724c00 2023-10-06T02:28:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.052+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:64 11.1 11:80000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd725400 2023-10-06T02:28:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.052+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.6 v2:172.21.15.191:6824/90897 9 ==== osd_op_reply(64 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd725400 2023-10-06T02:28:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.052+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:65 11.11 11:88000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd725000 2023-10-06T02:28:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.053+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.2 v2:172.21.15.37:6800/90611 11 ==== osd_op_reply(65 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725000 2023-10-06T02:28:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.053+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:66 11.9 11:90000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd724800 2023-10-06T02:28:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.053+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.3 v2:172.21.15.37:6817/90628 7 ==== osd_op_reply(66 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd724800 2023-10-06T02:28:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.053+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:67 11.19 11:98000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd6fe800 2023-10-06T02:28:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.053+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.0 v2:172.21.15.37:6816/90621 11 ==== osd_op_reply(67 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683200 con 0x5593fd6fe800 2023-10-06T02:28:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.053+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:68 11.5 11:a0000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd724c00 2023-10-06T02:28:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.053+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.7 v2:172.21.15.191:6813/90854 13 ==== osd_op_reply(68 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683200 con 0x5593fd724c00 2023-10-06T02:28:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.053+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:69 11.15 11:a8000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd725000 2023-10-06T02:28:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.054+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.2 v2:172.21.15.37:6800/90611 12 ==== osd_op_reply(69 [pgnls start_epoch 74 out=97b] v73'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725000 2023-10-06T02:28:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.054+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:70 11.d 11:b0000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd725000 2023-10-06T02:28:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.054+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.2 v2:172.21.15.37:6800/90611 13 ==== osd_op_reply(70 [pgnls start_epoch 74 out=74b] v71'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725000 2023-10-06T02:28:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.054+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:71 11.1d 11:b8000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd724c00 2023-10-06T02:28:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.054+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.7 v2:172.21.15.191:6813/90854 14 ==== osd_op_reply(71 [pgnls start_epoch 74 out=73b] v73'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5593fd683200 con 0x5593fd724c00 2023-10-06T02:28:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.054+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:72 11.3 11:c0000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd725400 2023-10-06T02:28:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.054+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.6 v2:172.21.15.191:6824/90897 10 ==== osd_op_reply(72 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd725400 2023-10-06T02:28:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.054+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:73 11.13 11:c8000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd725c00 2023-10-06T02:28:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.055+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.5 v2:172.21.15.191:6808/90853 10 ==== osd_op_reply(73 [pgnls start_epoch 74 out=98b] v73'5 uv5 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725c00 2023-10-06T02:28:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.055+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- osd_op(unknown.0.0:74 11.b 11:d0000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd724800 2023-10-06T02:28:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.055+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.3 v2:172.21.15.37:6817/90628 8 ==== osd_op_reply(74 [pgnls start_epoch 74 out=76b] v74'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd724800 2023-10-06T02:28:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.055+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:75 11.1b 11:d8000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd830000 2023-10-06T02:28:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.055+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.4 v2:172.21.15.191:6800/90852 5 ==== osd_op_reply(75 [pgnls start_epoch 74 out=49b] v74'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683200 con 0x5593fd830000 2023-10-06T02:28:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.055+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:76 11.7 11:e0000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd725c00 2023-10-06T02:28:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.056+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.5 v2:172.21.15.191:6808/90853 11 ==== osd_op_reply(76 [pgnls start_epoch 74 out=105b] v74'9 uv9 ondisk = 1) v8 ==== 144+0+105 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725c00 2023-10-06T02:28:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.056+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:77 11.17 11:e8000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd724c00 2023-10-06T02:28:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.056+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.7 v2:172.21.15.191:6813/90854 15 ==== osd_op_reply(77 [pgnls start_epoch 74 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5593fd683200 con 0x5593fd724c00 2023-10-06T02:28:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.056+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:78 11.f 11:f0000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd724c00 2023-10-06T02:28:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.056+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.7 v2:172.21.15.191:6813/90854 16 ==== osd_op_reply(78 [pgnls start_epoch 74 out=73b] v74'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5593fd683200 con 0x5593fd724c00 2023-10-06T02:28:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.056+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:79 11.1f 11:f8000000::::head [pgnls start_epoch 74 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ffc00 con 0x5593fd725000 2023-10-06T02:28:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.057+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.2 v2:172.21.15.37:6800/90611 14 ==== osd_op_reply(79 [pgnls start_epoch 74 out=101b] v74'9 uv8 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725000 2023-10-06T02:28:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.057+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 601.00000000 2023-10-06T02:28:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.057+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:80 11.10 11:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd831c00 con 0x5593fd6fe800 2023-10-06T02:28:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.057+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.0 v2:172.21.15.37:6816/90621 12 ==== osd_op_reply(80 601.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5593fd683200 con 0x5593fd6fe800 2023-10-06T02:28:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.057+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 602.00000000 2023-10-06T02:28:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.057+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:81 11.10 11:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd6fe800 2023-10-06T02:28:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.057+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.0 v2:172.21.15.37:6816/90621 13 ==== osd_op_reply(81 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5593fd683200 con 0x5593fd6fe800 2023-10-06T02:28:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.057+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2023-10-06T02:28:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.057+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:82 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd83e000 con 0x5593fd6fe800 2023-10-06T02:28:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.058+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.0 v2:172.21.15.37:6816/90621 14 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals out=1023b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+1023 (crc 0 0 0) 0x5593fd683200 con 0x5593fd6fe800 2023-10-06T02:28:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.058+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 600.00000000 2023-10-06T02:28:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.058+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:83 11.10 11:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd83e400 con 0x5593fd6fe800 2023-10-06T02:28:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.058+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.0 v2:172.21.15.37:6816/90621 15 ==== osd_op_reply(83 600.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5593fd683200 con 0x5593fd6fe800 2023-10-06T02:28:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.058+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 603.00000000 2023-10-06T02:28:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.058+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- osd_op(unknown.0.0:84 11.10 11:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd83e800 con 0x5593fd6fe800 2023-10-06T02:28:33.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.058+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.0 v2:172.21.15.37:6816/90621 16 ==== osd_op_reply(84 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5593fd683200 con 0x5593fd6fe800 2023-10-06T02:28:33.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.058+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2023-10-06T02:28:33.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.058+0000 7f54bfe8a740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-10-06T02:28:33.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.058+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 200.00000000 2023-10-06T02:28:33.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.058+0000 7f54bfe8a740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2023-10-06T02:28:33.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.058+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 200.00000001 2023-10-06T02:28:33.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.058+0000 7f54bfe8a740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2023-10-06T02:28:33.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.058+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 606.00000000 2023-10-06T02:28:33.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.058+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:85 11.14 11:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd83ec00 con 0x5593fd725400 2023-10-06T02:28:33.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.059+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.6 v2:172.21.15.191:6824/90897 11 ==== osd_op_reply(85 606.00000000 [omap-get-vals out=5b] v0'0 uv37 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd725400 2023-10-06T02:28:33.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.059+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 607.00000000 2023-10-06T02:28:33.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.059+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- osd_op(unknown.0.0:86 11.1c 11:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd83f000 con 0x5593fd725400 2023-10-06T02:28:33.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.059+0000 7f54b90f8700 1 -- 172.21.15.37:0/522894301 <== osd.6 v2:172.21.15.191:6824/90897 12 ==== osd_op_reply(86 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5593fd682fc0 con 0x5593fd725400 2023-10-06T02:28:33.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.059+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 10000000003.00000000 2023-10-06T02:28:33.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.059+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:87 11.12 11:4def72d4:::10000000003.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd83f400 con 0x5593fd724c00 2023-10-06T02:28:33.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.059+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.7 v2:172.21.15.191:6813/90854 17 ==== osd_op_reply(87 10000000003.00000000 [omap-get-vals out=511b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+511 (crc 0 0 0) 0x5593fd683200 con 0x5593fd724c00 2023-10-06T02:28:33.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.059+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2023-10-06T02:28:33.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.059+0000 7f54bfe8a740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2023-10-06T02:28:33.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.059+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 608.00000000 2023-10-06T02:28:33.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.059+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- osd_op(unknown.0.0:88 11.e 11:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd83f800 con 0x5593fd830000 2023-10-06T02:28:33.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.059+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.4 v2:172.21.15.191:6800/90852 6 ==== osd_op_reply(88 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5593fd683200 con 0x5593fd830000 2023-10-06T02:28:33.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.059+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 604.00000000 2023-10-06T02:28:33.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.060+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:89 11.15 11:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd83fc00 con 0x5593fd725000 2023-10-06T02:28:33.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.060+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.2 v2:172.21.15.37:6800/90611 15 ==== osd_op_reply(89 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725000 2023-10-06T02:28:33.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.060+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 500.00000000 2023-10-06T02:28:33.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.060+0000 7f54bfe8a740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2023-10-06T02:28:33.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.060+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object mds_snaptable 2023-10-06T02:28:33.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.060+0000 7f54bfe8a740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-10-06T02:28:33.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.060+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 605.00000000 2023-10-06T02:28:33.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.060+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- osd_op(unknown.0.0:90 11.1d 11:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd83e000 con 0x5593fd724c00 2023-10-06T02:28:33.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.060+0000 7f54b98f9700 1 -- 172.21.15.37:0/522894301 <== osd.7 v2:172.21.15.191:6813/90854 18 ==== osd_op_reply(90 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5593fd683200 con 0x5593fd724c00 2023-10-06T02:28:33.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.060+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object mds0_inotable 2023-10-06T02:28:33.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.060+0000 7f54bfe8a740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-10-06T02:28:33.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.060+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 100.00000000 2023-10-06T02:28:33.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.060+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:91 11.13 11:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd725c00 2023-10-06T02:28:33.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.060+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.5 v2:172.21.15.191:6808/90853 12 ==== osd_op_reply(91 100.00000000 [omap-get-vals out=5075b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5075 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725c00 2023-10-06T02:28:33.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2023-10-06T02:28:33.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-10-06T02:28:33.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 609.00000000 2023-10-06T02:28:33.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:92 11.7 11:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd831800 con 0x5593fd725c00 2023-10-06T02:28:33.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.5 v2:172.21.15.191:6808/90853 13 ==== osd_op_reply(92 609.00000000 [omap-get-vals out=5b] v0'0 uv8 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725c00 2023-10-06T02:28:33.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 10000000001.00000000 2023-10-06T02:28:33.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:93 11.7 11:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd831400 con 0x5593fd725c00 2023-10-06T02:28:33.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.5 v2:172.21.15.191:6808/90853 14 ==== osd_op_reply(93 10000000001.00000000 [omap-get-vals out=1509b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+1509 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725c00 2023-10-06T02:28:33.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 20 datascan.scan_links: injected ino detected 2023-10-06T02:28:33.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 20 datascan.scan_links: adding 0x100000001f7 for future processing to fix dnfirst 2023-10-06T02:28:33.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 400.00000000 2023-10-06T02:28:33.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2023-10-06T02:28:33.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2023-10-06T02:28:33.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-10-06T02:28:33.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 10 datascan.scan_links: step 2: handling object 1.00000000 2023-10-06T02:28:33.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:94 11.1f 11:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd831c00 con 0x5593fd725000 2023-10-06T02:28:33.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.2 v2:172.21.15.37:6800/90611 16 ==== osd_op_reply(94 1.00000000 [omap-get-vals out=512b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+512 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725000 2023-10-06T02:28:33.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2023-10-06T02:28:33.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 10 datascan.scan_links: removing dup dentries from 0 objects 2023-10-06T02:28:33.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 10 datascan.scan_links: processing 0 bad_nlink_inos 2023-10-06T02:28:33.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 10 datascan.scan_links: processing 1 injected_inos 2023-10-06T02:28:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 10 datascan.scan_links: handling injected_ino 0x100000001f7 2023-10-06T02:28:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000001:bravo 2023-10-06T02:28:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.061+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:95 11.7 11:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ff400 con 0x5593fd725c00 2023-10-06T02:28:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.062+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.5 v2:172.21.15.191:6808/90853 15 ==== osd_op_reply(95 10000000001.00000000 [omap-get-vals-by-keys out=494b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+494 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725c00 2023-10-06T02:28:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.062+0000 7f54bfe8a740 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2023-10-06T02:28:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.062+0000 7f54bfe8a740 20 datascan.scan_links: first is now 2 2023-10-06T02:28:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.062+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:96 11.7 11:e2e07930:::10000000001.00000000:head [omap-set-vals in=494b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6fec00 con 0x5593fd725c00 2023-10-06T02:28:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.063+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.5 v2:172.21.15.191:6808/90853 16 ==== osd_op_reply(96 10000000001.00000000 [omap-set-vals] v74'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725c00 2023-10-06T02:28:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.063+0000 7f54bfe8a740 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x100000001f7 2023-10-06T02:28:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.063+0000 7f54bfe8a740 10 datascan.scan_links: updating inotable 2023-10-06T02:28:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.063+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:97 11.13 11:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd725800 con 0x5593fd725c00 2023-10-06T02:28:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.063+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.5 v2:172.21.15.191:6808/90853 17 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv4 ondisk = 0) v8 ==== 157+0+50 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725c00 2023-10-06T02:28:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.063+0000 7f54bfe8a740 10 mds.0.inotable: skip_inos was [0x10000000005~0x1f2,0x100000001f9~0xfffffffe07] 2023-10-06T02:28:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.063+0000 7f54bfe8a740 10 mds.0.inotable: skip_inos now [0x100000001f9~0xfffffffe07] 2023-10-06T02:28:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.063+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- osd_op(unknown.0.0:98 11.13 11:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd83fc00 con 0x5593fd725c00 2023-10-06T02:28:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.5 v2:172.21.15.191:6808/90853 18 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v74'6 uv6 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725c00 2023-10-06T02:28:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 10 datascan.scan_links: updating snaptable 2023-10-06T02:28:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- osd_op(unknown.0.0:99 11.d 11:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74) v8 -- 0x5593fd6ff800 con 0x5593fd725000 2023-10-06T02:28:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 <== osd.2 v2:172.21.15.37:6800/90611 17 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x5593fd683440 con 0x5593fd725000 2023-10-06T02:28:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x5593fd6fe800 msgr2=0x5593fd818000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x5593fd6fe800 0x5593fd818000 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5593fd6fe400 msgr2=0x5593fd65bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:33.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x5593fd6fe400 0x5593fd65bb80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x5593fd725000 msgr2=0x5593fd818b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:33.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x5593fd725000 0x5593fd818b00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x5593fd724800 msgr2=0x5593fd818580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:33.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x5593fd724800 0x5593fd818580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 reap_dead start 2023-10-06T02:28:33.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x5593fd830000 msgr2=0x5593fd81a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:33.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x5593fd830000 0x5593fd81a680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x5593fd725c00 msgr2=0x5593fd819080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:33.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x5593fd725c00 0x5593fd819080 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x5593fd725400 msgr2=0x5593fd819b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x5593fd725400 0x5593fd819b80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x5593fd724c00 msgr2=0x5593fd819600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54b88f7700 1 -- 172.21.15.37:0/522894301 reap_dead start 2023-10-06T02:28:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x5593fd724c00 0x5593fd819600 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x5593fd724400 msgr2=0x5593fd65d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x5593fd724400 0x5593fd65d700 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x5593fd68c000 tx=0x5593fd68ee40 comp rx=0 tx=0).stop 2023-10-06T02:28:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fd6fe000 msgr2=0x5593fd65c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fd6fe000 0x5593fd65c100 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x5593fd68c9c0 tx=0x5593fd63b980 comp rx=0 tx=0).stop 2023-10-06T02:28:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 shutdown_connections 2023-10-06T02:28:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x5593fd724c00 0x5593fd819600 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x5593fd724400 0x5593fd65d700 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/522894301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fd6fe000 0x5593fd65c100 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 >> 172.21.15.37:0/522894301 conn(0x5593fca1f000 msgr2=0x5593fc97d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 shutdown_connections 2023-10-06T02:28:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 -- 172.21.15.37:0/522894301 wait complete. 2023-10-06T02:28:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 -- 172.21.15.37:0/151872959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fca1e400 msgr2=0x5593fd65a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/151872959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fca1e400 0x5593fd65a580 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x5593fd68a0f0 tx=0x5593fd688180 comp rx=0 tx=0).stop 2023-10-06T02:28:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 -- 172.21.15.37:0/151872959 shutdown_connections 2023-10-06T02:28:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/151872959 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5593fca1ec00 0x5593fd65b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/151872959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593fca1e400 0x5593fd65a580 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 --2- 172.21.15.37:0/151872959 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5593fca1e800 0x5593fd65ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.066+0000 7f54bfe8a740 1 -- 172.21.15.37:0/151872959 >> 172.21.15.37:0/151872959 conn(0x5593fca1e000 msgr2=0x5593fc97d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.067+0000 7f54bfe8a740 1 -- 172.21.15.37:0/151872959 shutdown_connections 2023-10-06T02:28:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.067+0000 7f54bfe8a740 1 -- 172.21.15.37:0/151872959 wait complete. 2023-10-06T02:28:33.091 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.134033, result: 2023-10-06T02:28:33.092 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:28:33.115 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:28:33.157 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2023-10-06T02:28:33.158 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2023-10-06T02:28:33.158 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:28:33.158 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2023-10-06T02:28:33.158 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.158 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2023-10-06T02:28:33.158 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.158 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2023-10-06T02:28:33.158 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.158 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2023-10-06T02:28:33.158 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2023-10-06T02:28:33.159 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.159 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2023-10-06T02:28:33.159 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2023-10-06T02:28:33.159 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.159 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:28:33.159 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2023-10-06T02:28:33.159 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.159 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:28:33.159 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:28:33.159 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.159 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2023-10-06T02:28:33.159 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.160 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2023-10-06T02:28:33.160 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2023-10-06T02:28:33.160 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:28:33.160 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:28:33.160 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2023-10-06T02:28:33.160 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:28:33.160 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2023-10-06T02:28:33.160 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:28:33.160 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:28:33.160 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2023-10-06T02:28:33.160 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.160 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:28:33.161 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.161 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2023-10-06T02:28:33.161 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.161 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2023-10-06T02:28:33.161 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.161 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2023-10-06T02:28:33.161 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2023-10-06T02:28:33.161 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2023-10-06T02:28:33.161 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]" 2023-10-06T02:28:33.161 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = d1f292a2-fd8c-430a-be88-f44de408e77c 2023-10-06T02:28:33.161 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.161 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2023-10-06T02:28:33.162 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2023-10-06T02:28:33.162 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.162 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2023-10-06T02:28:33.162 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2023-10-06T02:28:33.162 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:28:33.162 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.162 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2023-10-06T02:28:33.162 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2023-10-06T02:28:33.162 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.162 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2023-10-06T02:28:33.162 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2023-10-06T02:28:33.163 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2023-10-06T02:28:33.163 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.163 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2023-10-06T02:28:33.163 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2023-10-06T02:28:33.163 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.163 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:28:33.163 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.163 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2023-10-06T02:28:33.163 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.163 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2023-10-06T02:28:33.163 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.163 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:28:33.163 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2023-10-06T02:28:33.164 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.164 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2023-10-06T02:28:33.164 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2023-10-06T02:28:33.164 INFO:teuthology.orchestra.run.smithi037.stdout: bdev async discard = True 2023-10-06T02:28:33.164 INFO:teuthology.orchestra.run.smithi037.stdout: bdev enable discard = True 2023-10-06T02:28:33.164 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore allocator = bitmap 2023-10-06T02:28:33.164 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2023-10-06T02:28:33.164 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2023-10-06T02:28:33.164 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 1/20 2023-10-06T02:28:33.164 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 1/20 2023-10-06T02:28:33.164 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:28:33.165 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2023-10-06T02:28:33.165 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 4/10 2023-10-06T02:28:33.165 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:28:33.165 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2023-10-06T02:28:33.165 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:28:33.165 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:28:33.165 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2023-10-06T02:28:33.165 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-10-06T02:28:33.165 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.165 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2023-10-06T02:28:33.165 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:28:33.165 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2023-10-06T02:28:33.165 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-10-06T02:28:33.166 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-10-06T02:28:33.166 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:28:33.166 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:28:33.166 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2023-10-06T02:28:33.166 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.166 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2023-10-06T02:28:33.166 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:28:33.166 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-10-06T02:28:33.166 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2023-10-06T02:28:33.166 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-10-06T02:28:33.166 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2023-10-06T02:28:33.167 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2023-10-06T02:28:33.167 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:28:33.167 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2023-10-06T02:28:33.167 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2023-10-06T02:28:33.167 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:28:33.167 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.167 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:28:33.167 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:28:33.167 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:28:33.167 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.167 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:28:33.167 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:28:33.168 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:28:33.168 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.168 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2023-10-06T02:28:33.168 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:28:33.168 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.168 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:28:33.168 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2023-10-06T02:28:33.168 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.168 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2023-10-06T02:28:33.168 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2023-10-06T02:28:33.168 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2023-10-06T02:28:33.169 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2023-10-06T02:28:33.169 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:28:33.169 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:28:33.169 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2023-10-06T02:28:33.169 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2023-10-06T02:28:33.169 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:28:33.169 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = "" 2023-10-06T02:28:33.169 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-10-06T02:28:33.169 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-10-06T02:28:33.169 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2023-10-06T02:28:33.169 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2023-10-06T02:28:33.169 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2023-10-06T02:28:33.170 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-10-06T02:28:33.170 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-10-06T02:28:33.170 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-10-06T02:28:33.170 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-10-06T02:28:33.170 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2023-10-06T02:28:33.170 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2023-10-06T02:28:33.170 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:28:33.170 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2023-10-06T02:28:33.170 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = False 2023-10-06T02:28:33.170 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2023-10-06T02:28:33.170 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = True 2023-10-06T02:28:33.171 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-10-06T02:28:33.171 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-10-06T02:28:33.171 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-10-06T02:28:33.172 INFO:teuthology.orchestra.run.smithi191.stdout:[global] 2023-10-06T02:28:33.172 INFO:teuthology.orchestra.run.smithi191.stdout: chdir = "" 2023-10-06T02:28:33.172 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:28:33.173 INFO:teuthology.orchestra.run.smithi191.stdout: auth supported = cephx 2023-10-06T02:28:33.173 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.173 INFO:teuthology.orchestra.run.smithi191.stdout: filestore xattr use omap = true 2023-10-06T02:28:33.173 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.173 INFO:teuthology.orchestra.run.smithi191.stdout: mon clock drift allowed = 1.000 2023-10-06T02:28:33.173 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.173 INFO:teuthology.orchestra.run.smithi191.stdout: osd crush chooseleaf type = 0 2023-10-06T02:28:33.173 INFO:teuthology.orchestra.run.smithi191.stdout: auth debug = true 2023-10-06T02:28:33.173 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.173 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on old message = true 2023-10-06T02:28:33.173 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on bug = true 2023-10-06T02:28:33.173 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.174 INFO:teuthology.orchestra.run.smithi191.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:28:33.174 INFO:teuthology.orchestra.run.smithi191.stdout: mon pg warn max object skew = 0 2023-10-06T02:28:33.174 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.174 INFO:teuthology.orchestra.run.smithi191.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:28:33.174 INFO:teuthology.orchestra.run.smithi191.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:28:33.174 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.174 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default size = 2 2023-10-06T02:28:33.174 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.174 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow primary affinity = true 2023-10-06T02:28:33.174 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow pg remap = true 2023-10-06T02:28:33.174 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:28:33.175 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:28:33.175 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on no sortbitwise = false 2023-10-06T02:28:33.175 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:28:33.175 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on too few osds = false 2023-10-06T02:28:33.175 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:28:33.175 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:28:33.175 INFO:teuthology.orchestra.run.smithi191.stdout: mon_allow_pool_size_one = true 2023-10-06T02:28:33.175 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.175 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:28:33.175 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.175 INFO:teuthology.orchestra.run.smithi191.stdout: osd default data pool replay window = 5 2023-10-06T02:28:33.176 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.176 INFO:teuthology.orchestra.run.smithi191.stdout: mon allow pool delete = true 2023-10-06T02:28:33.176 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.176 INFO:teuthology.orchestra.run.smithi191.stdout: mon cluster log file level = debug 2023-10-06T02:28:33.176 INFO:teuthology.orchestra.run.smithi191.stdout: debug asserts on shutdown = true 2023-10-06T02:28:33.176 INFO:teuthology.orchestra.run.smithi191.stdout: mon health detail to clog = false 2023-10-06T02:28:33.176 INFO:teuthology.orchestra.run.smithi191.stdout: mon host = "172.21.15.37,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]" 2023-10-06T02:28:33.176 INFO:teuthology.orchestra.run.smithi191.stdout: fsid = d1f292a2-fd8c-430a-be88-f44de408e77c 2023-10-06T02:28:33.176 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.176 INFO:teuthology.orchestra.run.smithi191.stdout:[osd] 2023-10-06T02:28:33.176 INFO:teuthology.orchestra.run.smithi191.stdout: osd journal size = 100 2023-10-06T02:28:33.176 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.177 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub load threshold = 5.0 2023-10-06T02:28:33.177 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub max interval = 600 2023-10-06T02:28:33.177 INFO:teuthology.orchestra.run.smithi191.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:28:33.177 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.177 INFO:teuthology.orchestra.run.smithi191.stdout: osd recover clone overlap = true 2023-10-06T02:28:33.177 INFO:teuthology.orchestra.run.smithi191.stdout: osd recovery max chunk = 1048576 2023-10-06T02:28:33.177 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.177 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug shutdown = true 2023-10-06T02:28:33.177 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug op order = true 2023-10-06T02:28:33.177 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug verify stray on activate = true 2023-10-06T02:28:33.177 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.177 INFO:teuthology.orchestra.run.smithi191.stdout: osd open classes on start = true 2023-10-06T02:28:33.178 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug pg log writeout = true 2023-10-06T02:28:33.178 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.178 INFO:teuthology.orchestra.run.smithi191.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:28:33.178 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.178 INFO:teuthology.orchestra.run.smithi191.stdout: osd map max advance = 10 2023-10-06T02:28:33.178 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.178 INFO:teuthology.orchestra.run.smithi191.stdout: journal zero on create = true 2023-10-06T02:28:33.178 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.178 INFO:teuthology.orchestra.run.smithi191.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:28:33.178 INFO:teuthology.orchestra.run.smithi191.stdout: filestore apply finisher threads = 3 2023-10-06T02:28:33.178 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.179 INFO:teuthology.orchestra.run.smithi191.stdout: bdev debug aio = true 2023-10-06T02:28:33.179 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug misdirected ops = true 2023-10-06T02:28:33.179 INFO:teuthology.orchestra.run.smithi191.stdout: bdev async discard = True 2023-10-06T02:28:33.179 INFO:teuthology.orchestra.run.smithi191.stdout: bdev enable discard = True 2023-10-06T02:28:33.179 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore allocator = bitmap 2023-10-06T02:28:33.179 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore block size = 96636764160 2023-10-06T02:28:33.179 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore fsck on mount = True 2023-10-06T02:28:33.179 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluefs = 1/20 2023-10-06T02:28:33.179 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluestore = 1/20 2023-10-06T02:28:33.179 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:28:33.179 INFO:teuthology.orchestra.run.smithi191.stdout: debug osd = 20 2023-10-06T02:28:33.180 INFO:teuthology.orchestra.run.smithi191.stdout: debug rocksdb = 4/10 2023-10-06T02:28:33.180 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:28:33.180 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd full ratio = 0.9 2023-10-06T02:28:33.180 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:28:33.180 INFO:teuthology.orchestra.run.smithi191.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:28:33.180 INFO:teuthology.orchestra.run.smithi191.stdout: osd objectstore = bluestore 2023-10-06T02:28:33.180 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2023-10-06T02:28:33.180 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.180 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr] 2023-10-06T02:28:33.180 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:28:33.180 INFO:teuthology.orchestra.run.smithi191.stdout: debug mgr = 20 2023-10-06T02:28:33.180 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2023-10-06T02:28:33.180 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2023-10-06T02:28:33.181 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:28:33.181 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:28:33.181 INFO:teuthology.orchestra.run.smithi191.stdout: mgr/telemetry/nag = false 2023-10-06T02:28:33.181 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.181 INFO:teuthology.orchestra.run.smithi191.stdout:[mon] 2023-10-06T02:28:33.181 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:28:33.181 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2023-10-06T02:28:33.181 INFO:teuthology.orchestra.run.smithi191.stdout: debug paxos = 20 2023-10-06T02:28:33.181 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2023-10-06T02:28:33.181 INFO:teuthology.orchestra.run.smithi191.stdout: mon data avail warn = 5 2023-10-06T02:28:33.181 INFO:teuthology.orchestra.run.smithi191.stdout: mon mgr mkfs grace = 240 2023-10-06T02:28:33.181 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:28:33.182 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd reporter subtree level = osd 2023-10-06T02:28:33.182 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd prime pg temp = true 2023-10-06T02:28:33.182 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:28:33.182 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.182 INFO:teuthology.orchestra.run.smithi191.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:28:33.182 INFO:teuthology.orchestra.run.smithi191.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:28:33.182 INFO:teuthology.orchestra.run.smithi191.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:28:33.182 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.182 INFO:teuthology.orchestra.run.smithi191.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:28:33.182 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:28:33.182 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:28:33.182 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.183 INFO:teuthology.orchestra.run.smithi191.stdout: # 1m isn't quite enough 2023-10-06T02:28:33.183 INFO:teuthology.orchestra.run.smithi191.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:28:33.183 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.183 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:28:33.183 INFO:teuthology.orchestra.run.smithi191.stdout: mon op complaint time = 120 2023-10-06T02:28:33.183 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.183 INFO:teuthology.orchestra.run.smithi191.stdout:[client] 2023-10-06T02:28:33.183 INFO:teuthology.orchestra.run.smithi191.stdout: rgw cache enabled = true 2023-10-06T02:28:33.183 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable ops log = true 2023-10-06T02:28:33.183 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable usage log = true 2023-10-06T02:28:33.183 INFO:teuthology.orchestra.run.smithi191.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:28:33.183 INFO:teuthology.orchestra.run.smithi191.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:28:33.184 INFO:teuthology.orchestra.run.smithi191.stdout: client mount timeout = 600 2023-10-06T02:28:33.184 INFO:teuthology.orchestra.run.smithi191.stdout: debug client = 20 2023-10-06T02:28:33.184 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:28:33.184 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = "" 2023-10-06T02:28:33.184 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2023-10-06T02:28:33.184 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2023-10-06T02:28:33.184 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.a] 2023-10-06T02:28:33.184 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.b] 2023-10-06T02:28:33.184 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.c] 2023-10-06T02:28:33.184 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.a] 2023-10-06T02:28:33.184 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.c] 2023-10-06T02:28:33.184 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.b] 2023-10-06T02:28:33.185 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.d] 2023-10-06T02:28:33.185 INFO:teuthology.orchestra.run.smithi191.stdout:[mds] 2023-10-06T02:28:33.185 INFO:teuthology.orchestra.run.smithi191.stdout: debug mds = 20 2023-10-06T02:28:33.185 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:28:33.185 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug frag = True 2023-10-06T02:28:33.185 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug scatterstat = False 2023-10-06T02:28:33.185 INFO:teuthology.orchestra.run.smithi191.stdout: mds op complaint time = 180 2023-10-06T02:28:33.185 INFO:teuthology.orchestra.run.smithi191.stdout: mds verify scatter = True 2023-10-06T02:28:33.185 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2023-10-06T02:28:33.185 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2023-10-06T02:28:33.185 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2023-10-06T02:28:33.186 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:28:33.214 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:28:33.256 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2023-10-06T02:28:33.257 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2023-10-06T02:28:33.257 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:28:33.257 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2023-10-06T02:28:33.257 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.257 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2023-10-06T02:28:33.257 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.258 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2023-10-06T02:28:33.258 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.258 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2023-10-06T02:28:33.258 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2023-10-06T02:28:33.258 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.259 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2023-10-06T02:28:33.259 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2023-10-06T02:28:33.259 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.259 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:28:33.259 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2023-10-06T02:28:33.259 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.259 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:28:33.259 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:28:33.259 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.259 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2023-10-06T02:28:33.259 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.259 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2023-10-06T02:28:33.260 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2023-10-06T02:28:33.260 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:28:33.260 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:28:33.260 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2023-10-06T02:28:33.260 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:28:33.260 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2023-10-06T02:28:33.260 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:28:33.261 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:28:33.261 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2023-10-06T02:28:33.261 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.261 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:28:33.261 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.261 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2023-10-06T02:28:33.261 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.261 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2023-10-06T02:28:33.262 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.262 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2023-10-06T02:28:33.262 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2023-10-06T02:28:33.262 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2023-10-06T02:28:33.262 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]" 2023-10-06T02:28:33.262 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = d1f292a2-fd8c-430a-be88-f44de408e77c 2023-10-06T02:28:33.262 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.262 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2023-10-06T02:28:33.262 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2023-10-06T02:28:33.263 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.263 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2023-10-06T02:28:33.263 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2023-10-06T02:28:33.263 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:28:33.263 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.263 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2023-10-06T02:28:33.263 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2023-10-06T02:28:33.263 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.263 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2023-10-06T02:28:33.263 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2023-10-06T02:28:33.263 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2023-10-06T02:28:33.263 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.264 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2023-10-06T02:28:33.264 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2023-10-06T02:28:33.264 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.264 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:28:33.264 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.264 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2023-10-06T02:28:33.264 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.264 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2023-10-06T02:28:33.264 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.264 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:28:33.264 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2023-10-06T02:28:33.264 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.264 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2023-10-06T02:28:33.265 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2023-10-06T02:28:33.265 INFO:teuthology.orchestra.run.smithi037.stdout: bdev async discard = True 2023-10-06T02:28:33.265 INFO:teuthology.orchestra.run.smithi037.stdout: bdev enable discard = True 2023-10-06T02:28:33.265 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore allocator = bitmap 2023-10-06T02:28:33.265 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2023-10-06T02:28:33.265 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2023-10-06T02:28:33.265 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 1/20 2023-10-06T02:28:33.265 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 1/20 2023-10-06T02:28:33.265 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:28:33.265 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2023-10-06T02:28:33.265 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 4/10 2023-10-06T02:28:33.265 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:28:33.266 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2023-10-06T02:28:33.266 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:28:33.266 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:28:33.266 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2023-10-06T02:28:33.266 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-10-06T02:28:33.266 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.266 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2023-10-06T02:28:33.266 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:28:33.266 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2023-10-06T02:28:33.266 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-10-06T02:28:33.266 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-10-06T02:28:33.267 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:28:33.267 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:28:33.267 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2023-10-06T02:28:33.267 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.267 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2023-10-06T02:28:33.267 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:28:33.267 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-10-06T02:28:33.267 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2023-10-06T02:28:33.267 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-10-06T02:28:33.267 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2023-10-06T02:28:33.267 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2023-10-06T02:28:33.267 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:28:33.267 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2023-10-06T02:28:33.268 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2023-10-06T02:28:33.268 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:28:33.268 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.268 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:28:33.268 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:28:33.268 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:28:33.268 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.268 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:28:33.269 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:28:33.269 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:28:33.269 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.269 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2023-10-06T02:28:33.269 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:28:33.269 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.269 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:28:33.270 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2023-10-06T02:28:33.270 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:33.270 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2023-10-06T02:28:33.270 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2023-10-06T02:28:33.270 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2023-10-06T02:28:33.270 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2023-10-06T02:28:33.271 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:28:33.271 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:28:33.271 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2023-10-06T02:28:33.271 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2023-10-06T02:28:33.271 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:28:33.271 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = "" 2023-10-06T02:28:33.271 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-10-06T02:28:33.271 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-10-06T02:28:33.271 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2023-10-06T02:28:33.271 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2023-10-06T02:28:33.271 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2023-10-06T02:28:33.271 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-10-06T02:28:33.272 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-10-06T02:28:33.272 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-10-06T02:28:33.272 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-10-06T02:28:33.272 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2023-10-06T02:28:33.272 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2023-10-06T02:28:33.272 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-10-06T02:28:33.272 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2023-10-06T02:28:33.272 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = True 2023-10-06T02:28:33.272 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2023-10-06T02:28:33.272 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = True 2023-10-06T02:28:33.273 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-10-06T02:28:33.273 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-10-06T02:28:33.273 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-10-06T02:28:33.274 INFO:teuthology.orchestra.run.smithi191.stdout:[global] 2023-10-06T02:28:33.274 INFO:teuthology.orchestra.run.smithi191.stdout: chdir = "" 2023-10-06T02:28:33.275 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:28:33.275 INFO:teuthology.orchestra.run.smithi191.stdout: auth supported = cephx 2023-10-06T02:28:33.275 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.275 INFO:teuthology.orchestra.run.smithi191.stdout: filestore xattr use omap = true 2023-10-06T02:28:33.275 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.275 INFO:teuthology.orchestra.run.smithi191.stdout: mon clock drift allowed = 1.000 2023-10-06T02:28:33.275 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.275 INFO:teuthology.orchestra.run.smithi191.stdout: osd crush chooseleaf type = 0 2023-10-06T02:28:33.275 INFO:teuthology.orchestra.run.smithi191.stdout: auth debug = true 2023-10-06T02:28:33.275 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.276 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on old message = true 2023-10-06T02:28:33.276 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on bug = true 2023-10-06T02:28:33.276 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.276 INFO:teuthology.orchestra.run.smithi191.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:28:33.276 INFO:teuthology.orchestra.run.smithi191.stdout: mon pg warn max object skew = 0 2023-10-06T02:28:33.276 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.276 INFO:teuthology.orchestra.run.smithi191.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:28:33.276 INFO:teuthology.orchestra.run.smithi191.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:28:33.276 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.276 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default size = 2 2023-10-06T02:28:33.277 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.277 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow primary affinity = true 2023-10-06T02:28:33.277 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow pg remap = true 2023-10-06T02:28:33.277 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:28:33.277 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:28:33.277 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on no sortbitwise = false 2023-10-06T02:28:33.277 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:28:33.277 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on too few osds = false 2023-10-06T02:28:33.277 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:28:33.277 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:28:33.277 INFO:teuthology.orchestra.run.smithi191.stdout: mon_allow_pool_size_one = true 2023-10-06T02:28:33.278 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.278 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:28:33.278 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.278 INFO:teuthology.orchestra.run.smithi191.stdout: osd default data pool replay window = 5 2023-10-06T02:28:33.278 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.278 INFO:teuthology.orchestra.run.smithi191.stdout: mon allow pool delete = true 2023-10-06T02:28:33.278 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.278 INFO:teuthology.orchestra.run.smithi191.stdout: mon cluster log file level = debug 2023-10-06T02:28:33.278 INFO:teuthology.orchestra.run.smithi191.stdout: debug asserts on shutdown = true 2023-10-06T02:28:33.278 INFO:teuthology.orchestra.run.smithi191.stdout: mon health detail to clog = false 2023-10-06T02:28:33.278 INFO:teuthology.orchestra.run.smithi191.stdout: mon host = "172.21.15.37,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]" 2023-10-06T02:28:33.278 INFO:teuthology.orchestra.run.smithi191.stdout: fsid = d1f292a2-fd8c-430a-be88-f44de408e77c 2023-10-06T02:28:33.279 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.279 INFO:teuthology.orchestra.run.smithi191.stdout:[osd] 2023-10-06T02:28:33.279 INFO:teuthology.orchestra.run.smithi191.stdout: osd journal size = 100 2023-10-06T02:28:33.279 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.279 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub load threshold = 5.0 2023-10-06T02:28:33.279 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub max interval = 600 2023-10-06T02:28:33.279 INFO:teuthology.orchestra.run.smithi191.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:28:33.279 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.279 INFO:teuthology.orchestra.run.smithi191.stdout: osd recover clone overlap = true 2023-10-06T02:28:33.279 INFO:teuthology.orchestra.run.smithi191.stdout: osd recovery max chunk = 1048576 2023-10-06T02:28:33.279 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.279 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug shutdown = true 2023-10-06T02:28:33.280 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug op order = true 2023-10-06T02:28:33.280 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug verify stray on activate = true 2023-10-06T02:28:33.280 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.280 INFO:teuthology.orchestra.run.smithi191.stdout: osd open classes on start = true 2023-10-06T02:28:33.280 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug pg log writeout = true 2023-10-06T02:28:33.280 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.280 INFO:teuthology.orchestra.run.smithi191.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:28:33.280 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.280 INFO:teuthology.orchestra.run.smithi191.stdout: osd map max advance = 10 2023-10-06T02:28:33.280 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.280 INFO:teuthology.orchestra.run.smithi191.stdout: journal zero on create = true 2023-10-06T02:28:33.281 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.281 INFO:teuthology.orchestra.run.smithi191.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:28:33.281 INFO:teuthology.orchestra.run.smithi191.stdout: filestore apply finisher threads = 3 2023-10-06T02:28:33.281 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.281 INFO:teuthology.orchestra.run.smithi191.stdout: bdev debug aio = true 2023-10-06T02:28:33.281 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug misdirected ops = true 2023-10-06T02:28:33.281 INFO:teuthology.orchestra.run.smithi191.stdout: bdev async discard = True 2023-10-06T02:28:33.281 INFO:teuthology.orchestra.run.smithi191.stdout: bdev enable discard = True 2023-10-06T02:28:33.281 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore allocator = bitmap 2023-10-06T02:28:33.281 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore block size = 96636764160 2023-10-06T02:28:33.281 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore fsck on mount = True 2023-10-06T02:28:33.281 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluefs = 1/20 2023-10-06T02:28:33.281 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluestore = 1/20 2023-10-06T02:28:33.282 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:28:33.282 INFO:teuthology.orchestra.run.smithi191.stdout: debug osd = 20 2023-10-06T02:28:33.282 INFO:teuthology.orchestra.run.smithi191.stdout: debug rocksdb = 4/10 2023-10-06T02:28:33.282 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:28:33.282 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd full ratio = 0.9 2023-10-06T02:28:33.282 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:28:33.282 INFO:teuthology.orchestra.run.smithi191.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:28:33.282 INFO:teuthology.orchestra.run.smithi191.stdout: osd objectstore = bluestore 2023-10-06T02:28:33.282 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2023-10-06T02:28:33.282 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.283 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr] 2023-10-06T02:28:33.283 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:28:33.283 INFO:teuthology.orchestra.run.smithi191.stdout: debug mgr = 20 2023-10-06T02:28:33.283 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2023-10-06T02:28:33.283 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2023-10-06T02:28:33.283 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:28:33.283 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:28:33.283 INFO:teuthology.orchestra.run.smithi191.stdout: mgr/telemetry/nag = false 2023-10-06T02:28:33.283 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.283 INFO:teuthology.orchestra.run.smithi191.stdout:[mon] 2023-10-06T02:28:33.283 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:28:33.284 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2023-10-06T02:28:33.284 INFO:teuthology.orchestra.run.smithi191.stdout: debug paxos = 20 2023-10-06T02:28:33.284 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2023-10-06T02:28:33.284 INFO:teuthology.orchestra.run.smithi191.stdout: mon data avail warn = 5 2023-10-06T02:28:33.284 INFO:teuthology.orchestra.run.smithi191.stdout: mon mgr mkfs grace = 240 2023-10-06T02:28:33.284 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:28:33.284 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd reporter subtree level = osd 2023-10-06T02:28:33.284 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd prime pg temp = true 2023-10-06T02:28:33.284 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:28:33.284 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.284 INFO:teuthology.orchestra.run.smithi191.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:28:33.284 INFO:teuthology.orchestra.run.smithi191.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:28:33.285 INFO:teuthology.orchestra.run.smithi191.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:28:33.285 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.285 INFO:teuthology.orchestra.run.smithi191.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:28:33.285 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:28:33.285 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:28:33.285 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.285 INFO:teuthology.orchestra.run.smithi191.stdout: # 1m isn't quite enough 2023-10-06T02:28:33.285 INFO:teuthology.orchestra.run.smithi191.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:28:33.285 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.285 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:28:33.285 INFO:teuthology.orchestra.run.smithi191.stdout: mon op complaint time = 120 2023-10-06T02:28:33.285 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-06T02:28:33.285 INFO:teuthology.orchestra.run.smithi191.stdout:[client] 2023-10-06T02:28:33.286 INFO:teuthology.orchestra.run.smithi191.stdout: rgw cache enabled = true 2023-10-06T02:28:33.286 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable ops log = true 2023-10-06T02:28:33.286 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable usage log = true 2023-10-06T02:28:33.286 INFO:teuthology.orchestra.run.smithi191.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:28:33.286 INFO:teuthology.orchestra.run.smithi191.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:28:33.286 INFO:teuthology.orchestra.run.smithi191.stdout: client mount timeout = 600 2023-10-06T02:28:33.286 INFO:teuthology.orchestra.run.smithi191.stdout: debug client = 20 2023-10-06T02:28:33.286 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:28:33.286 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = "" 2023-10-06T02:28:33.286 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2023-10-06T02:28:33.286 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2023-10-06T02:28:33.286 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.a] 2023-10-06T02:28:33.287 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.b] 2023-10-06T02:28:33.287 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.c] 2023-10-06T02:28:33.287 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.a] 2023-10-06T02:28:33.287 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.c] 2023-10-06T02:28:33.287 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.b] 2023-10-06T02:28:33.287 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.d] 2023-10-06T02:28:33.287 INFO:teuthology.orchestra.run.smithi191.stdout:[mds] 2023-10-06T02:28:33.287 INFO:teuthology.orchestra.run.smithi191.stdout: debug mds = 20 2023-10-06T02:28:33.287 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-06T02:28:33.287 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug frag = True 2023-10-06T02:28:33.287 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug scatterstat = True 2023-10-06T02:28:33.287 INFO:teuthology.orchestra.run.smithi191.stdout: mds op complaint time = 180 2023-10-06T02:28:33.288 INFO:teuthology.orchestra.run.smithi191.stdout: mds verify scatter = True 2023-10-06T02:28:33.288 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2023-10-06T02:28:33.288 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2023-10-06T02:28:33.288 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2023-10-06T02:28:33.288 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T02:28:33.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.438+0000 7f6df6276700 1 Processor -- start 2023-10-06T02:28:33.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.438+0000 7f6df6276700 1 -- start start 2023-10-06T02:28:33.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.439+0000 7f6df6276700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6df00b45f0 0x7f6df00b3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.439+0000 7f6df6276700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6df00b3bb0 0x7f6df00aa560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.439+0000 7f6df6276700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df00b4a70 con 0x7f6df0159670 2023-10-06T02:28:33.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.439+0000 7f6df6276700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df00b4050 con 0x7f6df00b45f0 2023-10-06T02:28:33.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.439+0000 7f6df6276700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df00cef20 con 0x7f6df00b3bb0 2023-10-06T02:28:33.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.439+0000 7f6df5274700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6df0159670 0x7f6df00ce700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36608/0 (socket says 172.21.15.37:36608) 2023-10-06T02:28:33.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.439+0000 7f6df5274700 1 -- 172.21.15.37:0/2779150514 learned_addr learned my addr 172.21.15.37:0/2779150514 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:33.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.439+0000 7f6df4a73700 1 --2- 172.21.15.37:0/2779150514 >> v2:172.21.15.191:3300/0 conn(0x7f6df00b45f0 0x7f6df00b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.439+0000 7f6df5a75700 1 --2- 172.21.15.37:0/2779150514 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6df00b3bb0 0x7f6df00aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.439+0000 7f6deffff700 1 -- 172.21.15.37:0/2779150514 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932838507 0 0) 0x7f6df00b4a70 con 0x7f6df0159670 2023-10-06T02:28:33.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.439+0000 7f6deffff700 1 -- 172.21.15.37:0/2779150514 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dd8003570 con 0x7f6df0159670 2023-10-06T02:28:33.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6deffff700 1 -- 172.21.15.37:0/2779150514 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2531524538 0 0) 0x7f6dd8003570 con 0x7f6df0159670 2023-10-06T02:28:33.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6deffff700 1 -- 172.21.15.37:0/2779150514 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6df00b3bb0 msgr2=0x7f6df00aa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:33.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6deffff700 1 --2- 172.21.15.37:0/2779150514 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6df00b3bb0 0x7f6df00aa560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6deffff700 1 -- 172.21.15.37:0/2779150514 >> v2:172.21.15.191:3300/0 conn(0x7f6df00b45f0 msgr2=0x7f6df00b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:33.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6deffff700 1 --2- 172.21.15.37:0/2779150514 >> v2:172.21.15.191:3300/0 conn(0x7f6df00b45f0 0x7f6df00b3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6deffff700 1 -- 172.21.15.37:0/2779150514 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df00cf200 con 0x7f6df0159670 2023-10-06T02:28:33.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6deffff700 1 -- 172.21.15.37:0/2779150514 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f6de8001470 con 0x7f6df0159670 2023-10-06T02:28:33.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6deffff700 1 -- 172.21.15.37:0/2779150514 >> v1:172.21.15.37:6789/0 conn(0x7f6df0159670 legacy=0x7f6df00ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6deffff700 1 --2- 172.21.15.37:0/2779150514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd8003a60 0x7f6dd8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6deffff700 1 --2- 172.21.15.37:0/2779150514 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6df00b3bb0 0x7f6dd8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6deffff700 1 --2- 172.21.15.37:0/2779150514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dd8004d50 0x7f6dd80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6deffff700 1 -- 172.21.15.37:0/2779150514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df00b4050 con 0x7f6dd8003a60 2023-10-06T02:28:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6deffff700 1 -- 172.21.15.37:0/2779150514 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df00cef20 con 0x7f6dd8004d50 2023-10-06T02:28:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6deffff700 1 -- 172.21.15.37:0/2779150514 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd800ba60 con 0x7f6df00b3bb0 2023-10-06T02:28:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6df4a73700 1 --2- 172.21.15.37:0/2779150514 >> v2:172.21.15.191:3300/0 conn(0x7f6df00b45f0 0x7f6df00b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6df5274700 1 --2- 172.21.15.37:0/2779150514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd8003a60 0x7f6dd8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6df5a75700 1 --2- 172.21.15.37:0/2779150514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dd8004d50 0x7f6dd80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6df4a73700 1 --2- 172.21.15.37:0/2779150514 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6df00b3bb0 0x7f6dd8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6df5274700 1 -- 172.21.15.37:0/2779150514 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6df00b3bb0 msgr2=0x7f6dd8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:33.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6df5274700 1 --2- 172.21.15.37:0/2779150514 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6df00b3bb0 0x7f6dd8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6df5274700 1 -- 172.21.15.37:0/2779150514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dd8004d50 msgr2=0x7f6dd80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:33.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6df5274700 1 --2- 172.21.15.37:0/2779150514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dd8004d50 0x7f6dd80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6df5274700 1 -- 172.21.15.37:0/2779150514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd8003570 con 0x7f6dd8003a60 2023-10-06T02:28:33.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6df5274700 1 --2- 172.21.15.37:0/2779150514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd8003a60 0x7f6dd8003e70 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f6de800c3c0 tx=0x7f6de8001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e056f532589f2eb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:33.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.440+0000 7f6deffff700 1 -- 172.21.15.37:0/2779150514 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de800cc30 con 0x7f6dd8003a60 2023-10-06T02:28:33.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.441+0000 7f6deffff700 1 -- 172.21.15.37:0/2779150514 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de800cdb0 con 0x7f6dd8003a60 2023-10-06T02:28:33.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.441+0000 7f6deffff700 1 -- 172.21.15.37:0/2779150514 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de8005b70 con 0x7f6dd8003a60 2023-10-06T02:28:33.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.441+0000 7f6df6276700 1 -- 172.21.15.37:0/2779150514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd8003a60 msgr2=0x7f6dd8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:33.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.441+0000 7f6df6276700 1 --2- 172.21.15.37:0/2779150514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd8003a60 0x7f6dd8003e70 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f6de800c3c0 tx=0x7f6de8001e90 comp rx=0 tx=0).stop 2023-10-06T02:28:33.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.441+0000 7f6df5a75700 1 -- 172.21.15.37:0/2779150514 reap_dead start 2023-10-06T02:28:33.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.441+0000 7f6df6276700 1 -- 172.21.15.37:0/2779150514 shutdown_connections 2023-10-06T02:28:33.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.441+0000 7f6df6276700 1 -- 172.21.15.37:0/2779150514 >> 172.21.15.37:0/2779150514 conn(0x7f6df0099610 msgr2=0x7f6df006c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:33.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.441+0000 7f6df6276700 1 -- 172.21.15.37:0/2779150514 shutdown_connections 2023-10-06T02:28:33.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.441+0000 7f6df6276700 1 -- 172.21.15.37:0/2779150514 wait complete. 2023-10-06T02:28:33.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.442+0000 7f6df6276700 1 Processor -- start 2023-10-06T02:28:33.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.442+0000 7f6df6276700 1 -- start start 2023-10-06T02:28:33.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.443+0000 7f6df6276700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6dd8003a60 0x7f6df00cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.443+0000 7f6df6276700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6df00c5540 0x7f6df009bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.443+0000 7f6df6276700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6df009d780 0x7f6df014a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.443+0000 7f6df6276700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df00cba80 con 0x7f6df009d780 2023-10-06T02:28:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.443+0000 7f6df6276700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df009c6e0 con 0x7f6df00c5540 2023-10-06T02:28:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.443+0000 7f6df6276700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df009c9c0 con 0x7f6dd8003a60 2023-10-06T02:28:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.443+0000 7f6df5a75700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6df009d780 0x7f6df014a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.443+0000 7f6df5a75700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6df009d780 0x7f6df014a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33114/0 (socket says 172.21.15.37:33114) 2023-10-06T02:28:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.443+0000 7f6df5a75700 1 -- 172.21.15.37:0/532154303 learned_addr learned my addr 172.21.15.37:0/532154303 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.443+0000 7f6df4a73700 1 --2- 172.21.15.37:0/532154303 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6df00c5540 0x7f6df009bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.443+0000 7f6df5274700 1 --2- 172.21.15.37:0/532154303 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6dd8003a60 0x7f6df00cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.443+0000 7f6df5a75700 1 -- 172.21.15.37:0/532154303 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6dd8003a60 msgr2=0x7f6df00cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.443+0000 7f6df5a75700 1 --2- 172.21.15.37:0/532154303 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6dd8003a60 0x7f6df00cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.443+0000 7f6df5a75700 1 -- 172.21.15.37:0/532154303 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6df00c5540 msgr2=0x7f6df009bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.443+0000 7f6df5a75700 1 --2- 172.21.15.37:0/532154303 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6df00c5540 0x7f6df009bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.443+0000 7f6df5a75700 1 -- 172.21.15.37:0/532154303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df009cca0 con 0x7f6df009d780 2023-10-06T02:28:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.444+0000 7f6df5a75700 1 --2- 172.21.15.37:0/532154303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6df009d780 0x7f6df014a040 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6df015d250 tx=0x7f6de000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.444+0000 7f6ded7fa700 1 -- 172.21.15.37:0/532154303 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de000e040 con 0x7f6df009d780 2023-10-06T02:28:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.444+0000 7f6ded7fa700 1 -- 172.21.15.37:0/532154303 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de000f040 con 0x7f6df009d780 2023-10-06T02:28:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.444+0000 7f6df6276700 1 -- 172.21.15.37:0/532154303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df009cf80 con 0x7f6df009d780 2023-10-06T02:28:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.444+0000 7f6ded7fa700 1 -- 172.21.15.37:0/532154303 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de000fd70 con 0x7f6df009d780 2023-10-06T02:28:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.444+0000 7f6df6276700 1 -- 172.21.15.37:0/532154303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df009c2f0 con 0x7f6df009d780 2023-10-06T02:28:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.445+0000 7f6df6276700 1 -- 172.21.15.37:0/532154303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df00884f0 con 0x7f6df009d780 2023-10-06T02:28:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.445+0000 7f6ded7fa700 1 -- 172.21.15.37:0/532154303 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6de0015640 con 0x7f6df009d780 2023-10-06T02:28:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.446+0000 7f6ded7fa700 1 --2- 172.21.15.37:0/532154303 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ddc066f30 0x7f6ddc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.446+0000 7f6ded7fa700 1 -- 172.21.15.37:0/532154303 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f6de0084fd0 con 0x7f6df009d780 2023-10-06T02:28:33.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.446+0000 7f6df5274700 1 --2- 172.21.15.37:0/532154303 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ddc066f30 0x7f6ddc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:33.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.446+0000 7f6df5274700 1 --2- 172.21.15.37:0/532154303 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ddc066f30 0x7f6ddc0693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6de8001ed0 tx=0x7f6de8015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:33.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.450+0000 7f6ded7fa700 1 -- 172.21.15.37:0/532154303 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6de0051f90 con 0x7f6df009d780 2023-10-06T02:28:33.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:33.690+0000 7f6df6276700 1 -- 172.21.15.37:0/532154303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f6df0064b00 con 0x7f6df009d780 2023-10-06T02:28:34.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.694+0000 7f6ded7fa700 1 -- 172.21.15.37:0/532154303 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v56) v1 ==== 162+0+0 (secure 0 0 0) 0x7f6de00555b0 con 0x7f6df009d780 2023-10-06T02:28:34.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.697+0000 7f6df6276700 1 -- 172.21.15.37:0/532154303 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ddc066f30 msgr2=0x7f6ddc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:34.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.697+0000 7f6df6276700 1 --2- 172.21.15.37:0/532154303 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ddc066f30 0x7f6ddc0693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6de8001ed0 tx=0x7f6de8015000 comp rx=0 tx=0).stop 2023-10-06T02:28:34.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.697+0000 7f6df6276700 1 -- 172.21.15.37:0/532154303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6df009d780 msgr2=0x7f6df014a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:34.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.697+0000 7f6df6276700 1 --2- 172.21.15.37:0/532154303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6df009d780 0x7f6df014a040 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6df015d250 tx=0x7f6de000b040 comp rx=0 tx=0).stop 2023-10-06T02:28:34.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.697+0000 7f6df6276700 1 -- 172.21.15.37:0/532154303 shutdown_connections 2023-10-06T02:28:34.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.697+0000 7f6df6276700 1 --2- 172.21.15.37:0/532154303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6df009d780 0x7f6df014a040 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:34.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.697+0000 7f6df6276700 1 --2- 172.21.15.37:0/532154303 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6dd8003a60 0x7f6df00cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:34.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.697+0000 7f6df6276700 1 --2- 172.21.15.37:0/532154303 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6ddc066f30 0x7f6ddc0693e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:34.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.697+0000 7f6df6276700 1 --2- 172.21.15.37:0/532154303 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6df00c5540 0x7f6df009bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:34.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.697+0000 7f6df6276700 1 -- 172.21.15.37:0/532154303 >> 172.21.15.37:0/532154303 conn(0x7f6df0099610 msgr2=0x7f6df00b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:34.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.698+0000 7f6df6276700 1 -- 172.21.15.37:0/532154303 shutdown_connections 2023-10-06T02:28:34.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.698+0000 7f6df6276700 1 -- 172.21.15.37:0/532154303 wait complete. 2023-10-06T02:28:34.699 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T02:28:34.715 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:34.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.841+0000 7fb43c656700 1 Processor -- start 2023-10-06T02:28:34.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.841+0000 7fb43c656700 1 -- start start 2023-10-06T02:28:34.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.842+0000 7fb43c656700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb434159760 0x7fb43415d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:34.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.842+0000 7fb43c656700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb43415d8d0 0x7fb43415dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:34.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.842+0000 7fb43c656700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb4340c5390 0x7fb4340c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:34.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.842+0000 7fb43c656700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4340cc2d0 con 0x7fb434159760 2023-10-06T02:28:34.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.842+0000 7fb43c656700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43415e260 con 0x7fb4340c5390 2023-10-06T02:28:34.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.842+0000 7fb43c656700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340cb650 con 0x7fb43415d8d0 2023-10-06T02:28:34.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.842+0000 7fb43a3f2700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb434159760 0x7fb43415d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:34.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.842+0000 7fb43a3f2700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb434159760 0x7fb43415d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33126/0 (socket says 172.21.15.37:33126) 2023-10-06T02:28:34.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.842+0000 7fb43a3f2700 1 -- 172.21.15.37:0/3845170481 learned_addr learned my addr 172.21.15.37:0/3845170481 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:34.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.842+0000 7fb43abf3700 1 --2- 172.21.15.37:0/3845170481 >> v2:172.21.15.191:3300/0 conn(0x7fb4340c5390 0x7fb4340c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:34.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.842+0000 7fb439bf1700 1 --2- 172.21.15.37:0/3845170481 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb43415d8d0 0x7fb43415dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:34.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.842+0000 7fb43a3f2700 1 -- 172.21.15.37:0/3845170481 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb43415d8d0 msgr2=0x7fb43415dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:34.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.842+0000 7fb43a3f2700 1 --2- 172.21.15.37:0/3845170481 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb43415d8d0 0x7fb43415dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:34.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.842+0000 7fb43a3f2700 1 -- 172.21.15.37:0/3845170481 >> v2:172.21.15.191:3300/0 conn(0x7fb4340c5390 msgr2=0x7fb4340c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:34.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.842+0000 7fb43a3f2700 1 --2- 172.21.15.37:0/3845170481 >> v2:172.21.15.191:3300/0 conn(0x7fb4340c5390 0x7fb4340c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:34.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.842+0000 7fb43a3f2700 1 -- 172.21.15.37:0/3845170481 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4340cb930 con 0x7fb434159760 2023-10-06T02:28:34.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.842+0000 7fb43a3f2700 1 --2- 172.21.15.37:0/3845170481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb434159760 0x7fb43415d390 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fb434089980 tx=0x7fb430009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33abeee56af33724 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:34.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.842+0000 7fb4393f0700 1 -- 172.21.15.37:0/3845170481 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43000b8f0 con 0x7fb434159760 2023-10-06T02:28:34.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.842+0000 7fb4393f0700 1 -- 172.21.15.37:0/3845170481 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43000ba50 con 0x7fb434159760 2023-10-06T02:28:34.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.843+0000 7fb4393f0700 1 -- 172.21.15.37:0/3845170481 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43000bdf0 con 0x7fb434159760 2023-10-06T02:28:34.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.843+0000 7fb43c656700 1 -- 172.21.15.37:0/3845170481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb434159760 msgr2=0x7fb43415d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:34.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.843+0000 7fb43c656700 1 --2- 172.21.15.37:0/3845170481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb434159760 0x7fb43415d390 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fb434089980 tx=0x7fb430009250 comp rx=0 tx=0).stop 2023-10-06T02:28:34.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.843+0000 7fb43c656700 1 -- 172.21.15.37:0/3845170481 shutdown_connections 2023-10-06T02:28:34.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.843+0000 7fb43c656700 1 --2- 172.21.15.37:0/3845170481 >> v2:172.21.15.191:3300/0 conn(0x7fb4340c5390 0x7fb4340c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:34.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.843+0000 7fb43c656700 1 --2- 172.21.15.37:0/3845170481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb434159760 0x7fb43415d390 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:34.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.843+0000 7fb43c656700 1 --2- 172.21.15.37:0/3845170481 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb43415d8d0 0x7fb43415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:34.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.843+0000 7fb43c656700 1 -- 172.21.15.37:0/3845170481 >> 172.21.15.37:0/3845170481 conn(0x7fb43406c890 msgr2=0x7fb4340d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:34.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.843+0000 7fb43c656700 1 -- 172.21.15.37:0/3845170481 shutdown_connections 2023-10-06T02:28:34.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.843+0000 7fb43c656700 1 -- 172.21.15.37:0/3845170481 wait complete. 2023-10-06T02:28:34.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.844+0000 7fb43c656700 1 Processor -- start 2023-10-06T02:28:34.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.844+0000 7fb43c656700 1 -- start start 2023-10-06T02:28:34.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.845+0000 7fb43c656700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4340c5390 0x7fb4340b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:34.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.845+0000 7fb43c656700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb434159760 0x7fb4341551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:34.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.845+0000 7fb43c656700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb43415d8d0 0x7fb434148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:34.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.845+0000 7fb43c656700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4341556e0 con 0x7fb43415d8d0 2023-10-06T02:28:34.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.845+0000 7fb43c656700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4341485a0 con 0x7fb4340c5390 2023-10-06T02:28:34.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.845+0000 7fb43c656700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4341558f0 con 0x7fb434159760 2023-10-06T02:28:34.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.845+0000 7fb43abf3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb43415d8d0 0x7fb434148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:34.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.845+0000 7fb43abf3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb43415d8d0 0x7fb434148060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33132/0 (socket says 172.21.15.37:33132) 2023-10-06T02:28:34.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.845+0000 7fb43abf3700 1 -- 172.21.15.37:0/1984317678 learned_addr learned my addr 172.21.15.37:0/1984317678 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:34.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.845+0000 7fb43a3f2700 1 --2- 172.21.15.37:0/1984317678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4340c5390 0x7fb4340b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:34.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.845+0000 7fb439bf1700 1 --2- 172.21.15.37:0/1984317678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb434159760 0x7fb4341551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:34.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.845+0000 7fb43abf3700 1 -- 172.21.15.37:0/1984317678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb434159760 msgr2=0x7fb4341551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:34.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.845+0000 7fb43abf3700 1 --2- 172.21.15.37:0/1984317678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb434159760 0x7fb4341551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:34.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.845+0000 7fb43abf3700 1 -- 172.21.15.37:0/1984317678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4340c5390 msgr2=0x7fb4340b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:34.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.845+0000 7fb43abf3700 1 --2- 172.21.15.37:0/1984317678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4340c5390 0x7fb4340b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:34.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.845+0000 7fb43abf3700 1 -- 172.21.15.37:0/1984317678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4300094f0 con 0x7fb43415d8d0 2023-10-06T02:28:34.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.846+0000 7fb43abf3700 1 --2- 172.21.15.37:0/1984317678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb43415d8d0 0x7fb434148060 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fb42c007f20 tx=0x7fb42c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:34.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.846+0000 7fb42a7fc700 1 -- 172.21.15.37:0/1984317678 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c00eb90 con 0x7fb43415d8d0 2023-10-06T02:28:34.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.846+0000 7fb42a7fc700 1 -- 172.21.15.37:0/1984317678 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42c00ed10 con 0x7fb43415d8d0 2023-10-06T02:28:34.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.846+0000 7fb43c656700 1 -- 172.21.15.37:0/1984317678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb434155bd0 con 0x7fb43415d8d0 2023-10-06T02:28:34.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.846+0000 7fb42a7fc700 1 -- 172.21.15.37:0/1984317678 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c014670 con 0x7fb43415d8d0 2023-10-06T02:28:34.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.846+0000 7fb43c656700 1 -- 172.21.15.37:0/1984317678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb434156190 con 0x7fb43415d8d0 2023-10-06T02:28:34.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.847+0000 7fb43c656700 1 -- 172.21.15.37:0/1984317678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43415d280 con 0x7fb43415d8d0 2023-10-06T02:28:34.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.847+0000 7fb42a7fc700 1 -- 172.21.15.37:0/1984317678 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb42c0149e0 con 0x7fb43415d8d0 2023-10-06T02:28:34.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.848+0000 7fb42a7fc700 1 --2- 172.21.15.37:0/1984317678 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb418066f30 0x7fb4180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:34.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.848+0000 7fb42a7fc700 1 -- 172.21.15.37:0/1984317678 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fb42c084cc0 con 0x7fb43415d8d0 2023-10-06T02:28:34.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.848+0000 7fb43a3f2700 1 --2- 172.21.15.37:0/1984317678 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb418066f30 0x7fb4180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:34.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.848+0000 7fb43a3f2700 1 --2- 172.21.15.37:0/1984317678 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb418066f30 0x7fb4180693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb434089980 tx=0x7fb430017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:34.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:34.852+0000 7fb42a7fc700 1 -- 172.21.15.37:0/1984317678 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb42c051d20 con 0x7fb43415d8d0 2023-10-06T02:28:35.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:35.088+0000 7fb43c656700 1 -- 172.21.15.37:0/1984317678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb43406fbf0 con 0x7fb43415d8d0 2023-10-06T02:28:35.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:35.088+0000 7fb42a7fc700 1 -- 172.21.15.37:0/1984317678 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4606 (secure 0 0 0) 0x7fb42c055340 con 0x7fb43415d8d0 2023-10-06T02:28:35.089 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:35.089 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":57,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3055524642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3055524642},{"type":"v1","addr":"172.21.15.37:6835","nonce":3055524642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2821947660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2821947660},{"type":"v1","addr":"172.21.15.191:6836","nonce":2821947660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6310,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3752119173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3752119173},{"type":"v1","addr":"172.21.15.191:6837","nonce":3752119173}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:27:43.200836+0000","modified":"2023-10-06T02:28:34.695229+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6840},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6840":{"gid":6840,"name":"c","rank":0,"incarnation":57,"state":"up:replay","state_seq":1,"addr":"172.21.15.37:6834/1787333914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1787333914},{"type":"v1","addr":"172.21.15.37:6834","nonce":1787333914}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:28:35.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:35.091+0000 7fb43c656700 1 -- 172.21.15.37:0/1984317678 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb418066f30 msgr2=0x7fb4180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:35.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:35.091+0000 7fb43c656700 1 --2- 172.21.15.37:0/1984317678 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb418066f30 0x7fb4180693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb434089980 tx=0x7fb430017000 comp rx=0 tx=0).stop 2023-10-06T02:28:35.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:35.091+0000 7fb43c656700 1 -- 172.21.15.37:0/1984317678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb43415d8d0 msgr2=0x7fb434148060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:35.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:35.091+0000 7fb43c656700 1 --2- 172.21.15.37:0/1984317678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb43415d8d0 0x7fb434148060 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fb42c007f20 tx=0x7fb42c009860 comp rx=0 tx=0).stop 2023-10-06T02:28:35.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:35.091+0000 7fb43c656700 1 -- 172.21.15.37:0/1984317678 shutdown_connections 2023-10-06T02:28:35.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:35.091+0000 7fb43c656700 1 --2- 172.21.15.37:0/1984317678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb43415d8d0 0x7fb434148060 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:35.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:35.091+0000 7fb43c656700 1 --2- 172.21.15.37:0/1984317678 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb418066f30 0x7fb4180693e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:35.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:35.091+0000 7fb43c656700 1 --2- 172.21.15.37:0/1984317678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4340c5390 0x7fb4340b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:35.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:35.091+0000 7fb43c656700 1 --2- 172.21.15.37:0/1984317678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb434159760 0x7fb4341551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:35.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:35.091+0000 7fb43c656700 1 -- 172.21.15.37:0/1984317678 >> 172.21.15.37:0/1984317678 conn(0x7fb43406c890 msgr2=0x7fb4340c9620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:35.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:35.091+0000 7fb43c656700 1 -- 172.21.15.37:0/1984317678 shutdown_connections 2023-10-06T02:28:35.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:35.091+0000 7fb43c656700 1 -- 172.21.15.37:0/1984317678 wait complete. 2023-10-06T02:28:35.093 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 57 2023-10-06T02:28:35.506 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:27:43.200836+0000', 'modified': '2023-10-06T02:28:34.695229+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 74, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6840}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6840': {'gid': 6840, 'name': 'c', 'rank': 0, 'incarnation': 57, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.37:6834/1787333914', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 1787333914}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 1787333914}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:28:35.506 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6840:up:replay 2023-10-06T02:28:36.507 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:36.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.639+0000 7fd575359700 1 Processor -- start 2023-10-06T02:28:36.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.639+0000 7fd575359700 1 -- start start 2023-10-06T02:28:36.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.640+0000 7fd575359700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd5700cd9f0 0x7fd57006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:36.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.640+0000 7fd575359700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd570159b10 0x7fd5700b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:36.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.640+0000 7fd575359700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd5700cddc0 0x7fd570067990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:36.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.640+0000 7fd575359700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd570159ff0 con 0x7fd570159b10 2023-10-06T02:28:36.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.640+0000 7fd575359700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57015a2d0 con 0x7fd5700cd9f0 2023-10-06T02:28:36.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.640+0000 7fd575359700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57015a5b0 con 0x7fd5700cddc0 2023-10-06T02:28:36.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.640+0000 7fd56f7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd570159b10 0x7fd5700b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:36.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.640+0000 7fd56f7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd570159b10 0x7fd5700b17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56542/0 (socket says 172.21.15.37:56542) 2023-10-06T02:28:36.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.640+0000 7fd56f7fe700 1 -- 172.21.15.37:0/2086703832 learned_addr learned my addr 172.21.15.37:0/2086703832 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:36.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.640+0000 7fd56ffff700 1 --2- 172.21.15.37:0/2086703832 >> v2:172.21.15.191:3300/0 conn(0x7fd5700cd9f0 0x7fd57006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:36.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.640+0000 7fd574b58700 1 --2- 172.21.15.37:0/2086703832 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd5700cddc0 0x7fd570067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:36.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.641+0000 7fd56f7fe700 1 -- 172.21.15.37:0/2086703832 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd5700cddc0 msgr2=0x7fd570067990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:36.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.641+0000 7fd56f7fe700 1 --2- 172.21.15.37:0/2086703832 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd5700cddc0 0x7fd570067990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.641+0000 7fd56f7fe700 1 -- 172.21.15.37:0/2086703832 >> v2:172.21.15.191:3300/0 conn(0x7fd5700cd9f0 msgr2=0x7fd57006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:36.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.641+0000 7fd56f7fe700 1 --2- 172.21.15.37:0/2086703832 >> v2:172.21.15.191:3300/0 conn(0x7fd5700cd9f0 0x7fd57006d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.641+0000 7fd56f7fe700 1 -- 172.21.15.37:0/2086703832 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57015a890 con 0x7fd570159b10 2023-10-06T02:28:36.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.641+0000 7fd56f7fe700 1 --2- 172.21.15.37:0/2086703832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd570159b10 0x7fd5700b17d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fd57006b040 tx=0x7fd564009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4de6dbd7a766795 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:36.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.641+0000 7fd56effd700 1 -- 172.21.15.37:0/2086703832 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400b860 con 0x7fd570159b10 2023-10-06T02:28:36.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.641+0000 7fd56effd700 1 -- 172.21.15.37:0/2086703832 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56400b9c0 con 0x7fd570159b10 2023-10-06T02:28:36.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.641+0000 7fd56effd700 1 -- 172.21.15.37:0/2086703832 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400bd60 con 0x7fd570159b10 2023-10-06T02:28:36.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.641+0000 7fd575359700 1 -- 172.21.15.37:0/2086703832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd570159b10 msgr2=0x7fd5700b17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:36.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.641+0000 7fd575359700 1 --2- 172.21.15.37:0/2086703832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd570159b10 0x7fd5700b17d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fd57006b040 tx=0x7fd564009250 comp rx=0 tx=0).stop 2023-10-06T02:28:36.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.642+0000 7fd575359700 1 -- 172.21.15.37:0/2086703832 shutdown_connections 2023-10-06T02:28:36.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.642+0000 7fd575359700 1 --2- 172.21.15.37:0/2086703832 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd5700cddc0 0x7fd570067990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.642+0000 7fd575359700 1 --2- 172.21.15.37:0/2086703832 >> v2:172.21.15.191:3300/0 conn(0x7fd5700cd9f0 0x7fd57006d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.642+0000 7fd575359700 1 --2- 172.21.15.37:0/2086703832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd570159b10 0x7fd5700b17d0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.642+0000 7fd575359700 1 -- 172.21.15.37:0/2086703832 >> 172.21.15.37:0/2086703832 conn(0x7fd5700ce280 msgr2=0x7fd5700ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:36.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.642+0000 7fd575359700 1 -- 172.21.15.37:0/2086703832 shutdown_connections 2023-10-06T02:28:36.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.642+0000 7fd575359700 1 -- 172.21.15.37:0/2086703832 wait complete. 2023-10-06T02:28:36.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.643+0000 7fd575359700 1 Processor -- start 2023-10-06T02:28:36.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.643+0000 7fd575359700 1 -- start start 2023-10-06T02:28:36.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd575359700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5700cd9f0 0x7fd57013bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:36.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd575359700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5700cddc0 0x7fd570158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:36.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd575359700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd570159b10 0x7fd570158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:36.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd575359700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57013e130 con 0x7fd5700cd9f0 2023-10-06T02:28:36.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd575359700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57013e410 con 0x7fd5700cddc0 2023-10-06T02:28:36.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd575359700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57013e6f0 con 0x7fd570159b10 2023-10-06T02:28:36.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd56ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5700cd9f0 0x7fd57013bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:36.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd56ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5700cd9f0 0x7fd57013bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56546/0 (socket says 172.21.15.37:56546) 2023-10-06T02:28:36.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd56ffff700 1 -- 172.21.15.37:0/1606140105 learned_addr learned my addr 172.21.15.37:0/1606140105 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:36.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd56f7fe700 1 --2- 172.21.15.37:0/1606140105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5700cddc0 0x7fd570158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:36.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd574b58700 1 --2- 172.21.15.37:0/1606140105 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd570159b10 0x7fd570158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:36.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd56ffff700 1 -- 172.21.15.37:0/1606140105 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd570159b10 msgr2=0x7fd570158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:36.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd56ffff700 1 --2- 172.21.15.37:0/1606140105 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd570159b10 0x7fd570158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd56ffff700 1 -- 172.21.15.37:0/1606140105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5700cddc0 msgr2=0x7fd570158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:36.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd56ffff700 1 --2- 172.21.15.37:0/1606140105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5700cddc0 0x7fd570158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd56ffff700 1 -- 172.21.15.37:0/1606140105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5640094f0 con 0x7fd5700cd9f0 2023-10-06T02:28:36.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd56ffff700 1 --2- 172.21.15.37:0/1606140105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5700cd9f0 0x7fd57013bac0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd56000d860 tx=0x7fd560008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:36.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd557fff700 1 -- 172.21.15.37:0/1606140105 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560009610 con 0x7fd5700cd9f0 2023-10-06T02:28:36.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd557fff700 1 -- 172.21.15.37:0/1606140105 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd560009770 con 0x7fd5700cd9f0 2023-10-06T02:28:36.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd575359700 1 -- 172.21.15.37:0/1606140105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd57013e9d0 con 0x7fd5700cd9f0 2023-10-06T02:28:36.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd557fff700 1 -- 172.21.15.37:0/1606140105 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560009b30 con 0x7fd5700cd9f0 2023-10-06T02:28:36.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.644+0000 7fd575359700 1 -- 172.21.15.37:0/1606140105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57013c000 con 0x7fd5700cd9f0 2023-10-06T02:28:36.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.645+0000 7fd575359700 1 -- 172.21.15.37:0/1606140105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd570064b00 con 0x7fd5700cd9f0 2023-10-06T02:28:36.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.646+0000 7fd557fff700 1 -- 172.21.15.37:0/1606140105 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd56001e460 con 0x7fd5700cd9f0 2023-10-06T02:28:36.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.646+0000 7fd557fff700 1 --2- 172.21.15.37:0/1606140105 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd55c066f30 0x7fd55c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:36.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.646+0000 7fd557fff700 1 -- 172.21.15.37:0/1606140105 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fd560084db0 con 0x7fd5700cd9f0 2023-10-06T02:28:36.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.646+0000 7fd56f7fe700 1 --2- 172.21.15.37:0/1606140105 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd55c066f30 0x7fd55c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:36.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.647+0000 7fd56f7fe700 1 --2- 172.21.15.37:0/1606140105 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd55c066f30 0x7fd55c0693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd57006b040 tx=0x7fd564017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:36.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.650+0000 7fd557fff700 1 -- 172.21.15.37:0/1606140105 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd560051e10 con 0x7fd5700cd9f0 2023-10-06T02:28:36.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.886+0000 7fd575359700 1 -- 172.21.15.37:0/1606140105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd57014fbf0 con 0x7fd5700cd9f0 2023-10-06T02:28:36.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.887+0000 7fd557fff700 1 -- 172.21.15.37:0/1606140105 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4606 (secure 0 0 0) 0x7fd560055430 con 0x7fd5700cd9f0 2023-10-06T02:28:36.888 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:36.888 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":59,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3055524642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3055524642},{"type":"v1","addr":"172.21.15.37:6835","nonce":3055524642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2821947660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2821947660},{"type":"v1","addr":"172.21.15.191:6836","nonce":2821947660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6310,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3752119173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3752119173},{"type":"v1","addr":"172.21.15.191:6837","nonce":3752119173}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:27:43.200836+0000","modified":"2023-10-06T02:28:36.702310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6840},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6840":{"gid":6840,"name":"c","rank":0,"incarnation":57,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.37:6834/1787333914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1787333914},{"type":"v1","addr":"172.21.15.37:6834","nonce":1787333914}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:28:36.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.889+0000 7fd575359700 1 -- 172.21.15.37:0/1606140105 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd55c066f30 msgr2=0x7fd55c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.889+0000 7fd575359700 1 --2- 172.21.15.37:0/1606140105 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd55c066f30 0x7fd55c0693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd57006b040 tx=0x7fd564017000 comp rx=0 tx=0).stop 2023-10-06T02:28:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.889+0000 7fd575359700 1 -- 172.21.15.37:0/1606140105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5700cd9f0 msgr2=0x7fd57013bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.889+0000 7fd575359700 1 --2- 172.21.15.37:0/1606140105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5700cd9f0 0x7fd57013bac0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd56000d860 tx=0x7fd560008040 comp rx=0 tx=0).stop 2023-10-06T02:28:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.889+0000 7fd575359700 1 -- 172.21.15.37:0/1606140105 shutdown_connections 2023-10-06T02:28:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.889+0000 7fd575359700 1 --2- 172.21.15.37:0/1606140105 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd570159b10 0x7fd570158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.889+0000 7fd575359700 1 --2- 172.21.15.37:0/1606140105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5700cd9f0 0x7fd57013bac0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.889+0000 7fd575359700 1 --2- 172.21.15.37:0/1606140105 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd55c066f30 0x7fd55c0693e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.889+0000 7fd575359700 1 --2- 172.21.15.37:0/1606140105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5700cddc0 0x7fd570158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.889+0000 7fd575359700 1 -- 172.21.15.37:0/1606140105 >> 172.21.15.37:0/1606140105 conn(0x7fd5700ce280 msgr2=0x7fd5700afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:36.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.889+0000 7fd575359700 1 -- 172.21.15.37:0/1606140105 shutdown_connections 2023-10-06T02:28:36.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:36.889+0000 7fd575359700 1 -- 172.21.15.37:0/1606140105 wait complete. 2023-10-06T02:28:36.891 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 59 2023-10-06T02:28:37.304 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:27:43.200836+0000', 'modified': '2023-10-06T02:28:36.702310+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 74, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6840}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6840': {'gid': 6840, 'name': 'c', 'rank': 0, 'incarnation': 57, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.37:6834/1787333914', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 1787333914}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 1787333914}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:28:37.304 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6840:up:rejoin 2023-10-06T02:28:38.305 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.437+0000 7f7e217c3700 1 Processor -- start 2023-10-06T02:28:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.437+0000 7f7e217c3700 1 -- start start 2023-10-06T02:28:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.438+0000 7f7e217c3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7e1c1596d0 0x7f7e1c0b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.438+0000 7f7e217c3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e1c159aa0 0x7f7e1c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.438+0000 7f7e217c3700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1c0c5300 con 0x7f7e1c0b3840 2023-10-06T02:28:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.438+0000 7f7e217c3700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1c0c6160 con 0x7f7e1c1596d0 2023-10-06T02:28:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.438+0000 7f7e217c3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c0c5550 con 0x7f7e1c159aa0 2023-10-06T02:28:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.438+0000 7f7e1affd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7e1c1596d0 0x7f7e1c0b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.438+0000 7f7e1a7fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7e1c0b3840 0x7f7e1c0c65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48178/0 (socket says 172.21.15.37:48178) 2023-10-06T02:28:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.438+0000 7f7e1a7fc700 1 -- 172.21.15.37:0/3282028736 learned_addr learned my addr 172.21.15.37:0/3282028736 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.438+0000 7f7e1b7fe700 1 --2- 172.21.15.37:0/3282028736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e1c159aa0 0x7f7e1c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.438+0000 7f7e1affd700 1 -- 172.21.15.37:0/3282028736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e1c159aa0 msgr2=0x7f7e1c0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.438+0000 7f7e1affd700 1 --2- 172.21.15.37:0/3282028736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e1c159aa0 0x7f7e1c0cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.438+0000 7f7e1affd700 1 -- 172.21.15.37:0/3282028736 >> v1:172.21.15.37:6789/0 conn(0x7f7e1c0b3840 legacy=0x7f7e1c0c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.438+0000 7f7e19ffb700 1 -- 172.21.15.37:0/3282028736 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760916353 0 0) 0x7f7e1c0c5300 con 0x7f7e1c0b3840 2023-10-06T02:28:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.438+0000 7f7e1affd700 1 -- 172.21.15.37:0/3282028736 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c0c5830 con 0x7f7e1c1596d0 2023-10-06T02:28:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.439+0000 7f7e1affd700 1 --2- 172.21.15.37:0/3282028736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e1c1596d0 0x7f7e1c0b3300 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009e60 tx=0x7f7e0c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24ade7f5982536e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.439+0000 7f7e19ffb700 1 -- 172.21.15.37:0/3282028736 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c00e070 con 0x7f7e1c1596d0 2023-10-06T02:28:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.439+0000 7f7e19ffb700 1 -- 172.21.15.37:0/3282028736 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c00bc30 con 0x7f7e1c1596d0 2023-10-06T02:28:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.439+0000 7f7e19ffb700 1 -- 172.21.15.37:0/3282028736 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c012430 con 0x7f7e1c1596d0 2023-10-06T02:28:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.439+0000 7f7e217c3700 1 -- 172.21.15.37:0/3282028736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e1c1596d0 msgr2=0x7f7e1c0b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:38.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.439+0000 7f7e217c3700 1 --2- 172.21.15.37:0/3282028736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e1c1596d0 0x7f7e1c0b3300 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009e60 tx=0x7f7e0c009780 comp rx=0 tx=0).stop 2023-10-06T02:28:38.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.439+0000 7f7e217c3700 1 -- 172.21.15.37:0/3282028736 shutdown_connections 2023-10-06T02:28:38.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.439+0000 7f7e217c3700 1 --2- 172.21.15.37:0/3282028736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e1c159aa0 0x7f7e1c0cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.439+0000 7f7e217c3700 1 --2- 172.21.15.37:0/3282028736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e1c1596d0 0x7f7e1c0b3300 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.439+0000 7f7e217c3700 1 -- 172.21.15.37:0/3282028736 >> 172.21.15.37:0/3282028736 conn(0x7f7e1c06c890 msgr2=0x7f7e1c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:38.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.439+0000 7f7e217c3700 1 -- 172.21.15.37:0/3282028736 shutdown_connections 2023-10-06T02:28:38.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.439+0000 7f7e217c3700 1 -- 172.21.15.37:0/3282028736 wait complete. 2023-10-06T02:28:38.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.441+0000 7f7e217c3700 1 Processor -- start 2023-10-06T02:28:38.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.441+0000 7f7e217c3700 1 -- start start 2023-10-06T02:28:38.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.441+0000 7f7e217c3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e1c0b3840 0x7f7e1c16db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:38.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.441+0000 7f7e217c3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e1c1596d0 0x7f7e1c15b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:38.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.441+0000 7f7e217c3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e1c159aa0 0x7f7e1c153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:38.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.441+0000 7f7e217c3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c15bdc0 con 0x7f7e1c1596d0 2023-10-06T02:28:38.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.441+0000 7f7e217c3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c16ea90 con 0x7f7e1c159aa0 2023-10-06T02:28:38.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.441+0000 7f7e217c3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c09a170 con 0x7f7e1c0b3840 2023-10-06T02:28:38.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.442+0000 7f7e1a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e1c1596d0 0x7f7e1c15b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:38.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.442+0000 7f7e1a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e1c1596d0 0x7f7e1c15b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56562/0 (socket says 172.21.15.37:56562) 2023-10-06T02:28:38.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.442+0000 7f7e1a7fc700 1 -- 172.21.15.37:0/396334900 learned_addr learned my addr 172.21.15.37:0/396334900 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:38.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.442+0000 7f7e1b7fe700 1 --2- 172.21.15.37:0/396334900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e1c159aa0 0x7f7e1c153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:38.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.442+0000 7f7e1affd700 1 --2- 172.21.15.37:0/396334900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e1c0b3840 0x7f7e1c16db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:38.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.442+0000 7f7e1a7fc700 1 -- 172.21.15.37:0/396334900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e1c0b3840 msgr2=0x7f7e1c16db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:38.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.442+0000 7f7e1a7fc700 1 --2- 172.21.15.37:0/396334900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e1c0b3840 0x7f7e1c16db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.442+0000 7f7e1a7fc700 1 -- 172.21.15.37:0/396334900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e1c159aa0 msgr2=0x7f7e1c153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:38.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.442+0000 7f7e1a7fc700 1 --2- 172.21.15.37:0/396334900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e1c159aa0 0x7f7e1c153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.442+0000 7f7e1a7fc700 1 -- 172.21.15.37:0/396334900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c009a20 con 0x7f7e1c1596d0 2023-10-06T02:28:38.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.442+0000 7f7e1a7fc700 1 --2- 172.21.15.37:0/396334900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e1c1596d0 0x7f7e1c15b880 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400c5b0 tx=0x7f7e04001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:38.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.442+0000 7f7e12ffd700 1 -- 172.21.15.37:0/396334900 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04005b30 con 0x7f7e1c1596d0 2023-10-06T02:28:38.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.442+0000 7f7e12ffd700 1 -- 172.21.15.37:0/396334900 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e04005c90 con 0x7f7e1c1596d0 2023-10-06T02:28:38.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.442+0000 7f7e217c3700 1 -- 172.21.15.37:0/396334900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1c16e1f0 con 0x7f7e1c1596d0 2023-10-06T02:28:38.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.442+0000 7f7e12ffd700 1 -- 172.21.15.37:0/396334900 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04007320 con 0x7f7e1c1596d0 2023-10-06T02:28:38.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.442+0000 7f7e217c3700 1 -- 172.21.15.37:0/396334900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1c16e7b0 con 0x7f7e1c1596d0 2023-10-06T02:28:38.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.443+0000 7f7e217c3700 1 -- 172.21.15.37:0/396334900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1c09a320 con 0x7f7e1c1596d0 2023-10-06T02:28:38.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.444+0000 7f7e12ffd700 1 -- 172.21.15.37:0/396334900 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e0401b3b0 con 0x7f7e1c1596d0 2023-10-06T02:28:38.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.444+0000 7f7e12ffd700 1 --2- 172.21.15.37:0/396334900 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7dfc066f30 0x7f7dfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:38.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.444+0000 7f7e12ffd700 1 -- 172.21.15.37:0/396334900 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f7e04083b90 con 0x7f7e1c1596d0 2023-10-06T02:28:38.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.444+0000 7f7e1affd700 1 --2- 172.21.15.37:0/396334900 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7dfc066f30 0x7f7dfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:38.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.445+0000 7f7e1affd700 1 --2- 172.21.15.37:0/396334900 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7dfc066f30 0x7f7dfc0693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009e60 tx=0x7f7e0c019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:38.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.448+0000 7f7e12ffd700 1 -- 172.21.15.37:0/396334900 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e1c09a320 con 0x7f7e1c1596d0 2023-10-06T02:28:38.615 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-10-06T02:28:38.614+0000 7f42586b4700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:28:38.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.688+0000 7f7e217c3700 1 -- 172.21.15.37:0/396334900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e1c09a2e0 con 0x7f7e1c1596d0 2023-10-06T02:28:38.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.688+0000 7f7e12ffd700 1 -- 172.21.15.37:0/396334900 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f7e04017090 con 0x7f7e1c1596d0 2023-10-06T02:28:38.689 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:38.689 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":60,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3055524642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3055524642},{"type":"v1","addr":"172.21.15.37:6835","nonce":3055524642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2821947660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2821947660},{"type":"v1","addr":"172.21.15.191:6836","nonce":2821947660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6310,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3752119173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3752119173},{"type":"v1","addr":"172.21.15.191:6837","nonce":3752119173}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:27:43.200836+0000","modified":"2023-10-06T02:28:37.708971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6840},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6840":{"gid":6840,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/1787333914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1787333914},{"type":"v1","addr":"172.21.15.37:6834","nonce":1787333914}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:28:38.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.690+0000 7f7e217c3700 1 -- 172.21.15.37:0/396334900 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7dfc066f30 msgr2=0x7f7dfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:38.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.690+0000 7f7e217c3700 1 --2- 172.21.15.37:0/396334900 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7dfc066f30 0x7f7dfc0693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009e60 tx=0x7f7e0c019000 comp rx=0 tx=0).stop 2023-10-06T02:28:38.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.690+0000 7f7e217c3700 1 -- 172.21.15.37:0/396334900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e1c1596d0 msgr2=0x7f7e1c15b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:38.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.690+0000 7f7e217c3700 1 --2- 172.21.15.37:0/396334900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e1c1596d0 0x7f7e1c15b880 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400c5b0 tx=0x7f7e04001070 comp rx=0 tx=0).stop 2023-10-06T02:28:38.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.690+0000 7f7e217c3700 1 -- 172.21.15.37:0/396334900 shutdown_connections 2023-10-06T02:28:38.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.690+0000 7f7e217c3700 1 --2- 172.21.15.37:0/396334900 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7dfc066f30 0x7f7dfc0693e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.690+0000 7f7e217c3700 1 --2- 172.21.15.37:0/396334900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e1c159aa0 0x7f7e1c153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.690+0000 7f7e217c3700 1 --2- 172.21.15.37:0/396334900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e1c0b3840 0x7f7e1c16db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.690+0000 7f7e217c3700 1 --2- 172.21.15.37:0/396334900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e1c1596d0 0x7f7e1c15b880 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:38.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.690+0000 7f7e217c3700 1 -- 172.21.15.37:0/396334900 >> 172.21.15.37:0/396334900 conn(0x7f7e1c06c890 msgr2=0x7f7e1c0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:38.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.690+0000 7f7e217c3700 1 -- 172.21.15.37:0/396334900 shutdown_connections 2023-10-06T02:28:38.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:38.690+0000 7f7e217c3700 1 -- 172.21.15.37:0/396334900 wait complete. 2023-10-06T02:28:38.692 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 60 2023-10-06T02:28:39.105 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:27:43.200836+0000', 'modified': '2023-10-06T02:28:37.708971+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 74, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6840}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6840': {'gid': 6840, 'name': 'c', 'rank': 0, 'incarnation': 57, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.37:6834/1787333914', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 1787333914}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 1787333914}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:28:39.105 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:28:39.105 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T02:28:39.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.230+0000 7fb4a359e700 1 Processor -- start 2023-10-06T02:28:39.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.230+0000 7fb4a359e700 1 -- start start 2023-10-06T02:28:39.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.231+0000 7fb4a359e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a406d870 0x7fb4a406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.231+0000 7fb4a359e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a40cbe60 con 0x7fb4a41596c0 2023-10-06T02:28:39.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.231+0000 7fb4a359e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a40cb250 con 0x7fb4a40b22a0 2023-10-06T02:28:39.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.231+0000 7fb4a359e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a40cb530 con 0x7fb4a406d870 2023-10-06T02:28:39.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.231+0000 7fb4a2d9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb4a41596c0 0x7fb4a40cc2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48180/0 (socket says 172.21.15.37:48180) 2023-10-06T02:28:39.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.231+0000 7fb4a2d9d700 1 -- 172.21.15.37:0/2147917025 learned_addr learned my addr 172.21.15.37:0/2147917025 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:39.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.231+0000 7fb4a259c700 1 --2- 172.21.15.37:0/2147917025 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a406d870 0x7fb4a406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.231+0000 7fb4a159a700 1 -- 172.21.15.37:0/2147917025 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69982429 0 0) 0x7fb4a40cbe60 con 0x7fb4a41596c0 2023-10-06T02:28:39.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.231+0000 7fb4a159a700 1 -- 172.21.15.37:0/2147917025 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb490003570 con 0x7fb4a41596c0 2023-10-06T02:28:39.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.231+0000 7fb4a159a700 1 -- 172.21.15.37:0/2147917025 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012957713 0 0) 0x7fb4a40cb250 con 0x7fb4a40b22a0 2023-10-06T02:28:39.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a159a700 1 -- 172.21.15.37:0/2147917025 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4a40cbe60 con 0x7fb4a40b22a0 2023-10-06T02:28:39.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a159a700 1 -- 172.21.15.37:0/2147917025 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 190722022 0 0) 0x7fb490003570 con 0x7fb4a41596c0 2023-10-06T02:28:39.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a159a700 1 -- 172.21.15.37:0/2147917025 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a406d870 msgr2=0x7fb4a406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:39.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a159a700 1 --2- 172.21.15.37:0/2147917025 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a406d870 0x7fb4a406dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a159a700 1 -- 172.21.15.37:0/2147917025 >> v1:172.21.15.191:6789/0 conn(0x7fb4a40b22a0 legacy=0x7fb4a4158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a159a700 1 -- 172.21.15.37:0/2147917025 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a40cb810 con 0x7fb4a41596c0 2023-10-06T02:28:39.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a159a700 1 -- 172.21.15.37:0/2147917025 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7fb494001470 con 0x7fb4a41596c0 2023-10-06T02:28:39.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a159a700 1 -- 172.21.15.37:0/2147917025 >> v1:172.21.15.37:6789/0 conn(0x7fb4a41596c0 legacy=0x7fb4a40cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a159a700 1 --2- 172.21.15.37:0/2147917025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb490003c20 0x7fb490004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a159a700 1 --2- 172.21.15.37:0/2147917025 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a406d870 0x7fb490004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a159a700 1 --2- 172.21.15.37:0/2147917025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb490004d50 0x7fb4900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a159a700 1 -- 172.21.15.37:0/2147917025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a40cb530 con 0x7fb490003c20 2023-10-06T02:28:39.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a159a700 1 -- 172.21.15.37:0/2147917025 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49000bb40 con 0x7fb490004d50 2023-10-06T02:28:39.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a159a700 1 -- 172.21.15.37:0/2147917025 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49000bd00 con 0x7fb4a406d870 2023-10-06T02:28:39.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a259c700 1 --2- 172.21.15.37:0/2147917025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb490003c20 0x7fb490004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a1d9b700 1 --2- 172.21.15.37:0/2147917025 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a406d870 0x7fb490004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a2d9d700 1 --2- 172.21.15.37:0/2147917025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb490004d50 0x7fb4900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a259c700 1 -- 172.21.15.37:0/2147917025 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a406d870 msgr2=0x7fb490004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a259c700 1 --2- 172.21.15.37:0/2147917025 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a406d870 0x7fb490004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a259c700 1 -- 172.21.15.37:0/2147917025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb490004d50 msgr2=0x7fb4900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a259c700 1 --2- 172.21.15.37:0/2147917025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb490004d50 0x7fb4900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a259c700 1 -- 172.21.15.37:0/2147917025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb490003570 con 0x7fb490003c20 2023-10-06T02:28:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a1d9b700 1 --2- 172.21.15.37:0/2147917025 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a406d870 0x7fb490004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a259c700 1 --2- 172.21.15.37:0/2147917025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb490003c20 0x7fb490004010 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fb49c00e210 tx=0x7fb49c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aafd38770119f3fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a159a700 1 -- 172.21.15.37:0/2147917025 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c00eac0 con 0x7fb490003c20 2023-10-06T02:28:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a159a700 1 -- 172.21.15.37:0/2147917025 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c00f040 con 0x7fb490003c20 2023-10-06T02:28:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.232+0000 7fb4a159a700 1 -- 172.21.15.37:0/2147917025 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c00ee70 con 0x7fb490003c20 2023-10-06T02:28:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.233+0000 7fb4a359e700 1 -- 172.21.15.37:0/2147917025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb490003c20 msgr2=0x7fb490004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.233+0000 7fb4a359e700 1 --2- 172.21.15.37:0/2147917025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb490003c20 0x7fb490004010 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fb49c00e210 tx=0x7fb49c00b040 comp rx=0 tx=0).stop 2023-10-06T02:28:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.233+0000 7fb4a2d9d700 1 -- 172.21.15.37:0/2147917025 reap_dead start 2023-10-06T02:28:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.233+0000 7fb4a359e700 1 -- 172.21.15.37:0/2147917025 shutdown_connections 2023-10-06T02:28:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.233+0000 7fb4a359e700 1 -- 172.21.15.37:0/2147917025 >> 172.21.15.37:0/2147917025 conn(0x7fb4a406c0b0 msgr2=0x7fb4a406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.233+0000 7fb4a359e700 1 -- 172.21.15.37:0/2147917025 shutdown_connections 2023-10-06T02:28:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.233+0000 7fb4a359e700 1 -- 172.21.15.37:0/2147917025 wait complete. 2023-10-06T02:28:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.234+0000 7fb4a359e700 1 Processor -- start 2023-10-06T02:28:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.234+0000 7fb4a359e700 1 -- start start 2023-10-06T02:28:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.235+0000 7fb4a359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb490003c20 0x7fb4a40c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.235+0000 7fb4a359e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a4153e00 0x7fb4a416dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.235+0000 7fb4a359e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4a4169c50 0x7fb4a416a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.235+0000 7fb4a359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a416e1a0 con 0x7fb490003c20 2023-10-06T02:28:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.235+0000 7fb4a359e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a40c79e0 con 0x7fb4a4169c50 2023-10-06T02:28:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.235+0000 7fb4a359e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a40c7cc0 con 0x7fb4a4153e00 2023-10-06T02:28:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.235+0000 7fb4a259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb490003c20 0x7fb4a40c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.235+0000 7fb4a259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb490003c20 0x7fb4a40c7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56578/0 (socket says 172.21.15.37:56578) 2023-10-06T02:28:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.235+0000 7fb4a259c700 1 -- 172.21.15.37:0/2554840491 learned_addr learned my addr 172.21.15.37:0/2554840491 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.235+0000 7fb4a1d9b700 1 --2- 172.21.15.37:0/2554840491 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a4153e00 0x7fb4a416dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.235+0000 7fb4a2d9d700 1 --2- 172.21.15.37:0/2554840491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4a4169c50 0x7fb4a416a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.235+0000 7fb4a259c700 1 -- 172.21.15.37:0/2554840491 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a4153e00 msgr2=0x7fb4a416dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.235+0000 7fb4a259c700 1 --2- 172.21.15.37:0/2554840491 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a4153e00 0x7fb4a416dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.235+0000 7fb4a259c700 1 -- 172.21.15.37:0/2554840491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4a4169c50 msgr2=0x7fb4a416a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.235+0000 7fb4a259c700 1 --2- 172.21.15.37:0/2554840491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4a4169c50 0x7fb4a416a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.235+0000 7fb4a259c700 1 -- 172.21.15.37:0/2554840491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a40c7fa0 con 0x7fb490003c20 2023-10-06T02:28:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.235+0000 7fb4a259c700 1 --2- 172.21.15.37:0/2554840491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb490003c20 0x7fb4a40c7370 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fb49c00afd0 tx=0x7fb49c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.236+0000 7fb49a7fc700 1 -- 172.21.15.37:0/2554840491 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c014e80 con 0x7fb490003c20 2023-10-06T02:28:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.236+0000 7fb49a7fc700 1 -- 172.21.15.37:0/2554840491 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c029450 con 0x7fb490003c20 2023-10-06T02:28:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.236+0000 7fb4a359e700 1 -- 172.21.15.37:0/2554840491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a40c8280 con 0x7fb490003c20 2023-10-06T02:28:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.236+0000 7fb49a7fc700 1 -- 172.21.15.37:0/2554840491 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c029850 con 0x7fb490003c20 2023-10-06T02:28:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.236+0000 7fb4a359e700 1 -- 172.21.15.37:0/2554840491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a4154270 con 0x7fb490003c20 2023-10-06T02:28:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.237+0000 7fb49a7fc700 1 -- 172.21.15.37:0/2554840491 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb49c003040 con 0x7fb490003c20 2023-10-06T02:28:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.237+0000 7fb49a7fc700 1 --2- 172.21.15.37:0/2554840491 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb484066f30 0x7fb4840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.238+0000 7fb49a7fc700 1 -- 172.21.15.37:0/2554840491 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fb49c086b20 con 0x7fb490003c20 2023-10-06T02:28:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.238+0000 7fb4a1d9b700 1 --2- 172.21.15.37:0/2554840491 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb484066f30 0x7fb4840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.238+0000 7fb4a1d9b700 1 --2- 172.21.15.37:0/2554840491 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb484066f30 0x7fb4840693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb48c0010e0 tx=0x7fb48c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.240+0000 7fb4b1d81b80 1 Processor -- start 2023-10-06T02:28:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.240+0000 7fb4b1d81b80 1 -- start start 2023-10-06T02:28:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.240+0000 7fb4b1d81b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e966e50 0x56172e941cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.241+0000 7fb4b1d81b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56172e9472c0 0x56172e942200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.241+0000 7fb4b1d81b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56172e948a10 0x56172e942740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.241+0000 7fb4b1d81b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x56172e89ca70 con 0x56172e966e50 2023-10-06T02:28:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.241+0000 7fb4b1d81b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56172e89a270 con 0x56172e948a10 2023-10-06T02:28:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.241+0000 7fb4b1d81b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x56172e896060 con 0x56172e9472c0 2023-10-06T02:28:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.241+0000 7fb4a259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e966e50 0x56172e941cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.241+0000 7fb4a259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e966e50 0x56172e941cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56590/0 (socket says 172.21.15.37:56590) 2023-10-06T02:28:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.241+0000 7fb4a259c700 1 -- 172.21.15.37:0/154284507 learned_addr learned my addr 172.21.15.37:0/154284507 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.241+0000 7fb4a1d9b700 1 --2- 172.21.15.37:0/154284507 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56172e9472c0 0x56172e942200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.241+0000 7fb4a2d9d700 1 --2- 172.21.15.37:0/154284507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56172e948a10 0x56172e942740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.241+0000 7fb4a259c700 1 -- 172.21.15.37:0/154284507 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56172e9472c0 msgr2=0x56172e942200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.241+0000 7fb4a259c700 1 --2- 172.21.15.37:0/154284507 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56172e9472c0 0x56172e942200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.241+0000 7fb4a259c700 1 -- 172.21.15.37:0/154284507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56172e948a10 msgr2=0x56172e942740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.241+0000 7fb4a259c700 1 --2- 172.21.15.37:0/154284507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56172e948a10 0x56172e942740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.241+0000 7fb4a259c700 1 -- 172.21.15.37:0/154284507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56172e730270 con 0x56172e966e50 2023-10-06T02:28:39.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.241+0000 7fb4a259c700 1 --2- 172.21.15.37:0/154284507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e966e50 0x56172e941cc0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fb49c017040 tx=0x7fb49c084d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08c5afb3b236f6d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.241+0000 7fb4837fe700 1 -- 172.21.15.37:0/154284507 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c06c030 con 0x56172e966e50 2023-10-06T02:28:39.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.241+0000 7fb4837fe700 1 -- 172.21.15.37:0/154284507 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c057f40 con 0x56172e966e50 2023-10-06T02:28:39.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.241+0000 7fb4837fe700 1 -- 172.21.15.37:0/154284507 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c057840 con 0x56172e966e50 2023-10-06T02:28:39.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.242+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/154284507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e966e50 msgr2=0x56172e941cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.242+0000 7fb4b1d81b80 1 --2- 172.21.15.37:0/154284507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e966e50 0x56172e941cc0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fb49c017040 tx=0x7fb49c084d90 comp rx=0 tx=0).stop 2023-10-06T02:28:39.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.242+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/154284507 shutdown_connections 2023-10-06T02:28:39.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.242+0000 7fb4b1d81b80 1 --2- 172.21.15.37:0/154284507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56172e948a10 0x56172e942740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.242+0000 7fb4b1d81b80 1 --2- 172.21.15.37:0/154284507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e966e50 0x56172e941cc0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.242+0000 7fb4b1d81b80 1 --2- 172.21.15.37:0/154284507 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56172e9472c0 0x56172e942200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.242+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/154284507 >> 172.21.15.37:0/154284507 conn(0x56172e946e80 msgr2=0x56172e9476b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:39.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.242+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/154284507 shutdown_connections 2023-10-06T02:28:39.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.242+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/154284507 wait complete. 2023-10-06T02:28:39.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.243+0000 7fb4b1d81b80 1 -- start start 2023-10-06T02:28:39.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.243+0000 7fb4b1d81b80 1 Processor -- start 2023-10-06T02:28:39.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb4b1d81b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56172e9472c0 0x56172e955d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb4b1d81b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e948a10 0x56172e98f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb4b1d81b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56172e966e50 0x56172e98d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb4b1d81b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x56172e841890 con 0x56172e948a10 2023-10-06T02:28:39.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb4b1d81b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56172e85cea0 con 0x56172e9472c0 2023-10-06T02:28:39.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb4b1d81b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x56172e718e30 con 0x56172e966e50 2023-10-06T02:28:39.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb4b1d81b80 10 client.0 _ll_register_callbacks cb 0x56172e909020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:28:39.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb4a1d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e948a10 0x56172e98f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb4a1d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e948a10 0x56172e98f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56602/0 (socket says 172.21.15.37:56602) 2023-10-06T02:28:39.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb4a1d9b700 1 -- 172.21.15.37:0/3958693375 learned_addr learned my addr 172.21.15.37:0/3958693375 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:39.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb4a2d9d700 1 --2- 172.21.15.37:0/3958693375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56172e966e50 0x56172e98d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb4a259c700 1 --2- 172.21.15.37:0/3958693375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56172e9472c0 0x56172e955d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb4a1d9b700 1 -- 172.21.15.37:0/3958693375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56172e966e50 msgr2=0x56172e98d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:39.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb4a1d9b700 1 --2- 172.21.15.37:0/3958693375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56172e966e50 0x56172e98d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb4a1d9b700 1 -- 172.21.15.37:0/3958693375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56172e9472c0 msgr2=0x56172e955d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:39.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb4a1d9b700 1 --2- 172.21.15.37:0/3958693375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56172e9472c0 0x56172e955d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb4a1d9b700 1 -- 172.21.15.37:0/3958693375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a4154270 con 0x56172e948a10 2023-10-06T02:28:39.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb4a1d9b700 1 --2- 172.21.15.37:0/3958693375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e948a10 0x56172e98f4f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fb48c015810 tx=0x7fb48c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71efc0fe9f11c22e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb480ff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:28:39.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb480ff9700 1 -- 172.21.15.37:0/3958693375 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c0226e0 con 0x56172e948a10 2023-10-06T02:28:39.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb480ff9700 1 -- 172.21.15.37:0/3958693375 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fb48c01a030 con 0x56172e948a10 2023-10-06T02:28:39.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/3958693375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56172e93a940 con 0x56172e948a10 2023-10-06T02:28:39.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.244+0000 7fb480ff9700 1 -- 172.21.15.37:0/3958693375 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb48c022a50 con 0x56172e948a10 2023-10-06T02:28:39.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.245+0000 7fb4b1d81b80 10 client.6933 fetch_fsmap learned FSMap version 60 2023-10-06T02:28:39.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.245+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/3958693375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x56172e6d2fe0 con 0x56172e948a10 2023-10-06T02:28:39.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.245+0000 7fb480ff9700 1 -- 172.21.15.37:0/3958693375 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56172e93a940 con 0x56172e948a10 2023-10-06T02:28:39.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.245+0000 7fb480ff9700 1 -- 172.21.15.37:0/3958693375 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 60) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb48c022bb0 con 0x56172e948a10 2023-10-06T02:28:39.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.245+0000 7fb4b1d81b80 10 client.6933 fetch_fsmap finished waiting for FSMap version 60 2023-10-06T02:28:39.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.245+0000 7fb4b1d81b80 10 client.6933 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:28:39.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.245+0000 7fb4b1d81b80 20 client.6933 populate_metadata read hostname 'smithi037' 2023-10-06T02:28:39.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.245+0000 7fb4b1d81b80 1 --2- 172.21.15.37:0/3958693375 >> [v2:172.21.15.37:6832/1787333914,v1:172.21.15.37:6834/1787333914] conn(0x56172e990440 0x56172e990810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.245+0000 7fb4b1d81b80 4 client.6933 mds_command: new command op to 6840 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:28:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.245+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/3958693375 --> [v2:172.21.15.37:6832/1787333914,v1:172.21.15.37:6834/1787333914] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56172e917870 con 0x56172e990440 2023-10-06T02:28:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.245+0000 7fb4a259c700 1 --2- 172.21.15.37:0/3958693375 >> [v2:172.21.15.37:6832/1787333914,v1:172.21.15.37:6834/1787333914] conn(0x56172e990440 0x56172e990810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.245+0000 7fb4a259c700 1 --2- 172.21.15.37:0/3958693375 >> [v2:172.21.15.37:6832/1787333914,v1:172.21.15.37:6834/1787333914] conn(0x56172e990440 0x56172e990810 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c458a1b41c763b2 server_cookie=7dbfdfd008ffeb5b in_seq=0 out_seq=0 2023-10-06T02:28:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.245+0000 7fb480ff9700 10 client.6933 ms_handle_connect on v2:172.21.15.37:6832/1787333914 2023-10-06T02:28:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.246+0000 7fb480ff9700 1 -- 172.21.15.37:0/3958693375 <== mds.0 v2:172.21.15.37:6832/1787333914 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56172e917870 con 0x56172e990440 2023-10-06T02:28:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.246+0000 7fb480ff9700 10 client.6933 handle_command_reply: tid=0 2023-10-06T02:28:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.246+0000 7fb4b1d81b80 1 client.6933 shutdown 2023-10-06T02:28:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.246+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/3958693375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e948a10 msgr2=0x56172e98f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.246+0000 7fb4b1d81b80 1 --2- 172.21.15.37:0/3958693375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e948a10 0x56172e98f4f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fb48c015810 tx=0x7fb48c017000 comp rx=0 tx=0).stop 2023-10-06T02:28:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.246+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/3958693375 shutdown_connections 2023-10-06T02:28:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.246+0000 7fb4b1d81b80 1 --2- 172.21.15.37:0/3958693375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56172e966e50 0x56172e98d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.246+0000 7fb4b1d81b80 1 --2- 172.21.15.37:0/3958693375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56172e9472c0 0x56172e955d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.246+0000 7fb4b1d81b80 1 --2- 172.21.15.37:0/3958693375 >> [v2:172.21.15.37:6832/1787333914,v1:172.21.15.37:6834/1787333914] conn(0x56172e990440 0x56172e990810 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.246+0000 7fb4b1d81b80 1 --2- 172.21.15.37:0/3958693375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e948a10 0x56172e98f4f0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.246+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/3958693375 >> 172.21.15.37:0/3958693375 conn(0x56172e946e80 msgr2=0x56172e945d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:39.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.246+0000 7fb480ff9700 0 client.6933 ms_handle_reset on v2:172.21.15.37:6832/1787333914 2023-10-06T02:28:39.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.246+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/3958693375 shutdown_connections 2023-10-06T02:28:39.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.246+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/3958693375 wait complete. 2023-10-06T02:28:39.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.246+0000 7fb4b1d81b80 20 client.6933 trim_cache size 0 max 16384 2023-10-06T02:28:39.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.263+0000 7fb4b1d81b80 1 Processor -- start 2023-10-06T02:28:39.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.263+0000 7fb4b1d81b80 1 -- start start 2023-10-06T02:28:39.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.264+0000 7fb4b1d81b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56172e9472c0 0x56172e96e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.264+0000 7fb4b1d81b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e948a10 0x56172e9665d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.264+0000 7fb4b1d81b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56172e966e50 0x56172e942cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.264+0000 7fb4b1d81b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x56172e973d10 con 0x56172e948a10 2023-10-06T02:28:39.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.264+0000 7fb4b1d81b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56172e96e6b0 con 0x56172e966e50 2023-10-06T02:28:39.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.264+0000 7fb4b1d81b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x56172e966b10 con 0x56172e9472c0 2023-10-06T02:28:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.264+0000 7fb4a1d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e948a10 0x56172e9665d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.264+0000 7fb4a1d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e948a10 0x56172e9665d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56606/0 (socket says 172.21.15.37:56606) 2023-10-06T02:28:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.264+0000 7fb4a1d9b700 1 -- 172.21.15.37:0/44999734 learned_addr learned my addr 172.21.15.37:0/44999734 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.264+0000 7fb4a1d9b700 1 -- 172.21.15.37:0/44999734 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56172e9472c0 msgr2=0x56172e96e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.264+0000 7fb4a1d9b700 1 --2- 172.21.15.37:0/44999734 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56172e9472c0 0x56172e96e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.264+0000 7fb4a1d9b700 1 -- 172.21.15.37:0/44999734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56172e966e50 msgr2=0x56172e942cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.264+0000 7fb4a1d9b700 1 --2- 172.21.15.37:0/44999734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56172e966e50 0x56172e942cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.264+0000 7fb4a1d9b700 1 -- 172.21.15.37:0/44999734 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56172e864780 con 0x56172e948a10 2023-10-06T02:28:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.265+0000 7fb4a1d9b700 1 --2- 172.21.15.37:0/44999734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e948a10 0x56172e9665d0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fb48c007bc0 tx=0x7fb48c024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a22ef4bcec70ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.265+0000 7fb483fff700 1 -- 172.21.15.37:0/44999734 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c0226e0 con 0x56172e948a10 2023-10-06T02:28:39.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.265+0000 7fb483fff700 1 -- 172.21.15.37:0/44999734 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48c000be0 con 0x56172e948a10 2023-10-06T02:28:39.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.265+0000 7fb483fff700 1 -- 172.21.15.37:0/44999734 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c022c60 con 0x56172e948a10 2023-10-06T02:28:39.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.265+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/44999734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e948a10 msgr2=0x56172e9665d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.265+0000 7fb4b1d81b80 1 --2- 172.21.15.37:0/44999734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e948a10 0x56172e9665d0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fb48c007bc0 tx=0x7fb48c024000 comp rx=0 tx=0).stop 2023-10-06T02:28:39.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.265+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/44999734 shutdown_connections 2023-10-06T02:28:39.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.265+0000 7fb4b1d81b80 1 --2- 172.21.15.37:0/44999734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56172e966e50 0x56172e942cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.265+0000 7fb4b1d81b80 1 --2- 172.21.15.37:0/44999734 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56172e9472c0 0x56172e96e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.265+0000 7fb4b1d81b80 1 --2- 172.21.15.37:0/44999734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e948a10 0x56172e9665d0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.265+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/44999734 >> 172.21.15.37:0/44999734 conn(0x56172e946e80 msgr2=0x56172e93cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:39.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.265+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/44999734 shutdown_connections 2023-10-06T02:28:39.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.265+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/44999734 wait complete. 2023-10-06T02:28:39.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.266+0000 7fb4b1d81b80 1 -- start start 2023-10-06T02:28:39.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.266+0000 7fb4b1d81b80 1 Processor -- start 2023-10-06T02:28:39.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.267+0000 7fb4b1d81b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56172e9472c0 0x56172e9e7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.267+0000 7fb4b1d81b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56172e948a10 0x56172e9741f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.267+0000 7fb4b1d81b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e966e50 0x56172e974730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.267+0000 7fb4b1d81b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x56172e9f2ff0 con 0x56172e966e50 2023-10-06T02:28:39.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.267+0000 7fb4b1d81b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56172e9e77a0 con 0x56172e948a10 2023-10-06T02:28:39.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.267+0000 7fb4b1d81b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x56172e974f80 con 0x56172e9472c0 2023-10-06T02:28:39.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.267+0000 7fb4b1d81b80 10 client.0 _ll_register_callbacks cb 0x56172e909020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:28:39.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.267+0000 7fb4a2d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e966e50 0x56172e974730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.267+0000 7fb4a2d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e966e50 0x56172e974730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56616/0 (socket says 172.21.15.37:56616) 2023-10-06T02:28:39.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.267+0000 7fb4a2d9d700 1 -- 172.21.15.37:0/2236579260 learned_addr learned my addr 172.21.15.37:0/2236579260 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:39.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.267+0000 7fb4a1d9b700 1 --2- 172.21.15.37:0/2236579260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56172e948a10 0x56172e9741f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.267+0000 7fb4a259c700 1 --2- 172.21.15.37:0/2236579260 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56172e9472c0 0x56172e9e7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.267+0000 7fb4a2d9d700 1 -- 172.21.15.37:0/2236579260 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56172e9472c0 msgr2=0x56172e9e7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:39.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.267+0000 7fb4a2d9d700 1 --2- 172.21.15.37:0/2236579260 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56172e9472c0 0x56172e9e7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.267+0000 7fb4a2d9d700 1 -- 172.21.15.37:0/2236579260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56172e948a10 msgr2=0x56172e9741f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:39.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.267+0000 7fb4a2d9d700 1 --2- 172.21.15.37:0/2236579260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56172e948a10 0x56172e9741f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.267+0000 7fb4a2d9d700 1 -- 172.21.15.37:0/2236579260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56172e6d2fe0 con 0x56172e966e50 2023-10-06T02:28:39.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.267+0000 7fb4a259c700 1 --2- 172.21.15.37:0/2236579260 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56172e9472c0 0x56172e9e7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:39.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.267+0000 7fb4a2d9d700 1 --2- 172.21.15.37:0/2236579260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e966e50 0x56172e974730 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fb4a40cbdf0 tx=0x7fb494009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea88bebdc540062 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.267+0000 7fb480ff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-10-06T02:28:39.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.268+0000 7fb480ff9700 1 -- 172.21.15.37:0/2236579260 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4940149b0 con 0x56172e966e50 2023-10-06T02:28:39.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.268+0000 7fb480ff9700 1 -- 172.21.15.37:0/2236579260 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fb494014b10 con 0x56172e966e50 2023-10-06T02:28:39.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.268+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/2236579260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb49c057f40 con 0x56172e966e50 2023-10-06T02:28:39.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.268+0000 7fb480ff9700 1 -- 172.21.15.37:0/2236579260 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb494014ee0 con 0x56172e966e50 2023-10-06T02:28:39.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.268+0000 7fb4b1d81b80 10 client.6939 fetch_fsmap learned FSMap version 60 2023-10-06T02:28:39.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.268+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/2236579260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x56172e84b470 con 0x56172e966e50 2023-10-06T02:28:39.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.268+0000 7fb480ff9700 1 -- 172.21.15.37:0/2236579260 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c057f40 con 0x56172e966e50 2023-10-06T02:28:39.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.268+0000 7fb480ff9700 1 -- 172.21.15.37:0/2236579260 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 60) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb494020400 con 0x56172e966e50 2023-10-06T02:28:39.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.268+0000 7fb4b1d81b80 10 client.6939 fetch_fsmap finished waiting for FSMap version 60 2023-10-06T02:28:39.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.268+0000 7fb4b1d81b80 10 client.6939 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:28:39.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.268+0000 7fb4b1d81b80 20 client.6939 populate_metadata read hostname 'smithi037' 2023-10-06T02:28:39.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.268+0000 7fb4b1d81b80 1 --2- 172.21.15.37:0/2236579260 >> [v2:172.21.15.37:6832/1787333914,v1:172.21.15.37:6834/1787333914] conn(0x56172e964040 0x56172e964410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.268+0000 7fb4b1d81b80 4 client.6939 mds_command: new command op to 6840 tid=0[{"prefix": "status"}] 2023-10-06T02:28:39.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.268+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/2236579260 --> [v2:172.21.15.37:6832/1787333914,v1:172.21.15.37:6834/1787333914] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56172e838e00 con 0x56172e964040 2023-10-06T02:28:39.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.268+0000 7fb4a259c700 1 --2- 172.21.15.37:0/2236579260 >> [v2:172.21.15.37:6832/1787333914,v1:172.21.15.37:6834/1787333914] conn(0x56172e964040 0x56172e964410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.268+0000 7fb480ff9700 10 client.6939 ms_handle_connect on v2:172.21.15.37:6832/1787333914 2023-10-06T02:28:39.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.268+0000 7fb4a259c700 1 --2- 172.21.15.37:0/2236579260 >> [v2:172.21.15.37:6832/1787333914,v1:172.21.15.37:6834/1787333914] conn(0x56172e964040 0x56172e964410 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87d981be92465375 server_cookie=d084016752e3c4cb in_seq=0 out_seq=0 2023-10-06T02:28:39.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.269+0000 7fb480ff9700 1 -- 172.21.15.37:0/2236579260 <== mds.0 v2:172.21.15.37:6832/1787333914 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x56172e838e00 con 0x56172e964040 2023-10-06T02:28:39.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.269+0000 7fb480ff9700 10 client.6939 handle_command_reply: tid=0 2023-10-06T02:28:39.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.269+0000 7fb4b1d81b80 1 client.6939 shutdown 2023-10-06T02:28:39.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.269+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/2236579260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e966e50 msgr2=0x56172e974730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.269+0000 7fb4b1d81b80 1 --2- 172.21.15.37:0/2236579260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e966e50 0x56172e974730 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fb4a40cbdf0 tx=0x7fb494009040 comp rx=0 tx=0).stop 2023-10-06T02:28:39.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.269+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/2236579260 shutdown_connections 2023-10-06T02:28:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.269+0000 7fb4b1d81b80 1 --2- 172.21.15.37:0/2236579260 >> [v2:172.21.15.37:6832/1787333914,v1:172.21.15.37:6834/1787333914] conn(0x56172e964040 0x56172e964410 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.269+0000 7fb4b1d81b80 1 --2- 172.21.15.37:0/2236579260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56172e966e50 0x56172e974730 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.269+0000 7fb4b1d81b80 1 --2- 172.21.15.37:0/2236579260 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56172e9472c0 0x56172e9e7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.269+0000 7fb480ff9700 0 client.6939 ms_handle_reset on v2:172.21.15.37:6832/1787333914 2023-10-06T02:28:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.269+0000 7fb4b1d81b80 1 --2- 172.21.15.37:0/2236579260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56172e948a10 0x56172e9741f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.269+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/2236579260 >> 172.21.15.37:0/2236579260 conn(0x56172e946e80 msgr2=0x56172e945d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.269+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/2236579260 shutdown_connections 2023-10-06T02:28:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.269+0000 7fb4b1d81b80 1 -- 172.21.15.37:0/2236579260 wait complete. 2023-10-06T02:28:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.269+0000 7fb4b1d81b80 20 client.6939 trim_cache size 0 max 16384 2023-10-06T02:28:39.276 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:28:39.277 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "d1f292a2-fd8c-430a-be88-f44de408e77c", 2023-10-06T02:28:39.277 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-10-06T02:28:39.277 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6840, 2023-10-06T02:28:39.277 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-10-06T02:28:39.277 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-10-06T02:28:39.277 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-10-06T02:28:39.277 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 4.5703057180000002, 2023-10-06T02:28:39.277 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 60, 2023-10-06T02:28:39.277 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 74, 2023-10-06T02:28:39.277 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 74, 2023-10-06T02:28:39.277 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 6.6308339739999997 2023-10-06T02:28:39.278 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:28:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.269+0000 7fb4a359e700 1 -- 172.21.15.37:0/2554840491 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb484066f30 msgr2=0x7fb4840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.269+0000 7fb4a359e700 1 --2- 172.21.15.37:0/2554840491 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb484066f30 0x7fb4840693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb48c0010e0 tx=0x7fb48c009040 comp rx=0 tx=0).stop 2023-10-06T02:28:39.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.269+0000 7fb4a359e700 1 -- 172.21.15.37:0/2554840491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb490003c20 msgr2=0x7fb4a40c7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.269+0000 7fb4a359e700 1 --2- 172.21.15.37:0/2554840491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb490003c20 0x7fb4a40c7370 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fb49c00afd0 tx=0x7fb49c01a000 comp rx=0 tx=0).stop 2023-10-06T02:28:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.270+0000 7fb4a359e700 1 -- 172.21.15.37:0/2554840491 shutdown_connections 2023-10-06T02:28:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.270+0000 7fb4a359e700 1 --2- 172.21.15.37:0/2554840491 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb484066f30 0x7fb4840693e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.270+0000 7fb4a359e700 1 --2- 172.21.15.37:0/2554840491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4a4169c50 0x7fb4a416a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.270+0000 7fb4a359e700 1 --2- 172.21.15.37:0/2554840491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb490003c20 0x7fb4a40c7370 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.270+0000 7fb4a359e700 1 --2- 172.21.15.37:0/2554840491 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a4153e00 0x7fb4a416dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.270+0000 7fb4a359e700 1 -- 172.21.15.37:0/2554840491 >> 172.21.15.37:0/2554840491 conn(0x7fb4a406c0b0 msgr2=0x7fb4a4158b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.270+0000 7fb4a359e700 1 -- 172.21.15.37:0/2554840491 shutdown_connections 2023-10-06T02:28:39.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.270+0000 7fb4a359e700 1 -- 172.21.15.37:0/2554840491 wait complete. 2023-10-06T02:28:39.282 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:28:39.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.401+0000 7fd926d46700 1 Processor -- start 2023-10-06T02:28:39.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.401+0000 7fd926d46700 1 -- start start 2023-10-06T02:28:39.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.402+0000 7fd926d46700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd92006c7c0 0x7fd9200cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.402+0000 7fd926d46700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9201403e0 con 0x7fd92013f980 2023-10-06T02:28:39.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.402+0000 7fd926d46700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd92006afb0 con 0x7fd92013fd50 2023-10-06T02:28:39.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.402+0000 7fd926d46700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd92006b290 con 0x7fd92006c7c0 2023-10-06T02:28:39.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.402+0000 7fd925543700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd92006c7c0 0x7fd9200cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.402+0000 7fd925d44700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd92013f980 0x7fd92006c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48196/0 (socket says 172.21.15.37:48196) 2023-10-06T02:28:39.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.402+0000 7fd925d44700 1 -- 172.21.15.37:0/1510864055 learned_addr learned my addr 172.21.15.37:0/1510864055 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:39.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.402+0000 7fd925543700 1 -- 172.21.15.37:0/1510864055 >> v1:172.21.15.191:6789/0 conn(0x7fd92013fd50 legacy=0x7fd920163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:39.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.402+0000 7fd925543700 1 -- 172.21.15.37:0/1510864055 >> v1:172.21.15.37:6789/0 conn(0x7fd92013f980 legacy=0x7fd92006c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.402+0000 7fd925543700 1 -- 172.21.15.37:0/1510864055 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd92006b570 con 0x7fd92006c7c0 2023-10-06T02:28:39.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.403+0000 7fd925543700 1 --2- 172.21.15.37:0/1510864055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd92006c7c0 0x7fd9200cace0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd9140098e0 tx=0x7fd9140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a058c6cbcafda1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.403+0000 7fd924d42700 1 -- 172.21.15.37:0/1510864055 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd914009e80 con 0x7fd92006c7c0 2023-10-06T02:28:39.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.403+0000 7fd924d42700 1 -- 172.21.15.37:0/1510864055 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91400b820 con 0x7fd92006c7c0 2023-10-06T02:28:39.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.403+0000 7fd924d42700 1 -- 172.21.15.37:0/1510864055 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91400bba0 con 0x7fd92006c7c0 2023-10-06T02:28:39.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.403+0000 7fd926d46700 1 -- 172.21.15.37:0/1510864055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd92006c7c0 msgr2=0x7fd9200cace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.403+0000 7fd926d46700 1 --2- 172.21.15.37:0/1510864055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd92006c7c0 0x7fd9200cace0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd9140098e0 tx=0x7fd9140091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.403+0000 7fd926d46700 1 -- 172.21.15.37:0/1510864055 shutdown_connections 2023-10-06T02:28:39.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.403+0000 7fd926d46700 1 --2- 172.21.15.37:0/1510864055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd92006c7c0 0x7fd9200cace0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.403+0000 7fd926d46700 1 -- 172.21.15.37:0/1510864055 >> 172.21.15.37:0/1510864055 conn(0x7fd92006dc90 msgr2=0x7fd92006ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:39.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.403+0000 7fd926d46700 1 -- 172.21.15.37:0/1510864055 shutdown_connections 2023-10-06T02:28:39.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.403+0000 7fd926d46700 1 -- 172.21.15.37:0/1510864055 wait complete. 2023-10-06T02:28:39.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.405+0000 7fd926d46700 1 Processor -- start 2023-10-06T02:28:39.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.405+0000 7fd926d46700 1 -- start start 2023-10-06T02:28:39.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.405+0000 7fd926d46700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd92006c7c0 0x7fd92016af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.405+0000 7fd926d46700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd92013f980 0x7fd92016cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.405+0000 7fd926d46700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd92013fd50 0x7fd92013d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.405+0000 7fd926d46700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92016d150 con 0x7fd92013f980 2023-10-06T02:28:39.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.405+0000 7fd926d46700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92016ab30 con 0x7fd92013fd50 2023-10-06T02:28:39.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.405+0000 7fd926d46700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9200c8c60 con 0x7fd92006c7c0 2023-10-06T02:28:39.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.405+0000 7fd925543700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd92013f980 0x7fd92016cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.405+0000 7fd925543700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd92013f980 0x7fd92016cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56638/0 (socket says 172.21.15.37:56638) 2023-10-06T02:28:39.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.405+0000 7fd925543700 1 -- 172.21.15.37:0/3301836580 learned_addr learned my addr 172.21.15.37:0/3301836580 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:39.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.406+0000 7fd925d44700 1 --2- 172.21.15.37:0/3301836580 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd92006c7c0 0x7fd92016af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.406+0000 7fd926545700 1 --2- 172.21.15.37:0/3301836580 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd92013fd50 0x7fd92013d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.406+0000 7fd925543700 1 -- 172.21.15.37:0/3301836580 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd92006c7c0 msgr2=0x7fd92016af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.406+0000 7fd925543700 1 --2- 172.21.15.37:0/3301836580 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd92006c7c0 0x7fd92016af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.406+0000 7fd925543700 1 -- 172.21.15.37:0/3301836580 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd92013fd50 msgr2=0x7fd92013d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.406+0000 7fd925543700 1 --2- 172.21.15.37:0/3301836580 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd92013fd50 0x7fd92013d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.406+0000 7fd925543700 1 -- 172.21.15.37:0/3301836580 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd914009420 con 0x7fd92013f980 2023-10-06T02:28:39.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.406+0000 7fd925543700 1 --2- 172.21.15.37:0/3301836580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd92013f980 0x7fd92016cc10 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd9140030c0 tx=0x7fd914016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.406+0000 7fd91dffb700 1 -- 172.21.15.37:0/3301836580 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91400bae0 con 0x7fd92013f980 2023-10-06T02:28:39.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.406+0000 7fd91dffb700 1 -- 172.21.15.37:0/3301836580 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd914020070 con 0x7fd92013f980 2023-10-06T02:28:39.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.406+0000 7fd926d46700 1 -- 172.21.15.37:0/3301836580 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9200c8f40 con 0x7fd92013f980 2023-10-06T02:28:39.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.406+0000 7fd91dffb700 1 -- 172.21.15.37:0/3301836580 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91401b6a0 con 0x7fd92013f980 2023-10-06T02:28:39.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.406+0000 7fd926d46700 1 -- 172.21.15.37:0/3301836580 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd92013d920 con 0x7fd92013f980 2023-10-06T02:28:39.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.407+0000 7fd926d46700 1 -- 172.21.15.37:0/3301836580 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9200c9460 con 0x7fd92013f980 2023-10-06T02:28:39.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.408+0000 7fd91dffb700 1 -- 172.21.15.37:0/3301836580 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd914022030 con 0x7fd92013f980 2023-10-06T02:28:39.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.408+0000 7fd91dffb700 1 --2- 172.21.15.37:0/3301836580 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd90c066f30 0x7fd90c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.408+0000 7fd91dffb700 1 -- 172.21.15.37:0/3301836580 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fd914086710 con 0x7fd92013f980 2023-10-06T02:28:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.408+0000 7fd925d44700 1 --2- 172.21.15.37:0/3301836580 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd90c066f30 0x7fd90c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.409+0000 7fd925d44700 1 --2- 172.21.15.37:0/3301836580 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd90c066f30 0x7fd90c0693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd91000e160 tx=0x7fd910009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.412+0000 7fd91dffb700 1 -- 172.21.15.37:0/3301836580 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9200c9460 con 0x7fd92013f980 2023-10-06T02:28:39.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.653+0000 7fd926d46700 1 -- 172.21.15.37:0/3301836580 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd9200c9460 con 0x7fd92013f980 2023-10-06T02:28:39.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.654+0000 7fd91dffb700 1 -- 172.21.15.37:0/3301836580 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v60) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd9200c9460 con 0x7fd92013f980 2023-10-06T02:28:39.655 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:28:39.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.656+0000 7fd926d46700 1 -- 172.21.15.37:0/3301836580 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd90c066f30 msgr2=0x7fd90c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.656+0000 7fd926d46700 1 --2- 172.21.15.37:0/3301836580 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd90c066f30 0x7fd90c0693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd91000e160 tx=0x7fd910009040 comp rx=0 tx=0).stop 2023-10-06T02:28:39.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.656+0000 7fd926d46700 1 -- 172.21.15.37:0/3301836580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd92013f980 msgr2=0x7fd92016cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:39.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.656+0000 7fd926d46700 1 --2- 172.21.15.37:0/3301836580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd92013f980 0x7fd92016cc10 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd9140030c0 tx=0x7fd914016000 comp rx=0 tx=0).stop 2023-10-06T02:28:39.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.656+0000 7fd926d46700 1 -- 172.21.15.37:0/3301836580 shutdown_connections 2023-10-06T02:28:39.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.656+0000 7fd926d46700 1 --2- 172.21.15.37:0/3301836580 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd90c066f30 0x7fd90c0693e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.656+0000 7fd926d46700 1 --2- 172.21.15.37:0/3301836580 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd92013fd50 0x7fd92013d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.656+0000 7fd926d46700 1 --2- 172.21.15.37:0/3301836580 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd92006c7c0 0x7fd92016af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.656+0000 7fd926d46700 1 --2- 172.21.15.37:0/3301836580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd92013f980 0x7fd92016cc10 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:39.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.656+0000 7fd926d46700 1 -- 172.21.15.37:0/3301836580 >> 172.21.15.37:0/3301836580 conn(0x7fd92006dc90 msgr2=0x7fd92013eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:39.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.656+0000 7fd926d46700 1 -- 172.21.15.37:0/3301836580 shutdown_connections 2023-10-06T02:28:39.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:39.656+0000 7fd926d46700 1 -- 172.21.15.37:0/3301836580 wait complete. 2023-10-06T02:28:39.669 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:28:39.669 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:28:39.669 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-10-06T02:28:39.669 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:28:39.669 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:39.669 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:28:39.669 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:28:39.670 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:28:39.670 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:28:39.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:39.670 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-10-06T02:28:39.686 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:28:39.687 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:28:39.687 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:28:39.687 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:39.687 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-10-06T02:28:39.687 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:39.687 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:28:39.688 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:39.688 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-10-06T02:28:39.688 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:28:39.688 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:39.688 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-10-06T02:28:39.688 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T02:28:39.688 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42162sec preferred_lft 42162sec 2023-10-06T02:28:39.689 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-10-06T02:28:39.689 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:39.689 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:28:39.689 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:39.689 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-10-06T02:28:39.689 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:28:39.689 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:39.690 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-10-06T02:28:39.690 INFO:teuthology.orchestra.run.smithi037.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:28:39.690 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 26:84:4a:aa:8b:b5 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:28:39.690 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:28:39.690 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:39.690 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::a0fb:38ff:fe90:57e1/64 scope link 2023-10-06T02:28:39.691 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:39.691 INFO:teuthology.orchestra.run.smithi037.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:28:39.691 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 36:fb:a9:50:59:76 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:28:39.691 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::34fb:a9ff:fe50:5976/64 scope link 2023-10-06T02:28:39.691 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:39.691 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:28:39.691 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 26:84:4a:aa:8b:b5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:28:39.692 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::2484:4aff:feaa:8bb5/64 scope link 2023-10-06T02:28:39.692 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:28:39.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:39.692 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:28:39.751 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T02:28:39.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:39.753 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-10-06T02:28:39.810 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-10-06T02:28:39.810 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:28:39.810 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T02:28:39.810 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T02:28:39.810 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:28:39.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:39.811 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-10-06T02:28:39.811 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-10-06T02:28:39.811 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T02:28:39.811 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T02:28:39.811 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T02:28:39.811 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-10-06T02:28:39.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:39.913 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T02:28:39.928 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:28:39.928 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:28:39.928 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:28:39.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:39.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-10-06T02:28:39.994 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T02:28:39.994 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:28:39.994 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:40.049 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:28:40.049 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:28:40.050 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:40.104 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T02:28:40.169 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:28:40.170 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:28:40.233 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:28:40.234 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:28:40.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:40.235 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T02:28:40.291 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:28:40.291 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T02:28:40.333 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-10-06T02:28:40.358 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:28:40.358 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:28:40.416 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-10-06T02:28:40.416+0000 7fd729fec540 -1 init, newargv = 0x55e8b484ecd0 newargc=15 2023-10-06T02:28:40.416 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[116970]: starting ceph client 2023-10-06T02:28:40.421 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[116970]: starting fuse 2023-10-06T02:28:40.423 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:28:40.424 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:28:40.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:40.425 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-10-06T02:28:40.481 INFO:teuthology.orchestra.run.smithi037.stdout:46 2023-10-06T02:28:40.482 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T02:28:40.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:40.482 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-10-06T02:28:40.482 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-10-06T02:28:40.482 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:28:40.482 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-10-06T02:28:40.482 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:40.483 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-10-06T02:28:40.483 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T02:28:40.483 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-10-06T02:28:40.483 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T02:28:40.483 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:40.483 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-10-06T02:28:40.483 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-10-06T02:28:40.483 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-10-06T02:28:40.483 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-10-06T02:28:40.483 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:40.483 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-10-06T02:28:40.483 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:28:40.484 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:28:40.484 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:28:40.484 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-10-06T02:28:40.484 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-10-06T02:28:40.484 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-10-06T02:28:40.484 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:28:40.484 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:40.484 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-10-06T02:28:40.484 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:28:40.606 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.116970.asok 2023-10-06T02:28:40.787 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.116970.asok 2023-10-06T02:28:40.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:40.787 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.116970.asok status 2023-10-06T02:28:40.940 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:28:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-10-06T02:28:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:28:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:28:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-10-06T02:28:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-10-06T02:28:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T02:28:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "116970", 2023-10-06T02:28:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-10-06T02:28:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:28:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-10-06T02:28:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-10-06T02:28:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6951, 2023-10-06T02:28:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-10-06T02:28:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-10-06T02:28:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-10-06T02:28:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 6951 2023-10-06T02:28:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:28:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T02:28:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T02:28:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:28:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3970138137 2023-10-06T02:28:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-10-06T02:28:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:28:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-10-06T02:28:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-10-06T02:28:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:28:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3970138137 2023-10-06T02:28:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-10-06T02:28:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.6951 192.168.0.1:0/3970138137", 2023-10-06T02:28:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/3970138137", 2023-10-06T02:28:40.946 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-10-06T02:28:40.946 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 60, 2023-10-06T02:28:40.946 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 74, 2023-10-06T02:28:40.947 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:28:40.947 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-10-06T02:28:40.947 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-10-06T02:28:40.947 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:28:40.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:40.950 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-10-06T02:28:40.951 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:40.966 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-10-06T02:28:40.966 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:40.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:40.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:41.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:28:41.031 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2023-10-06T02:28:41.097 INFO:teuthology.orchestra.run.smithi037.stdout:./ 2023-10-06T02:28:41.097 INFO:teuthology.orchestra.run.smithi037.stdout:./parent 2023-10-06T02:28:41.097 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed 2023-10-06T02:28:41.097 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed/charlie 2023-10-06T02:28:41.098 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed/alpha 2023-10-06T02:28:41.098 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/flushed/bravo 2023-10-06T02:28:41.098 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/unflushed 2023-10-06T02:28:41.098 INFO:teuthology.orchestra.run.smithi037.stdout:./parent/unflushed/jfile 2023-10-06T02:28:41.098 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:41.098 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:28:41.098 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:28:41.098 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:41.098 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2023-10-06T02:28:41.099 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:28:41.203 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-10-06T02:28:41.391 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:41.392 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:28:41.392 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:28:41.392 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:41.392 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2023-10-06T02:28:41.392 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:28:41.498 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627776 2023-10-06T02:28:41.687 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:41.687 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:28:41.687 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:28:41.687 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:41.688 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2023-10-06T02:28:41.688 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:28:41.794 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627777 2023-10-06T02:28:41.982 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:41.982 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:28:41.983 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:28:41.983 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:41.983 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2023-10-06T02:28:41.983 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:28:42.089 INFO:teuthology.orchestra.run.smithi037.stdout:1099511628280 2023-10-06T02:28:42.277 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:42.277 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:28:42.277 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:28:42.278 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:42.278 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2023-10-06T02:28:42.278 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:28:42.384 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627778 2023-10-06T02:28:42.572 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:42.572 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:28:42.572 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:28:42.572 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:42.572 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2023-10-06T02:28:42.572 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:28:42.679 INFO:teuthology.orchestra.run.smithi037.stdout:1099511628279 2023-10-06T02:28:42.867 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:42.867 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:28:42.868 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:28:42.868 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:42.868 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2023-10-06T02:28:42.868 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:28:42.974 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627779 2023-10-06T02:28:43.163 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:28:43.163 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-10-06T02:28:43.163 DEBUG:teuthology.orchestra.run.smithi037:> import stat 2023-10-06T02:28:43.163 DEBUG:teuthology.orchestra.run.smithi037:> 2023-10-06T02:28:43.163 DEBUG:teuthology.orchestra.run.smithi037:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2023-10-06T02:28:43.163 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-10-06T02:28:43.270 INFO:teuthology.orchestra.run.smithi037.stdout:1099511627780 2023-10-06T02:28:43.459 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:28:43.459 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:28:43.544 DEBUG:teuthology.orchestra.run.smithi191:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:28:43.586 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:28:43.586 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-10-06T02:28:43.586 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:28:43.587 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T02:28:43.621 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[116970]: fuse finished with error 0 and tester_r 0 2023-10-06T02:28:43.623 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:28:43.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:43.623 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:28:43.788 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:28:43.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:43.788 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:28:43.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:28:43.807 INFO:teuthology.orchestra.run.smithi191.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T02:28:43.807 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:28:43.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:43.807 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T02:28:43.843 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:28:43.844 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T02:28:43.844 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:28:43.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:43.844 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T02:28:43.863 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:28:43.864 INFO:teuthology.orchestra.run.smithi191.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T02:28:43.864 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:44.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.003+0000 7fe099632700 1 Processor -- start 2023-10-06T02:28:44.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.003+0000 7fe099632700 1 -- start start 2023-10-06T02:28:44.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.004+0000 7fe099632700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe0941595a0 0x7fe0940b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.004+0000 7fe099632700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe09406d890 0x7fe09406dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.004+0000 7fe099632700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe09406c0b0 0x7fe09406c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.004+0000 7fe099632700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09406e270 con 0x7fe09406d890 2023-10-06T02:28:44.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.004+0000 7fe099632700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09415e180 con 0x7fe0941595a0 2023-10-06T02:28:44.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.004+0000 7fe099632700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0940b1000 con 0x7fe09406c0b0 2023-10-06T02:28:44.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.004+0000 7fe0927fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe09406d890 0x7fe09406dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.004+0000 7fe0927fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe09406d890 0x7fe09406dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56642/0 (socket says 172.21.15.37:56642) 2023-10-06T02:28:44.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.004+0000 7fe0927fc700 1 -- 172.21.15.37:0/2387175781 learned_addr learned my addr 172.21.15.37:0/2387175781 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:44.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.004+0000 7fe092ffd700 1 --2- 172.21.15.37:0/2387175781 >> v2:172.21.15.191:3300/0 conn(0x7fe0941595a0 0x7fe0940b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.004+0000 7fe0937fe700 1 --2- 172.21.15.37:0/2387175781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe09406c0b0 0x7fe09406c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.005+0000 7fe0927fc700 1 -- 172.21.15.37:0/2387175781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe09406c0b0 msgr2=0x7fe09406c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.005+0000 7fe0927fc700 1 --2- 172.21.15.37:0/2387175781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe09406c0b0 0x7fe09406c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.005+0000 7fe0927fc700 1 -- 172.21.15.37:0/2387175781 >> v2:172.21.15.191:3300/0 conn(0x7fe0941595a0 msgr2=0x7fe0940b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.005+0000 7fe0927fc700 1 --2- 172.21.15.37:0/2387175781 >> v2:172.21.15.191:3300/0 conn(0x7fe0941595a0 0x7fe0940b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.005+0000 7fe0927fc700 1 -- 172.21.15.37:0/2387175781 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09415d570 con 0x7fe09406d890 2023-10-06T02:28:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.005+0000 7fe0927fc700 1 --2- 172.21.15.37:0/2387175781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09406d890 0x7fe09406dd30 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fe09406e5d0 tx=0x7fe07c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88efd2524e279e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.005+0000 7fe091ffb700 1 -- 172.21.15.37:0/2387175781 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c00b640 con 0x7fe09406d890 2023-10-06T02:28:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.005+0000 7fe091ffb700 1 -- 172.21.15.37:0/2387175781 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07c00b7a0 con 0x7fe09406d890 2023-10-06T02:28:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.005+0000 7fe091ffb700 1 -- 172.21.15.37:0/2387175781 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c00bb40 con 0x7fe09406d890 2023-10-06T02:28:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.006+0000 7fe099632700 1 -- 172.21.15.37:0/2387175781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09406d890 msgr2=0x7fe09406dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:44.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.006+0000 7fe099632700 1 --2- 172.21.15.37:0/2387175781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09406d890 0x7fe09406dd30 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fe09406e5d0 tx=0x7fe07c009250 comp rx=0 tx=0).stop 2023-10-06T02:28:44.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.006+0000 7fe099632700 1 -- 172.21.15.37:0/2387175781 shutdown_connections 2023-10-06T02:28:44.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.006+0000 7fe099632700 1 --2- 172.21.15.37:0/2387175781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe09406c0b0 0x7fe09406c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.006+0000 7fe099632700 1 --2- 172.21.15.37:0/2387175781 >> v2:172.21.15.191:3300/0 conn(0x7fe0941595a0 0x7fe0940b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.006+0000 7fe099632700 1 --2- 172.21.15.37:0/2387175781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09406d890 0x7fe09406dd30 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.006+0000 7fe099632700 1 -- 172.21.15.37:0/2387175781 >> 172.21.15.37:0/2387175781 conn(0x7fe0940d04d0 msgr2=0x7fe0940d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:44.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.006+0000 7fe099632700 1 -- 172.21.15.37:0/2387175781 shutdown_connections 2023-10-06T02:28:44.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.006+0000 7fe099632700 1 -- 172.21.15.37:0/2387175781 wait complete. 2023-10-06T02:28:44.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.007+0000 7fe099632700 1 Processor -- start 2023-10-06T02:28:44.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.007+0000 7fe099632700 1 -- start start 2023-10-06T02:28:44.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.008+0000 7fe099632700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe09406c0b0 0x7fe0940c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.008+0000 7fe099632700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe09406d890 0x7fe0940b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.008+0000 7fe099632700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0941595a0 0x7fe094155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.008+0000 7fe099632700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0940b0df0 con 0x7fe0941595a0 2023-10-06T02:28:44.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.008+0000 7fe099632700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09415d040 con 0x7fe09406d890 2023-10-06T02:28:44.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.008+0000 7fe099632700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09415c430 con 0x7fe09406c0b0 2023-10-06T02:28:44.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.008+0000 7fe0937fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0941595a0 0x7fe094155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.008+0000 7fe0937fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0941595a0 0x7fe094155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56650/0 (socket says 172.21.15.37:56650) 2023-10-06T02:28:44.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.008+0000 7fe0937fe700 1 -- 172.21.15.37:0/1251192393 learned_addr learned my addr 172.21.15.37:0/1251192393 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:44.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.008+0000 7fe0927fc700 1 --2- 172.21.15.37:0/1251192393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe09406d890 0x7fe0940b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.008+0000 7fe092ffd700 1 --2- 172.21.15.37:0/1251192393 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe09406c0b0 0x7fe0940c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.008+0000 7fe0937fe700 1 -- 172.21.15.37:0/1251192393 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe09406c0b0 msgr2=0x7fe0940c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:44.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.009+0000 7fe0937fe700 1 --2- 172.21.15.37:0/1251192393 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe09406c0b0 0x7fe0940c50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.009+0000 7fe0937fe700 1 -- 172.21.15.37:0/1251192393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe09406d890 msgr2=0x7fe0940b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:44.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.009+0000 7fe0937fe700 1 --2- 172.21.15.37:0/1251192393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe09406d890 0x7fe0940b08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.009+0000 7fe0937fe700 1 -- 172.21.15.37:0/1251192393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c0094f0 con 0x7fe0941595a0 2023-10-06T02:28:44.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.009+0000 7fe0937fe700 1 --2- 172.21.15.37:0/1251192393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0941595a0 0x7fe094155c60 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fe084009e90 tx=0x7fe08400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:44.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.009+0000 7fe08affd700 1 -- 172.21.15.37:0/1251192393 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08400cc20 con 0x7fe0941595a0 2023-10-06T02:28:44.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.009+0000 7fe08affd700 1 -- 172.21.15.37:0/1251192393 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08400f040 con 0x7fe0941595a0 2023-10-06T02:28:44.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.009+0000 7fe099632700 1 -- 172.21.15.37:0/1251192393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09415c710 con 0x7fe0941595a0 2023-10-06T02:28:44.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.009+0000 7fe08affd700 1 -- 172.21.15.37:0/1251192393 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084014480 con 0x7fe0941595a0 2023-10-06T02:28:44.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.009+0000 7fe099632700 1 -- 172.21.15.37:0/1251192393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09415ccd0 con 0x7fe0941595a0 2023-10-06T02:28:44.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.010+0000 7fe099632700 1 -- 172.21.15.37:0/1251192393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09406e730 con 0x7fe0941595a0 2023-10-06T02:28:44.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.010+0000 7fe08affd700 1 -- 172.21.15.37:0/1251192393 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0840147f0 con 0x7fe0941595a0 2023-10-06T02:28:44.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.011+0000 7fe08affd700 1 --2- 172.21.15.37:0/1251192393 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe074066f30 0x7fe0740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.011+0000 7fe08affd700 1 -- 172.21.15.37:0/1251192393 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fe0840854f0 con 0x7fe0941595a0 2023-10-06T02:28:44.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.011+0000 7fe092ffd700 1 --2- 172.21.15.37:0/1251192393 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe074066f30 0x7fe0740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.011+0000 7fe092ffd700 1 --2- 172.21.15.37:0/1251192393 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe074066f30 0x7fe0740693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe08c009b50 tx=0x7fe08c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:44.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.015+0000 7fe08affd700 1 -- 172.21.15.37:0/1251192393 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe084055f40 con 0x7fe0941595a0 2023-10-06T02:28:44.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.253+0000 7fe099632700 1 -- 172.21.15.37:0/1251192393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe09415d1b0 con 0x7fe0941595a0 2023-10-06T02:28:44.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.254+0000 7fe08affd700 1 -- 172.21.15.37:0/1251192393 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4606 (secure 0 0 0) 0x7fe084055ad0 con 0x7fe0941595a0 2023-10-06T02:28:44.254 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:44.255 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":60,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3055524642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3055524642},{"type":"v1","addr":"172.21.15.37:6835","nonce":3055524642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2821947660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2821947660},{"type":"v1","addr":"172.21.15.191:6836","nonce":2821947660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6310,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3752119173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3752119173},{"type":"v1","addr":"172.21.15.191:6837","nonce":3752119173}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:27:43.200836+0000","modified":"2023-10-06T02:28:37.708971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6840},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6840":{"gid":6840,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/1787333914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1787333914},{"type":"v1","addr":"172.21.15.37:6834","nonce":1787333914}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:28:44.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.256+0000 7fe099632700 1 -- 172.21.15.37:0/1251192393 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe074066f30 msgr2=0x7fe0740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:44.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.256+0000 7fe099632700 1 --2- 172.21.15.37:0/1251192393 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe074066f30 0x7fe0740693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe08c009b50 tx=0x7fe08c008040 comp rx=0 tx=0).stop 2023-10-06T02:28:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.256+0000 7fe099632700 1 -- 172.21.15.37:0/1251192393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0941595a0 msgr2=0x7fe094155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.256+0000 7fe099632700 1 --2- 172.21.15.37:0/1251192393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0941595a0 0x7fe094155c60 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fe084009e90 tx=0x7fe08400b040 comp rx=0 tx=0).stop 2023-10-06T02:28:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.256+0000 7fe099632700 1 -- 172.21.15.37:0/1251192393 shutdown_connections 2023-10-06T02:28:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.256+0000 7fe099632700 1 --2- 172.21.15.37:0/1251192393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0941595a0 0x7fe094155c60 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.256+0000 7fe099632700 1 --2- 172.21.15.37:0/1251192393 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe09406c0b0 0x7fe0940c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.256+0000 7fe099632700 1 --2- 172.21.15.37:0/1251192393 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fe074066f30 0x7fe0740693e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.256+0000 7fe099632700 1 --2- 172.21.15.37:0/1251192393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe09406d890 0x7fe0940b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.256+0000 7fe099632700 1 -- 172.21.15.37:0/1251192393 >> 172.21.15.37:0/1251192393 conn(0x7fe0940d04d0 msgr2=0x7fe0940b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.256+0000 7fe099632700 1 -- 172.21.15.37:0/1251192393 shutdown_connections 2023-10-06T02:28:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.256+0000 7fe099632700 1 -- 172.21.15.37:0/1251192393 wait complete. 2023-10-06T02:28:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 60 2023-10-06T02:28:44.268 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:28:44.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.387+0000 7f877f59e700 1 Processor -- start 2023-10-06T02:28:44.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.387+0000 7f877f59e700 1 -- start start 2023-10-06T02:28:44.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.388+0000 7f877f59e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f87800b0620 0x7f8780159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.388+0000 7f877f59e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f87800b2270 0x7f878015db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.388+0000 7f877f59e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87800cb200 con 0x7f8780159370 2023-10-06T02:28:44.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.388+0000 7f877f59e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87800b5c00 con 0x7f87800b2270 2023-10-06T02:28:44.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.388+0000 7f877f59e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87800cb7c0 con 0x7f87800b0620 2023-10-06T02:28:44.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.388+0000 7f877ed9d700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f87800b2270 0x7f878015db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.388+0000 7f877dd9b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f87800b0620 0x7f8780159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.388+0000 7f877e59c700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f8780159370 0x7f87800aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:35706/0 (socket says 172.21.15.37:35706) 2023-10-06T02:28:44.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.388+0000 7f877ed9d700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f87800b2270 0x7f878015db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:54374/0 (socket says 172.21.15.37:54374) 2023-10-06T02:28:44.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.388+0000 7f877e59c700 1 -- 172.21.15.37:0/443400059 learned_addr learned my addr 172.21.15.37:0/443400059 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:44.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.388+0000 7f877ed9d700 1 -- 172.21.15.37:0/443400059 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f87800b0620 msgr2=0x7f8780159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:44.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.388+0000 7f877ed9d700 1 --2- 172.21.15.37:0/443400059 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f87800b0620 0x7f8780159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.388+0000 7f877ed9d700 1 -- 172.21.15.37:0/443400059 >> v1:172.21.15.191:6789/0 conn(0x7f8780159370 legacy=0x7f87800aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:44.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.388+0000 7f877ed9d700 1 -- 172.21.15.37:0/443400059 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878015e0d0 con 0x7f87800b2270 2023-10-06T02:28:44.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.389+0000 7f877ed9d700 1 --2- 172.21.15.37:0/443400059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87800b2270 0x7f878015db90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8778009e60 tx=0x7f8778009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ca66b1ff0edbce2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:44.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.389+0000 7f877d59a700 1 -- 172.21.15.37:0/443400059 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877800e070 con 0x7f87800b2270 2023-10-06T02:28:44.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.389+0000 7f877d59a700 1 -- 172.21.15.37:0/443400059 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877800bb60 con 0x7f87800b2270 2023-10-06T02:28:44.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.389+0000 7f877d59a700 1 -- 172.21.15.37:0/443400059 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778012430 con 0x7f87800b2270 2023-10-06T02:28:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.389+0000 7f877f59e700 1 -- 172.21.15.37:0/443400059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87800b2270 msgr2=0x7f878015db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.389+0000 7f877f59e700 1 --2- 172.21.15.37:0/443400059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87800b2270 0x7f878015db90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8778009e60 tx=0x7f8778009780 comp rx=0 tx=0).stop 2023-10-06T02:28:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.389+0000 7f877f59e700 1 -- 172.21.15.37:0/443400059 shutdown_connections 2023-10-06T02:28:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.389+0000 7f877f59e700 1 --2- 172.21.15.37:0/443400059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87800b2270 0x7f878015db90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.389+0000 7f877f59e700 1 --2- 172.21.15.37:0/443400059 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f87800b0620 0x7f8780159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.389+0000 7f877f59e700 1 -- 172.21.15.37:0/443400059 >> 172.21.15.37:0/443400059 conn(0x7f878006c0b0 msgr2=0x7f878006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.390+0000 7f877f59e700 1 -- 172.21.15.37:0/443400059 shutdown_connections 2023-10-06T02:28:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.390+0000 7f877f59e700 1 -- 172.21.15.37:0/443400059 wait complete. 2023-10-06T02:28:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.391+0000 7f877f59e700 1 Processor -- start 2023-10-06T02:28:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.391+0000 7f877f59e700 1 -- start start 2023-10-06T02:28:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.391+0000 7f877f59e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87800b0620 0x7f87800c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.391+0000 7f877f59e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f87800b2270 0x7f878015c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.391+0000 7f877f59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8780159370 0x7f87800cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.391+0000 7f877f59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87800ca0e0 con 0x7f8780159370 2023-10-06T02:28:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.391+0000 7f877f59e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87800c9390 con 0x7f87800b0620 2023-10-06T02:28:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.391+0000 7f877f59e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87800c83b0 con 0x7f87800b2270 2023-10-06T02:28:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.391+0000 7f877ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8780159370 0x7f87800cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.392+0000 7f877ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8780159370 0x7f87800cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56666/0 (socket says 172.21.15.37:56666) 2023-10-06T02:28:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.392+0000 7f877ed9d700 1 -- 172.21.15.37:0/2802937364 learned_addr learned my addr 172.21.15.37:0/2802937364 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.392+0000 7f877e59c700 1 --2- 172.21.15.37:0/2802937364 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87800b0620 0x7f87800c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.392+0000 7f877dd9b700 1 --2- 172.21.15.37:0/2802937364 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f87800b2270 0x7f878015c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.392+0000 7f877ed9d700 1 -- 172.21.15.37:0/2802937364 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f87800b2270 msgr2=0x7f878015c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.392+0000 7f877ed9d700 1 --2- 172.21.15.37:0/2802937364 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f87800b2270 0x7f878015c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.392+0000 7f877ed9d700 1 -- 172.21.15.37:0/2802937364 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87800b0620 msgr2=0x7f87800c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.392+0000 7f877ed9d700 1 --2- 172.21.15.37:0/2802937364 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87800b0620 0x7f87800c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.392+0000 7f877ed9d700 1 -- 172.21.15.37:0/2802937364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8778009a20 con 0x7f8780159370 2023-10-06T02:28:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.392+0000 7f877e59c700 1 --2- 172.21.15.37:0/2802937364 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87800b0620 0x7f87800c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.392+0000 7f877ed9d700 1 --2- 172.21.15.37:0/2802937364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8780159370 0x7f87800cbc50 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f878006ea40 tx=0x7f8778019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.392+0000 7f876e7fc700 1 -- 172.21.15.37:0/2802937364 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778012ea0 con 0x7f8780159370 2023-10-06T02:28:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.392+0000 7f876e7fc700 1 -- 172.21.15.37:0/2802937364 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8778027470 con 0x7f8780159370 2023-10-06T02:28:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.392+0000 7f877f59e700 1 -- 172.21.15.37:0/2802937364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878016a4d0 con 0x7f8780159370 2023-10-06T02:28:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.392+0000 7f876e7fc700 1 -- 172.21.15.37:0/2802937364 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778027850 con 0x7f8780159370 2023-10-06T02:28:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.392+0000 7f877f59e700 1 -- 172.21.15.37:0/2802937364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87800c8930 con 0x7f8780159370 2023-10-06T02:28:44.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.393+0000 7f877f59e700 1 -- 172.21.15.37:0/2802937364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87800c8b50 con 0x7f8780159370 2023-10-06T02:28:44.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.394+0000 7f876e7fc700 1 -- 172.21.15.37:0/2802937364 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8778024070 con 0x7f8780159370 2023-10-06T02:28:44.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.394+0000 7f876e7fc700 1 --2- 172.21.15.37:0/2802937364 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8760066f30 0x7f87600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.394+0000 7f876e7fc700 1 -- 172.21.15.37:0/2802937364 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f8778087270 con 0x7f8780159370 2023-10-06T02:28:44.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.394+0000 7f877e59c700 1 --2- 172.21.15.37:0/2802937364 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8760066f30 0x7f87600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.395+0000 7f877e59c700 1 --2- 172.21.15.37:0/2802937364 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8760066f30 0x7f87600693e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f878015cc80 tx=0x7f8770007f10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:44.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.398+0000 7f876e7fc700 1 -- 172.21.15.37:0/2802937364 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87780542d0 con 0x7f8780159370 2023-10-06T02:28:44.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.591+0000 7f877f59e700 1 -- 172.21.15.37:0/2802937364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87800645f0 con 0x7f8780159370 2023-10-06T02:28:44.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.592+0000 7f876e7fc700 1 -- 172.21.15.37:0/2802937364 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+17130 (secure 0 0 0) 0x7f87780578f0 con 0x7f8780159370 2023-10-06T02:28:44.593 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:44.593 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":74,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:28:32.607238+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:27:40.951347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T02:27:42.184642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6834/4246185831":"2023-10-07T02:28:32.607211+0000","172.21.15.37:6832/4246185831":"2023-10-07T02:28:32.607211+0000","172.21.15.191:6837/2764715102":"2023-10-07T02:28:14.483678+0000","172.21.15.191:6834/2764715102":"2023-10-07T02:28:14.483678+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:28:44.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.594+0000 7f877f59e700 1 -- 172.21.15.37:0/2802937364 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8760066f30 msgr2=0x7f87600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:44.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.594+0000 7f877f59e700 1 --2- 172.21.15.37:0/2802937364 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8760066f30 0x7f87600693e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f878015cc80 tx=0x7f8770007f10 comp rx=0 tx=0).stop 2023-10-06T02:28:44.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.594+0000 7f877f59e700 1 -- 172.21.15.37:0/2802937364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8780159370 msgr2=0x7f87800cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:44.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.594+0000 7f877f59e700 1 --2- 172.21.15.37:0/2802937364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8780159370 0x7f87800cbc50 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f878006ea40 tx=0x7f8778019000 comp rx=0 tx=0).stop 2023-10-06T02:28:44.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.594+0000 7f877f59e700 1 -- 172.21.15.37:0/2802937364 shutdown_connections 2023-10-06T02:28:44.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.594+0000 7f877f59e700 1 --2- 172.21.15.37:0/2802937364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8780159370 0x7f87800cbc50 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.594+0000 7f877f59e700 1 --2- 172.21.15.37:0/2802937364 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f8760066f30 0x7f87600693e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.594+0000 7f877f59e700 1 --2- 172.21.15.37:0/2802937364 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87800b0620 0x7f87800c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.594+0000 7f877f59e700 1 --2- 172.21.15.37:0/2802937364 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f87800b2270 0x7f878015c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.594+0000 7f877f59e700 1 -- 172.21.15.37:0/2802937364 >> 172.21.15.37:0/2802937364 conn(0x7f878006c0b0 msgr2=0x7f87800b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:44.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.594+0000 7f877f59e700 1 -- 172.21.15.37:0/2802937364 shutdown_connections 2023-10-06T02:28:44.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.594+0000 7f877f59e700 1 -- 172.21.15.37:0/2802937364 wait complete. 2023-10-06T02:28:44.607 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:23:08.066048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:23:08.561964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:27:40.951347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:27:42.184642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:28:44.607 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:28:44.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.729+0000 7f708036c700 1 Processor -- start 2023-10-06T02:28:44.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.729+0000 7f708036c700 1 -- start start 2023-10-06T02:28:44.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.730+0000 7f708036c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70780b3310 0x7f70780b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.730+0000 7f708036c700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70780b43b0 con 0x7f70781599e0 2023-10-06T02:28:44.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.730+0000 7f708036c700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70780b37a0 con 0x7f7078159610 2023-10-06T02:28:44.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.730+0000 7f708036c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70780cde50 con 0x7f70780b3310 2023-10-06T02:28:44.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.730+0000 7f707d907700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f70781599e0 0x7f70780b4840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48210/0 (socket says 172.21.15.37:48210) 2023-10-06T02:28:44.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.730+0000 7f707d907700 1 -- 172.21.15.37:0/3560607086 learned_addr learned my addr 172.21.15.37:0/3560607086 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:44.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.730+0000 7f707e909700 1 --2- 172.21.15.37:0/3560607086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70780b3310 0x7f70780b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.730+0000 7f707d106700 1 -- 172.21.15.37:0/3560607086 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141565740 0 0) 0x7f70780b43b0 con 0x7f70781599e0 2023-10-06T02:28:44.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.730+0000 7f707d106700 1 -- 172.21.15.37:0/3560607086 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7064003570 con 0x7f70781599e0 2023-10-06T02:28:44.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707d106700 1 -- 172.21.15.37:0/3560607086 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963849612 0 0) 0x7f70780b37a0 con 0x7f7078159610 2023-10-06T02:28:44.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707d106700 1 -- 172.21.15.37:0/3560607086 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70780b43b0 con 0x7f7078159610 2023-10-06T02:28:44.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707d106700 1 -- 172.21.15.37:0/3560607086 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2805448201 0 0) 0x7f7064003570 con 0x7f70781599e0 2023-10-06T02:28:44.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707d106700 1 -- 172.21.15.37:0/3560607086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70780b3310 msgr2=0x7f70780b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:44.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707d106700 1 --2- 172.21.15.37:0/3560607086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70780b3310 0x7f70780b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707d106700 1 -- 172.21.15.37:0/3560607086 >> v1:172.21.15.191:6789/0 conn(0x7f7078159610 legacy=0x7f70780d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:44.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707d106700 1 -- 172.21.15.37:0/3560607086 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70780b3a80 con 0x7f70781599e0 2023-10-06T02:28:44.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707d106700 1 -- 172.21.15.37:0/3560607086 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f7068001470 con 0x7f70781599e0 2023-10-06T02:28:44.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707d106700 1 -- 172.21.15.37:0/3560607086 >> v1:172.21.15.37:6789/0 conn(0x7f70781599e0 legacy=0x7f70780b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:44.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707d106700 1 --2- 172.21.15.37:0/3560607086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7064003c20 0x7f7064004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707d106700 1 --2- 172.21.15.37:0/3560607086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70780b3310 0x7f7064004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707d106700 1 --2- 172.21.15.37:0/3560607086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7064004d50 0x7f70640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707d106700 1 -- 172.21.15.37:0/3560607086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70780cde50 con 0x7f7064004d50 2023-10-06T02:28:44.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707d106700 1 -- 172.21.15.37:0/3560607086 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706400bb40 con 0x7f7064003c20 2023-10-06T02:28:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707d106700 1 -- 172.21.15.37:0/3560607086 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706400bd00 con 0x7f70780b3310 2023-10-06T02:28:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707e909700 1 --2- 172.21.15.37:0/3560607086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7064004d50 0x7f70640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707e108700 1 --2- 172.21.15.37:0/3560607086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7064003c20 0x7f7064004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707d907700 1 --2- 172.21.15.37:0/3560607086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70780b3310 0x7f7064004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707e909700 1 -- 172.21.15.37:0/3560607086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70780b3310 msgr2=0x7f7064004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707e909700 1 --2- 172.21.15.37:0/3560607086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70780b3310 0x7f7064004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707e909700 1 -- 172.21.15.37:0/3560607086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7064003c20 msgr2=0x7f7064004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707e909700 1 --2- 172.21.15.37:0/3560607086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7064003c20 0x7f7064004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707e909700 1 -- 172.21.15.37:0/3560607086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7064003570 con 0x7f7064004d50 2023-10-06T02:28:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.731+0000 7f707e909700 1 --2- 172.21.15.37:0/3560607086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7064004d50 0x7f70640051c0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f7070009c00 tx=0x7f70700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2863132c631388 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.732+0000 7f707d106700 1 -- 172.21.15.37:0/3560607086 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707000e710 con 0x7f7064004d50 2023-10-06T02:28:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.732+0000 7f707d106700 1 -- 172.21.15.37:0/3560607086 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707000e870 con 0x7f7064004d50 2023-10-06T02:28:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.732+0000 7f707d106700 1 -- 172.21.15.37:0/3560607086 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707000ec30 con 0x7f7064004d50 2023-10-06T02:28:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.732+0000 7f708036c700 1 -- 172.21.15.37:0/3560607086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7064004d50 msgr2=0x7f70640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.732+0000 7f708036c700 1 --2- 172.21.15.37:0/3560607086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7064004d50 0x7f70640051c0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f7070009c00 tx=0x7f70700091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.732+0000 7f707e909700 1 -- 172.21.15.37:0/3560607086 reap_dead start 2023-10-06T02:28:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.732+0000 7f708036c700 1 -- 172.21.15.37:0/3560607086 shutdown_connections 2023-10-06T02:28:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.732+0000 7f708036c700 1 -- 172.21.15.37:0/3560607086 >> 172.21.15.37:0/3560607086 conn(0x7f707806c0b0 msgr2=0x7f707806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.732+0000 7f708036c700 1 -- 172.21.15.37:0/3560607086 shutdown_connections 2023-10-06T02:28:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.732+0000 7f708036c700 1 -- 172.21.15.37:0/3560607086 wait complete. 2023-10-06T02:28:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.733+0000 7f708036c700 1 Processor -- start 2023-10-06T02:28:44.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.733+0000 7f708036c700 1 -- start start 2023-10-06T02:28:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.734+0000 7f708036c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7064004d50 0x7f70780c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.734+0000 7f708036c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70780c4370 0x7f70780ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.734+0000 7f708036c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70780c47e0 0x7f70780ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.734+0000 7f708036c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70780ca8a0 con 0x7f7064004d50 2023-10-06T02:28:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.734+0000 7f708036c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7078155bd0 con 0x7f70780c47e0 2023-10-06T02:28:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.734+0000 7f708036c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70780ca410 con 0x7f70780c4370 2023-10-06T02:28:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.734+0000 7f707e108700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7064004d50 0x7f70780c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.734+0000 7f707e108700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7064004d50 0x7f70780c66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56682/0 (socket says 172.21.15.37:56682) 2023-10-06T02:28:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.734+0000 7f707e108700 1 -- 172.21.15.37:0/2405422899 learned_addr learned my addr 172.21.15.37:0/2405422899 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.734+0000 7f707d907700 1 --2- 172.21.15.37:0/2405422899 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70780c4370 0x7f70780ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.734+0000 7f707e909700 1 --2- 172.21.15.37:0/2405422899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70780c47e0 0x7f70780ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.734+0000 7f707e108700 1 -- 172.21.15.37:0/2405422899 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70780c4370 msgr2=0x7f70780ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.734+0000 7f707e108700 1 --2- 172.21.15.37:0/2405422899 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70780c4370 0x7f70780ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.734+0000 7f707e108700 1 -- 172.21.15.37:0/2405422899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70780c47e0 msgr2=0x7f70780ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.734+0000 7f707e108700 1 --2- 172.21.15.37:0/2405422899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70780c47e0 0x7f70780ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.734+0000 7f707e108700 1 -- 172.21.15.37:0/2405422899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70780c9800 con 0x7f7064004d50 2023-10-06T02:28:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.735+0000 7f707e108700 1 --2- 172.21.15.37:0/2405422899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7064004d50 0x7f70780c66b0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f707400ecc0 tx=0x7f70740017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.735+0000 7f706e7fc700 1 -- 172.21.15.37:0/2405422899 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707400ee70 con 0x7f7064004d50 2023-10-06T02:28:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.735+0000 7f706e7fc700 1 -- 172.21.15.37:0/2405422899 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707400cb10 con 0x7f7064004d50 2023-10-06T02:28:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.735+0000 7f708036c700 1 -- 172.21.15.37:0/2405422899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70780c9ae0 con 0x7f7064004d50 2023-10-06T02:28:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.735+0000 7f706e7fc700 1 -- 172.21.15.37:0/2405422899 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7074015430 con 0x7f7064004d50 2023-10-06T02:28:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.735+0000 7f708036c700 1 -- 172.21.15.37:0/2405422899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70780ca0a0 con 0x7f7064004d50 2023-10-06T02:28:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.736+0000 7f708036c700 1 -- 172.21.15.37:0/2405422899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7078088b30 con 0x7f7064004d50 2023-10-06T02:28:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.736+0000 7f706e7fc700 1 -- 172.21.15.37:0/2405422899 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f70740157a0 con 0x7f7064004d50 2023-10-06T02:28:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.737+0000 7f706e7fc700 1 --2- 172.21.15.37:0/2405422899 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f705c066f30 0x7f705c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.737+0000 7f706e7fc700 1 -- 172.21.15.37:0/2405422899 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f70740850e0 con 0x7f7064004d50 2023-10-06T02:28:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.737+0000 7f707d907700 1 --2- 172.21.15.37:0/2405422899 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f705c066f30 0x7f705c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:44.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.737+0000 7f707d907700 1 --2- 172.21.15.37:0/2405422899 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f705c066f30 0x7f705c0693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f70680015a0 tx=0x7f7068009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:44.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.741+0000 7f706e7fc700 1 -- 172.21.15.37:0/2405422899 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7074052140 con 0x7f7064004d50 2023-10-06T02:28:44.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.932+0000 7f708036c700 1 -- 172.21.15.37:0/2405422899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f70780b3d60 con 0x7f7064004d50 2023-10-06T02:28:44.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.932+0000 7f706e7fc700 1 -- 172.21.15.37:0/2405422899 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v74) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7074055760 con 0x7f7064004d50 2023-10-06T02:28:44.933 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-10-06T02:28:44.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.934+0000 7f708036c700 1 -- 172.21.15.37:0/2405422899 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f705c066f30 msgr2=0x7f705c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:44.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.934+0000 7f708036c700 1 --2- 172.21.15.37:0/2405422899 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f705c066f30 0x7f705c0693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f70680015a0 tx=0x7f7068009040 comp rx=0 tx=0).stop 2023-10-06T02:28:44.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.934+0000 7f708036c700 1 -- 172.21.15.37:0/2405422899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7064004d50 msgr2=0x7f70780c66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:44.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.934+0000 7f708036c700 1 --2- 172.21.15.37:0/2405422899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7064004d50 0x7f70780c66b0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f707400ecc0 tx=0x7f70740017a0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.934+0000 7f708036c700 1 -- 172.21.15.37:0/2405422899 shutdown_connections 2023-10-06T02:28:44.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.934+0000 7f708036c700 1 --2- 172.21.15.37:0/2405422899 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f705c066f30 0x7f705c0693e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.934+0000 7f708036c700 1 --2- 172.21.15.37:0/2405422899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70780c47e0 0x7f70780ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.934+0000 7f708036c700 1 --2- 172.21.15.37:0/2405422899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7064004d50 0x7f70780c66b0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.934+0000 7f708036c700 1 --2- 172.21.15.37:0/2405422899 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70780c4370 0x7f70780ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:44.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.934+0000 7f708036c700 1 -- 172.21.15.37:0/2405422899 >> 172.21.15.37:0/2405422899 conn(0x7f707806c0b0 msgr2=0x7f70780ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:44.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.934+0000 7f708036c700 1 -- 172.21.15.37:0/2405422899 shutdown_connections 2023-10-06T02:28:44.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:44.934+0000 7f708036c700 1 -- 172.21.15.37:0/2405422899 wait complete. 2023-10-06T02:28:44.947 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:28:45.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.071+0000 7f6b47317700 1 Processor -- start 2023-10-06T02:28:45.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.071+0000 7f6b47317700 1 -- start start 2023-10-06T02:28:45.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.072+0000 7f6b47317700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6b400b29d0 0x7f6b400ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:45.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.072+0000 7f6b47317700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b400cb170 0x7f6b400cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:45.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.072+0000 7f6b47317700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b400b2da0 con 0x7f6b400cf340 2023-10-06T02:28:45.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.072+0000 7f6b47317700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b40099bd0 con 0x7f6b400b29d0 2023-10-06T02:28:45.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.072+0000 7f6b47317700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b40159a70 con 0x7f6b400cb170 2023-10-06T02:28:45.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.072+0000 7f6b46315700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6b400b29d0 0x7f6b400ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:45.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.072+0000 7f6b45b14700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b400cb170 0x7f6b400cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:45.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.072+0000 7f6b46b16700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f6b400cf340 0x7f6b400c5170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:35720/0 (socket says 172.21.15.37:35720) 2023-10-06T02:28:45.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.072+0000 7f6b46b16700 1 -- 172.21.15.37:0/513274860 learned_addr learned my addr 172.21.15.37:0/513274860 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:45.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.072+0000 7f6b45313700 1 -- 172.21.15.37:0/513274860 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372305616 0 0) 0x7f6b38001490 con 0x7f6b400cf340 2023-10-06T02:28:45.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.072+0000 7f6b45313700 1 -- 172.21.15.37:0/513274860 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b28003570 con 0x7f6b400cf340 2023-10-06T02:28:45.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.073+0000 7f6b46315700 1 -- 172.21.15.37:0/513274860 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b400cb170 msgr2=0x7f6b400cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:45.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.073+0000 7f6b46315700 1 --2- 172.21.15.37:0/513274860 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b400cb170 0x7f6b400cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.073+0000 7f6b46315700 1 -- 172.21.15.37:0/513274860 >> v1:172.21.15.191:6789/0 conn(0x7f6b400cf340 legacy=0x7f6b400c5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:45.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.073+0000 7f6b46315700 1 -- 172.21.15.37:0/513274860 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b400cb5e0 con 0x7f6b400b29d0 2023-10-06T02:28:45.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.073+0000 7f6b45b14700 1 --2- 172.21.15.37:0/513274860 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b400cb170 0x7f6b400cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:45.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.073+0000 7f6b46315700 1 --2- 172.21.15.37:0/513274860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b400b29d0 0x7f6b400ce8c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6b300098e0 tx=0x7f6b300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b12cd3712742cf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:45.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.073+0000 7f6b45313700 1 -- 172.21.15.37:0/513274860 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30011630 con 0x7f6b400b29d0 2023-10-06T02:28:45.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.073+0000 7f6b45313700 1 -- 172.21.15.37:0/513274860 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b30011790 con 0x7f6b400b29d0 2023-10-06T02:28:45.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.073+0000 7f6b45313700 1 -- 172.21.15.37:0/513274860 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30011b30 con 0x7f6b400b29d0 2023-10-06T02:28:45.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.073+0000 7f6b47317700 1 -- 172.21.15.37:0/513274860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b400b29d0 msgr2=0x7f6b400ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:45.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.073+0000 7f6b47317700 1 --2- 172.21.15.37:0/513274860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b400b29d0 0x7f6b400ce8c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6b300098e0 tx=0x7f6b300091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.074+0000 7f6b47317700 1 -- 172.21.15.37:0/513274860 shutdown_connections 2023-10-06T02:28:45.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.074+0000 7f6b47317700 1 --2- 172.21.15.37:0/513274860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b400b29d0 0x7f6b400ce8c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.074+0000 7f6b47317700 1 --2- 172.21.15.37:0/513274860 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b400cb170 0x7f6b400cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.074+0000 7f6b47317700 1 -- 172.21.15.37:0/513274860 >> 172.21.15.37:0/513274860 conn(0x7f6b40099610 msgr2=0x7f6b4006c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:45.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.074+0000 7f6b47317700 1 -- 172.21.15.37:0/513274860 shutdown_connections 2023-10-06T02:28:45.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.074+0000 7f6b47317700 1 -- 172.21.15.37:0/513274860 wait complete. 2023-10-06T02:28:45.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.075+0000 7f6b47317700 1 Processor -- start 2023-10-06T02:28:45.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.075+0000 7f6b47317700 1 -- start start 2023-10-06T02:28:45.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.075+0000 7f6b47317700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b400b29d0 0x7f6b4015ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:45.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.075+0000 7f6b47317700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b400cb170 0x7f6b400cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:45.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.075+0000 7f6b47317700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b400cf340 0x7f6b4016d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:45.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.075+0000 7f6b47317700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b40149640 con 0x7f6b400b29d0 2023-10-06T02:28:45.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.075+0000 7f6b47317700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400b3ac0 con 0x7f6b400cb170 2023-10-06T02:28:45.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.075+0000 7f6b47317700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4014ce00 con 0x7f6b400cf340 2023-10-06T02:28:45.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.076+0000 7f6b46315700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b400b29d0 0x7f6b4015ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:45.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.076+0000 7f6b46315700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b400b29d0 0x7f6b4015ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56696/0 (socket says 172.21.15.37:56696) 2023-10-06T02:28:45.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.076+0000 7f6b46315700 1 -- 172.21.15.37:0/401330253 learned_addr learned my addr 172.21.15.37:0/401330253 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:45.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.076+0000 7f6b45b14700 1 --2- 172.21.15.37:0/401330253 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b400cb170 0x7f6b400cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:45.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.076+0000 7f6b46b16700 1 --2- 172.21.15.37:0/401330253 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b400cf340 0x7f6b4016d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:45.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.076+0000 7f6b46315700 1 -- 172.21.15.37:0/401330253 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b400cf340 msgr2=0x7f6b4016d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:45.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.076+0000 7f6b46315700 1 --2- 172.21.15.37:0/401330253 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b400cf340 0x7f6b4016d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.076+0000 7f6b46315700 1 -- 172.21.15.37:0/401330253 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b400cb170 msgr2=0x7f6b400cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:45.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.076+0000 7f6b46315700 1 --2- 172.21.15.37:0/401330253 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b400cb170 0x7f6b400cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.076+0000 7f6b46315700 1 -- 172.21.15.37:0/401330253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b34009420 con 0x7f6b400b29d0 2023-10-06T02:28:45.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.076+0000 7f6b46315700 1 --2- 172.21.15.37:0/401330253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b400b29d0 0x7f6b4015ea30 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f6b400d1430 tx=0x7f6b30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:45.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.076+0000 7f6b3e7fc700 1 -- 172.21.15.37:0/401330253 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30011900 con 0x7f6b400b29d0 2023-10-06T02:28:45.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.076+0000 7f6b3e7fc700 1 -- 172.21.15.37:0/401330253 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b30011a60 con 0x7f6b400b29d0 2023-10-06T02:28:45.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.076+0000 7f6b3e7fc700 1 -- 172.21.15.37:0/401330253 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30023620 con 0x7f6b400b29d0 2023-10-06T02:28:45.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.076+0000 7f6b47317700 1 -- 172.21.15.37:0/401330253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b30009420 con 0x7f6b400b29d0 2023-10-06T02:28:45.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.077+0000 7f6b47317700 1 -- 172.21.15.37:0/401330253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4014d150 con 0x7f6b400b29d0 2023-10-06T02:28:45.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.077+0000 7f6b47317700 1 -- 172.21.15.37:0/401330253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b400891a0 con 0x7f6b400b29d0 2023-10-06T02:28:45.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.078+0000 7f6b3e7fc700 1 -- 172.21.15.37:0/401330253 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b3002c3b0 con 0x7f6b400b29d0 2023-10-06T02:28:45.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.078+0000 7f6b3e7fc700 1 --2- 172.21.15.37:0/401330253 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6b2c066f30 0x7f6b2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:45.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.078+0000 7f6b3e7fc700 1 -- 172.21.15.37:0/401330253 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f6b30085ac0 con 0x7f6b400b29d0 2023-10-06T02:28:45.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.079+0000 7f6b45b14700 1 --2- 172.21.15.37:0/401330253 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6b2c066f30 0x7f6b2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:45.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.079+0000 7f6b45b14700 1 --2- 172.21.15.37:0/401330253 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6b2c066f30 0x7f6b2c0693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6b34009f40 tx=0x7f6b340091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:45.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.082+0000 7f6b3e7fc700 1 -- 172.21.15.37:0/401330253 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b30052ba0 con 0x7f6b400b29d0 2023-10-06T02:28:45.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.272+0000 7f6b47317700 1 -- 172.21.15.37:0/401330253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b400884f0 con 0x7f6b400b29d0 2023-10-06T02:28:45.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.272+0000 7f6b3e7fc700 1 -- 172.21.15.37:0/401330253 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b300561c0 con 0x7f6b400b29d0 2023-10-06T02:28:45.273 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-10-06T02:28:45.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.274+0000 7f6b47317700 1 -- 172.21.15.37:0/401330253 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6b2c066f30 msgr2=0x7f6b2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:45.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.274+0000 7f6b47317700 1 --2- 172.21.15.37:0/401330253 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6b2c066f30 0x7f6b2c0693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6b34009f40 tx=0x7f6b340091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.274+0000 7f6b47317700 1 -- 172.21.15.37:0/401330253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b400b29d0 msgr2=0x7f6b4015ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:45.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.274+0000 7f6b47317700 1 --2- 172.21.15.37:0/401330253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b400b29d0 0x7f6b4015ea30 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f6b400d1430 tx=0x7f6b30017000 comp rx=0 tx=0).stop 2023-10-06T02:28:45.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.274+0000 7f6b47317700 1 -- 172.21.15.37:0/401330253 shutdown_connections 2023-10-06T02:28:45.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.274+0000 7f6b47317700 1 --2- 172.21.15.37:0/401330253 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b400cf340 0x7f6b4016d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.274+0000 7f6b47317700 1 --2- 172.21.15.37:0/401330253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b400b29d0 0x7f6b4015ea30 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.274+0000 7f6b47317700 1 --2- 172.21.15.37:0/401330253 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6b2c066f30 0x7f6b2c0693e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.274+0000 7f6b47317700 1 --2- 172.21.15.37:0/401330253 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b400cb170 0x7f6b400cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.274+0000 7f6b47317700 1 -- 172.21.15.37:0/401330253 >> 172.21.15.37:0/401330253 conn(0x7f6b40099610 msgr2=0x7f6b4015fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:45.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.274+0000 7f6b47317700 1 -- 172.21.15.37:0/401330253 shutdown_connections 2023-10-06T02:28:45.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.274+0000 7f6b47317700 1 -- 172.21.15.37:0/401330253 wait complete. 2023-10-06T02:28:45.287 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:28:45.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.408+0000 7fce06c36700 1 Processor -- start 2023-10-06T02:28:45.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.408+0000 7fce06c36700 1 -- start start 2023-10-06T02:28:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.409+0000 7fce06c36700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fce000b2b80 0x7fce001646d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.409+0000 7fce06c36700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce000b40a0 con 0x7fce000af8a0 2023-10-06T02:28:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.409+0000 7fce06c36700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce000b31b0 con 0x7fce000af4d0 2023-10-06T02:28:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.409+0000 7fce06c36700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce000b1a60 con 0x7fce000b2b80 2023-10-06T02:28:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.409+0000 7fce05433700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fce000af8a0 0x7fce000d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44680/0 (socket says 172.21.15.37:44680) 2023-10-06T02:28:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.409+0000 7fce05433700 1 -- 172.21.15.37:0/1821533930 learned_addr learned my addr 172.21.15.37:0/1821533930 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.409+0000 7fce06435700 1 --2- 172.21.15.37:0/1821533930 >> v2:172.21.15.191:3300/0 conn(0x7fce000b2b80 0x7fce001646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.409+0000 7fce04c32700 1 -- 172.21.15.37:0/1821533930 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296460837 0 0) 0x7fce000b40a0 con 0x7fce000af8a0 2023-10-06T02:28:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.409+0000 7fce04c32700 1 -- 172.21.15.37:0/1821533930 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcde8003570 con 0x7fce000af8a0 2023-10-06T02:28:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.410+0000 7fce04c32700 1 -- 172.21.15.37:0/1821533930 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189698873 0 0) 0x7fce000b31b0 con 0x7fce000af4d0 2023-10-06T02:28:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.410+0000 7fce04c32700 1 -- 172.21.15.37:0/1821533930 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce000b40a0 con 0x7fce000af4d0 2023-10-06T02:28:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.410+0000 7fce06435700 1 -- 172.21.15.37:0/1821533930 >> v1:172.21.15.191:6789/0 conn(0x7fce000af4d0 legacy=0x7fce000b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.410+0000 7fce06435700 1 -- 172.21.15.37:0/1821533930 >> v1:172.21.15.37:6789/0 conn(0x7fce000af8a0 legacy=0x7fce000d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.410+0000 7fce06435700 1 -- 172.21.15.37:0/1821533930 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce000b3490 con 0x7fce000b2b80 2023-10-06T02:28:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.410+0000 7fce06435700 1 --2- 172.21.15.37:0/1821533930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce000b2b80 0x7fce001646d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009e60 tx=0x7fcdf8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b32e1b796365e29b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.410+0000 7fce04c32700 1 -- 172.21.15.37:0/1821533930 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf800e070 con 0x7fce000b2b80 2023-10-06T02:28:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.410+0000 7fce04c32700 1 -- 172.21.15.37:0/1821533930 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf800bab0 con 0x7fce000b2b80 2023-10-06T02:28:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.410+0000 7fce04c32700 1 -- 172.21.15.37:0/1821533930 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf800be70 con 0x7fce000b2b80 2023-10-06T02:28:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.411+0000 7fce06c36700 1 -- 172.21.15.37:0/1821533930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce000b2b80 msgr2=0x7fce001646d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.411+0000 7fce06c36700 1 --2- 172.21.15.37:0/1821533930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce000b2b80 0x7fce001646d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009e60 tx=0x7fcdf8009780 comp rx=0 tx=0).stop 2023-10-06T02:28:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.411+0000 7fce06c36700 1 -- 172.21.15.37:0/1821533930 shutdown_connections 2023-10-06T02:28:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.411+0000 7fce06c36700 1 --2- 172.21.15.37:0/1821533930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce000b2b80 0x7fce001646d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.411+0000 7fce06c36700 1 -- 172.21.15.37:0/1821533930 >> 172.21.15.37:0/1821533930 conn(0x7fce0006c0b0 msgr2=0x7fce0006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.411+0000 7fce06c36700 1 -- 172.21.15.37:0/1821533930 shutdown_connections 2023-10-06T02:28:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.411+0000 7fce06c36700 1 -- 172.21.15.37:0/1821533930 wait complete. 2023-10-06T02:28:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.412+0000 7fce06c36700 1 Processor -- start 2023-10-06T02:28:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.412+0000 7fce06c36700 1 -- start start 2023-10-06T02:28:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.412+0000 7fce06c36700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce000af4d0 0x7fce0016cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.412+0000 7fce06c36700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce000af8a0 0x7fce00155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.412+0000 7fce06c36700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce001519a0 0x7fce0015a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.412+0000 7fce06c36700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce000c3e10 con 0x7fce000af8a0 2023-10-06T02:28:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.412+0000 7fce06c36700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0016d380 con 0x7fce000af4d0 2023-10-06T02:28:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.412+0000 7fce06c36700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0016d660 con 0x7fce001519a0 2023-10-06T02:28:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.413+0000 7fce05433700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce000af8a0 0x7fce00155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.413+0000 7fce05433700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce000af8a0 0x7fce00155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47976/0 (socket says 172.21.15.37:47976) 2023-10-06T02:28:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.413+0000 7fce05433700 1 -- 172.21.15.37:0/3865511662 learned_addr learned my addr 172.21.15.37:0/3865511662 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.413+0000 7fce05c34700 1 --2- 172.21.15.37:0/3865511662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce000af4d0 0x7fce0016cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.413+0000 7fce06435700 1 --2- 172.21.15.37:0/3865511662 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce001519a0 0x7fce0015a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.413+0000 7fce05433700 1 -- 172.21.15.37:0/3865511662 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce001519a0 msgr2=0x7fce0015a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.413+0000 7fce05433700 1 --2- 172.21.15.37:0/3865511662 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce001519a0 0x7fce0015a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.413+0000 7fce05433700 1 -- 172.21.15.37:0/3865511662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce000af4d0 msgr2=0x7fce0016cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.413+0000 7fce05433700 1 --2- 172.21.15.37:0/3865511662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce000af4d0 0x7fce0016cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.413+0000 7fce05433700 1 -- 172.21.15.37:0/3865511662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf8009a20 con 0x7fce000af8a0 2023-10-06T02:28:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.413+0000 7fce05c34700 1 --2- 172.21.15.37:0/3865511662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce000af4d0 0x7fce0016cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.413+0000 7fce05433700 1 --2- 172.21.15.37:0/3865511662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce000af8a0 0x7fce00155af0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400c790 tx=0x7fcdf4007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.413+0000 7fcdfdffb700 1 -- 172.21.15.37:0/3865511662 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4005b30 con 0x7fce000af8a0 2023-10-06T02:28:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.413+0000 7fcdfdffb700 1 -- 172.21.15.37:0/3865511662 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf4005cd0 con 0x7fce000af8a0 2023-10-06T02:28:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.413+0000 7fcdfdffb700 1 -- 172.21.15.37:0/3865511662 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4007320 con 0x7fce000af8a0 2023-10-06T02:28:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.413+0000 7fce06c36700 1 -- 172.21.15.37:0/3865511662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0016d940 con 0x7fce000af8a0 2023-10-06T02:28:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.414+0000 7fce06c36700 1 -- 172.21.15.37:0/3865511662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce00151fd0 con 0x7fce000af8a0 2023-10-06T02:28:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.414+0000 7fce06c36700 1 -- 172.21.15.37:0/3865511662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce000c3f80 con 0x7fce000af8a0 2023-10-06T02:28:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.415+0000 7fcdfdffb700 1 -- 172.21.15.37:0/3865511662 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcdf4012400 con 0x7fce000af8a0 2023-10-06T02:28:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.415+0000 7fcdfdffb700 1 --2- 172.21.15.37:0/3865511662 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcdec066f30 0x7fcdec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.415+0000 7fcdfdffb700 1 -- 172.21.15.37:0/3865511662 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fcdf4083b00 con 0x7fce000af8a0 2023-10-06T02:28:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.415+0000 7fce05c34700 1 --2- 172.21.15.37:0/3865511662 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcdec066f30 0x7fcdec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.416+0000 7fce05c34700 1 --2- 172.21.15.37:0/3865511662 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcdec066f30 0x7fcdec0693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fce00152ce0 tx=0x7fcdf0007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.419+0000 7fcdfdffb700 1 -- 172.21.15.37:0/3865511662 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcdf404b5a0 con 0x7fce000af8a0 2023-10-06T02:28:45.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.612+0000 7fce06c36700 1 -- 172.21.15.37:0/3865511662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fce00064b00 con 0x7fce000af8a0 2023-10-06T02:28:45.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.612+0000 7fcdfdffb700 1 -- 172.21.15.37:0/3865511662 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcdf4017020 con 0x7fce000af8a0 2023-10-06T02:28:45.614 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-10-06T02:28:45.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.614+0000 7fce06c36700 1 -- 172.21.15.37:0/3865511662 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcdec066f30 msgr2=0x7fcdec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:45.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.614+0000 7fce06c36700 1 --2- 172.21.15.37:0/3865511662 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcdec066f30 0x7fcdec0693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fce00152ce0 tx=0x7fcdf0007d50 comp rx=0 tx=0).stop 2023-10-06T02:28:45.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.614+0000 7fce06c36700 1 -- 172.21.15.37:0/3865511662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce000af8a0 msgr2=0x7fce00155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:45.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.614+0000 7fce06c36700 1 --2- 172.21.15.37:0/3865511662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce000af8a0 0x7fce00155af0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400c790 tx=0x7fcdf4007e80 comp rx=0 tx=0).stop 2023-10-06T02:28:45.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.614+0000 7fce06c36700 1 -- 172.21.15.37:0/3865511662 shutdown_connections 2023-10-06T02:28:45.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.614+0000 7fce06c36700 1 --2- 172.21.15.37:0/3865511662 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce001519a0 0x7fce0015a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.614+0000 7fce06c36700 1 --2- 172.21.15.37:0/3865511662 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcdec066f30 0x7fcdec0693e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.614+0000 7fce06c36700 1 --2- 172.21.15.37:0/3865511662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce000af4d0 0x7fce0016cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.614+0000 7fce06c36700 1 --2- 172.21.15.37:0/3865511662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce000af8a0 0x7fce00155af0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.614+0000 7fce06c36700 1 -- 172.21.15.37:0/3865511662 >> 172.21.15.37:0/3865511662 conn(0x7fce0006c0b0 msgr2=0x7fce000cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:45.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.614+0000 7fce06c36700 1 -- 172.21.15.37:0/3865511662 shutdown_connections 2023-10-06T02:28:45.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.614+0000 7fce06c36700 1 -- 172.21.15.37:0/3865511662 wait complete. 2023-10-06T02:28:45.627 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:28:45.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.750+0000 7f5ee6911700 1 Processor -- start 2023-10-06T02:28:45.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.750+0000 7f5ee6911700 1 -- start start 2023-10-06T02:28:45.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.751+0000 7f5ee6911700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5ee0159610 0x7f5ee00b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:45.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.751+0000 7f5ee6911700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee00b43b0 con 0x7f5ee00b3310 2023-10-06T02:28:45.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.751+0000 7f5ee6911700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee00b37a0 con 0x7f5ee01599e0 2023-10-06T02:28:45.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.751+0000 7f5ee6911700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee00cde50 con 0x7f5ee0159610 2023-10-06T02:28:45.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.751+0000 7f5edffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5ee0159610 0x7f5ee00b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:45.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.751+0000 7f5ee4eae700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5ee00b3310 0x7f5ee00b4840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44690/0 (socket says 172.21.15.37:44690) 2023-10-06T02:28:45.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.751+0000 7f5ee4eae700 1 -- 172.21.15.37:0/1380751795 learned_addr learned my addr 172.21.15.37:0/1380751795 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:45.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.751+0000 7f5edffff700 1 -- 172.21.15.37:0/1380751795 >> v1:172.21.15.191:6789/0 conn(0x7f5ee01599e0 legacy=0x7f5ee00d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:45.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.751+0000 7f5edffff700 1 -- 172.21.15.37:0/1380751795 >> v1:172.21.15.37:6789/0 conn(0x7f5ee00b3310 legacy=0x7f5ee00b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:45.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.751+0000 7f5edeffd700 1 -- 172.21.15.37:0/1380751795 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634268630 0 0) 0x7f5ee00b43b0 con 0x7f5ee00b3310 2023-10-06T02:28:45.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.751+0000 7f5edffff700 1 -- 172.21.15.37:0/1380751795 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee00b3a80 con 0x7f5ee0159610 2023-10-06T02:28:45.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.751+0000 7f5edffff700 1 --2- 172.21.15.37:0/1380751795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ee0159610 0x7f5ee00b0ae0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00098e0 tx=0x7f5ed00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babc63836163db3f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:45.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.752+0000 7f5edeffd700 1 -- 172.21.15.37:0/1380751795 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0009e80 con 0x7f5ee0159610 2023-10-06T02:28:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.752+0000 7f5edeffd700 1 -- 172.21.15.37:0/1380751795 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed000b820 con 0x7f5ee0159610 2023-10-06T02:28:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.752+0000 7f5edeffd700 1 -- 172.21.15.37:0/1380751795 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed000bba0 con 0x7f5ee0159610 2023-10-06T02:28:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.752+0000 7f5ee6911700 1 -- 172.21.15.37:0/1380751795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ee0159610 msgr2=0x7f5ee00b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.752+0000 7f5ee6911700 1 --2- 172.21.15.37:0/1380751795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ee0159610 0x7f5ee00b0ae0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00098e0 tx=0x7f5ed00091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.752+0000 7f5ee6911700 1 -- 172.21.15.37:0/1380751795 shutdown_connections 2023-10-06T02:28:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.752+0000 7f5ee6911700 1 --2- 172.21.15.37:0/1380751795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ee0159610 0x7f5ee00b0ae0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.752+0000 7f5ee6911700 1 -- 172.21.15.37:0/1380751795 >> 172.21.15.37:0/1380751795 conn(0x7f5ee006c0b0 msgr2=0x7f5ee006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.752+0000 7f5ee6911700 1 -- 172.21.15.37:0/1380751795 shutdown_connections 2023-10-06T02:28:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.752+0000 7f5ee6911700 1 -- 172.21.15.37:0/1380751795 wait complete. 2023-10-06T02:28:45.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.753+0000 7f5ee6911700 1 Processor -- start 2023-10-06T02:28:45.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.753+0000 7f5ee6911700 1 -- start start 2023-10-06T02:28:45.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.754+0000 7f5ee6911700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ee00b3310 0x7f5ee014d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:45.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.754+0000 7f5ee6911700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ee0159610 0x7f5ee00b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:45.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.754+0000 7f5ee6911700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ee01599e0 0x7f5ee00b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:45.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.754+0000 7f5ee6911700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee0169e20 con 0x7f5ee0159610 2023-10-06T02:28:45.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.754+0000 7f5ee6911700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee016a0e0 con 0x7f5ee01599e0 2023-10-06T02:28:45.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.754+0000 7f5ee6911700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee016a3c0 con 0x7f5ee00b3310 2023-10-06T02:28:45.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.754+0000 7f5edf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ee0159610 0x7f5ee00b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:45.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.754+0000 7f5edf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ee0159610 0x7f5ee00b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47984/0 (socket says 172.21.15.37:47984) 2023-10-06T02:28:45.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.754+0000 7f5edf7fe700 1 -- 172.21.15.37:0/2955565100 learned_addr learned my addr 172.21.15.37:0/2955565100 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:45.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.754+0000 7f5edffff700 1 --2- 172.21.15.37:0/2955565100 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ee00b3310 0x7f5ee014d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:45.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.754+0000 7f5ee4eae700 1 --2- 172.21.15.37:0/2955565100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ee01599e0 0x7f5ee00b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:45.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.755+0000 7f5edf7fe700 1 -- 172.21.15.37:0/2955565100 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ee00b3310 msgr2=0x7f5ee014d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:45.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.755+0000 7f5edf7fe700 1 --2- 172.21.15.37:0/2955565100 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ee00b3310 0x7f5ee014d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.755+0000 7f5edf7fe700 1 -- 172.21.15.37:0/2955565100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ee01599e0 msgr2=0x7f5ee00b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:45.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.755+0000 7f5edf7fe700 1 --2- 172.21.15.37:0/2955565100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ee01599e0 0x7f5ee00b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.755+0000 7f5edf7fe700 1 -- 172.21.15.37:0/2955565100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed0009420 con 0x7f5ee0159610 2023-10-06T02:28:45.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.755+0000 7f5ee4eae700 1 --2- 172.21.15.37:0/2955565100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ee01599e0 0x7f5ee00b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:45.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.755+0000 7f5edf7fe700 1 --2- 172.21.15.37:0/2955565100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ee0159610 0x7f5ee00b5450 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f5ed400b5e0 tx=0x7f5ed4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:45.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.755+0000 7f5ec7fff700 1 -- 172.21.15.37:0/2955565100 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed400f510 con 0x7f5ee0159610 2023-10-06T02:28:45.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.755+0000 7f5ec7fff700 1 -- 172.21.15.37:0/2955565100 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed400f670 con 0x7f5ee0159610 2023-10-06T02:28:45.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.755+0000 7f5ee6911700 1 -- 172.21.15.37:0/2955565100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee016a6a0 con 0x7f5ee0159610 2023-10-06T02:28:45.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.755+0000 7f5ec7fff700 1 -- 172.21.15.37:0/2955565100 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed400fa30 con 0x7f5ee0159610 2023-10-06T02:28:45.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.755+0000 7f5ee6911700 1 -- 172.21.15.37:0/2955565100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee014da00 con 0x7f5ee0159610 2023-10-06T02:28:45.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.756+0000 7f5ee6911700 1 -- 172.21.15.37:0/2955565100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee016aba0 con 0x7f5ee0159610 2023-10-06T02:28:45.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.756+0000 7f5ec7fff700 1 -- 172.21.15.37:0/2955565100 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ed401a400 con 0x7f5ee0159610 2023-10-06T02:28:45.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.757+0000 7f5ec7fff700 1 --2- 172.21.15.37:0/2955565100 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ecc066f30 0x7f5ecc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:45.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.757+0000 7f5ec7fff700 1 -- 172.21.15.37:0/2955565100 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f5ed40841e0 con 0x7f5ee0159610 2023-10-06T02:28:45.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.757+0000 7f5edffff700 1 --2- 172.21.15.37:0/2955565100 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ecc066f30 0x7f5ecc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:45.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.757+0000 7f5edffff700 1 --2- 172.21.15.37:0/2955565100 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ecc066f30 0x7f5ecc0693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00030c0 tx=0x7f5ed0016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:45.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.761+0000 7f5ec7fff700 1 -- 172.21.15.37:0/2955565100 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ed40512c0 con 0x7f5ee0159610 2023-10-06T02:28:45.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.951+0000 7f5ee6911700 1 -- 172.21.15.37:0/2955565100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5ee004bb80 con 0x7f5ee0159610 2023-10-06T02:28:45.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.951+0000 7f5ec7fff700 1 -- 172.21.15.37:0/2955565100 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5ed40548e0 con 0x7f5ee0159610 2023-10-06T02:28:45.952 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-10-06T02:28:45.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.953+0000 7f5ee6911700 1 -- 172.21.15.37:0/2955565100 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ecc066f30 msgr2=0x7f5ecc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:45.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.953+0000 7f5ee6911700 1 --2- 172.21.15.37:0/2955565100 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ecc066f30 0x7f5ecc0693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00030c0 tx=0x7f5ed0016000 comp rx=0 tx=0).stop 2023-10-06T02:28:45.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.953+0000 7f5ee6911700 1 -- 172.21.15.37:0/2955565100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ee0159610 msgr2=0x7f5ee00b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:45.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.953+0000 7f5ee6911700 1 --2- 172.21.15.37:0/2955565100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ee0159610 0x7f5ee00b5450 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f5ed400b5e0 tx=0x7f5ed4009120 comp rx=0 tx=0).stop 2023-10-06T02:28:45.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.953+0000 7f5ee6911700 1 -- 172.21.15.37:0/2955565100 shutdown_connections 2023-10-06T02:28:45.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.953+0000 7f5ee6911700 1 --2- 172.21.15.37:0/2955565100 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ecc066f30 0x7f5ecc0693e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.953+0000 7f5ee6911700 1 --2- 172.21.15.37:0/2955565100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ee01599e0 0x7f5ee00b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.953+0000 7f5ee6911700 1 --2- 172.21.15.37:0/2955565100 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ee00b3310 0x7f5ee014d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.953+0000 7f5ee6911700 1 --2- 172.21.15.37:0/2955565100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ee0159610 0x7f5ee00b5450 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:45.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.953+0000 7f5ee6911700 1 -- 172.21.15.37:0/2955565100 >> 172.21.15.37:0/2955565100 conn(0x7f5ee006c0b0 msgr2=0x7f5ee00cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:45.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.953+0000 7f5ee6911700 1 -- 172.21.15.37:0/2955565100 shutdown_connections 2023-10-06T02:28:45.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:45.953+0000 7f5ee6911700 1 -- 172.21.15.37:0/2955565100 wait complete. 2023-10-06T02:28:45.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:46.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.085+0000 7f3bc9080700 1 Processor -- start 2023-10-06T02:28:46.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.085+0000 7f3bc9080700 1 -- start start 2023-10-06T02:28:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.086+0000 7f3bc9080700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f3bc40b2270 0x7f3bc406d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.086+0000 7f3bc9080700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc406db80 0x7f3bc40cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.086+0000 7f3bc9080700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc406e4c0 con 0x7f3bc4159510 2023-10-06T02:28:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.086+0000 7f3bc9080700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc40b26c0 con 0x7f3bc40b2270 2023-10-06T02:28:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.086+0000 7f3bc9080700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc406e000 con 0x7f3bc406db80 2023-10-06T02:28:46.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.086+0000 7f3bc3fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3bc4159510 0x7f3bc415da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44696/0 (socket says 172.21.15.37:44696) 2023-10-06T02:28:46.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.086+0000 7f3bc3fff700 1 -- 172.21.15.37:0/922018195 learned_addr learned my addr 172.21.15.37:0/922018195 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:46.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.086+0000 7f3bc37fe700 1 --2- 172.21.15.37:0/922018195 >> v2:172.21.15.191:3300/0 conn(0x7f3bc40b2270 0x7f3bc406d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.086+0000 7f3bc887f700 1 --2- 172.21.15.37:0/922018195 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc406db80 0x7f3bc40cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.086+0000 7f3bc2ffd700 1 -- 172.21.15.37:0/922018195 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486871710 0 0) 0x7f3bc406e4c0 con 0x7f3bc4159510 2023-10-06T02:28:46.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.086+0000 7f3bc2ffd700 1 -- 172.21.15.37:0/922018195 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bac003570 con 0x7f3bc4159510 2023-10-06T02:28:46.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.087+0000 7f3bc37fe700 1 -- 172.21.15.37:0/922018195 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc406db80 msgr2=0x7f3bc40cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:46.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.087+0000 7f3bc2ffd700 1 -- 172.21.15.37:0/922018195 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1610453988 0 0) 0x7f3bac003570 con 0x7f3bc4159510 2023-10-06T02:28:46.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.087+0000 7f3bc37fe700 1 --2- 172.21.15.37:0/922018195 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc406db80 0x7f3bc40cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.087+0000 7f3bc37fe700 1 -- 172.21.15.37:0/922018195 >> v1:172.21.15.37:6789/0 conn(0x7f3bc4159510 legacy=0x7f3bc415da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.087+0000 7f3bc37fe700 1 -- 172.21.15.37:0/922018195 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc40cb900 con 0x7f3bc40b2270 2023-10-06T02:28:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.087+0000 7f3bc887f700 1 --2- 172.21.15.37:0/922018195 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc406db80 0x7f3bc40cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.087+0000 7f3bc37fe700 1 --2- 172.21.15.37:0/922018195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bc40b2270 0x7f3bc406d640 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8009910 tx=0x7f3bb80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bea04de7223f429 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.087+0000 7f3bc2ffd700 1 -- 172.21.15.37:0/922018195 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4001470 con 0x7f3bc40b2270 2023-10-06T02:28:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.087+0000 7f3bc2ffd700 1 -- 172.21.15.37:0/922018195 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb8011420 con 0x7f3bc40b2270 2023-10-06T02:28:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.087+0000 7f3bc2ffd700 1 -- 172.21.15.37:0/922018195 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb80117c0 con 0x7f3bc40b2270 2023-10-06T02:28:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.087+0000 7f3bc9080700 1 -- 172.21.15.37:0/922018195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bc40b2270 msgr2=0x7f3bc406d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.087+0000 7f3bc9080700 1 --2- 172.21.15.37:0/922018195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bc40b2270 0x7f3bc406d640 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8009910 tx=0x7f3bb80091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.087+0000 7f3bc9080700 1 -- 172.21.15.37:0/922018195 shutdown_connections 2023-10-06T02:28:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.087+0000 7f3bc9080700 1 --2- 172.21.15.37:0/922018195 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc406db80 0x7f3bc40cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.087+0000 7f3bc9080700 1 --2- 172.21.15.37:0/922018195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bc40b2270 0x7f3bc406d640 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.087+0000 7f3bc9080700 1 -- 172.21.15.37:0/922018195 >> 172.21.15.37:0/922018195 conn(0x7f3bc406c0b0 msgr2=0x7f3bc406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.088+0000 7f3bc9080700 1 -- 172.21.15.37:0/922018195 shutdown_connections 2023-10-06T02:28:46.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.088+0000 7f3bc9080700 1 -- 172.21.15.37:0/922018195 wait complete. 2023-10-06T02:28:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.089+0000 7f3bc9080700 1 Processor -- start 2023-10-06T02:28:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.089+0000 7f3bc9080700 1 -- start start 2023-10-06T02:28:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.089+0000 7f3bc9080700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc406db80 0x7f3bc40c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.089+0000 7f3bc9080700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bc40b2270 0x7f3bc4151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.089+0000 7f3bc9080700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bc4159510 0x7f3bc40c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.089+0000 7f3bc9080700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc40c80a0 con 0x7f3bc4159510 2023-10-06T02:28:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.089+0000 7f3bc9080700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc40c88e0 con 0x7f3bc40b2270 2023-10-06T02:28:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.089+0000 7f3bc9080700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc40c9fa0 con 0x7f3bc406db80 2023-10-06T02:28:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.090+0000 7f3bc887f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bc4159510 0x7f3bc40c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.090+0000 7f3bc887f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bc4159510 0x7f3bc40c4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47992/0 (socket says 172.21.15.37:47992) 2023-10-06T02:28:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.090+0000 7f3bc887f700 1 -- 172.21.15.37:0/1174786630 learned_addr learned my addr 172.21.15.37:0/1174786630 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.090+0000 7f3bc37fe700 1 --2- 172.21.15.37:0/1174786630 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bc40b2270 0x7f3bc4151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.090+0000 7f3bc3fff700 1 --2- 172.21.15.37:0/1174786630 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc406db80 0x7f3bc40c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.090+0000 7f3bc887f700 1 -- 172.21.15.37:0/1174786630 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc406db80 msgr2=0x7f3bc40c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.090+0000 7f3bc887f700 1 --2- 172.21.15.37:0/1174786630 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc406db80 0x7f3bc40c99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.090+0000 7f3bc887f700 1 -- 172.21.15.37:0/1174786630 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bc40b2270 msgr2=0x7f3bc4151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.090+0000 7f3bc887f700 1 --2- 172.21.15.37:0/1174786630 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bc40b2270 0x7f3bc4151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.090+0000 7f3bc887f700 1 -- 172.21.15.37:0/1174786630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc009a20 con 0x7f3bc4159510 2023-10-06T02:28:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.090+0000 7f3bc887f700 1 --2- 172.21.15.37:0/1174786630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bc4159510 0x7f3bc40c4ca0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009f20 tx=0x7f3bbc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.090+0000 7f3babfff700 1 -- 172.21.15.37:0/1174786630 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc009c80 con 0x7f3bc4159510 2023-10-06T02:28:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.090+0000 7f3babfff700 1 -- 172.21.15.37:0/1174786630 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bbc00f040 con 0x7f3bc4159510 2023-10-06T02:28:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.090+0000 7f3babfff700 1 -- 172.21.15.37:0/1174786630 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc00cdc0 con 0x7f3bc4159510 2023-10-06T02:28:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.090+0000 7f3bc9080700 1 -- 172.21.15.37:0/1174786630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb8009420 con 0x7f3bc4159510 2023-10-06T02:28:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.090+0000 7f3bc9080700 1 -- 172.21.15.37:0/1174786630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc40c8570 con 0x7f3bc4159510 2023-10-06T02:28:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.091+0000 7f3bc9080700 1 -- 172.21.15.37:0/1174786630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc4151b20 con 0x7f3bc4159510 2023-10-06T02:28:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.092+0000 7f3babfff700 1 -- 172.21.15.37:0/1174786630 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bbc003020 con 0x7f3bc4159510 2023-10-06T02:28:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.092+0000 7f3babfff700 1 --2- 172.21.15.37:0/1174786630 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3bb0066f30 0x7f3bb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.092+0000 7f3babfff700 1 -- 172.21.15.37:0/1174786630 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f3bbc084f50 con 0x7f3bc4159510 2023-10-06T02:28:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.092+0000 7f3bc3fff700 1 --2- 172.21.15.37:0/1174786630 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3bb0066f30 0x7f3bb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.093+0000 7f3bc3fff700 1 --2- 172.21.15.37:0/1174786630 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3bb0066f30 0x7f3bb00693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40011e0 tx=0x7f3bb4001560 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.096+0000 7f3babfff700 1 -- 172.21.15.37:0/1174786630 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bbc051fb0 con 0x7f3bc4159510 2023-10-06T02:28:46.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.336+0000 7f3bc9080700 1 -- 172.21.15.37:0/1174786630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bc4064b00 con 0x7f3bc4159510 2023-10-06T02:28:46.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.337+0000 7f3babfff700 1 -- 172.21.15.37:0/1174786630 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f3bbc0555d0 con 0x7f3bc4159510 2023-10-06T02:28:46.337 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:46.338 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":60,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3055524642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3055524642},{"type":"v1","addr":"172.21.15.37:6835","nonce":3055524642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2821947660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2821947660},{"type":"v1","addr":"172.21.15.191:6836","nonce":2821947660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6310,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3752119173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3752119173},{"type":"v1","addr":"172.21.15.191:6837","nonce":3752119173}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:27:43.200836+0000","modified":"2023-10-06T02:28:37.708971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6840},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6840":{"gid":6840,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/1787333914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1787333914},{"type":"v1","addr":"172.21.15.37:6834","nonce":1787333914}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:28:46.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.339+0000 7f3bc9080700 1 -- 172.21.15.37:0/1174786630 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3bb0066f30 msgr2=0x7f3bb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.339+0000 7f3bc9080700 1 --2- 172.21.15.37:0/1174786630 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3bb0066f30 0x7f3bb00693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40011e0 tx=0x7f3bb4001560 comp rx=0 tx=0).stop 2023-10-06T02:28:46.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.339+0000 7f3bc9080700 1 -- 172.21.15.37:0/1174786630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bc4159510 msgr2=0x7f3bc40c4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.339+0000 7f3bc9080700 1 --2- 172.21.15.37:0/1174786630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bc4159510 0x7f3bc40c4ca0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009f20 tx=0x7f3bbc00b040 comp rx=0 tx=0).stop 2023-10-06T02:28:46.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.339+0000 7f3bc9080700 1 -- 172.21.15.37:0/1174786630 shutdown_connections 2023-10-06T02:28:46.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.339+0000 7f3bc9080700 1 --2- 172.21.15.37:0/1174786630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bc4159510 0x7f3bc40c4ca0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.339+0000 7f3bc9080700 1 --2- 172.21.15.37:0/1174786630 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc406db80 0x7f3bc40c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.339+0000 7f3bc9080700 1 --2- 172.21.15.37:0/1174786630 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3bb0066f30 0x7f3bb00693e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.339+0000 7f3bc9080700 1 --2- 172.21.15.37:0/1174786630 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bc40b2270 0x7f3bc4151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.339+0000 7f3bc9080700 1 -- 172.21.15.37:0/1174786630 >> 172.21.15.37:0/1174786630 conn(0x7f3bc406c0b0 msgr2=0x7f3bc40b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:46.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.339+0000 7f3bc9080700 1 -- 172.21.15.37:0/1174786630 shutdown_connections 2023-10-06T02:28:46.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.339+0000 7f3bc9080700 1 -- 172.21.15.37:0/1174786630 wait complete. 2023-10-06T02:28:46.341 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 60 2023-10-06T02:28:46.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:28:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.470+0000 7f1015994700 1 Processor -- start 2023-10-06T02:28:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.470+0000 7f1015994700 1 -- start start 2023-10-06T02:28:46.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.471+0000 7f1015994700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f1010159370 0x7f1010159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.471+0000 7f1015994700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10100b0620 0x7f101015db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.471+0000 7f1015994700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10100cb200 con 0x7f10100b2270 2023-10-06T02:28:46.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.471+0000 7f1015994700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10100b5c00 con 0x7f1010159370 2023-10-06T02:28:46.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.471+0000 7f1015994700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10100cb7c0 con 0x7f10100b0620 2023-10-06T02:28:46.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.471+0000 7f100ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f10100b2270 0x7f10100aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44702/0 (socket says 172.21.15.37:44702) 2023-10-06T02:28:46.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.471+0000 7f100ffff700 1 -- 172.21.15.37:0/1137539331 learned_addr learned my addr 172.21.15.37:0/1137539331 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:46.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.471+0000 7f1014992700 1 --2- 172.21.15.37:0/1137539331 >> v2:172.21.15.191:3300/0 conn(0x7f1010159370 0x7f1010159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.471+0000 7f1015193700 1 --2- 172.21.15.37:0/1137539331 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10100b0620 0x7f101015db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.471+0000 7f100f7fe700 1 -- 172.21.15.37:0/1137539331 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144017223 0 0) 0x7f10100cb200 con 0x7f10100b2270 2023-10-06T02:28:46.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.471+0000 7f100f7fe700 1 -- 172.21.15.37:0/1137539331 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ff8003570 con 0x7f10100b2270 2023-10-06T02:28:46.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.472+0000 7f1014992700 1 -- 172.21.15.37:0/1137539331 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10100b0620 msgr2=0x7f101015db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:46.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.472+0000 7f1014992700 1 --2- 172.21.15.37:0/1137539331 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10100b0620 0x7f101015db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.472+0000 7f1014992700 1 -- 172.21.15.37:0/1137539331 >> v1:172.21.15.37:6789/0 conn(0x7f10100b2270 legacy=0x7f10100aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.472+0000 7f1014992700 1 -- 172.21.15.37:0/1137539331 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101015e0d0 con 0x7f1010159370 2023-10-06T02:28:46.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.472+0000 7f1014992700 1 --2- 172.21.15.37:0/1137539331 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1010159370 0x7f1010159740 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1008009e60 tx=0x7f1008009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbd9c8f57ecd2977 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.472+0000 7f100f7fe700 1 -- 172.21.15.37:0/1137539331 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100800e070 con 0x7f1010159370 2023-10-06T02:28:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.472+0000 7f100f7fe700 1 -- 172.21.15.37:0/1137539331 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100800bab0 con 0x7f1010159370 2023-10-06T02:28:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.472+0000 7f100f7fe700 1 -- 172.21.15.37:0/1137539331 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100800be70 con 0x7f1010159370 2023-10-06T02:28:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.472+0000 7f1015994700 1 -- 172.21.15.37:0/1137539331 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1010159370 msgr2=0x7f1010159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.472+0000 7f1015994700 1 --2- 172.21.15.37:0/1137539331 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1010159370 0x7f1010159740 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1008009e60 tx=0x7f1008009780 comp rx=0 tx=0).stop 2023-10-06T02:28:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.472+0000 7f1015994700 1 -- 172.21.15.37:0/1137539331 shutdown_connections 2023-10-06T02:28:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.472+0000 7f1015994700 1 --2- 172.21.15.37:0/1137539331 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10100b0620 0x7f101015db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.473+0000 7f1015994700 1 --2- 172.21.15.37:0/1137539331 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1010159370 0x7f1010159740 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.473+0000 7f1015994700 1 -- 172.21.15.37:0/1137539331 >> 172.21.15.37:0/1137539331 conn(0x7f101006c0b0 msgr2=0x7f101006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.473+0000 7f1015994700 1 -- 172.21.15.37:0/1137539331 shutdown_connections 2023-10-06T02:28:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.473+0000 7f1015994700 1 -- 172.21.15.37:0/1137539331 wait complete. 2023-10-06T02:28:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.474+0000 7f1015994700 1 Processor -- start 2023-10-06T02:28:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.474+0000 7f1015994700 1 -- start start 2023-10-06T02:28:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.474+0000 7f1015994700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10100b0620 0x7f10100c5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.474+0000 7f1015994700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10100b2270 0x7f1010155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.474+0000 7f1015994700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1010159370 0x7f101015b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.475+0000 7f1015994700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1010169dd0 con 0x7f10100b2270 2023-10-06T02:28:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.475+0000 7f1015994700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1010169fe0 con 0x7f1010159370 2023-10-06T02:28:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.475+0000 7f1015994700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101016a280 con 0x7f10100b0620 2023-10-06T02:28:46.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.475+0000 7f100ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10100b2270 0x7f1010155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.475+0000 7f100ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10100b2270 0x7f1010155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48004/0 (socket says 172.21.15.37:48004) 2023-10-06T02:28:46.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.475+0000 7f100ffff700 1 -- 172.21.15.37:0/2525753479 learned_addr learned my addr 172.21.15.37:0/2525753479 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:46.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.475+0000 7f1014992700 1 --2- 172.21.15.37:0/2525753479 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10100b0620 0x7f10100c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.475+0000 7f1015193700 1 --2- 172.21.15.37:0/2525753479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1010159370 0x7f101015b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.475+0000 7f100ffff700 1 -- 172.21.15.37:0/2525753479 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10100b0620 msgr2=0x7f10100c5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.475+0000 7f100ffff700 1 --2- 172.21.15.37:0/2525753479 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10100b0620 0x7f10100c5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.475+0000 7f100ffff700 1 -- 172.21.15.37:0/2525753479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1010159370 msgr2=0x7f101015b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.475+0000 7f100ffff700 1 --2- 172.21.15.37:0/2525753479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1010159370 0x7f101015b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.475+0000 7f100ffff700 1 -- 172.21.15.37:0/2525753479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1008009a20 con 0x7f10100b2270 2023-10-06T02:28:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.475+0000 7f100ffff700 1 --2- 172.21.15.37:0/2525753479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10100b2270 0x7f1010155890 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f100400c7c0 tx=0x7f1004007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.475+0000 7f100cff9700 1 -- 172.21.15.37:0/2525753479 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1004005c00 con 0x7f10100b2270 2023-10-06T02:28:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.475+0000 7f100cff9700 1 -- 172.21.15.37:0/2525753479 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1004005d60 con 0x7f10100b2270 2023-10-06T02:28:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.475+0000 7f1015994700 1 -- 172.21.15.37:0/2525753479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101016a560 con 0x7f10100b2270 2023-10-06T02:28:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.475+0000 7f100cff9700 1 -- 172.21.15.37:0/2525753479 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1004007320 con 0x7f10100b2270 2023-10-06T02:28:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.475+0000 7f1015994700 1 -- 172.21.15.37:0/2525753479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101016ab20 con 0x7f10100b2270 2023-10-06T02:28:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.476+0000 7f1015994700 1 -- 172.21.15.37:0/2525753479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101016ad40 con 0x7f10100b2270 2023-10-06T02:28:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.477+0000 7f100cff9700 1 -- 172.21.15.37:0/2525753479 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f100401b3b0 con 0x7f10100b2270 2023-10-06T02:28:46.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.477+0000 7f100cff9700 1 --2- 172.21.15.37:0/2525753479 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0ffc066f30 0x7f0ffc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.477+0000 7f100cff9700 1 -- 172.21.15.37:0/2525753479 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f1004083c20 con 0x7f10100b2270 2023-10-06T02:28:46.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.477+0000 7f1014992700 1 --2- 172.21.15.37:0/2525753479 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0ffc066f30 0x7f0ffc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.478+0000 7f1014992700 1 --2- 172.21.15.37:0/2525753479 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0ffc066f30 0x7f0ffc0693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f10080097c0 tx=0x7f1008019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.481+0000 7f100cff9700 1 -- 172.21.15.37:0/2525753479 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1004050c80 con 0x7f10100b2270 2023-10-06T02:28:46.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.677+0000 7f1015994700 1 -- 172.21.15.37:0/2525753479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1010064b00 con 0x7f10100b2270 2023-10-06T02:28:46.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.678+0000 7f100cff9700 1 -- 172.21.15.37:0/2525753479 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+17130 (secure 0 0 0) 0x7f1004017070 con 0x7f10100b2270 2023-10-06T02:28:46.678 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:46.678 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":74,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:28:32.607238+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:27:40.951347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T02:27:42.184642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6834/4246185831":"2023-10-07T02:28:32.607211+0000","172.21.15.37:6832/4246185831":"2023-10-07T02:28:32.607211+0000","172.21.15.191:6837/2764715102":"2023-10-07T02:28:14.483678+0000","172.21.15.191:6834/2764715102":"2023-10-07T02:28:14.483678+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:28:46.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.680+0000 7f1015994700 1 -- 172.21.15.37:0/2525753479 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0ffc066f30 msgr2=0x7f0ffc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.680+0000 7f1015994700 1 --2- 172.21.15.37:0/2525753479 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0ffc066f30 0x7f0ffc0693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f10080097c0 tx=0x7f1008019000 comp rx=0 tx=0).stop 2023-10-06T02:28:46.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.680+0000 7f1015994700 1 -- 172.21.15.37:0/2525753479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10100b2270 msgr2=0x7f1010155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.680+0000 7f1015994700 1 --2- 172.21.15.37:0/2525753479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10100b2270 0x7f1010155890 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f100400c7c0 tx=0x7f1004007dd0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.680+0000 7f1015994700 1 -- 172.21.15.37:0/2525753479 shutdown_connections 2023-10-06T02:28:46.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.680+0000 7f1015994700 1 --2- 172.21.15.37:0/2525753479 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0ffc066f30 0x7f0ffc0693e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.680+0000 7f1015994700 1 --2- 172.21.15.37:0/2525753479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1010159370 0x7f101015b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.680+0000 7f1015994700 1 --2- 172.21.15.37:0/2525753479 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10100b0620 0x7f10100c5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.680+0000 7f1015994700 1 --2- 172.21.15.37:0/2525753479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10100b2270 0x7f1010155890 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.680+0000 7f1015994700 1 -- 172.21.15.37:0/2525753479 >> 172.21.15.37:0/2525753479 conn(0x7f101006c0b0 msgr2=0x7f1010156770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:46.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.680+0000 7f1015994700 1 -- 172.21.15.37:0/2525753479 shutdown_connections 2023-10-06T02:28:46.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.680+0000 7f1015994700 1 -- 172.21.15.37:0/2525753479 wait complete. 2023-10-06T02:28:46.692 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:28:46.693 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.812+0000 7f919b59e700 1 Processor -- start 2023-10-06T02:28:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.812+0000 7f919b59e700 1 -- start start 2023-10-06T02:28:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.813+0000 7f919b59e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f919c155f10 0x7f919c063380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.813+0000 7f919b59e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919c0638c0 con 0x7f919c1562e0 2023-10-06T02:28:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.813+0000 7f919b59e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919c0c8db0 con 0x7f919c0ca9f0 2023-10-06T02:28:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.813+0000 7f919b59e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919c0af220 con 0x7f919c155f10 2023-10-06T02:28:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.813+0000 7f9199d9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f919c1562e0 0x7f919c0ca2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44718/0 (socket says 172.21.15.37:44718) 2023-10-06T02:28:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.813+0000 7f9199d9b700 1 -- 172.21.15.37:0/2906398893 learned_addr learned my addr 172.21.15.37:0/2906398893 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.814+0000 7f919a59c700 1 --2- 172.21.15.37:0/2906398893 >> v2:172.21.15.191:3300/0 conn(0x7f919c155f10 0x7f919c063380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.814+0000 7f919959a700 1 -- 172.21.15.37:0/2906398893 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107009266 0 0) 0x7f9190001110 con 0x7f919c1562e0 2023-10-06T02:28:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.814+0000 7f919959a700 1 -- 172.21.15.37:0/2906398893 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9184003570 con 0x7f919c1562e0 2023-10-06T02:28:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.814+0000 7f919a59c700 1 -- 172.21.15.37:0/2906398893 >> v1:172.21.15.191:6789/0 conn(0x7f919c0ca9f0 legacy=0x7f919c06c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.814+0000 7f919a59c700 1 -- 172.21.15.37:0/2906398893 >> v1:172.21.15.37:6789/0 conn(0x7f919c1562e0 legacy=0x7f919c0ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.814+0000 7f919a59c700 1 -- 172.21.15.37:0/2906398893 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919c0c81a0 con 0x7f919c155f10 2023-10-06T02:28:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.814+0000 7f919a59c700 1 --2- 172.21.15.37:0/2906398893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f919c155f10 0x7f919c063380 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f918c0098e0 tx=0x7f918c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ab5178aa366b54b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.814+0000 7f919959a700 1 -- 172.21.15.37:0/2906398893 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c00b640 con 0x7f919c155f10 2023-10-06T02:28:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.814+0000 7f919959a700 1 -- 172.21.15.37:0/2906398893 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918c00b7a0 con 0x7f919c155f10 2023-10-06T02:28:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.814+0000 7f919959a700 1 -- 172.21.15.37:0/2906398893 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c00bb40 con 0x7f919c155f10 2023-10-06T02:28:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.815+0000 7f919b59e700 1 -- 172.21.15.37:0/2906398893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f919c155f10 msgr2=0x7f919c063380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.815+0000 7f919b59e700 1 --2- 172.21.15.37:0/2906398893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f919c155f10 0x7f919c063380 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f918c0098e0 tx=0x7f918c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.815+0000 7f919b59e700 1 -- 172.21.15.37:0/2906398893 shutdown_connections 2023-10-06T02:28:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.815+0000 7f919b59e700 1 --2- 172.21.15.37:0/2906398893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f919c155f10 0x7f919c063380 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.815+0000 7f919b59e700 1 -- 172.21.15.37:0/2906398893 >> 172.21.15.37:0/2906398893 conn(0x7f919c0cd280 msgr2=0x7f919c0c9220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.815+0000 7f919b59e700 1 -- 172.21.15.37:0/2906398893 shutdown_connections 2023-10-06T02:28:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.815+0000 7f919b59e700 1 -- 172.21.15.37:0/2906398893 wait complete. 2023-10-06T02:28:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.816+0000 7f919b59e700 1 Processor -- start 2023-10-06T02:28:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.816+0000 7f919b59e700 1 -- start start 2023-10-06T02:28:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.817+0000 7f919b59e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f919c0ca9f0 0x7f919c14c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.817+0000 7f919b59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f919c155f10 0x7f919c0c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.817+0000 7f919b59e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f919c167940 0x7f919c167de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.817+0000 7f919b59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c0c4e70 con 0x7f919c155f10 2023-10-06T02:28:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.817+0000 7f919b59e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c0c3fc0 con 0x7f919c0ca9f0 2023-10-06T02:28:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.817+0000 7f919b59e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919c0c4260 con 0x7f919c167940 2023-10-06T02:28:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.817+0000 7f9199d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f919c155f10 0x7f919c0c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.817+0000 7f9199d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f919c155f10 0x7f919c0c3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48008/0 (socket says 172.21.15.37:48008) 2023-10-06T02:28:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.817+0000 7f9199d9b700 1 -- 172.21.15.37:0/3138208607 learned_addr learned my addr 172.21.15.37:0/3138208607 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.817+0000 7f919a59c700 1 --2- 172.21.15.37:0/3138208607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f919c0ca9f0 0x7f919c14c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.817+0000 7f919ad9d700 1 --2- 172.21.15.37:0/3138208607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f919c167940 0x7f919c167de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.817+0000 7f9199d9b700 1 -- 172.21.15.37:0/3138208607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f919c167940 msgr2=0x7f919c167de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.817+0000 7f9199d9b700 1 --2- 172.21.15.37:0/3138208607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f919c167940 0x7f919c167de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.817+0000 7f9199d9b700 1 -- 172.21.15.37:0/3138208607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f919c0ca9f0 msgr2=0x7f919c14c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.817+0000 7f9199d9b700 1 --2- 172.21.15.37:0/3138208607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f919c0ca9f0 0x7f919c14c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.817+0000 7f9199d9b700 1 -- 172.21.15.37:0/3138208607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918c009420 con 0x7f919c155f10 2023-10-06T02:28:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.817+0000 7f919ad9d700 1 --2- 172.21.15.37:0/3138208607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f919c167940 0x7f919c167de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.817+0000 7f9199d9b700 1 --2- 172.21.15.37:0/3138208607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f919c155f10 0x7f919c0c3a80 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f919000c590 tx=0x7f9190007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.818+0000 7f918a7fc700 1 -- 172.21.15.37:0/3138208607 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9190005b30 con 0x7f919c155f10 2023-10-06T02:28:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.818+0000 7f918a7fc700 1 -- 172.21.15.37:0/3138208607 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9190005cb0 con 0x7f919c155f10 2023-10-06T02:28:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.818+0000 7f919b59e700 1 -- 172.21.15.37:0/3138208607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919c0c4540 con 0x7f919c155f10 2023-10-06T02:28:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.818+0000 7f918a7fc700 1 -- 172.21.15.37:0/3138208607 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9190007320 con 0x7f919c155f10 2023-10-06T02:28:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.818+0000 7f919b59e700 1 -- 172.21.15.37:0/3138208607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919c0c4b00 con 0x7f919c155f10 2023-10-06T02:28:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.819+0000 7f919b59e700 1 -- 172.21.15.37:0/3138208607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f919c0c4fe0 con 0x7f919c155f10 2023-10-06T02:28:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.819+0000 7f918a7fc700 1 -- 172.21.15.37:0/3138208607 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f919001b3b0 con 0x7f919c155f10 2023-10-06T02:28:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.819+0000 7f918a7fc700 1 --2- 172.21.15.37:0/3138208607 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f917c066f30 0x7f917c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.819+0000 7f918a7fc700 1 -- 172.21.15.37:0/3138208607 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f9190083b40 con 0x7f919c155f10 2023-10-06T02:28:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.820+0000 7f919a59c700 1 --2- 172.21.15.37:0/3138208607 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f917c066f30 0x7f917c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.820+0000 7f919a59c700 1 --2- 172.21.15.37:0/3138208607 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f917c066f30 0x7f917c0693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f918c0093f0 tx=0x7f918c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:46.824+0000 7f918a7fc700 1 -- 172.21.15.37:0/3138208607 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9190050ba0 con 0x7f919c155f10 2023-10-06T02:28:47.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.059+0000 7f919b59e700 1 -- 172.21.15.37:0/3138208607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f919c0638c0 con 0x7f919c155f10 2023-10-06T02:28:47.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.060+0000 7f918a7fc700 1 -- 172.21.15.37:0/3138208607 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f919c0638c0 con 0x7f919c155f10 2023-10-06T02:28:47.061 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:47.061 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":60,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3055524642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3055524642},{"type":"v1","addr":"172.21.15.37:6835","nonce":3055524642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2821947660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2821947660},{"type":"v1","addr":"172.21.15.191:6836","nonce":2821947660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6310,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3752119173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3752119173},{"type":"v1","addr":"172.21.15.191:6837","nonce":3752119173}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:27:43.200836+0000","modified":"2023-10-06T02:28:37.708971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6840},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6840":{"gid":6840,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/1787333914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1787333914},{"type":"v1","addr":"172.21.15.37:6834","nonce":1787333914}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:28:47.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.062+0000 7f919b59e700 1 -- 172.21.15.37:0/3138208607 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f917c066f30 msgr2=0x7f917c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:47.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.062+0000 7f919b59e700 1 --2- 172.21.15.37:0/3138208607 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f917c066f30 0x7f917c0693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f918c0093f0 tx=0x7f918c017000 comp rx=0 tx=0).stop 2023-10-06T02:28:47.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.062+0000 7f919b59e700 1 -- 172.21.15.37:0/3138208607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f919c155f10 msgr2=0x7f919c0c3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:47.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.062+0000 7f919b59e700 1 --2- 172.21.15.37:0/3138208607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f919c155f10 0x7f919c0c3a80 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f919000c590 tx=0x7f9190007c70 comp rx=0 tx=0).stop 2023-10-06T02:28:47.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.062+0000 7f919b59e700 1 -- 172.21.15.37:0/3138208607 shutdown_connections 2023-10-06T02:28:47.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.062+0000 7f919b59e700 1 --2- 172.21.15.37:0/3138208607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f919c167940 0x7f919c167de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.062+0000 7f919b59e700 1 --2- 172.21.15.37:0/3138208607 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f917c066f30 0x7f917c0693e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.062+0000 7f919b59e700 1 --2- 172.21.15.37:0/3138208607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f919c0ca9f0 0x7f919c14c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.062+0000 7f919b59e700 1 --2- 172.21.15.37:0/3138208607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f919c155f10 0x7f919c0c3a80 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.062+0000 7f919b59e700 1 -- 172.21.15.37:0/3138208607 >> 172.21.15.37:0/3138208607 conn(0x7f919c0cd280 msgr2=0x7f919c06cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.062+0000 7f919b59e700 1 -- 172.21.15.37:0/3138208607 shutdown_connections 2023-10-06T02:28:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.062+0000 7f919b59e700 1 -- 172.21.15.37:0/3138208607 wait complete. 2023-10-06T02:28:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 60 2023-10-06T02:28:47.075 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:28:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.193+0000 7f981759e700 1 Processor -- start 2023-10-06T02:28:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.193+0000 7f981759e700 1 -- start start 2023-10-06T02:28:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.194+0000 7f981759e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f98181429c0 0x7f981815d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.194+0000 7f981759e700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98180c9950 con 0x7f981806f150 2023-10-06T02:28:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.194+0000 7f981759e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981806ef10 con 0x7f9818142d90 2023-10-06T02:28:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.194+0000 7f981759e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981815df10 con 0x7f98181429c0 2023-10-06T02:28:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.194+0000 7f9816d9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f981806f150 0x7f98180cac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44720/0 (socket says 172.21.15.37:44720) 2023-10-06T02:28:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.194+0000 7f9816d9d700 1 -- 172.21.15.37:0/1949173883 learned_addr learned my addr 172.21.15.37:0/1949173883 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.194+0000 7f981659c700 1 --2- 172.21.15.37:0/1949173883 >> v2:172.21.15.191:3300/0 conn(0x7f98181429c0 0x7f981815d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.194+0000 7f981559a700 1 -- 172.21.15.37:0/1949173883 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924859127 0 0) 0x7f98180c9950 con 0x7f981806f150 2023-10-06T02:28:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.194+0000 7f981559a700 1 -- 172.21.15.37:0/1949173883 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9804003570 con 0x7f981806f150 2023-10-06T02:28:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.194+0000 7f981559a700 1 -- 172.21.15.37:0/1949173883 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412591342 0 0) 0x7f981806ef10 con 0x7f9818142d90 2023-10-06T02:28:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.194+0000 7f981559a700 1 -- 172.21.15.37:0/1949173883 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98180c9950 con 0x7f9818142d90 2023-10-06T02:28:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.194+0000 7f981659c700 1 -- 172.21.15.37:0/1949173883 >> v1:172.21.15.191:6789/0 conn(0x7f9818142d90 legacy=0x7f98180c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.194+0000 7f981659c700 1 -- 172.21.15.37:0/1949173883 >> v1:172.21.15.37:6789/0 conn(0x7f981806f150 legacy=0x7f98180cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.195+0000 7f981559a700 1 -- 172.21.15.37:0/1949173883 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 107720169 0 0) 0x7f9804003570 con 0x7f981806f150 2023-10-06T02:28:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.195+0000 7f981659c700 1 -- 172.21.15.37:0/1949173883 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981806c150 con 0x7f98181429c0 2023-10-06T02:28:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.195+0000 7f981659c700 1 --2- 172.21.15.37:0/1949173883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98181429c0 0x7f981815d9d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9808009e60 tx=0x7f9808009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e81d70be2940079 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.195+0000 7f981559a700 1 -- 172.21.15.37:0/1949173883 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980800e070 con 0x7f98181429c0 2023-10-06T02:28:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.195+0000 7f981559a700 1 -- 172.21.15.37:0/1949173883 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980800b7a0 con 0x7f98181429c0 2023-10-06T02:28:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.195+0000 7f981559a700 1 -- 172.21.15.37:0/1949173883 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810001470 con 0x7f98181429c0 2023-10-06T02:28:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.195+0000 7f981759e700 1 -- 172.21.15.37:0/1949173883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98181429c0 msgr2=0x7f981815d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.195+0000 7f981759e700 1 --2- 172.21.15.37:0/1949173883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98181429c0 0x7f981815d9d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9808009e60 tx=0x7f9808009780 comp rx=0 tx=0).stop 2023-10-06T02:28:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.195+0000 7f981759e700 1 -- 172.21.15.37:0/1949173883 shutdown_connections 2023-10-06T02:28:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.195+0000 7f981759e700 1 --2- 172.21.15.37:0/1949173883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98181429c0 0x7f981815d9d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.195+0000 7f981759e700 1 -- 172.21.15.37:0/1949173883 >> 172.21.15.37:0/1949173883 conn(0x7f981806d1c0 msgr2=0x7f981806d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.196+0000 7f981759e700 1 -- 172.21.15.37:0/1949173883 shutdown_connections 2023-10-06T02:28:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.196+0000 7f981759e700 1 -- 172.21.15.37:0/1949173883 wait complete. 2023-10-06T02:28:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.197+0000 7f981759e700 1 Processor -- start 2023-10-06T02:28:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.197+0000 7f981759e700 1 -- start start 2023-10-06T02:28:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.197+0000 7f981759e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f981806f150 0x7f9818159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.197+0000 7f981759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98181429c0 0x7f9818140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.197+0000 7f981759e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9818142d90 0x7f98180c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.197+0000 7f981759e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981815aed0 con 0x7f98181429c0 2023-10-06T02:28:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.197+0000 7f981759e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981815a2c0 con 0x7f9818142d90 2023-10-06T02:28:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.197+0000 7f981759e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981815a5a0 con 0x7f981806f150 2023-10-06T02:28:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.197+0000 7f9815d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98181429c0 0x7f9818140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.197+0000 7f9815d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98181429c0 0x7f9818140bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48020/0 (socket says 172.21.15.37:48020) 2023-10-06T02:28:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.197+0000 7f9815d9b700 1 -- 172.21.15.37:0/3412612961 learned_addr learned my addr 172.21.15.37:0/3412612961 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.198+0000 7f9816d9d700 1 --2- 172.21.15.37:0/3412612961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9818142d90 0x7f98180c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.198+0000 7f981659c700 1 --2- 172.21.15.37:0/3412612961 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f981806f150 0x7f9818159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.198+0000 7f9815d9b700 1 -- 172.21.15.37:0/3412612961 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f981806f150 msgr2=0x7f9818159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.198+0000 7f9815d9b700 1 --2- 172.21.15.37:0/3412612961 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f981806f150 0x7f9818159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.198+0000 7f9815d9b700 1 -- 172.21.15.37:0/3412612961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9818142d90 msgr2=0x7f98180c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.198+0000 7f9815d9b700 1 --2- 172.21.15.37:0/3412612961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9818142d90 0x7f98180c6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.198+0000 7f9815d9b700 1 -- 172.21.15.37:0/3412612961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9808009a20 con 0x7f98181429c0 2023-10-06T02:28:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.198+0000 7f981659c700 1 --2- 172.21.15.37:0/3412612961 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f981806f150 0x7f9818159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.198+0000 7f9816d9d700 1 --2- 172.21.15.37:0/3412612961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9818142d90 0x7f98180c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.198+0000 7f9815d9b700 1 --2- 172.21.15.37:0/3412612961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98181429c0 0x7f9818140bd0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f980000c580 tx=0x7f9800007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.198+0000 7f980e7fc700 1 -- 172.21.15.37:0/3412612961 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800010510 con 0x7f98181429c0 2023-10-06T02:28:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.198+0000 7f980e7fc700 1 -- 172.21.15.37:0/3412612961 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9800010670 con 0x7f98181429c0 2023-10-06T02:28:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.198+0000 7f981759e700 1 -- 172.21.15.37:0/3412612961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981815a880 con 0x7f98181429c0 2023-10-06T02:28:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.198+0000 7f980e7fc700 1 -- 172.21.15.37:0/3412612961 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800010a30 con 0x7f98181429c0 2023-10-06T02:28:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.198+0000 7f981759e700 1 -- 172.21.15.37:0/3412612961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9818159f70 con 0x7f98181429c0 2023-10-06T02:28:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.199+0000 7f981759e700 1 -- 172.21.15.37:0/3412612961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981815b080 con 0x7f98181429c0 2023-10-06T02:28:47.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.199+0000 7f980e7fc700 1 -- 172.21.15.37:0/3412612961 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f980001b400 con 0x7f98181429c0 2023-10-06T02:28:47.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.200+0000 7f980e7fc700 1 --2- 172.21.15.37:0/3412612961 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f97f8066f30 0x7f97f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.200+0000 7f980e7fc700 1 -- 172.21.15.37:0/3412612961 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f98000843b0 con 0x7f98181429c0 2023-10-06T02:28:47.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.200+0000 7f981659c700 1 --2- 172.21.15.37:0/3412612961 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f97f8066f30 0x7f97f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.201+0000 7f981659c700 1 --2- 172.21.15.37:0/3412612961 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f97f8066f30 0x7f97f80693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f98080099f0 tx=0x7f9808017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:47.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.204+0000 7f980e7fc700 1 -- 172.21.15.37:0/3412612961 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f981815b080 con 0x7f98181429c0 2023-10-06T02:28:47.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.440+0000 7f981759e700 1 -- 172.21.15.37:0/3412612961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f981815b080 con 0x7f98181429c0 2023-10-06T02:28:47.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.441+0000 7f980e7fc700 1 -- 172.21.15.37:0/3412612961 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f981815b080 con 0x7f98181429c0 2023-10-06T02:28:47.441 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:47.442 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":60,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3055524642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3055524642},{"type":"v1","addr":"172.21.15.37:6835","nonce":3055524642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2821947660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2821947660},{"type":"v1","addr":"172.21.15.191:6836","nonce":2821947660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6310,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3752119173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3752119173},{"type":"v1","addr":"172.21.15.191:6837","nonce":3752119173}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:27:43.200836+0000","modified":"2023-10-06T02:28:37.708971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6840},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6840":{"gid":6840,"name":"c","rank":0,"incarnation":57,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/1787333914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1787333914},{"type":"v1","addr":"172.21.15.37:6834","nonce":1787333914}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T02:28:47.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.443+0000 7f981759e700 1 -- 172.21.15.37:0/3412612961 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f97f8066f30 msgr2=0x7f97f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:47.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.443+0000 7f981759e700 1 --2- 172.21.15.37:0/3412612961 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f97f8066f30 0x7f97f80693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f98080099f0 tx=0x7f9808017000 comp rx=0 tx=0).stop 2023-10-06T02:28:47.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.443+0000 7f981759e700 1 -- 172.21.15.37:0/3412612961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98181429c0 msgr2=0x7f9818140bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:47.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.443+0000 7f981759e700 1 --2- 172.21.15.37:0/3412612961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98181429c0 0x7f9818140bd0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f980000c580 tx=0x7f9800007e10 comp rx=0 tx=0).stop 2023-10-06T02:28:47.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.443+0000 7f981759e700 1 -- 172.21.15.37:0/3412612961 shutdown_connections 2023-10-06T02:28:47.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.443+0000 7f981759e700 1 --2- 172.21.15.37:0/3412612961 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f97f8066f30 0x7f97f80693e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.443+0000 7f981759e700 1 --2- 172.21.15.37:0/3412612961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9818142d90 0x7f98180c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.443+0000 7f981759e700 1 --2- 172.21.15.37:0/3412612961 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f981806f150 0x7f9818159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.443+0000 7f981759e700 1 --2- 172.21.15.37:0/3412612961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98181429c0 0x7f9818140bd0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.443+0000 7f981759e700 1 -- 172.21.15.37:0/3412612961 >> 172.21.15.37:0/3412612961 conn(0x7f981806d1c0 msgr2=0x7f9818141b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:47.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.443+0000 7f981759e700 1 -- 172.21.15.37:0/3412612961 shutdown_connections 2023-10-06T02:28:47.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.443+0000 7f981759e700 1 -- 172.21.15.37:0/3412612961 wait complete. 2023-10-06T02:28:47.445 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 60 2023-10-06T02:28:47.457 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:28:47.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.575+0000 7f5cfe958700 1 Processor -- start 2023-10-06T02:28:47.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.575+0000 7f5cfe958700 1 -- start start 2023-10-06T02:28:47.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.576+0000 7f5cfe958700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5cf80a8b40 0x7f5cf80cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.576+0000 7f5cfe958700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5cf80a8f10 0x7f5cf80ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.576+0000 7f5cfe958700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf815b1a0 0x7f5cf80ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.576+0000 7f5cfe958700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf80cd470 con 0x7f5cf80a8b40 2023-10-06T02:28:47.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.576+0000 7f5cfe958700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf80cc860 con 0x7f5cf80a8f10 2023-10-06T02:28:47.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.576+0000 7f5cfe958700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80ccb40 con 0x7f5cf815b1a0 2023-10-06T02:28:47.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.576+0000 7f5cf7fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5cf80a8b40 0x7f5cf80cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.576+0000 7f5cf7fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5cf80a8b40 0x7f5cf80cbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48022/0 (socket says 172.21.15.37:48022) 2023-10-06T02:28:47.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.576+0000 7f5cf7fff700 1 -- 172.21.15.37:0/4114874309 learned_addr learned my addr 172.21.15.37:0/4114874309 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:47.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.577+0000 7f5cf77fe700 1 --2- 172.21.15.37:0/4114874309 >> v2:172.21.15.191:3300/0 conn(0x7f5cf80a8f10 0x7f5cf80ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.577+0000 7f5cfcef5700 1 --2- 172.21.15.37:0/4114874309 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf815b1a0 0x7f5cf80ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.577+0000 7f5cf7fff700 1 -- 172.21.15.37:0/4114874309 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf815b1a0 msgr2=0x7f5cf80ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:47.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.577+0000 7f5cf7fff700 1 --2- 172.21.15.37:0/4114874309 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf815b1a0 0x7f5cf80ce560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.577+0000 7f5cf7fff700 1 -- 172.21.15.37:0/4114874309 >> v2:172.21.15.191:3300/0 conn(0x7f5cf80a8f10 msgr2=0x7f5cf80ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:47.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.577+0000 7f5cf7fff700 1 --2- 172.21.15.37:0/4114874309 >> v2:172.21.15.191:3300/0 conn(0x7f5cf80a8f10 0x7f5cf80ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.577+0000 7f5cf7fff700 1 -- 172.21.15.37:0/4114874309 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf80cce20 con 0x7f5cf80a8b40 2023-10-06T02:28:47.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.577+0000 7f5cf77fe700 1 --2- 172.21.15.37:0/4114874309 >> v2:172.21.15.191:3300/0 conn(0x7f5cf80a8f10 0x7f5cf80ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:47.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.577+0000 7f5cf7fff700 1 --2- 172.21.15.37:0/4114874309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf80a8b40 0x7f5cf80cbf10 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80642b0 tx=0x7f5ce8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d562c3dc38c9de9c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:47.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.577+0000 7f5cf6ffd700 1 -- 172.21.15.37:0/4114874309 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce800b860 con 0x7f5cf80a8b40 2023-10-06T02:28:47.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.577+0000 7f5cf6ffd700 1 -- 172.21.15.37:0/4114874309 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce800b9c0 con 0x7f5cf80a8b40 2023-10-06T02:28:47.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.577+0000 7f5cf6ffd700 1 -- 172.21.15.37:0/4114874309 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce800bd60 con 0x7f5cf80a8b40 2023-10-06T02:28:47.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.578+0000 7f5cfe958700 1 -- 172.21.15.37:0/4114874309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf80a8b40 msgr2=0x7f5cf80cbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:47.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.578+0000 7f5cfe958700 1 --2- 172.21.15.37:0/4114874309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf80a8b40 0x7f5cf80cbf10 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80642b0 tx=0x7f5ce8009250 comp rx=0 tx=0).stop 2023-10-06T02:28:47.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.578+0000 7f5cfe958700 1 -- 172.21.15.37:0/4114874309 shutdown_connections 2023-10-06T02:28:47.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.578+0000 7f5cfe958700 1 --2- 172.21.15.37:0/4114874309 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf815b1a0 0x7f5cf80ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.578+0000 7f5cfe958700 1 --2- 172.21.15.37:0/4114874309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf80a8b40 0x7f5cf80cbf10 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.578+0000 7f5cfe958700 1 --2- 172.21.15.37:0/4114874309 >> v2:172.21.15.191:3300/0 conn(0x7f5cf80a8f10 0x7f5cf80ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.578+0000 7f5cfe958700 1 -- 172.21.15.37:0/4114874309 >> 172.21.15.37:0/4114874309 conn(0x7f5cf8067b30 msgr2=0x7f5cf8067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:47.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.578+0000 7f5cfe958700 1 -- 172.21.15.37:0/4114874309 shutdown_connections 2023-10-06T02:28:47.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.578+0000 7f5cfe958700 1 -- 172.21.15.37:0/4114874309 wait complete. 2023-10-06T02:28:47.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.579+0000 7f5cfe958700 1 Processor -- start 2023-10-06T02:28:47.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.579+0000 7f5cfe958700 1 -- start start 2023-10-06T02:28:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cfe958700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf80a8b40 0x7f5cf8169ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cfe958700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf80a8f10 0x7f5cf80b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cfe958700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf815b1a0 0x7f5cf8159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cfe958700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf8169ff0 con 0x7f5cf815b1a0 2023-10-06T02:28:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cfe958700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80b0a00 con 0x7f5cf80a8f10 2023-10-06T02:28:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cfe958700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80c74a0 con 0x7f5cf80a8b40 2023-10-06T02:28:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cfcef5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf815b1a0 0x7f5cf8159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cfcef5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf815b1a0 0x7f5cf8159680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48028/0 (socket says 172.21.15.37:48028) 2023-10-06T02:28:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cfcef5700 1 -- 172.21.15.37:0/3768345170 learned_addr learned my addr 172.21.15.37:0/3768345170 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cf77fe700 1 --2- 172.21.15.37:0/3768345170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf80a8f10 0x7f5cf80b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cf7fff700 1 --2- 172.21.15.37:0/3768345170 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf80a8b40 0x7f5cf8169ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cfcef5700 1 -- 172.21.15.37:0/3768345170 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf80a8b40 msgr2=0x7f5cf8169ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:47.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cfcef5700 1 --2- 172.21.15.37:0/3768345170 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf80a8b40 0x7f5cf8169ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cfcef5700 1 -- 172.21.15.37:0/3768345170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf80a8f10 msgr2=0x7f5cf80b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:47.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cfcef5700 1 --2- 172.21.15.37:0/3768345170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf80a8f10 0x7f5cf80b0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cfcef5700 1 -- 172.21.15.37:0/3768345170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce80094f0 con 0x7f5cf815b1a0 2023-10-06T02:28:47.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cfcef5700 1 --2- 172.21.15.37:0/3768345170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf815b1a0 0x7f5cf8159680 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0007f20 tx=0x7f5cf0009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:47.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cdffff700 1 -- 172.21.15.37:0/3768345170 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf000eb90 con 0x7f5cf815b1a0 2023-10-06T02:28:47.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cdffff700 1 -- 172.21.15.37:0/3768345170 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf000ed10 con 0x7f5cf815b1a0 2023-10-06T02:28:47.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cfe958700 1 -- 172.21.15.37:0/3768345170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf80c7780 con 0x7f5cf815b1a0 2023-10-06T02:28:47.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cdffff700 1 -- 172.21.15.37:0/3768345170 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0014670 con 0x7f5cf815b1a0 2023-10-06T02:28:47.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.580+0000 7f5cfe958700 1 -- 172.21.15.37:0/3768345170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf80c7d40 con 0x7f5cf815b1a0 2023-10-06T02:28:47.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.581+0000 7f5cfe958700 1 -- 172.21.15.37:0/3768345170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf80ad980 con 0x7f5cf815b1a0 2023-10-06T02:28:47.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.582+0000 7f5cdffff700 1 -- 172.21.15.37:0/3768345170 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5cf00149e0 con 0x7f5cf815b1a0 2023-10-06T02:28:47.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.582+0000 7f5cdffff700 1 --2- 172.21.15.37:0/3768345170 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ce4066f30 0x7f5ce40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.582+0000 7f5cdffff700 1 -- 172.21.15.37:0/3768345170 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f5cf0084cc0 con 0x7f5cf815b1a0 2023-10-06T02:28:47.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.583+0000 7f5cf7fff700 1 --2- 172.21.15.37:0/3768345170 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ce4066f30 0x7f5ce40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.583+0000 7f5cf7fff700 1 --2- 172.21.15.37:0/3768345170 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ce4066f30 0x7f5ce40693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80642b0 tx=0x7f5ce8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:47.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.586+0000 7f5cdffff700 1 -- 172.21.15.37:0/3768345170 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5cf008b080 con 0x7f5cf815b1a0 2023-10-06T02:28:47.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.784+0000 7f5cfe958700 1 -- 172.21.15.37:0/3768345170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cf80cd100 con 0x7f5cf815b1a0 2023-10-06T02:28:47.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.785+0000 7f5cdffff700 1 -- 172.21.15.37:0/3768345170 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+17130 (secure 0 0 0) 0x7f5cf0051c80 con 0x7f5cf815b1a0 2023-10-06T02:28:47.786 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:47.786 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":74,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:28:32.607238+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:27:40.951347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T02:27:42.184642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6834/4246185831":"2023-10-07T02:28:32.607211+0000","172.21.15.37:6832/4246185831":"2023-10-07T02:28:32.607211+0000","172.21.15.191:6837/2764715102":"2023-10-07T02:28:14.483678+0000","172.21.15.191:6834/2764715102":"2023-10-07T02:28:14.483678+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:28:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.787+0000 7f5cfe958700 1 -- 172.21.15.37:0/3768345170 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ce4066f30 msgr2=0x7f5ce40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.787+0000 7f5cfe958700 1 --2- 172.21.15.37:0/3768345170 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ce4066f30 0x7f5ce40693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80642b0 tx=0x7f5ce8017000 comp rx=0 tx=0).stop 2023-10-06T02:28:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.787+0000 7f5cfe958700 1 -- 172.21.15.37:0/3768345170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf815b1a0 msgr2=0x7f5cf8159680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.787+0000 7f5cfe958700 1 --2- 172.21.15.37:0/3768345170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf815b1a0 0x7f5cf8159680 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0007f20 tx=0x7f5cf0009860 comp rx=0 tx=0).stop 2023-10-06T02:28:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.787+0000 7f5cfe958700 1 -- 172.21.15.37:0/3768345170 shutdown_connections 2023-10-06T02:28:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.787+0000 7f5cfe958700 1 --2- 172.21.15.37:0/3768345170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf815b1a0 0x7f5cf8159680 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.787+0000 7f5cfe958700 1 --2- 172.21.15.37:0/3768345170 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf80a8b40 0x7f5cf8169ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.787+0000 7f5cfe958700 1 --2- 172.21.15.37:0/3768345170 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ce4066f30 0x7f5ce40693e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.787+0000 7f5cfe958700 1 --2- 172.21.15.37:0/3768345170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf80a8f10 0x7f5cf80b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.787+0000 7f5cfe958700 1 -- 172.21.15.37:0/3768345170 >> 172.21.15.37:0/3768345170 conn(0x7f5cf8067b30 msgr2=0x7f5cf80b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:47.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.787+0000 7f5cfe958700 1 -- 172.21.15.37:0/3768345170 shutdown_connections 2023-10-06T02:28:47.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.787+0000 7f5cfe958700 1 -- 172.21.15.37:0/3768345170 wait complete. 2023-10-06T02:28:47.800 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:28:47.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.921+0000 7f99db32b700 1 Processor -- start 2023-10-06T02:28:47.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.921+0000 7f99db32b700 1 -- start start 2023-10-06T02:28:47.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.922+0000 7f99db32b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f99d40cb080 0x7f99d40b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.922+0000 7f99db32b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99d406de80 0x7f99d40b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.922+0000 7f99db32b700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d40cc250 con 0x7f99d406dab0 2023-10-06T02:28:47.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.922+0000 7f99db32b700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d40cb640 con 0x7f99d40cb080 2023-10-06T02:28:47.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.922+0000 7f99db32b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d40cb920 con 0x7f99d406de80 2023-10-06T02:28:47.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.922+0000 7f99d90c7700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f99d406dab0 0x7f99d40cc6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44736/0 (socket says 172.21.15.37:44736) 2023-10-06T02:28:47.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.922+0000 7f99d90c7700 1 -- 172.21.15.37:0/872701615 learned_addr learned my addr 172.21.15.37:0/872701615 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:47.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.922+0000 7f99d3fff700 1 -- 172.21.15.37:0/872701615 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767058188 0 0) 0x7f99d40cc250 con 0x7f99d406dab0 2023-10-06T02:28:47.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d88c6700 1 --2- 172.21.15.37:0/872701615 >> v2:172.21.15.191:3300/0 conn(0x7f99d40cb080 0x7f99d40b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d98c8700 1 --2- 172.21.15.37:0/872701615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99d406de80 0x7f99d40b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d3fff700 1 -- 172.21.15.37:0/872701615 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99bc003570 con 0x7f99d406dab0 2023-10-06T02:28:47.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d3fff700 1 -- 172.21.15.37:0/872701615 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2349326408 0 0) 0x7f99bc003570 con 0x7f99d406dab0 2023-10-06T02:28:47.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d3fff700 1 -- 172.21.15.37:0/872701615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99d406de80 msgr2=0x7f99d40b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:47.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d3fff700 1 --2- 172.21.15.37:0/872701615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99d406de80 0x7f99d40b06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d3fff700 1 -- 172.21.15.37:0/872701615 >> v2:172.21.15.191:3300/0 conn(0x7f99d40cb080 msgr2=0x7f99d40b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:47.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d3fff700 1 --2- 172.21.15.37:0/872701615 >> v2:172.21.15.191:3300/0 conn(0x7f99d40cb080 0x7f99d40b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d3fff700 1 -- 172.21.15.37:0/872701615 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d40cbc00 con 0x7f99d406dab0 2023-10-06T02:28:47.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d3fff700 1 -- 172.21.15.37:0/872701615 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f99c40017f0 con 0x7f99d406dab0 2023-10-06T02:28:47.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d3fff700 1 -- 172.21.15.37:0/872701615 >> v1:172.21.15.37:6789/0 conn(0x7f99d406dab0 legacy=0x7f99d40cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:47.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d3fff700 1 --2- 172.21.15.37:0/872701615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99d406de80 0x7f99bc003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d3fff700 1 --2- 172.21.15.37:0/872701615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc003fe0 0x7f99bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d3fff700 1 --2- 172.21.15.37:0/872701615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99bc004d50 0x7f99bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d3fff700 1 -- 172.21.15.37:0/872701615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d40cb640 con 0x7f99bc003fe0 2023-10-06T02:28:47.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d3fff700 1 -- 172.21.15.37:0/872701615 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d40cb920 con 0x7f99bc004d50 2023-10-06T02:28:47.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d3fff700 1 -- 172.21.15.37:0/872701615 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc00ba90 con 0x7f99d406de80 2023-10-06T02:28:47.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d88c6700 1 --2- 172.21.15.37:0/872701615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc003fe0 0x7f99bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d90c7700 1 --2- 172.21.15.37:0/872701615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99d406de80 0x7f99bc003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d98c8700 1 --2- 172.21.15.37:0/872701615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99bc004d50 0x7f99bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d88c6700 1 -- 172.21.15.37:0/872701615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99d406de80 msgr2=0x7f99bc003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:47.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d88c6700 1 --2- 172.21.15.37:0/872701615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99d406de80 0x7f99bc003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d88c6700 1 -- 172.21.15.37:0/872701615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99bc004d50 msgr2=0x7f99bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:47.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d88c6700 1 --2- 172.21.15.37:0/872701615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99bc004d50 0x7f99bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d88c6700 1 -- 172.21.15.37:0/872701615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc003570 con 0x7f99bc003fe0 2023-10-06T02:28:47.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d98c8700 1 --2- 172.21.15.37:0/872701615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99bc004d50 0x7f99bc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:47.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.923+0000 7f99d88c6700 1 --2- 172.21.15.37:0/872701615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc003fe0 0x7f99bc004810 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009c00 tx=0x7f99c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7cdbab8a81faa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:47.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.924+0000 7f99d3fff700 1 -- 172.21.15.37:0/872701615 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c800e6b0 con 0x7f99bc003fe0 2023-10-06T02:28:47.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.924+0000 7f99d3fff700 1 -- 172.21.15.37:0/872701615 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c800e810 con 0x7f99bc003fe0 2023-10-06T02:28:47.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.924+0000 7f99d3fff700 1 -- 172.21.15.37:0/872701615 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c800ebd0 con 0x7f99bc003fe0 2023-10-06T02:28:47.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.924+0000 7f99db32b700 1 -- 172.21.15.37:0/872701615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc003fe0 msgr2=0x7f99bc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:47.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.924+0000 7f99db32b700 1 --2- 172.21.15.37:0/872701615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc003fe0 0x7f99bc004810 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009c00 tx=0x7f99c80091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.924+0000 7f99d98c8700 1 -- 172.21.15.37:0/872701615 reap_dead start 2023-10-06T02:28:47.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.924+0000 7f99db32b700 1 -- 172.21.15.37:0/872701615 shutdown_connections 2023-10-06T02:28:47.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.924+0000 7f99db32b700 1 -- 172.21.15.37:0/872701615 >> 172.21.15.37:0/872701615 conn(0x7f99d40d0510 msgr2=0x7f99d40d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:47.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.924+0000 7f99db32b700 1 -- 172.21.15.37:0/872701615 shutdown_connections 2023-10-06T02:28:47.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.924+0000 7f99db32b700 1 -- 172.21.15.37:0/872701615 wait complete. 2023-10-06T02:28:47.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.925+0000 7f99db32b700 1 Processor -- start 2023-10-06T02:28:47.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.925+0000 7f99db32b700 1 -- start start 2023-10-06T02:28:47.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.926+0000 7f99db32b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99bc003fe0 0x7f99d40b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.926+0000 7f99db32b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99d40b4970 0x7f99d40a6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.926+0000 7f99db32b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99d40af940 0x7f99d40a7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.926+0000 7f99db32b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d40b5a20 con 0x7f99d40af940 2023-10-06T02:28:47.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.926+0000 7f99db32b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d40b4e10 con 0x7f99d40b4970 2023-10-06T02:28:47.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.926+0000 7f99db32b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d40b50f0 con 0x7f99bc003fe0 2023-10-06T02:28:47.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.926+0000 7f99d98c8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99d40af940 0x7f99d40a7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.926+0000 7f99d98c8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99d40af940 0x7f99d40a7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48046/0 (socket says 172.21.15.37:48046) 2023-10-06T02:28:47.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.926+0000 7f99d98c8700 1 -- 172.21.15.37:0/3158927402 learned_addr learned my addr 172.21.15.37:0/3158927402 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:47.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.926+0000 7f99d88c6700 1 --2- 172.21.15.37:0/3158927402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99d40b4970 0x7f99d40a6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.926+0000 7f99d90c7700 1 --2- 172.21.15.37:0/3158927402 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99bc003fe0 0x7f99d40b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.927+0000 7f99d98c8700 1 -- 172.21.15.37:0/3158927402 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99bc003fe0 msgr2=0x7f99d40b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:47.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.927+0000 7f99d98c8700 1 --2- 172.21.15.37:0/3158927402 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99bc003fe0 0x7f99d40b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.927+0000 7f99d98c8700 1 -- 172.21.15.37:0/3158927402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99d40b4970 msgr2=0x7f99d40a6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:47.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.927+0000 7f99d98c8700 1 --2- 172.21.15.37:0/3158927402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99d40b4970 0x7f99d40a6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:47.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.927+0000 7f99d98c8700 1 -- 172.21.15.37:0/3158927402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d40b53d0 con 0x7f99d40af940 2023-10-06T02:28:47.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.927+0000 7f99d98c8700 1 --2- 172.21.15.37:0/3158927402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99d40af940 0x7f99d40a7350 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f99d40c7540 tx=0x7f99cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:47.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.927+0000 7f99d17fa700 1 -- 172.21.15.37:0/3158927402 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc011ed0 con 0x7f99d40af940 2023-10-06T02:28:47.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.927+0000 7f99d17fa700 1 -- 172.21.15.37:0/3158927402 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc015670 con 0x7f99d40af940 2023-10-06T02:28:47.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.927+0000 7f99db32b700 1 -- 172.21.15.37:0/3158927402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d40b56b0 con 0x7f99d40af940 2023-10-06T02:28:47.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.927+0000 7f99d17fa700 1 -- 172.21.15.37:0/3158927402 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc015a30 con 0x7f99d40af940 2023-10-06T02:28:47.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.927+0000 7f99db32b700 1 -- 172.21.15.37:0/3158927402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d4159f20 con 0x7f99d40af940 2023-10-06T02:28:47.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.928+0000 7f99db32b700 1 -- 172.21.15.37:0/3158927402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d40b5db0 con 0x7f99d40af940 2023-10-06T02:28:47.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.928+0000 7f99d17fa700 1 -- 172.21.15.37:0/3158927402 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99cc020460 con 0x7f99d40af940 2023-10-06T02:28:47.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.929+0000 7f99d17fa700 1 --2- 172.21.15.37:0/3158927402 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f99c0066f30 0x7f99c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:47.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.929+0000 7f99d17fa700 1 -- 172.21.15.37:0/3158927402 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f99cc084710 con 0x7f99d40af940 2023-10-06T02:28:47.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.929+0000 7f99d90c7700 1 --2- 172.21.15.37:0/3158927402 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f99c0066f30 0x7f99c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:47.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.930+0000 7f99d90c7700 1 --2- 172.21.15.37:0/3158927402 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f99c0066f30 0x7f99c00693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f99c4004f40 tx=0x7f99c4006040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:47.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:47.933+0000 7f99d17fa700 1 -- 172.21.15.37:0/3158927402 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99d40b5db0 con 0x7f99d40af940 2023-10-06T02:28:48.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.169+0000 7f99db32b700 1 -- 172.21.15.37:0/3158927402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f99d40b5db0 con 0x7f99d40af940 2023-10-06T02:28:48.169 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-10-06T02:28:48.169+0000 7f292cc58700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:28:48.176 INFO:tasks.ceph.mds.c.smithi037.stderr: -1339> 2023-10-06T02:28:38.614+0000 7f42586b4700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:28:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.177+0000 7f99d17fa700 1 -- 172.21.15.37:0/3158927402 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) v1 ==== 161+0+0 (secure 0 0 0) 0x7f99d40b5db0 con 0x7f99d40af940 2023-10-06T02:28:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.179+0000 7f99db32b700 1 -- 172.21.15.37:0/3158927402 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f99c0066f30 msgr2=0x7f99c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.179+0000 7f99db32b700 1 --2- 172.21.15.37:0/3158927402 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f99c0066f30 0x7f99c00693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f99c4004f40 tx=0x7f99c4006040 comp rx=0 tx=0).stop 2023-10-06T02:28:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.179+0000 7f99db32b700 1 -- 172.21.15.37:0/3158927402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99d40af940 msgr2=0x7f99d40a7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.179+0000 7f99db32b700 1 --2- 172.21.15.37:0/3158927402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99d40af940 0x7f99d40a7350 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f99d40c7540 tx=0x7f99cc008040 comp rx=0 tx=0).stop 2023-10-06T02:28:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.179+0000 7f99db32b700 1 -- 172.21.15.37:0/3158927402 shutdown_connections 2023-10-06T02:28:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.179+0000 7f99db32b700 1 --2- 172.21.15.37:0/3158927402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99d40af940 0x7f99d40a7350 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.179+0000 7f99db32b700 1 --2- 172.21.15.37:0/3158927402 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99bc003fe0 0x7f99d40b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.179+0000 7f99db32b700 1 --2- 172.21.15.37:0/3158927402 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f99c0066f30 0x7f99c00693e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.179+0000 7f99db32b700 1 --2- 172.21.15.37:0/3158927402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99d40b4970 0x7f99d40a6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.179+0000 7f99db32b700 1 -- 172.21.15.37:0/3158927402 >> 172.21.15.37:0/3158927402 conn(0x7f99d40d0510 msgr2=0x7f99d40b0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.179+0000 7f99db32b700 1 -- 172.21.15.37:0/3158927402 shutdown_connections 2023-10-06T02:28:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.179+0000 7f99db32b700 1 -- 172.21.15.37:0/3158927402 wait complete. 2023-10-06T02:28:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:28:48.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:28:48.199 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-10-06T02:28:48.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.313+0000 7f6b65e2d700 1 Processor -- start 2023-10-06T02:28:48.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.313+0000 7f6b65e2d700 1 -- start start 2023-10-06T02:28:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.314+0000 7f6b65e2d700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6b600c3870 0x7f6b600c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.314+0000 7f6b65e2d700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b60159bb0 con 0x7f6b600b0a20 2023-10-06T02:28:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.314+0000 7f6b65e2d700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6006e150 con 0x7f6b600b0650 2023-10-06T02:28:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.314+0000 7f6b65e2d700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b600c4230 con 0x7f6b600c3870 2023-10-06T02:28:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.314+0000 7f6b5effd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6b600b0a20 0x7f6b600cd710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44748/0 (socket says 172.21.15.37:44748) 2023-10-06T02:28:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.314+0000 7f6b5effd700 1 -- 172.21.15.37:0/2727321982 learned_addr learned my addr 172.21.15.37:0/2727321982 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.314+0000 7f6b5ffff700 1 --2- 172.21.15.37:0/2727321982 >> v2:172.21.15.191:3300/0 conn(0x7f6b600c3870 0x7f6b600c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.314+0000 7f6b5e7fc700 1 -- 172.21.15.37:0/2727321982 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044059928 0 0) 0x7f6b60159bb0 con 0x7f6b600b0a20 2023-10-06T02:28:48.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.314+0000 7f6b5e7fc700 1 -- 172.21.15.37:0/2727321982 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b48003570 con 0x7f6b600b0a20 2023-10-06T02:28:48.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.314+0000 7f6b5e7fc700 1 -- 172.21.15.37:0/2727321982 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921930479 0 0) 0x7f6b6006e150 con 0x7f6b600b0650 2023-10-06T02:28:48.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.314+0000 7f6b5e7fc700 1 -- 172.21.15.37:0/2727321982 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b60159bb0 con 0x7f6b600b0650 2023-10-06T02:28:48.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.314+0000 7f6b5e7fc700 1 -- 172.21.15.37:0/2727321982 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3149801274 0 0) 0x7f6b48003570 con 0x7f6b600b0a20 2023-10-06T02:28:48.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.314+0000 7f6b5ffff700 1 -- 172.21.15.37:0/2727321982 >> v1:172.21.15.191:6789/0 conn(0x7f6b600b0650 legacy=0x7f6b600c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:48.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.314+0000 7f6b5ffff700 1 -- 172.21.15.37:0/2727321982 >> v1:172.21.15.37:6789/0 conn(0x7f6b600b0a20 legacy=0x7f6b600cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:48.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.314+0000 7f6b5ffff700 1 -- 172.21.15.37:0/2727321982 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b600cde20 con 0x7f6b600c3870 2023-10-06T02:28:48.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.315+0000 7f6b5ffff700 1 --2- 172.21.15.37:0/2727321982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b600c3870 0x7f6b600c3cf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6b58009e60 tx=0x7f6b58009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdd63c2e20bc52ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:48.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.315+0000 7f6b5e7fc700 1 -- 172.21.15.37:0/2727321982 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5800e070 con 0x7f6b600c3870 2023-10-06T02:28:48.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.315+0000 7f6b5e7fc700 1 -- 172.21.15.37:0/2727321982 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5800b7a0 con 0x7f6b600c3870 2023-10-06T02:28:48.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.315+0000 7f6b5e7fc700 1 -- 172.21.15.37:0/2727321982 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b54001470 con 0x7f6b600c3870 2023-10-06T02:28:48.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.315+0000 7f6b65e2d700 1 -- 172.21.15.37:0/2727321982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b600c3870 msgr2=0x7f6b600c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:48.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.315+0000 7f6b65e2d700 1 --2- 172.21.15.37:0/2727321982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b600c3870 0x7f6b600c3cf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6b58009e60 tx=0x7f6b58009780 comp rx=0 tx=0).stop 2023-10-06T02:28:48.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.315+0000 7f6b65e2d700 1 -- 172.21.15.37:0/2727321982 shutdown_connections 2023-10-06T02:28:48.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.315+0000 7f6b65e2d700 1 --2- 172.21.15.37:0/2727321982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b600c3870 0x7f6b600c3cf0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:48.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.315+0000 7f6b65e2d700 1 -- 172.21.15.37:0/2727321982 >> 172.21.15.37:0/2727321982 conn(0x7f6b600974e0 msgr2=0x7f6b6006c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:48.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.315+0000 7f6b65e2d700 1 -- 172.21.15.37:0/2727321982 shutdown_connections 2023-10-06T02:28:48.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.315+0000 7f6b65e2d700 1 -- 172.21.15.37:0/2727321982 wait complete. 2023-10-06T02:28:48.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.317+0000 7f6b65e2d700 1 Processor -- start 2023-10-06T02:28:48.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.317+0000 7f6b65e2d700 1 -- start start 2023-10-06T02:28:48.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.317+0000 7f6b65e2d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b600b0650 0x7f6b60158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:48.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.317+0000 7f6b65e2d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b600b0a20 0x7f6b600b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:48.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.317+0000 7f6b65e2d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b600c3870 0x7f6b600b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:48.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.317+0000 7f6b65e2d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60099d80 con 0x7f6b600b0650 2023-10-06T02:28:48.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.317+0000 7f6b65e2d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b600b3d00 con 0x7f6b600b0a20 2023-10-06T02:28:48.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.317+0000 7f6b65e2d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60099170 con 0x7f6b600c3870 2023-10-06T02:28:48.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.317+0000 7f6b5f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b600b0650 0x7f6b60158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:48.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.318+0000 7f6b5f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b600b0650 0x7f6b60158080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48092/0 (socket says 172.21.15.37:48092) 2023-10-06T02:28:48.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.318+0000 7f6b5f7fe700 1 -- 172.21.15.37:0/1442874176 learned_addr learned my addr 172.21.15.37:0/1442874176 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:48.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.318+0000 7f6b5ffff700 1 --2- 172.21.15.37:0/1442874176 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b600c3870 0x7f6b600b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:48.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.318+0000 7f6b5effd700 1 --2- 172.21.15.37:0/1442874176 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b600b0a20 0x7f6b600b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:48.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.318+0000 7f6b5f7fe700 1 -- 172.21.15.37:0/1442874176 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b600c3870 msgr2=0x7f6b600b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:48.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.318+0000 7f6b5f7fe700 1 --2- 172.21.15.37:0/1442874176 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b600c3870 0x7f6b600b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:48.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.318+0000 7f6b5f7fe700 1 -- 172.21.15.37:0/1442874176 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b600b0a20 msgr2=0x7f6b600b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:48.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.318+0000 7f6b5f7fe700 1 --2- 172.21.15.37:0/1442874176 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b600b0a20 0x7f6b600b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:48.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.318+0000 7f6b5f7fe700 1 -- 172.21.15.37:0/1442874176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b58009a20 con 0x7f6b600b0650 2023-10-06T02:28:48.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.318+0000 7f6b5f7fe700 1 --2- 172.21.15.37:0/1442874176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b600b0650 0x7f6b60158080 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000c7c0 tx=0x7f6b50007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:48.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.318+0000 7f6b477fe700 1 -- 172.21.15.37:0/1442874176 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50011680 con 0x7f6b600b0650 2023-10-06T02:28:48.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.318+0000 7f6b477fe700 1 -- 172.21.15.37:0/1442874176 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b500117e0 con 0x7f6b600b0650 2023-10-06T02:28:48.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.318+0000 7f6b65e2d700 1 -- 172.21.15.37:0/1442874176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b60099450 con 0x7f6b600b0650 2023-10-06T02:28:48.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.318+0000 7f6b477fe700 1 -- 172.21.15.37:0/1442874176 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50011ba0 con 0x7f6b600b0650 2023-10-06T02:28:48.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.318+0000 7f6b65e2d700 1 -- 172.21.15.37:0/1442874176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b60099a10 con 0x7f6b600b0650 2023-10-06T02:28:48.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.319+0000 7f6b65e2d700 1 -- 172.21.15.37:0/1442874176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b60064b00 con 0x7f6b600b0650 2023-10-06T02:28:48.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.319+0000 7f6b477fe700 1 -- 172.21.15.37:0/1442874176 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b50012440 con 0x7f6b600b0650 2023-10-06T02:28:48.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.320+0000 7f6b477fe700 1 --2- 172.21.15.37:0/1442874176 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6b4c066f30 0x7f6b4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:48.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.320+0000 7f6b477fe700 1 -- 172.21.15.37:0/1442874176 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f6b50084680 con 0x7f6b600b0650 2023-10-06T02:28:48.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.320+0000 7f6b5effd700 1 --2- 172.21.15.37:0/1442874176 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6b4c066f30 0x7f6b4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:48.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.321+0000 7f6b5effd700 1 --2- 172.21.15.37:0/1442874176 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6b4c066f30 0x7f6b4c0693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6b600ab900 tx=0x7f6b54000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:48.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.324+0000 7f6b477fe700 1 -- 172.21.15.37:0/1442874176 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b50051690 con 0x7f6b600b0650 2023-10-06T02:28:48.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:48.561+0000 7f6b65e2d700 1 -- 172.21.15.37:0/1442874176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6b6006d540 con 0x7f6b600b0650 2023-10-06T02:28:49.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.182+0000 7f6b477fe700 1 -- 172.21.15.37:0/1442874176 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v62) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6b50054cb0 con 0x7f6b600b0650 2023-10-06T02:28:49.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.185+0000 7f6b65e2d700 1 -- 172.21.15.37:0/1442874176 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6b4c066f30 msgr2=0x7f6b4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:49.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.185+0000 7f6b65e2d700 1 --2- 172.21.15.37:0/1442874176 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6b4c066f30 0x7f6b4c0693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6b600ab900 tx=0x7f6b54000bc0 comp rx=0 tx=0).stop 2023-10-06T02:28:49.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.185+0000 7f6b65e2d700 1 -- 172.21.15.37:0/1442874176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b600b0650 msgr2=0x7f6b60158080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:49.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.185+0000 7f6b65e2d700 1 --2- 172.21.15.37:0/1442874176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b600b0650 0x7f6b60158080 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000c7c0 tx=0x7f6b50007e00 comp rx=0 tx=0).stop 2023-10-06T02:28:49.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.185+0000 7f6b65e2d700 1 -- 172.21.15.37:0/1442874176 shutdown_connections 2023-10-06T02:28:49.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.185+0000 7f6b65e2d700 1 --2- 172.21.15.37:0/1442874176 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b600c3870 0x7f6b600b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:49.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.185+0000 7f6b65e2d700 1 --2- 172.21.15.37:0/1442874176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b600b0650 0x7f6b60158080 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:49.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.185+0000 7f6b65e2d700 1 --2- 172.21.15.37:0/1442874176 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f6b4c066f30 0x7f6b4c0693e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.185+0000 7f6b65e2d700 1 --2- 172.21.15.37:0/1442874176 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b600b0a20 0x7f6b600b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.185+0000 7f6b65e2d700 1 -- 172.21.15.37:0/1442874176 >> 172.21.15.37:0/1442874176 conn(0x7f6b600974e0 msgr2=0x7f6b60158ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.185+0000 7f6b65e2d700 1 -- 172.21.15.37:0/1442874176 shutdown_connections 2023-10-06T02:28:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.185+0000 7f6b65e2d700 1 -- 172.21.15.37:0/1442874176 wait complete. 2023-10-06T02:28:49.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:28:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.364+0000 7f3c8a61b700 1 Processor -- start 2023-10-06T02:28:50.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.364+0000 7f3c8a61b700 1 -- start start 2023-10-06T02:28:50.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.365+0000 7f3c8a61b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f3c84159380 0x7f3c840ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:50.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.365+0000 7f3c8a61b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3c840b0c80 0x7f3c840cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:50.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.365+0000 7f3c8a61b700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8415dd90 con 0x7f3c84159750 2023-10-06T02:28:50.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.365+0000 7f3c8a61b700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8415d180 con 0x7f3c840b0c80 2023-10-06T02:28:50.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.365+0000 7f3c8a61b700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8415d460 con 0x7f3c84159380 2023-10-06T02:28:50.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.365+0000 7f3c88e18700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3c840b0c80 0x7f3c840cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:50.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.365+0000 7f3c89e1a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3c84159750 0x7f3c840b2320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44752/0 (socket says 172.21.15.37:44752) 2023-10-06T02:28:50.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.365+0000 7f3c89e1a700 1 -- 172.21.15.37:0/2771615132 learned_addr learned my addr 172.21.15.37:0/2771615132 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:50.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.365+0000 7f3c89619700 1 --2- 172.21.15.37:0/2771615132 >> v2:172.21.15.191:3300/0 conn(0x7f3c84159380 0x7f3c840ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:50.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.365+0000 7f3c88e18700 1 -- 172.21.15.37:0/2771615132 >> v2:172.21.15.191:3300/0 conn(0x7f3c84159380 msgr2=0x7f3c840ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:50.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.365+0000 7f3c88e18700 1 --2- 172.21.15.37:0/2771615132 >> v2:172.21.15.191:3300/0 conn(0x7f3c84159380 0x7f3c840ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:50.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.365+0000 7f3c88e18700 1 -- 172.21.15.37:0/2771615132 >> v1:172.21.15.37:6789/0 conn(0x7f3c84159750 legacy=0x7f3c840b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:50.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.365+0000 7f3c88e18700 1 -- 172.21.15.37:0/2771615132 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8415d740 con 0x7f3c840b0c80 2023-10-06T02:28:50.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.365+0000 7f3c83fff700 1 -- 172.21.15.37:0/2771615132 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257110487 0 0) 0x7f3c8415dd90 con 0x7f3c84159750 2023-10-06T02:28:50.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.366+0000 7f3c88e18700 1 --2- 172.21.15.37:0/2771615132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c840b0c80 0x7f3c840cd280 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f3c84064a40 tx=0x7f3c780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f018450d525da6d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:50.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.366+0000 7f3c83fff700 1 -- 172.21.15.37:0/2771615132 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7800b6b0 con 0x7f3c840b0c80 2023-10-06T02:28:50.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.366+0000 7f3c83fff700 1 -- 172.21.15.37:0/2771615132 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7800b810 con 0x7f3c840b0c80 2023-10-06T02:28:50.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.366+0000 7f3c83fff700 1 -- 172.21.15.37:0/2771615132 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7800bbb0 con 0x7f3c840b0c80 2023-10-06T02:28:50.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.366+0000 7f3c8a61b700 1 -- 172.21.15.37:0/2771615132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c840b0c80 msgr2=0x7f3c840cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:50.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.366+0000 7f3c8a61b700 1 --2- 172.21.15.37:0/2771615132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c840b0c80 0x7f3c840cd280 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f3c84064a40 tx=0x7f3c780091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:50.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.366+0000 7f3c8a61b700 1 -- 172.21.15.37:0/2771615132 shutdown_connections 2023-10-06T02:28:50.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.366+0000 7f3c8a61b700 1 --2- 172.21.15.37:0/2771615132 >> v2:172.21.15.191:3300/0 conn(0x7f3c84159380 0x7f3c840ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:50.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.366+0000 7f3c8a61b700 1 --2- 172.21.15.37:0/2771615132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c840b0c80 0x7f3c840cd280 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:50.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.366+0000 7f3c8a61b700 1 -- 172.21.15.37:0/2771615132 >> 172.21.15.37:0/2771615132 conn(0x7f3c8406c0b0 msgr2=0x7f3c8406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:50.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.366+0000 7f3c8a61b700 1 -- 172.21.15.37:0/2771615132 shutdown_connections 2023-10-06T02:28:50.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.366+0000 7f3c8a61b700 1 -- 172.21.15.37:0/2771615132 wait complete. 2023-10-06T02:28:50.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.368+0000 7f3c8a61b700 1 Processor -- start 2023-10-06T02:28:50.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.368+0000 7f3c8a61b700 1 -- start start 2023-10-06T02:28:50.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.368+0000 7f3c8a61b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3c840b0c80 0x7f3c8416a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:50.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.368+0000 7f3c8a61b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c84159380 0x7f3c841569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:50.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.368+0000 7f3c8a61b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c84159750 0x7f3c840c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:50.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.368+0000 7f3c8a61b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8416aba0 con 0x7f3c84159750 2023-10-06T02:28:50.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.368+0000 7f3c8a61b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c840c80e0 con 0x7f3c84159380 2023-10-06T02:28:50.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.368+0000 7f3c8a61b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c840c83c0 con 0x7f3c840b0c80 2023-10-06T02:28:50.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.369+0000 7f3c89e1a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c84159750 0x7f3c840c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:50.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.369+0000 7f3c89e1a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c84159750 0x7f3c840c56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48124/0 (socket says 172.21.15.37:48124) 2023-10-06T02:28:50.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.369+0000 7f3c89e1a700 1 -- 172.21.15.37:0/2826161660 learned_addr learned my addr 172.21.15.37:0/2826161660 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:50.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.369+0000 7f3c88e18700 1 --2- 172.21.15.37:0/2826161660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c84159380 0x7f3c841569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:50.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.369+0000 7f3c89619700 1 --2- 172.21.15.37:0/2826161660 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3c840b0c80 0x7f3c8416a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:50.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.369+0000 7f3c89e1a700 1 -- 172.21.15.37:0/2826161660 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3c840b0c80 msgr2=0x7f3c8416a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:50.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.369+0000 7f3c89e1a700 1 --2- 172.21.15.37:0/2826161660 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3c840b0c80 0x7f3c8416a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:50.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.369+0000 7f3c89e1a700 1 -- 172.21.15.37:0/2826161660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c84159380 msgr2=0x7f3c841569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:50.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.369+0000 7f3c89e1a700 1 --2- 172.21.15.37:0/2826161660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c84159380 0x7f3c841569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:50.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.369+0000 7f3c89e1a700 1 -- 172.21.15.37:0/2826161660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c78009420 con 0x7f3c84159750 2023-10-06T02:28:50.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.369+0000 7f3c89e1a700 1 --2- 172.21.15.37:0/2826161660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c84159750 0x7f3c840c56b0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00c4f0 tx=0x7f3c7c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:50.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.369+0000 7f3c817fa700 1 -- 172.21.15.37:0/2826161660 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c005b30 con 0x7f3c84159750 2023-10-06T02:28:50.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.369+0000 7f3c817fa700 1 -- 172.21.15.37:0/2826161660 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7c005cb0 con 0x7f3c84159750 2023-10-06T02:28:50.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.369+0000 7f3c8a61b700 1 -- 172.21.15.37:0/2826161660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c840c86a0 con 0x7f3c84159750 2023-10-06T02:28:50.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.369+0000 7f3c817fa700 1 -- 172.21.15.37:0/2826161660 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c007320 con 0x7f3c84159750 2023-10-06T02:28:50.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.369+0000 7f3c8a61b700 1 -- 172.21.15.37:0/2826161660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c840c8c60 con 0x7f3c84159750 2023-10-06T02:28:50.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.370+0000 7f3c8a61b700 1 -- 172.21.15.37:0/2826161660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c84064b00 con 0x7f3c84159750 2023-10-06T02:28:50.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.371+0000 7f3c817fa700 1 -- 172.21.15.37:0/2826161660 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c7c01b3b0 con 0x7f3c84159750 2023-10-06T02:28:50.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.371+0000 7f3c817fa700 1 --2- 172.21.15.37:0/2826161660 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3c70066f30 0x7f3c700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:50.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.371+0000 7f3c817fa700 1 -- 172.21.15.37:0/2826161660 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f3c7c083ce0 con 0x7f3c84159750 2023-10-06T02:28:50.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.371+0000 7f3c89619700 1 --2- 172.21.15.37:0/2826161660 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3c70066f30 0x7f3c700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:50.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.372+0000 7f3c89619700 1 --2- 172.21.15.37:0/2826161660 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3c70066f30 0x7f3c700693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3c840c6490 tx=0x7f3c7400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:50.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.375+0000 7f3c817fa700 1 -- 172.21.15.37:0/2826161660 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c7c050c60 con 0x7f3c84159750 2023-10-06T02:28:50.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:49.567+0000 7f3c8a61b700 1 -- 172.21.15.37:0/2826161660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3c8415da20 con 0x7f3c84159750 2023-10-06T02:28:50.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.188+0000 7f3c817fa700 1 -- 172.21.15.37:0/2826161660 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v76) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3c7c017020 con 0x7f3c84159750 2023-10-06T02:28:50.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.192+0000 7f3c8a61b700 1 -- 172.21.15.37:0/2826161660 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3c70066f30 msgr2=0x7f3c700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:50.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.192+0000 7f3c8a61b700 1 --2- 172.21.15.37:0/2826161660 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3c70066f30 0x7f3c700693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3c840c6490 tx=0x7f3c7400b040 comp rx=0 tx=0).stop 2023-10-06T02:28:50.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.192+0000 7f3c8a61b700 1 -- 172.21.15.37:0/2826161660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c84159750 msgr2=0x7f3c840c56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:50.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.192+0000 7f3c8a61b700 1 --2- 172.21.15.37:0/2826161660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c84159750 0x7f3c840c56b0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00c4f0 tx=0x7f3c7c007f50 comp rx=0 tx=0).stop 2023-10-06T02:28:50.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.192+0000 7f3c8a61b700 1 -- 172.21.15.37:0/2826161660 shutdown_connections 2023-10-06T02:28:50.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.192+0000 7f3c8a61b700 1 --2- 172.21.15.37:0/2826161660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c84159750 0x7f3c840c56b0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:50.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.192+0000 7f3c8a61b700 1 --2- 172.21.15.37:0/2826161660 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3c840b0c80 0x7f3c8416a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:50.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.192+0000 7f3c8a61b700 1 --2- 172.21.15.37:0/2826161660 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f3c70066f30 0x7f3c700693e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:50.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.192+0000 7f3c8a61b700 1 --2- 172.21.15.37:0/2826161660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c84159380 0x7f3c841569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:50.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.192+0000 7f3c8a61b700 1 -- 172.21.15.37:0/2826161660 >> 172.21.15.37:0/2826161660 conn(0x7f3c8406c0b0 msgr2=0x7f3c84159bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:50.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.192+0000 7f3c8a61b700 1 -- 172.21.15.37:0/2826161660 shutdown_connections 2023-10-06T02:28:50.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.192+0000 7f3c8a61b700 1 -- 172.21.15.37:0/2826161660 wait complete. 2023-10-06T02:28:50.194 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:28:50.207 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:28:50.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.335+0000 7faf3e194700 1 Processor -- start 2023-10-06T02:28:50.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.335+0000 7faf3e194700 1 -- start start 2023-10-06T02:28:50.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.336+0000 7faf3e194700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf380cd450 0x7faf38164440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:50.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.336+0000 7faf3e194700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3815dd90 con 0x7faf380b0c80 2023-10-06T02:28:50.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.336+0000 7faf3e194700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3815d180 con 0x7faf38159380 2023-10-06T02:28:50.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.336+0000 7faf3e194700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3815d460 con 0x7faf380cd450 2023-10-06T02:28:50.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.336+0000 7faf3c991700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faf380b0c80 0x7faf380b2320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44762/0 (socket says 172.21.15.37:44762) 2023-10-06T02:28:50.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.336+0000 7faf3c991700 1 -- 172.21.15.37:0/1292699288 learned_addr learned my addr 172.21.15.37:0/1292699288 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:50.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.336+0000 7faf3d993700 1 --2- 172.21.15.37:0/1292699288 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf380cd450 0x7faf38164440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:50.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.336+0000 7faf37fff700 1 -- 172.21.15.37:0/1292699288 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144884990 0 0) 0x7faf3815dd90 con 0x7faf380b0c80 2023-10-06T02:28:50.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.336+0000 7faf37fff700 1 -- 172.21.15.37:0/1292699288 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf20003570 con 0x7faf380b0c80 2023-10-06T02:28:50.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.336+0000 7faf37fff700 1 -- 172.21.15.37:0/1292699288 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426470748 0 0) 0x7faf3815d180 con 0x7faf38159380 2023-10-06T02:28:50.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.336+0000 7faf37fff700 1 -- 172.21.15.37:0/1292699288 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf3815dd90 con 0x7faf38159380 2023-10-06T02:28:50.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.337+0000 7faf3d993700 1 -- 172.21.15.37:0/1292699288 >> v1:172.21.15.191:6789/0 conn(0x7faf38159380 legacy=0x7faf380ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:50.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.337+0000 7faf3d993700 1 -- 172.21.15.37:0/1292699288 >> v1:172.21.15.37:6789/0 conn(0x7faf380b0c80 legacy=0x7faf380b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:50.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.337+0000 7faf3d993700 1 -- 172.21.15.37:0/1292699288 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3815d740 con 0x7faf380cd450 2023-10-06T02:28:50.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.337+0000 7faf3d993700 1 --2- 172.21.15.37:0/1292699288 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf380cd450 0x7faf38164440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faf30009910 tx=0x7faf300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d69b82e99cfaa69 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:50.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.337+0000 7faf37fff700 1 -- 172.21.15.37:0/1292699288 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30011630 con 0x7faf380cd450 2023-10-06T02:28:50.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.337+0000 7faf37fff700 1 -- 172.21.15.37:0/1292699288 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf30011790 con 0x7faf380cd450 2023-10-06T02:28:50.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.337+0000 7faf37fff700 1 -- 172.21.15.37:0/1292699288 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30011b30 con 0x7faf380cd450 2023-10-06T02:28:50.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.337+0000 7faf3e194700 1 -- 172.21.15.37:0/1292699288 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf380cd450 msgr2=0x7faf38164440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:50.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.338+0000 7faf3e194700 1 --2- 172.21.15.37:0/1292699288 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf380cd450 0x7faf38164440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faf30009910 tx=0x7faf300091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:50.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.338+0000 7faf3e194700 1 -- 172.21.15.37:0/1292699288 shutdown_connections 2023-10-06T02:28:50.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.338+0000 7faf3e194700 1 --2- 172.21.15.37:0/1292699288 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf380cd450 0x7faf38164440 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:50.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.338+0000 7faf3e194700 1 -- 172.21.15.37:0/1292699288 >> 172.21.15.37:0/1292699288 conn(0x7faf3806c0b0 msgr2=0x7faf3806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:50.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.338+0000 7faf3e194700 1 -- 172.21.15.37:0/1292699288 shutdown_connections 2023-10-06T02:28:50.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.338+0000 7faf3e194700 1 -- 172.21.15.37:0/1292699288 wait complete. 2023-10-06T02:28:50.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.339+0000 7faf3e194700 1 Processor -- start 2023-10-06T02:28:50.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.339+0000 7faf3e194700 1 -- start start 2023-10-06T02:28:50.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf3e194700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf380b0c80 0x7faf38157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:50.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf3e194700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf380cd450 0x7faf380cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:50.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf3e194700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf38159380 0x7faf380ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:50.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf3e194700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3816a430 con 0x7faf380cd450 2023-10-06T02:28:50.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf3e194700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf381695c0 con 0x7faf38159380 2023-10-06T02:28:50.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf3e194700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf38169820 con 0x7faf380b0c80 2023-10-06T02:28:50.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf3c991700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf380cd450 0x7faf380cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:50.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf3c991700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf380cd450 0x7faf380cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48130/0 (socket says 172.21.15.37:48130) 2023-10-06T02:28:50.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf3c991700 1 -- 172.21.15.37:0/499297343 learned_addr learned my addr 172.21.15.37:0/499297343 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:50.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf3d192700 1 --2- 172.21.15.37:0/499297343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf380b0c80 0x7faf38157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:50.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf3d993700 1 --2- 172.21.15.37:0/499297343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf38159380 0x7faf380ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:50.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf3c991700 1 -- 172.21.15.37:0/499297343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf380b0c80 msgr2=0x7faf38157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:50.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf3c991700 1 --2- 172.21.15.37:0/499297343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf380b0c80 0x7faf38157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:50.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf3c991700 1 -- 172.21.15.37:0/499297343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf38159380 msgr2=0x7faf380ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:50.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf3c991700 1 --2- 172.21.15.37:0/499297343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf38159380 0x7faf380ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:50.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf3c991700 1 -- 172.21.15.37:0/499297343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf30009420 con 0x7faf380cd450 2023-10-06T02:28:50.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf3d993700 1 --2- 172.21.15.37:0/499297343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf38159380 0x7faf380ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:50.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf3c991700 1 --2- 172.21.15.37:0/499297343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf380cd450 0x7faf380cc890 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00c790 tx=0x7faf2c007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:50.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf357fa700 1 -- 172.21.15.37:0/499297343 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c005b30 con 0x7faf380cd450 2023-10-06T02:28:50.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf357fa700 1 -- 172.21.15.37:0/499297343 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c005c90 con 0x7faf380cd450 2023-10-06T02:28:50.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf3e194700 1 -- 172.21.15.37:0/499297343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf38169b00 con 0x7faf380cd450 2023-10-06T02:28:50.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf357fa700 1 -- 172.21.15.37:0/499297343 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c007300 con 0x7faf380cd450 2023-10-06T02:28:50.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.340+0000 7faf3e194700 1 -- 172.21.15.37:0/499297343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3816a0c0 con 0x7faf380cd450 2023-10-06T02:28:50.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.341+0000 7faf3e194700 1 -- 172.21.15.37:0/499297343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3816a5a0 con 0x7faf380cd450 2023-10-06T02:28:50.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.342+0000 7faf357fa700 1 -- 172.21.15.37:0/499297343 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf2c01b3b0 con 0x7faf380cd450 2023-10-06T02:28:50.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.342+0000 7faf357fa700 1 --2- 172.21.15.37:0/499297343 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7faf24066f30 0x7faf240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:50.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.342+0000 7faf357fa700 1 -- 172.21.15.37:0/499297343 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5878+0+0 (secure 0 0 0) 0x7faf2c083b90 con 0x7faf380cd450 2023-10-06T02:28:50.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.342+0000 7faf3d192700 1 --2- 172.21.15.37:0/499297343 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7faf24066f30 0x7faf240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:50.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.343+0000 7faf3d192700 1 --2- 172.21.15.37:0/499297343 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7faf24066f30 0x7faf240693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7faf380b4db0 tx=0x7faf28002680 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:50.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.346+0000 7faf357fa700 1 -- 172.21.15.37:0/499297343 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf2c0548a0 con 0x7faf380cd450 2023-10-06T02:28:50.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:50.539+0000 7faf3e194700 1 -- 172.21.15.37:0/499297343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faf38064b00 con 0x7faf380cd450 2023-10-06T02:28:51.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.195+0000 7faf357fa700 1 -- 172.21.15.37:0/499297343 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v77) v1 ==== 169+0+0 (secure 0 0 0) 0x7faf2c017020 con 0x7faf380cd450 2023-10-06T02:28:51.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.199+0000 7faf3e194700 1 -- 172.21.15.37:0/499297343 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7faf24066f30 msgr2=0x7faf240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:51.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.199+0000 7faf3e194700 1 --2- 172.21.15.37:0/499297343 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7faf24066f30 0x7faf240693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7faf380b4db0 tx=0x7faf28002680 comp rx=0 tx=0).stop 2023-10-06T02:28:51.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.199+0000 7faf3e194700 1 -- 172.21.15.37:0/499297343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf380cd450 msgr2=0x7faf380cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:51.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.199+0000 7faf3e194700 1 --2- 172.21.15.37:0/499297343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf380cd450 0x7faf380cc890 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00c790 tx=0x7faf2c007e40 comp rx=0 tx=0).stop 2023-10-06T02:28:51.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.200+0000 7faf3e194700 1 -- 172.21.15.37:0/499297343 shutdown_connections 2023-10-06T02:28:51.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.200+0000 7faf3e194700 1 --2- 172.21.15.37:0/499297343 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7faf24066f30 0x7faf240693e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.200+0000 7faf3e194700 1 --2- 172.21.15.37:0/499297343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf38159380 0x7faf380ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.200+0000 7faf3e194700 1 --2- 172.21.15.37:0/499297343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf380b0c80 0x7faf38157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.200+0000 7faf3e194700 1 --2- 172.21.15.37:0/499297343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf380cd450 0x7faf380cc890 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.200+0000 7faf3e194700 1 -- 172.21.15.37:0/499297343 >> 172.21.15.37:0/499297343 conn(0x7faf3806c0b0 msgr2=0x7faf380cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:51.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.200+0000 7faf3e194700 1 -- 172.21.15.37:0/499297343 shutdown_connections 2023-10-06T02:28:51.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.200+0000 7faf3e194700 1 -- 172.21.15.37:0/499297343 wait complete. 2023-10-06T02:28:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-10-06T02:28:51.214 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:28:51.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.345+0000 7fab78de4700 1 Processor -- start 2023-10-06T02:28:51.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.345+0000 7fab78de4700 1 -- start start 2023-10-06T02:28:51.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.346+0000 7fab78de4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab74150750 0x7fab740b1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.346+0000 7fab78de4700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fab740b1ad0 0x7fab7406d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.346+0000 7fab78de4700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab7415e070 con 0x7fab74150380 2023-10-06T02:28:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.346+0000 7fab78de4700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab740b1f10 con 0x7fab740b1ad0 2023-10-06T02:28:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.346+0000 7fab78de4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7415d1c0 con 0x7fab74150750 2023-10-06T02:28:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.347+0000 7fab72d9d700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fab740b1ad0 0x7fab7406d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.347+0000 7fab7259c700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fab74150380 0x7fab740b3c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:43990/0 (socket says 172.21.15.37:43990) 2023-10-06T02:28:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.347+0000 7fab7259c700 1 -- 172.21.15.37:0/3157309405 learned_addr learned my addr 172.21.15.37:0/3157309405 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.347+0000 7fab71d9b700 1 --2- 172.21.15.37:0/3157309405 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab74150750 0x7fab740b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.347+0000 7fab71d9b700 1 -- 172.21.15.37:0/3157309405 >> v2:172.21.15.191:3300/0 conn(0x7fab740b1ad0 msgr2=0x7fab7406d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.347+0000 7fab71d9b700 1 --2- 172.21.15.37:0/3157309405 >> v2:172.21.15.191:3300/0 conn(0x7fab740b1ad0 0x7fab7406d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.347+0000 7fab71d9b700 1 -- 172.21.15.37:0/3157309405 >> v1:172.21.15.191:6789/0 conn(0x7fab74150380 legacy=0x7fab740b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.347+0000 7fab7159a700 1 -- 172.21.15.37:0/3157309405 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853624073 0 0) 0x7fab7415e070 con 0x7fab74150380 2023-10-06T02:28:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.347+0000 7fab71d9b700 1 -- 172.21.15.37:0/3157309405 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7415d460 con 0x7fab74150750 2023-10-06T02:28:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.347+0000 7fab72d9d700 1 --2- 172.21.15.37:0/3157309405 >> v2:172.21.15.191:3300/0 conn(0x7fab740b1ad0 0x7fab7406d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.347+0000 7fab71d9b700 1 --2- 172.21.15.37:0/3157309405 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab74150750 0x7fab740b1590 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fab5c0098e0 tx=0x7fab5c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8ad7b88a89ad9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.347+0000 7fab7159a700 1 -- 172.21.15.37:0/3157309405 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c00b640 con 0x7fab74150750 2023-10-06T02:28:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.348+0000 7fab7159a700 1 -- 172.21.15.37:0/3157309405 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5c00b7a0 con 0x7fab74150750 2023-10-06T02:28:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.348+0000 7fab7159a700 1 -- 172.21.15.37:0/3157309405 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c00bb40 con 0x7fab74150750 2023-10-06T02:28:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.348+0000 7fab78de4700 1 -- 172.21.15.37:0/3157309405 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab74150750 msgr2=0x7fab740b1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.348+0000 7fab78de4700 1 --2- 172.21.15.37:0/3157309405 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab74150750 0x7fab740b1590 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fab5c0098e0 tx=0x7fab5c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.348+0000 7fab78de4700 1 -- 172.21.15.37:0/3157309405 shutdown_connections 2023-10-06T02:28:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.348+0000 7fab78de4700 1 --2- 172.21.15.37:0/3157309405 >> v2:172.21.15.191:3300/0 conn(0x7fab740b1ad0 0x7fab7406d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.348+0000 7fab78de4700 1 --2- 172.21.15.37:0/3157309405 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab74150750 0x7fab740b1590 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.348+0000 7fab78de4700 1 -- 172.21.15.37:0/3157309405 >> 172.21.15.37:0/3157309405 conn(0x7fab7406c0b0 msgr2=0x7fab7406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.348+0000 7fab78de4700 1 -- 172.21.15.37:0/3157309405 shutdown_connections 2023-10-06T02:28:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.348+0000 7fab78de4700 1 -- 172.21.15.37:0/3157309405 wait complete. 2023-10-06T02:28:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.349+0000 7fab78de4700 1 Processor -- start 2023-10-06T02:28:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.349+0000 7fab78de4700 1 -- start start 2023-10-06T02:28:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.350+0000 7fab78de4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab740b1ad0 0x7fab7413adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.350+0000 7fab78de4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fab74150380 0x7fab740cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.350+0000 7fab78de4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab74150750 0x7fab740cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.350+0000 7fab78de4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7415c6d0 con 0x7fab74150750 2023-10-06T02:28:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.350+0000 7fab78de4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab740cc0c0 con 0x7fab74150380 2023-10-06T02:28:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.350+0000 7fab78de4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7415c3f0 con 0x7fab740b1ad0 2023-10-06T02:28:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.350+0000 7fab72d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab74150750 0x7fab740cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.350+0000 7fab72d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab74150750 0x7fab740cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48134/0 (socket says 172.21.15.37:48134) 2023-10-06T02:28:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.350+0000 7fab72d9d700 1 -- 172.21.15.37:0/407143743 learned_addr learned my addr 172.21.15.37:0/407143743 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.350+0000 7fab7259c700 1 --2- 172.21.15.37:0/407143743 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab740b1ad0 0x7fab7413adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.350+0000 7fab71d9b700 1 --2- 172.21.15.37:0/407143743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fab74150380 0x7fab740cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:51.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.350+0000 7fab72d9d700 1 -- 172.21.15.37:0/407143743 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab740b1ad0 msgr2=0x7fab7413adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:51.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.350+0000 7fab72d9d700 1 --2- 172.21.15.37:0/407143743 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab740b1ad0 0x7fab7413adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.350+0000 7fab72d9d700 1 -- 172.21.15.37:0/407143743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fab74150380 msgr2=0x7fab740cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:51.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.350+0000 7fab72d9d700 1 --2- 172.21.15.37:0/407143743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fab74150380 0x7fab740cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.350+0000 7fab72d9d700 1 -- 172.21.15.37:0/407143743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c009420 con 0x7fab74150750 2023-10-06T02:28:51.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.351+0000 7fab72d9d700 1 --2- 172.21.15.37:0/407143743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab74150750 0x7fab740cdee0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00ea50 tx=0x7fab6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:51.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.351+0000 7fab6a7fc700 1 -- 172.21.15.37:0/407143743 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c00ee90 con 0x7fab74150750 2023-10-06T02:28:51.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.351+0000 7fab6a7fc700 1 -- 172.21.15.37:0/407143743 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6c00c850 con 0x7fab74150750 2023-10-06T02:28:51.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.351+0000 7fab78de4700 1 -- 172.21.15.37:0/407143743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5c009420 con 0x7fab74150750 2023-10-06T02:28:51.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.351+0000 7fab6a7fc700 1 -- 172.21.15.37:0/407143743 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c00cc10 con 0x7fab74150750 2023-10-06T02:28:51.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.351+0000 7fab78de4700 1 -- 172.21.15.37:0/407143743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab740cbd50 con 0x7fab74150750 2023-10-06T02:28:51.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.352+0000 7fab78de4700 1 -- 172.21.15.37:0/407143743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab740cc250 con 0x7fab74150750 2023-10-06T02:28:51.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.352+0000 7fab6a7fc700 1 -- 172.21.15.37:0/407143743 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab6c013470 con 0x7fab74150750 2023-10-06T02:28:51.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.352+0000 7fab6a7fc700 1 --2- 172.21.15.37:0/407143743 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fab54066f30 0x7fab540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:51.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.353+0000 7fab6a7fc700 1 -- 172.21.15.37:0/407143743 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fab6c084370 con 0x7fab74150750 2023-10-06T02:28:51.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.353+0000 7fab7259c700 1 --2- 172.21.15.37:0/407143743 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fab54066f30 0x7fab540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:51.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.353+0000 7fab7259c700 1 --2- 172.21.15.37:0/407143743 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fab54066f30 0x7fab540693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fab740b1910 tx=0x7fab64001970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:51.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.357+0000 7fab6a7fc700 1 -- 172.21.15.37:0/407143743 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab6c0516d0 con 0x7fab74150750 2023-10-06T02:28:51.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.556+0000 7fab78de4700 1 -- 172.21.15.37:0/407143743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fab7415d740 con 0x7fab74150750 2023-10-06T02:28:51.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.560+0000 7fab6a7fc700 1 -- 172.21.15.37:0/407143743 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fab6c054cf0 con 0x7fab74150750 2023-10-06T02:28:51.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.562+0000 7fab78de4700 1 -- 172.21.15.37:0/407143743 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fab54066f30 msgr2=0x7fab540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:51.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.562+0000 7fab78de4700 1 --2- 172.21.15.37:0/407143743 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fab54066f30 0x7fab540693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fab740b1910 tx=0x7fab64001970 comp rx=0 tx=0).stop 2023-10-06T02:28:51.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.562+0000 7fab78de4700 1 -- 172.21.15.37:0/407143743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab74150750 msgr2=0x7fab740cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:51.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.562+0000 7fab78de4700 1 --2- 172.21.15.37:0/407143743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab74150750 0x7fab740cdee0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00ea50 tx=0x7fab6c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.562+0000 7fab78de4700 1 -- 172.21.15.37:0/407143743 shutdown_connections 2023-10-06T02:28:51.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.562+0000 7fab78de4700 1 --2- 172.21.15.37:0/407143743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab74150750 0x7fab740cdee0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.562+0000 7fab78de4700 1 --2- 172.21.15.37:0/407143743 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab740b1ad0 0x7fab7413adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.562+0000 7fab78de4700 1 --2- 172.21.15.37:0/407143743 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fab54066f30 0x7fab540693e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.562+0000 7fab78de4700 1 --2- 172.21.15.37:0/407143743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fab74150380 0x7fab740cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.562+0000 7fab78de4700 1 -- 172.21.15.37:0/407143743 >> 172.21.15.37:0/407143743 conn(0x7fab7406c0b0 msgr2=0x7fab7406d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:51.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.562+0000 7fab78de4700 1 -- 172.21.15.37:0/407143743 shutdown_connections 2023-10-06T02:28:51.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.562+0000 7fab78de4700 1 -- 172.21.15.37:0/407143743 wait complete. 2023-10-06T02:28:51.574 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2023-10-06T02:28:51.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.693+0000 7fcc0d3a3700 1 Processor -- start 2023-10-06T02:28:51.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.694+0000 7fcc0d3a3700 1 -- start start 2023-10-06T02:28:51.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.694+0000 7fcc0d3a3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcc081596d0 0x7fcc0815dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:51.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.694+0000 7fcc0d3a3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc0806ad60 0x7fcc080c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:51.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.694+0000 7fcc0d3a3700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fcc080c5cc0 0x7fcc080c6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:51.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.694+0000 7fcc0d3a3700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0806b6d0 con 0x7fcc081596d0 2023-10-06T02:28:51.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.694+0000 7fcc0d3a3700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc08063800 con 0x7fcc080c5cc0 2023-10-06T02:28:51.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.694+0000 7fcc0d3a3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc080ca080 con 0x7fcc0806ad60 2023-10-06T02:28:51.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.695+0000 7fcc06ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcc081596d0 0x7fcc0815dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:51.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.695+0000 7fcc06ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcc081596d0 0x7fcc0815dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48146/0 (socket says 172.21.15.37:48146) 2023-10-06T02:28:51.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.695+0000 7fcc06ffd700 1 -- 172.21.15.37:0/940300450 learned_addr learned my addr 172.21.15.37:0/940300450 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:51.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.695+0000 7fcc06ffd700 1 -- 172.21.15.37:0/940300450 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc0806ad60 msgr2=0x7fcc080c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:51.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.695+0000 7fcc067fc700 1 --2- 172.21.15.37:0/940300450 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc0806ad60 0x7fcc080c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:51.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.695+0000 7fcc077fe700 1 --2- 172.21.15.37:0/940300450 >> v2:172.21.15.191:3300/0 conn(0x7fcc080c5cc0 0x7fcc080c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:51.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.695+0000 7fcc06ffd700 1 --2- 172.21.15.37:0/940300450 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc0806ad60 0x7fcc080c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.695+0000 7fcc06ffd700 1 -- 172.21.15.37:0/940300450 >> v2:172.21.15.191:3300/0 conn(0x7fcc080c5cc0 msgr2=0x7fcc080c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:51.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.695+0000 7fcc06ffd700 1 --2- 172.21.15.37:0/940300450 >> v2:172.21.15.191:3300/0 conn(0x7fcc080c5cc0 0x7fcc080c6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.695+0000 7fcc06ffd700 1 -- 172.21.15.37:0/940300450 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0806a8d0 con 0x7fcc081596d0 2023-10-06T02:28:51.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.695+0000 7fcc067fc700 1 --2- 172.21.15.37:0/940300450 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc0806ad60 0x7fcc080c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:51.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.695+0000 7fcc077fe700 1 --2- 172.21.15.37:0/940300450 >> v2:172.21.15.191:3300/0 conn(0x7fcc080c5cc0 0x7fcc080c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:51.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.695+0000 7fcc06ffd700 1 --2- 172.21.15.37:0/940300450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc081596d0 0x7fcc0815dc20 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fcc080c6ab0 tx=0x7fcbf8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb866dd65f14473b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:51.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.695+0000 7fcc05ffb700 1 -- 172.21.15.37:0/940300450 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf800e070 con 0x7fcc081596d0 2023-10-06T02:28:51.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.695+0000 7fcc05ffb700 1 -- 172.21.15.37:0/940300450 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf800ba50 con 0x7fcc081596d0 2023-10-06T02:28:51.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.695+0000 7fcc05ffb700 1 -- 172.21.15.37:0/940300450 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf80092e0 con 0x7fcc081596d0 2023-10-06T02:28:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.696+0000 7fcc0d3a3700 1 -- 172.21.15.37:0/940300450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc081596d0 msgr2=0x7fcc0815dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.696+0000 7fcc0d3a3700 1 --2- 172.21.15.37:0/940300450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc081596d0 0x7fcc0815dc20 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fcc080c6ab0 tx=0x7fcbf8009840 comp rx=0 tx=0).stop 2023-10-06T02:28:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.696+0000 7fcc0d3a3700 1 -- 172.21.15.37:0/940300450 shutdown_connections 2023-10-06T02:28:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.696+0000 7fcc0d3a3700 1 --2- 172.21.15.37:0/940300450 >> v2:172.21.15.191:3300/0 conn(0x7fcc080c5cc0 0x7fcc080c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.696+0000 7fcc0d3a3700 1 --2- 172.21.15.37:0/940300450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc081596d0 0x7fcc0815dc20 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.696+0000 7fcc0d3a3700 1 --2- 172.21.15.37:0/940300450 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc0806ad60 0x7fcc080c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.696+0000 7fcc0d3a3700 1 -- 172.21.15.37:0/940300450 >> 172.21.15.37:0/940300450 conn(0x7fcc080cd490 msgr2=0x7fcc080c9430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.696+0000 7fcc0d3a3700 1 -- 172.21.15.37:0/940300450 shutdown_connections 2023-10-06T02:28:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.696+0000 7fcc0d3a3700 1 -- 172.21.15.37:0/940300450 wait complete. 2023-10-06T02:28:51.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.697+0000 7fcc0d3a3700 1 Processor -- start 2023-10-06T02:28:51.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.697+0000 7fcc0d3a3700 1 -- start start 2023-10-06T02:28:51.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.698+0000 7fcc0d3a3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc0806ad60 0x7fcc0814d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:51.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.698+0000 7fcc0d3a3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc080c5cc0 0x7fcc080ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:51.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.698+0000 7fcc0d3a3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc081596d0 0x7fcc080b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:51.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.698+0000 7fcc0d3a3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc080ade00 con 0x7fcc080c5cc0 2023-10-06T02:28:51.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.698+0000 7fcc0d3a3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc08151450 con 0x7fcc0806ad60 2023-10-06T02:28:51.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.698+0000 7fcc0d3a3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc080ace30 con 0x7fcc081596d0 2023-10-06T02:28:51.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.698+0000 7fcc067fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc080c5cc0 0x7fcc080ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:51.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.698+0000 7fcc067fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc080c5cc0 0x7fcc080ac490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48158/0 (socket says 172.21.15.37:48158) 2023-10-06T02:28:51.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.698+0000 7fcc067fc700 1 -- 172.21.15.37:0/339185322 learned_addr learned my addr 172.21.15.37:0/339185322 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.698+0000 7fcc077fe700 1 --2- 172.21.15.37:0/339185322 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc081596d0 0x7fcc080b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.698+0000 7fcc06ffd700 1 --2- 172.21.15.37:0/339185322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc0806ad60 0x7fcc0814d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.698+0000 7fcc067fc700 1 -- 172.21.15.37:0/339185322 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc081596d0 msgr2=0x7fcc080b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.698+0000 7fcc067fc700 1 --2- 172.21.15.37:0/339185322 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc081596d0 0x7fcc080b0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.698+0000 7fcc067fc700 1 -- 172.21.15.37:0/339185322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc0806ad60 msgr2=0x7fcc0814d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.698+0000 7fcc067fc700 1 --2- 172.21.15.37:0/339185322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc0806ad60 0x7fcc0814d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.698+0000 7fcc067fc700 1 -- 172.21.15.37:0/339185322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf8009ae0 con 0x7fcc080c5cc0 2023-10-06T02:28:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.698+0000 7fcc077fe700 1 --2- 172.21.15.37:0/339185322 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc081596d0 0x7fcc080b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.698+0000 7fcc067fc700 1 --2- 172.21.15.37:0/339185322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc080c5cc0 0x7fcc080ac490 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000c880 tx=0x7fcbf0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.699+0000 7fcbfeffd700 1 -- 172.21.15.37:0/339185322 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0011600 con 0x7fcc080c5cc0 2023-10-06T02:28:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.699+0000 7fcbfeffd700 1 -- 172.21.15.37:0/339185322 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf0011760 con 0x7fcc080c5cc0 2023-10-06T02:28:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.699+0000 7fcc0d3a3700 1 -- 172.21.15.37:0/339185322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc080ad110 con 0x7fcc080c5cc0 2023-10-06T02:28:51.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.699+0000 7fcbfeffd700 1 -- 172.21.15.37:0/339185322 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0011ae0 con 0x7fcc080c5cc0 2023-10-06T02:28:51.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.699+0000 7fcc0d3a3700 1 -- 172.21.15.37:0/339185322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc080ada90 con 0x7fcc080c5cc0 2023-10-06T02:28:51.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.699+0000 7fcc0d3a3700 1 -- 172.21.15.37:0/339185322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc080adf70 con 0x7fcc080c5cc0 2023-10-06T02:28:51.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.700+0000 7fcbfeffd700 1 -- 172.21.15.37:0/339185322 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcbf0010350 con 0x7fcc080c5cc0 2023-10-06T02:28:51.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.700+0000 7fcbfeffd700 1 --2- 172.21.15.37:0/339185322 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcbe8066f30 0x7fcbe80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:51.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.700+0000 7fcbfeffd700 1 -- 172.21.15.37:0/339185322 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fcbf0084390 con 0x7fcc080c5cc0 2023-10-06T02:28:51.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.701+0000 7fcc06ffd700 1 --2- 172.21.15.37:0/339185322 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcbe8066f30 0x7fcbe80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:51.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.701+0000 7fcc06ffd700 1 --2- 172.21.15.37:0/339185322 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcbe8066f30 0x7fcbe80693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8009ab0 tx=0x7fcbf8018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:51.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.705+0000 7fcbfeffd700 1 -- 172.21.15.37:0/339185322 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcbf0055180 con 0x7fcc080c5cc0 2023-10-06T02:28:51.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:51.976+0000 7fcc0d3a3700 1 -- 172.21.15.37:0/339185322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) v1 -- 0x7fcc0804bb80 con 0x7fcc080c5cc0 2023-10-06T02:28:52.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.195+0000 7fcbfeffd700 1 -- 172.21.15.37:0/339185322 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v274) v1 ==== 144+0+0 (secure 0 0 0) 0x7fcbf0054d10 con 0x7fcc080c5cc0 2023-10-06T02:28:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.197+0000 7fcc0d3a3700 1 -- 172.21.15.37:0/339185322 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcbe8066f30 msgr2=0x7fcbe80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.197+0000 7fcc0d3a3700 1 --2- 172.21.15.37:0/339185322 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcbe8066f30 0x7fcbe80693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8009ab0 tx=0x7fcbf8018000 comp rx=0 tx=0).stop 2023-10-06T02:28:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.197+0000 7fcc0d3a3700 1 -- 172.21.15.37:0/339185322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc080c5cc0 msgr2=0x7fcc080ac490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.197+0000 7fcc0d3a3700 1 --2- 172.21.15.37:0/339185322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc080c5cc0 0x7fcc080ac490 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000c880 tx=0x7fcbf0008040 comp rx=0 tx=0).stop 2023-10-06T02:28:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.197+0000 7fcc0d3a3700 1 -- 172.21.15.37:0/339185322 shutdown_connections 2023-10-06T02:28:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.197+0000 7fcc0d3a3700 1 --2- 172.21.15.37:0/339185322 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc081596d0 0x7fcc080b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.197+0000 7fcc0d3a3700 1 --2- 172.21.15.37:0/339185322 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fcbe8066f30 0x7fcbe80693e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.197+0000 7fcc0d3a3700 1 --2- 172.21.15.37:0/339185322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc0806ad60 0x7fcc0814d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.197+0000 7fcc0d3a3700 1 --2- 172.21.15.37:0/339185322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc080c5cc0 0x7fcc080ac490 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.197+0000 7fcc0d3a3700 1 -- 172.21.15.37:0/339185322 >> 172.21.15.37:0/339185322 conn(0x7fcc080cd490 msgr2=0x7fcc080ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.197+0000 7fcc0d3a3700 1 -- 172.21.15.37:0/339185322 shutdown_connections 2023-10-06T02:28:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.197+0000 7fcc0d3a3700 1 -- 172.21.15.37:0/339185322 wait complete. 2023-10-06T02:28:52.210 INFO:tasks.cephfs_test_runner:test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2023-10-06T02:28:52.210 INFO:tasks.cephfs_test_runner: 2023-10-06T02:28:52.210 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T02:28:52.211 INFO:tasks.cephfs_test_runner:Ran 4 tests in 302.108s 2023-10-06T02:28:52.211 INFO:tasks.cephfs_test_runner: 2023-10-06T02:28:52.211 INFO:tasks.cephfs_test_runner:OK 2023-10-06T02:28:52.211 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T02:28:52.220 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-06T02:28:52.228 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-06T02:28:52.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:52.228 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-10-06T02:28:52.244 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:28:52.244 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:28:52.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:52.244 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:28:52.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:52.318 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:28:52.334 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:28:52.361 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:28:52.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:52.396 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-10-06T02:28:52.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:52.501 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2023-10-06T02:28:52.518 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T02:28:52.518 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T02:28:52.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:52.519 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T02:28:52.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:52.596 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:28:52.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:28:52.679 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link delete ceph-brx 2023-10-06T02:28:52.778 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T02:28:52.787 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T02:28:52.787 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:28:52.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.911+0000 7fc312896700 1 Processor -- start 2023-10-06T02:28:52.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.911+0000 7fc312896700 1 -- start start 2023-10-06T02:28:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.912+0000 7fc312896700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc30c155a80 0x7fc30c0ab190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.912+0000 7fc312896700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30c0aa740 con 0x7fc30c0ab6d0 2023-10-06T02:28:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.912+0000 7fc312896700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30c15a2c0 con 0x7fc30c155e50 2023-10-06T02:28:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.912+0000 7fc312896700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c15a5a0 con 0x7fc30c155a80 2023-10-06T02:28:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.912+0000 7fc30b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc30c0ab6d0 0x7fc30c159800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44774/0 (socket says 172.21.15.37:44774) 2023-10-06T02:28:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.912+0000 7fc30b7fe700 1 -- 172.21.15.37:0/1392528935 learned_addr learned my addr 172.21.15.37:0/1392528935 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.912+0000 7fc30bfff700 1 --2- 172.21.15.37:0/1392528935 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc30c155a80 0x7fc30c0ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.913+0000 7fc30affd700 1 -- 172.21.15.37:0/1392528935 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999348778 0 0) 0x7fc30c0aa740 con 0x7fc30c0ab6d0 2023-10-06T02:28:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.913+0000 7fc30affd700 1 -- 172.21.15.37:0/1392528935 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2f8003570 con 0x7fc30c0ab6d0 2023-10-06T02:28:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.913+0000 7fc30affd700 1 -- 172.21.15.37:0/1392528935 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404177724 0 0) 0x7fc30c15a2c0 con 0x7fc30c155e50 2023-10-06T02:28:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.913+0000 7fc30affd700 1 -- 172.21.15.37:0/1392528935 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc30c0aa740 con 0x7fc30c155e50 2023-10-06T02:28:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.913+0000 7fc30bfff700 1 -- 172.21.15.37:0/1392528935 >> v1:172.21.15.191:6789/0 conn(0x7fc30c155e50 legacy=0x7fc30c06ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.913+0000 7fc30bfff700 1 -- 172.21.15.37:0/1392528935 >> v1:172.21.15.37:6789/0 conn(0x7fc30c0ab6d0 legacy=0x7fc30c159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.913+0000 7fc30bfff700 1 -- 172.21.15.37:0/1392528935 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c0aa990 con 0x7fc30c155a80 2023-10-06T02:28:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.913+0000 7fc30bfff700 1 --2- 172.21.15.37:0/1392528935 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc30c155a80 0x7fc30c0ab190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4009910 tx=0x7fc2f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2d6a277273133be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.913+0000 7fc30affd700 1 -- 172.21.15.37:0/1392528935 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4011630 con 0x7fc30c155a80 2023-10-06T02:28:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.913+0000 7fc30affd700 1 -- 172.21.15.37:0/1392528935 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f4011790 con 0x7fc30c155a80 2023-10-06T02:28:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.913+0000 7fc30affd700 1 -- 172.21.15.37:0/1392528935 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4011b30 con 0x7fc30c155a80 2023-10-06T02:28:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.914+0000 7fc312896700 1 -- 172.21.15.37:0/1392528935 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc30c155a80 msgr2=0x7fc30c0ab190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.914+0000 7fc312896700 1 --2- 172.21.15.37:0/1392528935 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc30c155a80 0x7fc30c0ab190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4009910 tx=0x7fc2f40091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.914+0000 7fc312896700 1 -- 172.21.15.37:0/1392528935 shutdown_connections 2023-10-06T02:28:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.914+0000 7fc312896700 1 --2- 172.21.15.37:0/1392528935 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc30c155a80 0x7fc30c0ab190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.914+0000 7fc312896700 1 -- 172.21.15.37:0/1392528935 >> 172.21.15.37:0/1392528935 conn(0x7fc30c0cc120 msgr2=0x7fc30c0cc520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.914+0000 7fc312896700 1 -- 172.21.15.37:0/1392528935 shutdown_connections 2023-10-06T02:28:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.914+0000 7fc312896700 1 -- 172.21.15.37:0/1392528935 wait complete. 2023-10-06T02:28:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.915+0000 7fc312896700 1 Processor -- start 2023-10-06T02:28:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.915+0000 7fc312896700 1 -- start start 2023-10-06T02:28:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.916+0000 7fc312896700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc30c0ab6d0 0x7fc30c0b1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.916+0000 7fc312896700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc30c155a80 0x7fc30c15a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.916+0000 7fc312896700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc30c155e50 0x7fc30c142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.916+0000 7fc312896700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c0696c0 con 0x7fc30c155a80 2023-10-06T02:28:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.916+0000 7fc312896700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c15b3d0 con 0x7fc30c155e50 2023-10-06T02:28:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.916+0000 7fc312896700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c15b6b0 con 0x7fc30c0ab6d0 2023-10-06T02:28:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.916+0000 7fc30b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc30c155a80 0x7fc30c15a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:52.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.916+0000 7fc30b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc30c155a80 0x7fc30c15a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48168/0 (socket says 172.21.15.37:48168) 2023-10-06T02:28:52.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.916+0000 7fc30b7fe700 1 -- 172.21.15.37:0/2260492773 learned_addr learned my addr 172.21.15.37:0/2260492773 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:52.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.916+0000 7fc30bfff700 1 --2- 172.21.15.37:0/2260492773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc30c0ab6d0 0x7fc30c0b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:52.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.916+0000 7fc310e33700 1 --2- 172.21.15.37:0/2260492773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc30c155e50 0x7fc30c142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:52.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.916+0000 7fc30b7fe700 1 -- 172.21.15.37:0/2260492773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc30c0ab6d0 msgr2=0x7fc30c0b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:52.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.916+0000 7fc30b7fe700 1 --2- 172.21.15.37:0/2260492773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc30c0ab6d0 0x7fc30c0b1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:52.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.916+0000 7fc30b7fe700 1 -- 172.21.15.37:0/2260492773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc30c155e50 msgr2=0x7fc30c142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:52.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.916+0000 7fc30b7fe700 1 --2- 172.21.15.37:0/2260492773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc30c155e50 0x7fc30c142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:52.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.916+0000 7fc30b7fe700 1 -- 172.21.15.37:0/2260492773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f4009420 con 0x7fc30c155a80 2023-10-06T02:28:52.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.916+0000 7fc310e33700 1 --2- 172.21.15.37:0/2260492773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc30c155e50 0x7fc30c142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:52.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.916+0000 7fc30b7fe700 1 --2- 172.21.15.37:0/2260492773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc30c155a80 0x7fc30c15a910 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00c790 tx=0x7fc2fc007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:52.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.917+0000 7fc303fff700 1 -- 172.21.15.37:0/2260492773 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc005b30 con 0x7fc30c155a80 2023-10-06T02:28:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.917+0000 7fc303fff700 1 -- 172.21.15.37:0/2260492773 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc005c90 con 0x7fc30c155a80 2023-10-06T02:28:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.917+0000 7fc312896700 1 -- 172.21.15.37:0/2260492773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30c15b990 con 0x7fc30c155a80 2023-10-06T02:28:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.917+0000 7fc303fff700 1 -- 172.21.15.37:0/2260492773 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc007300 con 0x7fc30c155a80 2023-10-06T02:28:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.917+0000 7fc312896700 1 -- 172.21.15.37:0/2260492773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30c0b17a0 con 0x7fc30c155a80 2023-10-06T02:28:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.917+0000 7fc312896700 1 -- 172.21.15.37:0/2260492773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30c15bbb0 con 0x7fc30c155a80 2023-10-06T02:28:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.918+0000 7fc303fff700 1 -- 172.21.15.37:0/2260492773 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc2fc01b3b0 con 0x7fc30c155a80 2023-10-06T02:28:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.918+0000 7fc303fff700 1 --2- 172.21.15.37:0/2260492773 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc2ec066f30 0x7fc2ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.918+0000 7fc303fff700 1 -- 172.21.15.37:0/2260492773 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fc2fc0839d0 con 0x7fc30c155a80 2023-10-06T02:28:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.919+0000 7fc30bfff700 1 --2- 172.21.15.37:0/2260492773 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc2ec066f30 0x7fc2ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.919+0000 7fc30bfff700 1 --2- 172.21.15.37:0/2260492773 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc2ec066f30 0x7fc2ec0693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4009860 tx=0x7fc2f4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:52.923+0000 7fc303fff700 1 -- 172.21.15.37:0/2260492773 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2fc0547c0 con 0x7fc30c155a80 2023-10-06T02:28:53.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.119+0000 7fc312896700 1 -- 172.21.15.37:0/2260492773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc30c067660 con 0x7fc30c155a80 2023-10-06T02:28:53.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.119+0000 7fc303fff700 1 -- 172.21.15.37:0/2260492773 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+14042 (secure 0 0 0) 0x7fc2fc017020 con 0x7fc30c155a80 2023-10-06T02:28:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:53.120 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":77,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:28:51.185416+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6834/1787333914":"2023-10-07T02:28:48.169902+0000","172.21.15.37:6832/1787333914":"2023-10-07T02:28:48.169902+0000","172.21.15.37:6834/4246185831":"2023-10-07T02:28:32.607211+0000","172.21.15.37:6832/4246185831":"2023-10-07T02:28:32.607211+0000","172.21.15.191:6837/2764715102":"2023-10-07T02:28:14.483678+0000","172.21.15.191:6834/2764715102":"2023-10-07T02:28:14.483678+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:28:53.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.122+0000 7fc312896700 1 -- 172.21.15.37:0/2260492773 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc2ec066f30 msgr2=0x7fc2ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:53.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.122+0000 7fc312896700 1 --2- 172.21.15.37:0/2260492773 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc2ec066f30 0x7fc2ec0693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4009860 tx=0x7fc2f4017000 comp rx=0 tx=0).stop 2023-10-06T02:28:53.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.122+0000 7fc312896700 1 -- 172.21.15.37:0/2260492773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc30c155a80 msgr2=0x7fc30c15a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:53.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.122+0000 7fc312896700 1 --2- 172.21.15.37:0/2260492773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc30c155a80 0x7fc30c15a910 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00c790 tx=0x7fc2fc007ea0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.122+0000 7fc312896700 1 -- 172.21.15.37:0/2260492773 shutdown_connections 2023-10-06T02:28:53.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.122+0000 7fc312896700 1 --2- 172.21.15.37:0/2260492773 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fc2ec066f30 0x7fc2ec0693e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.122+0000 7fc312896700 1 --2- 172.21.15.37:0/2260492773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc30c155e50 0x7fc30c142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.122+0000 7fc312896700 1 --2- 172.21.15.37:0/2260492773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc30c0ab6d0 0x7fc30c0b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.122+0000 7fc312896700 1 --2- 172.21.15.37:0/2260492773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc30c155a80 0x7fc30c15a910 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.122+0000 7fc312896700 1 -- 172.21.15.37:0/2260492773 >> 172.21.15.37:0/2260492773 conn(0x7fc30c0cc120 msgr2=0x7fc30c0cb450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:53.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.122+0000 7fc312896700 1 -- 172.21.15.37:0/2260492773 shutdown_connections 2023-10-06T02:28:53.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.122+0000 7fc312896700 1 -- 172.21.15.37:0/2260492773 wait complete. 2023-10-06T02:28:53.135 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T02:28:53.135 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:28:53.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.254+0000 7f85649fc700 1 Processor -- start 2023-10-06T02:28:53.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.254+0000 7f85649fc700 1 -- start start 2023-10-06T02:28:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.255+0000 7f85649fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85600b2270 0x7f856006d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.255+0000 7f85649fc700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856006e4c0 con 0x7f8560159510 2023-10-06T02:28:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.255+0000 7f85649fc700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85600cb900 con 0x7f856006db80 2023-10-06T02:28:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.255+0000 7f85649fc700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85600b26c0 con 0x7f85600b2270 2023-10-06T02:28:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.255+0000 7f855effd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85600b2270 0x7f856006d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.255+0000 7f855f7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8560159510 0x7f856015da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44782/0 (socket says 172.21.15.37:44782) 2023-10-06T02:28:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.255+0000 7f855f7fe700 1 -- 172.21.15.37:0/829613960 learned_addr learned my addr 172.21.15.37:0/829613960 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.255+0000 7f855effd700 1 -- 172.21.15.37:0/829613960 >> v1:172.21.15.191:6789/0 conn(0x7f856006db80 legacy=0x7f85600cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.255+0000 7f855effd700 1 -- 172.21.15.37:0/829613960 >> v1:172.21.15.37:6789/0 conn(0x7f8560159510 legacy=0x7f856015da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.255+0000 7f855effd700 1 -- 172.21.15.37:0/829613960 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85600b2ba0 con 0x7f85600b2270 2023-10-06T02:28:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.255+0000 7f855e7fc700 1 -- 172.21.15.37:0/829613960 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430635581 0 0) 0x7f856006e4c0 con 0x7f8560159510 2023-10-06T02:28:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.256+0000 7f855effd700 1 --2- 172.21.15.37:0/829613960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85600b2270 0x7f856006d640 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f85540098e0 tx=0x7f85540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3803ece0335a1727 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.256+0000 7f855e7fc700 1 -- 172.21.15.37:0/829613960 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8554009e80 con 0x7f85600b2270 2023-10-06T02:28:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.256+0000 7f855e7fc700 1 -- 172.21.15.37:0/829613960 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855400b820 con 0x7f85600b2270 2023-10-06T02:28:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.256+0000 7f855e7fc700 1 -- 172.21.15.37:0/829613960 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855400bba0 con 0x7f85600b2270 2023-10-06T02:28:53.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.256+0000 7f85649fc700 1 -- 172.21.15.37:0/829613960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85600b2270 msgr2=0x7f856006d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:53.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.256+0000 7f85649fc700 1 --2- 172.21.15.37:0/829613960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85600b2270 0x7f856006d640 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f85540098e0 tx=0x7f85540091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.256+0000 7f85649fc700 1 -- 172.21.15.37:0/829613960 shutdown_connections 2023-10-06T02:28:53.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.256+0000 7f85649fc700 1 --2- 172.21.15.37:0/829613960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85600b2270 0x7f856006d640 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.256+0000 7f85649fc700 1 -- 172.21.15.37:0/829613960 >> 172.21.15.37:0/829613960 conn(0x7f856006c0b0 msgr2=0x7f856006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.256+0000 7f85649fc700 1 -- 172.21.15.37:0/829613960 shutdown_connections 2023-10-06T02:28:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.256+0000 7f85649fc700 1 -- 172.21.15.37:0/829613960 wait complete. 2023-10-06T02:28:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.258+0000 7f85649fc700 1 Processor -- start 2023-10-06T02:28:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.258+0000 7f85649fc700 1 -- start start 2023-10-06T02:28:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.258+0000 7f85649fc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f856006db80 0x7f85600c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.258+0000 7f85649fc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85600b2270 0x7f85601540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.258+0000 7f85649fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8560159510 0x7f85601697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.258+0000 7f85649fc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85600c5e50 con 0x7f8560159510 2023-10-06T02:28:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.258+0000 7f85649fc700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85600c51d0 con 0x7f85600b2270 2023-10-06T02:28:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.258+0000 7f85649fc700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85600c54b0 con 0x7f856006db80 2023-10-06T02:28:53.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.258+0000 7f855ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8560159510 0x7f85601697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:53.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.259+0000 7f855ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8560159510 0x7f85601697b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48194/0 (socket says 172.21.15.37:48194) 2023-10-06T02:28:53.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.259+0000 7f855ffff700 1 -- 172.21.15.37:0/3694591474 learned_addr learned my addr 172.21.15.37:0/3694591474 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:53.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.259+0000 7f855f7fe700 1 --2- 172.21.15.37:0/3694591474 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f856006db80 0x7f85600c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:53.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.259+0000 7f855effd700 1 --2- 172.21.15.37:0/3694591474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85600b2270 0x7f85601540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:53.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.259+0000 7f855ffff700 1 -- 172.21.15.37:0/3694591474 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f856006db80 msgr2=0x7f85600c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:53.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.259+0000 7f855ffff700 1 --2- 172.21.15.37:0/3694591474 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f856006db80 0x7f85600c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.259+0000 7f855ffff700 1 -- 172.21.15.37:0/3694591474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85600b2270 msgr2=0x7f85601540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:53.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.259+0000 7f855ffff700 1 --2- 172.21.15.37:0/3694591474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85600b2270 0x7f85601540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.259+0000 7f855ffff700 1 -- 172.21.15.37:0/3694591474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8554009420 con 0x7f8560159510 2023-10-06T02:28:53.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.259+0000 7f855effd700 1 --2- 172.21.15.37:0/3694591474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85600b2270 0x7f85601540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:53.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.259+0000 7f855ffff700 1 --2- 172.21.15.37:0/3694591474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8560159510 0x7f85601697b0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f855800bc30 tx=0x7f8558009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:53.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.259+0000 7f85477fe700 1 -- 172.21.15.37:0/3694591474 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855800c9b0 con 0x7f8560159510 2023-10-06T02:28:53.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.259+0000 7f85477fe700 1 -- 172.21.15.37:0/3694591474 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855800cb50 con 0x7f8560159510 2023-10-06T02:28:53.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.259+0000 7f85649fc700 1 -- 172.21.15.37:0/3694591474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85600c5790 con 0x7f8560159510 2023-10-06T02:28:53.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.259+0000 7f85477fe700 1 -- 172.21.15.37:0/3694591474 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8558014410 con 0x7f8560159510 2023-10-06T02:28:53.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.259+0000 7f85649fc700 1 -- 172.21.15.37:0/3694591474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8560154610 con 0x7f8560159510 2023-10-06T02:28:53.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.260+0000 7f85649fc700 1 -- 172.21.15.37:0/3694591474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85600c5f90 con 0x7f8560159510 2023-10-06T02:28:53.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.261+0000 7f85477fe700 1 -- 172.21.15.37:0/3694591474 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8558014800 con 0x7f8560159510 2023-10-06T02:28:53.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.261+0000 7f85477fe700 1 --2- 172.21.15.37:0/3694591474 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f854c066f30 0x7f854c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:53.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.261+0000 7f85477fe700 1 -- 172.21.15.37:0/3694591474 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f85580844f0 con 0x7f8560159510 2023-10-06T02:28:53.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.261+0000 7f855f7fe700 1 --2- 172.21.15.37:0/3694591474 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f854c066f30 0x7f854c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:53.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.262+0000 7f855f7fe700 1 --2- 172.21.15.37:0/3694591474 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f854c066f30 0x7f854c0693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f855000c8f0 tx=0x7f8550009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:53.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.265+0000 7f85477fe700 1 -- 172.21.15.37:0/3694591474 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f855804c5a0 con 0x7f8560159510 2023-10-06T02:28:53.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.455+0000 7f85649fc700 1 -- 172.21.15.37:0/3694591474 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8560064b00 con 0x7f854c066f30 2023-10-06T02:28:53.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.458+0000 7f85477fe700 1 -- 172.21.15.37:0/3694591474 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73480 (secure 0 0 0) 0x7f8560064b00 con 0x7f854c066f30 2023-10-06T02:28:53.459 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:53.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.460+0000 7f85649fc700 1 -- 172.21.15.37:0/3694591474 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f854c066f30 msgr2=0x7f854c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:53.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.460+0000 7f85649fc700 1 --2- 172.21.15.37:0/3694591474 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f854c066f30 0x7f854c0693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f855000c8f0 tx=0x7f8550009040 comp rx=0 tx=0).stop 2023-10-06T02:28:53.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.460+0000 7f85649fc700 1 -- 172.21.15.37:0/3694591474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8560159510 msgr2=0x7f85601697b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:53.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.460+0000 7f85649fc700 1 --2- 172.21.15.37:0/3694591474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8560159510 0x7f85601697b0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f855800bc30 tx=0x7f8558009820 comp rx=0 tx=0).stop 2023-10-06T02:28:53.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.460+0000 7f85649fc700 1 -- 172.21.15.37:0/3694591474 shutdown_connections 2023-10-06T02:28:53.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.460+0000 7f85649fc700 1 --2- 172.21.15.37:0/3694591474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8560159510 0x7f85601697b0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.460+0000 7f85649fc700 1 --2- 172.21.15.37:0/3694591474 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f856006db80 0x7f85600c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.460+0000 7f85649fc700 1 --2- 172.21.15.37:0/3694591474 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f854c066f30 0x7f854c0693e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.460+0000 7f85649fc700 1 --2- 172.21.15.37:0/3694591474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85600b2270 0x7f85601540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.460+0000 7f85649fc700 1 -- 172.21.15.37:0/3694591474 >> 172.21.15.37:0/3694591474 conn(0x7f856006c0b0 msgr2=0x7f85600b3970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:53.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.460+0000 7f85649fc700 1 -- 172.21.15.37:0/3694591474 shutdown_connections 2023-10-06T02:28:53.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.460+0000 7f85649fc700 1 -- 172.21.15.37:0/3694591474 wait complete. 2023-10-06T02:28:53.462 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:28:53.473 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2023-10-06T02:28:52.591646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2403000,"kb_used_data":24696,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752571720,"statfs":{"total":773094113280,"available":770633441280,"internally_reserved":0,"allocated":25288704,"data_stored":21221533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390674,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-198,"num_read_kb":-194,"num_write":-171,"num_write_kb":-8290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001317"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.615391+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:28:32.615391+0000","last_peered":"2023-10-06T02:28:32.615391+0000","last_clean":"2023-10-06T02:28:32.615391+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:28:32.615391+0000","last_undegraded":"2023-10-06T02:28:32.615391+0000","last_fullsized":"2023-10-06T02:28:32.615391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":60,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.686979+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:28:32.686979+0000","last_peered":"2023-10-06T02:28:32.686979+0000","last_clean":"2023-10-06T02:28:32.686979+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:28:32.686979+0000","last_undegraded":"2023-10-06T02:28:32.686979+0000","last_fullsized":"2023-10-06T02:28:32.686979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":60,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.681794+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:28:32.681794+0000","last_peered":"2023-10-06T02:28:32.681794+0000","last_clean":"2023-10-06T02:28:32.681794+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:28:32.681794+0000","last_undegraded":"2023-10-06T02:28:32.681794+0000","last_fullsized":"2023-10-06T02:28:32.681794+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":206,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.676792+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:28:32.676792+0000","last_peered":"2023-10-06T02:28:32.676792+0000","last_clean":"2023-10-06T02:28:32.676792+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:28:32.676792+0000","last_undegraded":"2023-10-06T02:28:32.676792+0000","last_fullsized":"2023-10-06T02:28:32.676792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":56,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.676839+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:28:32.676839+0000","last_peered":"2023-10-06T02:28:32.676839+0000","last_clean":"2023-10-06T02:28:32.676839+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:28:32.676839+0000","last_undegraded":"2023-10-06T02:28:32.676839+0000","last_fullsized":"2023-10-06T02:28:32.676839+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":56,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.676910+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:28:32.676910+0000","last_peered":"2023-10-06T02:28:32.676910+0000","last_clean":"2023-10-06T02:28:32.676910+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:28:32.676910+0000","last_undegraded":"2023-10-06T02:28:32.676910+0000","last_fullsized":"2023-10-06T02:28:32.676910+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":67,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.614294+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:28:32.614294+0000","last_peered":"2023-10-06T02:28:32.614294+0000","last_clean":"2023-10-06T02:28:32.614294+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:28:32.614294+0000","last_undegraded":"2023-10-06T02:28:32.614294+0000","last_fullsized":"2023-10-06T02:28:32.614294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":60,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.681662+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:28:32.681662+0000","last_peered":"2023-10-06T02:28:32.681662+0000","last_clean":"2023-10-06T02:28:32.681662+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:28:32.681662+0000","last_undegraded":"2023-10-06T02:28:32.681662+0000","last_fullsized":"2023-10-06T02:28:32.681662+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":60,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.681965+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:28:32.681965+0000","last_peered":"2023-10-06T02:28:32.681965+0000","last_clean":"2023-10-06T02:28:32.681965+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:28:32.681965+0000","last_undegraded":"2023-10-06T02:28:32.681965+0000","last_fullsized":"2023-10-06T02:28:32.681965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298764,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073076,"statfs":{"total":96636764160,"available":96330829824,"internally_reserved":0,"allocated":1511424,"data_stored":1002047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.376,"5min":0.311,"15min":0.311},"max":{"1min":0.66800000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.372},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57199999999999995,"15min":0.55100000000000005},"min":{"1min":0.37,"5min":0.314,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.52400000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56299999999999994,"15min":0.54300000000000004},"min":{"1min":0.41699999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68799999999999994,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.436}]},{"osd":2,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56999999999999995,"15min":0.55500000000000005},"min":{"1min":0.42999999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78300000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57699999999999996,"15min":0.55600000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79900000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.44800000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.71399999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.56499999999999995},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.48499999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48299999999999998,"15min":0.499},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65300000000000002,"5min":1.014,"15min":1.014},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.36299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.63400000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.50700000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.503,"15min":0.51400000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66700000000000004,"5min":0.747,"15min":0.747},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.38800000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56699999999999995,"15min":0.58399999999999996},"min":{"1min":0.38400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76700000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.497},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56799999999999995,"15min":0.58999999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302288,"kb_used_data":5000,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069552,"statfs":{"total":96636764160,"available":96327221248,"internally_reserved":0,"allocated":5120000,"data_stored":4607503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59899999999999998,"15min":0.72099999999999997},"min":{"1min":0.33600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.71299999999999997,"5min":5.859,"15min":5.859},"last":0.503},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.38800000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82799999999999996,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.317}]},{"osd":1,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.52300000000000002},"min":{"1min":0.35699999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.879,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56499999999999995,"15min":0.53900000000000003},"min":{"1min":0.42099999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81299999999999994,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.434}]},{"osd":2,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.38700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85599999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58499999999999996,"15min":0.55500000000000005},"min":{"1min":0.40600000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84299999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.47299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.33600000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67000000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.41099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.68999999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.42899999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70399999999999996,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.41199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.54100000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.58199999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.59599999999999997,"15min":0.60499999999999998},"min":{"1min":0.49099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79700000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.59499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302856,"kb_used_data":5568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94068984,"statfs":{"total":96636764160,"available":96326639616,"internally_reserved":0,"allocated":5701632,"data_stored":5189852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35699999999999998,"15min":0.376},"min":{"1min":0.23100000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.502,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.46400000000000002,"15min":0.64800000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.55800000000000005,"5min":7.6900000000000004,"15min":7.6900000000000004},"last":0.35399999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.42399999999999999,"15min":0.60499999999999998},"min":{"1min":0.248,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48899999999999999,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.48899999999999999,"15min":0.67800000000000005},"min":{"1min":0.32800000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.60199999999999998,"5min":7.758,"15min":7.758},"last":0.30099999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.51600000000000001,"15min":0.70399999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59399999999999997,"5min":7.7869999999999999,"15min":7.7869999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.27600000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57999999999999996,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.73099999999999998,"15min":1.0309999999999999},"min":{"1min":0.41699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88700000000000001,"5min":11.678000000000001,"15min":11.678000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.68999999999999995,"15min":0.88},"min":{"1min":0.443,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77200000000000002,"5min":7.6529999999999996,"15min":7.6529999999999996},"last":0.50700000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66700000000000004,"15min":0.67100000000000004},"min":{"1min":0.46000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81399999999999995,"5min":1.399,"15min":1.399},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.73099999999999998,"15min":0.91400000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.81699999999999995,"5min":7.508,"15min":7.508},"last":0.495}]},{"osd":6,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.70699999999999996,"15min":0.89100000000000001},"min":{"1min":0.47399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82899999999999996,"5min":7.7270000000000003,"15min":7.7270000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.65900000000000003,"15min":0.68300000000000005},"min":{"1min":0.45700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.75600000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.55100000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67900000000000005,"15min":0.69099999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85299999999999998,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.75700000000000001,"15min":0.93700000000000006},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.82999999999999996,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.57799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302264,"kb_used_data":4976,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069576,"statfs":{"total":96636764160,"available":96327245824,"internally_reserved":0,"allocated":5095424,"data_stored":4598021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.34799999999999998},"min":{"1min":0.23300000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.38900000000000001,"15min":0.36799999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.36899999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39900000000000002,"15min":0.38900000000000001},"min":{"1min":0.29399999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52200000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42199999999999999,"15min":0.41499999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.624,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.40899999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.371,"15min":0.35599999999999998},"min":{"1min":0.26000000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.53300000000000003,"5min":0.622,"15min":0.622},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.42499999999999999,"15min":0.40100000000000002},"min":{"1min":0.30199999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.315}]},{"osd":4,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.46899999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83999999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.85399999999999998,"5min":1.008,"15min":1.008},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77900000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.40600000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77400000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64700000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84399999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.439,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":1,"15min":1},"last":0.53900000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81100000000000005,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86099999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.67000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302276,"kb_used_data":4988,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069564,"statfs":{"total":96636764160,"available":96327233536,"internally_reserved":0,"allocated":5107712,"data_stored":4600081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.34000000000000002},"min":{"1min":0.25700000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.53000000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38200000000000001},"min":{"1min":0.26600000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.55200000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.34599999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.36099999999999999,"15min":0.35099999999999998},"min":{"1min":0.27400000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46000000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40999999999999998,"15min":0.40200000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.40500000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.42799999999999999,"15min":0.41199999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54600000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42699999999999999,"15min":0.42999999999999999},"min":{"1min":0.32900000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.53900000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.36099999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61299999999999999,"15min":0.60399999999999998},"min":{"1min":0.46300000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92800000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.46400000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82999999999999996,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93899999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.499},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.63},"min":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.84299999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.63}]},{"osd":6,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.46100000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95699999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.47699999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.56299999999999994}]},{"osd":7,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65900000000000003,"15min":0.67100000000000004},"min":{"1min":0.44900000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83999999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47899999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.91900000000000004,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.61399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":410863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.44500000000000001,"15min":0.66300000000000003},"min":{"1min":0.24299999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.55900000000000005,"5min":10.164999999999999,"15min":10.164999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.39200000000000002,"15min":0.40600000000000003},"min":{"1min":0.25,"5min":0.224,"15min":0.224},"max":{"1min":0.46500000000000002,"5min":1.266,"15min":1.266},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.28000000000000003,"5min":0.191,"15min":0.191},"max":{"1min":0.68400000000000005,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42299999999999999,"15min":0.42999999999999999},"min":{"1min":0.249,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.77800000000000002,"5min":1.319,"15min":1.319},"last":0.373}]},{"osd":2,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44,"15min":0.44},"min":{"1min":0.28100000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.93500000000000005,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.46600000000000003,"15min":0.48399999999999999},"min":{"1min":0.30599999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58799999999999997,"5min":1.5,"15min":1.5},"last":0.496}]},{"osd":4,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.621,"15min":0.627},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77000000000000002,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85899999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63600000000000001,"15min":0.65400000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84299999999999997,"5min":1.538,"15min":1.538},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63700000000000001,"15min":0.63800000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79900000000000004,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.70499999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.44,"5min":0.38,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":1.111,"15min":1.111},"last":0.872},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66800000000000004,"15min":0.68300000000000005},"min":{"1min":0.45700000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.875,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.72899999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65100000000000002,"15min":0.65000000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81899999999999995,"5min":1.21,"15min":1.21},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.63700000000000001,"15min":0.64700000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80400000000000005,"5min":1.135,"15min":1.135},"last":0.82999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298188,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073652,"statfs":{"total":96636764160,"available":96331419648,"internally_reserved":0,"allocated":921600,"data_stored":408057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.52000000000000002},"min":{"1min":0.40100000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.628,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54700000000000004,"15min":0.51500000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73999999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.41599999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54100000000000004,"15min":0.504},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.71299999999999997,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68899999999999995,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.51600000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.57699999999999996},"min":{"1min":0.48399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69499999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.58599999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77100000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.372,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73499999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.44,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76200000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56100000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.499,"15min":0.49099999999999999},"min":{"1min":0.35399999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68700000000000006,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.41899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72799999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.39200000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69999999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71599999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.624}]},{"osd":7,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.42899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80500000000000005,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.45700000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.79800000000000004,"5min":1.04,"15min":1.04},"last":0.69699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":913408,"data_stored":405109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.501},"min":{"1min":0.377,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66000000000000003,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52800000000000002,"15min":0.496},"min":{"1min":0.30299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.501}]},{"osd":1,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53400000000000003,"15min":0.498},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66700000000000004,"5min":0.755,"15min":0.755},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52900000000000003,"15min":0.503},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58499999999999996,"15min":0.56299999999999994},"min":{"1min":0.43099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76400000000000001,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59899999999999998,"15min":0.57699999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79600000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54200000000000004,"15min":0.51800000000000002},"min":{"1min":0.34699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":0.745,"15min":0.745},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.55100000000000005},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47999999999999998,"15min":0.48999999999999999},"min":{"1min":0.32600000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.71299999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50700000000000001,"15min":0.51800000000000002},"min":{"1min":0.38,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76100000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.627}]},{"osd":6,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.34999999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.74299999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78000000000000003,"5min":0.873,"15min":0.873},"last":0.57399999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53800000000000003,"15min":0.56100000000000005},"min":{"1min":0.38100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67900000000000005,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56499999999999995,"15min":0.59899999999999998},"min":{"1min":0.41399999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72999999999999998,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:28:53.475 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:28:53.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.594+0000 7f84ced09700 1 Processor -- start 2023-10-06T02:28:53.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.594+0000 7f84ced09700 1 -- start start 2023-10-06T02:28:53.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.595+0000 7f84ced09700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84c80cf9f0 0x7f84c80cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:53.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.595+0000 7f84ced09700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c80c5300 con 0x7f84c8159aa0 2023-10-06T02:28:53.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.595+0000 7f84ced09700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c80c6160 con 0x7f84c81596d0 2023-10-06T02:28:53.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.595+0000 7f84ced09700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c80d03b0 con 0x7f84c80cf9f0 2023-10-06T02:28:53.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.595+0000 7f84c7fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f84c8159aa0 0x7f84c80c65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44786/0 (socket says 172.21.15.37:44786) 2023-10-06T02:28:53.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.595+0000 7f84c7fff700 1 -- 172.21.15.37:0/3615665290 learned_addr learned my addr 172.21.15.37:0/3615665290 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:53.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.596+0000 7f84cd2a6700 1 --2- 172.21.15.37:0/3615665290 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84c80cf9f0 0x7f84c80cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:53.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.596+0000 7f84c77fe700 1 -- 172.21.15.37:0/3615665290 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855555868 0 0) 0x7f84c80c5300 con 0x7f84c8159aa0 2023-10-06T02:28:53.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.596+0000 7f84c77fe700 1 -- 172.21.15.37:0/3615665290 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84b4003570 con 0x7f84c8159aa0 2023-10-06T02:28:53.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.596+0000 7f84c77fe700 1 -- 172.21.15.37:0/3615665290 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1199729409 0 0) 0x7f84b4003570 con 0x7f84c8159aa0 2023-10-06T02:28:53.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.596+0000 7f84c77fe700 1 -- 172.21.15.37:0/3615665290 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84c80cf9f0 msgr2=0x7f84c80cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:53.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.596+0000 7f84c77fe700 1 --2- 172.21.15.37:0/3615665290 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84c80cf9f0 0x7f84c80cfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.596+0000 7f84c77fe700 1 -- 172.21.15.37:0/3615665290 >> v1:172.21.15.191:6789/0 conn(0x7f84c81596d0 legacy=0x7f84c80b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:53.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.596+0000 7f84c77fe700 1 -- 172.21.15.37:0/3615665290 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c80c5550 con 0x7f84c8159aa0 2023-10-06T02:28:53.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.596+0000 7f84c77fe700 1 -- 172.21.15.37:0/3615665290 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f84b80017f0 con 0x7f84c8159aa0 2023-10-06T02:28:53.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.596+0000 7f84c77fe700 1 -- 172.21.15.37:0/3615665290 >> v1:172.21.15.37:6789/0 conn(0x7f84c8159aa0 legacy=0x7f84c80c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:53.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.596+0000 7f84c77fe700 1 --2- 172.21.15.37:0/3615665290 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84c80cf9f0 0x7f84b4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:53.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.596+0000 7f84c77fe700 1 --2- 172.21.15.37:0/3615665290 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84b4004010 0x7f84b4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.596+0000 7f84c77fe700 1 --2- 172.21.15.37:0/3615665290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4004d50 0x7f84b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.596+0000 7f84c77fe700 1 -- 172.21.15.37:0/3615665290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c80d03b0 con 0x7f84b4004d50 2023-10-06T02:28:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.596+0000 7f84c77fe700 1 -- 172.21.15.37:0/3615665290 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b400bbf0 con 0x7f84b4004010 2023-10-06T02:28:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.596+0000 7f84c77fe700 1 -- 172.21.15.37:0/3615665290 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b400bdb0 con 0x7f84c80cf9f0 2023-10-06T02:28:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.596+0000 7f84cd2a6700 1 --2- 172.21.15.37:0/3615665290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4004d50 0x7f84b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.596+0000 7f84ccaa5700 1 --2- 172.21.15.37:0/3615665290 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84c80cf9f0 0x7f84b4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.596+0000 7f84c7fff700 1 --2- 172.21.15.37:0/3615665290 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84b4004010 0x7f84b4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.597+0000 7f84cd2a6700 1 -- 172.21.15.37:0/3615665290 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84c80cf9f0 msgr2=0x7f84b4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.597+0000 7f84cd2a6700 1 --2- 172.21.15.37:0/3615665290 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84c80cf9f0 0x7f84b4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.597+0000 7f84cd2a6700 1 -- 172.21.15.37:0/3615665290 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84b4004010 msgr2=0x7f84b4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.597+0000 7f84cd2a6700 1 --2- 172.21.15.37:0/3615665290 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84b4004010 0x7f84b4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.597+0000 7f84cd2a6700 1 -- 172.21.15.37:0/3615665290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b4003570 con 0x7f84b4004d50 2023-10-06T02:28:53.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.597+0000 7f84cd2a6700 1 --2- 172.21.15.37:0/3615665290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4004d50 0x7f84b40051c0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f84b0006f00 tx=0x7f84b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868d2dc0a33b10b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:53.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.597+0000 7f84c77fe700 1 -- 172.21.15.37:0/3615665290 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b000e710 con 0x7f84b4004d50 2023-10-06T02:28:53.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.597+0000 7f84c77fe700 1 -- 172.21.15.37:0/3615665290 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b000e870 con 0x7f84b4004d50 2023-10-06T02:28:53.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.597+0000 7f84c77fe700 1 -- 172.21.15.37:0/3615665290 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b000ec30 con 0x7f84b4004d50 2023-10-06T02:28:53.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.597+0000 7f84ced09700 1 -- 172.21.15.37:0/3615665290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4004d50 msgr2=0x7f84b40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:53.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.597+0000 7f84ced09700 1 --2- 172.21.15.37:0/3615665290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4004d50 0x7f84b40051c0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f84b0006f00 tx=0x7f84b00091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.597+0000 7f84cd2a6700 1 -- 172.21.15.37:0/3615665290 reap_dead start 2023-10-06T02:28:53.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.597+0000 7f84ced09700 1 -- 172.21.15.37:0/3615665290 shutdown_connections 2023-10-06T02:28:53.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.597+0000 7f84ced09700 1 -- 172.21.15.37:0/3615665290 >> 172.21.15.37:0/3615665290 conn(0x7f84c806c890 msgr2=0x7f84c80d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:53.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.597+0000 7f84ced09700 1 -- 172.21.15.37:0/3615665290 shutdown_connections 2023-10-06T02:28:53.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.597+0000 7f84ced09700 1 -- 172.21.15.37:0/3615665290 wait complete. 2023-10-06T02:28:53.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.599+0000 7f84ced09700 1 Processor -- start 2023-10-06T02:28:53.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.599+0000 7f84ced09700 1 -- start start 2023-10-06T02:28:53.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.599+0000 7f84ced09700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4004d50 0x7f84c809c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:53.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.599+0000 7f84ced09700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84c809ab20 0x7f84c80cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:53.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.599+0000 7f84ced09700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84c80cbfb0 0x7f84c8153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:53.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.599+0000 7f84ced09700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c816ad60 con 0x7f84b4004d50 2023-10-06T02:28:53.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.599+0000 7f84ced09700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c816a1e0 con 0x7f84c80cbfb0 2023-10-06T02:28:53.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.599+0000 7f84ced09700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c816a4c0 con 0x7f84c809ab20 2023-10-06T02:28:53.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.600+0000 7f84ccaa5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4004d50 0x7f84c809c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:53.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.600+0000 7f84ccaa5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4004d50 0x7f84c809c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48210/0 (socket says 172.21.15.37:48210) 2023-10-06T02:28:53.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.600+0000 7f84ccaa5700 1 -- 172.21.15.37:0/1860185377 learned_addr learned my addr 172.21.15.37:0/1860185377 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:53.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.600+0000 7f84c7fff700 1 --2- 172.21.15.37:0/1860185377 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84c809ab20 0x7f84c80cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:53.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.600+0000 7f84cd2a6700 1 --2- 172.21.15.37:0/1860185377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84c80cbfb0 0x7f84c8153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:53.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.600+0000 7f84ccaa5700 1 -- 172.21.15.37:0/1860185377 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84c809ab20 msgr2=0x7f84c80cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:53.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.600+0000 7f84ccaa5700 1 --2- 172.21.15.37:0/1860185377 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84c809ab20 0x7f84c80cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.600+0000 7f84ccaa5700 1 -- 172.21.15.37:0/1860185377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84c80cbfb0 msgr2=0x7f84c8153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:53.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.600+0000 7f84ccaa5700 1 --2- 172.21.15.37:0/1860185377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84c80cbfb0 0x7f84c8153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.600+0000 7f84ccaa5700 1 -- 172.21.15.37:0/1860185377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c816a7a0 con 0x7f84b4004d50 2023-10-06T02:28:53.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.600+0000 7f84c7fff700 1 --2- 172.21.15.37:0/1860185377 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84c809ab20 0x7f84c80cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:53.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.600+0000 7f84ccaa5700 1 --2- 172.21.15.37:0/1860185377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4004d50 0x7f84c809c750 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f84c0002980 tx=0x7f84c0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:53.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.600+0000 7f84c4ff9700 1 -- 172.21.15.37:0/1860185377 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c000f8d0 con 0x7f84b4004d50 2023-10-06T02:28:53.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.600+0000 7f84c4ff9700 1 -- 172.21.15.37:0/1860185377 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c000fa30 con 0x7f84b4004d50 2023-10-06T02:28:53.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.600+0000 7f84ced09700 1 -- 172.21.15.37:0/1860185377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c816aa80 con 0x7f84b4004d50 2023-10-06T02:28:53.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.600+0000 7f84c4ff9700 1 -- 172.21.15.37:0/1860185377 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c000fdf0 con 0x7f84b4004d50 2023-10-06T02:28:53.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.600+0000 7f84ced09700 1 -- 172.21.15.37:0/1860185377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c809ce50 con 0x7f84b4004d50 2023-10-06T02:28:53.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.601+0000 7f84ced09700 1 -- 172.21.15.37:0/1860185377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c806fbf0 con 0x7f84b4004d50 2023-10-06T02:28:53.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.602+0000 7f84c4ff9700 1 -- 172.21.15.37:0/1860185377 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84c0013600 con 0x7f84b4004d50 2023-10-06T02:28:53.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.602+0000 7f84c4ff9700 1 --2- 172.21.15.37:0/1860185377 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f84a8066f30 0x7f84a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:53.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.602+0000 7f84c4ff9700 1 -- 172.21.15.37:0/1860185377 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f84c00848d0 con 0x7f84b4004d50 2023-10-06T02:28:53.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.602+0000 7f84c7fff700 1 --2- 172.21.15.37:0/1860185377 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f84a8066f30 0x7f84a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:53.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.603+0000 7f84c7fff700 1 --2- 172.21.15.37:0/1860185377 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f84a8066f30 0x7f84a80693e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f84b8002060 tx=0x7f84b8006040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:53.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.606+0000 7f84c4ff9700 1 -- 172.21.15.37:0/1860185377 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84c0051c30 con 0x7f84b4004d50 2023-10-06T02:28:53.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.797+0000 7f84ced09700 1 -- 172.21.15.37:0/1860185377 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84c80c5eb0 con 0x7f84a8066f30 2023-10-06T02:28:53.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.800+0000 7f84c4ff9700 1 -- 172.21.15.37:0/1860185377 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73480 (secure 0 0 0) 0x7f84c80c5eb0 con 0x7f84a8066f30 2023-10-06T02:28:53.801 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.802+0000 7f84ced09700 1 -- 172.21.15.37:0/1860185377 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f84a8066f30 msgr2=0x7f84a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.802+0000 7f84ced09700 1 --2- 172.21.15.37:0/1860185377 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f84a8066f30 0x7f84a80693e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f84b8002060 tx=0x7f84b8006040 comp rx=0 tx=0).stop 2023-10-06T02:28:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.802+0000 7f84ced09700 1 -- 172.21.15.37:0/1860185377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4004d50 msgr2=0x7f84c809c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.802+0000 7f84ced09700 1 --2- 172.21.15.37:0/1860185377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4004d50 0x7f84c809c750 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f84c0002980 tx=0x7f84c0007d30 comp rx=0 tx=0).stop 2023-10-06T02:28:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.802+0000 7f84ced09700 1 -- 172.21.15.37:0/1860185377 shutdown_connections 2023-10-06T02:28:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.802+0000 7f84ced09700 1 --2- 172.21.15.37:0/1860185377 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f84a8066f30 0x7f84a80693e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.802+0000 7f84ced09700 1 --2- 172.21.15.37:0/1860185377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84c80cbfb0 0x7f84c8153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.802+0000 7f84ced09700 1 --2- 172.21.15.37:0/1860185377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4004d50 0x7f84c809c750 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.802+0000 7f84ced09700 1 --2- 172.21.15.37:0/1860185377 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84c809ab20 0x7f84c80cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.802+0000 7f84ced09700 1 -- 172.21.15.37:0/1860185377 >> 172.21.15.37:0/1860185377 conn(0x7f84c806c890 msgr2=0x7f84c806d930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.802+0000 7f84ced09700 1 -- 172.21.15.37:0/1860185377 shutdown_connections 2023-10-06T02:28:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.802+0000 7f84ced09700 1 -- 172.21.15.37:0/1860185377 wait complete. 2023-10-06T02:28:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:28:53.817 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2023-10-06T02:28:52.591646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2403000,"kb_used_data":24696,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752571720,"statfs":{"total":773094113280,"available":770633441280,"internally_reserved":0,"allocated":25288704,"data_stored":21221533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390674,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-198,"num_read_kb":-194,"num_write":-171,"num_write_kb":-8290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001317"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.615391+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:28:32.615391+0000","last_peered":"2023-10-06T02:28:32.615391+0000","last_clean":"2023-10-06T02:28:32.615391+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:28:32.615391+0000","last_undegraded":"2023-10-06T02:28:32.615391+0000","last_fullsized":"2023-10-06T02:28:32.615391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":60,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.686979+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:28:32.686979+0000","last_peered":"2023-10-06T02:28:32.686979+0000","last_clean":"2023-10-06T02:28:32.686979+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:28:32.686979+0000","last_undegraded":"2023-10-06T02:28:32.686979+0000","last_fullsized":"2023-10-06T02:28:32.686979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":60,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.681794+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:28:32.681794+0000","last_peered":"2023-10-06T02:28:32.681794+0000","last_clean":"2023-10-06T02:28:32.681794+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:28:32.681794+0000","last_undegraded":"2023-10-06T02:28:32.681794+0000","last_fullsized":"2023-10-06T02:28:32.681794+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":206,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.676792+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:28:32.676792+0000","last_peered":"2023-10-06T02:28:32.676792+0000","last_clean":"2023-10-06T02:28:32.676792+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:28:32.676792+0000","last_undegraded":"2023-10-06T02:28:32.676792+0000","last_fullsized":"2023-10-06T02:28:32.676792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":56,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.676839+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:28:32.676839+0000","last_peered":"2023-10-06T02:28:32.676839+0000","last_clean":"2023-10-06T02:28:32.676839+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:28:32.676839+0000","last_undegraded":"2023-10-06T02:28:32.676839+0000","last_fullsized":"2023-10-06T02:28:32.676839+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":56,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.676910+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:28:32.676910+0000","last_peered":"2023-10-06T02:28:32.676910+0000","last_clean":"2023-10-06T02:28:32.676910+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:28:32.676910+0000","last_undegraded":"2023-10-06T02:28:32.676910+0000","last_fullsized":"2023-10-06T02:28:32.676910+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":67,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.614294+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:28:32.614294+0000","last_peered":"2023-10-06T02:28:32.614294+0000","last_clean":"2023-10-06T02:28:32.614294+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:28:32.614294+0000","last_undegraded":"2023-10-06T02:28:32.614294+0000","last_fullsized":"2023-10-06T02:28:32.614294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":60,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.681662+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:28:32.681662+0000","last_peered":"2023-10-06T02:28:32.681662+0000","last_clean":"2023-10-06T02:28:32.681662+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:28:32.681662+0000","last_undegraded":"2023-10-06T02:28:32.681662+0000","last_fullsized":"2023-10-06T02:28:32.681662+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":60,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.681965+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:28:32.681965+0000","last_peered":"2023-10-06T02:28:32.681965+0000","last_clean":"2023-10-06T02:28:32.681965+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:28:32.681965+0000","last_undegraded":"2023-10-06T02:28:32.681965+0000","last_fullsized":"2023-10-06T02:28:32.681965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298764,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073076,"statfs":{"total":96636764160,"available":96330829824,"internally_reserved":0,"allocated":1511424,"data_stored":1002047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.376,"5min":0.311,"15min":0.311},"max":{"1min":0.66800000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.372},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57199999999999995,"15min":0.55100000000000005},"min":{"1min":0.37,"5min":0.314,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.52400000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56299999999999994,"15min":0.54300000000000004},"min":{"1min":0.41699999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68799999999999994,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.436}]},{"osd":2,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56999999999999995,"15min":0.55500000000000005},"min":{"1min":0.42999999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78300000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57699999999999996,"15min":0.55600000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79900000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.44800000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.71399999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.56499999999999995},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.48499999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48299999999999998,"15min":0.499},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65300000000000002,"5min":1.014,"15min":1.014},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.36299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.63400000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.50700000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.503,"15min":0.51400000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66700000000000004,"5min":0.747,"15min":0.747},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.38800000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56699999999999995,"15min":0.58399999999999996},"min":{"1min":0.38400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76700000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.497},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56799999999999995,"15min":0.58999999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302288,"kb_used_data":5000,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069552,"statfs":{"total":96636764160,"available":96327221248,"internally_reserved":0,"allocated":5120000,"data_stored":4607503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59899999999999998,"15min":0.72099999999999997},"min":{"1min":0.33600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.71299999999999997,"5min":5.859,"15min":5.859},"last":0.503},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.38800000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82799999999999996,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.317}]},{"osd":1,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.52300000000000002},"min":{"1min":0.35699999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.879,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56499999999999995,"15min":0.53900000000000003},"min":{"1min":0.42099999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81299999999999994,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.434}]},{"osd":2,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.38700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85599999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58499999999999996,"15min":0.55500000000000005},"min":{"1min":0.40600000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84299999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.47299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.33600000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67000000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.41099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.68999999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.42899999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70399999999999996,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.41199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.54100000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.58199999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.59599999999999997,"15min":0.60499999999999998},"min":{"1min":0.49099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79700000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.59499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302856,"kb_used_data":5568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94068984,"statfs":{"total":96636764160,"available":96326639616,"internally_reserved":0,"allocated":5701632,"data_stored":5189852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35699999999999998,"15min":0.376},"min":{"1min":0.23100000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.502,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.46400000000000002,"15min":0.64800000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.55800000000000005,"5min":7.6900000000000004,"15min":7.6900000000000004},"last":0.35399999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.42399999999999999,"15min":0.60499999999999998},"min":{"1min":0.248,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48899999999999999,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.48899999999999999,"15min":0.67800000000000005},"min":{"1min":0.32800000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.60199999999999998,"5min":7.758,"15min":7.758},"last":0.30099999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.51600000000000001,"15min":0.70399999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59399999999999997,"5min":7.7869999999999999,"15min":7.7869999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.27600000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57999999999999996,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.73099999999999998,"15min":1.0309999999999999},"min":{"1min":0.41699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88700000000000001,"5min":11.678000000000001,"15min":11.678000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.68999999999999995,"15min":0.88},"min":{"1min":0.443,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77200000000000002,"5min":7.6529999999999996,"15min":7.6529999999999996},"last":0.50700000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66700000000000004,"15min":0.67100000000000004},"min":{"1min":0.46000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81399999999999995,"5min":1.399,"15min":1.399},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.73099999999999998,"15min":0.91400000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.81699999999999995,"5min":7.508,"15min":7.508},"last":0.495}]},{"osd":6,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.70699999999999996,"15min":0.89100000000000001},"min":{"1min":0.47399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82899999999999996,"5min":7.7270000000000003,"15min":7.7270000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.65900000000000003,"15min":0.68300000000000005},"min":{"1min":0.45700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.75600000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.55100000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67900000000000005,"15min":0.69099999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85299999999999998,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.75700000000000001,"15min":0.93700000000000006},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.82999999999999996,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.57799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302264,"kb_used_data":4976,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069576,"statfs":{"total":96636764160,"available":96327245824,"internally_reserved":0,"allocated":5095424,"data_stored":4598021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.34799999999999998},"min":{"1min":0.23300000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.38900000000000001,"15min":0.36799999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.36899999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39900000000000002,"15min":0.38900000000000001},"min":{"1min":0.29399999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52200000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42199999999999999,"15min":0.41499999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.624,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.40899999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.371,"15min":0.35599999999999998},"min":{"1min":0.26000000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.53300000000000003,"5min":0.622,"15min":0.622},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.42499999999999999,"15min":0.40100000000000002},"min":{"1min":0.30199999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.315}]},{"osd":4,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.46899999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83999999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.85399999999999998,"5min":1.008,"15min":1.008},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77900000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.40600000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77400000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64700000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84399999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.439,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":1,"15min":1},"last":0.53900000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81100000000000005,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86099999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.67000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302276,"kb_used_data":4988,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069564,"statfs":{"total":96636764160,"available":96327233536,"internally_reserved":0,"allocated":5107712,"data_stored":4600081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.34000000000000002},"min":{"1min":0.25700000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.53000000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38200000000000001},"min":{"1min":0.26600000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.55200000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.34599999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.36099999999999999,"15min":0.35099999999999998},"min":{"1min":0.27400000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46000000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40999999999999998,"15min":0.40200000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.40500000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.42799999999999999,"15min":0.41199999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54600000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42699999999999999,"15min":0.42999999999999999},"min":{"1min":0.32900000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.53900000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.36099999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61299999999999999,"15min":0.60399999999999998},"min":{"1min":0.46300000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92800000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.46400000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82999999999999996,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93899999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.499},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.63},"min":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.84299999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.63}]},{"osd":6,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.46100000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95699999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.47699999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.56299999999999994}]},{"osd":7,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65900000000000003,"15min":0.67100000000000004},"min":{"1min":0.44900000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83999999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47899999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.91900000000000004,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.61399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":410863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.44500000000000001,"15min":0.66300000000000003},"min":{"1min":0.24299999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.55900000000000005,"5min":10.164999999999999,"15min":10.164999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.39200000000000002,"15min":0.40600000000000003},"min":{"1min":0.25,"5min":0.224,"15min":0.224},"max":{"1min":0.46500000000000002,"5min":1.266,"15min":1.266},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.28000000000000003,"5min":0.191,"15min":0.191},"max":{"1min":0.68400000000000005,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42299999999999999,"15min":0.42999999999999999},"min":{"1min":0.249,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.77800000000000002,"5min":1.319,"15min":1.319},"last":0.373}]},{"osd":2,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44,"15min":0.44},"min":{"1min":0.28100000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.93500000000000005,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.46600000000000003,"15min":0.48399999999999999},"min":{"1min":0.30599999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58799999999999997,"5min":1.5,"15min":1.5},"last":0.496}]},{"osd":4,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.621,"15min":0.627},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77000000000000002,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85899999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63600000000000001,"15min":0.65400000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84299999999999997,"5min":1.538,"15min":1.538},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63700000000000001,"15min":0.63800000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79900000000000004,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.70499999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.44,"5min":0.38,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":1.111,"15min":1.111},"last":0.872},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66800000000000004,"15min":0.68300000000000005},"min":{"1min":0.45700000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.875,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.72899999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65100000000000002,"15min":0.65000000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81899999999999995,"5min":1.21,"15min":1.21},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.63700000000000001,"15min":0.64700000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80400000000000005,"5min":1.135,"15min":1.135},"last":0.82999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298188,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073652,"statfs":{"total":96636764160,"available":96331419648,"internally_reserved":0,"allocated":921600,"data_stored":408057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.52000000000000002},"min":{"1min":0.40100000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.628,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54700000000000004,"15min":0.51500000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73999999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.41599999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54100000000000004,"15min":0.504},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.71299999999999997,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68899999999999995,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.51600000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.57699999999999996},"min":{"1min":0.48399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69499999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.58599999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77100000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.372,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73499999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.44,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76200000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56100000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.499,"15min":0.49099999999999999},"min":{"1min":0.35399999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68700000000000006,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.41899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72799999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.39200000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69999999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71599999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.624}]},{"osd":7,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.42899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80500000000000005,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.45700000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.79800000000000004,"5min":1.04,"15min":1.04},"last":0.69699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":913408,"data_stored":405109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.501},"min":{"1min":0.377,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66000000000000003,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52800000000000002,"15min":0.496},"min":{"1min":0.30299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.501}]},{"osd":1,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53400000000000003,"15min":0.498},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66700000000000004,"5min":0.755,"15min":0.755},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52900000000000003,"15min":0.503},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58499999999999996,"15min":0.56299999999999994},"min":{"1min":0.43099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76400000000000001,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59899999999999998,"15min":0.57699999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79600000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54200000000000004,"15min":0.51800000000000002},"min":{"1min":0.34699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":0.745,"15min":0.745},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.55100000000000005},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47999999999999998,"15min":0.48999999999999999},"min":{"1min":0.32600000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.71299999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50700000000000001,"15min":0.51800000000000002},"min":{"1min":0.38,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76100000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.627}]},{"osd":6,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.34999999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.74299999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78000000000000003,"5min":0.873,"15min":0.873},"last":0.57399999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53800000000000003,"15min":0.56100000000000005},"min":{"1min":0.38100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67900000000000005,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56499999999999995,"15min":0.59899999999999998},"min":{"1min":0.41399999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72999999999999998,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:28:53.820 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T02:28:53.820 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:28:53.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.938+0000 7fdb491f3700 1 Processor -- start 2023-10-06T02:28:53.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.938+0000 7fdb491f3700 1 -- start start 2023-10-06T02:28:53.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.939+0000 7fdb491f3700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fdb44159aa0 0x7fdb440c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:53.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.939+0000 7fdb491f3700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb440c5300 con 0x7fdb440c6b30 2023-10-06T02:28:53.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.939+0000 7fdb491f3700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb440c6160 con 0x7fdb441596d0 2023-10-06T02:28:53.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.939+0000 7fdb491f3700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb440c5550 con 0x7fdb44159aa0 2023-10-06T02:28:53.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.939+0000 7fdb4359e700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdb440c6b30 0x7fdb440cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44800/0 (socket says 172.21.15.37:44800) 2023-10-06T02:28:53.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.939+0000 7fdb4359e700 1 -- 172.21.15.37:0/2308068187 learned_addr learned my addr 172.21.15.37:0/2308068187 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:53.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.939+0000 7fdb4259c700 1 --2- 172.21.15.37:0/2308068187 >> v2:172.21.15.191:3300/0 conn(0x7fdb44159aa0 0x7fdb440c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:53.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.940+0000 7fdb41d9b700 1 -- 172.21.15.37:0/2308068187 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173738940 0 0) 0x7fdb440c5300 con 0x7fdb440c6b30 2023-10-06T02:28:53.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.940+0000 7fdb41d9b700 1 -- 172.21.15.37:0/2308068187 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb2c003570 con 0x7fdb440c6b30 2023-10-06T02:28:53.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.940+0000 7fdb41d9b700 1 -- 172.21.15.37:0/2308068187 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541170191 0 0) 0x7fdb440c6160 con 0x7fdb441596d0 2023-10-06T02:28:53.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.940+0000 7fdb41d9b700 1 -- 172.21.15.37:0/2308068187 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb440c5300 con 0x7fdb441596d0 2023-10-06T02:28:53.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.940+0000 7fdb4259c700 1 -- 172.21.15.37:0/2308068187 >> v1:172.21.15.191:6789/0 conn(0x7fdb441596d0 legacy=0x7fdb440b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:53.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.940+0000 7fdb4259c700 1 -- 172.21.15.37:0/2308068187 >> v1:172.21.15.37:6789/0 conn(0x7fdb440c6b30 legacy=0x7fdb440cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:53.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.940+0000 7fdb4259c700 1 -- 172.21.15.37:0/2308068187 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb440c5830 con 0x7fdb44159aa0 2023-10-06T02:28:53.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.940+0000 7fdb4259c700 1 --2- 172.21.15.37:0/2308068187 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb44159aa0 0x7fdb440c65f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdb380098e0 tx=0x7fdb380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b74e2d8d7deb5c9e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:53.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.940+0000 7fdb41d9b700 1 -- 172.21.15.37:0/2308068187 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb38011630 con 0x7fdb44159aa0 2023-10-06T02:28:53.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.940+0000 7fdb41d9b700 1 -- 172.21.15.37:0/2308068187 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb38011790 con 0x7fdb44159aa0 2023-10-06T02:28:53.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.940+0000 7fdb41d9b700 1 -- 172.21.15.37:0/2308068187 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb38011b30 con 0x7fdb44159aa0 2023-10-06T02:28:53.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.941+0000 7fdb491f3700 1 -- 172.21.15.37:0/2308068187 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb44159aa0 msgr2=0x7fdb440c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:53.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.941+0000 7fdb491f3700 1 --2- 172.21.15.37:0/2308068187 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb44159aa0 0x7fdb440c65f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdb380098e0 tx=0x7fdb380091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.941+0000 7fdb491f3700 1 -- 172.21.15.37:0/2308068187 shutdown_connections 2023-10-06T02:28:53.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.941+0000 7fdb491f3700 1 --2- 172.21.15.37:0/2308068187 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb44159aa0 0x7fdb440c65f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.941+0000 7fdb491f3700 1 -- 172.21.15.37:0/2308068187 >> 172.21.15.37:0/2308068187 conn(0x7fdb4406c890 msgr2=0x7fdb440d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:53.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.941+0000 7fdb491f3700 1 -- 172.21.15.37:0/2308068187 shutdown_connections 2023-10-06T02:28:53.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.941+0000 7fdb491f3700 1 -- 172.21.15.37:0/2308068187 wait complete. 2023-10-06T02:28:53.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.942+0000 7fdb491f3700 1 Processor -- start 2023-10-06T02:28:53.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.942+0000 7fdb491f3700 1 -- start start 2023-10-06T02:28:53.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.943+0000 7fdb491f3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb440c6b30 0x7fdb4409b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:53.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.943+0000 7fdb491f3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdb441596d0 0x7fdb4406db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:53.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.943+0000 7fdb491f3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb44159aa0 0x7fdb4415a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:53.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.943+0000 7fdb491f3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4409b3b0 con 0x7fdb44159aa0 2023-10-06T02:28:53.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.943+0000 7fdb491f3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4415c360 con 0x7fdb440c6b30 2023-10-06T02:28:53.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.943+0000 7fdb491f3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4415bac0 con 0x7fdb441596d0 2023-10-06T02:28:53.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.943+0000 7fdb4359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb44159aa0 0x7fdb4415a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:53.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.943+0000 7fdb4359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb44159aa0 0x7fdb4415a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48226/0 (socket says 172.21.15.37:48226) 2023-10-06T02:28:53.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.943+0000 7fdb4359e700 1 -- 172.21.15.37:0/3810887240 learned_addr learned my addr 172.21.15.37:0/3810887240 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:53.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.943+0000 7fdb4259c700 1 --2- 172.21.15.37:0/3810887240 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdb441596d0 0x7fdb4406db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:53.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.943+0000 7fdb42d9d700 1 --2- 172.21.15.37:0/3810887240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb440c6b30 0x7fdb4409b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:53.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.943+0000 7fdb4359e700 1 -- 172.21.15.37:0/3810887240 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdb441596d0 msgr2=0x7fdb4406db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:53.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.943+0000 7fdb4359e700 1 --2- 172.21.15.37:0/3810887240 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdb441596d0 0x7fdb4406db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.943+0000 7fdb4359e700 1 -- 172.21.15.37:0/3810887240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb440c6b30 msgr2=0x7fdb4409b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:53.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.943+0000 7fdb4359e700 1 --2- 172.21.15.37:0/3810887240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb440c6b30 0x7fdb4409b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:53.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.943+0000 7fdb4359e700 1 -- 172.21.15.37:0/3810887240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb38009420 con 0x7fdb44159aa0 2023-10-06T02:28:53.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.943+0000 7fdb4259c700 1 --2- 172.21.15.37:0/3810887240 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdb441596d0 0x7fdb4406db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:53.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.943+0000 7fdb4359e700 1 --2- 172.21.15.37:0/3810887240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb44159aa0 0x7fdb4415a450 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00cc60 tx=0x7fdb3c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:53.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.944+0000 7fdb2affd700 1 -- 172.21.15.37:0/3810887240 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c00ce70 con 0x7fdb44159aa0 2023-10-06T02:28:53.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.944+0000 7fdb2affd700 1 -- 172.21.15.37:0/3810887240 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c00ab70 con 0x7fdb44159aa0 2023-10-06T02:28:53.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.944+0000 7fdb491f3700 1 -- 172.21.15.37:0/3810887240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4415bda0 con 0x7fdb44159aa0 2023-10-06T02:28:53.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.944+0000 7fdb2affd700 1 -- 172.21.15.37:0/3810887240 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c0070f0 con 0x7fdb44159aa0 2023-10-06T02:28:53.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.944+0000 7fdb491f3700 1 -- 172.21.15.37:0/3810887240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb44159f30 con 0x7fdb44159aa0 2023-10-06T02:28:53.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.944+0000 7fdb491f3700 1 -- 172.21.15.37:0/3810887240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb4406fbf0 con 0x7fdb44159aa0 2023-10-06T02:28:53.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.945+0000 7fdb2affd700 1 -- 172.21.15.37:0/3810887240 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb3c0074a0 con 0x7fdb44159aa0 2023-10-06T02:28:53.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.945+0000 7fdb2affd700 1 --2- 172.21.15.37:0/3810887240 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdb30066f30 0x7fdb300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:53.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.945+0000 7fdb2affd700 1 -- 172.21.15.37:0/3810887240 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fdb3c0848e0 con 0x7fdb44159aa0 2023-10-06T02:28:53.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.946+0000 7fdb42d9d700 1 --2- 172.21.15.37:0/3810887240 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdb30066f30 0x7fdb300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:53.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.946+0000 7fdb42d9d700 1 --2- 172.21.15.37:0/3810887240 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdb30066f30 0x7fdb300693e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fdb34003870 tx=0x7fdb34009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:53.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:53.950+0000 7fdb2affd700 1 -- 172.21.15.37:0/3810887240 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb3c051cc0 con 0x7fdb44159aa0 2023-10-06T02:28:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.139+0000 7fdb491f3700 1 -- 172.21.15.37:0/3810887240 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb4415a120 con 0x7fdb30066f30 2023-10-06T02:28:54.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.142+0000 7fdb2affd700 1 -- 172.21.15.37:0/3810887240 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73480 (secure 0 0 0) 0x7fdb4415a120 con 0x7fdb30066f30 2023-10-06T02:28:54.143 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:54.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.144+0000 7fdb491f3700 1 -- 172.21.15.37:0/3810887240 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdb30066f30 msgr2=0x7fdb300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:54.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.144+0000 7fdb491f3700 1 --2- 172.21.15.37:0/3810887240 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdb30066f30 0x7fdb300693e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fdb34003870 tx=0x7fdb34009040 comp rx=0 tx=0).stop 2023-10-06T02:28:54.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.144+0000 7fdb491f3700 1 -- 172.21.15.37:0/3810887240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb44159aa0 msgr2=0x7fdb4415a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:54.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.144+0000 7fdb491f3700 1 --2- 172.21.15.37:0/3810887240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb44159aa0 0x7fdb4415a450 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00cc60 tx=0x7fdb3c001ae0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.144+0000 7fdb491f3700 1 -- 172.21.15.37:0/3810887240 shutdown_connections 2023-10-06T02:28:54.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.144+0000 7fdb491f3700 1 --2- 172.21.15.37:0/3810887240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb44159aa0 0x7fdb4415a450 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.144+0000 7fdb491f3700 1 --2- 172.21.15.37:0/3810887240 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fdb30066f30 0x7fdb300693e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.144+0000 7fdb491f3700 1 --2- 172.21.15.37:0/3810887240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb440c6b30 0x7fdb4409b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.144+0000 7fdb491f3700 1 --2- 172.21.15.37:0/3810887240 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdb441596d0 0x7fdb4406db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.144+0000 7fdb491f3700 1 -- 172.21.15.37:0/3810887240 >> 172.21.15.37:0/3810887240 conn(0x7fdb4406c890 msgr2=0x7fdb440cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:54.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.145+0000 7fdb491f3700 1 -- 172.21.15.37:0/3810887240 shutdown_connections 2023-10-06T02:28:54.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.145+0000 7fdb491f3700 1 -- 172.21.15.37:0/3810887240 wait complete. 2023-10-06T02:28:54.146 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:28:54.157 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2023-10-06T02:28:52.591646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2403000,"kb_used_data":24696,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752571720,"statfs":{"total":773094113280,"available":770633441280,"internally_reserved":0,"allocated":25288704,"data_stored":21221533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390674,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-198,"num_read_kb":-194,"num_write":-171,"num_write_kb":-8290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001317"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.615391+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:28:32.615391+0000","last_peered":"2023-10-06T02:28:32.615391+0000","last_clean":"2023-10-06T02:28:32.615391+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:28:32.615391+0000","last_undegraded":"2023-10-06T02:28:32.615391+0000","last_fullsized":"2023-10-06T02:28:32.615391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":60,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.686979+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:28:32.686979+0000","last_peered":"2023-10-06T02:28:32.686979+0000","last_clean":"2023-10-06T02:28:32.686979+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:28:32.686979+0000","last_undegraded":"2023-10-06T02:28:32.686979+0000","last_fullsized":"2023-10-06T02:28:32.686979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":60,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.681794+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:28:32.681794+0000","last_peered":"2023-10-06T02:28:32.681794+0000","last_clean":"2023-10-06T02:28:32.681794+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:28:32.681794+0000","last_undegraded":"2023-10-06T02:28:32.681794+0000","last_fullsized":"2023-10-06T02:28:32.681794+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":206,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.676792+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:28:32.676792+0000","last_peered":"2023-10-06T02:28:32.676792+0000","last_clean":"2023-10-06T02:28:32.676792+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:28:32.676792+0000","last_undegraded":"2023-10-06T02:28:32.676792+0000","last_fullsized":"2023-10-06T02:28:32.676792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":56,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.676839+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:28:32.676839+0000","last_peered":"2023-10-06T02:28:32.676839+0000","last_clean":"2023-10-06T02:28:32.676839+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:28:32.676839+0000","last_undegraded":"2023-10-06T02:28:32.676839+0000","last_fullsized":"2023-10-06T02:28:32.676839+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":56,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.676910+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:28:32.676910+0000","last_peered":"2023-10-06T02:28:32.676910+0000","last_clean":"2023-10-06T02:28:32.676910+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:28:32.676910+0000","last_undegraded":"2023-10-06T02:28:32.676910+0000","last_fullsized":"2023-10-06T02:28:32.676910+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":67,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.614294+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:28:32.614294+0000","last_peered":"2023-10-06T02:28:32.614294+0000","last_clean":"2023-10-06T02:28:32.614294+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:28:32.614294+0000","last_undegraded":"2023-10-06T02:28:32.614294+0000","last_fullsized":"2023-10-06T02:28:32.614294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":60,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.681662+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:28:32.681662+0000","last_peered":"2023-10-06T02:28:32.681662+0000","last_clean":"2023-10-06T02:28:32.681662+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:28:32.681662+0000","last_undegraded":"2023-10-06T02:28:32.681662+0000","last_fullsized":"2023-10-06T02:28:32.681662+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":60,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T02:28:32.681965+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:28:32.681965+0000","last_peered":"2023-10-06T02:28:32.681965+0000","last_clean":"2023-10-06T02:28:32.681965+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:28:32.681965+0000","last_undegraded":"2023-10-06T02:28:32.681965+0000","last_fullsized":"2023-10-06T02:28:32.681965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298764,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073076,"statfs":{"total":96636764160,"available":96330829824,"internally_reserved":0,"allocated":1511424,"data_stored":1002047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.376,"5min":0.311,"15min":0.311},"max":{"1min":0.66800000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.372},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57199999999999995,"15min":0.55100000000000005},"min":{"1min":0.37,"5min":0.314,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.52400000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56299999999999994,"15min":0.54300000000000004},"min":{"1min":0.41699999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68799999999999994,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.436}]},{"osd":2,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56999999999999995,"15min":0.55500000000000005},"min":{"1min":0.42999999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78300000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57699999999999996,"15min":0.55600000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79900000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.44800000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.71399999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.56499999999999995},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.48499999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48299999999999998,"15min":0.499},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65300000000000002,"5min":1.014,"15min":1.014},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.36299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.63400000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.50700000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.503,"15min":0.51400000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66700000000000004,"5min":0.747,"15min":0.747},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.38800000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56699999999999995,"15min":0.58399999999999996},"min":{"1min":0.38400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76700000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.497},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56799999999999995,"15min":0.58999999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302288,"kb_used_data":5000,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069552,"statfs":{"total":96636764160,"available":96327221248,"internally_reserved":0,"allocated":5120000,"data_stored":4607503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59899999999999998,"15min":0.72099999999999997},"min":{"1min":0.33600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.71299999999999997,"5min":5.859,"15min":5.859},"last":0.503},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.38800000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82799999999999996,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.317}]},{"osd":1,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.52300000000000002},"min":{"1min":0.35699999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.879,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56499999999999995,"15min":0.53900000000000003},"min":{"1min":0.42099999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81299999999999994,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.434}]},{"osd":2,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.38700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85599999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58499999999999996,"15min":0.55500000000000005},"min":{"1min":0.40600000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84299999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.47299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.33600000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67000000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.41099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.68999999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.42899999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70399999999999996,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.41199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.54100000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.58199999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.59599999999999997,"15min":0.60499999999999998},"min":{"1min":0.49099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79700000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.59499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302856,"kb_used_data":5568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94068984,"statfs":{"total":96636764160,"available":96326639616,"internally_reserved":0,"allocated":5701632,"data_stored":5189852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35699999999999998,"15min":0.376},"min":{"1min":0.23100000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.502,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.46400000000000002,"15min":0.64800000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.55800000000000005,"5min":7.6900000000000004,"15min":7.6900000000000004},"last":0.35399999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.42399999999999999,"15min":0.60499999999999998},"min":{"1min":0.248,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48899999999999999,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.48899999999999999,"15min":0.67800000000000005},"min":{"1min":0.32800000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.60199999999999998,"5min":7.758,"15min":7.758},"last":0.30099999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.51600000000000001,"15min":0.70399999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59399999999999997,"5min":7.7869999999999999,"15min":7.7869999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.27600000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57999999999999996,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.73099999999999998,"15min":1.0309999999999999},"min":{"1min":0.41699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88700000000000001,"5min":11.678000000000001,"15min":11.678000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.68999999999999995,"15min":0.88},"min":{"1min":0.443,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77200000000000002,"5min":7.6529999999999996,"15min":7.6529999999999996},"last":0.50700000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66700000000000004,"15min":0.67100000000000004},"min":{"1min":0.46000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81399999999999995,"5min":1.399,"15min":1.399},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.73099999999999998,"15min":0.91400000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.81699999999999995,"5min":7.508,"15min":7.508},"last":0.495}]},{"osd":6,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.70699999999999996,"15min":0.89100000000000001},"min":{"1min":0.47399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82899999999999996,"5min":7.7270000000000003,"15min":7.7270000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.65900000000000003,"15min":0.68300000000000005},"min":{"1min":0.45700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.75600000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.55100000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67900000000000005,"15min":0.69099999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85299999999999998,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.75700000000000001,"15min":0.93700000000000006},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.82999999999999996,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.57799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302264,"kb_used_data":4976,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069576,"statfs":{"total":96636764160,"available":96327245824,"internally_reserved":0,"allocated":5095424,"data_stored":4598021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.34799999999999998},"min":{"1min":0.23300000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.38900000000000001,"15min":0.36799999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.36899999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39900000000000002,"15min":0.38900000000000001},"min":{"1min":0.29399999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52200000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42199999999999999,"15min":0.41499999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.624,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.40899999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.371,"15min":0.35599999999999998},"min":{"1min":0.26000000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.53300000000000003,"5min":0.622,"15min":0.622},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.42499999999999999,"15min":0.40100000000000002},"min":{"1min":0.30199999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.315}]},{"osd":4,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.46899999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83999999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.85399999999999998,"5min":1.008,"15min":1.008},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77900000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.40600000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77400000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64700000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84399999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.439,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":1,"15min":1},"last":0.53900000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81100000000000005,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86099999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.67000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302276,"kb_used_data":4988,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94069564,"statfs":{"total":96636764160,"available":96327233536,"internally_reserved":0,"allocated":5107712,"data_stored":4600081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.34000000000000002},"min":{"1min":0.25700000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.53000000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38200000000000001},"min":{"1min":0.26600000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.55200000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.34599999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.36099999999999999,"15min":0.35099999999999998},"min":{"1min":0.27400000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46000000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40999999999999998,"15min":0.40200000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.40500000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.42799999999999999,"15min":0.41199999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54600000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42699999999999999,"15min":0.42999999999999999},"min":{"1min":0.32900000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.53900000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.36099999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61299999999999999,"15min":0.60399999999999998},"min":{"1min":0.46300000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92800000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.46400000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82999999999999996,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93899999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.499},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.63},"min":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.84299999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.63}]},{"osd":6,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.46100000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95699999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.47699999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.56299999999999994}]},{"osd":7,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65900000000000003,"15min":0.67100000000000004},"min":{"1min":0.44900000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83999999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47899999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.91900000000000004,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.61399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":410863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.44500000000000001,"15min":0.66300000000000003},"min":{"1min":0.24299999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.55900000000000005,"5min":10.164999999999999,"15min":10.164999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.39200000000000002,"15min":0.40600000000000003},"min":{"1min":0.25,"5min":0.224,"15min":0.224},"max":{"1min":0.46500000000000002,"5min":1.266,"15min":1.266},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.28000000000000003,"5min":0.191,"15min":0.191},"max":{"1min":0.68400000000000005,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42299999999999999,"15min":0.42999999999999999},"min":{"1min":0.249,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.77800000000000002,"5min":1.319,"15min":1.319},"last":0.373}]},{"osd":2,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44,"15min":0.44},"min":{"1min":0.28100000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.93500000000000005,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.46600000000000003,"15min":0.48399999999999999},"min":{"1min":0.30599999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58799999999999997,"5min":1.5,"15min":1.5},"last":0.496}]},{"osd":4,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.621,"15min":0.627},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77000000000000002,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85899999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63600000000000001,"15min":0.65400000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84299999999999997,"5min":1.538,"15min":1.538},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63700000000000001,"15min":0.63800000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79900000000000004,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.70499999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.44,"5min":0.38,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":1.111,"15min":1.111},"last":0.872},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66800000000000004,"15min":0.68300000000000005},"min":{"1min":0.45700000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.875,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.72899999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65100000000000002,"15min":0.65000000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81899999999999995,"5min":1.21,"15min":1.21},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.63700000000000001,"15min":0.64700000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80400000000000005,"5min":1.135,"15min":1.135},"last":0.82999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298188,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073652,"statfs":{"total":96636764160,"available":96331419648,"internally_reserved":0,"allocated":921600,"data_stored":408057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.52000000000000002},"min":{"1min":0.40100000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.628,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54700000000000004,"15min":0.51500000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73999999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.41599999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54100000000000004,"15min":0.504},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.71299999999999997,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68899999999999995,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.51600000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.57699999999999996},"min":{"1min":0.48399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69499999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.58599999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77100000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.372,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73499999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.44,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76200000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56100000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.499,"15min":0.49099999999999999},"min":{"1min":0.35399999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68700000000000006,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.41899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72799999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.39200000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69999999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71599999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.624}]},{"osd":7,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.42899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80500000000000005,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.45700000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.79800000000000004,"5min":1.04,"15min":1.04},"last":0.69699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":913408,"data_stored":405109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.501},"min":{"1min":0.377,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66000000000000003,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52800000000000002,"15min":0.496},"min":{"1min":0.30299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.501}]},{"osd":1,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53400000000000003,"15min":0.498},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66700000000000004,"5min":0.755,"15min":0.755},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52900000000000003,"15min":0.503},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58499999999999996,"15min":0.56299999999999994},"min":{"1min":0.43099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76400000000000001,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59899999999999998,"15min":0.57699999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79600000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54200000000000004,"15min":0.51800000000000002},"min":{"1min":0.34699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":0.745,"15min":0.745},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.55100000000000005},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47999999999999998,"15min":0.48999999999999999},"min":{"1min":0.32600000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.71299999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50700000000000001,"15min":0.51800000000000002},"min":{"1min":0.38,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76100000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.627}]},{"osd":6,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.34999999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.74299999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78000000000000003,"5min":0.873,"15min":0.873},"last":0.57399999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53800000000000003,"15min":0.56100000000000005},"min":{"1min":0.38100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67900000000000005,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56499999999999995,"15min":0.59899999999999998},"min":{"1min":0.41399999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72999999999999998,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:28:54.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:28:54.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.278+0000 7f4609112700 1 Processor -- start 2023-10-06T02:28:54.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.278+0000 7f4609112700 1 -- start start 2023-10-06T02:28:54.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.279+0000 7f4609112700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4604157500 0x7f46040b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:54.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.279+0000 7f4609112700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f460415b6d0 0x7f460406c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:54.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.279+0000 7f4609112700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f460406b040 con 0x7f4604157130 2023-10-06T02:28:54.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.279+0000 7f4609112700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460406a780 con 0x7f460415b6d0 2023-10-06T02:28:54.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.279+0000 7f4609112700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460406a9f0 con 0x7f4604157500 2023-10-06T02:28:54.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.279+0000 7f460359e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f460415b6d0 0x7f460406c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:54.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.279+0000 7f4602d9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4604157130 0x7f460415afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44804/0 (socket says 172.21.15.37:44804) 2023-10-06T02:28:54.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.279+0000 7f4602d9d700 1 -- 172.21.15.37:0/3494727771 learned_addr learned my addr 172.21.15.37:0/3494727771 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:54.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.279+0000 7f45fbfff700 1 --2- 172.21.15.37:0/3494727771 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4604157500 0x7f46040b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:54.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.279+0000 7f460359e700 1 -- 172.21.15.37:0/3494727771 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4604157500 msgr2=0x7f46040b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:54.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.279+0000 7f460359e700 1 --2- 172.21.15.37:0/3494727771 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4604157500 0x7f46040b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.279+0000 7f460359e700 1 -- 172.21.15.37:0/3494727771 >> v1:172.21.15.37:6789/0 conn(0x7f4604157130 legacy=0x7f460415afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:54.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.279+0000 7f460359e700 1 -- 172.21.15.37:0/3494727771 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460406acd0 con 0x7f460415b6d0 2023-10-06T02:28:54.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.279+0000 7f460259c700 1 -- 172.21.15.37:0/3494727771 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 572020759 0 0) 0x7f460406b040 con 0x7f4604157130 2023-10-06T02:28:54.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.279+0000 7f45fbfff700 1 --2- 172.21.15.37:0/3494727771 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4604157500 0x7f46040b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:54.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.280+0000 7f460359e700 1 --2- 172.21.15.37:0/3494727771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f460415b6d0 0x7f460406c0b0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009e60 tx=0x7f45fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb7449c0917006f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:54.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.280+0000 7f460259c700 1 -- 172.21.15.37:0/3494727771 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc00e070 con 0x7f460415b6d0 2023-10-06T02:28:54.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.280+0000 7f460259c700 1 -- 172.21.15.37:0/3494727771 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc00bc30 con 0x7f460415b6d0 2023-10-06T02:28:54.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.280+0000 7f460259c700 1 -- 172.21.15.37:0/3494727771 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc012430 con 0x7f460415b6d0 2023-10-06T02:28:54.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.280+0000 7f4609112700 1 -- 172.21.15.37:0/3494727771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f460415b6d0 msgr2=0x7f460406c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:54.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.280+0000 7f4609112700 1 --2- 172.21.15.37:0/3494727771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f460415b6d0 0x7f460406c0b0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009e60 tx=0x7f45fc009780 comp rx=0 tx=0).stop 2023-10-06T02:28:54.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.280+0000 7f4609112700 1 -- 172.21.15.37:0/3494727771 shutdown_connections 2023-10-06T02:28:54.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.280+0000 7f4609112700 1 --2- 172.21.15.37:0/3494727771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f460415b6d0 0x7f460406c0b0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.280+0000 7f4609112700 1 --2- 172.21.15.37:0/3494727771 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4604157500 0x7f46040b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.280+0000 7f4609112700 1 -- 172.21.15.37:0/3494727771 >> 172.21.15.37:0/3494727771 conn(0x7f46040cd490 msgr2=0x7f46040c9430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:54.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.280+0000 7f4609112700 1 -- 172.21.15.37:0/3494727771 shutdown_connections 2023-10-06T02:28:54.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.280+0000 7f4609112700 1 -- 172.21.15.37:0/3494727771 wait complete. 2023-10-06T02:28:54.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.281+0000 7f4609112700 1 Processor -- start 2023-10-06T02:28:54.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.281+0000 7f4609112700 1 -- start start 2023-10-06T02:28:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.282+0000 7f4609112700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4604157130 0x7f4604167b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.282+0000 7f4609112700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4604157500 0x7f460414def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.282+0000 7f4609112700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f460415b6d0 0x7f4604168d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.282+0000 7f4609112700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460414f2b0 con 0x7f4604157500 2023-10-06T02:28:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.282+0000 7f4609112700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46041681b0 con 0x7f460415b6d0 2023-10-06T02:28:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.282+0000 7f4609112700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4604168490 con 0x7f4604157130 2023-10-06T02:28:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.282+0000 7f45fbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4604157500 0x7f460414def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.282+0000 7f45fbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4604157500 0x7f460414def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48256/0 (socket says 172.21.15.37:48256) 2023-10-06T02:28:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.282+0000 7f45fbfff700 1 -- 172.21.15.37:0/265363122 learned_addr learned my addr 172.21.15.37:0/265363122 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.282+0000 7f460359e700 1 --2- 172.21.15.37:0/265363122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f460415b6d0 0x7f4604168d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:54.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.282+0000 7f4602d9d700 1 --2- 172.21.15.37:0/265363122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4604157130 0x7f4604167b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:54.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.282+0000 7f45fbfff700 1 -- 172.21.15.37:0/265363122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4604157130 msgr2=0x7f4604167b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:54.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.282+0000 7f45fbfff700 1 --2- 172.21.15.37:0/265363122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4604157130 0x7f4604167b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.282+0000 7f45fbfff700 1 -- 172.21.15.37:0/265363122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f460415b6d0 msgr2=0x7f4604168d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:54.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.283+0000 7f45fbfff700 1 --2- 172.21.15.37:0/265363122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f460415b6d0 0x7f4604168d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.283+0000 7f45fbfff700 1 -- 172.21.15.37:0/265363122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc009a20 con 0x7f4604157500 2023-10-06T02:28:54.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.283+0000 7f460359e700 1 --2- 172.21.15.37:0/265363122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f460415b6d0 0x7f4604168d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:54.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.283+0000 7f45fbfff700 1 --2- 172.21.15.37:0/265363122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4604157500 0x7f460414def0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00e8d0 tx=0x7f45ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:54.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.283+0000 7f45faffd700 1 -- 172.21.15.37:0/265363122 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec013410 con 0x7f4604157500 2023-10-06T02:28:54.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.283+0000 7f45faffd700 1 -- 172.21.15.37:0/265363122 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec013570 con 0x7f4604157500 2023-10-06T02:28:54.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.283+0000 7f4609112700 1 -- 172.21.15.37:0/265363122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4604168770 con 0x7f4604157500 2023-10-06T02:28:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.283+0000 7f45faffd700 1 -- 172.21.15.37:0/265363122 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec013910 con 0x7f4604157500 2023-10-06T02:28:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.283+0000 7f4609112700 1 -- 172.21.15.37:0/265363122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460414e430 con 0x7f4604157500 2023-10-06T02:28:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.284+0000 7f4609112700 1 -- 172.21.15.37:0/265363122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f460414f4d0 con 0x7f4604157500 2023-10-06T02:28:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.284+0000 7f45faffd700 1 -- 172.21.15.37:0/265363122 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f45ec013d00 con 0x7f4604157500 2023-10-06T02:28:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.285+0000 7f45faffd700 1 --2- 172.21.15.37:0/265363122 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f45e4066f30 0x7f45e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.285+0000 7f45faffd700 1 -- 172.21.15.37:0/265363122 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f45ec0841b0 con 0x7f4604157500 2023-10-06T02:28:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.285+0000 7f4602d9d700 1 --2- 172.21.15.37:0/265363122 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f45e4066f30 0x7f45e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.285+0000 7f4602d9d700 1 --2- 172.21.15.37:0/265363122 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f45e4066f30 0x7f45e40693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f460414dc40 tx=0x7f45f4007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:54.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.289+0000 7f45faffd700 1 -- 172.21.15.37:0/265363122 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f460414f4d0 con 0x7f4604157500 2023-10-06T02:28:54.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.486+0000 7f4609112700 1 -- 172.21.15.37:0/265363122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f460414f4d0 con 0x7f4604157500 2023-10-06T02:28:54.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.487+0000 7f45faffd700 1 -- 172.21.15.37:0/265363122 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+14042 (secure 0 0 0) 0x7f460414f4d0 con 0x7f4604157500 2023-10-06T02:28:54.488 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:54.488 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":77,"fsid":"d1f292a2-fd8c-430a-be88-f44de408e77c","created":"2023-10-06T02:22:56.856509+0000","modified":"2023-10-06T02:28:51.185416+0000","last_up_change":"2023-10-06T02:23:07.658112+0000","last_in_change":"2023-10-06T02:22:59.280396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T02:23:08.066048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T02:23:08.561964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"0aa502f4-2695-4923-81ba-2f763421893c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":90621},{"type":"v1","addr":"172.21.15.37:6818","nonce":90621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":90621},{"type":"v1","addr":"172.21.15.37:6822","nonce":90621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":90621},{"type":"v1","addr":"172.21.15.37:6829","nonce":90621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6823","nonce":90621},{"type":"v1","addr":"172.21.15.37:6825","nonce":90621}]},"public_addr":"172.21.15.37:6818/90621","cluster_addr":"172.21.15.37:6822/90621","heartbeat_back_addr":"172.21.15.37:6829/90621","heartbeat_front_addr":"172.21.15.37:6825/90621","state":["exists","up"]},{"osd":1,"uuid":"51351ef0-12c1-4d13-8839-eebdd005de0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":90617},{"type":"v1","addr":"172.21.15.37:6809","nonce":90617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":90617},{"type":"v1","addr":"172.21.15.37:6811","nonce":90617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":90617},{"type":"v1","addr":"172.21.15.37:6815","nonce":90617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":90617},{"type":"v1","addr":"172.21.15.37:6813","nonce":90617}]},"public_addr":"172.21.15.37:6809/90617","cluster_addr":"172.21.15.37:6811/90617","heartbeat_back_addr":"172.21.15.37:6815/90617","heartbeat_front_addr":"172.21.15.37:6813/90617","state":["exists","up"]},{"osd":2,"uuid":"695ca0a7-3663-4c6e-8059-0995bbb3d7d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":90611},{"type":"v1","addr":"172.21.15.37:6801","nonce":90611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":90611},{"type":"v1","addr":"172.21.15.37:6803","nonce":90611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":90611},{"type":"v1","addr":"172.21.15.37:6807","nonce":90611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":90611},{"type":"v1","addr":"172.21.15.37:6805","nonce":90611}]},"public_addr":"172.21.15.37:6801/90611","cluster_addr":"172.21.15.37:6803/90611","heartbeat_back_addr":"172.21.15.37:6807/90611","heartbeat_front_addr":"172.21.15.37:6805/90611","state":["exists","up"]},{"osd":3,"uuid":"842b08b2-065f-40f4-a235-4552b31e3bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6817","nonce":90628},{"type":"v1","addr":"172.21.15.37:6819","nonce":90628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":90628},{"type":"v1","addr":"172.21.15.37:6824","nonce":90628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":90628},{"type":"v1","addr":"172.21.15.37:6831","nonce":90628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":90628},{"type":"v1","addr":"172.21.15.37:6828","nonce":90628}]},"public_addr":"172.21.15.37:6819/90628","cluster_addr":"172.21.15.37:6824/90628","heartbeat_back_addr":"172.21.15.37:6831/90628","heartbeat_front_addr":"172.21.15.37:6828/90628","state":["exists","up"]},{"osd":4,"uuid":"6ffea2c6-af6b-47e7-a454-0d72f00c54ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":90852},{"type":"v1","addr":"172.21.15.191:6801","nonce":90852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":90852},{"type":"v1","addr":"172.21.15.191:6803","nonce":90852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":90852},{"type":"v1","addr":"172.21.15.191:6807","nonce":90852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":90852},{"type":"v1","addr":"172.21.15.191:6805","nonce":90852}]},"public_addr":"172.21.15.191:6801/90852","cluster_addr":"172.21.15.191:6803/90852","heartbeat_back_addr":"172.21.15.191:6807/90852","heartbeat_front_addr":"172.21.15.191:6805/90852","state":["exists","up"]},{"osd":5,"uuid":"21e7e274-891d-4316-84bc-28ff01d9957d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":90853},{"type":"v1","addr":"172.21.15.191:6809","nonce":90853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":90853},{"type":"v1","addr":"172.21.15.191:6811","nonce":90853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":90853},{"type":"v1","addr":"172.21.15.191:6818","nonce":90853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":90853},{"type":"v1","addr":"172.21.15.191:6814","nonce":90853}]},"public_addr":"172.21.15.191:6809/90853","cluster_addr":"172.21.15.191:6811/90853","heartbeat_back_addr":"172.21.15.191:6818/90853","heartbeat_front_addr":"172.21.15.191:6814/90853","state":["exists","up"]},{"osd":6,"uuid":"0a10ba9a-6c76-4dfb-8697-775b2f8b426d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":90897},{"type":"v1","addr":"172.21.15.191:6825","nonce":90897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":90897},{"type":"v1","addr":"172.21.15.191:6827","nonce":90897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":90897},{"type":"v1","addr":"172.21.15.191:6831","nonce":90897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":90897},{"type":"v1","addr":"172.21.15.191:6829","nonce":90897}]},"public_addr":"172.21.15.191:6825/90897","cluster_addr":"172.21.15.191:6827/90897","heartbeat_back_addr":"172.21.15.191:6831/90897","heartbeat_front_addr":"172.21.15.191:6829/90897","state":["exists","up"]},{"osd":7,"uuid":"520bfada-3175-43ed-aeb3-f7ecf1a98cd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":90854},{"type":"v1","addr":"172.21.15.191:6815","nonce":90854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":90854},{"type":"v1","addr":"172.21.15.191:6819","nonce":90854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":90854},{"type":"v1","addr":"172.21.15.191:6823","nonce":90854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":90854},{"type":"v1","addr":"172.21.15.191:6821","nonce":90854}]},"public_addr":"172.21.15.191:6815/90854","cluster_addr":"172.21.15.191:6819/90854","heartbeat_back_addr":"172.21.15.191:6823/90854","heartbeat_front_addr":"172.21.15.191:6821/90854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.441851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.395958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.412715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.410221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.425733+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.138153+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.433234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:23:04.458163+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6834/1787333914":"2023-10-07T02:28:48.169902+0000","172.21.15.37:6832/1787333914":"2023-10-07T02:28:48.169902+0000","172.21.15.37:6834/4246185831":"2023-10-07T02:28:32.607211+0000","172.21.15.37:6832/4246185831":"2023-10-07T02:28:32.607211+0000","172.21.15.191:6837/2764715102":"2023-10-07T02:28:14.483678+0000","172.21.15.191:6834/2764715102":"2023-10-07T02:28:14.483678+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:28:54.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.489+0000 7f4609112700 1 -- 172.21.15.37:0/265363122 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f45e4066f30 msgr2=0x7f45e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:54.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.489+0000 7f4609112700 1 --2- 172.21.15.37:0/265363122 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f45e4066f30 0x7f45e40693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f460414dc40 tx=0x7f45f4007d30 comp rx=0 tx=0).stop 2023-10-06T02:28:54.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.489+0000 7f4609112700 1 -- 172.21.15.37:0/265363122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4604157500 msgr2=0x7f460414def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:54.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.489+0000 7f4609112700 1 --2- 172.21.15.37:0/265363122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4604157500 0x7f460414def0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00e8d0 tx=0x7f45ec008040 comp rx=0 tx=0).stop 2023-10-06T02:28:54.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.490+0000 7f4609112700 1 -- 172.21.15.37:0/265363122 shutdown_connections 2023-10-06T02:28:54.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.490+0000 7f4609112700 1 --2- 172.21.15.37:0/265363122 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f45e4066f30 0x7f45e40693e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.490+0000 7f4609112700 1 --2- 172.21.15.37:0/265363122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f460415b6d0 0x7f4604168d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.490+0000 7f4609112700 1 --2- 172.21.15.37:0/265363122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4604157130 0x7f4604167b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.490+0000 7f4609112700 1 --2- 172.21.15.37:0/265363122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4604157500 0x7f460414def0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:54.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.490+0000 7f4609112700 1 -- 172.21.15.37:0/265363122 >> 172.21.15.37:0/265363122 conn(0x7f46040cd490 msgr2=0x7f4604069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:54.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.490+0000 7f4609112700 1 -- 172.21.15.37:0/265363122 shutdown_connections 2023-10-06T02:28:54.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:54.490+0000 7f4609112700 1 -- 172.21.15.37:0/265363122 wait complete. 2023-10-06T02:28:55.503 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T02:28:55.504 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:28:55.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.640+0000 7f2753dd3700 1 Processor -- start 2023-10-06T02:28:55.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.640+0000 7f2753dd3700 1 -- start start 2023-10-06T02:28:55.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.641+0000 7f2753dd3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f274c1599c0 0x7f274c06d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.641+0000 7f2753dd3700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f274c06dd70 0x7f274c0cb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.641+0000 7f2753dd3700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274c06e1b0 con 0x7f274c1595f0 2023-10-06T02:28:55.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.641+0000 7f2753dd3700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274c0cb320 con 0x7f274c06dd70 2023-10-06T02:28:55.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.641+0000 7f2753dd3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c0b5d40 con 0x7f274c1599c0 2023-10-06T02:28:55.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.641+0000 7f2752370700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f274c06dd70 0x7f274c0cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.641+0000 7f2752370700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f274c06dd70 0x7f274c0cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47004/0 (socket says 172.21.15.37:47004) 2023-10-06T02:28:55.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.641+0000 7f2752370700 1 -- 172.21.15.37:0/3698692700 learned_addr learned my addr 172.21.15.37:0/3698692700 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:55.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.641+0000 7f275136e700 1 --2- 172.21.15.37:0/3698692700 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f274c1599c0 0x7f274c06d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.641+0000 7f2752370700 1 -- 172.21.15.37:0/3698692700 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f274c1599c0 msgr2=0x7f274c06d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:55.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.641+0000 7f2752370700 1 --2- 172.21.15.37:0/3698692700 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f274c1599c0 0x7f274c06d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.641+0000 7f2752370700 1 -- 172.21.15.37:0/3698692700 >> v1:172.21.15.191:6789/0 conn(0x7f274c1595f0 legacy=0x7f274c0b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:55.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.641+0000 7f2752370700 1 -- 172.21.15.37:0/3698692700 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c15d710 con 0x7f274c06dd70 2023-10-06T02:28:55.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.642+0000 7f2752370700 1 --2- 172.21.15.37:0/3698692700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f274c06dd70 0x7f274c0cb740 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f2744009f20 tx=0x7f2744009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff13da06e47c3f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:55.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.642+0000 7f2750b6d700 1 -- 172.21.15.37:0/3698692700 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274400e070 con 0x7f274c06dd70 2023-10-06T02:28:55.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.642+0000 7f2750b6d700 1 -- 172.21.15.37:0/3698692700 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274400ba40 con 0x7f274c06dd70 2023-10-06T02:28:55.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.642+0000 7f2750b6d700 1 -- 172.21.15.37:0/3698692700 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27440092e0 con 0x7f274c06dd70 2023-10-06T02:28:55.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.642+0000 7f2753dd3700 1 -- 172.21.15.37:0/3698692700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f274c06dd70 msgr2=0x7f274c0cb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.642+0000 7f2753dd3700 1 --2- 172.21.15.37:0/3698692700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f274c06dd70 0x7f274c0cb740 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f2744009f20 tx=0x7f2744009840 comp rx=0 tx=0).stop 2023-10-06T02:28:55.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.642+0000 7f2753dd3700 1 -- 172.21.15.37:0/3698692700 shutdown_connections 2023-10-06T02:28:55.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.642+0000 7f2753dd3700 1 --2- 172.21.15.37:0/3698692700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f274c06dd70 0x7f274c0cb740 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.642+0000 7f2753dd3700 1 --2- 172.21.15.37:0/3698692700 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f274c1599c0 0x7f274c06d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.642+0000 7f2753dd3700 1 -- 172.21.15.37:0/3698692700 >> 172.21.15.37:0/3698692700 conn(0x7f274c0ccf90 msgr2=0x7f274c0cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:55.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.642+0000 7f2753dd3700 1 -- 172.21.15.37:0/3698692700 shutdown_connections 2023-10-06T02:28:55.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.642+0000 7f2753dd3700 1 -- 172.21.15.37:0/3698692700 wait complete. 2023-10-06T02:28:55.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.643+0000 7f2753dd3700 1 Processor -- start 2023-10-06T02:28:55.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.643+0000 7f2753dd3700 1 -- start start 2023-10-06T02:28:55.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.644+0000 7f2753dd3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f274c06dd70 0x7f274c155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.644+0000 7f2753dd3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f274c1595f0 0x7f274c0c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.644+0000 7f2753dd3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f274c1599c0 0x7f274c0ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.644+0000 7f2753dd3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c0ca870 con 0x7f274c1599c0 2023-10-06T02:28:55.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.644+0000 7f2753dd3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c0b1010 con 0x7f274c06dd70 2023-10-06T02:28:55.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.644+0000 7f2753dd3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c15af90 con 0x7f274c1595f0 2023-10-06T02:28:55.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.644+0000 7f2752370700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f274c1599c0 0x7f274c0ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.644+0000 7f2752370700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f274c1599c0 0x7f274c0ca210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47006/0 (socket says 172.21.15.37:47006) 2023-10-06T02:28:55.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.644+0000 7f2752370700 1 -- 172.21.15.37:0/2660892868 learned_addr learned my addr 172.21.15.37:0/2660892868 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:55.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.644+0000 7f275136e700 1 --2- 172.21.15.37:0/2660892868 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f274c1595f0 0x7f274c0c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.644+0000 7f2751b6f700 1 --2- 172.21.15.37:0/2660892868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f274c06dd70 0x7f274c155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.645+0000 7f2752370700 1 -- 172.21.15.37:0/2660892868 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f274c1595f0 msgr2=0x7f274c0c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.645+0000 7f2752370700 1 --2- 172.21.15.37:0/2660892868 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f274c1595f0 0x7f274c0c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.645+0000 7f2752370700 1 -- 172.21.15.37:0/2660892868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f274c06dd70 msgr2=0x7f274c155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.645+0000 7f2752370700 1 --2- 172.21.15.37:0/2660892868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f274c06dd70 0x7f274c155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.645+0000 7f2752370700 1 -- 172.21.15.37:0/2660892868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2744009ae0 con 0x7f274c1599c0 2023-10-06T02:28:55.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.645+0000 7f2752370700 1 --2- 172.21.15.37:0/2660892868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f274c1599c0 0x7f274c0ca210 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f274c06e340 tx=0x7f2744017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:55.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.645+0000 7f273dffb700 1 -- 172.21.15.37:0/2660892868 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27440032f0 con 0x7f274c1599c0 2023-10-06T02:28:55.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.645+0000 7f273dffb700 1 -- 172.21.15.37:0/2660892868 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2744012d00 con 0x7f274c1599c0 2023-10-06T02:28:55.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.645+0000 7f2753dd3700 1 -- 172.21.15.37:0/2660892868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274c16a1e0 con 0x7f274c1599c0 2023-10-06T02:28:55.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.645+0000 7f273dffb700 1 -- 172.21.15.37:0/2660892868 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274401d670 con 0x7f274c1599c0 2023-10-06T02:28:55.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.645+0000 7f2753dd3700 1 -- 172.21.15.37:0/2660892868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274c16a7a0 con 0x7f274c1599c0 2023-10-06T02:28:55.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.646+0000 7f2753dd3700 1 -- 172.21.15.37:0/2660892868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f274c088b10 con 0x7f274c1599c0 2023-10-06T02:28:55.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.647+0000 7f273dffb700 1 -- 172.21.15.37:0/2660892868 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f274401da60 con 0x7f274c1599c0 2023-10-06T02:28:55.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.647+0000 7f273dffb700 1 --2- 172.21.15.37:0/2660892868 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2730066f30 0x7f27300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.647+0000 7f273dffb700 1 -- 172.21.15.37:0/2660892868 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2744085bf0 con 0x7f274c1599c0 2023-10-06T02:28:55.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.647+0000 7f273dffb700 1 --2- 172.21.15.37:0/2660892868 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x7f273006d4e0 0x7f273006f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.647+0000 7f273dffb700 1 -- 172.21.15.37:0/2660892868 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f273006ffa0 con 0x7f273006d4e0 2023-10-06T02:28:55.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.647+0000 7f273dffb700 1 -- 172.21.15.37:0/2660892868 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2744088230 con 0x7f274c1599c0 2023-10-06T02:28:55.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.647+0000 7f2751b6f700 1 --2- 172.21.15.37:0/2660892868 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2730066f30 0x7f27300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.647+0000 7f275136e700 1 --2- 172.21.15.37:0/2660892868 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x7f273006d4e0 0x7f273006f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.648+0000 7f275136e700 1 --2- 172.21.15.37:0/2660892868 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x7f273006d4e0 0x7f273006f8f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:55.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.648+0000 7f2751b6f700 1 --2- 172.21.15.37:0/2660892868 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2730066f30 0x7f27300693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2748003a30 tx=0x7f2748007ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:55.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.648+0000 7f273dffb700 1 -- 172.21.15.37:0/2660892868 <== osd.0 v2:172.21.15.37:6816/90621 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f273006ffa0 con 0x7f273006d4e0 2023-10-06T02:28:55.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.662+0000 7f2753dd3700 1 -- 172.21.15.37:0/2660892868 --> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f274c15d9f0 con 0x7f273006d4e0 2023-10-06T02:28:55.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.662+0000 7f273dffb700 1 -- 172.21.15.37:0/2660892868 <== osd.0 v2:172.21.15.37:6816/90621 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f274c15d9f0 con 0x7f273006d4e0 2023-10-06T02:28:55.663 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:28:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T02:28:55.665 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:28:55.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.663+0000 7f2753dd3700 1 -- 172.21.15.37:0/2660892868 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x7f273006d4e0 msgr2=0x7f273006f8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.663+0000 7f2753dd3700 1 --2- 172.21.15.37:0/2660892868 >> [v2:172.21.15.37:6816/90621,v1:172.21.15.37:6818/90621] conn(0x7f273006d4e0 0x7f273006f8f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.663+0000 7f2753dd3700 1 -- 172.21.15.37:0/2660892868 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2730066f30 msgr2=0x7f27300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.663+0000 7f2753dd3700 1 --2- 172.21.15.37:0/2660892868 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f2730066f30 0x7f27300693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2748003a30 tx=0x7f2748007ea0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.663+0000 7f2753dd3700 1 -- 172.21.15.37:0/2660892868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f274c1599c0 msgr2=0x7f274c0ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.663+0000 7f2753dd3700 1 --2- 172.21.15.37:0/2660892868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f274c1599c0 0x7f274c0ca210 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f274c06e340 tx=0x7f2744017000 comp rx=0 tx=0).stop 2023-10-06T02:28:55.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.663+0000 7f2752370700 1 -- 172.21.15.37:0/2660892868 reap_dead start 2023-10-06T02:28:55.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.663+0000 7f2753dd3700 1 -- 172.21.15.37:0/2660892868 shutdown_connections 2023-10-06T02:28:55.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.663+0000 7f2753dd3700 1 -- 172.21.15.37:0/2660892868 >> 172.21.15.37:0/2660892868 conn(0x7f274c0ccf90 msgr2=0x7f274c1570d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:55.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.663+0000 7f2753dd3700 1 -- 172.21.15.37:0/2660892868 shutdown_connections 2023-10-06T02:28:55.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.663+0000 7f2753dd3700 1 -- 172.21.15.37:0/2660892868 wait complete. 2023-10-06T02:28:55.675 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T02:28:55.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.794+0000 7f3309482700 1 Processor -- start 2023-10-06T02:28:55.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.794+0000 7f3309482700 1 -- start start 2023-10-06T02:28:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.795+0000 7f3309482700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f33040b29b0 0x7f330406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.795+0000 7f3309482700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3304158fb0 0x7f3304159450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.795+0000 7f3309482700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33040cbe60 con 0x7f330406d870 2023-10-06T02:28:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.795+0000 7f3309482700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33040cb250 con 0x7f3304158fb0 2023-10-06T02:28:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.795+0000 7f3309482700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33040cb530 con 0x7f33040b29b0 2023-10-06T02:28:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.795+0000 7f3308c81700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3304158fb0 0x7f3304159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.795+0000 7f3303fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f330406d870 0x7f33040b22a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37450/0 (socket says 172.21.15.37:37450) 2023-10-06T02:28:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.795+0000 7f3303fff700 1 -- 172.21.15.37:0/1269860960 learned_addr learned my addr 172.21.15.37:0/1269860960 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.795+0000 7f33037fe700 1 --2- 172.21.15.37:0/1269860960 >> v2:172.21.15.191:3300/0 conn(0x7f33040b29b0 0x7f330406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.795+0000 7f3308c81700 1 -- 172.21.15.37:0/1269860960 >> v2:172.21.15.191:3300/0 conn(0x7f33040b29b0 msgr2=0x7f330406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.795+0000 7f3308c81700 1 --2- 172.21.15.37:0/1269860960 >> v2:172.21.15.191:3300/0 conn(0x7f33040b29b0 0x7f330406dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.795+0000 7f3308c81700 1 -- 172.21.15.37:0/1269860960 >> v1:172.21.15.37:6789/0 conn(0x7f330406d870 legacy=0x7f33040b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.795+0000 7f3308c81700 1 -- 172.21.15.37:0/1269860960 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33040cb810 con 0x7f3304158fb0 2023-10-06T02:28:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.795+0000 7f3302ffd700 1 -- 172.21.15.37:0/1269860960 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551981532 0 0) 0x7f33040cbe60 con 0x7f330406d870 2023-10-06T02:28:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.796+0000 7f3308c81700 1 --2- 172.21.15.37:0/1269860960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3304158fb0 0x7f3304159450 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f33040caf70 tx=0x7f32fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ef0378f9dea8a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.796+0000 7f3302ffd700 1 -- 172.21.15.37:0/1269860960 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc00e070 con 0x7f3304158fb0 2023-10-06T02:28:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.796+0000 7f3302ffd700 1 -- 172.21.15.37:0/1269860960 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc00bb60 con 0x7f3304158fb0 2023-10-06T02:28:55.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.796+0000 7f3302ffd700 1 -- 172.21.15.37:0/1269860960 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc012430 con 0x7f3304158fb0 2023-10-06T02:28:55.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.796+0000 7f3309482700 1 -- 172.21.15.37:0/1269860960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3304158fb0 msgr2=0x7f3304159450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.796+0000 7f3309482700 1 --2- 172.21.15.37:0/1269860960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3304158fb0 0x7f3304159450 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f33040caf70 tx=0x7f32fc009780 comp rx=0 tx=0).stop 2023-10-06T02:28:55.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.796+0000 7f3309482700 1 -- 172.21.15.37:0/1269860960 shutdown_connections 2023-10-06T02:28:55.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.796+0000 7f3309482700 1 --2- 172.21.15.37:0/1269860960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3304158fb0 0x7f3304159450 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.796+0000 7f3309482700 1 --2- 172.21.15.37:0/1269860960 >> v2:172.21.15.191:3300/0 conn(0x7f33040b29b0 0x7f330406dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.796+0000 7f3309482700 1 -- 172.21.15.37:0/1269860960 >> 172.21.15.37:0/1269860960 conn(0x7f330406c0b0 msgr2=0x7f330406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:55.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.796+0000 7f3309482700 1 -- 172.21.15.37:0/1269860960 shutdown_connections 2023-10-06T02:28:55.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.796+0000 7f3309482700 1 -- 172.21.15.37:0/1269860960 wait complete. 2023-10-06T02:28:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.797+0000 7f3309482700 1 Processor -- start 2023-10-06T02:28:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.798+0000 7f3309482700 1 -- start start 2023-10-06T02:28:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.798+0000 7f3309482700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f330406d870 0x7f33040a83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.798+0000 7f3309482700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33040b29b0 0x7f330416a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.798+0000 7f3309482700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3304158fb0 0x7f33040c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.798+0000 7f3309482700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330416a610 con 0x7f33040b29b0 2023-10-06T02:28:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.798+0000 7f3309482700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33040a7140 con 0x7f330406d870 2023-10-06T02:28:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.798+0000 7f3309482700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33040c78b0 con 0x7f3304158fb0 2023-10-06T02:28:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.798+0000 7f33037fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33040b29b0 0x7f330416a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.798+0000 7f33037fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33040b29b0 0x7f330416a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47022/0 (socket says 172.21.15.37:47022) 2023-10-06T02:28:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.798+0000 7f33037fe700 1 -- 172.21.15.37:0/3247071850 learned_addr learned my addr 172.21.15.37:0/3247071850 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.799+0000 7f33037fe700 1 -- 172.21.15.37:0/3247071850 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3304158fb0 msgr2=0x7f33040c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.799+0000 7f33037fe700 1 --2- 172.21.15.37:0/3247071850 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3304158fb0 0x7f33040c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.799+0000 7f33037fe700 1 -- 172.21.15.37:0/3247071850 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f330406d870 msgr2=0x7f33040a83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.799+0000 7f3303fff700 1 --2- 172.21.15.37:0/3247071850 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f330406d870 0x7f33040a83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.799+0000 7f33037fe700 1 --2- 172.21.15.37:0/3247071850 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f330406d870 0x7f33040a83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.799+0000 7f33037fe700 1 -- 172.21.15.37:0/3247071850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc009a20 con 0x7f33040b29b0 2023-10-06T02:28:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.799+0000 7f33037fe700 1 --2- 172.21.15.37:0/3247071850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33040b29b0 0x7f330416a0d0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f32f800ecb0 tx=0x7f32f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.799+0000 7f32ebfff700 1 -- 172.21.15.37:0/3247071850 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f800c9d0 con 0x7f33040b29b0 2023-10-06T02:28:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.799+0000 7f32ebfff700 1 -- 172.21.15.37:0/3247071850 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f800cb30 con 0x7f33040b29b0 2023-10-06T02:28:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.799+0000 7f32ebfff700 1 -- 172.21.15.37:0/3247071850 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f8013470 con 0x7f33040b29b0 2023-10-06T02:28:55.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.799+0000 7f3309482700 1 -- 172.21.15.37:0/3247071850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33040a8f80 con 0x7f33040b29b0 2023-10-06T02:28:55.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.799+0000 7f3309482700 1 -- 172.21.15.37:0/3247071850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33040a8ca0 con 0x7f33040b29b0 2023-10-06T02:28:55.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.800+0000 7f3309482700 1 -- 172.21.15.37:0/3247071850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33040a72d0 con 0x7f33040b29b0 2023-10-06T02:28:55.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.801+0000 7f32ebfff700 1 -- 172.21.15.37:0/3247071850 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f32f8005a00 con 0x7f33040b29b0 2023-10-06T02:28:55.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.801+0000 7f32ebfff700 1 --2- 172.21.15.37:0/3247071850 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f32f0066f30 0x7f32f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:55.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.801+0000 7f32ebfff700 1 -- 172.21.15.37:0/3247071850 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f32f80844e0 con 0x7f33040b29b0 2023-10-06T02:28:55.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.801+0000 7f3303fff700 1 --2- 172.21.15.37:0/3247071850 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f32f0066f30 0x7f32f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:55.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.802+0000 7f3303fff700 1 --2- 172.21.15.37:0/3247071850 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f32f0066f30 0x7f32f00693e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f32f4007fd0 tx=0x7f32f4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:55.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.805+0000 7f32ebfff700 1 -- 172.21.15.37:0/3247071850 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32f8051840 con 0x7f33040b29b0 2023-10-06T02:28:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.999+0000 7f3309482700 1 -- 172.21.15.37:0/3247071850 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f33040cbaf0 con 0x7f32f0066f30 2023-10-06T02:28:56.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:55.999+0000 7f32ebfff700 1 -- 172.21.15.37:0/3247071850 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f33040cbaf0 con 0x7f32f0066f30 2023-10-06T02:28:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.001+0000 7f3309482700 1 -- 172.21.15.37:0/3247071850 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f32f0066f30 msgr2=0x7f32f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.001+0000 7f3309482700 1 --2- 172.21.15.37:0/3247071850 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f32f0066f30 0x7f32f00693e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f32f4007fd0 tx=0x7f32f4009040 comp rx=0 tx=0).stop 2023-10-06T02:28:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.001+0000 7f3309482700 1 -- 172.21.15.37:0/3247071850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33040b29b0 msgr2=0x7f330416a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.001+0000 7f3309482700 1 --2- 172.21.15.37:0/3247071850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33040b29b0 0x7f330416a0d0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f32f800ecb0 tx=0x7f32f80091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.001+0000 7f3309482700 1 -- 172.21.15.37:0/3247071850 shutdown_connections 2023-10-06T02:28:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.001+0000 7f3309482700 1 --2- 172.21.15.37:0/3247071850 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3304158fb0 0x7f33040c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.001+0000 7f3309482700 1 --2- 172.21.15.37:0/3247071850 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f32f0066f30 0x7f32f00693e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.001+0000 7f3309482700 1 --2- 172.21.15.37:0/3247071850 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f330406d870 0x7f33040a83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.001+0000 7f3309482700 1 --2- 172.21.15.37:0/3247071850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33040b29b0 0x7f330416a0d0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.001+0000 7f3309482700 1 -- 172.21.15.37:0/3247071850 >> 172.21.15.37:0/3247071850 conn(0x7f330406c0b0 msgr2=0x7f330406c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.002+0000 7f3309482700 1 -- 172.21.15.37:0/3247071850 shutdown_connections 2023-10-06T02:28:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.002+0000 7f3309482700 1 -- 172.21.15.37:0/3247071850 wait complete. 2023-10-06T02:28:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T02:28:56.014 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T02:28:56.014 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:28:56.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.136+0000 7f4c3e24a700 1 Processor -- start 2023-10-06T02:28:56.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.136+0000 7f4c3e24a700 1 -- start start 2023-10-06T02:28:56.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.137+0000 7f4c3e24a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c381595f0 0x7f4c380b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.137+0000 7f4c3e24a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4c381599c0 0x7f4c3806d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.137+0000 7f4c3e24a700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c380b1000 con 0x7f4c3806dd70 2023-10-06T02:28:56.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.137+0000 7f4c3e24a700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c380cb320 con 0x7f4c381599c0 2023-10-06T02:28:56.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.137+0000 7f4c3e24a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c380b5d40 con 0x7f4c381595f0 2023-10-06T02:28:56.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.137+0000 7f4c36ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4c381599c0 0x7f4c3806d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.137+0000 7f4c36ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4c381599c0 0x7f4c3806d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47024/0 (socket says 172.21.15.37:47024) 2023-10-06T02:28:56.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.137+0000 7f4c36ffd700 1 -- 172.21.15.37:0/2368706339 learned_addr learned my addr 172.21.15.37:0/2368706339 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:56.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.137+0000 7f4c377fe700 1 --2- 172.21.15.37:0/2368706339 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c381595f0 0x7f4c380b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.138+0000 7f4c36ffd700 1 -- 172.21.15.37:0/2368706339 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c381595f0 msgr2=0x7f4c380b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:56.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.138+0000 7f4c36ffd700 1 --2- 172.21.15.37:0/2368706339 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c381595f0 0x7f4c380b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.138+0000 7f4c36ffd700 1 -- 172.21.15.37:0/2368706339 >> v1:172.21.15.191:6789/0 conn(0x7f4c3806dd70 legacy=0x7f4c3806c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.138+0000 7f4c36ffd700 1 -- 172.21.15.37:0/2368706339 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3806e160 con 0x7f4c381599c0 2023-10-06T02:28:56.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.138+0000 7f4c36ffd700 1 --2- 172.21.15.37:0/2368706339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c381599c0 0x7f4c3806d830 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0099b0 tx=0x7f4c2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c71fee08e623577 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.138+0000 7f4c367fc700 1 -- 172.21.15.37:0/2368706339 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c009ea0 con 0x7f4c381599c0 2023-10-06T02:28:56.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.138+0000 7f4c367fc700 1 -- 172.21.15.37:0/2368706339 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2c00b860 con 0x7f4c381599c0 2023-10-06T02:28:56.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.138+0000 7f4c367fc700 1 -- 172.21.15.37:0/2368706339 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c00bc00 con 0x7f4c381599c0 2023-10-06T02:28:56.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.139+0000 7f4c3e24a700 1 -- 172.21.15.37:0/2368706339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c381599c0 msgr2=0x7f4c3806d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.139+0000 7f4c3e24a700 1 --2- 172.21.15.37:0/2368706339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c381599c0 0x7f4c3806d830 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0099b0 tx=0x7f4c2c009250 comp rx=0 tx=0).stop 2023-10-06T02:28:56.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.139+0000 7f4c3e24a700 1 -- 172.21.15.37:0/2368706339 shutdown_connections 2023-10-06T02:28:56.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.139+0000 7f4c3e24a700 1 --2- 172.21.15.37:0/2368706339 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c381595f0 0x7f4c380b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.139+0000 7f4c3e24a700 1 --2- 172.21.15.37:0/2368706339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c381599c0 0x7f4c3806d830 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.139+0000 7f4c3e24a700 1 -- 172.21.15.37:0/2368706339 >> 172.21.15.37:0/2368706339 conn(0x7f4c380ccf90 msgr2=0x7f4c380cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:56.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.139+0000 7f4c3e24a700 1 -- 172.21.15.37:0/2368706339 shutdown_connections 2023-10-06T02:28:56.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.139+0000 7f4c3e24a700 1 -- 172.21.15.37:0/2368706339 wait complete. 2023-10-06T02:28:56.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.140+0000 7f4c3e24a700 1 Processor -- start 2023-10-06T02:28:56.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.140+0000 7f4c3e24a700 1 -- start start 2023-10-06T02:28:56.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c3e24a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c3806dd70 0x7f4c38155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c3e24a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c381595f0 0x7f4c380c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c3e24a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c381599c0 0x7f4c380c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c3e24a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c380d1030 con 0x7f4c381599c0 2023-10-06T02:28:56.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c3e24a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c380c5360 con 0x7f4c381595f0 2023-10-06T02:28:56.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c3e24a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c380c4ad0 con 0x7f4c3806dd70 2023-10-06T02:28:56.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c37fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c381599c0 0x7f4c380c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c37fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c381599c0 0x7f4c380c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47026/0 (socket says 172.21.15.37:47026) 2023-10-06T02:28:56.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c37fff700 1 -- 172.21.15.37:0/2429733379 learned_addr learned my addr 172.21.15.37:0/2429733379 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:56.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c36ffd700 1 --2- 172.21.15.37:0/2429733379 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c381595f0 0x7f4c380c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c377fe700 1 --2- 172.21.15.37:0/2429733379 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c3806dd70 0x7f4c38155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c37fff700 1 -- 172.21.15.37:0/2429733379 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c3806dd70 msgr2=0x7f4c38155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c37fff700 1 --2- 172.21.15.37:0/2429733379 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c3806dd70 0x7f4c38155d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c37fff700 1 -- 172.21.15.37:0/2429733379 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c381595f0 msgr2=0x7f4c380c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c37fff700 1 --2- 172.21.15.37:0/2429733379 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c381595f0 0x7f4c380c3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c37fff700 1 -- 172.21.15.37:0/2429733379 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c0094f0 con 0x7f4c381599c0 2023-10-06T02:28:56.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c36ffd700 1 --2- 172.21.15.37:0/2429733379 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c381595f0 0x7f4c380c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:56.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c37fff700 1 --2- 172.21.15.37:0/2429733379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c381599c0 0x7f4c380c44c0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000c8e0 tx=0x7f4c30001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c1f7fe700 1 -- 172.21.15.37:0/2429733379 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3000ce80 con 0x7f4c381599c0 2023-10-06T02:28:56.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c1f7fe700 1 -- 172.21.15.37:0/2429733379 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3000a7e0 con 0x7f4c381599c0 2023-10-06T02:28:56.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c3e24a700 1 -- 172.21.15.37:0/2429733379 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c380c4db0 con 0x7f4c381599c0 2023-10-06T02:28:56.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c1f7fe700 1 -- 172.21.15.37:0/2429733379 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3000ab80 con 0x7f4c381599c0 2023-10-06T02:28:56.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.141+0000 7f4c3e24a700 1 -- 172.21.15.37:0/2429733379 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c380c58e0 con 0x7f4c381599c0 2023-10-06T02:28:56.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.142+0000 7f4c3e24a700 1 -- 172.21.15.37:0/2429733379 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4c38088b10 con 0x7f4c381599c0 2023-10-06T02:28:56.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.143+0000 7f4c1f7fe700 1 -- 172.21.15.37:0/2429733379 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c30012420 con 0x7f4c381599c0 2023-10-06T02:28:56.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.143+0000 7f4c1f7fe700 1 --2- 172.21.15.37:0/2429733379 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4c24066f30 0x7f4c240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.143+0000 7f4c1f7fe700 1 -- 172.21.15.37:0/2429733379 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4c300847b0 con 0x7f4c381599c0 2023-10-06T02:28:56.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.143+0000 7f4c1f7fe700 1 --2- 172.21.15.37:0/2429733379 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x7f4c2406d4e0 0x7f4c2406f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.143+0000 7f4c1f7fe700 1 -- 172.21.15.37:0/2429733379 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4c2406ffa0 con 0x7f4c2406d4e0 2023-10-06T02:28:56.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.143+0000 7f4c1f7fe700 1 -- 172.21.15.37:0/2429733379 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c30086df0 con 0x7f4c381599c0 2023-10-06T02:28:56.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.143+0000 7f4c377fe700 1 --2- 172.21.15.37:0/2429733379 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4c24066f30 0x7f4c240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.144+0000 7f4c36ffd700 1 --2- 172.21.15.37:0/2429733379 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x7f4c2406d4e0 0x7f4c2406f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.144+0000 7f4c36ffd700 1 --2- 172.21.15.37:0/2429733379 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x7f4c2406d4e0 0x7f4c2406f8f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.144+0000 7f4c377fe700 1 --2- 172.21.15.37:0/2429733379 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4c24066f30 0x7f4c240693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4c280093f0 tx=0x7f4c28008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.145+0000 7f4c1f7fe700 1 -- 172.21.15.37:0/2429733379 <== osd.1 v2:172.21.15.37:6808/90617 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f4c2406ffa0 con 0x7f4c2406d4e0 2023-10-06T02:28:56.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.158+0000 7f4c3e24a700 1 -- 172.21.15.37:0/2429733379 --> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4c3815d710 con 0x7f4c2406d4e0 2023-10-06T02:28:56.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.159+0000 7f4c1f7fe700 1 -- 172.21.15.37:0/2429733379 <== osd.1 v2:172.21.15.37:6808/90617 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4c3815d710 con 0x7f4c2406d4e0 2023-10-06T02:28:56.160 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:28:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T02:28:56.161 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:28:56.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.159+0000 7f4c3e24a700 1 -- 172.21.15.37:0/2429733379 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x7f4c2406d4e0 msgr2=0x7f4c2406f8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.159+0000 7f4c3e24a700 1 --2- 172.21.15.37:0/2429733379 >> [v2:172.21.15.37:6808/90617,v1:172.21.15.37:6809/90617] conn(0x7f4c2406d4e0 0x7f4c2406f8f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.159+0000 7f4c3e24a700 1 -- 172.21.15.37:0/2429733379 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4c24066f30 msgr2=0x7f4c240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.159+0000 7f4c3e24a700 1 --2- 172.21.15.37:0/2429733379 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4c24066f30 0x7f4c240693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4c280093f0 tx=0x7f4c28008040 comp rx=0 tx=0).stop 2023-10-06T02:28:56.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.159+0000 7f4c3e24a700 1 -- 172.21.15.37:0/2429733379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c381599c0 msgr2=0x7f4c380c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.159+0000 7f4c3e24a700 1 --2- 172.21.15.37:0/2429733379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c381599c0 0x7f4c380c44c0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000c8e0 tx=0x7f4c30001710 comp rx=0 tx=0).stop 2023-10-06T02:28:56.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.159+0000 7f4c37fff700 1 -- 172.21.15.37:0/2429733379 reap_dead start 2023-10-06T02:28:56.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.159+0000 7f4c3e24a700 1 -- 172.21.15.37:0/2429733379 shutdown_connections 2023-10-06T02:28:56.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.159+0000 7f4c3e24a700 1 -- 172.21.15.37:0/2429733379 >> 172.21.15.37:0/2429733379 conn(0x7f4c380ccf90 msgr2=0x7f4c380b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:56.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.159+0000 7f4c3e24a700 1 -- 172.21.15.37:0/2429733379 shutdown_connections 2023-10-06T02:28:56.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.159+0000 7f4c3e24a700 1 -- 172.21.15.37:0/2429733379 wait complete. 2023-10-06T02:28:56.171 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T02:28:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.290+0000 7f049c21a700 1 Processor -- start 2023-10-06T02:28:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.291+0000 7f049c21a700 1 -- start start 2023-10-06T02:28:56.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.291+0000 7f049c21a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f049406c270 0x7f049406c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.291+0000 7f049c21a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0494159820 0x7f049415de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.291+0000 7f049c21a700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04940b3270 con 0x7f04940b00a0 2023-10-06T02:28:56.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.291+0000 7f049c21a700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049415e340 con 0x7f0494159820 2023-10-06T02:28:56.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.291+0000 7f049c21a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04940b0510 con 0x7f049406c270 2023-10-06T02:28:56.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.292+0000 7f049a7b7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0494159820 0x7f049415de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.292+0000 7f049a7b7700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0494159820 0x7f049415de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47042/0 (socket says 172.21.15.37:47042) 2023-10-06T02:28:56.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.292+0000 7f049a7b7700 1 -- 172.21.15.37:0/2032911892 learned_addr learned my addr 172.21.15.37:0/2032911892 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:56.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.292+0000 7f0499fb6700 1 --2- 172.21.15.37:0/2032911892 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f049406c270 0x7f049406c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.292+0000 7f049a7b7700 1 -- 172.21.15.37:0/2032911892 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f049406c270 msgr2=0x7f049406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:56.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.292+0000 7f049a7b7700 1 --2- 172.21.15.37:0/2032911892 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f049406c270 0x7f049406c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.292+0000 7f049a7b7700 1 -- 172.21.15.37:0/2032911892 >> v1:172.21.15.191:6789/0 conn(0x7f04940b00a0 legacy=0x7f0494159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:56.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.292+0000 7f049a7b7700 1 -- 172.21.15.37:0/2032911892 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0494159ca0 con 0x7f0494159820 2023-10-06T02:28:56.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.292+0000 7f049a7b7700 1 --2- 172.21.15.37:0/2032911892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0494159820 0x7f049415de00 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f0484009f20 tx=0x7f0484009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fafa3c18991fe3c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.292+0000 7f0498fb4700 1 -- 172.21.15.37:0/2032911892 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048400e070 con 0x7f0494159820 2023-10-06T02:28:56.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.292+0000 7f0498fb4700 1 -- 172.21.15.37:0/2032911892 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048400ba40 con 0x7f0494159820 2023-10-06T02:28:56.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.292+0000 7f0498fb4700 1 -- 172.21.15.37:0/2032911892 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04840092e0 con 0x7f0494159820 2023-10-06T02:28:56.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.293+0000 7f049c21a700 1 -- 172.21.15.37:0/2032911892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0494159820 msgr2=0x7f049415de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.293+0000 7f049c21a700 1 --2- 172.21.15.37:0/2032911892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0494159820 0x7f049415de00 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f0484009f20 tx=0x7f0484009840 comp rx=0 tx=0).stop 2023-10-06T02:28:56.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.293+0000 7f049c21a700 1 -- 172.21.15.37:0/2032911892 shutdown_connections 2023-10-06T02:28:56.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.293+0000 7f049c21a700 1 --2- 172.21.15.37:0/2032911892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0494159820 0x7f049415de00 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.293+0000 7f049c21a700 1 --2- 172.21.15.37:0/2032911892 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f049406c270 0x7f049406c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.293+0000 7f049c21a700 1 -- 172.21.15.37:0/2032911892 >> 172.21.15.37:0/2032911892 conn(0x7f04940ccf30 msgr2=0x7f04940cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:56.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.293+0000 7f049c21a700 1 -- 172.21.15.37:0/2032911892 shutdown_connections 2023-10-06T02:28:56.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.293+0000 7f049c21a700 1 -- 172.21.15.37:0/2032911892 wait complete. 2023-10-06T02:28:56.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.294+0000 7f049c21a700 1 Processor -- start 2023-10-06T02:28:56.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.294+0000 7f049c21a700 1 -- start start 2023-10-06T02:28:56.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.295+0000 7f049c21a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f049406c270 0x7f04940c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.295+0000 7f049c21a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04940b00a0 0x7f04940c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.295+0000 7f049c21a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0494159820 0x7f0494153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.295+0000 7f049c21a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049415a7f0 con 0x7f0494159820 2023-10-06T02:28:56.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.295+0000 7f049c21a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04940ca1c0 con 0x7f04940b00a0 2023-10-06T02:28:56.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.295+0000 7f049c21a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0494159ec0 con 0x7f049406c270 2023-10-06T02:28:56.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.295+0000 7f049a7b7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0494159820 0x7f0494153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.295+0000 7f049a7b7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0494159820 0x7f0494153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47050/0 (socket says 172.21.15.37:47050) 2023-10-06T02:28:56.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.295+0000 7f049a7b7700 1 -- 172.21.15.37:0/3897027324 learned_addr learned my addr 172.21.15.37:0/3897027324 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:56.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.295+0000 7f04997b5700 1 --2- 172.21.15.37:0/3897027324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04940b00a0 0x7f04940c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.295+0000 7f0499fb6700 1 --2- 172.21.15.37:0/3897027324 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f049406c270 0x7f04940c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.295+0000 7f049a7b7700 1 -- 172.21.15.37:0/3897027324 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f049406c270 msgr2=0x7f04940c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.295+0000 7f049a7b7700 1 --2- 172.21.15.37:0/3897027324 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f049406c270 0x7f04940c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.295+0000 7f049a7b7700 1 -- 172.21.15.37:0/3897027324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04940b00a0 msgr2=0x7f04940c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.295+0000 7f049a7b7700 1 --2- 172.21.15.37:0/3897027324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04940b00a0 0x7f04940c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.295+0000 7f049a7b7700 1 -- 172.21.15.37:0/3897027324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0484009ae0 con 0x7f0494159820 2023-10-06T02:28:56.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.295+0000 7f049a7b7700 1 --2- 172.21.15.37:0/3897027324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0494159820 0x7f0494153ba0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f04940d0000 tx=0x7f0484017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.295+0000 7f0491ffb700 1 -- 172.21.15.37:0/3897027324 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0484012e60 con 0x7f0494159820 2023-10-06T02:28:56.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.295+0000 7f0491ffb700 1 -- 172.21.15.37:0/3897027324 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04840092e0 con 0x7f0494159820 2023-10-06T02:28:56.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.296+0000 7f049c21a700 1 -- 172.21.15.37:0/3897027324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049415a1a0 con 0x7f0494159820 2023-10-06T02:28:56.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.296+0000 7f0491ffb700 1 -- 172.21.15.37:0/3897027324 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048401e680 con 0x7f0494159820 2023-10-06T02:28:56.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.296+0000 7f049c21a700 1 -- 172.21.15.37:0/3897027324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04940c8580 con 0x7f0494159820 2023-10-06T02:28:56.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.297+0000 7f049c21a700 1 -- 172.21.15.37:0/3897027324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0494088310 con 0x7f0494159820 2023-10-06T02:28:56.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.297+0000 7f0491ffb700 1 -- 172.21.15.37:0/3897027324 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f048401e9f0 con 0x7f0494159820 2023-10-06T02:28:56.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.297+0000 7f0491ffb700 1 --2- 172.21.15.37:0/3897027324 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0480066f30 0x7f04800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.298+0000 7f0491ffb700 1 -- 172.21.15.37:0/3897027324 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0484086020 con 0x7f0494159820 2023-10-06T02:28:56.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.298+0000 7f0499fb6700 1 --2- 172.21.15.37:0/3897027324 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0480066f30 0x7f04800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.298+0000 7f0499fb6700 1 --2- 172.21.15.37:0/3897027324 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0480066f30 0x7f04800693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f048c006fd0 tx=0x7f048c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.302+0000 7f0491ffb700 1 -- 172.21.15.37:0/3897027324 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0484053380 con 0x7f0494159820 2023-10-06T02:28:56.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.493+0000 7f049c21a700 1 -- 172.21.15.37:0/3897027324 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f04940b07a0 con 0x7f0480066f30 2023-10-06T02:28:56.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.493+0000 7f0491ffb700 1 -- 172.21.15.37:0/3897027324 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f04940b07a0 con 0x7f0480066f30 2023-10-06T02:28:56.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.495+0000 7f049c21a700 1 -- 172.21.15.37:0/3897027324 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0480066f30 msgr2=0x7f04800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.495+0000 7f049c21a700 1 --2- 172.21.15.37:0/3897027324 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0480066f30 0x7f04800693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f048c006fd0 tx=0x7f048c008040 comp rx=0 tx=0).stop 2023-10-06T02:28:56.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.495+0000 7f049c21a700 1 -- 172.21.15.37:0/3897027324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0494159820 msgr2=0x7f0494153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.495+0000 7f049c21a700 1 --2- 172.21.15.37:0/3897027324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0494159820 0x7f0494153ba0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f04940d0000 tx=0x7f0484017000 comp rx=0 tx=0).stop 2023-10-06T02:28:56.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.496+0000 7f049c21a700 1 -- 172.21.15.37:0/3897027324 shutdown_connections 2023-10-06T02:28:56.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.496+0000 7f049c21a700 1 --2- 172.21.15.37:0/3897027324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0494159820 0x7f0494153ba0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.496+0000 7f049c21a700 1 --2- 172.21.15.37:0/3897027324 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f049406c270 0x7f04940c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.496+0000 7f049c21a700 1 --2- 172.21.15.37:0/3897027324 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f0480066f30 0x7f04800693e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.496+0000 7f049c21a700 1 --2- 172.21.15.37:0/3897027324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04940b00a0 0x7f04940c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.496+0000 7f049c21a700 1 -- 172.21.15.37:0/3897027324 >> 172.21.15.37:0/3897027324 conn(0x7f04940ccf30 msgr2=0x7f0494157d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:56.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.496+0000 7f049c21a700 1 -- 172.21.15.37:0/3897027324 shutdown_connections 2023-10-06T02:28:56.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.496+0000 7f049c21a700 1 -- 172.21.15.37:0/3897027324 wait complete. 2023-10-06T02:28:56.499 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T02:28:56.509 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T02:28:56.509 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:28:56.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.631+0000 7fac5eabf700 1 Processor -- start 2023-10-06T02:28:56.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.631+0000 7fac5eabf700 1 -- start start 2023-10-06T02:28:56.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.632+0000 7fac5eabf700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fac5806c7c0 0x7fac5806afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.632+0000 7fac5eabf700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac5806b510 0x7fac580c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.632+0000 7fac5eabf700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac580cae70 con 0x7fac58142eb0 2023-10-06T02:28:56.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.632+0000 7fac5eabf700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac580cb9f0 con 0x7fac5806c7c0 2023-10-06T02:28:56.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.632+0000 7fac5eabf700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac580cb150 con 0x7fac5806b510 2023-10-06T02:28:56.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.632+0000 7fac57fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fac5806c7c0 0x7fac5806afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.632+0000 7fac57fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fac5806c7c0 0x7fac5806afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47064/0 (socket says 172.21.15.37:47064) 2023-10-06T02:28:56.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.632+0000 7fac57fff700 1 -- 172.21.15.37:0/2062776149 learned_addr learned my addr 172.21.15.37:0/2062776149 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:56.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.632+0000 7fac5d05c700 1 --2- 172.21.15.37:0/2062776149 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac5806b510 0x7fac580c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.632+0000 7fac57fff700 1 -- 172.21.15.37:0/2062776149 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac5806b510 msgr2=0x7fac580c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:56.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.632+0000 7fac57fff700 1 --2- 172.21.15.37:0/2062776149 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac5806b510 0x7fac580c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.632+0000 7fac57fff700 1 -- 172.21.15.37:0/2062776149 >> v1:172.21.15.191:6789/0 conn(0x7fac58142eb0 legacy=0x7fac5806c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:56.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.632+0000 7fac57fff700 1 -- 172.21.15.37:0/2062776149 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac580cb430 con 0x7fac5806c7c0 2023-10-06T02:28:56.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.632+0000 7fac57fff700 1 --2- 172.21.15.37:0/2062776149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5806c7c0 0x7fac5806afd0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0099b0 tx=0x7fac4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fcdfabc18d95244 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.632+0000 7fac577fe700 1 -- 172.21.15.37:0/2062776149 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c00b820 con 0x7fac5806c7c0 2023-10-06T02:28:56.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.632+0000 7fac577fe700 1 -- 172.21.15.37:0/2062776149 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c00b980 con 0x7fac5806c7c0 2023-10-06T02:28:56.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.632+0000 7fac577fe700 1 -- 172.21.15.37:0/2062776149 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c00bd20 con 0x7fac5806c7c0 2023-10-06T02:28:56.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.633+0000 7fac5eabf700 1 -- 172.21.15.37:0/2062776149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5806c7c0 msgr2=0x7fac5806afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.633+0000 7fac5eabf700 1 --2- 172.21.15.37:0/2062776149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5806c7c0 0x7fac5806afd0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0099b0 tx=0x7fac4c009250 comp rx=0 tx=0).stop 2023-10-06T02:28:56.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.633+0000 7fac5eabf700 1 -- 172.21.15.37:0/2062776149 shutdown_connections 2023-10-06T02:28:56.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.633+0000 7fac5eabf700 1 --2- 172.21.15.37:0/2062776149 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac5806b510 0x7fac580c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.633+0000 7fac5eabf700 1 --2- 172.21.15.37:0/2062776149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5806c7c0 0x7fac5806afd0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.633+0000 7fac5eabf700 1 -- 172.21.15.37:0/2062776149 >> 172.21.15.37:0/2062776149 conn(0x7fac5806dc90 msgr2=0x7fac58067660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:56.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.633+0000 7fac5eabf700 1 -- 172.21.15.37:0/2062776149 shutdown_connections 2023-10-06T02:28:56.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.633+0000 7fac5eabf700 1 -- 172.21.15.37:0/2062776149 wait complete. 2023-10-06T02:28:56.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.634+0000 7fac5eabf700 1 Processor -- start 2023-10-06T02:28:56.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.634+0000 7fac5eabf700 1 -- start start 2023-10-06T02:28:56.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.635+0000 7fac5eabf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5806b510 0x7fac580affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.635+0000 7fac5eabf700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac5806c7c0 0x7fac5813ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.635+0000 7fac5eabf700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac58142eb0 0x7fac5815d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.635+0000 7fac5eabf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac580b2570 con 0x7fac5806b510 2023-10-06T02:28:56.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.635+0000 7fac5eabf700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac580c4c70 con 0x7fac58142eb0 2023-10-06T02:28:56.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.635+0000 7fac5eabf700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac580b2290 con 0x7fac5806c7c0 2023-10-06T02:28:56.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.635+0000 7fac5c85b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5806b510 0x7fac580affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.635+0000 7fac5c85b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5806b510 0x7fac580affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47074/0 (socket says 172.21.15.37:47074) 2023-10-06T02:28:56.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.635+0000 7fac5c85b700 1 -- 172.21.15.37:0/365424891 learned_addr learned my addr 172.21.15.37:0/365424891 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:56.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.635+0000 7fac57fff700 1 --2- 172.21.15.37:0/365424891 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac5806c7c0 0x7fac5813ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.635+0000 7fac5d05c700 1 --2- 172.21.15.37:0/365424891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac58142eb0 0x7fac5815d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.635+0000 7fac5c85b700 1 -- 172.21.15.37:0/365424891 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac5806c7c0 msgr2=0x7fac5813ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.635+0000 7fac5c85b700 1 --2- 172.21.15.37:0/365424891 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac5806c7c0 0x7fac5813ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.635+0000 7fac5c85b700 1 -- 172.21.15.37:0/365424891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac58142eb0 msgr2=0x7fac5815d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.635+0000 7fac5c85b700 1 --2- 172.21.15.37:0/365424891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac58142eb0 0x7fac5815d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.635+0000 7fac5c85b700 1 -- 172.21.15.37:0/365424891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c0094f0 con 0x7fac5806b510 2023-10-06T02:28:56.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.636+0000 7fac5c85b700 1 --2- 172.21.15.37:0/365424891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5806b510 0x7fac580affa0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fac5000bc60 tx=0x7fac50009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.636+0000 7fac54ff9700 1 -- 172.21.15.37:0/365424891 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5000c960 con 0x7fac5806b510 2023-10-06T02:28:56.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.636+0000 7fac54ff9700 1 -- 172.21.15.37:0/365424891 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5000cb00 con 0x7fac5806b510 2023-10-06T02:28:56.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.636+0000 7fac5eabf700 1 -- 172.21.15.37:0/365424891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac580b2870 con 0x7fac5806b510 2023-10-06T02:28:56.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.636+0000 7fac54ff9700 1 -- 172.21.15.37:0/365424891 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac50014410 con 0x7fac5806b510 2023-10-06T02:28:56.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.636+0000 7fac5eabf700 1 -- 172.21.15.37:0/365424891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5813f180 con 0x7fac5806b510 2023-10-06T02:28:56.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.636+0000 7fac5eabf700 1 -- 172.21.15.37:0/365424891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fac580b26d0 con 0x7fac5806b510 2023-10-06T02:28:56.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.637+0000 7fac54ff9700 1 -- 172.21.15.37:0/365424891 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac500147c0 con 0x7fac5806b510 2023-10-06T02:28:56.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.637+0000 7fac54ff9700 1 --2- 172.21.15.37:0/365424891 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fac44066f30 0x7fac440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.638+0000 7fac54ff9700 1 -- 172.21.15.37:0/365424891 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fac500844e0 con 0x7fac5806b510 2023-10-06T02:28:56.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.638+0000 7fac57fff700 1 --2- 172.21.15.37:0/365424891 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fac44066f30 0x7fac440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.638+0000 7fac54ff9700 1 --2- 172.21.15.37:0/365424891 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x7fac4406d4e0 0x7fac4406f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.638+0000 7fac54ff9700 1 -- 172.21.15.37:0/365424891 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fac4406ffa0 con 0x7fac4406d4e0 2023-10-06T02:28:56.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.638+0000 7fac54ff9700 1 -- 172.21.15.37:0/365424891 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac50086b20 con 0x7fac5806b510 2023-10-06T02:28:56.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.638+0000 7fac5d05c700 1 --2- 172.21.15.37:0/365424891 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x7fac4406d4e0 0x7fac4406f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.638+0000 7fac5d05c700 1 --2- 172.21.15.37:0/365424891 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x7fac4406d4e0 0x7fac4406f8f0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.638+0000 7fac57fff700 1 --2- 172.21.15.37:0/365424891 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fac44066f30 0x7fac440693e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0099b0 tx=0x7fac4c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.639+0000 7fac54ff9700 1 -- 172.21.15.37:0/365424891 <== osd.2 v2:172.21.15.37:6800/90611 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fac4406ffa0 con 0x7fac4406d4e0 2023-10-06T02:28:56.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.653+0000 7fac5eabf700 1 -- 172.21.15.37:0/365424891 --> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fac580c4000 con 0x7fac4406d4e0 2023-10-06T02:28:56.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.653+0000 7fac54ff9700 1 -- 172.21.15.37:0/365424891 <== osd.2 v2:172.21.15.37:6800/90611 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fac580c4000 con 0x7fac4406d4e0 2023-10-06T02:28:56.655 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:28:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T02:28:56.655 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:28:56.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.653+0000 7fac5eabf700 1 -- 172.21.15.37:0/365424891 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x7fac4406d4e0 msgr2=0x7fac4406f8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.653+0000 7fac5eabf700 1 --2- 172.21.15.37:0/365424891 >> [v2:172.21.15.37:6800/90611,v1:172.21.15.37:6801/90611] conn(0x7fac4406d4e0 0x7fac4406f8f0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.653+0000 7fac5eabf700 1 -- 172.21.15.37:0/365424891 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fac44066f30 msgr2=0x7fac440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.653+0000 7fac5eabf700 1 --2- 172.21.15.37:0/365424891 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fac44066f30 0x7fac440693e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0099b0 tx=0x7fac4c016000 comp rx=0 tx=0).stop 2023-10-06T02:28:56.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.653+0000 7fac5eabf700 1 -- 172.21.15.37:0/365424891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5806b510 msgr2=0x7fac580affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.653+0000 7fac5eabf700 1 --2- 172.21.15.37:0/365424891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac5806b510 0x7fac580affa0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fac5000bc60 tx=0x7fac50009820 comp rx=0 tx=0).stop 2023-10-06T02:28:56.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.653+0000 7fac5d05c700 1 -- 172.21.15.37:0/365424891 reap_dead start 2023-10-06T02:28:56.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.654+0000 7fac5eabf700 1 -- 172.21.15.37:0/365424891 shutdown_connections 2023-10-06T02:28:56.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.654+0000 7fac5eabf700 1 -- 172.21.15.37:0/365424891 >> 172.21.15.37:0/365424891 conn(0x7fac5806dc90 msgr2=0x7fac580c2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:56.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.654+0000 7fac5eabf700 1 -- 172.21.15.37:0/365424891 shutdown_connections 2023-10-06T02:28:56.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.654+0000 7fac5eabf700 1 -- 172.21.15.37:0/365424891 wait complete. 2023-10-06T02:28:56.667 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T02:28:56.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.785+0000 7fbd29a4b700 1 Processor -- start 2023-10-06T02:28:56.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.786+0000 7fbd29a4b700 1 -- start start 2023-10-06T02:28:56.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.786+0000 7fbd29a4b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbd24159340 0x7fbd240b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.787+0000 7fbd29a4b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd24068140 0x7fbd24159710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.787+0000 7fbd29a4b700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2406e470 con 0x7fbd240b3f80 2023-10-06T02:28:56.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.787+0000 7fbd29a4b700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2406d860 con 0x7fbd24159340 2023-10-06T02:28:56.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.787+0000 7fbd29a4b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2406db40 con 0x7fbd24068140 2023-10-06T02:28:56.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.787+0000 7fbd22ffd700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbd24159340 0x7fbd240b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.787+0000 7fbd227fc700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fbd240b3f80 0x7fbd24067a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:34638/0 (socket says 172.21.15.37:34638) 2023-10-06T02:28:56.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.787+0000 7fbd227fc700 1 -- 172.21.15.37:0/2297107002 learned_addr learned my addr 172.21.15.37:0/2297107002 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:56.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.787+0000 7fbd237fe700 1 --2- 172.21.15.37:0/2297107002 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd24068140 0x7fbd24159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.787+0000 7fbd22ffd700 1 -- 172.21.15.37:0/2297107002 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd24068140 msgr2=0x7fbd24159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:56.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.787+0000 7fbd22ffd700 1 --2- 172.21.15.37:0/2297107002 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd24068140 0x7fbd24159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.787+0000 7fbd22ffd700 1 -- 172.21.15.37:0/2297107002 >> v1:172.21.15.191:6789/0 conn(0x7fbd240b3f80 legacy=0x7fbd24067a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.787+0000 7fbd22ffd700 1 -- 172.21.15.37:0/2297107002 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2406de20 con 0x7fbd24159340 2023-10-06T02:28:56.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.787+0000 7fbd237fe700 1 --2- 172.21.15.37:0/2297107002 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd24068140 0x7fbd24159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:56.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.787+0000 7fbd22ffd700 1 --2- 172.21.15.37:0/2297107002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd24159340 0x7fbd240b3a40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbd140098e0 tx=0x7fbd140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd123f007d8646c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.788+0000 7fbd21ffb700 1 -- 172.21.15.37:0/2297107002 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1400b640 con 0x7fbd24159340 2023-10-06T02:28:56.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.788+0000 7fbd21ffb700 1 -- 172.21.15.37:0/2297107002 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1400b7a0 con 0x7fbd24159340 2023-10-06T02:28:56.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.788+0000 7fbd21ffb700 1 -- 172.21.15.37:0/2297107002 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1400bb40 con 0x7fbd24159340 2023-10-06T02:28:56.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.788+0000 7fbd29a4b700 1 -- 172.21.15.37:0/2297107002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd24159340 msgr2=0x7fbd240b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.788+0000 7fbd29a4b700 1 --2- 172.21.15.37:0/2297107002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd24159340 0x7fbd240b3a40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbd140098e0 tx=0x7fbd140091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.788+0000 7fbd29a4b700 1 -- 172.21.15.37:0/2297107002 shutdown_connections 2023-10-06T02:28:56.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.788+0000 7fbd29a4b700 1 --2- 172.21.15.37:0/2297107002 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd24068140 0x7fbd24159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.788+0000 7fbd29a4b700 1 --2- 172.21.15.37:0/2297107002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd24159340 0x7fbd240b3a40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.788+0000 7fbd29a4b700 1 -- 172.21.15.37:0/2297107002 >> 172.21.15.37:0/2297107002 conn(0x7fbd240ce330 msgr2=0x7fbd240ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:56.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.788+0000 7fbd29a4b700 1 -- 172.21.15.37:0/2297107002 shutdown_connections 2023-10-06T02:28:56.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.788+0000 7fbd29a4b700 1 -- 172.21.15.37:0/2297107002 wait complete. 2023-10-06T02:28:56.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.789+0000 7fbd29a4b700 1 Processor -- start 2023-10-06T02:28:56.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.789+0000 7fbd29a4b700 1 -- start start 2023-10-06T02:28:56.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.790+0000 7fbd29a4b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd24068140 0x7fbd240c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.790+0000 7fbd29a4b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd240b3f80 0x7fbd24154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.790+0000 7fbd29a4b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd24159340 0x7fbd24155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.790+0000 7fbd29a4b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd24150f20 con 0x7fbd24068140 2023-10-06T02:28:56.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.790+0000 7fbd29a4b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2416a5a0 con 0x7fbd24159340 2023-10-06T02:28:56.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.790+0000 7fbd29a4b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd24151170 con 0x7fbd240b3f80 2023-10-06T02:28:56.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.790+0000 7fbd22ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd24068140 0x7fbd240c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.790+0000 7fbd22ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd24068140 0x7fbd240c9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47082/0 (socket says 172.21.15.37:47082) 2023-10-06T02:28:56.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.790+0000 7fbd22ffd700 1 -- 172.21.15.37:0/2212833983 learned_addr learned my addr 172.21.15.37:0/2212833983 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:56.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.791+0000 7fbd237fe700 1 --2- 172.21.15.37:0/2212833983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd24159340 0x7fbd24155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.791+0000 7fbd227fc700 1 --2- 172.21.15.37:0/2212833983 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd240b3f80 0x7fbd24154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.791+0000 7fbd22ffd700 1 -- 172.21.15.37:0/2212833983 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd240b3f80 msgr2=0x7fbd24154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.791+0000 7fbd22ffd700 1 --2- 172.21.15.37:0/2212833983 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd240b3f80 0x7fbd24154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.791+0000 7fbd22ffd700 1 -- 172.21.15.37:0/2212833983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd24159340 msgr2=0x7fbd24155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.791+0000 7fbd22ffd700 1 --2- 172.21.15.37:0/2212833983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd24159340 0x7fbd24155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.791+0000 7fbd22ffd700 1 -- 172.21.15.37:0/2212833983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c009a20 con 0x7fbd24068140 2023-10-06T02:28:56.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.791+0000 7fbd237fe700 1 --2- 172.21.15.37:0/2212833983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd24159340 0x7fbd24155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:56.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.791+0000 7fbd22ffd700 1 --2- 172.21.15.37:0/2212833983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd24068140 0x7fbd240c9ba0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fbd2406b320 tx=0x7fbd14017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.791+0000 7fbd1affd700 1 -- 172.21.15.37:0/2212833983 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1401bcd0 con 0x7fbd24068140 2023-10-06T02:28:56.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.791+0000 7fbd1affd700 1 -- 172.21.15.37:0/2212833983 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1401be30 con 0x7fbd24068140 2023-10-06T02:28:56.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.791+0000 7fbd29a4b700 1 -- 172.21.15.37:0/2212833983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd14009420 con 0x7fbd24068140 2023-10-06T02:28:56.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.791+0000 7fbd1affd700 1 -- 172.21.15.37:0/2212833983 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14011670 con 0x7fbd24068140 2023-10-06T02:28:56.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.791+0000 7fbd29a4b700 1 -- 172.21.15.37:0/2212833983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd24151730 con 0x7fbd24068140 2023-10-06T02:28:56.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.792+0000 7fbd29a4b700 1 -- 172.21.15.37:0/2212833983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2406a5d0 con 0x7fbd24068140 2023-10-06T02:28:56.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.792+0000 7fbd1affd700 1 -- 172.21.15.37:0/2212833983 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd14011a20 con 0x7fbd24068140 2023-10-06T02:28:56.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.793+0000 7fbd1affd700 1 --2- 172.21.15.37:0/2212833983 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbd04066f30 0x7fbd040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:56.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.793+0000 7fbd1affd700 1 -- 172.21.15.37:0/2212833983 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fbd140858b0 con 0x7fbd24068140 2023-10-06T02:28:56.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.793+0000 7fbd227fc700 1 --2- 172.21.15.37:0/2212833983 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbd04066f30 0x7fbd040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:56.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.794+0000 7fbd227fc700 1 --2- 172.21.15.37:0/2212833983 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbd04066f30 0x7fbd040693e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbd240c9360 tx=0x7fbd0c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:56.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.797+0000 7fbd1affd700 1 -- 172.21.15.37:0/2212833983 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd14052c10 con 0x7fbd24068140 2023-10-06T02:28:56.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.991+0000 7fbd29a4b700 1 -- 172.21.15.37:0/2212833983 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd2406e100 con 0x7fbd04066f30 2023-10-06T02:28:56.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.991+0000 7fbd1affd700 1 -- 172.21.15.37:0/2212833983 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbd2406e100 con 0x7fbd04066f30 2023-10-06T02:28:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.993+0000 7fbd29a4b700 1 -- 172.21.15.37:0/2212833983 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbd04066f30 msgr2=0x7fbd040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.993+0000 7fbd29a4b700 1 --2- 172.21.15.37:0/2212833983 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbd04066f30 0x7fbd040693e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbd240c9360 tx=0x7fbd0c009040 comp rx=0 tx=0).stop 2023-10-06T02:28:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.993+0000 7fbd29a4b700 1 -- 172.21.15.37:0/2212833983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd24068140 msgr2=0x7fbd240c9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.993+0000 7fbd29a4b700 1 --2- 172.21.15.37:0/2212833983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd24068140 0x7fbd240c9ba0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fbd2406b320 tx=0x7fbd14017000 comp rx=0 tx=0).stop 2023-10-06T02:28:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.993+0000 7fbd29a4b700 1 -- 172.21.15.37:0/2212833983 shutdown_connections 2023-10-06T02:28:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.993+0000 7fbd29a4b700 1 --2- 172.21.15.37:0/2212833983 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fbd04066f30 0x7fbd040693e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.993+0000 7fbd29a4b700 1 --2- 172.21.15.37:0/2212833983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd24159340 0x7fbd24155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.993+0000 7fbd29a4b700 1 --2- 172.21.15.37:0/2212833983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd24068140 0x7fbd240c9ba0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.993+0000 7fbd29a4b700 1 --2- 172.21.15.37:0/2212833983 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd240b3f80 0x7fbd24154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.993+0000 7fbd29a4b700 1 -- 172.21.15.37:0/2212833983 >> 172.21.15.37:0/2212833983 conn(0x7fbd240ce330 msgr2=0x7fbd24158530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.993+0000 7fbd29a4b700 1 -- 172.21.15.37:0/2212833983 shutdown_connections 2023-10-06T02:28:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:56.994+0000 7fbd29a4b700 1 -- 172.21.15.37:0/2212833983 wait complete. 2023-10-06T02:28:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T02:28:57.007 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T02:28:57.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:28:57.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.129+0000 7fb1763ca700 1 Processor -- start 2023-10-06T02:28:57.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.129+0000 7fb1763ca700 1 -- start start 2023-10-06T02:28:57.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.129+0000 7fb1763ca700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1701430a0 0x7fb17006e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.129+0000 7fb1763ca700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb1700c9060 0x7fb170067990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.129+0000 7fb1763ca700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17006de70 con 0x7fb17006e840 2023-10-06T02:28:57.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.129+0000 7fb1763ca700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17006d260 con 0x7fb1701430a0 2023-10-06T02:28:57.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.129+0000 7fb1763ca700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17006d540 con 0x7fb1700c9060 2023-10-06T02:28:57.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.130+0000 7fb16ffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1701430a0 0x7fb17006e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.130+0000 7fb16f7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb17006e840 0x7fb1700c8950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37452/0 (socket says 172.21.15.37:37452) 2023-10-06T02:28:57.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.130+0000 7fb16f7fe700 1 -- 172.21.15.37:0/1835068358 learned_addr learned my addr 172.21.15.37:0/1835068358 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:57.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.130+0000 7fb174967700 1 --2- 172.21.15.37:0/1835068358 >> v2:172.21.15.191:3300/0 conn(0x7fb1700c9060 0x7fb170067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.130+0000 7fb16ffff700 1 -- 172.21.15.37:0/1835068358 >> v2:172.21.15.191:3300/0 conn(0x7fb1700c9060 msgr2=0x7fb170067990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:57.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.130+0000 7fb16ffff700 1 --2- 172.21.15.37:0/1835068358 >> v2:172.21.15.191:3300/0 conn(0x7fb1700c9060 0x7fb170067990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.130+0000 7fb16ffff700 1 -- 172.21.15.37:0/1835068358 >> v1:172.21.15.37:6789/0 conn(0x7fb17006e840 legacy=0x7fb1700c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.130+0000 7fb16ffff700 1 -- 172.21.15.37:0/1835068358 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17006d820 con 0x7fb1701430a0 2023-10-06T02:28:57.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.130+0000 7fb16effd700 1 -- 172.21.15.37:0/1835068358 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130086816 0 0) 0x7fb17006de70 con 0x7fb17006e840 2023-10-06T02:28:57.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.130+0000 7fb16ffff700 1 --2- 172.21.15.37:0/1835068358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1701430a0 0x7fb17006e300 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fb17006b600 tx=0x7fb1580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd374350f96eb7b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:57.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.130+0000 7fb16effd700 1 -- 172.21.15.37:0/1835068358 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158011630 con 0x7fb1701430a0 2023-10-06T02:28:57.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.130+0000 7fb16effd700 1 -- 172.21.15.37:0/1835068358 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb158011790 con 0x7fb1701430a0 2023-10-06T02:28:57.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.130+0000 7fb16effd700 1 -- 172.21.15.37:0/1835068358 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158011b30 con 0x7fb1701430a0 2023-10-06T02:28:57.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.131+0000 7fb1763ca700 1 -- 172.21.15.37:0/1835068358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1701430a0 msgr2=0x7fb17006e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.131+0000 7fb1763ca700 1 --2- 172.21.15.37:0/1835068358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1701430a0 0x7fb17006e300 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fb17006b600 tx=0x7fb1580091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.131+0000 7fb1763ca700 1 -- 172.21.15.37:0/1835068358 shutdown_connections 2023-10-06T02:28:57.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.131+0000 7fb1763ca700 1 --2- 172.21.15.37:0/1835068358 >> v2:172.21.15.191:3300/0 conn(0x7fb1700c9060 0x7fb170067990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.131+0000 7fb1763ca700 1 --2- 172.21.15.37:0/1835068358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1701430a0 0x7fb17006e300 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.131+0000 7fb1763ca700 1 -- 172.21.15.37:0/1835068358 >> 172.21.15.37:0/1835068358 conn(0x7fb1700ce310 msgr2=0x7fb1700ce710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:57.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.131+0000 7fb1763ca700 1 -- 172.21.15.37:0/1835068358 shutdown_connections 2023-10-06T02:28:57.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.131+0000 7fb1763ca700 1 -- 172.21.15.37:0/1835068358 wait complete. 2023-10-06T02:28:57.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.132+0000 7fb1763ca700 1 Processor -- start 2023-10-06T02:28:57.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.132+0000 7fb1763ca700 1 -- start start 2023-10-06T02:28:57.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.133+0000 7fb1763ca700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb17006e840 0x7fb170159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.133+0000 7fb1763ca700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1700c9060 0x7fb1700c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.133+0000 7fb1763ca700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1701430a0 0x7fb1700c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.133+0000 7fb1763ca700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700b1450 con 0x7fb17006e840 2023-10-06T02:28:57.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.133+0000 7fb1763ca700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700b1150 con 0x7fb1701430a0 2023-10-06T02:28:57.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.133+0000 7fb1763ca700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17016a120 con 0x7fb1700c9060 2023-10-06T02:28:57.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.133+0000 7fb16ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb17006e840 0x7fb170159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.133+0000 7fb16ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb17006e840 0x7fb170159040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47110/0 (socket says 172.21.15.37:47110) 2023-10-06T02:28:57.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.133+0000 7fb16ffff700 1 -- 172.21.15.37:0/204879006 learned_addr learned my addr 172.21.15.37:0/204879006 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:57.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.133+0000 7fb174967700 1 --2- 172.21.15.37:0/204879006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1701430a0 0x7fb1700c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.133+0000 7fb16ffff700 1 -- 172.21.15.37:0/204879006 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1700c9060 msgr2=0x7fb1700c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.133+0000 7fb16ffff700 1 --2- 172.21.15.37:0/204879006 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1700c9060 0x7fb1700c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.133+0000 7fb16ffff700 1 -- 172.21.15.37:0/204879006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1701430a0 msgr2=0x7fb1700c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.133+0000 7fb16ffff700 1 --2- 172.21.15.37:0/204879006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1701430a0 0x7fb1700c5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.133+0000 7fb16ffff700 1 -- 172.21.15.37:0/204879006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb158009420 con 0x7fb17006e840 2023-10-06T02:28:57.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.133+0000 7fb16ffff700 1 --2- 172.21.15.37:0/204879006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb17006e840 0x7fb170159040 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fb17006b000 tx=0x7fb158017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:57.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.134+0000 7fb167fff700 1 -- 172.21.15.37:0/204879006 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158011b10 con 0x7fb17006e840 2023-10-06T02:28:57.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.134+0000 7fb167fff700 1 -- 172.21.15.37:0/204879006 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1580253f0 con 0x7fb17006e840 2023-10-06T02:28:57.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.134+0000 7fb1763ca700 1 -- 172.21.15.37:0/204879006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1700c7340 con 0x7fb17006e840 2023-10-06T02:28:57.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.134+0000 7fb167fff700 1 -- 172.21.15.37:0/204879006 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158025790 con 0x7fb17006e840 2023-10-06T02:28:57.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.134+0000 7fb1763ca700 1 -- 172.21.15.37:0/204879006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1700c6ff0 con 0x7fb17006e840 2023-10-06T02:28:57.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.134+0000 7fb1763ca700 1 -- 172.21.15.37:0/204879006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb17006a5d0 con 0x7fb17006e840 2023-10-06T02:28:57.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.135+0000 7fb167fff700 1 -- 172.21.15.37:0/204879006 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb158025b80 con 0x7fb17006e840 2023-10-06T02:28:57.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.135+0000 7fb167fff700 1 --2- 172.21.15.37:0/204879006 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb150066f30 0x7fb1500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.136+0000 7fb167fff700 1 -- 172.21.15.37:0/204879006 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb158086910 con 0x7fb17006e840 2023-10-06T02:28:57.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.136+0000 7fb167fff700 1 --2- 172.21.15.37:0/204879006 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x7fb15006d4e0 0x7fb15006f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.136+0000 7fb167fff700 1 -- 172.21.15.37:0/204879006 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb15006ffa0 con 0x7fb15006d4e0 2023-10-06T02:28:57.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.136+0000 7fb167fff700 1 -- 172.21.15.37:0/204879006 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb158086ce0 con 0x7fb17006e840 2023-10-06T02:28:57.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.136+0000 7fb16f7fe700 1 --2- 172.21.15.37:0/204879006 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb150066f30 0x7fb1500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.136+0000 7fb174967700 1 --2- 172.21.15.37:0/204879006 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x7fb15006d4e0 0x7fb15006f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.136+0000 7fb174967700 1 --2- 172.21.15.37:0/204879006 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x7fb15006d4e0 0x7fb15006f8f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:57.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.136+0000 7fb16f7fe700 1 --2- 172.21.15.37:0/204879006 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb150066f30 0x7fb1500693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb1600011e0 tx=0x7fb1600079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.137+0000 7fb167fff700 1 -- 172.21.15.37:0/204879006 <== osd.3 v2:172.21.15.37:6817/90628 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb15006ffa0 con 0x7fb15006d4e0 2023-10-06T02:28:57.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.151+0000 7fb1763ca700 1 -- 172.21.15.37:0/204879006 --> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb17006db00 con 0x7fb15006d4e0 2023-10-06T02:28:57.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.151+0000 7fb167fff700 1 -- 172.21.15.37:0/204879006 <== osd.3 v2:172.21.15.37:6817/90628 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb17006db00 con 0x7fb15006d4e0 2023-10-06T02:28:57.152 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:28:57.153 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T02:28:57.153 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:28:57.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.151+0000 7fb1763ca700 1 -- 172.21.15.37:0/204879006 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x7fb15006d4e0 msgr2=0x7fb15006f8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.151+0000 7fb1763ca700 1 --2- 172.21.15.37:0/204879006 >> [v2:172.21.15.37:6817/90628,v1:172.21.15.37:6819/90628] conn(0x7fb15006d4e0 0x7fb15006f8f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.151+0000 7fb1763ca700 1 -- 172.21.15.37:0/204879006 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb150066f30 msgr2=0x7fb1500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.151+0000 7fb1763ca700 1 --2- 172.21.15.37:0/204879006 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb150066f30 0x7fb1500693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb1600011e0 tx=0x7fb1600079d0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.151+0000 7fb1763ca700 1 -- 172.21.15.37:0/204879006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb17006e840 msgr2=0x7fb170159040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.151+0000 7fb1763ca700 1 --2- 172.21.15.37:0/204879006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb17006e840 0x7fb170159040 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fb17006b000 tx=0x7fb158017000 comp rx=0 tx=0).stop 2023-10-06T02:28:57.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.151+0000 7fb174967700 1 -- 172.21.15.37:0/204879006 reap_dead start 2023-10-06T02:28:57.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.151+0000 7fb1763ca700 1 -- 172.21.15.37:0/204879006 shutdown_connections 2023-10-06T02:28:57.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.151+0000 7fb1763ca700 1 -- 172.21.15.37:0/204879006 >> 172.21.15.37:0/204879006 conn(0x7fb1700ce310 msgr2=0x7fb1700695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:57.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.151+0000 7fb1763ca700 1 -- 172.21.15.37:0/204879006 shutdown_connections 2023-10-06T02:28:57.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.151+0000 7fb1763ca700 1 -- 172.21.15.37:0/204879006 wait complete. 2023-10-06T02:28:57.164 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T02:28:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.282+0000 7f0391941700 1 Processor -- start 2023-10-06T02:28:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.282+0000 7f0391941700 1 -- start start 2023-10-06T02:28:57.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.283+0000 7f0391941700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f038c0cb080 0x7f038c0b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.283+0000 7f0391941700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f038c0cc250 con 0x7f038c06de80 2023-10-06T02:28:57.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.283+0000 7f0391941700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f038c0cb640 con 0x7f038c06dab0 2023-10-06T02:28:57.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.283+0000 7f0391941700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f038c0b0e00 con 0x7f038c0cb080 2023-10-06T02:28:57.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.283+0000 7f038b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f038c06de80 0x7f038c0b06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37464/0 (socket says 172.21.15.37:37464) 2023-10-06T02:28:57.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.283+0000 7f038b7fe700 1 -- 172.21.15.37:0/3588164199 learned_addr learned my addr 172.21.15.37:0/3588164199 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.283+0000 7f038a7fc700 1 --2- 172.21.15.37:0/3588164199 >> v2:172.21.15.191:3300/0 conn(0x7f038c0cb080 0x7f038c0b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.283+0000 7f0389ffb700 1 -- 172.21.15.37:0/3588164199 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325168838 0 0) 0x7f038c0cc250 con 0x7f038c06de80 2023-10-06T02:28:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.284+0000 7f0389ffb700 1 -- 172.21.15.37:0/3588164199 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0378003570 con 0x7f038c06de80 2023-10-06T02:28:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.284+0000 7f038a7fc700 1 -- 172.21.15.37:0/3588164199 >> v1:172.21.15.191:6789/0 conn(0x7f038c06dab0 legacy=0x7f038c0cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.284+0000 7f038a7fc700 1 -- 172.21.15.37:0/3588164199 >> v1:172.21.15.37:6789/0 conn(0x7f038c06de80 legacy=0x7f038c0b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.284+0000 7f038a7fc700 1 -- 172.21.15.37:0/3588164199 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c0cb920 con 0x7f038c0cb080 2023-10-06T02:28:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.284+0000 7f038a7fc700 1 --2- 172.21.15.37:0/3588164199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f038c0cb080 0x7f038c0b01b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f03740098e0 tx=0x7f03740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6beb45fd96d4aab8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.284+0000 7f0389ffb700 1 -- 172.21.15.37:0/3588164199 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037400b640 con 0x7f038c0cb080 2023-10-06T02:28:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.284+0000 7f0389ffb700 1 -- 172.21.15.37:0/3588164199 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037400b7a0 con 0x7f038c0cb080 2023-10-06T02:28:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.284+0000 7f0389ffb700 1 -- 172.21.15.37:0/3588164199 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037400bb40 con 0x7f038c0cb080 2023-10-06T02:28:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.284+0000 7f0391941700 1 -- 172.21.15.37:0/3588164199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f038c0cb080 msgr2=0x7f038c0b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.285+0000 7f0391941700 1 --2- 172.21.15.37:0/3588164199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f038c0cb080 0x7f038c0b01b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f03740098e0 tx=0x7f03740091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.285+0000 7f0391941700 1 -- 172.21.15.37:0/3588164199 shutdown_connections 2023-10-06T02:28:57.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.285+0000 7f0391941700 1 --2- 172.21.15.37:0/3588164199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f038c0cb080 0x7f038c0b01b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.285+0000 7f0391941700 1 -- 172.21.15.37:0/3588164199 >> 172.21.15.37:0/3588164199 conn(0x7f038c0d0510 msgr2=0x7f038c0d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:57.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.285+0000 7f0391941700 1 -- 172.21.15.37:0/3588164199 shutdown_connections 2023-10-06T02:28:57.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.285+0000 7f0391941700 1 -- 172.21.15.37:0/3588164199 wait complete. 2023-10-06T02:28:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.286+0000 7f0391941700 1 Processor -- start 2023-10-06T02:28:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.286+0000 7f0391941700 1 -- start start 2023-10-06T02:28:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.286+0000 7f0391941700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f038c06dab0 0x7f038c156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.286+0000 7f0391941700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f038c06de80 0x7f038c15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.287+0000 7f0391941700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f038c0cb080 0x7f038c0b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.287+0000 7f0391941700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0b4280 con 0x7f038c06dab0 2023-10-06T02:28:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.287+0000 7f0391941700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0b5210 con 0x7f038c06de80 2023-10-06T02:28:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.287+0000 7f0391941700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c15b520 con 0x7f038c0cb080 2023-10-06T02:28:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.287+0000 7f038affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f038c06dab0 0x7f038c156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.287+0000 7f038affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f038c06dab0 0x7f038c156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47114/0 (socket says 172.21.15.37:47114) 2023-10-06T02:28:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.287+0000 7f038affd700 1 -- 172.21.15.37:0/3450607778 learned_addr learned my addr 172.21.15.37:0/3450607778 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.287+0000 7f038a7fc700 1 --2- 172.21.15.37:0/3450607778 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f038c06de80 0x7f038c15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.287+0000 7f038b7fe700 1 --2- 172.21.15.37:0/3450607778 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f038c0cb080 0x7f038c0b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.287+0000 7f038affd700 1 -- 172.21.15.37:0/3450607778 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f038c0cb080 msgr2=0x7f038c0b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.287+0000 7f038affd700 1 --2- 172.21.15.37:0/3450607778 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f038c0cb080 0x7f038c0b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.287+0000 7f038affd700 1 -- 172.21.15.37:0/3450607778 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f038c06de80 msgr2=0x7f038c15ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.287+0000 7f038affd700 1 --2- 172.21.15.37:0/3450607778 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f038c06de80 0x7f038c15ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.287+0000 7f038affd700 1 -- 172.21.15.37:0/3450607778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0374009420 con 0x7f038c06dab0 2023-10-06T02:28:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.287+0000 7f038affd700 1 --2- 172.21.15.37:0/3450607778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f038c06dab0 0x7f038c156330 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f038400cb10 tx=0x7f03840017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.287+0000 7f0382ffd700 1 -- 172.21.15.37:0/3450607778 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038400ce20 con 0x7f038c06dab0 2023-10-06T02:28:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.287+0000 7f0382ffd700 1 -- 172.21.15.37:0/3450607778 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038400a7e0 con 0x7f038c06dab0 2023-10-06T02:28:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.287+0000 7f0391941700 1 -- 172.21.15.37:0/3450607778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038c15b800 con 0x7f038c06dab0 2023-10-06T02:28:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.287+0000 7f0382ffd700 1 -- 172.21.15.37:0/3450607778 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038400aba0 con 0x7f038c06dab0 2023-10-06T02:28:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.287+0000 7f0391941700 1 -- 172.21.15.37:0/3450607778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038c0b47b0 con 0x7f038c06dab0 2023-10-06T02:28:57.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.288+0000 7f0391941700 1 -- 172.21.15.37:0/3450607778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038c088ba0 con 0x7f038c06dab0 2023-10-06T02:28:57.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.289+0000 7f0382ffd700 1 -- 172.21.15.37:0/3450607778 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0384003030 con 0x7f038c06dab0 2023-10-06T02:28:57.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.289+0000 7f0382ffd700 1 --2- 172.21.15.37:0/3450607778 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f036c066f30 0x7f036c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.289+0000 7f0382ffd700 1 -- 172.21.15.37:0/3450607778 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f03840843d0 con 0x7f038c06dab0 2023-10-06T02:28:57.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.289+0000 7f038a7fc700 1 --2- 172.21.15.37:0/3450607778 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f036c066f30 0x7f036c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.290+0000 7f038a7fc700 1 --2- 172.21.15.37:0/3450607778 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f036c066f30 0x7f036c0693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f03740093f0 tx=0x7f0374017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:57.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.293+0000 7f0382ffd700 1 -- 172.21.15.37:0/3450607778 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0384051730 con 0x7f038c06dab0 2023-10-06T02:28:57.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.487+0000 7f0391941700 1 -- 172.21.15.37:0/3450607778 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f038c0cbc00 con 0x7f036c066f30 2023-10-06T02:28:57.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.487+0000 7f0382ffd700 1 -- 172.21.15.37:0/3450607778 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f038c0cbc00 con 0x7f036c066f30 2023-10-06T02:28:57.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.489+0000 7f0391941700 1 -- 172.21.15.37:0/3450607778 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f036c066f30 msgr2=0x7f036c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.489+0000 7f0391941700 1 --2- 172.21.15.37:0/3450607778 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f036c066f30 0x7f036c0693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f03740093f0 tx=0x7f0374017000 comp rx=0 tx=0).stop 2023-10-06T02:28:57.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.490+0000 7f0391941700 1 -- 172.21.15.37:0/3450607778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f038c06dab0 msgr2=0x7f038c156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.490+0000 7f0391941700 1 --2- 172.21.15.37:0/3450607778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f038c06dab0 0x7f038c156330 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f038400cb10 tx=0x7f03840017b0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.490+0000 7f0391941700 1 -- 172.21.15.37:0/3450607778 shutdown_connections 2023-10-06T02:28:57.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.490+0000 7f0391941700 1 --2- 172.21.15.37:0/3450607778 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f038c0cb080 0x7f038c0b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.490+0000 7f0391941700 1 --2- 172.21.15.37:0/3450607778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f038c06dab0 0x7f038c156330 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.490+0000 7f0391941700 1 --2- 172.21.15.37:0/3450607778 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f036c066f30 0x7f036c0693e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.490+0000 7f0391941700 1 --2- 172.21.15.37:0/3450607778 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f038c06de80 0x7f038c15ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.490+0000 7f0391941700 1 -- 172.21.15.37:0/3450607778 >> 172.21.15.37:0/3450607778 conn(0x7f038c0d0510 msgr2=0x7f038c0c9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:57.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.490+0000 7f0391941700 1 -- 172.21.15.37:0/3450607778 shutdown_connections 2023-10-06T02:28:57.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.490+0000 7f0391941700 1 -- 172.21.15.37:0/3450607778 wait complete. 2023-10-06T02:28:57.493 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T02:28:57.503 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T02:28:57.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:28:57.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.625+0000 7f9095358700 1 Processor -- start 2023-10-06T02:28:57.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.625+0000 7f9095358700 1 -- start start 2023-10-06T02:28:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.626+0000 7f9095358700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f909006df40 0x7f9090164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.626+0000 7f9095358700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909015d710 con 0x7f90901599c0 2023-10-06T02:28:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.626+0000 7f9095358700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909015d9f0 con 0x7f90901595f0 2023-10-06T02:28:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.626+0000 7f9095358700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90900cb320 con 0x7f909006df40 2023-10-06T02:28:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.626+0000 7f908e7fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f90901599c0 0x7f909006d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37470/0 (socket says 172.21.15.37:37470) 2023-10-06T02:28:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.626+0000 7f908e7fc700 1 -- 172.21.15.37:0/878428280 learned_addr learned my addr 172.21.15.37:0/878428280 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.626+0000 7f908f7fe700 1 --2- 172.21.15.37:0/878428280 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f909006df40 0x7f9090164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.626+0000 7f908dffb700 1 -- 172.21.15.37:0/878428280 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4137050080 0 0) 0x7f909015d710 con 0x7f90901599c0 2023-10-06T02:28:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.626+0000 7f908dffb700 1 -- 172.21.15.37:0/878428280 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f907c003570 con 0x7f90901599c0 2023-10-06T02:28:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.626+0000 7f908dffb700 1 -- 172.21.15.37:0/878428280 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1206786254 0 0) 0x7f909015d9f0 con 0x7f90901595f0 2023-10-06T02:28:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.626+0000 7f908f7fe700 1 -- 172.21.15.37:0/878428280 >> v1:172.21.15.191:6789/0 conn(0x7f90901595f0 legacy=0x7f90900b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.626+0000 7f908f7fe700 1 -- 172.21.15.37:0/878428280 >> v1:172.21.15.37:6789/0 conn(0x7f90901599c0 legacy=0x7f909006d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.626+0000 7f908f7fe700 1 -- 172.21.15.37:0/878428280 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909015dcd0 con 0x7f909006df40 2023-10-06T02:28:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.626+0000 7f908f7fe700 1 --2- 172.21.15.37:0/878428280 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f909006df40 0x7f9090164600 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9080009e90 tx=0x7f9080009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd6841f399e5bc02 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.627+0000 7f908dffb700 1 -- 172.21.15.37:0/878428280 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908000e070 con 0x7f909006df40 2023-10-06T02:28:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.627+0000 7f908dffb700 1 -- 172.21.15.37:0/878428280 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908000bc30 con 0x7f909006df40 2023-10-06T02:28:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.627+0000 7f908dffb700 1 -- 172.21.15.37:0/878428280 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080012430 con 0x7f909006df40 2023-10-06T02:28:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.627+0000 7f9095358700 1 -- 172.21.15.37:0/878428280 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f909006df40 msgr2=0x7f9090164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.627+0000 7f9095358700 1 --2- 172.21.15.37:0/878428280 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f909006df40 0x7f9090164600 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9080009e90 tx=0x7f9080009780 comp rx=0 tx=0).stop 2023-10-06T02:28:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.627+0000 7f9095358700 1 -- 172.21.15.37:0/878428280 shutdown_connections 2023-10-06T02:28:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.627+0000 7f9095358700 1 --2- 172.21.15.37:0/878428280 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f909006df40 0x7f9090164600 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.627+0000 7f9095358700 1 -- 172.21.15.37:0/878428280 >> 172.21.15.37:0/878428280 conn(0x7f90900ccf90 msgr2=0x7f90900cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.627+0000 7f9095358700 1 -- 172.21.15.37:0/878428280 shutdown_connections 2023-10-06T02:28:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.627+0000 7f9095358700 1 -- 172.21.15.37:0/878428280 wait complete. 2023-10-06T02:28:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.628+0000 7f9095358700 1 Processor -- start 2023-10-06T02:28:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.628+0000 7f9095358700 1 -- start start 2023-10-06T02:28:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.629+0000 7f9095358700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f909006df40 0x7f909016ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.629+0000 7f9095358700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90901595f0 0x7f9090167ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.629+0000 7f9095358700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90901599c0 0x7f90901699b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.629+0000 7f9095358700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909015c5e0 con 0x7f909006df40 2023-10-06T02:28:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.629+0000 7f9095358700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909016b220 con 0x7f90901595f0 2023-10-06T02:28:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.629+0000 7f9095358700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909016c540 con 0x7f90901599c0 2023-10-06T02:28:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.629+0000 7f908effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f909006df40 0x7f909016ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.629+0000 7f908effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f909006df40 0x7f909016ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47116/0 (socket says 172.21.15.37:47116) 2023-10-06T02:28:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.629+0000 7f908effd700 1 -- 172.21.15.37:0/4200809497 learned_addr learned my addr 172.21.15.37:0/4200809497 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.630+0000 7f908f7fe700 1 --2- 172.21.15.37:0/4200809497 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90901599c0 0x7f90901699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.630+0000 7f908e7fc700 1 --2- 172.21.15.37:0/4200809497 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90901595f0 0x7f9090167ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.630+0000 7f908effd700 1 -- 172.21.15.37:0/4200809497 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90901599c0 msgr2=0x7f90901699b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.630+0000 7f908effd700 1 --2- 172.21.15.37:0/4200809497 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90901599c0 0x7f90901699b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.630+0000 7f908effd700 1 -- 172.21.15.37:0/4200809497 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90901595f0 msgr2=0x7f9090167ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.630+0000 7f908effd700 1 --2- 172.21.15.37:0/4200809497 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90901595f0 0x7f9090167ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.630+0000 7f908effd700 1 -- 172.21.15.37:0/4200809497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9080009a20 con 0x7f909006df40 2023-10-06T02:28:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.630+0000 7f908f7fe700 1 --2- 172.21.15.37:0/4200809497 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90901599c0 0x7f90901699b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.630+0000 7f908effd700 1 --2- 172.21.15.37:0/4200809497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f909006df40 0x7f909016ace0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f908800c810 tx=0x7f9088007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.630+0000 7f9086ffd700 1 -- 172.21.15.37:0/4200809497 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9088011590 con 0x7f909006df40 2023-10-06T02:28:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.630+0000 7f9086ffd700 1 -- 172.21.15.37:0/4200809497 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9088011730 con 0x7f909006df40 2023-10-06T02:28:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.630+0000 7f9095358700 1 -- 172.21.15.37:0/4200809497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90901683e0 con 0x7f909006df40 2023-10-06T02:28:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.630+0000 7f9086ffd700 1 -- 172.21.15.37:0/4200809497 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9088011af0 con 0x7f909006df40 2023-10-06T02:28:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.630+0000 7f9095358700 1 -- 172.21.15.37:0/4200809497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909016bc10 con 0x7f909006df40 2023-10-06T02:28:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.631+0000 7f9095358700 1 -- 172.21.15.37:0/4200809497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9090088b10 con 0x7f909006df40 2023-10-06T02:28:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.631+0000 7f9086ffd700 1 -- 172.21.15.37:0/4200809497 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9088012420 con 0x7f909006df40 2023-10-06T02:28:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.632+0000 7f9086ffd700 1 --2- 172.21.15.37:0/4200809497 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9070066f30 0x7f90700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.632+0000 7f9086ffd700 1 -- 172.21.15.37:0/4200809497 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9088083950 con 0x7f909006df40 2023-10-06T02:28:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.632+0000 7f9086ffd700 1 --2- 172.21.15.37:0/4200809497 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x7f907006d4e0 0x7f907006f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.632+0000 7f9086ffd700 1 -- 172.21.15.37:0/4200809497 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f907006ffa0 con 0x7f907006d4e0 2023-10-06T02:28:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.632+0000 7f9086ffd700 1 -- 172.21.15.37:0/4200809497 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9088088220 con 0x7f909006df40 2023-10-06T02:28:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.632+0000 7f908e7fc700 1 --2- 172.21.15.37:0/4200809497 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9070066f30 0x7f90700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.632+0000 7f908f7fe700 1 --2- 172.21.15.37:0/4200809497 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x7f907006d4e0 0x7f907006f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.632+0000 7f908e7fc700 1 --2- 172.21.15.37:0/4200809497 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9070066f30 0x7f90700693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f909006d440 tx=0x7f9078009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.633+0000 7f908f7fe700 1 --2- 172.21.15.37:0/4200809497 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x7f907006d4e0 0x7f907006f8f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:57.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.633+0000 7f9086ffd700 1 -- 172.21.15.37:0/4200809497 <== osd.4 v2:172.21.15.191:6800/90852 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f907006ffa0 con 0x7f907006d4e0 2023-10-06T02:28:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.647+0000 7f9095358700 1 -- 172.21.15.37:0/4200809497 --> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f90900ca340 con 0x7f907006d4e0 2023-10-06T02:28:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.648+0000 7f9086ffd700 1 -- 172.21.15.37:0/4200809497 <== osd.4 v2:172.21.15.191:6800/90852 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f90900ca340 con 0x7f907006d4e0 2023-10-06T02:28:57.649 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:28:57.649 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T02:28:57.649 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:28:57.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.648+0000 7f9095358700 1 -- 172.21.15.37:0/4200809497 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x7f907006d4e0 msgr2=0x7f907006f8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.648+0000 7f9095358700 1 --2- 172.21.15.37:0/4200809497 >> [v2:172.21.15.191:6800/90852,v1:172.21.15.191:6801/90852] conn(0x7f907006d4e0 0x7f907006f8f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.648+0000 7f9095358700 1 -- 172.21.15.37:0/4200809497 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9070066f30 msgr2=0x7f90700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.648+0000 7f9095358700 1 --2- 172.21.15.37:0/4200809497 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9070066f30 0x7f90700693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f909006d440 tx=0x7f9078009040 comp rx=0 tx=0).stop 2023-10-06T02:28:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.648+0000 7f9095358700 1 -- 172.21.15.37:0/4200809497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f909006df40 msgr2=0x7f909016ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.648+0000 7f9095358700 1 --2- 172.21.15.37:0/4200809497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f909006df40 0x7f909016ace0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f908800c810 tx=0x7f9088007df0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.648+0000 7f908f7fe700 1 -- 172.21.15.37:0/4200809497 reap_dead start 2023-10-06T02:28:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.648+0000 7f9095358700 1 -- 172.21.15.37:0/4200809497 shutdown_connections 2023-10-06T02:28:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.648+0000 7f9095358700 1 -- 172.21.15.37:0/4200809497 >> 172.21.15.37:0/4200809497 conn(0x7f90900ccf90 msgr2=0x7f90901589f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.648+0000 7f9095358700 1 -- 172.21.15.37:0/4200809497 shutdown_connections 2023-10-06T02:28:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.648+0000 7f9095358700 1 -- 172.21.15.37:0/4200809497 wait complete. 2023-10-06T02:28:57.661 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T02:28:57.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.779+0000 7f4d37019700 1 Processor -- start 2023-10-06T02:28:57.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.779+0000 7f4d37019700 1 -- start start 2023-10-06T02:28:57.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.780+0000 7f4d37019700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d3006c270 0x7f4d3006c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.780+0000 7f4d37019700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d30159820 0x7f4d3015de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.780+0000 7f4d37019700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d300b3270 con 0x7f4d300b00a0 2023-10-06T02:28:57.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.780+0000 7f4d37019700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3015e340 con 0x7f4d30159820 2023-10-06T02:28:57.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.780+0000 7f4d37019700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300b0510 con 0x7f4d3006c270 2023-10-06T02:28:57.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.780+0000 7f4d355b6700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d30159820 0x7f4d3015de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.780+0000 7f4d2ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4d300b00a0 0x7f4d30159110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37480/0 (socket says 172.21.15.37:37480) 2023-10-06T02:28:57.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.780+0000 7f4d2ffff700 1 -- 172.21.15.37:0/1802298475 learned_addr learned my addr 172.21.15.37:0/1802298475 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:57.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.781+0000 7f4d34db5700 1 --2- 172.21.15.37:0/1802298475 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d3006c270 0x7f4d3006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.781+0000 7f4d355b6700 1 -- 172.21.15.37:0/1802298475 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d3006c270 msgr2=0x7f4d3006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:57.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.781+0000 7f4d355b6700 1 --2- 172.21.15.37:0/1802298475 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d3006c270 0x7f4d3006c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.781+0000 7f4d355b6700 1 -- 172.21.15.37:0/1802298475 >> v1:172.21.15.37:6789/0 conn(0x7f4d300b00a0 legacy=0x7f4d30159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.781+0000 7f4d355b6700 1 -- 172.21.15.37:0/1802298475 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d30159ca0 con 0x7f4d30159820 2023-10-06T02:28:57.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.781+0000 7f4d2f7fe700 1 -- 172.21.15.37:0/1802298475 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433708979 0 0) 0x7f4d300b3270 con 0x7f4d300b00a0 2023-10-06T02:28:57.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.781+0000 7f4d34db5700 1 --2- 172.21.15.37:0/1802298475 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d3006c270 0x7f4d3006c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:57.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.781+0000 7f4d355b6700 1 --2- 172.21.15.37:0/1802298475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d30159820 0x7f4d3015de00 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f4d180098e0 tx=0x7f4d180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911131e8bb84c70d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:57.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.781+0000 7f4d2f7fe700 1 -- 172.21.15.37:0/1802298475 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18009e80 con 0x7f4d30159820 2023-10-06T02:28:57.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.781+0000 7f4d2f7fe700 1 -- 172.21.15.37:0/1802298475 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1800b860 con 0x7f4d30159820 2023-10-06T02:28:57.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.781+0000 7f4d2f7fe700 1 -- 172.21.15.37:0/1802298475 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1800bbe0 con 0x7f4d30159820 2023-10-06T02:28:57.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.782+0000 7f4d37019700 1 -- 172.21.15.37:0/1802298475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d30159820 msgr2=0x7f4d3015de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.782+0000 7f4d37019700 1 --2- 172.21.15.37:0/1802298475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d30159820 0x7f4d3015de00 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f4d180098e0 tx=0x7f4d180091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.782+0000 7f4d37019700 1 -- 172.21.15.37:0/1802298475 shutdown_connections 2023-10-06T02:28:57.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.782+0000 7f4d37019700 1 --2- 172.21.15.37:0/1802298475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d30159820 0x7f4d3015de00 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.782+0000 7f4d37019700 1 --2- 172.21.15.37:0/1802298475 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d3006c270 0x7f4d3006c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.782+0000 7f4d37019700 1 -- 172.21.15.37:0/1802298475 >> 172.21.15.37:0/1802298475 conn(0x7f4d300ccf30 msgr2=0x7f4d300cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:57.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.782+0000 7f4d37019700 1 -- 172.21.15.37:0/1802298475 shutdown_connections 2023-10-06T02:28:57.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.782+0000 7f4d37019700 1 -- 172.21.15.37:0/1802298475 wait complete. 2023-10-06T02:28:57.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.783+0000 7f4d37019700 1 Processor -- start 2023-10-06T02:28:57.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.783+0000 7f4d37019700 1 -- start start 2023-10-06T02:28:57.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d37019700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d3006c270 0x7f4d3015ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d37019700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d300b00a0 0x7f4d3015b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d37019700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d30159820 0x7f4d300c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d37019700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3015c610 con 0x7f4d300b00a0 2023-10-06T02:28:57.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d37019700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300c51c0 con 0x7f4d30159820 2023-10-06T02:28:57.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d37019700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3015ba00 con 0x7f4d3006c270 2023-10-06T02:28:57.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d2ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d300b00a0 0x7f4d3015b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d2ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d300b00a0 0x7f4d3015b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47140/0 (socket says 172.21.15.37:47140) 2023-10-06T02:28:57.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d2ffff700 1 -- 172.21.15.37:0/3446184668 learned_addr learned my addr 172.21.15.37:0/3446184668 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:57.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d34db5700 1 --2- 172.21.15.37:0/3446184668 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d3006c270 0x7f4d3015ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d2ffff700 1 -- 172.21.15.37:0/3446184668 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d3006c270 msgr2=0x7f4d3015ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d2ffff700 1 --2- 172.21.15.37:0/3446184668 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d3006c270 0x7f4d3015ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d355b6700 1 --2- 172.21.15.37:0/3446184668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d30159820 0x7f4d300c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d2ffff700 1 -- 172.21.15.37:0/3446184668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d30159820 msgr2=0x7f4d300c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d2ffff700 1 --2- 172.21.15.37:0/3446184668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d30159820 0x7f4d300c5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d2ffff700 1 -- 172.21.15.37:0/3446184668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d18009420 con 0x7f4d300b00a0 2023-10-06T02:28:57.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d34db5700 1 --2- 172.21.15.37:0/3446184668 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d3006c270 0x7f4d3015ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:57.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d2ffff700 1 --2- 172.21.15.37:0/3446184668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d300b00a0 0x7f4d3015b3d0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000cd80 tx=0x7f4d20001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:57.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d2cff9700 1 -- 172.21.15.37:0/3446184668 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2000ab10 con 0x7f4d300b00a0 2023-10-06T02:28:57.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d2cff9700 1 -- 172.21.15.37:0/3446184668 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2000ac70 con 0x7f4d300b00a0 2023-10-06T02:28:57.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d37019700 1 -- 172.21.15.37:0/3446184668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d3015bce0 con 0x7f4d300b00a0 2023-10-06T02:28:57.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d2cff9700 1 -- 172.21.15.37:0/3446184668 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d200070f0 con 0x7f4d300b00a0 2023-10-06T02:28:57.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.784+0000 7f4d37019700 1 -- 172.21.15.37:0/3446184668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3015c2a0 con 0x7f4d300b00a0 2023-10-06T02:28:57.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.785+0000 7f4d37019700 1 -- 172.21.15.37:0/3446184668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d300b5880 con 0x7f4d300b00a0 2023-10-06T02:28:57.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.786+0000 7f4d2cff9700 1 -- 172.21.15.37:0/3446184668 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d200074e0 con 0x7f4d300b00a0 2023-10-06T02:28:57.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.786+0000 7f4d2cff9700 1 --2- 172.21.15.37:0/3446184668 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4d10066f30 0x7f4d100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:57.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.786+0000 7f4d2cff9700 1 -- 172.21.15.37:0/3446184668 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4d20084940 con 0x7f4d300b00a0 2023-10-06T02:28:57.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.786+0000 7f4d34db5700 1 --2- 172.21.15.37:0/3446184668 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4d10066f30 0x7f4d100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:57.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.787+0000 7f4d34db5700 1 --2- 172.21.15.37:0/3446184668 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4d10066f30 0x7f4d100693e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4d28008b20 tx=0x7f4d28008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:57.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.790+0000 7f4d2cff9700 1 -- 172.21.15.37:0/3446184668 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d20051d20 con 0x7f4d300b00a0 2023-10-06T02:28:57.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.983+0000 7f4d37019700 1 -- 172.21.15.37:0/3446184668 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d30088310 con 0x7f4d10066f30 2023-10-06T02:28:57.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.983+0000 7f4d2cff9700 1 -- 172.21.15.37:0/3446184668 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4d30088310 con 0x7f4d10066f30 2023-10-06T02:28:57.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.985+0000 7f4d37019700 1 -- 172.21.15.37:0/3446184668 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4d10066f30 msgr2=0x7f4d100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.985+0000 7f4d37019700 1 --2- 172.21.15.37:0/3446184668 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4d10066f30 0x7f4d100693e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4d28008b20 tx=0x7f4d28008040 comp rx=0 tx=0).stop 2023-10-06T02:28:57.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.985+0000 7f4d37019700 1 -- 172.21.15.37:0/3446184668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d300b00a0 msgr2=0x7f4d3015b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:57.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.985+0000 7f4d37019700 1 --2- 172.21.15.37:0/3446184668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d300b00a0 0x7f4d3015b3d0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000cd80 tx=0x7f4d20001ae0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.985+0000 7f4d37019700 1 -- 172.21.15.37:0/3446184668 shutdown_connections 2023-10-06T02:28:57.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.985+0000 7f4d37019700 1 --2- 172.21.15.37:0/3446184668 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f4d10066f30 0x7f4d100693e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.985+0000 7f4d37019700 1 --2- 172.21.15.37:0/3446184668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d30159820 0x7f4d300c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.985+0000 7f4d37019700 1 --2- 172.21.15.37:0/3446184668 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d3006c270 0x7f4d3015ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.985+0000 7f4d37019700 1 --2- 172.21.15.37:0/3446184668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d300b00a0 0x7f4d3015b3d0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:57.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.985+0000 7f4d37019700 1 -- 172.21.15.37:0/3446184668 >> 172.21.15.37:0/3446184668 conn(0x7f4d300ccf30 msgr2=0x7f4d30156ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:57.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.985+0000 7f4d37019700 1 -- 172.21.15.37:0/3446184668 shutdown_connections 2023-10-06T02:28:57.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:57.985+0000 7f4d37019700 1 -- 172.21.15.37:0/3446184668 wait complete. 2023-10-06T02:28:57.988 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T02:28:57.999 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T02:28:57.999 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:28:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.121+0000 7efce2bcd700 1 Processor -- start 2023-10-06T02:28:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.121+0000 7efce2bcd700 1 -- start start 2023-10-06T02:28:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.121+0000 7efce2bcd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efcdc159550 0x7efcdc159920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.121+0000 7efce2bcd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efcdc0b24d0 0x7efcdc15ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.121+0000 7efce2bcd700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7efcdc06c0b0 0x7efcdc06c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.121+0000 7efce2bcd700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcdc15e300 con 0x7efcdc0b24d0 2023-10-06T02:28:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.121+0000 7efce2bcd700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcdc06ca10 con 0x7efcdc06c0b0 2023-10-06T02:28:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.121+0000 7efce2bcd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc0b29b0 con 0x7efcdc159550 2023-10-06T02:28:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.122+0000 7efcdbfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efcdc0b24d0 0x7efcdc15ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.122+0000 7efcdbfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efcdc0b24d0 0x7efcdc15ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47152/0 (socket says 172.21.15.37:47152) 2023-10-06T02:28:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.122+0000 7efcdbfff700 1 -- 172.21.15.37:0/3409602109 learned_addr learned my addr 172.21.15.37:0/3409602109 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.122+0000 7efce116a700 1 --2- 172.21.15.37:0/3409602109 >> v2:172.21.15.191:3300/0 conn(0x7efcdc06c0b0 0x7efcdc06c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.122+0000 7efce0969700 1 --2- 172.21.15.37:0/3409602109 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efcdc159550 0x7efcdc159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.122+0000 7efcdbfff700 1 -- 172.21.15.37:0/3409602109 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efcdc159550 msgr2=0x7efcdc159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.122+0000 7efcdbfff700 1 --2- 172.21.15.37:0/3409602109 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efcdc159550 0x7efcdc159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.122+0000 7efcdbfff700 1 -- 172.21.15.37:0/3409602109 >> v2:172.21.15.191:3300/0 conn(0x7efcdc06c0b0 msgr2=0x7efcdc06c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.122+0000 7efcdbfff700 1 --2- 172.21.15.37:0/3409602109 >> v2:172.21.15.191:3300/0 conn(0x7efcdc06c0b0 0x7efcdc06c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.122+0000 7efcdbfff700 1 -- 172.21.15.37:0/3409602109 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0b2c90 con 0x7efcdc0b24d0 2023-10-06T02:28:58.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.122+0000 7efce0969700 1 --2- 172.21.15.37:0/3409602109 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efcdc159550 0x7efcdc159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:58.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.122+0000 7efcdbfff700 1 --2- 172.21.15.37:0/3409602109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcdc0b24d0 0x7efcdc15ddc0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7efcdc06be40 tx=0x7efccc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b25f6830620116e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:58.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.122+0000 7efcdb7fe700 1 -- 172.21.15.37:0/3409602109 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc00b860 con 0x7efcdc0b24d0 2023-10-06T02:28:58.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.122+0000 7efcdb7fe700 1 -- 172.21.15.37:0/3409602109 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efccc00b9c0 con 0x7efcdc0b24d0 2023-10-06T02:28:58.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.122+0000 7efcdb7fe700 1 -- 172.21.15.37:0/3409602109 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc00bd60 con 0x7efcdc0b24d0 2023-10-06T02:28:58.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.123+0000 7efce2bcd700 1 -- 172.21.15.37:0/3409602109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcdc0b24d0 msgr2=0x7efcdc15ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.123+0000 7efce2bcd700 1 --2- 172.21.15.37:0/3409602109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcdc0b24d0 0x7efcdc15ddc0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7efcdc06be40 tx=0x7efccc009250 comp rx=0 tx=0).stop 2023-10-06T02:28:58.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.123+0000 7efce2bcd700 1 -- 172.21.15.37:0/3409602109 shutdown_connections 2023-10-06T02:28:58.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.123+0000 7efce2bcd700 1 --2- 172.21.15.37:0/3409602109 >> v2:172.21.15.191:3300/0 conn(0x7efcdc06c0b0 0x7efcdc06c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.123+0000 7efce2bcd700 1 --2- 172.21.15.37:0/3409602109 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efcdc159550 0x7efcdc159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.123+0000 7efce2bcd700 1 --2- 172.21.15.37:0/3409602109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcdc0b24d0 0x7efcdc15ddc0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.123+0000 7efce2bcd700 1 -- 172.21.15.37:0/3409602109 >> 172.21.15.37:0/3409602109 conn(0x7efcdc06d900 msgr2=0x7efcdc06dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:58.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.123+0000 7efce2bcd700 1 -- 172.21.15.37:0/3409602109 shutdown_connections 2023-10-06T02:28:58.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.123+0000 7efce2bcd700 1 -- 172.21.15.37:0/3409602109 wait complete. 2023-10-06T02:28:58.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.124+0000 7efce2bcd700 1 Processor -- start 2023-10-06T02:28:58.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.124+0000 7efce2bcd700 1 -- start start 2023-10-06T02:28:58.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.125+0000 7efce2bcd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efcdc06c0b0 0x7efcdc0a6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.125+0000 7efce2bcd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efcdc0b24d0 0x7efcdc0cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.125+0000 7efce2bcd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcdc159550 0x7efcdc169b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.125+0000 7efce2bcd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc0ccc70 con 0x7efcdc159550 2023-10-06T02:28:58.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.125+0000 7efce2bcd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc15a780 con 0x7efcdc0b24d0 2023-10-06T02:28:58.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.125+0000 7efce2bcd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc0ccea0 con 0x7efcdc06c0b0 2023-10-06T02:28:58.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.125+0000 7efce116a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcdc159550 0x7efcdc169b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.125+0000 7efce116a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcdc159550 0x7efcdc169b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47158/0 (socket says 172.21.15.37:47158) 2023-10-06T02:28:58.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.125+0000 7efce116a700 1 -- 172.21.15.37:0/3344201595 learned_addr learned my addr 172.21.15.37:0/3344201595 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:58.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.125+0000 7efcdbfff700 1 --2- 172.21.15.37:0/3344201595 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efcdc0b24d0 0x7efcdc0cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.125+0000 7efce0969700 1 --2- 172.21.15.37:0/3344201595 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efcdc06c0b0 0x7efcdc0a6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.125+0000 7efce116a700 1 -- 172.21.15.37:0/3344201595 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efcdc06c0b0 msgr2=0x7efcdc0a6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.125+0000 7efce116a700 1 --2- 172.21.15.37:0/3344201595 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efcdc06c0b0 0x7efcdc0a6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.125+0000 7efce116a700 1 -- 172.21.15.37:0/3344201595 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efcdc0b24d0 msgr2=0x7efcdc0cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.125+0000 7efce116a700 1 --2- 172.21.15.37:0/3344201595 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efcdc0b24d0 0x7efcdc0cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.125+0000 7efce116a700 1 -- 172.21.15.37:0/3344201595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc0094f0 con 0x7efcdc159550 2023-10-06T02:28:58.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.125+0000 7efce0969700 1 --2- 172.21.15.37:0/3344201595 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efcdc06c0b0 0x7efcdc0a6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:58.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.125+0000 7efce116a700 1 --2- 172.21.15.37:0/3344201595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcdc159550 0x7efcdc169b50 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7efcc400d890 tx=0x7efcc4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:58.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.126+0000 7efcd8ff9700 1 -- 172.21.15.37:0/3344201595 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc40125f0 con 0x7efcdc159550 2023-10-06T02:28:58.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.126+0000 7efcd8ff9700 1 -- 172.21.15.37:0/3344201595 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc4012770 con 0x7efcdc159550 2023-10-06T02:28:58.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.126+0000 7efce2bcd700 1 -- 172.21.15.37:0/3344201595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc0cd180 con 0x7efcdc159550 2023-10-06T02:28:58.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.126+0000 7efcd8ff9700 1 -- 172.21.15.37:0/3344201595 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4012b30 con 0x7efcdc159550 2023-10-06T02:28:58.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.126+0000 7efce2bcd700 1 -- 172.21.15.37:0/3344201595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc155dd0 con 0x7efcdc159550 2023-10-06T02:28:58.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.126+0000 7efce2bcd700 1 -- 172.21.15.37:0/3344201595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efcdc088b20 con 0x7efcdc159550 2023-10-06T02:28:58.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.127+0000 7efcd8ff9700 1 -- 172.21.15.37:0/3344201595 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efcc401e460 con 0x7efcdc159550 2023-10-06T02:28:58.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.127+0000 7efcd8ff9700 1 --2- 172.21.15.37:0/3344201595 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7efcbc066f30 0x7efcbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.128+0000 7efcd8ff9700 1 -- 172.21.15.37:0/3344201595 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7efcc4084a30 con 0x7efcdc159550 2023-10-06T02:28:58.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.128+0000 7efcd8ff9700 1 --2- 172.21.15.37:0/3344201595 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x7efcbc06d4e0 0x7efcbc06f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.128+0000 7efcd8ff9700 1 -- 172.21.15.37:0/3344201595 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efcbc06ffa0 con 0x7efcbc06d4e0 2023-10-06T02:28:58.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.128+0000 7efce0969700 1 --2- 172.21.15.37:0/3344201595 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7efcbc066f30 0x7efcbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.128+0000 7efcd8ff9700 1 -- 172.21.15.37:0/3344201595 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcc4089240 con 0x7efcdc159550 2023-10-06T02:28:58.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.128+0000 7efcdbfff700 1 --2- 172.21.15.37:0/3344201595 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x7efcbc06d4e0 0x7efcbc06f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.128+0000 7efce0969700 1 --2- 172.21.15.37:0/3344201595 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7efcbc066f30 0x7efcbc0693e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7efcdc15ca10 tx=0x7efcd4007700 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:58.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.128+0000 7efcdbfff700 1 --2- 172.21.15.37:0/3344201595 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x7efcbc06d4e0 0x7efcbc06f8f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:58.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.129+0000 7efcd8ff9700 1 -- 172.21.15.37:0/3344201595 <== osd.5 v2:172.21.15.191:6808/90853 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7efcbc06ffa0 con 0x7efcbc06d4e0 2023-10-06T02:28:58.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.143+0000 7efce2bcd700 1 -- 172.21.15.37:0/3344201595 --> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efcdc0cd620 con 0x7efcbc06d4e0 2023-10-06T02:28:58.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.143+0000 7efcd8ff9700 1 -- 172.21.15.37:0/3344201595 <== osd.5 v2:172.21.15.191:6808/90853 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7efcdc0cd620 con 0x7efcbc06d4e0 2023-10-06T02:28:58.145 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:28:58.145 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T02:28:58.145 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:28:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.144+0000 7efce2bcd700 1 -- 172.21.15.37:0/3344201595 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x7efcbc06d4e0 msgr2=0x7efcbc06f8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.144+0000 7efce2bcd700 1 --2- 172.21.15.37:0/3344201595 >> [v2:172.21.15.191:6808/90853,v1:172.21.15.191:6809/90853] conn(0x7efcbc06d4e0 0x7efcbc06f8f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.144+0000 7efce2bcd700 1 -- 172.21.15.37:0/3344201595 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7efcbc066f30 msgr2=0x7efcbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.144+0000 7efce2bcd700 1 --2- 172.21.15.37:0/3344201595 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7efcbc066f30 0x7efcbc0693e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7efcdc15ca10 tx=0x7efcd4007700 comp rx=0 tx=0).stop 2023-10-06T02:28:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.144+0000 7efce2bcd700 1 -- 172.21.15.37:0/3344201595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcdc159550 msgr2=0x7efcdc169b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.144+0000 7efce2bcd700 1 --2- 172.21.15.37:0/3344201595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcdc159550 0x7efcdc169b50 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7efcc400d890 tx=0x7efcc4008040 comp rx=0 tx=0).stop 2023-10-06T02:28:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.144+0000 7efce116a700 1 -- 172.21.15.37:0/3344201595 reap_dead start 2023-10-06T02:28:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.144+0000 7efce2bcd700 1 -- 172.21.15.37:0/3344201595 shutdown_connections 2023-10-06T02:28:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.144+0000 7efce2bcd700 1 -- 172.21.15.37:0/3344201595 >> 172.21.15.37:0/3344201595 conn(0x7efcdc06d900 msgr2=0x7efcdc156520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.144+0000 7efce2bcd700 1 -- 172.21.15.37:0/3344201595 shutdown_connections 2023-10-06T02:28:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.144+0000 7efce2bcd700 1 -- 172.21.15.37:0/3344201595 wait complete. 2023-10-06T02:28:58.157 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T02:28:58.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.275+0000 7f52c9cc8700 1 Processor -- start 2023-10-06T02:28:58.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.276+0000 7f52c9cc8700 1 -- start start 2023-10-06T02:28:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.276+0000 7f52c9cc8700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f52c4067ea0 0x7f52c41641f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.276+0000 7f52c9cc8700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c406e470 con 0x7f52c4159340 2023-10-06T02:28:58.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.276+0000 7f52c9cc8700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c406d860 con 0x7f52c4067a30 2023-10-06T02:28:58.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.276+0000 7f52c9cc8700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c406db40 con 0x7f52c4067ea0 2023-10-06T02:28:58.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.276+0000 7f52c37fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f52c4159340 0x7f52c40b3a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37492/0 (socket says 172.21.15.37:37492) 2023-10-06T02:28:58.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.277+0000 7f52c37fe700 1 -- 172.21.15.37:0/350270353 learned_addr learned my addr 172.21.15.37:0/350270353 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:58.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.277+0000 7f52c3fff700 1 --2- 172.21.15.37:0/350270353 >> v2:172.21.15.191:3300/0 conn(0x7f52c4067ea0 0x7f52c41641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.277+0000 7f52c27fc700 1 -- 172.21.15.37:0/350270353 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856967456 0 0) 0x7f52c406e470 con 0x7f52c4159340 2023-10-06T02:28:58.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.277+0000 7f52c27fc700 1 -- 172.21.15.37:0/350270353 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52ac003570 con 0x7f52c4159340 2023-10-06T02:28:58.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.277+0000 7f52c3fff700 1 -- 172.21.15.37:0/350270353 >> v1:172.21.15.191:6789/0 conn(0x7f52c4067a30 legacy=0x7f52c4159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.277+0000 7f52c3fff700 1 -- 172.21.15.37:0/350270353 >> v1:172.21.15.37:6789/0 conn(0x7f52c4159340 legacy=0x7f52c40b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.277+0000 7f52c3fff700 1 -- 172.21.15.37:0/350270353 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c406de20 con 0x7f52c4067ea0 2023-10-06T02:28:58.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.277+0000 7f52c3fff700 1 --2- 172.21.15.37:0/350270353 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52c4067ea0 0x7f52c41641f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009e60 tx=0x7f52bc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b711a723f3a48561 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:58.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.277+0000 7f52c27fc700 1 -- 172.21.15.37:0/350270353 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc00e070 con 0x7f52c4067ea0 2023-10-06T02:28:58.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.277+0000 7f52c27fc700 1 -- 172.21.15.37:0/350270353 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc00bb60 con 0x7f52c4067ea0 2023-10-06T02:28:58.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.277+0000 7f52c27fc700 1 -- 172.21.15.37:0/350270353 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc012430 con 0x7f52c4067ea0 2023-10-06T02:28:58.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.278+0000 7f52c9cc8700 1 -- 172.21.15.37:0/350270353 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52c4067ea0 msgr2=0x7f52c41641f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.278+0000 7f52c9cc8700 1 --2- 172.21.15.37:0/350270353 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52c4067ea0 0x7f52c41641f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009e60 tx=0x7f52bc009780 comp rx=0 tx=0).stop 2023-10-06T02:28:58.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.278+0000 7f52c9cc8700 1 -- 172.21.15.37:0/350270353 shutdown_connections 2023-10-06T02:28:58.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.278+0000 7f52c9cc8700 1 --2- 172.21.15.37:0/350270353 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52c4067ea0 0x7f52c41641f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.278+0000 7f52c9cc8700 1 -- 172.21.15.37:0/350270353 >> 172.21.15.37:0/350270353 conn(0x7f52c40ce330 msgr2=0x7f52c40ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:58.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.278+0000 7f52c9cc8700 1 -- 172.21.15.37:0/350270353 shutdown_connections 2023-10-06T02:28:58.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.278+0000 7f52c9cc8700 1 -- 172.21.15.37:0/350270353 wait complete. 2023-10-06T02:28:58.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.279+0000 7f52c9cc8700 1 Processor -- start 2023-10-06T02:28:58.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.279+0000 7f52c9cc8700 1 -- start start 2023-10-06T02:28:58.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.280+0000 7f52c9cc8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52c4067a30 0x7f52c4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.280+0000 7f52c9cc8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52c4067ea0 0x7f52c41519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.280+0000 7f52c9cc8700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52c4159340 0x7f52c4151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.280+0000 7f52c9cc8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c4156520 con 0x7f52c4067a30 2023-10-06T02:28:58.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.280+0000 7f52c9cc8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c4153a50 con 0x7f52c4067ea0 2023-10-06T02:28:58.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.280+0000 7f52c9cc8700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c415d300 con 0x7f52c4159340 2023-10-06T02:28:58.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.280+0000 7f52c37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52c4067a30 0x7f52c4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.280+0000 7f52c37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52c4067a30 0x7f52c4155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47164/0 (socket says 172.21.15.37:47164) 2023-10-06T02:28:58.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.280+0000 7f52c37fe700 1 -- 172.21.15.37:0/3055273058 learned_addr learned my addr 172.21.15.37:0/3055273058 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:58.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.280+0000 7f52c2ffd700 1 --2- 172.21.15.37:0/3055273058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52c4067ea0 0x7f52c41519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.280+0000 7f52c37fe700 1 -- 172.21.15.37:0/3055273058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52c4159340 msgr2=0x7f52c4151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.280+0000 7f52c3fff700 1 --2- 172.21.15.37:0/3055273058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52c4159340 0x7f52c4151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.280+0000 7f52c37fe700 1 --2- 172.21.15.37:0/3055273058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52c4159340 0x7f52c4151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.280+0000 7f52c37fe700 1 -- 172.21.15.37:0/3055273058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52c4067ea0 msgr2=0x7f52c41519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.280+0000 7f52c37fe700 1 --2- 172.21.15.37:0/3055273058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52c4067ea0 0x7f52c41519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.280+0000 7f52c37fe700 1 -- 172.21.15.37:0/3055273058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc009a20 con 0x7f52c4067a30 2023-10-06T02:28:58.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.280+0000 7f52c2ffd700 1 --2- 172.21.15.37:0/3055273058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52c4067ea0 0x7f52c41519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:58.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.281+0000 7f52c37fe700 1 --2- 172.21.15.37:0/3055273058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52c4067a30 0x7f52c4155fe0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f52b400c590 tx=0x7f52b4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:58.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.281+0000 7f52ab7fe700 1 -- 172.21.15.37:0/3055273058 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4005b30 con 0x7f52c4067a30 2023-10-06T02:28:58.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.281+0000 7f52ab7fe700 1 -- 172.21.15.37:0/3055273058 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b4005cb0 con 0x7f52c4067a30 2023-10-06T02:28:58.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.281+0000 7f52c9cc8700 1 -- 172.21.15.37:0/3055273058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c4153d10 con 0x7f52c4067a30 2023-10-06T02:28:58.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.281+0000 7f52ab7fe700 1 -- 172.21.15.37:0/3055273058 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4007320 con 0x7f52c4067a30 2023-10-06T02:28:58.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.281+0000 7f52c9cc8700 1 -- 172.21.15.37:0/3055273058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c415cd40 con 0x7f52c4067a30 2023-10-06T02:28:58.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.282+0000 7f52c9cc8700 1 -- 172.21.15.37:0/3055273058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c406a5d0 con 0x7f52c4067a30 2023-10-06T02:28:58.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.282+0000 7f52ab7fe700 1 -- 172.21.15.37:0/3055273058 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52b401b3b0 con 0x7f52c4067a30 2023-10-06T02:28:58.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.282+0000 7f52ab7fe700 1 --2- 172.21.15.37:0/3055273058 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f52b0066f30 0x7f52b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.283+0000 7f52ab7fe700 1 -- 172.21.15.37:0/3055273058 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f52b4083a40 con 0x7f52c4067a30 2023-10-06T02:28:58.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.283+0000 7f52c2ffd700 1 --2- 172.21.15.37:0/3055273058 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f52b0066f30 0x7f52b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.283+0000 7f52c2ffd700 1 --2- 172.21.15.37:0/3055273058 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f52b0066f30 0x7f52b00693e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f52c416cb90 tx=0x7f52b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:58.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.287+0000 7f52ab7fe700 1 -- 172.21.15.37:0/3055273058 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52b4050d00 con 0x7f52c4067a30 2023-10-06T02:28:58.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.479+0000 7f52c9cc8700 1 -- 172.21.15.37:0/3055273058 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f52c406e100 con 0x7f52b0066f30 2023-10-06T02:28:58.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.479+0000 7f52ab7fe700 1 -- 172.21.15.37:0/3055273058 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f52c406e100 con 0x7f52b0066f30 2023-10-06T02:28:58.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.482+0000 7f52c9cc8700 1 -- 172.21.15.37:0/3055273058 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f52b0066f30 msgr2=0x7f52b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.482+0000 7f52c9cc8700 1 --2- 172.21.15.37:0/3055273058 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f52b0066f30 0x7f52b00693e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f52c416cb90 tx=0x7f52b8009040 comp rx=0 tx=0).stop 2023-10-06T02:28:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.482+0000 7f52c9cc8700 1 -- 172.21.15.37:0/3055273058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52c4067a30 msgr2=0x7f52c4155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.482+0000 7f52c9cc8700 1 --2- 172.21.15.37:0/3055273058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52c4067a30 0x7f52c4155fe0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f52b400c590 tx=0x7f52b4007e00 comp rx=0 tx=0).stop 2023-10-06T02:28:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.482+0000 7f52c9cc8700 1 -- 172.21.15.37:0/3055273058 shutdown_connections 2023-10-06T02:28:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.482+0000 7f52c9cc8700 1 --2- 172.21.15.37:0/3055273058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52c4159340 0x7f52c4151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.482+0000 7f52c9cc8700 1 --2- 172.21.15.37:0/3055273058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52c4067a30 0x7f52c4155fe0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.482+0000 7f52c9cc8700 1 --2- 172.21.15.37:0/3055273058 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f52b0066f30 0x7f52b00693e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.482+0000 7f52c9cc8700 1 --2- 172.21.15.37:0/3055273058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52c4067ea0 0x7f52c41519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.482+0000 7f52c9cc8700 1 -- 172.21.15.37:0/3055273058 >> 172.21.15.37:0/3055273058 conn(0x7f52c40ce330 msgr2=0x7f52c40ae7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.482+0000 7f52c9cc8700 1 -- 172.21.15.37:0/3055273058 shutdown_connections 2023-10-06T02:28:58.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.482+0000 7f52c9cc8700 1 -- 172.21.15.37:0/3055273058 wait complete. 2023-10-06T02:28:58.485 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T02:28:58.495 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T02:28:58.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:28:58.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.617+0000 7f5ea8a48700 1 Processor -- start 2023-10-06T02:28:58.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.617+0000 7f5ea8a48700 1 -- start start 2023-10-06T02:28:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea8a48700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5ea41593a0 0x7f5ea40b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea8a48700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ea4159770 0x7f5ea40d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea8a48700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5ea40d09d0 0x7f5ea415d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea8a48700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea40cbbc0 con 0x7f5ea40d09d0 2023-10-06T02:28:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea8a48700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea40d0e10 con 0x7f5ea41593a0 2023-10-06T02:28:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea8a48700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea40b0710 con 0x7f5ea4159770 2023-10-06T02:28:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea2d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5ea40d09d0 0x7f5ea415d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea2d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5ea40d09d0 0x7f5ea415d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47172/0 (socket says 172.21.15.37:47172) 2023-10-06T02:28:58.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea2d9d700 1 -- 172.21.15.37:0/3069102273 learned_addr learned my addr 172.21.15.37:0/3069102273 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea259c700 1 --2- 172.21.15.37:0/3069102273 >> v2:172.21.15.191:3300/0 conn(0x7f5ea41593a0 0x7f5ea40b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea1d9b700 1 --2- 172.21.15.37:0/3069102273 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ea4159770 0x7f5ea40d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea2d9d700 1 -- 172.21.15.37:0/3069102273 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ea4159770 msgr2=0x7f5ea40d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea2d9d700 1 --2- 172.21.15.37:0/3069102273 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ea4159770 0x7f5ea40d0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea2d9d700 1 -- 172.21.15.37:0/3069102273 >> v2:172.21.15.191:3300/0 conn(0x7f5ea41593a0 msgr2=0x7f5ea40b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea2d9d700 1 --2- 172.21.15.37:0/3069102273 >> v2:172.21.15.191:3300/0 conn(0x7f5ea41593a0 0x7f5ea40b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea2d9d700 1 -- 172.21.15.37:0/3069102273 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea40cb290 con 0x7f5ea40d09d0 2023-10-06T02:28:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea1d9b700 1 --2- 172.21.15.37:0/3069102273 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ea4159770 0x7f5ea40d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea259c700 1 --2- 172.21.15.37:0/3069102273 >> v2:172.21.15.191:3300/0 conn(0x7f5ea41593a0 0x7f5ea40b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea2d9d700 1 --2- 172.21.15.37:0/3069102273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ea40d09d0 0x7f5ea415d530 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4089360 tx=0x7f5e9c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9715caa7d33ca60 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea159a700 1 -- 172.21.15.37:0/3069102273 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c00e070 con 0x7f5ea40d09d0 2023-10-06T02:28:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea159a700 1 -- 172.21.15.37:0/3069102273 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c00ba50 con 0x7f5ea40d09d0 2023-10-06T02:28:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.618+0000 7f5ea159a700 1 -- 172.21.15.37:0/3069102273 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c0092e0 con 0x7f5ea40d09d0 2023-10-06T02:28:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.619+0000 7f5ea8a48700 1 -- 172.21.15.37:0/3069102273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ea40d09d0 msgr2=0x7f5ea415d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.619+0000 7f5ea8a48700 1 --2- 172.21.15.37:0/3069102273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ea40d09d0 0x7f5ea415d530 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4089360 tx=0x7f5e9c009840 comp rx=0 tx=0).stop 2023-10-06T02:28:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.619+0000 7f5ea8a48700 1 -- 172.21.15.37:0/3069102273 shutdown_connections 2023-10-06T02:28:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.619+0000 7f5ea8a48700 1 --2- 172.21.15.37:0/3069102273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ea40d09d0 0x7f5ea415d530 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.619+0000 7f5ea8a48700 1 --2- 172.21.15.37:0/3069102273 >> v2:172.21.15.191:3300/0 conn(0x7f5ea41593a0 0x7f5ea40b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.619+0000 7f5ea8a48700 1 --2- 172.21.15.37:0/3069102273 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ea4159770 0x7f5ea40d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.619+0000 7f5ea8a48700 1 -- 172.21.15.37:0/3069102273 >> 172.21.15.37:0/3069102273 conn(0x7f5ea406c0b0 msgr2=0x7f5ea406c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.619+0000 7f5ea8a48700 1 -- 172.21.15.37:0/3069102273 shutdown_connections 2023-10-06T02:28:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.619+0000 7f5ea8a48700 1 -- 172.21.15.37:0/3069102273 wait complete. 2023-10-06T02:28:58.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.620+0000 7f5ea8a48700 1 Processor -- start 2023-10-06T02:28:58.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.620+0000 7f5ea8a48700 1 -- start start 2023-10-06T02:28:58.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.621+0000 7f5ea8a48700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ea40d09d0 0x7f5ea414f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.621+0000 7f5ea8a48700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ea41593a0 0x7f5ea40c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.621+0000 7f5ea8a48700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ea4159770 0x7f5ea40c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.621+0000 7f5ea8a48700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea4158bd0 con 0x7f5ea4159770 2023-10-06T02:28:58.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.621+0000 7f5ea8a48700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea4150df0 con 0x7f5ea41593a0 2023-10-06T02:28:58.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.621+0000 7f5ea8a48700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea41550b0 con 0x7f5ea40d09d0 2023-10-06T02:28:58.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.621+0000 7f5ea2d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ea4159770 0x7f5ea40c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.621+0000 7f5ea2d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ea4159770 0x7f5ea40c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47180/0 (socket says 172.21.15.37:47180) 2023-10-06T02:28:58.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.621+0000 7f5ea2d9d700 1 -- 172.21.15.37:0/3233238492 learned_addr learned my addr 172.21.15.37:0/3233238492 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:58.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.621+0000 7f5ea1d9b700 1 --2- 172.21.15.37:0/3233238492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ea41593a0 0x7f5ea40c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.621+0000 7f5ea259c700 1 --2- 172.21.15.37:0/3233238492 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ea40d09d0 0x7f5ea414f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.621+0000 7f5ea2d9d700 1 -- 172.21.15.37:0/3233238492 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ea40d09d0 msgr2=0x7f5ea414f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.621+0000 7f5ea2d9d700 1 --2- 172.21.15.37:0/3233238492 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ea40d09d0 0x7f5ea414f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.621+0000 7f5ea2d9d700 1 -- 172.21.15.37:0/3233238492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ea41593a0 msgr2=0x7f5ea40c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.621+0000 7f5ea2d9d700 1 --2- 172.21.15.37:0/3233238492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ea41593a0 0x7f5ea40c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.621+0000 7f5ea2d9d700 1 -- 172.21.15.37:0/3233238492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9c009ae0 con 0x7f5ea4159770 2023-10-06T02:28:58.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.621+0000 7f5ea259c700 1 --2- 172.21.15.37:0/3233238492 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ea40d09d0 0x7f5ea414f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:58.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.621+0000 7f5ea2d9d700 1 --2- 172.21.15.37:0/3233238492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ea4159770 0x7f5ea40c8810 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4063e80 tx=0x7f5e9c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:58.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.622+0000 7f5e927fc700 1 -- 172.21.15.37:0/3233238492 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c0094e0 con 0x7f5ea4159770 2023-10-06T02:28:58.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.622+0000 7f5e927fc700 1 -- 172.21.15.37:0/3233238492 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c0032f0 con 0x7f5ea4159770 2023-10-06T02:28:58.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.622+0000 7f5ea8a48700 1 -- 172.21.15.37:0/3233238492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea41504c0 con 0x7f5ea4159770 2023-10-06T02:28:58.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.622+0000 7f5e927fc700 1 -- 172.21.15.37:0/3233238492 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c0256b0 con 0x7f5ea4159770 2023-10-06T02:28:58.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.622+0000 7f5ea8a48700 1 -- 172.21.15.37:0/3233238492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea4150a80 con 0x7f5ea4159770 2023-10-06T02:28:58.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.622+0000 7f5ea8a48700 1 -- 172.21.15.37:0/3233238492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ea4088b90 con 0x7f5ea4159770 2023-10-06T02:28:58.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.623+0000 7f5e927fc700 1 -- 172.21.15.37:0/3233238492 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5e9c003040 con 0x7f5ea4159770 2023-10-06T02:28:58.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.623+0000 7f5e927fc700 1 --2- 172.21.15.37:0/3233238492 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5e84066f30 0x7f5e840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.624+0000 7f5e927fc700 1 -- 172.21.15.37:0/3233238492 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5e9c0864d0 con 0x7f5ea4159770 2023-10-06T02:28:58.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.624+0000 7f5e927fc700 1 --2- 172.21.15.37:0/3233238492 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x7f5e8406d370 0x7f5e8406f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.624+0000 7f5e927fc700 1 -- 172.21.15.37:0/3233238492 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e8406fe30 con 0x7f5e8406d370 2023-10-06T02:28:58.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.624+0000 7f5e927fc700 1 -- 172.21.15.37:0/3233238492 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e9c0868a0 con 0x7f5ea4159770 2023-10-06T02:28:58.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.624+0000 7f5ea259c700 1 --2- 172.21.15.37:0/3233238492 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5e84066f30 0x7f5e840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.624+0000 7f5ea1d9b700 1 --2- 172.21.15.37:0/3233238492 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x7f5e8406d370 0x7f5e8406f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.624+0000 7f5ea259c700 1 --2- 172.21.15.37:0/3233238492 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5e84066f30 0x7f5e840693e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400ab50 tx=0x7f5e94008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:58.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.624+0000 7f5ea1d9b700 1 --2- 172.21.15.37:0/3233238492 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x7f5e8406d370 0x7f5e8406f780 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:58.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.625+0000 7f5e927fc700 1 -- 172.21.15.37:0/3233238492 <== osd.6 v2:172.21.15.191:6824/90897 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5e8406fe30 con 0x7f5e8406d370 2023-10-06T02:28:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.639+0000 7f5ea8a48700 1 -- 172.21.15.37:0/3233238492 --> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5ea404bb80 con 0x7f5e8406d370 2023-10-06T02:28:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.640+0000 7f5e927fc700 1 -- 172.21.15.37:0/3233238492 <== osd.6 v2:172.21.15.191:6824/90897 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5ea404bb80 con 0x7f5e8406d370 2023-10-06T02:28:58.641 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:28:58.641 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T02:28:58.641 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:28:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.640+0000 7f5ea8a48700 1 -- 172.21.15.37:0/3233238492 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x7f5e8406d370 msgr2=0x7f5e8406f780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.640+0000 7f5ea8a48700 1 --2- 172.21.15.37:0/3233238492 >> [v2:172.21.15.191:6824/90897,v1:172.21.15.191:6825/90897] conn(0x7f5e8406d370 0x7f5e8406f780 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.640+0000 7f5ea8a48700 1 -- 172.21.15.37:0/3233238492 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5e84066f30 msgr2=0x7f5e840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.640+0000 7f5ea8a48700 1 --2- 172.21.15.37:0/3233238492 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5e84066f30 0x7f5e840693e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400ab50 tx=0x7f5e94008040 comp rx=0 tx=0).stop 2023-10-06T02:28:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.640+0000 7f5ea8a48700 1 -- 172.21.15.37:0/3233238492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ea4159770 msgr2=0x7f5ea40c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.640+0000 7f5ea8a48700 1 --2- 172.21.15.37:0/3233238492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ea4159770 0x7f5ea40c8810 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4063e80 tx=0x7f5e9c018000 comp rx=0 tx=0).stop 2023-10-06T02:28:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.640+0000 7f5ea2d9d700 1 -- 172.21.15.37:0/3233238492 reap_dead start 2023-10-06T02:28:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.640+0000 7f5ea8a48700 1 -- 172.21.15.37:0/3233238492 shutdown_connections 2023-10-06T02:28:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.640+0000 7f5ea8a48700 1 -- 172.21.15.37:0/3233238492 >> 172.21.15.37:0/3233238492 conn(0x7f5ea406c0b0 msgr2=0x7f5ea40c6130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:58.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.640+0000 7f5ea8a48700 1 -- 172.21.15.37:0/3233238492 shutdown_connections 2023-10-06T02:28:58.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.640+0000 7f5ea8a48700 1 -- 172.21.15.37:0/3233238492 wait complete. 2023-10-06T02:28:58.653 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T02:28:58.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.772+0000 7f79235af700 1 Processor -- start 2023-10-06T02:28:58.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.772+0000 7f79235af700 1 -- start start 2023-10-06T02:28:58.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.773+0000 7f79235af700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f791c06dab0 0x7f791c0cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.773+0000 7f79235af700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f791c06de80 0x7f791c0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.773+0000 7f79235af700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791c0cc250 con 0x7f791c0cb080 2023-10-06T02:28:58.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.773+0000 7f79235af700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f791c0b0e00 con 0x7f791c06de80 2023-10-06T02:28:58.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.773+0000 7f79235af700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791c0ccc20 con 0x7f791c06dab0 2023-10-06T02:28:58.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.773+0000 7f7921b4c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f791c06de80 0x7f791c0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.773+0000 7f792134b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f791c06dab0 0x7f791c0cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.773+0000 7f7920b4a700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f791c0cb080 0x7f791c0b01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:34682/0 (socket says 172.21.15.37:34682) 2023-10-06T02:28:58.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.773+0000 7f7921b4c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f791c06de80 0x7f791c0b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.37:43408/0 (socket says 172.21.15.37:43408) 2023-10-06T02:28:58.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.773+0000 7f7920b4a700 1 -- 172.21.15.37:0/2190616090 learned_addr learned my addr 172.21.15.37:0/2190616090 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:58.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.773+0000 7f792134b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f791c06dab0 0x7f791c0cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.37:36192/0 (socket says 172.21.15.37:36192) 2023-10-06T02:28:58.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.774+0000 7f791bfff700 1 -- 172.21.15.37:0/2190616090 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657447206 0 0) 0x7f791c0cc250 con 0x7f791c0cb080 2023-10-06T02:28:58.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.774+0000 7f791bfff700 1 -- 172.21.15.37:0/2190616090 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7904003570 con 0x7f791c0cb080 2023-10-06T02:28:58.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.774+0000 7f792134b700 1 -- 172.21.15.37:0/2190616090 >> v2:172.21.15.191:3300/0 conn(0x7f791c06de80 msgr2=0x7f791c0b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:58.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.774+0000 7f792134b700 1 --2- 172.21.15.37:0/2190616090 >> v2:172.21.15.191:3300/0 conn(0x7f791c06de80 0x7f791c0b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.774+0000 7f792134b700 1 -- 172.21.15.37:0/2190616090 >> v1:172.21.15.191:6789/0 conn(0x7f791c0cb080 legacy=0x7f791c0b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.774+0000 7f792134b700 1 -- 172.21.15.37:0/2190616090 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c0cb640 con 0x7f791c06dab0 2023-10-06T02:28:58.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.774+0000 7f7921b4c700 1 --2- 172.21.15.37:0/2190616090 >> v2:172.21.15.191:3300/0 conn(0x7f791c06de80 0x7f791c0b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:58.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.774+0000 7f792134b700 1 --2- 172.21.15.37:0/2190616090 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f791c06dab0 0x7f791c0cc6e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f790c009e60 tx=0x7f790c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fde603cb187211e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:58.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.774+0000 7f791bfff700 1 -- 172.21.15.37:0/2190616090 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c00e070 con 0x7f791c06dab0 2023-10-06T02:28:58.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.774+0000 7f791bfff700 1 -- 172.21.15.37:0/2190616090 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790c00bab0 con 0x7f791c06dab0 2023-10-06T02:28:58.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.774+0000 7f791bfff700 1 -- 172.21.15.37:0/2190616090 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c00be70 con 0x7f791c06dab0 2023-10-06T02:28:58.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.775+0000 7f79235af700 1 -- 172.21.15.37:0/2190616090 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f791c06dab0 msgr2=0x7f791c0cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.775+0000 7f79235af700 1 --2- 172.21.15.37:0/2190616090 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f791c06dab0 0x7f791c0cc6e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f790c009e60 tx=0x7f790c009780 comp rx=0 tx=0).stop 2023-10-06T02:28:58.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.775+0000 7f79235af700 1 -- 172.21.15.37:0/2190616090 shutdown_connections 2023-10-06T02:28:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.775+0000 7f79235af700 1 --2- 172.21.15.37:0/2190616090 >> v2:172.21.15.191:3300/0 conn(0x7f791c06de80 0x7f791c0b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.775+0000 7f79235af700 1 --2- 172.21.15.37:0/2190616090 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f791c06dab0 0x7f791c0cc6e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.775+0000 7f79235af700 1 -- 172.21.15.37:0/2190616090 >> 172.21.15.37:0/2190616090 conn(0x7f791c0d0510 msgr2=0x7f791c0d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.775+0000 7f79235af700 1 -- 172.21.15.37:0/2190616090 shutdown_connections 2023-10-06T02:28:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.775+0000 7f79235af700 1 -- 172.21.15.37:0/2190616090 wait complete. 2023-10-06T02:28:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.776+0000 7f79235af700 1 Processor -- start 2023-10-06T02:28:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.776+0000 7f79235af700 1 -- start start 2023-10-06T02:28:58.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.777+0000 7f79235af700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f791c06dab0 0x7f791c0af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.777+0000 7f79235af700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f791c06de80 0x7f791c0a6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.777+0000 7f79235af700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f791c0cb080 0x7f791c0a7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.777+0000 7f79235af700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791c16d720 con 0x7f791c06de80 2023-10-06T02:28:58.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.777+0000 7f79235af700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791c16cdf0 con 0x7f791c0cb080 2023-10-06T02:28:58.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.777+0000 7f79235af700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791c16d0d0 con 0x7f791c06dab0 2023-10-06T02:28:58.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.777+0000 7f7920b4a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f791c06de80 0x7f791c0a6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.777+0000 7f7920b4a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f791c06de80 0x7f791c0a6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47188/0 (socket says 172.21.15.37:47188) 2023-10-06T02:28:58.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.777+0000 7f7920b4a700 1 -- 172.21.15.37:0/2530627732 learned_addr learned my addr 172.21.15.37:0/2530627732 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:58.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.777+0000 7f792134b700 1 --2- 172.21.15.37:0/2530627732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f791c06dab0 0x7f791c0af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.777+0000 7f7921b4c700 1 --2- 172.21.15.37:0/2530627732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f791c0cb080 0x7f791c0a7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.777+0000 7f7920b4a700 1 -- 172.21.15.37:0/2530627732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f791c06dab0 msgr2=0x7f791c0af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.777+0000 7f7920b4a700 1 --2- 172.21.15.37:0/2530627732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f791c06dab0 0x7f791c0af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.777+0000 7f7920b4a700 1 -- 172.21.15.37:0/2530627732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f791c0cb080 msgr2=0x7f791c0a7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.777+0000 7f7920b4a700 1 --2- 172.21.15.37:0/2530627732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f791c0cb080 0x7f791c0a7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.777+0000 7f7920b4a700 1 -- 172.21.15.37:0/2530627732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7914009420 con 0x7f791c06de80 2023-10-06T02:28:58.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.777+0000 7f7921b4c700 1 --2- 172.21.15.37:0/2530627732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f791c0cb080 0x7f791c0a7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:58.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.777+0000 7f7920b4a700 1 --2- 172.21.15.37:0/2530627732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f791c06de80 0x7f791c0a6e10 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f79100011e0 tx=0x7f7910007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:58.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.778+0000 7f79197fa700 1 -- 172.21.15.37:0/2530627732 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910005b30 con 0x7f791c06de80 2023-10-06T02:28:58.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.778+0000 7f79197fa700 1 -- 172.21.15.37:0/2530627732 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7910005c90 con 0x7f791c06de80 2023-10-06T02:28:58.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.778+0000 7f79235af700 1 -- 172.21.15.37:0/2530627732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790c009a20 con 0x7f791c06de80 2023-10-06T02:28:58.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.778+0000 7f79197fa700 1 -- 172.21.15.37:0/2530627732 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910007320 con 0x7f791c06de80 2023-10-06T02:28:58.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.778+0000 7f79235af700 1 -- 172.21.15.37:0/2530627732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791c0afa80 con 0x7f791c06de80 2023-10-06T02:28:58.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.779+0000 7f79235af700 1 -- 172.21.15.37:0/2530627732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f791c088ba0 con 0x7f791c06de80 2023-10-06T02:28:58.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.779+0000 7f79197fa700 1 -- 172.21.15.37:0/2530627732 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7910007690 con 0x7f791c06de80 2023-10-06T02:28:58.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.779+0000 7f79197fa700 1 --2- 172.21.15.37:0/2530627732 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7908066f30 0x7f79080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:58.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.779+0000 7f79197fa700 1 -- 172.21.15.37:0/2530627732 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f7910083940 con 0x7f791c06de80 2023-10-06T02:28:58.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.780+0000 7f792134b700 1 --2- 172.21.15.37:0/2530627732 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7908066f30 0x7f79080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:58.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.780+0000 7f792134b700 1 --2- 172.21.15.37:0/2530627732 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7908066f30 0x7f79080693e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f790c0097c0 tx=0x7f790c019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.784+0000 7f79197fa700 1 -- 172.21.15.37:0/2530627732 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7910050ca0 con 0x7f791c06de80 2023-10-06T02:28:58.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.985+0000 7f79235af700 1 -- 172.21.15.37:0/2530627732 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f791c16d860 con 0x7f7908066f30 2023-10-06T02:28:58.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.985+0000 7f79197fa700 1 -- 172.21.15.37:0/2530627732 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f791c16d860 con 0x7f7908066f30 2023-10-06T02:28:58.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.987+0000 7f79235af700 1 -- 172.21.15.37:0/2530627732 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7908066f30 msgr2=0x7f79080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.987+0000 7f79235af700 1 --2- 172.21.15.37:0/2530627732 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7908066f30 0x7f79080693e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f790c0097c0 tx=0x7f790c019000 comp rx=0 tx=0).stop 2023-10-06T02:28:58.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.987+0000 7f79235af700 1 -- 172.21.15.37:0/2530627732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f791c06de80 msgr2=0x7f791c0a6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:58.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.987+0000 7f79235af700 1 --2- 172.21.15.37:0/2530627732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f791c06de80 0x7f791c0a6e10 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f79100011e0 tx=0x7f7910007df0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.987+0000 7f79235af700 1 -- 172.21.15.37:0/2530627732 shutdown_connections 2023-10-06T02:28:58.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.987+0000 7f79235af700 1 --2- 172.21.15.37:0/2530627732 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f7908066f30 0x7f79080693e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.987+0000 7f79235af700 1 --2- 172.21.15.37:0/2530627732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f791c0cb080 0x7f791c0a7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.987+0000 7f79235af700 1 --2- 172.21.15.37:0/2530627732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f791c06dab0 0x7f791c0af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.987+0000 7f79235af700 1 --2- 172.21.15.37:0/2530627732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f791c06de80 0x7f791c0a6e10 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:58.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.987+0000 7f79235af700 1 -- 172.21.15.37:0/2530627732 >> 172.21.15.37:0/2530627732 conn(0x7f791c0d0510 msgr2=0x7f791c0c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:58.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.988+0000 7f79235af700 1 -- 172.21.15.37:0/2530627732 shutdown_connections 2023-10-06T02:28:58.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:58.988+0000 7f79235af700 1 -- 172.21.15.37:0/2530627732 wait complete. 2023-10-06T02:28:58.990 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T02:28:59.001 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T02:28:59.001 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T02:28:59.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.122+0000 7f5cfaab1700 1 Processor -- start 2023-10-06T02:28:59.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.123+0000 7f5cfaab1700 1 -- start start 2023-10-06T02:28:59.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.123+0000 7f5cfaab1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5cf4156770 0x7f5cf4067d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.123+0000 7f5cfaab1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf40682b0 0x7f5cf40ade20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.123+0000 7f5cfaab1700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf40b0210 con 0x7f5cf40ae360 2023-10-06T02:28:59.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.123+0000 7f5cfaab1700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf40ad800 con 0x7f5cf4156770 2023-10-06T02:28:59.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.123+0000 7f5cfaab1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf4156b40 con 0x7f5cf40682b0 2023-10-06T02:28:59.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.123+0000 7f5cf884d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5cf4156770 0x7f5cf4067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.124+0000 7f5cf884d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5cf4156770 0x7f5cf4067d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47198/0 (socket says 172.21.15.37:47198) 2023-10-06T02:28:59.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.124+0000 7f5cf884d700 1 -- 172.21.15.37:0/2066041865 learned_addr learned my addr 172.21.15.37:0/2066041865 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:59.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.124+0000 7f5cf3fff700 1 --2- 172.21.15.37:0/2066041865 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf40682b0 0x7f5cf40ade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.124+0000 7f5cf884d700 1 -- 172.21.15.37:0/2066041865 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf40682b0 msgr2=0x7f5cf40ade20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:59.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.124+0000 7f5cf884d700 1 --2- 172.21.15.37:0/2066041865 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf40682b0 0x7f5cf40ade20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.124+0000 7f5cf884d700 1 -- 172.21.15.37:0/2066041865 >> v1:172.21.15.191:6789/0 conn(0x7f5cf40ae360 legacy=0x7f5cf415a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:59.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.124+0000 7f5cf884d700 1 -- 172.21.15.37:0/2066041865 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf4157fa0 con 0x7f5cf4156770 2023-10-06T02:28:59.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.124+0000 7f5cf884d700 1 --2- 172.21.15.37:0/2066041865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf4156770 0x7f5cf4067d70 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40099b0 tx=0x7f5ce4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8dab2f538cedace server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:59.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.124+0000 7f5cf37fe700 1 -- 172.21.15.37:0/2066041865 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce400b860 con 0x7f5cf4156770 2023-10-06T02:28:59.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.124+0000 7f5cf37fe700 1 -- 172.21.15.37:0/2066041865 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce400b9c0 con 0x7f5cf4156770 2023-10-06T02:28:59.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.124+0000 7f5cf37fe700 1 -- 172.21.15.37:0/2066041865 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce400bd60 con 0x7f5cf4156770 2023-10-06T02:28:59.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.125+0000 7f5cfaab1700 1 -- 172.21.15.37:0/2066041865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf4156770 msgr2=0x7f5cf4067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:59.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.125+0000 7f5cfaab1700 1 --2- 172.21.15.37:0/2066041865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf4156770 0x7f5cf4067d70 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40099b0 tx=0x7f5ce4009250 comp rx=0 tx=0).stop 2023-10-06T02:28:59.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.125+0000 7f5cfaab1700 1 -- 172.21.15.37:0/2066041865 shutdown_connections 2023-10-06T02:28:59.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.125+0000 7f5cfaab1700 1 --2- 172.21.15.37:0/2066041865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf4156770 0x7f5cf4067d70 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.125+0000 7f5cfaab1700 1 --2- 172.21.15.37:0/2066041865 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf40682b0 0x7f5cf40ade20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.125+0000 7f5cfaab1700 1 -- 172.21.15.37:0/2066041865 >> 172.21.15.37:0/2066041865 conn(0x7f5cf406dc50 msgr2=0x7f5cf4067660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.125+0000 7f5cfaab1700 1 -- 172.21.15.37:0/2066041865 shutdown_connections 2023-10-06T02:28:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.125+0000 7f5cfaab1700 1 -- 172.21.15.37:0/2066041865 wait complete. 2023-10-06T02:28:59.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.126+0000 7f5cfaab1700 1 Processor -- start 2023-10-06T02:28:59.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.126+0000 7f5cfaab1700 1 -- start start 2023-10-06T02:28:59.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cfaab1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf40682b0 0x7f5cf40b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cfaab1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf40ae360 0x7f5cf414e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cfaab1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf4156770 0x7f5cf414e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cfaab1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf4155410 con 0x7f5cf4156770 2023-10-06T02:28:59.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cfaab1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf4154f80 con 0x7f5cf40ae360 2023-10-06T02:28:59.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cfaab1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf4154370 con 0x7f5cf40682b0 2023-10-06T02:28:59.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cf904e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf4156770 0x7f5cf414e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cf904e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf4156770 0x7f5cf414e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47206/0 (socket says 172.21.15.37:47206) 2023-10-06T02:28:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cf904e700 1 -- 172.21.15.37:0/3731623301 learned_addr learned my addr 172.21.15.37:0/3731623301 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cf884d700 1 --2- 172.21.15.37:0/3731623301 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf40682b0 0x7f5cf40b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cf3fff700 1 --2- 172.21.15.37:0/3731623301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf40ae360 0x7f5cf414e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cf904e700 1 -- 172.21.15.37:0/3731623301 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf40682b0 msgr2=0x7f5cf40b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cf904e700 1 --2- 172.21.15.37:0/3731623301 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5cf40682b0 0x7f5cf40b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cf904e700 1 -- 172.21.15.37:0/3731623301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf40ae360 msgr2=0x7f5cf414e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cf904e700 1 --2- 172.21.15.37:0/3731623301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf40ae360 0x7f5cf414e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cf904e700 1 -- 172.21.15.37:0/3731623301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce40094f0 con 0x7f5cf4156770 2023-10-06T02:28:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cf3fff700 1 --2- 172.21.15.37:0/3731623301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cf40ae360 0x7f5cf414e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:28:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cf904e700 1 --2- 172.21.15.37:0/3731623301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf4156770 0x7f5cf414e970 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00c8e0 tx=0x7f5cec001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cf0ff9700 1 -- 172.21.15.37:0/3731623301 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec00ce80 con 0x7f5cf4156770 2023-10-06T02:28:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cf0ff9700 1 -- 172.21.15.37:0/3731623301 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cec00a7e0 con 0x7f5cf4156770 2023-10-06T02:28:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.127+0000 7f5cfaab1700 1 -- 172.21.15.37:0/3731623301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf4154650 con 0x7f5cf4156770 2023-10-06T02:28:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.128+0000 7f5cf0ff9700 1 -- 172.21.15.37:0/3731623301 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec00ab80 con 0x7f5cf4156770 2023-10-06T02:28:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.128+0000 7f5cfaab1700 1 -- 172.21.15.37:0/3731623301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf41549e0 con 0x7f5cf4156770 2023-10-06T02:28:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.128+0000 7f5cfaab1700 1 -- 172.21.15.37:0/3731623301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5cf40af2a0 con 0x7f5cf4156770 2023-10-06T02:28:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.129+0000 7f5cf0ff9700 1 -- 172.21.15.37:0/3731623301 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5cec012420 con 0x7f5cf4156770 2023-10-06T02:28:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.129+0000 7f5cf0ff9700 1 --2- 172.21.15.37:0/3731623301 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ce0066f30 0x7f5ce00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.129+0000 7f5cf0ff9700 1 -- 172.21.15.37:0/3731623301 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5cec0846d0 con 0x7f5cf4156770 2023-10-06T02:28:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.130+0000 7f5cf0ff9700 1 --2- 172.21.15.37:0/3731623301 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x7f5ce006d4e0 0x7f5ce006f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.130+0000 7f5cf0ff9700 1 -- 172.21.15.37:0/3731623301 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ce006ffa0 con 0x7f5ce006d4e0 2023-10-06T02:28:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.130+0000 7f5cf0ff9700 1 -- 172.21.15.37:0/3731623301 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5cec086d10 con 0x7f5cf4156770 2023-10-06T02:28:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.130+0000 7f5cf884d700 1 --2- 172.21.15.37:0/3731623301 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ce0066f30 0x7f5ce00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.130+0000 7f5cf3fff700 1 --2- 172.21.15.37:0/3731623301 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x7f5ce006d4e0 0x7f5ce006f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.130+0000 7f5cf884d700 1 --2- 172.21.15.37:0/3731623301 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ce0066f30 0x7f5ce00693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40099b0 tx=0x7f5ce4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.130+0000 7f5cf3fff700 1 --2- 172.21.15.37:0/3731623301 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x7f5ce006d4e0 0x7f5ce006f8f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.131+0000 7f5cf0ff9700 1 -- 172.21.15.37:0/3731623301 <== osd.7 v2:172.21.15.191:6813/90854 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5ce006ffa0 con 0x7f5ce006d4e0 2023-10-06T02:28:59.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.145+0000 7f5cfaab1700 1 -- 172.21.15.37:0/3731623301 --> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5cf4070c30 con 0x7f5ce006d4e0 2023-10-06T02:28:59.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.145+0000 7f5cf0ff9700 1 -- 172.21.15.37:0/3731623301 <== osd.7 v2:172.21.15.191:6813/90854 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5cf4070c30 con 0x7f5ce006d4e0 2023-10-06T02:28:59.147 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-10-06T02:28:59.147 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T02:28:59.147 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-10-06T02:28:59.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.146+0000 7f5cfaab1700 1 -- 172.21.15.37:0/3731623301 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x7f5ce006d4e0 msgr2=0x7f5ce006f8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:59.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.146+0000 7f5cfaab1700 1 --2- 172.21.15.37:0/3731623301 >> [v2:172.21.15.191:6813/90854,v1:172.21.15.191:6815/90854] conn(0x7f5ce006d4e0 0x7f5ce006f8f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.146+0000 7f5cfaab1700 1 -- 172.21.15.37:0/3731623301 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ce0066f30 msgr2=0x7f5ce00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:59.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.146+0000 7f5cfaab1700 1 --2- 172.21.15.37:0/3731623301 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5ce0066f30 0x7f5ce00693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40099b0 tx=0x7f5ce4017000 comp rx=0 tx=0).stop 2023-10-06T02:28:59.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.146+0000 7f5cfaab1700 1 -- 172.21.15.37:0/3731623301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf4156770 msgr2=0x7f5cf414e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:59.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.146+0000 7f5cfaab1700 1 --2- 172.21.15.37:0/3731623301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf4156770 0x7f5cf414e970 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00c8e0 tx=0x7f5cec001710 comp rx=0 tx=0).stop 2023-10-06T02:28:59.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.146+0000 7f5cf904e700 1 -- 172.21.15.37:0/3731623301 reap_dead start 2023-10-06T02:28:59.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.146+0000 7f5cfaab1700 1 -- 172.21.15.37:0/3731623301 shutdown_connections 2023-10-06T02:28:59.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.146+0000 7f5cfaab1700 1 -- 172.21.15.37:0/3731623301 >> 172.21.15.37:0/3731623301 conn(0x7f5cf406dc50 msgr2=0x7f5cf40ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:59.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.146+0000 7f5cfaab1700 1 -- 172.21.15.37:0/3731623301 shutdown_connections 2023-10-06T02:28:59.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.146+0000 7f5cfaab1700 1 -- 172.21.15.37:0/3731623301 wait complete. 2023-10-06T02:28:59.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T02:28:59.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.277+0000 7fd4b16c2700 1 Processor -- start 2023-10-06T02:28:59.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.277+0000 7fd4b16c2700 1 -- start start 2023-10-06T02:28:59.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.278+0000 7fd4b16c2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4ac067ea0 0x7fd4ac1641f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.278+0000 7fd4b16c2700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ac06e470 con 0x7fd4ac159340 2023-10-06T02:28:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.278+0000 7fd4b16c2700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ac06d860 con 0x7fd4ac067a30 2023-10-06T02:28:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.278+0000 7fd4b16c2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac06db40 con 0x7fd4ac067ea0 2023-10-06T02:28:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.278+0000 7fd4aaffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd4ac159340 0x7fd4ac0b3a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37494/0 (socket says 172.21.15.37:37494) 2023-10-06T02:28:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.278+0000 7fd4aaffd700 1 -- 172.21.15.37:0/2434454594 learned_addr learned my addr 172.21.15.37:0/2434454594 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.278+0000 7fd4ab7fe700 1 --2- 172.21.15.37:0/2434454594 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4ac067ea0 0x7fd4ac1641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.278+0000 7fd4a9ffb700 1 -- 172.21.15.37:0/2434454594 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1367239782 0 0) 0x7fd4ac06e470 con 0x7fd4ac159340 2023-10-06T02:28:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.279+0000 7fd4a9ffb700 1 -- 172.21.15.37:0/2434454594 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd498003570 con 0x7fd4ac159340 2023-10-06T02:28:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.279+0000 7fd4a9ffb700 1 -- 172.21.15.37:0/2434454594 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535706426 0 0) 0x7fd4ac06d860 con 0x7fd4ac067a30 2023-10-06T02:28:59.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.279+0000 7fd4ab7fe700 1 -- 172.21.15.37:0/2434454594 >> v1:172.21.15.191:6789/0 conn(0x7fd4ac067a30 legacy=0x7fd4ac159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:59.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.279+0000 7fd4ab7fe700 1 -- 172.21.15.37:0/2434454594 >> v1:172.21.15.37:6789/0 conn(0x7fd4ac159340 legacy=0x7fd4ac0b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:59.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.279+0000 7fd4ab7fe700 1 -- 172.21.15.37:0/2434454594 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac06de20 con 0x7fd4ac067ea0 2023-10-06T02:28:59.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.279+0000 7fd4ab7fe700 1 --2- 172.21.15.37:0/2434454594 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4ac067ea0 0x7fd4ac1641f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009910 tx=0x7fd4a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d601556a8b20fef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:59.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.279+0000 7fd4a9ffb700 1 -- 172.21.15.37:0/2434454594 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a400b680 con 0x7fd4ac067ea0 2023-10-06T02:28:59.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.279+0000 7fd4a9ffb700 1 -- 172.21.15.37:0/2434454594 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a400b7e0 con 0x7fd4ac067ea0 2023-10-06T02:28:59.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.279+0000 7fd4a9ffb700 1 -- 172.21.15.37:0/2434454594 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a400bba0 con 0x7fd4ac067ea0 2023-10-06T02:28:59.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.280+0000 7fd4b16c2700 1 -- 172.21.15.37:0/2434454594 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4ac067ea0 msgr2=0x7fd4ac1641f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:59.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.280+0000 7fd4b16c2700 1 --2- 172.21.15.37:0/2434454594 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4ac067ea0 0x7fd4ac1641f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009910 tx=0x7fd4a40091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.280+0000 7fd4b16c2700 1 -- 172.21.15.37:0/2434454594 shutdown_connections 2023-10-06T02:28:59.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.280+0000 7fd4b16c2700 1 --2- 172.21.15.37:0/2434454594 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4ac067ea0 0x7fd4ac1641f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.280+0000 7fd4b16c2700 1 -- 172.21.15.37:0/2434454594 >> 172.21.15.37:0/2434454594 conn(0x7fd4ac0ce330 msgr2=0x7fd4ac0ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:59.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.280+0000 7fd4b16c2700 1 -- 172.21.15.37:0/2434454594 shutdown_connections 2023-10-06T02:28:59.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.280+0000 7fd4b16c2700 1 -- 172.21.15.37:0/2434454594 wait complete. 2023-10-06T02:28:59.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.281+0000 7fd4b16c2700 1 Processor -- start 2023-10-06T02:28:59.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.281+0000 7fd4b16c2700 1 -- start start 2023-10-06T02:28:59.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4b16c2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4ac067a30 0x7fd4ac143fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4b16c2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4ac067ea0 0x7fd4ac0c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4b16c2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4ac159340 0x7fd4ac143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4b16c2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0cd4e0 con 0x7fd4ac159340 2023-10-06T02:28:59.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4b16c2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac16b7d0 con 0x7fd4ac067a30 2023-10-06T02:28:59.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4b16c2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0c8430 con 0x7fd4ac067ea0 2023-10-06T02:28:59.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4ab7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4ac159340 0x7fd4ac143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4ab7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4ac159340 0x7fd4ac143700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47216/0 (socket says 172.21.15.37:47216) 2023-10-06T02:28:59.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4ab7fe700 1 -- 172.21.15.37:0/1147763385 learned_addr learned my addr 172.21.15.37:0/1147763385 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:59.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4aaffd700 1 --2- 172.21.15.37:0/1147763385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4ac067a30 0x7fd4ac143fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4aa7fc700 1 --2- 172.21.15.37:0/1147763385 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4ac067ea0 0x7fd4ac0c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4ab7fe700 1 -- 172.21.15.37:0/1147763385 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4ac067ea0 msgr2=0x7fd4ac0c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:59.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4ab7fe700 1 --2- 172.21.15.37:0/1147763385 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4ac067ea0 0x7fd4ac0c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4ab7fe700 1 -- 172.21.15.37:0/1147763385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4ac067a30 msgr2=0x7fd4ac143fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:59.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4ab7fe700 1 --2- 172.21.15.37:0/1147763385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4ac067a30 0x7fd4ac143fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4ab7fe700 1 -- 172.21.15.37:0/1147763385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a4009420 con 0x7fd4ac159340 2023-10-06T02:28:59.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4aa7fc700 1 --2- 172.21.15.37:0/1147763385 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4ac067ea0 0x7fd4ac0c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:59.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4ab7fe700 1 --2- 172.21.15.37:0/1147763385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4ac159340 0x7fd4ac143700 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fd4a40093f0 tx=0x7fd4a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:59.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4a2ffd700 1 -- 172.21.15.37:0/1147763385 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a400bb60 con 0x7fd4ac159340 2023-10-06T02:28:59.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4a2ffd700 1 -- 172.21.15.37:0/1147763385 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a4027450 con 0x7fd4ac159340 2023-10-06T02:28:59.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4b16c2700 1 -- 172.21.15.37:0/1147763385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ac16abc0 con 0x7fd4ac159340 2023-10-06T02:28:59.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.282+0000 7fd4a2ffd700 1 -- 172.21.15.37:0/1147763385 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a40277f0 con 0x7fd4ac159340 2023-10-06T02:28:59.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.283+0000 7fd4b16c2700 1 -- 172.21.15.37:0/1147763385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ac16b180 con 0x7fd4ac159340 2023-10-06T02:28:59.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.284+0000 7fd4b16c2700 1 -- 172.21.15.37:0/1147763385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ac0b1e30 con 0x7fd4ac159340 2023-10-06T02:28:59.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.284+0000 7fd4a2ffd700 1 -- 172.21.15.37:0/1147763385 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4a401a430 con 0x7fd4ac159340 2023-10-06T02:28:59.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.284+0000 7fd4a2ffd700 1 --2- 172.21.15.37:0/1147763385 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd48c066f30 0x7fd48c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.284+0000 7fd4a2ffd700 1 -- 172.21.15.37:0/1147763385 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd4a4086490 con 0x7fd4ac159340 2023-10-06T02:28:59.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.285+0000 7fd4aaffd700 1 --2- 172.21.15.37:0/1147763385 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd48c066f30 0x7fd48c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.285+0000 7fd4aaffd700 1 --2- 172.21.15.37:0/1147763385 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd48c066f30 0x7fd48c0693e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd49c002250 tx=0x7fd49c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:59.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.289+0000 7fd4a2ffd700 1 -- 172.21.15.37:0/1147763385 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4a40538a0 con 0x7fd4ac159340 2023-10-06T02:28:59.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.482+0000 7fd4b16c2700 1 -- 172.21.15.37:0/1147763385 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4ac06e170 con 0x7fd48c066f30 2023-10-06T02:28:59.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.483+0000 7fd4a2ffd700 1 -- 172.21.15.37:0/1147763385 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd4ac06e170 con 0x7fd48c066f30 2023-10-06T02:28:59.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.485+0000 7fd4b16c2700 1 -- 172.21.15.37:0/1147763385 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd48c066f30 msgr2=0x7fd48c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:59.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.485+0000 7fd4b16c2700 1 --2- 172.21.15.37:0/1147763385 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd48c066f30 0x7fd48c0693e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd49c002250 tx=0x7fd49c009040 comp rx=0 tx=0).stop 2023-10-06T02:28:59.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.485+0000 7fd4b16c2700 1 -- 172.21.15.37:0/1147763385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4ac159340 msgr2=0x7fd4ac143700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:59.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.485+0000 7fd4b16c2700 1 --2- 172.21.15.37:0/1147763385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4ac159340 0x7fd4ac143700 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fd4a40093f0 tx=0x7fd4a4017000 comp rx=0 tx=0).stop 2023-10-06T02:28:59.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.485+0000 7fd4b16c2700 1 -- 172.21.15.37:0/1147763385 shutdown_connections 2023-10-06T02:28:59.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.485+0000 7fd4b16c2700 1 --2- 172.21.15.37:0/1147763385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4ac159340 0x7fd4ac143700 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.485+0000 7fd4b16c2700 1 --2- 172.21.15.37:0/1147763385 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fd48c066f30 0x7fd48c0693e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.485+0000 7fd4b16c2700 1 --2- 172.21.15.37:0/1147763385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4ac067a30 0x7fd4ac143fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.485+0000 7fd4b16c2700 1 --2- 172.21.15.37:0/1147763385 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4ac067ea0 0x7fd4ac0c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.485+0000 7fd4b16c2700 1 -- 172.21.15.37:0/1147763385 >> 172.21.15.37:0/1147763385 conn(0x7fd4ac0ce330 msgr2=0x7fd4ac159920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:59.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.485+0000 7fd4b16c2700 1 -- 172.21.15.37:0/1147763385 shutdown_connections 2023-10-06T02:28:59.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.485+0000 7fd4b16c2700 1 -- 172.21.15.37:0/1147763385 wait complete. 2023-10-06T02:28:59.488 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T02:28:59.499 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:28:59.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.616+0000 7f5bd9492700 1 Processor -- start 2023-10-06T02:28:59.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.616+0000 7f5bd9492700 1 -- start start 2023-10-06T02:28:59.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.617+0000 7f5bd9492700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5bd41596d0 0x7f5bd40b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.617+0000 7f5bd9492700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5bd40b3840 0x7f5bd40c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.617+0000 7f5bd9492700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd40c5300 con 0x7f5bd4159aa0 2023-10-06T02:28:59.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.617+0000 7f5bd9492700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd40c6160 con 0x7f5bd40b3840 2023-10-06T02:28:59.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.617+0000 7f5bd9492700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd40c5550 con 0x7f5bd41596d0 2023-10-06T02:28:59.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.617+0000 7f5bd37fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5bd4159aa0 0x7f5bd40caba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37500/0 (socket says 172.21.15.37:37500) 2023-10-06T02:28:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.617+0000 7f5bd37fe700 1 -- 172.21.15.37:0/1888886174 learned_addr learned my addr 172.21.15.37:0/1888886174 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:28:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd2ffd700 1 --2- 172.21.15.37:0/1888886174 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5bd41596d0 0x7f5bd40b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd27fc700 1 --2- 172.21.15.37:0/1888886174 >> v2:172.21.15.191:3300/0 conn(0x7f5bd40b3840 0x7f5bd40c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd1ffb700 1 -- 172.21.15.37:0/1888886174 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143478708 0 0) 0x7f5bd40c5300 con 0x7f5bd4159aa0 2023-10-06T02:28:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd1ffb700 1 -- 172.21.15.37:0/1888886174 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bc0003570 con 0x7f5bd4159aa0 2023-10-06T02:28:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd1ffb700 1 -- 172.21.15.37:0/1888886174 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2773350389 0 0) 0x7f5bc0003570 con 0x7f5bd4159aa0 2023-10-06T02:28:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd1ffb700 1 -- 172.21.15.37:0/1888886174 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5bd41596d0 msgr2=0x7f5bd40b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd1ffb700 1 --2- 172.21.15.37:0/1888886174 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5bd41596d0 0x7f5bd40b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd1ffb700 1 -- 172.21.15.37:0/1888886174 >> v2:172.21.15.191:3300/0 conn(0x7f5bd40b3840 msgr2=0x7f5bd40c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd1ffb700 1 --2- 172.21.15.37:0/1888886174 >> v2:172.21.15.191:3300/0 conn(0x7f5bd40b3840 0x7f5bd40c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd1ffb700 1 -- 172.21.15.37:0/1888886174 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd40c5830 con 0x7f5bd4159aa0 2023-10-06T02:28:59.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd1ffb700 1 -- 172.21.15.37:0/1888886174 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3149674260 0 0) 0x7f5bcc001470 con 0x7f5bd4159aa0 2023-10-06T02:28:59.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd1ffb700 1 -- 172.21.15.37:0/1888886174 >> v1:172.21.15.37:6789/0 conn(0x7f5bd4159aa0 legacy=0x7f5bd40caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:59.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd1ffb700 1 --2- 172.21.15.37:0/1888886174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bc0003a60 0x7f5bc0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd1ffb700 1 --2- 172.21.15.37:0/1888886174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bc0004810 0x7f5bc0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd1ffb700 1 --2- 172.21.15.37:0/1888886174 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5bc00051c0 0x7f5bc000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd1ffb700 1 -- 172.21.15.37:0/1888886174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd40c6160 con 0x7f5bc0004810 2023-10-06T02:28:59.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd1ffb700 1 -- 172.21.15.37:0/1888886174 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd40c5550 con 0x7f5bc0003a60 2023-10-06T02:28:59.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd1ffb700 1 -- 172.21.15.37:0/1888886174 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc000bfa0 con 0x7f5bc00051c0 2023-10-06T02:28:59.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd2ffd700 1 --2- 172.21.15.37:0/1888886174 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5bd41596d0 0x7f5bd40b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:59.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd27fc700 1 --2- 172.21.15.37:0/1888886174 >> v2:172.21.15.191:3300/0 conn(0x7f5bd40b3840 0x7f5bd40c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:28:59.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd27fc700 1 --2- 172.21.15.37:0/1888886174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bc0004810 0x7f5bc0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd2ffd700 1 --2- 172.21.15.37:0/1888886174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bc0003a60 0x7f5bc0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.618+0000 7f5bd37fe700 1 --2- 172.21.15.37:0/1888886174 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5bc00051c0 0x7f5bc000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.619+0000 7f5bd27fc700 1 -- 172.21.15.37:0/1888886174 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5bc00051c0 msgr2=0x7f5bc000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:59.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.619+0000 7f5bd27fc700 1 --2- 172.21.15.37:0/1888886174 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5bc00051c0 0x7f5bc000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.619+0000 7f5bd27fc700 1 -- 172.21.15.37:0/1888886174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bc0003a60 msgr2=0x7f5bc0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:28:59.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.619+0000 7f5bd27fc700 1 --2- 172.21.15.37:0/1888886174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bc0003a60 0x7f5bc0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.619+0000 7f5bd27fc700 1 -- 172.21.15.37:0/1888886174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc0003570 con 0x7f5bc0004810 2023-10-06T02:28:59.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.619+0000 7f5bd2ffd700 1 --2- 172.21.15.37:0/1888886174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bc0003a60 0x7f5bc0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:28:59.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.619+0000 7f5bd27fc700 1 --2- 172.21.15.37:0/1888886174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bc0004810 0x7f5bc0004c80 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009db0 tx=0x7f5bbc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d8e363c30ea06a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:59.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.619+0000 7f5bd1ffb700 1 -- 172.21.15.37:0/1888886174 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc009740 con 0x7f5bc0004810 2023-10-06T02:28:59.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.619+0000 7f5bd1ffb700 1 -- 172.21.15.37:0/1888886174 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc00e920 con 0x7f5bc0004810 2023-10-06T02:28:59.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.619+0000 7f5bd1ffb700 1 -- 172.21.15.37:0/1888886174 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc00eca0 con 0x7f5bc0004810 2023-10-06T02:28:59.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.619+0000 7f5bd9492700 1 -- 172.21.15.37:0/1888886174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bc0004810 msgr2=0x7f5bc0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:59.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.619+0000 7f5bd9492700 1 --2- 172.21.15.37:0/1888886174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bc0004810 0x7f5bc0004c80 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009db0 tx=0x7f5bbc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.619+0000 7f5bd37fe700 1 -- 172.21.15.37:0/1888886174 reap_dead start 2023-10-06T02:28:59.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.619+0000 7f5bd9492700 1 -- 172.21.15.37:0/1888886174 shutdown_connections 2023-10-06T02:28:59.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.619+0000 7f5bd9492700 1 -- 172.21.15.37:0/1888886174 >> 172.21.15.37:0/1888886174 conn(0x7f5bd406c890 msgr2=0x7f5bd40d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:59.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.620+0000 7f5bd9492700 1 -- 172.21.15.37:0/1888886174 shutdown_connections 2023-10-06T02:28:59.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.620+0000 7f5bd9492700 1 -- 172.21.15.37:0/1888886174 wait complete. 2023-10-06T02:28:59.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.621+0000 7f5bd9492700 1 Processor -- start 2023-10-06T02:28:59.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.621+0000 7f5bd9492700 1 -- start start 2023-10-06T02:28:59.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.621+0000 7f5bd9492700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bc0004810 0x7f5bd409d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bd9492700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5bd4154360 0x7f5bd40c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bd9492700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bd4158010 0x7f5bd41584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bd9492700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd409dfa0 con 0x7f5bc0004810 2023-10-06T02:28:59.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bd9492700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd41589f0 con 0x7f5bd4158010 2023-10-06T02:28:59.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bd9492700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd40ca8c0 con 0x7f5bd4154360 2023-10-06T02:28:59.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bd2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bc0004810 0x7f5bd409d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bd2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bc0004810 0x7f5bd409d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47236/0 (socket says 172.21.15.37:47236) 2023-10-06T02:28:59.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bd2ffd700 1 -- 172.21.15.37:0/3401190942 learned_addr learned my addr 172.21.15.37:0/3401190942 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:28:59.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bd37fe700 1 --2- 172.21.15.37:0/3401190942 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bd4158010 0x7f5bd41584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bd27fc700 1 --2- 172.21.15.37:0/3401190942 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5bd4154360 0x7f5bd40c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bd2ffd700 1 -- 172.21.15.37:0/3401190942 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5bd4154360 msgr2=0x7f5bd40c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:59.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bd2ffd700 1 --2- 172.21.15.37:0/3401190942 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5bd4154360 0x7f5bd40c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bd2ffd700 1 -- 172.21.15.37:0/3401190942 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bd4158010 msgr2=0x7f5bd41584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:59.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bd2ffd700 1 --2- 172.21.15.37:0/3401190942 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bd4158010 0x7f5bd41584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bd2ffd700 1 -- 172.21.15.37:0/3401190942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd40ca590 con 0x7f5bc0004810 2023-10-06T02:28:59.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bd2ffd700 1 --2- 172.21.15.37:0/3401190942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bc0004810 0x7f5bd409d020 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4011530 tx=0x7f5bc400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:59.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bcaffd700 1 -- 172.21.15.37:0/3401190942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc400e030 con 0x7f5bc0004810 2023-10-06T02:28:59.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bcaffd700 1 -- 172.21.15.37:0/3401190942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc4016470 con 0x7f5bc0004810 2023-10-06T02:28:59.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bd9492700 1 -- 172.21.15.37:0/3401190942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd41547d0 con 0x7f5bc0004810 2023-10-06T02:28:59.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bcaffd700 1 -- 172.21.15.37:0/3401190942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4016810 con 0x7f5bc0004810 2023-10-06T02:28:59.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.622+0000 7f5bd9492700 1 -- 172.21.15.37:0/3401190942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd409d9e0 con 0x7f5bc0004810 2023-10-06T02:28:59.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.623+0000 7f5bd9492700 1 -- 172.21.15.37:0/3401190942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd406fbf0 con 0x7f5bc0004810 2023-10-06T02:28:59.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.624+0000 7f5bcaffd700 1 -- 172.21.15.37:0/3401190942 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5bc4016c40 con 0x7f5bc0004810 2023-10-06T02:28:59.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.624+0000 7f5bcaffd700 1 --2- 172.21.15.37:0/3401190942 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5bb4066f30 0x7f5bb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:28:59.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.624+0000 7f5bcaffd700 1 -- 172.21.15.37:0/3401190942 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5bc400f070 con 0x7f5bc0004810 2023-10-06T02:28:59.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.625+0000 7f5bd27fc700 1 --2- 172.21.15.37:0/3401190942 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5bb4066f30 0x7f5bb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:28:59.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.625+0000 7f5bd27fc700 1 --2- 172.21.15.37:0/3401190942 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5bb4066f30 0x7f5bb40693e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0091e0 tx=0x7f5bbc019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:28:59.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.629+0000 7f5bcaffd700 1 -- 172.21.15.37:0/3401190942 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5bc4052770 con 0x7f5bc0004810 2023-10-06T02:28:59.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.817+0000 7f5bd9492700 1 -- 172.21.15.37:0/3401190942 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5bd4159040 con 0x7f5bb4066f30 2023-10-06T02:28:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.820+0000 7f5bcaffd700 1 -- 172.21.15.37:0/3401190942 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73541 (secure 0 0 0) 0x7f5bd4159040 con 0x7f5bb4066f30 2023-10-06T02:28:59.823 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:28:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.823+0000 7f5bd9492700 1 -- 172.21.15.37:0/3401190942 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5bb4066f30 msgr2=0x7f5bb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.823+0000 7f5bd9492700 1 --2- 172.21.15.37:0/3401190942 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5bb4066f30 0x7f5bb40693e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0091e0 tx=0x7f5bbc019000 comp rx=0 tx=0).stop 2023-10-06T02:28:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.823+0000 7f5bd9492700 1 -- 172.21.15.37:0/3401190942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bc0004810 msgr2=0x7f5bd409d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:28:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.823+0000 7f5bd9492700 1 --2- 172.21.15.37:0/3401190942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bc0004810 0x7f5bd409d020 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4011530 tx=0x7f5bc400b040 comp rx=0 tx=0).stop 2023-10-06T02:28:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.823+0000 7f5bd9492700 1 -- 172.21.15.37:0/3401190942 shutdown_connections 2023-10-06T02:28:59.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.823+0000 7f5bd9492700 1 --2- 172.21.15.37:0/3401190942 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5bb4066f30 0x7f5bb40693e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.823+0000 7f5bd9492700 1 --2- 172.21.15.37:0/3401190942 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bd4158010 0x7f5bd41584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.823+0000 7f5bd9492700 1 --2- 172.21.15.37:0/3401190942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bc0004810 0x7f5bd409d020 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.823+0000 7f5bd9492700 1 --2- 172.21.15.37:0/3401190942 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5bd4154360 0x7f5bd40c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:28:59.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.823+0000 7f5bd9492700 1 -- 172.21.15.37:0/3401190942 >> 172.21.15.37:0/3401190942 conn(0x7f5bd406c890 msgr2=0x7f5bd4156080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:28:59.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.823+0000 7f5bd9492700 1 -- 172.21.15.37:0/3401190942 shutdown_connections 2023-10-06T02:28:59.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:28:59.823+0000 7f5bd9492700 1 -- 172.21.15.37:0/3401190942 wait complete. 2023-10-06T02:28:59.827 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:28:59.836 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2023-10-06T02:28:58.592793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2395036,"kb_used_data":8540,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752579684,"statfs":{"total":773094113280,"available":770641596416,"internally_reserved":0,"allocated":8744960,"data_stored":4570685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8388625,"num_objects":-5,"num_object_clones":0,"num_object_copies":-10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":0,"num_read":-32,"num_read_kb":-13,"num_write":-29,"num_write_kb":-8195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.404247"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":63,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T02:28:50.192123+0000","last_change":"2023-10-06T02:23:10.475299+0000","last_active":"2023-10-06T02:28:50.192123+0000","last_peered":"2023-10-06T02:28:50.192123+0000","last_clean":"2023-10-06T02:28:50.192123+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:28:50.192123+0000","last_undegraded":"2023-10-06T02:28:50.192123+0000","last_fullsized":"2023-10-06T02:28:50.192123+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:24.252565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":62,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T02:28:50.998208+0000","last_change":"2023-10-06T02:23:09.820856+0000","last_active":"2023-10-06T02:28:50.998208+0000","last_peered":"2023-10-06T02:28:50.998208+0000","last_clean":"2023-10-06T02:28:50.998208+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:28:50.998208+0000","last_undegraded":"2023-10-06T02:28:50.998208+0000","last_fullsized":"2023-10-06T02:28:50.998208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:47.378310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":62,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T02:28:50.997830+0000","last_change":"2023-10-06T02:23:09.827024+0000","last_active":"2023-10-06T02:28:50.997830+0000","last_peered":"2023-10-06T02:28:50.997830+0000","last_clean":"2023-10-06T02:28:50.997830+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:28:50.997830+0000","last_undegraded":"2023-10-06T02:28:50.997830+0000","last_fullsized":"2023-10-06T02:28:50.997830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":208,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T02:28:50.496132+0000","last_change":"2023-10-06T02:23:09.827710+0000","last_active":"2023-10-06T02:28:50.496132+0000","last_peered":"2023-10-06T02:28:50.496132+0000","last_clean":"2023-10-06T02:28:50.496132+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:28:50.496132+0000","last_undegraded":"2023-10-06T02:28:50.496132+0000","last_fullsized":"2023-10-06T02:28:50.496132+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":58,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T02:28:50.496298+0000","last_change":"2023-10-06T02:23:10.566747+0000","last_active":"2023-10-06T02:28:50.496298+0000","last_peered":"2023-10-06T02:28:50.496298+0000","last_clean":"2023-10-06T02:28:50.496298+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:28:50.496298+0000","last_undegraded":"2023-10-06T02:28:50.496298+0000","last_fullsized":"2023-10-06T02:28:50.496298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:20.510923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":58,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T02:28:50.496451+0000","last_change":"2023-10-06T02:23:10.566628+0000","last_active":"2023-10-06T02:28:50.496451+0000","last_peered":"2023-10-06T02:28:50.496451+0000","last_clean":"2023-10-06T02:28:50.496451+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:28:50.496451+0000","last_undegraded":"2023-10-06T02:28:50.496451+0000","last_fullsized":"2023-10-06T02:28:50.496451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":69,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T02:28:50.191442+0000","last_change":"2023-10-06T02:23:10.566739+0000","last_active":"2023-10-06T02:28:50.191442+0000","last_peered":"2023-10-06T02:28:50.191442+0000","last_clean":"2023-10-06T02:28:50.191442+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:28:50.191442+0000","last_undegraded":"2023-10-06T02:28:50.191442+0000","last_fullsized":"2023-10-06T02:28:50.191442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":62,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T02:28:50.997459+0000","last_change":"2023-10-06T02:23:10.567417+0000","last_active":"2023-10-06T02:28:50.997459+0000","last_peered":"2023-10-06T02:28:50.997459+0000","last_clean":"2023-10-06T02:28:50.997459+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:28:50.997459+0000","last_undegraded":"2023-10-06T02:28:50.997459+0000","last_fullsized":"2023-10-06T02:28:50.997459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.801075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":62,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-06T02:28:50.998045+0000","last_change":"2023-10-06T02:23:09.820539+0000","last_active":"2023-10-06T02:28:50.998045+0000","last_peered":"2023-10-06T02:28:50.998045+0000","last_clean":"2023-10-06T02:28:50.998045+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:28:50.998045+0000","last_undegraded":"2023-10-06T02:28:50.998045+0000","last_fullsized":"2023-10-06T02:28:50.998045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:23:08.797932+0000","last_clean_scrub_stamp":"2023-10-06T02:23:08.797932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:28.867737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574922,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302888,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068952,"statfs":{"total":96636764160,"available":96326606848,"internally_reserved":0,"allocated":1540096,"data_stored":1014619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.376,"5min":0.311,"15min":0.311},"max":{"1min":0.66800000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57199999999999995,"15min":0.55100000000000005},"min":{"1min":0.37,"5min":0.314,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.83799999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.52400000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56299999999999994,"15min":0.54300000000000004},"min":{"1min":0.41699999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68799999999999994,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.76000000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56999999999999995,"15min":0.55500000000000005},"min":{"1min":0.42999999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78300000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.745},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57699999999999996,"15min":0.55600000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79900000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.66100000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.71399999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.56499999999999995},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.72399999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48299999999999998,"15min":0.499},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65300000000000002,"5min":1.014,"15min":1.014},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.36299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.63400000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.505}]},{"osd":5,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.503,"15min":0.51400000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66700000000000004,"5min":0.747,"15min":0.747},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.52300000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56699999999999995,"15min":0.58399999999999996},"min":{"1min":0.38400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76700000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56799999999999995,"15min":0.58999999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.55100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073632,"statfs":{"total":96636764160,"available":96331399168,"internally_reserved":0,"allocated":942080,"data_stored":422898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59899999999999998,"15min":0.72099999999999997},"min":{"1min":0.33600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.71299999999999997,"5min":5.859,"15min":5.859},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.38800000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82799999999999996,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.73099999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.52300000000000002},"min":{"1min":0.35699999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.879,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.501},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56499999999999995,"15min":0.53900000000000003},"min":{"1min":0.42099999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81299999999999994,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.55800000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.38700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85599999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.61499999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58499999999999996,"15min":0.55500000000000005},"min":{"1min":0.40600000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84299999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.47299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.33600000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67000000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.41099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.68999999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.79400000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.42899999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70399999999999996,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.41199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.58199999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.63},{"interface":"front","average":{"1min":0.63,"5min":0.59599999999999997,"15min":0.60499999999999998},"min":{"1min":0.49099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79700000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.87}]}]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302888,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068952,"statfs":{"total":96636764160,"available":96326606848,"internally_reserved":0,"allocated":1540096,"data_stored":1014619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35699999999999998,"15min":0.376},"min":{"1min":0.23100000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.502,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.46400000000000002,"15min":0.64800000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.55800000000000005,"5min":7.6900000000000004,"15min":7.6900000000000004},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.42399999999999999,"15min":0.60499999999999998},"min":{"1min":0.248,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48899999999999999,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.48899999999999999,"15min":0.67800000000000005},"min":{"1min":0.32800000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.60199999999999998,"5min":7.758,"15min":7.758},"last":0.372}]},{"osd":3,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.51600000000000001,"15min":0.70399999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59399999999999997,"5min":7.7869999999999999,"15min":7.7869999999999999},"last":0.436},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.27600000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57999999999999996,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.40200000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.73099999999999998,"15min":1.0309999999999999},"min":{"1min":0.41699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88700000000000001,"5min":11.678000000000001,"15min":11.678000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.68999999999999995,"15min":0.88},"min":{"1min":0.443,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77200000000000002,"5min":7.6529999999999996,"15min":7.6529999999999996},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66700000000000004,"15min":0.67100000000000004},"min":{"1min":0.46000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81399999999999995,"5min":1.399,"15min":1.399},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.73099999999999998,"15min":0.91400000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.81699999999999995,"5min":7.508,"15min":7.508},"last":0.69099999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.70699999999999996,"15min":0.89100000000000001},"min":{"1min":0.47399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82899999999999996,"5min":7.7270000000000003,"15min":7.7270000000000003},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.65900000000000003,"15min":0.68300000000000005},"min":{"1min":0.45700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.75600000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67900000000000005,"15min":0.69099999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85299999999999998,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.75700000000000001,"15min":0.93700000000000006},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.82999999999999996,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.61699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574923,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073632,"statfs":{"total":96636764160,"available":96331399168,"internally_reserved":0,"allocated":942080,"data_stored":422898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.34799999999999998},"min":{"1min":0.23300000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.376},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.38900000000000001,"15min":0.36799999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.36199999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39900000000000002,"15min":0.38900000000000001},"min":{"1min":0.29399999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52200000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42199999999999999,"15min":0.41499999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.624,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.318}]},{"osd":3,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.371,"15min":0.35599999999999998},"min":{"1min":0.26000000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.53300000000000003,"5min":0.622,"15min":0.622},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.42499999999999999,"15min":0.40100000000000002},"min":{"1min":0.30199999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.34000000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.46899999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83999999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.85399999999999998,"5min":1.008,"15min":1.008},"last":0.90800000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77900000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.40600000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77400000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.88300000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84399999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.439,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":1,"15min":1},"last":0.83599999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81100000000000005,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86099999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.86699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":424251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.34000000000000002},"min":{"1min":0.25700000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.53000000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38200000000000001},"min":{"1min":0.26600000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.55200000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.40300000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.36099999999999999,"15min":0.35099999999999998},"min":{"1min":0.27400000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46000000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40999999999999998,"15min":0.40200000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.33900000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.42799999999999999,"15min":0.41199999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54600000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.372},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42699999999999999,"15min":0.42999999999999999},"min":{"1min":0.32900000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.53900000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.29799999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61299999999999999,"15min":0.60399999999999998},"min":{"1min":0.46300000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92800000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.46400000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82999999999999996,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.50700000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93899999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.63},"min":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.84299999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.47699999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.46100000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95699999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.47699999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.54300000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65900000000000003,"15min":0.67100000000000004},"min":{"1min":0.44900000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83999999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47899999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.91900000000000004,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.55400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574922,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073632,"statfs":{"total":96636764160,"available":96331399168,"internally_reserved":0,"allocated":942080,"data_stored":422898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.44500000000000001,"15min":0.66300000000000003},"min":{"1min":0.24299999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.55900000000000005,"5min":10.164999999999999,"15min":10.164999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.39200000000000002,"15min":0.40600000000000003},"min":{"1min":0.25,"5min":0.224,"15min":0.224},"max":{"1min":0.46500000000000002,"5min":1.266,"15min":1.266},"last":0.34599999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.28000000000000003,"5min":0.191,"15min":0.191},"max":{"1min":0.68400000000000005,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.38},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42299999999999999,"15min":0.42999999999999999},"min":{"1min":0.249,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.77800000000000002,"5min":1.319,"15min":1.319},"last":0.41499999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44,"15min":0.44},"min":{"1min":0.28100000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.93500000000000005,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.46600000000000003,"15min":0.48399999999999999},"min":{"1min":0.30599999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58799999999999997,"5min":1.5,"15min":1.5},"last":0.40500000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.621,"15min":0.627},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77000000000000002,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85899999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.46700000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63600000000000001,"15min":0.65400000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84299999999999997,"5min":1.538,"15min":1.538},"last":0.501},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63700000000000001,"15min":0.63800000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79900000000000004,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.44,"5min":0.38,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":1.111,"15min":1.111},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66800000000000004,"15min":0.68300000000000005},"min":{"1min":0.45700000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.875,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.45500000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65100000000000002,"15min":0.65000000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81899999999999995,"5min":1.21,"15min":1.21},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.63700000000000001,"15min":0.64700000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80400000000000005,"5min":1.135,"15min":1.135},"last":0.55400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":424251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.52000000000000002},"min":{"1min":0.40100000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.628,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54700000000000004,"15min":0.51500000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73999999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.495}]},{"osd":1,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54100000000000004,"15min":0.504},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.71299999999999997,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68899999999999995,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.57699999999999996},"min":{"1min":0.48399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69499999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.58599999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77100000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55900000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.372,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73499999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.44,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76200000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57699999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.499,"15min":0.49099999999999999},"min":{"1min":0.35399999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68700000000000006,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.41899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72799999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.39200000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69999999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71599999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.45100000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.42899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80500000000000005,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.45700000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.79800000000000004,"5min":1.04,"15min":1.04},"last":0.65500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":424251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.501},"min":{"1min":0.377,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66000000000000003,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52800000000000002,"15min":0.496},"min":{"1min":0.30299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.35599999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53400000000000003,"15min":0.498},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66700000000000004,"5min":0.755,"15min":0.755},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52900000000000003,"15min":0.503},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.38200000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58499999999999996,"15min":0.56299999999999994},"min":{"1min":0.43099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76400000000000001,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59899999999999998,"15min":0.57699999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79600000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54200000000000004,"15min":0.51800000000000002},"min":{"1min":0.34699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":0.745,"15min":0.745},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.55100000000000005},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.47599999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47999999999999998,"15min":0.48999999999999999},"min":{"1min":0.32600000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.71299999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.435},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50700000000000001,"15min":0.51800000000000002},"min":{"1min":0.38,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76100000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.45300000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.34999999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.74299999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78000000000000003,"5min":0.873,"15min":0.873},"last":0.54900000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53800000000000003,"15min":0.56100000000000005},"min":{"1min":0.38100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67900000000000005,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.499},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56499999999999995,"15min":0.59899999999999998},"min":{"1min":0.41399999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72999999999999998,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:28:59.841 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-10-06T02:23:08.797932+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=23, tm_sec=8, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=28, tm_sec=54, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:28:59.841 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-10-06T02:23:08.797932+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=23, tm_sec=8, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=28, tm_sec=54, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:28:59.841 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-10-06T02:23:08.797932+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=23, tm_sec=8, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=28, tm_sec=54, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:28:59.841 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T02:23:08.797932+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=23, tm_sec=8, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=28, tm_sec=54, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:28:59.842 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-10-06T02:23:08.797932+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=23, tm_sec=8, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=28, tm_sec=54, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:28:59.842 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T02:23:08.797932+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=23, tm_sec=8, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=28, tm_sec=54, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:28:59.842 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-10-06T02:23:08.797932+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=23, tm_sec=8, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=28, tm_sec=54, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:28:59.842 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-10-06T02:23:08.797932+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=23, tm_sec=8, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=28, tm_sec=54, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:28:59.842 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-10-06T02:23:08.797932+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=23, tm_sec=8, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=28, tm_sec=54, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T02:28:59.842 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T02:29:19.843 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:29:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.977+0000 7f9fe3024700 1 Processor -- start 2023-10-06T02:29:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.977+0000 7f9fe3024700 1 -- start start 2023-10-06T02:29:19.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.978+0000 7f9fe3024700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9fdc159aa0 0x7f9fdc0c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:19.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.978+0000 7f9fe3024700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9fdc0c6b30 0x7f9fdc0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:19.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.978+0000 7f9fe3024700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fdc0c5300 con 0x7f9fdc1596d0 2023-10-06T02:29:19.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.978+0000 7f9fe3024700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fdc0c6160 con 0x7f9fdc0c6b30 2023-10-06T02:29:19.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.978+0000 7f9fe3024700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc0c5550 con 0x7f9fdc159aa0 2023-10-06T02:29:19.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.978+0000 7f9fe15c1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9fdc0c6b30 0x7f9fdc0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:19.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.978+0000 7f9fe15c1700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9fdc0c6b30 0x7f9fdc0cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59684/0 (socket says 172.21.15.37:59684) 2023-10-06T02:29:19.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.978+0000 7f9fe15c1700 1 -- 172.21.15.37:0/2155339709 learned_addr learned my addr 172.21.15.37:0/2155339709 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:29:19.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.979+0000 7f9fe15c1700 1 -- 172.21.15.37:0/2155339709 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9fdc159aa0 msgr2=0x7f9fdc0c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:19.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.979+0000 7f9fdbfff700 1 --2- 172.21.15.37:0/2155339709 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9fdc159aa0 0x7f9fdc0c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:19.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.979+0000 7f9fe15c1700 1 --2- 172.21.15.37:0/2155339709 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9fdc159aa0 0x7f9fdc0c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:19.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.979+0000 7f9fe15c1700 1 -- 172.21.15.37:0/2155339709 >> v1:172.21.15.191:6789/0 conn(0x7f9fdc1596d0 legacy=0x7f9fdc0b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:19.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.979+0000 7f9fe15c1700 1 -- 172.21.15.37:0/2155339709 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fdc0c5830 con 0x7f9fdc0c6b30 2023-10-06T02:29:19.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.979+0000 7f9fdbfff700 1 --2- 172.21.15.37:0/2155339709 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9fdc159aa0 0x7f9fdc0c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.979+0000 7f9fe15c1700 1 --2- 172.21.15.37:0/2155339709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fdc0c6b30 0x7f9fdc0cf9f0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4009f20 tx=0x7f9fd4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0167cb228528763 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.979+0000 7f9fdb7fe700 1 -- 172.21.15.37:0/2155339709 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd400e070 con 0x7f9fdc0c6b30 2023-10-06T02:29:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.979+0000 7f9fdb7fe700 1 -- 172.21.15.37:0/2155339709 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd400ba40 con 0x7f9fdc0c6b30 2023-10-06T02:29:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.979+0000 7f9fdb7fe700 1 -- 172.21.15.37:0/2155339709 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd40092e0 con 0x7f9fdc0c6b30 2023-10-06T02:29:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.979+0000 7f9fe3024700 1 -- 172.21.15.37:0/2155339709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fdc0c6b30 msgr2=0x7f9fdc0cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.979+0000 7f9fe3024700 1 --2- 172.21.15.37:0/2155339709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fdc0c6b30 0x7f9fdc0cf9f0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4009f20 tx=0x7f9fd4009840 comp rx=0 tx=0).stop 2023-10-06T02:29:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.980+0000 7f9fe3024700 1 -- 172.21.15.37:0/2155339709 shutdown_connections 2023-10-06T02:29:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.980+0000 7f9fe3024700 1 --2- 172.21.15.37:0/2155339709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fdc0c6b30 0x7f9fdc0cf9f0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.980+0000 7f9fe3024700 1 --2- 172.21.15.37:0/2155339709 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9fdc159aa0 0x7f9fdc0c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.980+0000 7f9fe3024700 1 -- 172.21.15.37:0/2155339709 >> 172.21.15.37:0/2155339709 conn(0x7f9fdc06c890 msgr2=0x7f9fdc0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.980+0000 7f9fe3024700 1 -- 172.21.15.37:0/2155339709 shutdown_connections 2023-10-06T02:29:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.980+0000 7f9fe3024700 1 -- 172.21.15.37:0/2155339709 wait complete. 2023-10-06T02:29:19.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.981+0000 7f9fe3024700 1 Processor -- start 2023-10-06T02:29:19.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.981+0000 7f9fe3024700 1 -- start start 2023-10-06T02:29:19.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fe3024700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fdc0c6b30 0x7f9fdc0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:19.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fe3024700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9fdc1596d0 0x7f9fdc14f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:19.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fe3024700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9fdc159aa0 0x7f9fdc15e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:19.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fe3024700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc0b6020 con 0x7f9fdc0c6b30 2023-10-06T02:29:19.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fe3024700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc0b51f0 con 0x7f9fdc1596d0 2023-10-06T02:29:19.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fe3024700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc15b220 con 0x7f9fdc159aa0 2023-10-06T02:29:19.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fe0dc0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fdc0c6b30 0x7f9fdc0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:19.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fe0dc0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fdc0c6b30 0x7f9fdc0b4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59700/0 (socket says 172.21.15.37:59700) 2023-10-06T02:29:19.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fe0dc0700 1 -- 172.21.15.37:0/259859161 learned_addr learned my addr 172.21.15.37:0/259859161 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:29:19.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fe15c1700 1 --2- 172.21.15.37:0/259859161 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9fdc159aa0 0x7f9fdc15e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:19.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fdbfff700 1 --2- 172.21.15.37:0/259859161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9fdc1596d0 0x7f9fdc14f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:19.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fe0dc0700 1 -- 172.21.15.37:0/259859161 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9fdc159aa0 msgr2=0x7f9fdc15e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:19.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fe0dc0700 1 --2- 172.21.15.37:0/259859161 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9fdc159aa0 0x7f9fdc15e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:19.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fe0dc0700 1 -- 172.21.15.37:0/259859161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9fdc1596d0 msgr2=0x7f9fdc14f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:19.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fe0dc0700 1 --2- 172.21.15.37:0/259859161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9fdc1596d0 0x7f9fdc14f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:19.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fe0dc0700 1 -- 172.21.15.37:0/259859161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd4009ae0 con 0x7f9fdc0c6b30 2023-10-06T02:29:19.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fe15c1700 1 --2- 172.21.15.37:0/259859161 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9fdc159aa0 0x7f9fdc15e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:19.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fdbfff700 1 --2- 172.21.15.37:0/259859161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9fdc1596d0 0x7f9fdc14f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:29:19.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fe0dc0700 1 --2- 172.21.15.37:0/259859161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fdc0c6b30 0x7f9fdc0b4cb0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000c5d0 tx=0x7f9fd0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:19.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fd8ff9700 1 -- 172.21.15.37:0/259859161 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0011590 con 0x7f9fdc0c6b30 2023-10-06T02:29:19.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fd8ff9700 1 -- 172.21.15.37:0/259859161 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd0011710 con 0x7f9fdc0c6b30 2023-10-06T02:29:19.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fe3024700 1 -- 172.21.15.37:0/259859161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fdc16d510 con 0x7f9fdc0c6b30 2023-10-06T02:29:19.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.982+0000 7f9fd8ff9700 1 -- 172.21.15.37:0/259859161 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0011ad0 con 0x7f9fdc0c6b30 2023-10-06T02:29:19.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.983+0000 7f9fe3024700 1 -- 172.21.15.37:0/259859161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fdc16ddb0 con 0x7f9fdc0c6b30 2023-10-06T02:29:19.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.984+0000 7f9fe3024700 1 -- 172.21.15.37:0/259859161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fdc06fbf0 con 0x7f9fdc0c6b30 2023-10-06T02:29:19.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.984+0000 7f9fd8ff9700 1 -- 172.21.15.37:0/259859161 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9fd001c460 con 0x7f9fdc0c6b30 2023-10-06T02:29:19.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.984+0000 7f9fd8ff9700 1 --2- 172.21.15.37:0/259859161 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9fc0066f30 0x7f9fc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:19.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.984+0000 7f9fd8ff9700 1 -- 172.21.15.37:0/259859161 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9fd00842a0 con 0x7f9fdc0c6b30 2023-10-06T02:29:19.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.985+0000 7f9fdbfff700 1 --2- 172.21.15.37:0/259859161 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9fc0066f30 0x7f9fc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:19.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.985+0000 7f9fdbfff700 1 --2- 172.21.15.37:0/259859161 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9fc0066f30 0x7f9fc00693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0ce300 tx=0x7f9fc8006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:19.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:19.989+0000 7f9fd8ff9700 1 -- 172.21.15.37:0/259859161 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fd0051600 con 0x7f9fdc0c6b30 2023-10-06T02:29:20.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.181+0000 7f9fe3024700 1 -- 172.21.15.37:0/259859161 --> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9fdc15b360 con 0x7f9fc0066f30 2023-10-06T02:29:20.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.184+0000 7f9fd8ff9700 1 -- 172.21.15.37:0/259859161 <== mgr.4102 v2:172.21.15.191:6832/90267 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73553 (secure 0 0 0) 0x7f9fc800f760 con 0x7f9fc0066f30 2023-10-06T02:29:20.186 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:29:20.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.186+0000 7f9fe3024700 1 -- 172.21.15.37:0/259859161 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9fc0066f30 msgr2=0x7f9fc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:20.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.186+0000 7f9fe3024700 1 --2- 172.21.15.37:0/259859161 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9fc0066f30 0x7f9fc00693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0ce300 tx=0x7f9fc8006f90 comp rx=0 tx=0).stop 2023-10-06T02:29:20.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.186+0000 7f9fe3024700 1 -- 172.21.15.37:0/259859161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fdc0c6b30 msgr2=0x7f9fdc0b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:20.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.186+0000 7f9fe3024700 1 --2- 172.21.15.37:0/259859161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fdc0c6b30 0x7f9fdc0b4cb0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000c5d0 tx=0x7f9fd0007f60 comp rx=0 tx=0).stop 2023-10-06T02:29:20.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.186+0000 7f9fe3024700 1 -- 172.21.15.37:0/259859161 shutdown_connections 2023-10-06T02:29:20.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.186+0000 7f9fe3024700 1 --2- 172.21.15.37:0/259859161 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9fdc159aa0 0x7f9fdc15e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.186+0000 7f9fe3024700 1 --2- 172.21.15.37:0/259859161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fdc0c6b30 0x7f9fdc0b4cb0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.186+0000 7f9fe3024700 1 --2- 172.21.15.37:0/259859161 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f9fc0066f30 0x7f9fc00693e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.186+0000 7f9fe3024700 1 --2- 172.21.15.37:0/259859161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9fdc1596d0 0x7f9fdc14f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.186+0000 7f9fe3024700 1 -- 172.21.15.37:0/259859161 >> 172.21.15.37:0/259859161 conn(0x7f9fdc06c890 msgr2=0x7f9fdc158760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:20.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.186+0000 7f9fe3024700 1 -- 172.21.15.37:0/259859161 shutdown_connections 2023-10-06T02:29:20.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.186+0000 7f9fe3024700 1 -- 172.21.15.37:0/259859161 wait complete. 2023-10-06T02:29:20.189 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-10-06T02:29:20.199 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2023-10-06T02:29:18.597200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2395036,"kb_used_data":8540,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752579684,"statfs":{"total":773094113280,"available":770641596416,"internally_reserved":0,"allocated":8744960,"data_stored":4570685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002476"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":74,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-06T02:29:01.070884+0000","last_change":"2023-10-06T02:29:01.070856+0000","last_active":"2023-10-06T02:29:01.070884+0000","last_peered":"2023-10-06T02:29:01.070884+0000","last_clean":"2023-10-06T02:29:01.070884+0000","last_became_active":"2023-10-06T02:23:10.474976+0000","last_became_peered":"2023-10-06T02:23:10.474976+0000","last_unstale":"2023-10-06T02:29:01.070884+0000","last_undegraded":"2023-10-06T02:29:01.070884+0000","last_fullsized":"2023-10-06T02:29:01.070884+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:29:01.070747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:29:01.070747+0000","last_clean_scrub_stamp":"2023-10-06T02:29:01.070747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:32.985607+0000","scrub_duration":0.0022177199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":73,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-06T02:28:59.532991+0000","last_change":"2023-10-06T02:28:59.532971+0000","last_active":"2023-10-06T02:28:59.532991+0000","last_peered":"2023-10-06T02:28:59.532991+0000","last_clean":"2023-10-06T02:28:59.532991+0000","last_became_active":"2023-10-06T02:23:09.820458+0000","last_became_peered":"2023-10-06T02:23:09.820458+0000","last_unstale":"2023-10-06T02:28:59.532991+0000","last_undegraded":"2023-10-06T02:28:59.532991+0000","last_fullsized":"2023-10-06T02:28:59.532991+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:28:59.532895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:28:59.532895+0000","last_clean_scrub_stamp":"2023-10-06T02:28:59.532895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:06:27.220129+0000","scrub_duration":0.0016345909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":73,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-06T02:29:01.090862+0000","last_change":"2023-10-06T02:29:01.090821+0000","last_active":"2023-10-06T02:29:01.090862+0000","last_peered":"2023-10-06T02:29:01.090862+0000","last_clean":"2023-10-06T02:29:01.090862+0000","last_became_active":"2023-10-06T02:23:09.826667+0000","last_became_peered":"2023-10-06T02:23:09.826667+0000","last_unstale":"2023-10-06T02:29:01.090862+0000","last_undegraded":"2023-10-06T02:29:01.090862+0000","last_fullsized":"2023-10-06T02:29:01.090862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:29:01.090718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:29:01.090718+0000","last_clean_scrub_stamp":"2023-10-06T02:29:01.090718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:08.069759+0000","scrub_duration":0.0020731450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"77'119","reported_seq":221,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-06T02:29:05.758146+0000","last_change":"2023-10-06T02:29:05.758116+0000","last_active":"2023-10-06T02:29:05.758146+0000","last_peered":"2023-10-06T02:29:05.758146+0000","last_clean":"2023-10-06T02:29:05.758146+0000","last_became_active":"2023-10-06T02:23:09.826606+0000","last_became_peered":"2023-10-06T02:23:09.826606+0000","last_unstale":"2023-10-06T02:29:05.758146+0000","last_undegraded":"2023-10-06T02:29:05.758146+0000","last_fullsized":"2023-10-06T02:29:05.758146+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'119","last_scrub_stamp":"2023-10-06T02:29:05.758021+0000","last_deep_scrub":"77'119","last_deep_scrub_stamp":"2023-10-06T02:29:05.758021+0000","last_clean_scrub_stamp":"2023-10-06T02:29:05.758021+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:06:33.445255+0000","scrub_duration":0.0058764389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":69,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-06T02:29:03.729429+0000","last_change":"2023-10-06T02:29:03.729381+0000","last_active":"2023-10-06T02:29:03.729429+0000","last_peered":"2023-10-06T02:29:03.729429+0000","last_clean":"2023-10-06T02:29:03.729429+0000","last_became_active":"2023-10-06T02:23:10.566313+0000","last_became_peered":"2023-10-06T02:23:10.566313+0000","last_unstale":"2023-10-06T02:29:03.729429+0000","last_undegraded":"2023-10-06T02:29:03.729429+0000","last_fullsized":"2023-10-06T02:29:03.729429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:29:03.729266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:29:03.729266+0000","last_clean_scrub_stamp":"2023-10-06T02:29:03.729266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:30:24.437480+0000","scrub_duration":0.0021820810000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":69,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-06T02:28:59.767593+0000","last_change":"2023-10-06T02:28:59.767554+0000","last_active":"2023-10-06T02:28:59.767593+0000","last_peered":"2023-10-06T02:28:59.767593+0000","last_clean":"2023-10-06T02:28:59.767593+0000","last_became_active":"2023-10-06T02:23:10.566353+0000","last_became_peered":"2023-10-06T02:23:10.566353+0000","last_unstale":"2023-10-06T02:28:59.767593+0000","last_undegraded":"2023-10-06T02:28:59.767593+0000","last_fullsized":"2023-10-06T02:28:59.767593+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:28:59.767422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:28:59.767422+0000","last_clean_scrub_stamp":"2023-10-06T02:28:59.767422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:35.303709+0000","scrub_duration":0.0016548260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":80,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-06T02:29:01.082452+0000","last_change":"2023-10-06T02:29:01.082418+0000","last_active":"2023-10-06T02:29:01.082452+0000","last_peered":"2023-10-06T02:29:01.082452+0000","last_clean":"2023-10-06T02:29:01.082452+0000","last_became_active":"2023-10-06T02:23:10.566442+0000","last_became_peered":"2023-10-06T02:23:10.566442+0000","last_unstale":"2023-10-06T02:29:01.082452+0000","last_undegraded":"2023-10-06T02:29:01.082452+0000","last_fullsized":"2023-10-06T02:29:01.082452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:29:01.082297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:29:01.082297+0000","last_clean_scrub_stamp":"2023-10-06T02:29:01.082297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:28.286615+0000","scrub_duration":0.0021035160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":73,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-06T02:29:01.254375+0000","last_change":"2023-10-06T02:29:01.254347+0000","last_active":"2023-10-06T02:29:01.254375+0000","last_peered":"2023-10-06T02:29:01.254375+0000","last_clean":"2023-10-06T02:29:01.254375+0000","last_became_active":"2023-10-06T02:23:10.566663+0000","last_became_peered":"2023-10-06T02:23:10.566663+0000","last_unstale":"2023-10-06T02:29:01.254375+0000","last_undegraded":"2023-10-06T02:29:01.254375+0000","last_fullsized":"2023-10-06T02:29:01.254375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:29:01.254239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:29:01.254239+0000","last_clean_scrub_stamp":"2023-10-06T02:29:01.254239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:42.795385+0000","scrub_duration":0.001709344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":73,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-06T02:29:08.377413+0000","last_change":"2023-10-06T02:29:08.377365+0000","last_active":"2023-10-06T02:29:08.377413+0000","last_peered":"2023-10-06T02:29:08.377413+0000","last_clean":"2023-10-06T02:29:08.377413+0000","last_became_active":"2023-10-06T02:23:09.820206+0000","last_became_peered":"2023-10-06T02:23:09.820206+0000","last_unstale":"2023-10-06T02:29:08.377413+0000","last_undegraded":"2023-10-06T02:29:08.377413+0000","last_fullsized":"2023-10-06T02:29:08.377413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:29:08.377251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:29:08.377251+0000","last_clean_scrub_stamp":"2023-10-06T02:29:08.377251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:15.356292+0000","scrub_duration":0.0022439550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302888,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068952,"statfs":{"total":96636764160,"available":96326606848,"internally_reserved":0,"allocated":1540096,"data_stored":1014619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.376,"5min":0.311,"15min":0.311},"max":{"1min":0.66800000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57199999999999995,"15min":0.55100000000000005},"min":{"1min":0.37,"5min":0.314,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.35099999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55400000000000005,"15min":0.52400000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56299999999999994,"15min":0.54300000000000004},"min":{"1min":0.41699999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68799999999999994,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.46600000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56999999999999995,"15min":0.55500000000000005},"min":{"1min":0.42999999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78300000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57699999999999996,"15min":0.55600000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79900000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.71399999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.56499999999999995},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48299999999999998,"15min":0.499},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65300000000000002,"5min":1.014,"15min":1.014},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.36299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.63400000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.371}]},{"osd":5,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.503,"15min":0.51400000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66700000000000004,"5min":0.747,"15min":0.747},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.43099999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56699999999999995,"15min":0.58399999999999996},"min":{"1min":0.38400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76700000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.498},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56799999999999995,"15min":0.58999999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574925,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073632,"statfs":{"total":96636764160,"available":96331399168,"internally_reserved":0,"allocated":942080,"data_stored":422898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59899999999999998,"15min":0.72099999999999997},"min":{"1min":0.33600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.71299999999999997,"5min":5.859,"15min":5.859},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.38800000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82799999999999996,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54400000000000004,"15min":0.52300000000000002},"min":{"1min":0.35699999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.879,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56499999999999995,"15min":0.53900000000000003},"min":{"1min":0.42099999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81299999999999994,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.54500000000000004},"min":{"1min":0.38700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85599999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.59999999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58499999999999996,"15min":0.55500000000000005},"min":{"1min":0.40600000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84299999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.47299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.67300000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.33600000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67000000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.41099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.68999999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.46800000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.42899999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70399999999999996,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.41199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.5}]},{"osd":7,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.58199999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.628},{"interface":"front","average":{"1min":0.63,"5min":0.59599999999999997,"15min":0.60499999999999998},"min":{"1min":0.49099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79700000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56299999999999994}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302888,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068952,"statfs":{"total":96636764160,"available":96326606848,"internally_reserved":0,"allocated":1540096,"data_stored":1014619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35699999999999998,"15min":0.376},"min":{"1min":0.23100000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.502,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.38},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.46400000000000002,"15min":0.64800000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.55800000000000005,"5min":7.6900000000000004,"15min":7.6900000000000004},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.42399999999999999,"15min":0.60499999999999998},"min":{"1min":0.248,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48899999999999999,"5min":7.3639999999999999,"15min":7.3639999999999999},"last":0.432},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.48899999999999999,"15min":0.67800000000000005},"min":{"1min":0.32800000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.60199999999999998,"5min":7.758,"15min":7.758},"last":0.40000000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.51600000000000001,"15min":0.70399999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59399999999999997,"5min":7.7869999999999999,"15min":7.7869999999999999},"last":0.504},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.41299999999999998,"15min":0.42199999999999999},"min":{"1min":0.27600000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57999999999999996,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.73099999999999998,"15min":1.0309999999999999},"min":{"1min":0.41699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88700000000000001,"5min":11.678000000000001,"15min":11.678000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.68999999999999995,"15min":0.88},"min":{"1min":0.443,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77200000000000002,"5min":7.6529999999999996,"15min":7.6529999999999996},"last":0.751}]},{"osd":5,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66700000000000004,"15min":0.67100000000000004},"min":{"1min":0.46000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81399999999999995,"5min":1.399,"15min":1.399},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.73099999999999998,"15min":0.91400000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.81699999999999995,"5min":7.508,"15min":7.508},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.70699999999999996,"15min":0.89100000000000001},"min":{"1min":0.47399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82899999999999996,"5min":7.7270000000000003,"15min":7.7270000000000003},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.65900000000000003,"15min":0.68300000000000005},"min":{"1min":0.45700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.75600000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:28:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67900000000000005,"15min":0.69099999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85299999999999998,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.75700000000000001,"15min":0.93700000000000006},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.82999999999999996,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.84999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073632,"statfs":{"total":96636764160,"available":96331399168,"internally_reserved":0,"allocated":942080,"data_stored":422898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.34799999999999998},"min":{"1min":0.23300000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.372},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.38900000000000001,"15min":0.36799999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.502}]},{"osd":2,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39900000000000002,"15min":0.38900000000000001},"min":{"1min":0.29399999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52200000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42199999999999999,"15min":0.41499999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.624,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.46300000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.371,"15min":0.35599999999999998},"min":{"1min":0.26000000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.53300000000000003,"5min":0.622,"15min":0.622},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.42499999999999999,"15min":0.40100000000000002},"min":{"1min":0.30199999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.52300000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.46899999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83999999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.85399999999999998,"5min":1.008,"15min":1.008},"last":0.751}]},{"osd":5,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77900000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.40600000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77400000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.72599999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84399999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.439,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":1,"15min":1},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:28:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81100000000000005,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86099999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.78800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":424251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.34000000000000002},"min":{"1min":0.25700000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.53000000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.38200000000000001},"min":{"1min":0.26600000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.55200000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.36099999999999999,"15min":0.35099999999999998},"min":{"1min":0.27400000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46000000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40999999999999998,"15min":0.40200000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.36899999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.42799999999999999,"15min":0.41199999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54600000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42699999999999999,"15min":0.42999999999999999},"min":{"1min":0.32900000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.53900000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61299999999999999,"15min":0.60399999999999998},"min":{"1min":0.46300000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92800000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.46400000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82999999999999996,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.623}]},{"osd":5,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93899999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.63},"min":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.84299999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.68000000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.46100000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95699999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.47699999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.755}]},{"osd":7,"last update":"Fri Oct 6 02:28:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65900000000000003,"15min":0.67100000000000004},"min":{"1min":0.44900000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83999999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47899999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.91900000000000004,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.84699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073632,"statfs":{"total":96636764160,"available":96331399168,"internally_reserved":0,"allocated":942080,"data_stored":422898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.44500000000000001,"15min":0.66300000000000003},"min":{"1min":0.24299999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.55900000000000005,"5min":10.164999999999999,"15min":10.164999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.39200000000000002,"15min":0.40600000000000003},"min":{"1min":0.25,"5min":0.224,"15min":0.224},"max":{"1min":0.46500000000000002,"5min":1.266,"15min":1.266},"last":0.41499999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.28000000000000003,"5min":0.191,"15min":0.191},"max":{"1min":0.68400000000000005,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42299999999999999,"15min":0.42999999999999999},"min":{"1min":0.249,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.77800000000000002,"5min":1.319,"15min":1.319},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44,"15min":0.44},"min":{"1min":0.28100000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.93500000000000005,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.46600000000000003,"15min":0.48399999999999999},"min":{"1min":0.30599999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58799999999999997,"5min":1.5,"15min":1.5},"last":0.44800000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.621,"15min":0.627},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77000000000000002,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85899999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.76200000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63600000000000001,"15min":0.65400000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84299999999999997,"5min":1.538,"15min":1.538},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63700000000000001,"15min":0.63800000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79900000000000004,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.44,"5min":0.38,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":1.111,"15min":1.111},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66800000000000004,"15min":0.68300000000000005},"min":{"1min":0.45700000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.875,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.71899999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:28:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65100000000000002,"15min":0.65000000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81899999999999995,"5min":1.21,"15min":1.21},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.63700000000000001,"15min":0.64700000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80400000000000005,"5min":1.135,"15min":1.135},"last":0.66000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":424251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.52000000000000002},"min":{"1min":0.40100000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.628,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54700000000000004,"15min":0.51500000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73999999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.40799999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54100000000000004,"15min":0.504},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.71299999999999997,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.438},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68899999999999995,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.57699999999999996},"min":{"1min":0.48399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69499999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.58599999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77100000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.372,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73499999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.44,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76200000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.48799999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.499,"15min":0.49099999999999999},"min":{"1min":0.35399999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68700000000000006,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.41899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72799999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.63}]},{"osd":6,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51500000000000001,"15min":0.52200000000000002},"min":{"1min":0.39200000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69999999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.62},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71599999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.54100000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.42899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80500000000000005,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.45700000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.79800000000000004,"5min":1.04,"15min":1.04},"last":0.58999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574925,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":424251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.501},"min":{"1min":0.377,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66000000000000003,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52800000000000002,"15min":0.496},"min":{"1min":0.30299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53400000000000003,"15min":0.498},"min":{"1min":0.38100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66700000000000004,"5min":0.755,"15min":0.755},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52900000000000003,"15min":0.503},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.62}]},{"osd":2,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58499999999999996,"15min":0.56299999999999994},"min":{"1min":0.43099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76400000000000001,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59899999999999998,"15min":0.57699999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79600000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54200000000000004,"15min":0.51800000000000002},"min":{"1min":0.34699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":0.745,"15min":0.745},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.55100000000000005},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.47999999999999998,"15min":0.48999999999999999},"min":{"1min":0.32600000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.71299999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50700000000000001,"15min":0.51800000000000002},"min":{"1min":0.38,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76100000000000001,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.46500000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.497,"15min":0.50900000000000001},"min":{"1min":0.34999999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.74299999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78000000000000003,"5min":0.873,"15min":0.873},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:28:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53800000000000003,"15min":0.56100000000000005},"min":{"1min":0.38100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67900000000000005,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56499999999999995,"15min":0.59899999999999998},"min":{"1min":0.41399999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72999999999999998,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:29:20.202 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T02:29:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.321+0000 7fb4ad781700 1 Processor -- start 2023-10-06T02:29:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.321+0000 7fb4ad781700 1 -- start start 2023-10-06T02:29:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.322+0000 7fb4ad781700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a80ca3f0 0x7fb4a80caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.322+0000 7fb4ad781700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a80697c0 con 0x7fb4a80ca020 2023-10-06T02:29:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.322+0000 7fb4ad781700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a8068bb0 con 0x7fb4a80cc450 2023-10-06T02:29:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.322+0000 7fb4ad781700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a8068e90 con 0x7fb4a80ca3f0 2023-10-06T02:29:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.322+0000 7fb4a7fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb4a80ca020 0x7fb4a80cbd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55616/0 (socket says 172.21.15.37:55616) 2023-10-06T02:29:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.322+0000 7fb4a7fff700 1 -- 172.21.15.37:0/3748442737 learned_addr learned my addr 172.21.15.37:0/3748442737 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:29:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.322+0000 7fb4a77fe700 1 --2- 172.21.15.37:0/3748442737 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a80ca3f0 0x7fb4a80caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.322+0000 7fb4a6ffd700 1 -- 172.21.15.37:0/3748442737 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512843337 0 0) 0x7fb4a80697c0 con 0x7fb4a80ca020 2023-10-06T02:29:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.322+0000 7fb4a6ffd700 1 -- 172.21.15.37:0/3748442737 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb494003570 con 0x7fb4a80ca020 2023-10-06T02:29:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.323+0000 7fb4a6ffd700 1 -- 172.21.15.37:0/3748442737 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651779443 0 0) 0x7fb4a8068bb0 con 0x7fb4a80cc450 2023-10-06T02:29:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.323+0000 7fb4a6ffd700 1 -- 172.21.15.37:0/3748442737 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4a80697c0 con 0x7fb4a80cc450 2023-10-06T02:29:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.323+0000 7fb4a77fe700 1 -- 172.21.15.37:0/3748442737 >> v1:172.21.15.191:6789/0 conn(0x7fb4a80cc450 legacy=0x7fb4a8159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.323+0000 7fb4a77fe700 1 -- 172.21.15.37:0/3748442737 >> v1:172.21.15.37:6789/0 conn(0x7fb4a80ca020 legacy=0x7fb4a80cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.323+0000 7fb4a77fe700 1 -- 172.21.15.37:0/3748442737 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a8069170 con 0x7fb4a80ca3f0 2023-10-06T02:29:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.323+0000 7fb4a77fe700 1 --2- 172.21.15.37:0/3748442737 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a80ca3f0 0x7fb4a80caa80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb498009910 tx=0x7fb4980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35dde4ed9e4a6fb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.323+0000 7fb4a6ffd700 1 -- 172.21.15.37:0/3748442737 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb498011630 con 0x7fb4a80ca3f0 2023-10-06T02:29:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.323+0000 7fb4a6ffd700 1 -- 172.21.15.37:0/3748442737 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb498011790 con 0x7fb4a80ca3f0 2023-10-06T02:29:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.323+0000 7fb4a6ffd700 1 -- 172.21.15.37:0/3748442737 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb498011b10 con 0x7fb4a80ca3f0 2023-10-06T02:29:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.324+0000 7fb4ad781700 1 -- 172.21.15.37:0/3748442737 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a80ca3f0 msgr2=0x7fb4a80caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.324+0000 7fb4ad781700 1 --2- 172.21.15.37:0/3748442737 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a80ca3f0 0x7fb4a80caa80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb498009910 tx=0x7fb4980091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.324+0000 7fb4ad781700 1 -- 172.21.15.37:0/3748442737 shutdown_connections 2023-10-06T02:29:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.324+0000 7fb4ad781700 1 --2- 172.21.15.37:0/3748442737 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a80ca3f0 0x7fb4a80caa80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.324+0000 7fb4ad781700 1 -- 172.21.15.37:0/3748442737 >> 172.21.15.37:0/3748442737 conn(0x7fb4a8068130 msgr2=0x7fb4a806c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.324+0000 7fb4ad781700 1 -- 172.21.15.37:0/3748442737 shutdown_connections 2023-10-06T02:29:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.324+0000 7fb4ad781700 1 -- 172.21.15.37:0/3748442737 wait complete. 2023-10-06T02:29:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.325+0000 7fb4ad781700 1 Processor -- start 2023-10-06T02:29:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.325+0000 7fb4ad781700 1 -- start start 2023-10-06T02:29:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb4ad781700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a80ca020 0x7fb4a816a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb4ad781700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4a80ca3f0 0x7fb4a816c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb4ad781700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4a80cc450 0x7fb4a80c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb4ad781700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a815b210 con 0x7fb4a80cc450 2023-10-06T02:29:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb4ad781700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a816a9d0 con 0x7fb4a80ca3f0 2023-10-06T02:29:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb4ad781700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a816ce10 con 0x7fb4a80ca020 2023-10-06T02:29:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb4acf80700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4a80cc450 0x7fb4a80c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb4acf80700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4a80cc450 0x7fb4a80c3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59714/0 (socket says 172.21.15.37:59714) 2023-10-06T02:29:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb4acf80700 1 -- 172.21.15.37:0/1570411731 learned_addr learned my addr 172.21.15.37:0/1570411731 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:29:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb4a7fff700 1 --2- 172.21.15.37:0/1570411731 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a80ca020 0x7fb4a816a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb4a77fe700 1 --2- 172.21.15.37:0/1570411731 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4a80ca3f0 0x7fb4a816c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb4acf80700 1 -- 172.21.15.37:0/1570411731 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a80ca020 msgr2=0x7fb4a816a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb4acf80700 1 --2- 172.21.15.37:0/1570411731 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a80ca020 0x7fb4a816a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb4acf80700 1 -- 172.21.15.37:0/1570411731 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4a80ca3f0 msgr2=0x7fb4a816c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb4acf80700 1 --2- 172.21.15.37:0/1570411731 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4a80ca3f0 0x7fb4a816c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb4acf80700 1 -- 172.21.15.37:0/1570411731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb498009420 con 0x7fb4a80cc450 2023-10-06T02:29:20.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb4acf80700 1 --2- 172.21.15.37:0/1570411731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4a80cc450 0x7fb4a80c3ee0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000c890 tx=0x7fb4a0002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:20.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb49ffff700 1 -- 172.21.15.37:0/1570411731 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0012630 con 0x7fb4a80cc450 2023-10-06T02:29:20.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb49ffff700 1 -- 172.21.15.37:0/1570411731 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a00127b0 con 0x7fb4a80cc450 2023-10-06T02:29:20.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb49ffff700 1 -- 172.21.15.37:0/1570411731 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0012b70 con 0x7fb4a80cc450 2023-10-06T02:29:20.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb4ad781700 1 -- 172.21.15.37:0/1570411731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a815a600 con 0x7fb4a80cc450 2023-10-06T02:29:20.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.326+0000 7fb4ad781700 1 -- 172.21.15.37:0/1570411731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a815abc0 con 0x7fb4a80cc450 2023-10-06T02:29:20.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.327+0000 7fb4ad781700 1 -- 172.21.15.37:0/1570411731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a815b380 con 0x7fb4a80cc450 2023-10-06T02:29:20.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.328+0000 7fb49ffff700 1 -- 172.21.15.37:0/1570411731 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb4a001b400 con 0x7fb4a80cc450 2023-10-06T02:29:20.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.328+0000 7fb49ffff700 1 --2- 172.21.15.37:0/1570411731 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb488066f30 0x7fb4880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:20.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.328+0000 7fb49ffff700 1 -- 172.21.15.37:0/1570411731 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb4a0084700 con 0x7fb4a80cc450 2023-10-06T02:29:20.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.329+0000 7fb4a7fff700 1 --2- 172.21.15.37:0/1570411731 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb488066f30 0x7fb4880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:20.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.329+0000 7fb4a7fff700 1 --2- 172.21.15.37:0/1570411731 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb488066f30 0x7fb4880693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb490007fd0 tx=0x7fb490009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:20.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.333+0000 7fb49ffff700 1 -- 172.21.15.37:0/1570411731 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4a0051a60 con 0x7fb4a80cc450 2023-10-06T02:29:20.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.523+0000 7fb4ad781700 1 -- 172.21.15.37:0/1570411731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fb4a8064b00 con 0x7fb4a80cc450 2023-10-06T02:29:20.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.526+0000 7fb49ffff700 1 -- 172.21.15.37:0/1570411731 <== mon.0 v2:172.21.15.37:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb4a0051a60 con 0x7fb4a80cc450 2023-10-06T02:29:20.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.527+0000 7fb49ffff700 1 -- 172.21.15.37:0/1570411731 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v18)=0 v18) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb4a00160c0 con 0x7fb4a80cc450 2023-10-06T02:29:20.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.530+0000 7fb4ad781700 1 -- 172.21.15.37:0/1570411731 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb488066f30 msgr2=0x7fb4880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:20.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.530+0000 7fb4ad781700 1 --2- 172.21.15.37:0/1570411731 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb488066f30 0x7fb4880693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb490007fd0 tx=0x7fb490009040 comp rx=0 tx=0).stop 2023-10-06T02:29:20.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.530+0000 7fb4ad781700 1 -- 172.21.15.37:0/1570411731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4a80cc450 msgr2=0x7fb4a80c3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:20.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.530+0000 7fb4ad781700 1 --2- 172.21.15.37:0/1570411731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4a80cc450 0x7fb4a80c3ee0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000c890 tx=0x7fb4a0002700 comp rx=0 tx=0).stop 2023-10-06T02:29:20.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.530+0000 7fb4ad781700 1 -- 172.21.15.37:0/1570411731 shutdown_connections 2023-10-06T02:29:20.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.530+0000 7fb4ad781700 1 --2- 172.21.15.37:0/1570411731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4a80cc450 0x7fb4a80c3ee0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.530+0000 7fb4ad781700 1 --2- 172.21.15.37:0/1570411731 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4a80ca020 0x7fb4a816a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.530+0000 7fb4ad781700 1 --2- 172.21.15.37:0/1570411731 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7fb488066f30 0x7fb4880693e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.530+0000 7fb4ad781700 1 --2- 172.21.15.37:0/1570411731 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4a80ca3f0 0x7fb4a816c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.530+0000 7fb4ad781700 1 -- 172.21.15.37:0/1570411731 >> 172.21.15.37:0/1570411731 conn(0x7fb4a8068130 msgr2=0x7fb4a8158d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:20.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.530+0000 7fb4ad781700 1 -- 172.21.15.37:0/1570411731 shutdown_connections 2023-10-06T02:29:20.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.530+0000 7fb4ad781700 1 -- 172.21.15.37:0/1570411731 wait complete. 2023-10-06T02:29:20.543 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:29:20.543 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:29:20.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.660+0000 7f5879f40700 1 Processor -- start 2023-10-06T02:29:20.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.661+0000 7f5879f40700 1 -- start start 2023-10-06T02:29:20.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.661+0000 7f5879f40700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58741595a0 0x7f58740b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:20.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.661+0000 7f5879f40700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f587406d890 0x7f587406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:20.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.661+0000 7f5879f40700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587406e240 con 0x7f587406c0b0 2023-10-06T02:29:20.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.661+0000 7f5879f40700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587415e180 con 0x7f587406d890 2023-10-06T02:29:20.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.661+0000 7f5879f40700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58740b1000 con 0x7f58741595a0 2023-10-06T02:29:20.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.662+0000 7f58737fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58741595a0 0x7f58740b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:20.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.662+0000 7f5872ffd700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f587406d890 0x7f587406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:20.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.662+0000 7f5873fff700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f587406c0b0 0x7f587406c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.37:58472/0 (socket says 172.21.15.37:58472) 2023-10-06T02:29:20.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.662+0000 7f5873fff700 1 -- 172.21.15.37:0/2170160682 learned_addr learned my addr 172.21.15.37:0/2170160682 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-10-06T02:29:20.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.662+0000 7f58727fc700 1 -- 172.21.15.37:0/2170160682 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2385740288 0 0) 0x7f587406e240 con 0x7f587406c0b0 2023-10-06T02:29:20.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.662+0000 7f58727fc700 1 -- 172.21.15.37:0/2170160682 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f585c003570 con 0x7f587406c0b0 2023-10-06T02:29:20.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.662+0000 7f5872ffd700 1 -- 172.21.15.37:0/2170160682 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58741595a0 msgr2=0x7f58740b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:29:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.662+0000 7f5872ffd700 1 --2- 172.21.15.37:0/2170160682 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58741595a0 0x7f58740b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.662+0000 7f5872ffd700 1 -- 172.21.15.37:0/2170160682 >> v1:172.21.15.191:6789/0 conn(0x7f587406c0b0 legacy=0x7f587406c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.662+0000 7f5872ffd700 1 -- 172.21.15.37:0/2170160682 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587415d570 con 0x7f587406d890 2023-10-06T02:29:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.662+0000 7f58737fe700 1 --2- 172.21.15.37:0/2170160682 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58741595a0 0x7f58740b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:29:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.662+0000 7f5872ffd700 1 --2- 172.21.15.37:0/2170160682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f587406d890 0x7f587406dd00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f58680098e0 tx=0x7f58680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48e7875f8d34517c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.662+0000 7f58727fc700 1 -- 172.21.15.37:0/2170160682 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868011630 con 0x7f587406d890 2023-10-06T02:29:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.662+0000 7f58727fc700 1 -- 172.21.15.37:0/2170160682 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5868011790 con 0x7f587406d890 2023-10-06T02:29:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.663+0000 7f58727fc700 1 -- 172.21.15.37:0/2170160682 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868011b50 con 0x7f587406d890 2023-10-06T02:29:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.663+0000 7f5879f40700 1 -- 172.21.15.37:0/2170160682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f587406d890 msgr2=0x7f587406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.663+0000 7f5879f40700 1 --2- 172.21.15.37:0/2170160682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f587406d890 0x7f587406dd00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f58680098e0 tx=0x7f58680091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.663+0000 7f5879f40700 1 -- 172.21.15.37:0/2170160682 shutdown_connections 2023-10-06T02:29:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.663+0000 7f5879f40700 1 --2- 172.21.15.37:0/2170160682 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58741595a0 0x7f58740b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.663+0000 7f5879f40700 1 --2- 172.21.15.37:0/2170160682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f587406d890 0x7f587406dd00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.663+0000 7f5879f40700 1 -- 172.21.15.37:0/2170160682 >> 172.21.15.37:0/2170160682 conn(0x7f58740d04d0 msgr2=0x7f58740d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.663+0000 7f5879f40700 1 -- 172.21.15.37:0/2170160682 shutdown_connections 2023-10-06T02:29:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.663+0000 7f5879f40700 1 -- 172.21.15.37:0/2170160682 wait complete. 2023-10-06T02:29:20.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.664+0000 7f5879f40700 1 Processor -- start 2023-10-06T02:29:20.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.664+0000 7f5879f40700 1 -- start start 2023-10-06T02:29:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.665+0000 7f5879f40700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f587406c0b0 0x7f58740c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.665+0000 7f5879f40700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f587406d890 0x7f5874150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.665+0000 7f5879f40700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58741595a0 0x7f587406c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.665+0000 7f5879f40700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58740c6d30 con 0x7f587406d890 2023-10-06T02:29:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.665+0000 7f5879f40700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587415bde0 con 0x7f58741595a0 2023-10-06T02:29:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.665+0000 7f5879f40700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587415b1d0 con 0x7f587406c0b0 2023-10-06T02:29:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.665+0000 7f5872ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f587406d890 0x7f5874150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.665+0000 7f5872ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f587406d890 0x7f5874150880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59716/0 (socket says 172.21.15.37:59716) 2023-10-06T02:29:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.665+0000 7f5872ffd700 1 -- 172.21.15.37:0/1630216116 learned_addr learned my addr 172.21.15.37:0/1630216116 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-10-06T02:29:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.665+0000 7f5873fff700 1 --2- 172.21.15.37:0/1630216116 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58741595a0 0x7f587406c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.665+0000 7f58737fe700 1 --2- 172.21.15.37:0/1630216116 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f587406c0b0 0x7f58740c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.665+0000 7f5872ffd700 1 -- 172.21.15.37:0/1630216116 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f587406c0b0 msgr2=0x7f58740c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.665+0000 7f5872ffd700 1 --2- 172.21.15.37:0/1630216116 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f587406c0b0 0x7f58740c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.665+0000 7f5872ffd700 1 -- 172.21.15.37:0/1630216116 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58741595a0 msgr2=0x7f587406c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.665+0000 7f5872ffd700 1 --2- 172.21.15.37:0/1630216116 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58741595a0 0x7f587406c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.665+0000 7f5872ffd700 1 -- 172.21.15.37:0/1630216116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5864009420 con 0x7f587406d890 2023-10-06T02:29:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.666+0000 7f58737fe700 1 --2- 172.21.15.37:0/1630216116 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f587406c0b0 0x7f58740c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:29:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.666+0000 7f5872ffd700 1 --2- 172.21.15.37:0/1630216116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f587406d890 0x7f5874150880 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f5868009ed0 tx=0x7f58680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.666+0000 7f585b7fe700 1 -- 172.21.15.37:0/1630216116 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868006b30 con 0x7f587406d890 2023-10-06T02:29:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.666+0000 7f585b7fe700 1 -- 172.21.15.37:0/1630216116 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5868011b10 con 0x7f587406d890 2023-10-06T02:29:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.666+0000 7f585b7fe700 1 -- 172.21.15.37:0/1630216116 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868025660 con 0x7f587406d890 2023-10-06T02:29:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.666+0000 7f5879f40700 1 -- 172.21.15.37:0/1630216116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5868009420 con 0x7f587406d890 2023-10-06T02:29:20.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.666+0000 7f5879f40700 1 -- 172.21.15.37:0/1630216116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587415b790 con 0x7f587406d890 2023-10-06T02:29:20.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.667+0000 7f5879f40700 1 -- 172.21.15.37:0/1630216116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5874088b20 con 0x7f587406d890 2023-10-06T02:29:20.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.667+0000 7f585b7fe700 1 -- 172.21.15.37:0/1630216116 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5868025a50 con 0x7f587406d890 2023-10-06T02:29:20.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.668+0000 7f585b7fe700 1 --2- 172.21.15.37:0/1630216116 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5860066f30 0x7f58600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:29:20.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.668+0000 7f585b7fe700 1 -- 172.21.15.37:0/1630216116 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5868085b60 con 0x7f587406d890 2023-10-06T02:29:20.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.668+0000 7f58737fe700 1 --2- 172.21.15.37:0/1630216116 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5860066f30 0x7f58600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:29:20.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.668+0000 7f58737fe700 1 --2- 172.21.15.37:0/1630216116 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5860066f30 0x7f58600693e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f58640093f0 tx=0x7f5864008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:29:20.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.672+0000 7f585b7fe700 1 -- 172.21.15.37:0/1630216116 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5868052ec0 con 0x7f587406d890 2023-10-06T02:29:20.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.912+0000 7f5879f40700 1 -- 172.21.15.37:0/1630216116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f587415d850 con 0x7f587406d890 2023-10-06T02:29:20.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.912+0000 7f585b7fe700 1 -- 172.21.15.37:0/1630216116 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f5868015090 con 0x7f587406d890 2023-10-06T02:29:20.914 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-10-06T02:29:20.914 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":62,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6109,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3055524642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":3055524642},{"type":"v1","addr":"172.21.15.37:6835","nonce":3055524642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2821947660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2821947660},{"type":"v1","addr":"172.21.15.191:6836","nonce":2821947660}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6310,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3752119173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3752119173},{"type":"v1","addr":"172.21.15.191:6837","nonce":3752119173}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":7026,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/241164493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":241164493},{"type":"v1","addr":"172.21.15.37:6834","nonce":241164493}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[]} 2023-10-06T02:29:20.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.915+0000 7f5879f40700 1 -- 172.21.15.37:0/1630216116 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5860066f30 msgr2=0x7f58600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:20.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.915+0000 7f5879f40700 1 --2- 172.21.15.37:0/1630216116 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5860066f30 0x7f58600693e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f58640093f0 tx=0x7f5864008040 comp rx=0 tx=0).stop 2023-10-06T02:29:20.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.915+0000 7f5879f40700 1 -- 172.21.15.37:0/1630216116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f587406d890 msgr2=0x7f5874150880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:29:20.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.915+0000 7f5879f40700 1 --2- 172.21.15.37:0/1630216116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f587406d890 0x7f5874150880 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f5868009ed0 tx=0x7f58680091a0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.915+0000 7f5879f40700 1 -- 172.21.15.37:0/1630216116 shutdown_connections 2023-10-06T02:29:20.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.915+0000 7f5879f40700 1 --2- 172.21.15.37:0/1630216116 >> [v2:172.21.15.191:6832/90267,v1:172.21.15.191:6833/90267] conn(0x7f5860066f30 0x7f58600693e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.915+0000 7f5879f40700 1 --2- 172.21.15.37:0/1630216116 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58741595a0 0x7f587406c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.915+0000 7f5879f40700 1 --2- 172.21.15.37:0/1630216116 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f587406c0b0 0x7f58740c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.915+0000 7f5879f40700 1 --2- 172.21.15.37:0/1630216116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f587406d890 0x7f5874150880 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:29:20.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.915+0000 7f5879f40700 1 -- 172.21.15.37:0/1630216116 >> 172.21.15.37:0/1630216116 conn(0x7f58740d04d0 msgr2=0x7f58740cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:29:20.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.915+0000 7f5879f40700 1 -- 172.21.15.37:0/1630216116 shutdown_connections 2023-10-06T02:29:20.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-10-06T02:29:20.915+0000 7f5879f40700 1 -- 172.21.15.37:0/1630216116 wait complete. 2023-10-06T02:29:20.918 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 62 2023-10-06T02:29:20.928 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T02:29:20.928 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T02:29:20.929 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:29:20.929 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:29:20.937 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:29:20.937 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:29:20.937 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:29:20.986 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:29:20.986 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:29:20.986 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:29:20.997 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:29:20.997 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:29:20.997 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:29:21.048 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:29:21.048 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T02:29:21.048 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T02:29:21.049 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:29:21.074 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T02:29:21.075 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T02:29:21.075 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:29:21.147 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T02:29:21.147 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T02:29:21.147 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:29:21.214 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T02:29:21.215 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T02:29:21.215 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:29:21.286 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T02:29:21.286 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T02:29:21.286 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:29:21.322 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T02:29:21.322 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T02:29:21.322 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:29:21.395 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T02:29:21.395 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T02:29:21.395 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:29:21.462 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T02:29:21.462 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T02:29:21.462 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:29:21.541 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T02:29:21.542 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T02:29:21.542 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T02:29:21.542 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:29:21.565 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T02:29:21.565 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T02:29:21.565 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:29:21.607 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T02:29:21.608 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T02:29:21.608 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T02:29:21.608 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:29:21.619 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T02:29:21.619 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T02:29:21.619 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:29:21.660 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T02:29:21.660 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T02:29:21.660 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:29:21.712 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T02:29:21.712 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T02:29:21.712 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2023-10-06T02:29:21.744 INFO:teuthology.orchestra.run.smithi037.stdout:1696558994.8773577 mon.a (mon.0) 135 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T02:29:21.744 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T02:29:21.745 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2023-10-06T02:29:21.815 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2023-10-06T02:29:21.885 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2023-10-06T02:29:21.955 INFO:teuthology.orchestra.run.smithi037.stdout:1696558994.8773577 mon.a (mon.0) 135 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T02:29:21.955 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:29:21.955 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T02:29:22.184 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:29:22.184 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T02:29:22.285 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:29:22.285 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T02:29:22.355 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:29:22.355 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T02:29:22.445 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:29:22.447 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:29:22.531 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:29:22.531 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T02:29:22.748 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:29:22.748 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T02:29:22.829 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:29:22.829 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T02:29:22.916 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:29:22.916 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T02:29:22.977 INFO:tasks.ceph:Archiving mon data... 2023-10-06T02:29:22.978 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412141/data/mon.a.tgz 2023-10-06T02:29:22.978 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2023-10-06T02:29:22.993 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.8DcjlisyiF 2023-10-06T02:29:22.993 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.8DcjlisyiF 2023-10-06T02:29:23.161 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.8DcjlisyiF 2023-10-06T02:29:23.243 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.8DcjlisyiF is 452KB 2023-10-06T02:29:23.340 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.8DcjlisyiF 2023-10-06T02:29:23.355 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412141/data/mon.b.tgz 2023-10-06T02:29:23.355 DEBUG:teuthology.orchestra.run.smithi191:> mktemp 2023-10-06T02:29:23.370 INFO:teuthology.orchestra.run.smithi191.stdout:/tmp/tmp.pfDxhv6w6n 2023-10-06T02:29:23.370 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.pfDxhv6w6n 2023-10-06T02:29:23.564 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0666 /tmp/tmp.pfDxhv6w6n 2023-10-06T02:29:23.965 DEBUG:teuthology.orchestra.remote:smithi191:/tmp/tmp.pfDxhv6w6n is 581KB 2023-10-06T02:29:24.065 DEBUG:teuthology.orchestra.run.smithi191:> rm -fr /tmp/tmp.pfDxhv6w6n 2023-10-06T02:29:24.079 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412141/data/mon.c.tgz 2023-10-06T02:29:25.041 DEBUG:teuthology.orchestra.run.smithi191:> mktemp 2023-10-06T02:29:25.060 INFO:teuthology.orchestra.run.smithi191.stdout:/tmp/tmp.Ciljg4lkdq 2023-10-06T02:29:25.071 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Ciljg4lkdq 2023-10-06T02:29:25.239 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0666 /tmp/tmp.Ciljg4lkdq 2023-10-06T02:29:25.321 DEBUG:teuthology.orchestra.remote:smithi191:/tmp/tmp.Ciljg4lkdq is 581KB 2023-10-06T02:29:25.420 DEBUG:teuthology.orchestra.run.smithi191:> rm -fr /tmp/tmp.Ciljg4lkdq 2023-10-06T02:29:25.434 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T02:29:25.434 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T02:29:25.436 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T02:29:25.496 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T02:29:25.497 DEBUG:teuthology.orchestra.run.smithi037:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T02:29:25.503 DEBUG:teuthology.orchestra.run.smithi191:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T02:29:25.530 INFO:teuthology.orchestra.run.smithi037.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T02:29:25.560 INFO:teuthology.orchestra.run.smithi191.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T02:29:25.566 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T02:29:25.568 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412141/remote/smithi037/crash 2023-10-06T02:29:25.568 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T02:29:25.603 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412141/remote/smithi191/crash 2023-10-06T02:29:25.604 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T02:29:25.631 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T02:29:25.631 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:29:25.647 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:29:25.721 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T02:29:25.746 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T02:29:25.770 INFO:tasks.ceph:Compressing logs... 2023-10-06T02:29:25.770 DEBUG:teuthology.orchestra.run.smithi037:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T02:29:25.790 DEBUG:teuthology.orchestra.run.smithi191:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T02:29:28.033 INFO:tasks.ceph:Archiving logs... 2023-10-06T02:29:28.033 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412141/remote/smithi037/log 2023-10-06T02:29:28.034 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T02:29:28.613 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412141/remote/smithi191/log 2023-10-06T02:29:28.614 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T02:29:28.898 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T02:29:28.907 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T02:29:28.907 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T02:29:28.909 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T02:29:28.991 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T02:29:29.000 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T02:29:29.000 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:29:29.003 DEBUG:teuthology.orchestra.run.smithi191:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:29:29.015 INFO:teuthology.orchestra.run.smithi037.stderr:bash: ntpq: command not found 2023-10-06T02:29:29.018 INFO:teuthology.orchestra.run.smithi191.stderr:bash: ntpq: command not found 2023-10-06T02:29:29.019 INFO:teuthology.orchestra.run.smithi037.stdout:210 Number of sources = 4 2023-10-06T02:29:29.019 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T02:29:29.019 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2023-10-06T02:29:29.019 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 29 -201us[ -201us] +/- 88ms 2023-10-06T02:29:29.019 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv02.front.sepia.ceph.com 3 6 377 29 -384us[ -363us] +/- 75ms 2023-10-06T02:29:29.019 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 29 +641us[ +641us] +/- 82ms 2023-10-06T02:29:29.020 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:29:29.022 INFO:teuthology.orchestra.run.smithi191.stdout:210 Number of sources = 4 2023-10-06T02:29:29.022 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T02:29:29.022 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2023-10-06T02:29:29.022 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 30 -175us[ -175us] +/- 88ms 2023-10-06T02:29:29.022 INFO:teuthology.orchestra.run.smithi191.stdout:^* hv02.front.sepia.ceph.com 3 6 377 31 -361us[ -354us] +/- 75ms 2023-10-06T02:29:29.022 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 +667us[ +667us] +/- 82ms 2023-10-06T02:29:29.023 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:29:29.023 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T02:29:29.032 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T02:29:29.033 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T02:29:29.080 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T02:29:29.189 DEBUG:teuthology.orchestra.run.smithi191:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T02:29:29.288 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T02:29:29.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:29:29.322 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T02:29:29.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:29:29.353 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T02:29:29.363 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T02:29:29.374 INFO:teuthology.task.internal:Duration was 1065.507318 seconds 2023-10-06T02:29:29.374 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T02:29:29.384 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T02:29:29.384 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T02:29:29.387 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T02:29:29.430 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T02:29:29.437 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T02:29:29.606 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T02:29:29.607 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2023-10-06T02:29:29.607 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T02:29:29.626 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi191.front.sepia.ceph.com 2023-10-06T02:29:29.626 DEBUG:teuthology.orchestra.run.smithi191:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T02:29:29.645 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T02:29:29.645 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T02:29:29.668 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T02:29:29.725 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T02:29:29.725 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T02:29:29.753 DEBUG:teuthology.orchestra.run.smithi191:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T02:29:29.840 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T02:29:29.851 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T02:29:29.851 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T02:29:29.877 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T02:29:29.902 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T02:29:29.913 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T02:29:29.920 DEBUG:teuthology.orchestra.run.smithi191:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T02:29:29.942 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2023-10-06T02:29:29.966 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = core 2023-10-06T02:29:29.979 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T02:29:30.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:29:30.011 DEBUG:teuthology.orchestra.run.smithi191:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T02:29:30.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:29:30.033 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T02:29:30.042 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T02:29:30.043 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412141/remote/smithi037 2023-10-06T02:29:30.043 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T02:29:30.089 DEBUG:teuthology.misc:Transferring archived files from smithi191:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412141/remote/smithi191 2023-10-06T02:29:30.089 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T02:29:30.124 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T02:29:30.124 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T02:29:30.127 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T02:29:30.173 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T02:29:30.184 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T02:29:30.185 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T02:29:30.195 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T02:29:30.195 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T02:29:30.198 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T02:29:30.210 INFO:teuthology.orchestra.run.smithi037.stdout: 262176 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 02:29 /home/ubuntu/cephtest 2023-10-06T02:29:30.227 INFO:teuthology.orchestra.run.smithi191.stdout: 263007 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 02:29 /home/ubuntu/cephtest 2023-10-06T02:29:30.229 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T02:29:30.239 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T02:29:30.263 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T02:29:30.291 DEBUG:teuthology.nuke:shortname: smithi037 2023-10-06T02:29:30.291 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T02:29:30.315 DEBUG:teuthology.nuke:shortname: smithi191 2023-10-06T02:29:30.315 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T02:29:30.322 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412141', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:04:47.736116', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJKZlYzKIoGjt9JFShyDF3oIYG1ZkOSvbkkzfJQ7aXa7ji9xesq8T8H2iwcL2Cnnfcmkm3GdqofyWGlMdZ1KwSk='} 2023-10-06T02:29:30.337 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412141', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:04:47.737577', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI+eWs6loppbmZWAWipjk8z8S8JkotjVclCjsg9hRbEYaaxuuKNuoqQ/fC4yOBXcb5I4YN2Ki9rolXWP+DPBhSI='} 2023-10-06T02:29:30.370 INFO:teuthology.orchestra.console.smithi037:Power off 2023-10-06T02:29:30.371 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T02:29:30.395 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-10-06T02:29:30.396 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T02:29:30.411 INFO:teuthology.orchestra.console.smithi191:Power off 2023-10-06T02:29:30.411 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T02:29:30.421 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-10-06T02:29:30.432 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-10-06T02:29:30.432 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T02:29:30.455 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-10-06T02:29:34.422 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T02:29:34.457 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T02:29:34.532 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-10-06T02:29:34.566 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-10-06T02:29:38.534 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T02:29:38.567 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T02:29:38.644 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-10-06T02:29:38.676 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-10-06T02:29:38.745 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-10-06T02:29:38.777 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-10-06T02:29:38.881 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} duration: 1065.5073177814484 failure_reason: '"1696558994.8773577 mon.a (mon.0) 135 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T02:29:38.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T02:29:38.963 INFO:teuthology.run:FAIL